Microstructure-Sensitive Deformation Modeling and Materials Design with Physics-Informed Neural Networks

Speech is a powerful means of expressing thoughts, emotions, and perspectives. However, accurately determining the emotions conveyed through speech remains a challenging task. Existing manual methods for analyzing speech to recognize emotions are prone to errors, limiting our understanding and response to individuals’ emotional states. To address diverse accents, an automated system capable of real-time emotion prediction from human speech is needed. This paper introduces a speech emotion recognition (SER) system that leverages supervised learning techniques to tackle cross-accent diversity. Distinctively, the system extracts a comprehensive set of nine speech features—Zero Crossing Rate, Mel Spectrum, Pitch, Root Mean Square values, Mel Frequency Cepstral Coefficients, chroma-stft, and three spectral features (Centroid, Contrast, and Roll-off) for refined speech signal processing and recognition. Seven machine learning models are employed, encompassing Random Forest, Logistic Regression, Decision Tree, Support Vector Machines, Gaussian Naive Bayes, K-Nearest Neighbors, ensemble learning, and four individual, hybrid deep learning models including Long short-term memory (LSTM) and 1-Dimensional Convolutional Neural Network (1D-CNN) with stratified cross-validation. Audio samples from diverse English regions are combined to train the models. The performance evaluation results of conventional machine learning and deep learning models indicate that the Random Forest-based feature selection model achieves the highest accuracy of up to 76% among the conventional machine learning models. Simultaneously, the 1D-CNN model with stratified cross-validation reaches up to 99% accuracy. The proposed framework enhances the cross-accent emotion recognition accuracy up to 86.3%, 89.87%, 90.27%, and 84.96% by margins of 14.71%, 10.15%, 9.6%, and 16.52% respectively.

Ground reaction force (GRF) estimation during gait is essential for analyzing human locomotion. Though several conventional machine learning models have been proposed for GRF estimation, their dependence on data often limits generalizability and prediction accuracy. To address these limitations, the present study explores the feasibility of Physics-Informed Neural Networks (PINNs) for GRF estimation. The developed PINN model was evaluated visually using plots and quantitatively using Root Mean Square Error (RMSE). Results indicate that applying PINN led to a significant RMSE reduction across all subjects, with improvements ranging from 67% to 89%, thereby highlighting the effectiveness of the proposed approach.

Self-induced stochastic resonance (SISR) is the emergence of coherent oscillations in slow-fast excitable systems driven solely by noise, without external periodic forcing or proximity to a bifurcation. This work presents a physics-informed machine learning framework for modeling and predicting SISR in the stochastic FitzHugh–Nagumo neuron. We embed the governing stochastic differential equations and SISR-asymptotic timescale-matching constraints directly into a Physics-Informed Neural Network (PINN) based on a Noise-Augmented State Predictor architecture. The composite loss integrates data fidelity, dynamical residuals, and barrier-based physical constraints derived from Kramers’ escape theory. The trained PINN accurately predicts the dependence of spike-train coherence on noise intensity, excitability, and timescale separation, matching results from direct stochastic simulations with substantial improvements in accuracy and generalization compared with purely data-driven methods, requiring significantly less computation. The framework provides a data-efficient and interpretable surrogate model for simulating and analyzing noise-induced coherence in multiscale stochastic systems. • A physics-informed neural network that learns stochastic dynamics directly. • Noise-Augmented State Predictor (NASP) for data-efficient multiscale modeling. • Predicts noise-driven oscillations and coherence from short trajectory data. • Shown on self-induced stochastic resonance in FitzHugh–Nagumo neuron model.

A Physics-Informed Neural Network (PINN) was developed to solve the complex Navier-Stokes (N-S) equations for multiphase flow measurement including flowrates of individual phases in the multiphase mixture, and phase ratios. The results were compared against a mathematical based multiphase flow measurement approach and validated through a controlled loop test using oil, water, and gas. The PINN embeds fundamental fluid dynamics principles into its learning process, ensuring that the neural network adheres to the governing physical laws of motion, continuity, and conservation. Unlike traditional neural networks that rely solely on data-driven learning, PINNs incorporate fluid dynamics driven differential equations, to enhance model accuracy and reliability. This study evaluates the accuracy, efficiency, and repeatability of PINNs by comparing their results against traditional mathematical-based multiphase flow measurement (MPFM) technology and controlled test cases. The developed PINN successfully solved the Navier- Stokes (N-S) equations in their closest approximation to the original form, with minimal assumptions and simplifications, to estimate multiphase flow rates, integrating fundamental fluid dynamics principles into its learning process. The results demonstrated that the PINN-based approach achieved accuracy comparable to traditional mathematical multiphase flow measurement (MPFM) technologies, while significantly improving computational efficiency. During controlled loop tests with oil, water, and gas, the PINN model consistently captured flow dynamics with high precision, validating its effectiveness under real-world conditions. Moreover, the PINN method exhibited strong generalization capabilities, adapting to various flow regimes without the need for extensive empirical calibration. Compared to conventional MPFM technologies, PINN reduced reliance on predefined correlations and offered greater adaptability to changing fluid properties. The repeatability of results confirmed the model's reliability, positioning PINNs as a promising alternative for complex multiphase flow measurement applications. These findings highlight the potential of PINNs as an innovative, physics-guided, and data-efficient solution, effectively bridging the gap between traditional physics-based methods and modern machine learning techniques. This paper presents an innovative application of Physics-Informed Neural Networks (PINNs) for multiphase flow measurement, offering a data-driven yet physics-guided alternative to traditional mathematical MPFM technologies. By embedding fundamental physical laws into the neural network training process, the proposed approach enhances accuracy, computational efficiency, and adaptability, while minimizing reliance on extensive empirical calibration. This advancement significantly improves real-time flow monitoring, equipping practicing engineers with a more reliable, data-efficient, and scalable solution for complex multiphase flow measurement in industrial applications.

3D concrete printing (3DCP) is an innovative construction method that extrudes cementitious materials layer-by-layer to fabricate building components based on a digital model. 3DCP has gained increasing adoption globally for projects like buildings, bridges, retaining walls, and stormwater management systems. However, 3DCP places stringent demands on the rheological properties of the printable cementitious materials. Rheology is critical for the flow and buildability of fresh concrete during extrusion. The mixture must have a low yield stress for pumping, moderate viscosity to hold its shape after deposition, minimal bleeding and segregation of aggregates, as well as responsive rheology that can transition from fluid to solid state as layers are printed sequentially. In this dissertation, we aim to solve the challenges mentioned above including: (1) accurate and efficient quantification of rheological and thixotropic properties of cementitious materials, (2) evaluation of flow behavior of fresh concrete during extrusion. Using traditional experimental methods to evaluate rheological properties of cement paste is labor-intensive and time-consuming. Numerical simulations like Finite Element Method (FEM) or Computational Fluid Dynamics (CFD) can help increase the speed of finding the most suitable material for 3DCP. However, these simulation methods are costly in computing power, making them less desirable for simulating the dynamic and complex process of 3DCP. Moreover, mesh-based approaches are not suitable for complex geometries as the mesh generation would be challenging with curved boundaries, small features, holes or thin regions. Physics-Informed Neural Network (PINN) is introduced in the work as an innovative solution to simulate and model the whole process of 3DCP. It can leverage the flexibility and computational efficiency of data-based neural networks, which can accelerate the learning and convergence speed. At the same time, Partial Differential Equations (PDEs) would be embedded in the network structure to increase the accuracy of its prediction. The integrated governing physical laws can help the neural network understanding the underlying physics of the 3DCP process, potentially increasing the accuracy and reliability of simulations. A significant part of the research is dedicated to understanding the rheological and thixotropic behavior of cementitious materials, which is critical for the material design in 3DCP. We developed a Rheology-informed Neural Network, RheologyNet, where we embedded the rheological constitutive laws into the loss function. These physical laws can help the network focus on simulating the rheological properties of cementitious materials. Moreover, a thixotropic evaluation system has been established based on the proposed model to evaluate the thixotropic property of cement paste. This study is presented in Chapter 2. Then, we proposed a Navier-Stokes Informed Neural Network (NSINN) to study the flow behavior of cement paste in the 3DCP barrel and nozzle since it involves complicated Multiscale or Multiphysics behaviors, such as anisotropy and non-uniform shear rate distribution. The Navier Stokes Equation and the rheological constitutive equations are coupled and embedded into the NSINN architecture to simulate the flow behavior in the barrel during 3D-printing extrusion process. This approach demonstrates the potential of PINNs to provide high-accuracy simulations of velocity and pressure fields in a computationally efficient manner compared to traditional mesh-based models. Also, we used the NSINN to learn the relationship between the nozzle size and the printing quality. The details of the study are presented in Chapter 3. At last, a multi-subnetwork PINN architecture (MultiSubPINN) is proposed to address the limitations of traditional PINNs. This is because traditional PINNs used Fully-connected Neural Network (FNN) as main bone. It has problems like different outputs must share parameters within the network structure. However, this parameter sharing nature might lead to potential errors and decrease the model performance. The main architecture of this network is consisted of multiple separated sub-networks and the loss function of each sub-network is calculated separately to update the parameters in each sub-network. By doing this, we can ensure that the optimization for one output doesn't negatively impact others, therefore providing a more flexible, scalable, and potentially more accurate alternative for the evaluation. Besides, using randomly distributed training points in the computational domain for PINNs is a common way. However, many physical problems exhibit non-uniform behavior, with certain regions of the domain having more complex dynamics or sharper gradients than others. Randomly distributed training points might not adequately capture these regions, leading to a model that misrepresents the underlying physics in critical areas. We proposed a Physical-based sampling strategy to optimize the training of the PINNs. This study is presented in Chapter 4. In summary, this dissertation has established a new platform that is enabled by interpretable NN to accurately quantify cement paste’s rheological properties and simulate the flow behavior of 3D concrete printing process. The findings suggest that PINNs can not only improve the efficiency and accuracy of simulations but also provide a more profound understanding of the material behaviors and process dynamics critical to 3DCP. The novel PINN structure developed from this dissertation is a powerful general platform that could be applicable to a variety of material domains for complex rheological behavior predictions.

Physics-informed neural networks (PINN) have recently become attractive for solving partial differential equations (PDEs) that describe physics laws. By including PDE-based loss functions, physics laws such as mass balance are enforced softly in PINN. This paper investigates how mass balance constraints are satisfied when PINN is used to solve the resulting PDEs. We investigate PINN’s ability to solve the 1D saturated groundwater flow equations (diffusion equations) for homogeneous and heterogeneous media and evaluate the local and global mass balance errors. We compare the obtained PINN’s solution and associated mass balance errors against a two-point finite volume numerical method and the corresponding analytical solution. We also evaluate the accuracy of PINN in solving the 1D saturated groundwater flow equation with and without incorporating hydraulic heads as training data. We demonstrate that PINN’s local and global mass balance errors are significant compared to the finite volume approach. Tuning the PINN’s hyperparameters, such as the number of collocation points, training data, hidden layers, nodes, epochs, and learning rate, did not improve the solution accuracy or the mass balance errors compared to the finite volume solution. Mass balance errors could considerably challenge the utility of PINN in applications where ensuring compliance with physical and mathematical properties is crucial.

Long-distance open-channel water diversion projects, such as China’s South-to-North Water Diversion Project, have significantly mitigated regional water supply-demand imbalances. However, the hydraulic behavior of open channels during water conveyance is highly complex, particularly under abnormal conditions like extreme weather or equipment failures, which can cause abrupt hydraulic changes, rapid water level rises, and even local overtopping or other safety hazards. Therefore, global, real-time, and accurate monitoring of open-channel hydraulics is essential to ensure the project's safe and efficient operation. Hydraulic characteristics of open channels are typically obtained through hydrological monitoring systems and numerical simulations. The reasonable placement and number of monitoring sections in a hydrological system are crucial for balancing monitoring accuracy and construction costs across the entire open channel. Numerical simulation accuracy and reliability depend on clear boundary conditions, precise Manning roughness coefficients, and other key parameters. However, these parameters can vary over time and are often difficult to determine in practical applications. Physics-Informed Neural Networks (PINNs) provide an effective solution to these challenges. This study develops a PINN model to predict the hydraulic characteristics of unsteady flow in open channels by integrating sparse hydrological data with physical laws. The study also examines how the number and placement of monitoring sections affect the accuracy of hydraulic predictions for the entire channel. Results demonstrate that PINNs can achieve high-precision hydraulic predictions along the channel using data from only three optimally placed monitoring sections, with average relative L2 errors below 0.5%. PINNs exhibit strong generalization across diverse boundary conditions, accurately predicting complex flow scenarios and demonstrating significantly higher noise resistance compared to traditional methods. Even with Gaussian noise levels of 10%, PINN predictions maintain relative L2 errors within 3%. Furthermore, PINNs show substantial potential for inverting key parameters such as the Manning roughness coefficient. PINNs offer an efficient and rapid approach to hydraulic predictions for long-distance water conveyance projects, aiding in the design and optimization of monitoring systems while minimizing the number of sensors, equipment, and costs.

1-D coupled surface flow and transport equations revisited via the physics-informed neural network approach

Conventional and Ensemble Machine Learning Models to Predict the Compressive Strength of Fly Ash Based Geopolymer Concrete

Error homogenization in physics-informed neural networks for modeling in manufacturing

Thermal deformation is a critical factor affecting the precision of machine tools, requiring accurate thermal modeling to predict temperature fields and thermal parameters. Traditional approaches, such as the Finite Element Method (FEM), require well-defined boundary conditions, which are often unknown or difficult to measure in real machining environments. This paper explores the use of Physics-informed neural networks (PINNs) as an alternative method for solving steady-state heat conduction problems in two dimensions. PINNs integrate sparse sensor data with physical laws, enabling temperature field prediction and convection coefficient estimation without the need for fully specified boundary conditions. We evaluate five different PINN models, varying the balance between data-driven and physics-informed constraints. Results show that enforcing the heat equation alone yields high accuracy in temperature prediction, but accurate convection coefficient estimation requires explicit enforcement of convection conditions. While PINNs successfully infer missing parameters, their sensitivity to temperature gradients can impact accuracy. Additionally, the need for retraining PINNs when conditions change limits real-time applicability, making them more suitable for offline thermal analysis rather than adaptive modeling in dynamic environments.

Performance investigation of osmotically assisted reverse osmosis using explainable machine learning models: A comparative study

Landslide is a devastating natural disaster, causing loss of life and property. It is likely to occur more frequently due to increasing urbanization, deforestation, and climate change. Landslide susceptibility mapping is vital to safeguard life and property. This article surveys machine learning (ML) models used for landslide susceptibility mapping to understand the current trend by analyzing published articles based on the ML models, landslide causative factors (LCFs), study location, datasets, evaluation methods, and model performance. Existing literature considered in this comprehensive survey is systematically selected using the ROSES protocol. The trend indicates a growing interest in the field. The choice of LCFs depends on data availability and case study location; China is the most studied location, and area under the receiver operating characteristic curve (AUC) is considered the best evaluation metric. Many ML models have achieved an AUC value > 0.90, indicating high reliability of the susceptibility map generated. This paper also discusses the recently developed hybrid, ensemble, and deep learning (DL) models in landslide susceptibility mapping. Generally, hybrid, ensemble, and DL models outperform conventional ML models. Based on the survey, a few recommendations and future works which may help the new researchers in the field are also presented.

This work proposes the inverse design of bandstop Frequency Selective Surface using a Graph based Conditional Variational Autoencoder (G-CVAE) integrated with a Physics-Informed Neural Network (PINN). This inverse design involves the prediction of FSS geometry that exhibits ultra-wide stopband characteristics. Initially, the graph convolutional network precisely extracts the topological and spatial relationships within the FSS geometrical design. The features of the graph and simulation results of the FSS dataset are used to train the CVAE, which maps the FSS physical structure and its electromagnetic behavior. The trained CVAE predicts the FSS geometries with desired frequency responses, while the PINN is incorporated to ensure physical feasibility. By monitoring the average relative error values, the simulated and predicted transmission coefficients are brought closer to each other. Also, similar approach is followed to enhance the angular stability and to achieve polarization independence in both TE and TM modes. A G-CVAE-PINN is constructed and trained using various random combinations of graph attributes and simulation outcomes, achieving an average inaccuracy of 3%. Further, one of the best designs from the predicted FSS designs is chosen for experimental validation. This predicted and experimentally validated bandstop FSS exhibits wide band rejection of 20 GHz ranging from 8 GHz to 28 GHz. The fabricated design exhibits polarization independence up to 75°in both normal and oblique angles. Thus, the predicted FSS designs are ideal for radome, EMI shielding, and satellite communications, providing efficient frequency filtering for 5G and beyond 5G networks.

Prediction of cardiovascular diseases using weight learning based on density information