Heat Transfer Prediction With Unknown Thermal Boundary Conditions Using Physics-Informed Neural Networks

Solution of conservative-form transport equations with physics-informed neural network

In recent engineering applications using deep learning, physics-informed neural network (PINN) is a new development as it can exploit the underlying physics of engineering systems. The novelty of PINN lies in the use of partial differential equations (PDE) for the loss function. Most PINNs are implemented using automatic differentiation (AD) for training the PDE loss functions. A lesser well-known study is the use of finite difference method (FDM) as an alternative. Unlike an AD based PINN, an immediate benefit of using a FDM based PINN is low implementation cost. In this paper, we propose the use of finite difference method for estimating the PDE loss functions in PINN. Our work is inspired by computational analysis in electromagnetic systems that traditionally solve Laplace’s equation using successive over-relaxation. In the case of Laplace’s equation, our PINN approach can be seen as taking the Laplacian filter response of the neural network output as the loss function. Thus, the implementation of PINN can be very simple. In our experiments, we tested PINN on Laplace’s equation and Burger’s equation. We showed that using FDM, PINN consistently outperforms non-PINN based deep learning. When comparing to AD based PINNs, we showed that our method is faster to compute as well as on par in terms of error reduction.

A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations

CAN-PINN: A fast physics-informed neural network based on coupled-automatic–numerical differentiation method

1-D coupled surface flow and transport equations revisited via the physics-informed neural network approach

A physics-informed neural network (PINN) uses physics-augmented loss functions, e.g., incorporating the residual term from governing partial differential equations (PDEs), to ensure its output is consistent with fundamental physics laws. However, it turns out to be difficult to train an accurate PINN model for many problems in practice. In this article, we present a novel perspective of the merits of learning in sinusoidal spaces with PINNs. By analyzing behavior at model initialization, we first show that a PINN of increasing expressiveness induces an initial bias around <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">flat output functions</i> . Notably, this initial solution can be very close to satisfying many physics PDEs, i.e., falling into a local minimum of the PINN loss that only minimizes PDE residuals, while still being far from the true solution that jointly minimizes PDE residuals and the initial and/or boundary conditions. It is difficult for gradient descent optimization to escape from such a local minimum trap, often causing the training to stall. We then prove that the sinusoidal mapping of inputs—in an architecture we label as <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">sf</i> -PINN—is effective to increase input gradient variability, thus avoiding being trapped in such deceptive local minimum. The level of variability can be effectively modulated to match high-frequency patterns in the problem at hand. A key facet of this article is the comprehensive empirical study that demonstrates the efficacy of learning in sinusoidal spaces with PINNs for a wide range of forward and inverse modeling problems spanning multiple physics domains.

Physics-informed neural networks for mesh deformation with exact boundary enforcement

Convective heat transfer in the flow of viscous Ag–water and Cu–water nanofluids over a stretching surface

Long-distance open-channel water diversion projects, such as China&amp;#8217;s South-to-North Water Diversion Project, have significantly mitigated regional water supply-demand imbalances. However, the hydraulic behavior of open channels during water conveyance is highly complex, particularly under abnormal conditions like extreme weather or equipment failures, which can cause abrupt hydraulic changes, rapid water level rises, and even local overtopping or other safety hazards. Therefore, global, real-time, and accurate monitoring of open-channel hydraulics is essential to ensure the project's safe and efficient operation. Hydraulic characteristics of open channels are typically obtained through hydrological monitoring systems and numerical simulations. The reasonable placement and number of monitoring sections in a hydrological system are crucial for balancing monitoring accuracy and construction costs across the entire open channel. Numerical simulation accuracy and reliability depend on clear boundary conditions, precise Manning roughness coefficients, and other key parameters. However, these parameters can vary over time and are often difficult to determine in practical applications. Physics-Informed Neural Networks (PINNs) provide an effective solution to these challenges. This study develops a PINN model to predict the hydraulic characteristics of unsteady flow in open channels by integrating sparse hydrological data with physical laws. The study also examines how the number and placement of monitoring sections affect the accuracy of hydraulic predictions for the entire channel. Results demonstrate that PINNs can achieve high-precision hydraulic predictions along the channel using data from only three optimally placed monitoring sections, with average relative L2 errors below 0.5%. PINNs exhibit strong generalization across diverse boundary conditions, accurately predicting complex flow scenarios and demonstrating significantly higher noise resistance compared to traditional methods. Even with Gaussian noise levels of 10%, PINN predictions maintain relative L2 errors within 3%. Furthermore, PINNs show substantial potential for inverting key parameters such as the Manning roughness coefficient. PINNs offer an efficient and rapid approach to hydraulic predictions for long-distance water conveyance projects, aiding in the design and optimization of monitoring systems while minimizing the number of sensors, equipment, and costs.

Transfer learning enhanced physics informed neural network for phase-field modeling of fracture

In this paper, we propose an extrinsic approach based on physics-informed neural networks (PINNs) for solving the partial differential equations (PDEs) on surfaces embedded in high dimensional space. PINNs are one of the deep learning-based techniques. Based on the training data and physical models, PINNs introduce the standard feedforward neural networks (NNs) to approximate the solutions to the PDE systems. Using automatic differentiation, the PDEs information could be encoded into NNs and a loss function. To deal with the surface differential operators in the loss function, we combine the extrinsic approach with PINNs and then express that loss function in extrinsic form. Subsequently, the loss function could be minimized extrinsically with respect to the NN parameters. Numerical results demonstrate that the extrinsic approach based on PINNs for surface problems has good accuracy and higher efficiency compared with the embedding approach based on PINNs. In addition, the strong nonlinear mapping ability of NNs makes this approach robust in solving time-dependent nonlinear problems on more complex surfaces.

This study works on how to simulate a flow field in a data-driven manner using a deep learning method called Physics-Informed Neural Networks (PINNs). This method trains a neural network, which inputs time and space and outputs the corresponding flow quantities by satisfying the Navier-Stokes equations, boundary conditions, and initial conditions. Then it can quickly reproduce a flow field in any time and space. The application of PINNs to engineering problems is an area for further investigation since PINNs need to be re-trained whenever the boundary conditions change, i.e., the training cost should be as low as possible. Hence, this study considers how to reduce the training cost of PINNs for an airfoil by adaptively arranging the collocation points. At present, this paper examines PINNs for a laminar flat plate as a preliminary step. The results show that, for qualitatively accurate PINNs, it is influential to consider the stagnation pressure at the leading edge of the plate as a constraint in the PINNs loss function.

Thermal deformation is a critical factor affecting the precision of machine tools, requiring accurate thermal modeling to predict temperature fields and thermal parameters. Traditional approaches, such as the Finite Element Method (FEM), require well-defined boundary conditions, which are often unknown or difficult to measure in real machining environments. This paper explores the use of Physics-informed neural networks (PINNs) as an alternative method for solving steady-state heat conduction problems in two dimensions. PINNs integrate sparse sensor data with physical laws, enabling temperature field prediction and convection coefficient estimation without the need for fully specified boundary conditions. We evaluate five different PINN models, varying the balance between data-driven and physics-informed constraints. Results show that enforcing the heat equation alone yields high accuracy in temperature prediction, but accurate convection coefficient estimation requires explicit enforcement of convection conditions. While PINNs successfully infer missing parameters, their sensitivity to temperature gradients can impact accuracy. Additionally, the need for retraining PINNs when conditions change limits real-time applicability, making them more suitable for offline thermal analysis rather than adaptive modeling in dynamic environments.

Entropy generation rate in a flow channel is associated with a number of parameters including the geometry of the channel, the thermal boundary conditions, and the thermo-physical properties of the fluid. Accurate determination of the overall rate of entropy generation in a duct may take considerable computational time, especially when two- or three-dimensional modeling is required as a result of geometry and complex relationship between the convection heat transfer and fluid flow parameters involved. In this paper, a simple yet accurate method of estimation for the total rate of entropy generation in a duct is presented. Consequently, a representative temperature, the “Log Mean Temperature”, at which the convection heat transfer and fluid flow properties are evaluated for the determination of total rate of entropy generation, is introduced. It is shown that the approximate Log Mean Temperature method provides considerably accurate values of total rate of entropy generation in a duct for both uniform wall heat flux and uniform wall temperature boundary conditions. Water and glycerol (highly viscous fluid at around room temperature) are used to assess the accuracy of the approximate Log Mean Temperature method. The assessment is done within the coverage of laminar flow (Re < 3,000) and single phase fluid (i.e., no phase change). It is shown that the error in using the approximate Log Mean Temperature method in evaluating the total rate of entropy generation in a duct stays within less than 1 % for the entire practical range of Re numbers and temperature changes considered.

The eikonal equation plays an important role across multidisciplinary branches of science and engineering. In geophysics, the eikonal equation, and its characteristics, are used in addressing two fundamental questions pertaining to seismic waves: what paths do the seismic waves take (its spreading)? and how long do they take? There have been numerous attempts to solve the eikonal equation, which can be broadly categorized as finite-difference and physics informed neural network (PINN) based approaches. While the former has been developed and optimized over the years, it still inherits some numerical inaccuracies and also the cost scales exponentially with the velocity model size. More importantly, it requires upwind calculations to satisfy the viscosity solution. PINNs, on the other hand, have shown great promise due to several features allowing for higher accuracy and scalability than conventional approaches. In this paper, we demonstrate another unique feature of PINN solutions, specifically its flexibility resulting from the global nature of its NN functional optimization, allowing for functional gradients referred to as automatic differentiation. This feature allows us to overcome the inability of conventional methods to handle large areas of missing information (gap) in the velocity model. We find empirically that the PINNs interpolation-extrapolation inherent capability enables us to circumvent a scenario when traveltime modelling is performed on velocity models containing gaps. Such a capability is crucial when performing traveltime modelling using the global tomographic Earth velocity model.