Abstract Physics-Informed Neural Networks (PINNs) have opened new possibilities for solving partial differential equations (PDEs) by embedding physical laws directly into the learning process. However, despite their flexibility, traditional PINNs often struggle to capture sharp gradients and intricate solution features, which limits their effectiveness in many practical problems. In this work, we have introduced Gradient-Driven Physics-Informed Neural Networks (GDPINNs) that improve the ability of traditional PINNs to resolve sharp gradients. By incorporating gradient information directly into the loss function, GDPINNs better target regions where traditional PINNs typically fail. We validated the method on steady-state and transient heat conduction problems, including a central heating source and a sinusoidal boundary condition, and found strong agreement with reference solutions. To further understand the framework's capability, we applied it to a high-gradient steady-state and transient heat conduction problem, where GDPINNs show clear advantages over traditional PINNs and align closely with reference results. We also extended GDPINNs to incompressible laminar flow in a lid-driven cavity, demonstrating its broader applicability. In these cases, GDPINNs consistently provide higher accuracy and better capture critical solution features, highlighting their potential to improve PINNs-based approaches for complex physical problems with sharp gradients.
more »
« less
Multiple scale method integrated physics-informed neural networks for reconstructing transient natural convection
This study employs physics-informed neural networks (PINNs) to reconstruct multiple flow fields in a transient natural convection system solely based on instantaneous temperature data at an arbitrary moment. Transient convection problems present reconstruction challenges due to the temporal variability of fields across different flow phases. In general, large reconstruction errors are observed during the incipient phase, while the quasi-steady phase exhibits relatively smaller errors, reduced by a factor of 2–4. We hypothesize that reconstruction errors vary across different flow phases due to the changing solution space of a PINN, inferred from the temporal gradients of the fields. Furthermore, we find that reconstruction errors tend to accumulate in regions where the spatial gradients are smaller than the order of 10−6, likely due to the vanishing gradient phenomenon. In convection phenomena, field variations often manifest across multiple scales in space. However, PINN-based reconstruction tends to preserve larger-scale variations, while smaller-scale variations become less pronounced due to the vanishing gradient problem. To mitigate the errors associated with vanishing gradients, we introduce a multi-scale approach that determines scaling constants for the PINN inputs and reformulates inputs across multiple scales. This approach improves the maximum and mean errors by 72.2% and 6.4%, respectively. Our research provides insight into the behavior of PINNs when applied to transient convection problems with large solution space and field variations across multiple scales.
more »
« less
- Award ID(s):
- 2337973
- PAR ID:
- 10586756
- Publisher / Repository:
- Physics of Fluids; AIP Publishing
- Date Published:
- Journal Name:
- Physics of Fluids
- Volume:
- 36
- Issue:
- 12
- ISSN:
- 1070-6631
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In this paper, we present a novel approach for fluid dynamic simulations by leveraging the capabilities of Physics-Informed Neural Networks (PINNs) guided by the newly unveiled Principle of Minimum Pressure Gradient (PMPG). In a PINN formulation, the physics problem is converted into a minimization problem (typically least squares). The PMPG asserts that for incompressible flows, the total magnitude of the pressure gradient over the domain must be minimum at every time instant, turning fluid mechanics into minimization problems, making it an excellent choice for PINNs formulation. Following the PMPG, the proposed PINN formulation seeks to construct a neural network for the flow field that minimizes Nature's cost function for incompressible flows in contrast to traditional PINNs that minimize the residuals of the Navier–Stokes equations. This technique eliminates the need to train a separate pressure model, thereby reducing training time and computational costs. We demonstrate the effectiveness of this approach through a case study of inviscid flow around a cylinder. The proposed approach outperforms the traditional PINNs approach in terms of training time, convergence rate, and compliance with physical metrics. While demonstrated on a simple geometry, the methodology is extensible to more complex flow fields (e.g., three-dimensional, unsteady, and viscous flows) within the incompressible realm, which is the region of applicability of the PMPG.more » « less
-
Transient dynamic analysis is crucial for power system stability, particularly with increasing renewable integration, yet traditional numerical integration methods are computation- ally expensive for large-scale online applications. We propose a novel framework integrating Physics-Informed Neural Networks (PINNs) with an AC Power Flow (AC-PF) solver to efficiently simulate dynamic trajectories in power systems in a scalable fashion. A separate PINN is trained for each generator to accurately capture the differential equations of the generator dynamic model. The trained PINNs and an AC-PF solver iteratively update the dynamic and algebraic variables to simulate dynamic trajectories for the entire system. The PINN training process consists of an unsupervised stage to enforce physical laws, followed by a supervised stage leveraging simulation data for enhanced accuracy. As the predictor training is performed separately for individual generators, the method’s computational complexity scales linearly with the number of generators in both training and testing. Experiments on a 3-generator 9-bus system demonstrate the very high accuracy of the developed method in simulating full system dynamic trajectories.more » « less
-
Physics-informed neural network (PINN) has emerged as a powerful tool to solve the challenging power system problems by incorporating the underlying physical models. This paper uses PINN for solving the differential equations governing a power system model for the Northeast Power Coordinating Council (NPCC) system as a case study. This approach adaptively transitions between the original nonlinear model, a trained PINN, and a hybrid model, which all partition the system into the study area keeping key generators in detail and the simplified external area. It utilizes a fully nonlinear model during the fault-on period, applies a hybrid model for significant rotor angle deviations, and relies on the PINN for smaller state variations. The simulation results are compared with the test cases using the original nonlinear model and using a partitioned hybrid model. PINNs provide faster and more accurate simulation results compared to conventional approaches, enabling efficient computation of dynamic states with reduced reliance on extensive training data.more » « less
-
Understanding mixing and transport of passive scalars in active fluids is important to many natural (e.g., algal blooms) and industrial (e.g., biofuel, vaccine production) processes. Here, we study the mixing of a passive scalar (dye) in dilute suspensions of swimming Escherichia coli in experiments using a two-dimensional (2D) time-periodic flow and in a simple simulation. Results show that the presence of bacteria hinders large-scale transport and reduces overall mixing rate. Stretching fields, calculated from experimentally measured velocity fields, show that bacterial activity attenuates fluid stretching and lowers flow chaoticity. Simulations suggest that this attenuation may be attributed to a transient accumulation of bacteria along regions of high stretching. Spatial power spectra and correlation functions of dye-concentration fields show that the transport of scalar variance across scales is also hindered by bacterial activity, resulting in an increase in average size and lifetime of structures. On the other hand, at small scales, activity seems to enhance local mixing. One piece of evidence is that the probability distribution of the spatial concentration gradients is nearly symmetric with a vanishing skewness. Overall, our results show that the coupling between activity and flow can lead to nontrivial effects on mixing and transport.more » « less
An official website of the United States government

