skip to main content

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Closure Learning for Nonlinear Model Reduction Using Deep Residual Neural Network
Developing accurate, efficient, and robust closure models is essential in the construction of reduced order models (ROMs) for realistic nonlinear systems, which generally require drastic ROM mode truncations. We propose a deep residual neural network (ResNet) closure learning framework for ROMs of nonlinear systems. The novel ResNet-ROM framework consists of two steps: (i) In the first step, we use ROM projection to filter the given nonlinear system and construct a spatially filtered ROM. This filtered ROM is low-dimensional, but is not closed. (ii) In the second step, we use ResNet to close the filtered ROM, i.e., to model the interaction between the resolved and unresolved ROM modes. We emphasize that in the new ResNet-ROM framework, data is used only to complement classical physical modeling (i.e., only in the closure modeling component), not to completely replace it. We also note that the new ResNet-ROM is built on general ideas of spatial filtering and deep learning and is independent of (restrictive) phenomenological arguments, e.g., of eddy viscosity type. The numerical experiments for the 1D Burgers equation show that the ResNet-ROM is significantly more accurate than the standard projection ROM. The new ResNet-ROM is also more accurate and significantly more efficient than other modern ROM closure models.  more » « less
Award ID(s):
1821145
PAR ID:
10302150
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Fluids
Volume:
5
Issue:
1
ISSN:
2311-5521
Page Range / eLocation ID:
39
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , Fluids)
    null (Ed.)
    There are two main strategies for improving the projection-based reduced order model (ROM) accuracy—(i) improving the ROM, that is, adding new terms to the standard ROM; and (ii) improving the ROM basis, that is, constructing ROM bases that yield more accurate ROMs. In this paper, we use the latter. We propose two new Lagrangian inner products that we use together with Eulerian and Lagrangian data to construct two new Lagrangian ROMs, which we denote α-ROM and λ-ROM. We show that both Lagrangian ROMs are more accurate than the standard Eulerian ROMs, that is, ROMs that use standard Eulerian inner product and data to construct the ROM basis. Specifically, for the quasi-geostrophic equations, we show that the new Lagrangian ROMs are more accurate than the standard Eulerian ROMs in approximating not only Lagrangian fields (e.g., the finite time Lyapunov exponent (FTLE)), but also Eulerian fields (e.g., the streamfunction). In particular, the α-ROM can be orders of magnitude more accurate than the standard Eulerian ROMs. We emphasize that the new Lagrangian ROMs do not employ any closure modeling to model the effect of discarded modes (which is standard procedure for low-dimensional ROMs of complex nonlinear systems). Thus, the dramatic increase in the new Lagrangian ROMs’ accuracy is entirely due to the novel Lagrangian inner products used to build the Lagrangian ROM basis. 
    more » « less
  2. ; ; ; ; ( , Fluids)
    null (Ed.)
    Reduced order models (ROMs) are computational models whose dimension is significantly lower than those obtained through classical numerical discretizations (e.g., finite element, finite difference, finite volume, or spectral methods). Thus, ROMs have been used to accelerate numerical simulations of many query problems, e.g., uncertainty quantification, control, and shape optimization. Projection-based ROMs have been particularly successful in the numerical simulation of fluid flows. In this brief survey, we summarize some recent ROM developments for the quasi-geostrophic equations (QGE) (also known as the barotropic vorticity equations), which are a simplified model for geophysical flows in which rotation plays a central role, such as wind-driven ocean circulation in mid-latitude ocean basins. Since the QGE represent a practical compromise between efficient numerical simulations of ocean flows and accurate representations of large scale ocean dynamics, these equations have often been used in the testing of new numerical methods for ocean flows. ROMs have also been tested on the QGE for various settings in order to understand their potential in efficient numerical simulations of ocean flows. In this paper, we survey the ROMs developed for the QGE in order to understand their potential in efficient numerical simulations of more complex ocean flows: We explain how classical numerical methods for the QGE are used to generate the ROM basis functions, we outline the main steps in the construction of projection-based ROMs (with a particular focus on the under-resolved regime, when the closure problem needs to be addressed), we illustrate the ROMs in the numerical simulation of the QGE for various settings, and we present several potential future research avenues in the ROM exploration of the QGE and more complex models of geophysical flows. 
    more » « less
  3. ; ; ; ( , Fluids)

    Reduced-order models (ROMs) have achieved a lot of success in reducing the computational cost of traditional numerical methods across many disciplines. In fluid dynamics, ROMs have been successful in providing efficient and relatively accurate solutions for the numerical simulation of laminar flows. For convection-dominated (e.g., turbulent) flows, however, standard ROMs generally yield inaccurate results, usually affected by spurious oscillations. Thus, ROMs are usually equipped with numerical stabilization or closure models in order to account for the effect of the discarded modes. The literature on ROM closures and stabilizations is large and growing fast. In this paper, instead of reviewing all the ROM closures and stabilizations, we took a more modest step and focused on one particular type of ROM closure and stabilization that is inspired by large eddy simulation (LES), a classical strategy in computational fluid dynamics (CFD). These ROMs, which we call LES-ROMs, are extremely easy to implement, very efficient, and accurate. Indeed, LES-ROMs are modular and generally require minimal modifications to standard (“legacy”) ROM formulations. Furthermore, the computational overhead of these modifications is minimal. Finally, carefully tuned LES-ROMs can accurately capture the average physical quantities of interest in challenging convection-dominated flows in science and engineering applications. LES-ROMs are constructed by leveraging spatial filtering, which is the same principle used to build classical LES models. This ensures a modeling consistency between LES-ROMs and the approaches that generated the data used to train them. It also “bridges” two distinct research fields (LES and ROMs) that have been disconnected until now. This paper is a review of LES-ROMs, with a particular focus on the LES concepts and models that enable the construction of LES-inspired ROMs and the bridging of LES and reduced-order modeling. This paper starts with a description of a versatile LES strategy called evolve–filter–relax (EFR) that has been successfully used as a full-order method for both incompressible and compressible convection-dominated flows. We present evidence of this success. We then show how the EFR strategy, and spatial filtering in general, can be leveraged to construct LES-ROMs (e.g., EFR-ROM). Several applications of LES-ROMs to the numerical simulation of incompressible and compressible convection-dominated flows are presented. Finally, we draw conclusions and outline several research directions and open questions in LES-ROM development. While we do not claim this review to be comprehensive, we certainly hope it serves as a brief and friendly introduction to this exciting research area, which we believe has a lot of potential in the practical numerical simulation of convection-dominated flows in science, engineering, and medicine.

     
    more » « less
  4. ; ( , Physics of Fluids)
    Reduced-order modeling (ROM) of fluid flows has been an active area of research for several decades. The huge computational cost of direct numerical simulations has motivated researchers to develop more efficient alternative methods, such as ROMs and other surrogate models. Similar to many application areas, such as computer vision and language modeling, machine learning and data-driven methods have played an important role in the development of novel models for fluid dynamics. The transformer is one of the state-of-the-art deep learning architectures that has made several breakthroughs in many application areas of artificial intelligence in recent years, including but not limited to natural language processing, image processing, and video processing. In this work, we investigate the capability of this architecture in learning the dynamics of fluid flows in a ROM framework. We use a convolutional autoencoder as a dimensionality reduction mechanism and train a transformer model to learn the system's dynamics in the encoded state space. The model shows competitive results even for turbulent datasets. 
    more » « less
  5. ( , Symposium on Thermoacoustics in Combustion: Industry meets Academia (SoTiC 2021))
    Computationally efficient modeling of gas turbine combustion is challenging due to the chaotic multi-scale physics and the complex non-linear interactions between acoustic, hydrodynamic, and chemical processes. A large-eddy simulation (LES) is conducted for the model combustor of Meier et al. (1) using an unstructured mesh finite volume method with turbulent combustion effects modeled using a flamelet-based method. The flow field is validated via comparison to averaged and unsteady high-frequency particle image velocimetry (PIV) fields. A high degree of correlation is noted with the experiment in terms of flow field snapshots and via modal analysis. The dynamics of the precessing vortex core (PVC) is quantitatively characterized using dynamic mode decomposition. The validated FOM dataset is used to construct projection-based ROMs, which aim to reduce the system dimension by projecting the state onto a reduced dimensional linear manifold. The use of a structure-preserving least squares formulation (SP-LSVT) guarantees stability of the ROM, compared to traditional model reduction techniques. The SP-LSVT ROM provides accurate reconstruction of the combustion dynamics within the training region, but faces a significant challenge in future state predictions. This limitation is mainly due to the increased projection error, which in turn is a direct consequence of the highly chaotic nature of the flow field, involving a wide range of disperse coherent structures. Formal projection-based ROMs have not been applied to a problem of this scale and complexity, and achieving accurate and efficient ROMs is a grand challenge problem. Further advances in non-linear manifold projections or adaptive basis projections have the potential to improve the predictive capability of this class of ROMs. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email