Abstract In large‐eddy simulations, subgrid‐scale (SGS) processes are parameterized as a function of filtered grid‐scale variables. First‐order, algebraic SGS models are based on the eddy‐viscosity assumption, which does not always hold for turbulence. Here we apply supervised deep neural networks (DNNs) to learn SGS stresses from a set of neighboring coarse‐grained velocity from direct numerical simulations of the convective boundary layer at friction Reynolds numbersReτup to 1243 without invoking the eddy‐viscosity assumption. The DNN model was found to produce higher correlation between SGS stresses compared to the Smagorinsky model and the Smagorinsky‐Bardina mixed model in the surface and mixed layers and can be applied to different grid resolutions and various stability conditions ranging from near neutral to very unstable. The DNN model can capture key statistics of turbulence ina posteriori(online) tests when applied to large‐eddy simulations of the atmospheric boundary layer.
more »
« less
Learning Closed‐Form Equations for Subgrid‐Scale Closures From High‐Fidelity Data: Promises and Challenges
Abstract There is growing interest in discovering interpretable, closed‐form equations for subgrid‐scale (SGS) closures/parameterizations of complex processes in Earth systems. Here, we apply a common equation‐discovery technique with expansive libraries to learn closures from filtered direct numerical simulations of 2D turbulence and Rayleigh‐Bénard convection (RBC). Across common filters (e.g., Gaussian, box), we robustly discover closures of the same form for momentum and heat fluxes. These closures depend on nonlinear combinations of gradients of filtered variables, with constants that are independent of the fluid/flow properties and only depend on filter type/size. We show that these closures are the nonlinear gradient model (NGM), which is derivable analytically using Taylor‐series. Indeed, we suggest that with common (physics‐free) equation‐discovery algorithms, for many common systems/physics, discovered closures are consistent with the leading term of the Taylor‐series (except when cutoff filters are used). Like previous studies, we find that large‐eddy simulations with NGM closures are unstable, despite significant similarities between the true and NGM‐predicted fluxes (correlations >0.95). We identify two shortcomings as reasons for these instabilities: in 2D, NGM produces zero kinetic energy transfer between resolved and subgrid scales, lacking both diffusion and backscattering. In RBC, potential energy backscattering is poorly predicted. Moreover, we show that SGS fluxes diagnosed from data, presumed the “truth” for discovery, depend on filtering procedures and are not unique. Accordingly, to learn accurate, stable closures in future work, we propose several ideas around using physics‐informed libraries, loss functions, and metrics. These findings are relevant to closure modeling of any multi‐scale system.
more »
« less
- Award ID(s):
- 2005123
- PAR ID:
- 10520649
- Publisher / Repository:
- DOI PREFIX: 10.1029
- Date Published:
- Journal Name:
- Journal of Advances in Modeling Earth Systems
- Volume:
- 16
- Issue:
- 7
- ISSN:
- 1942-2466
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Extensive experimental evidence highlights that scalar turbulence exhibits anomalous diffusion and stronger intermittency levels at small scales compared to that in fluid turbulence. This renders the corresponding subgrid-scale dynamics modeling for scalar turbulence a greater challenge to date. We develop a new large eddy simulation (LES) paradigm for efficiently and dynamically nonlocal LES modeling of the scalar turbulence. To this end, we formulate the underlying nonlocal model starting from the filtered Boltzmann kinetic transport equation, where the divergence of subgrid-scale scalar fluxes emerges as a fractional-order Laplacian term in the filtered advection–diffusion model, coding the corresponding superdiffusive nature of scalar turbulence. Subsequently, we develop a robust data-driven algorithm for estimation of the fractional (noninteger) Laplacian exponent, where we, on the fly, calculate the corresponding model coefficient employing a new dynamic procedure. Our a priori tests show that our new dynamically nonlocal LES paradigm provides better agreement with the ground-truth filtered direct numerical simulation data in comparison to the conventional static and dynamic Prandtl–Smagorinsky models. Moreover, in order to analyze the numerical stability and assessing the model's performance, we carry out comprehensive a posteriori tests. They unanimously illustrate that our new model considerably outperforms other existing functional models, correctly predicting the backscattering phenomena and, at the same time, providing higher correlations at small-to-large filter sizes. We conclude that our proposed nonlocal subgrid-scale model for scalar turbulence is amenable for coarse LES and very large eddy simulation frameworks even with strong anisotropies, applicable to environmental applications.more » « less
-
Ocean mesoscale eddies are often poorly represented in climate models, and therefore, their effects on the large scale circulation must be parameterized. Traditional parameterizations, which represent the bulk effect of the unresolved eddies, can be improved with new subgrid models learned directly from data. Zanna and Bolton (ZB20) applied an equation‐discovery algorithm to reveal an interpretable expression parameterizing the subgrid momentum fluxes by mesoscale eddies through the components of the velocity‐gradient tensor. In this work, we implement the ZB20 parameterization into the primitive‐equation GFDL MOM6 ocean model and test it in two idealized configurations with significantly different dynamical regimes and topography. The original parameterization was found to generate excessive numerical noise near the grid scale. We propose two filtering approaches to avoid the numerical issues and additionally enhance the strength of large‐scale energy backscatter. The filtered ZB20 parameterizations led to improved climatological mean state and energy distributions, compared to the current state‐of‐the‐art energy backscatter parameterizations. The filtered ZB20 parameterizations are scale‐aware and, consequently, can be used with a single value of the non‐dimensional scaling coefficient for a range of resolutions. The successful application of the filtered ZB20 parameterizations to parameterize mesoscale eddies in two idealized configurations offers a promising opportunity to reduce long‐standing biases in global ocean simulations in future studies.more » « less
-
Yortsos, Yannis (Ed.)Abstract Transfer learning (TL), which enables neural networks (NNs) to generalize out-of-distribution via targeted re-training, is becoming a powerful tool in scientific machine learning (ML) applications such as weather/climate prediction and turbulence modeling. Effective TL requires knowing (1) how to re-train NNs? and (2) what physics are learned during TL? Here, we present novel analyses and a framework addressing (1)–(2) for a broad range of multi-scale, nonlinear, dynamical systems. Our approach combines spectral (e.g. Fourier) analyses of such systems with spectral analyses of convolutional NNs, revealing physical connections between the systems and what the NN learns (a combination of low-, high-, band-pass filters and Gabor filters). Integrating these analyses, we introduce a general framework that identifies the best re-training procedure for a given problem based on physics and NN theory. As test case, we explain the physics of TL in subgrid-scale modeling of several setups of 2D turbulence. Furthermore, these analyses show that in these cases, the shallowest convolution layers are the best to re-train, which is consistent with our physics-guided framework but is against the common wisdom guiding TL in the ML literature. Our work provides a new avenue for optimal and explainable TL, and a step toward fully explainable NNs, for wide-ranging applications in science and engineering, such as climate change modeling.more » « less
-
In this work, we develop numerical methods to solve forward and inverse wave problems for a nonlinear Helmholtz equation defined in a spherical shell between two concentric spheres centred at the origin. A spectral method is developed to solve the forward problem while a combination of a finite difference approximation and the least squares method are derived for the inverse problem. Numerical examples are given to verify the method. ReferencesR. Askey. Orthogonal polynomials and special functions. CBMS-NSF Regional Conference Series in Applied Mathematics. SIAM, 1975. doi: 10.1137/1.9781611970470G. Baruch, G. Fibich, and S. Tsynkov. High-order numerical method for the nonlinear Helmholtz equation with material discontinuities in one space dimension. Nonlinear Photonics. Optica Publishing Group, 2007. doi: 10.1364/np.2007.ntha6G. Fibich and S. Tsynkov. High-Order Two-Way Artificial Boundary Conditions for Nonlinear Wave Propagation with Backscattering. J. Comput. Phys. 171 (2001), pp. 632–677. doi: 10.1006/jcph.2001.6800G. Fibich and S. Tsynkov. Numerical solution of the nonlinear Helmholtz equation using nonorthogonal expansions. J. Comput. Phys. 210 (2005), pp. 183–224. doi: 10.1016/j.jcp.2005.04.015P. M. Morse and K. U. Ingard. Theoretical Acoustics. International Series in Pure and Applied Physics. McGraw-Hill Book Company, 1968G. N. Watson. A treatise on the theory of Bessel functions. International Series in Pure and Applied Physics. Cambridge Mathematical Library, 1996. url: https://www.cambridge.org/au/universitypress/subjects/mathematics/real-and-complex-analysis/treatise-theory-bessel-functions-2nd-edition-1?format=PB&isbn=9780521483919more » « less
An official website of the United States government
