skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 10:00 PM ET on Friday, December 8 until 2:00 AM ET on Saturday, December 9 due to maintenance. We apologize for the inconvenience.

Title: Large-eddy simulations with ClimateMachine v0.2.0: a new open-source code for atmospheric simulations on GPUs and CPUs
Abstract. We introduce ClimateMachine, a new open-source atmosphere modeling framework which uses the Julia language and is designed to be scalable on central processing units (CPUs) and graphics processing units (GPUs). ClimateMachine uses a common framework both for coarser-resolution global simulations and for high-resolution, limited-area large-eddy simulations (LESs). Here, we demonstrate the LES configuration of the atmosphere model in canonical benchmark cases and atmospheric flows using a total energy-conserving nodal discontinuous Galerkin (DG) discretization of the governing equations. Resolution dependence, conservation characteristics, and scaling metrics are examined in comparison with existing LES codes. They demonstrate the utility of ClimateMachine as a modeling tool for limited-area LES flow configurations.  more » « less
Award ID(s):
1835860 1835443
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Geoscientific Model Development
Page Range / eLocation ID:
6259 to 6284
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    The uncertainty in polar cloud feedbacks calls for process understanding of the cloud response to climate warming. As an initial step toward improved process understanding, we investigate the seasonal cycle of polar clouds in the current climate by adopting a novel modeling framework using large eddy simulations (LES), which explicitly resolve cloud dynamics. Resolved horizontal and vertical advection of heat and moisture from an idealized general circulation model (GCM) are prescribed as forcing in the LES. The LES are also forced with prescribed sea ice thickness, but surface temperature, atmospheric temperature, and moisture evolve freely without nudging. A semigray radiative transfer scheme without water vapor and cloud feedbacks allows the GCM and LES to achieve closed energy budgets more easily than would be possible with more complex schemes. This enables the mean states in the two models to be consistently compared, without the added complications from interaction with more comprehensive radiation. We show that the LES closely follow the GCM seasonal cycle, and the seasonal cycle of low‐level clouds in the LES resembles observations: maximum cloud liquid occurs in late summer and early autumn, and winter clouds are dominated by ice in the upper troposphere. Large‐scale advection of moisture provides the main source of water vapor for the liquid‐containing clouds in summer, while a temperature advection peak in winter makes the atmosphere relatively dry and reduces cloud condensate. The framework we develop and employ can be used broadly for studying cloud processes and the response of polar clouds to climate warming.

    more » « less
  2. The question of at what resolution the large eddy simulations (LESs) of a tropical cyclone (TC) high wind area may converge largely remains unanswered. To address this issue, LESs with five resolutions of 300 m, 100 m, 60 m, 33 m, and 20 m are performed in this study to simulate a high wind area near the radius of maximum wind of Typhoon Chanthu (2021) using the Weather Research and Forecasting (WRF) model. The results show that, for a limited area LES, model grid resolution may alter the local turbulence structure to generate significantly different extreme values of temperature, moisture, and winds, but it only has a marginal impact on the median values of these variables throughout the vertical column. All simulations are able to capture the turbulent roll vortices in the TC boundary layer, but the structure and intensity of the rolls vary substantially in different resolution simulations. Local hectometer-scale eddies with vertical velocities exceeding 10 m s−1 are only observed in the 20 m resolution simulation but not in the coarser resolution simulations. The ratio of the resolved turbulent momentum fluxes and turbulent kinetic energies (TKEs) to the total momentum fluxes and TKEs appears to show some convergence of LESs when the grid resolution reaches 100 m or finer, suggesting that it is an acceptable grid resolution for LES applications in TC simulations. 
    more » « less
  3. Abstract

    We revisit the longstanding problem of grid sensitivity, i.e., the lack of grid convergence in large-eddy simulations (LES) of the stable boundary layer. We use a comprehensive set of LES of the well-known Global Energy and Water Cycle Experiment Atmospheric Boundary Layer Study 1 (GABLS1) case with varying grid spacings between 12.5 m and 1 m to investigate several physical processes and numerical features that are possible causes of grid sensitivity. Our results demonstrate that there are two resolution regimes in which grid sensitivity manifests differently. We find that changing the numerical advection schemes and the subgrid-scale models alters the simulation results, but the options tested do not fully address the grid-sensitivity issue. Moreover, sensitivity runs suggest that the surface boundary condition and the interaction of the surface with the near-surface flow, as well as the mixing with the free atmosphere, are unlikely to be the causes of the observed grid sensitivity. One interesting finding is that the grid sensitivity in the fine grid-spacing regime (grid spacings$$\le 2\,\mathrm{m}$$2m) is closely related to the reduction in the energy content of large-scale turbulence, leading to less turbulence kinetic energy and hence lower boundary-layer heights. The present work demonstrates that there is still an urgent need to address this grid-sensitivity issue in order to perform reliable LES of the stable boundary layer.

    more » « less
  4. The water content in the soil regulates exchanges between soil and atmosphere, impacts plant livelihood, and determines the antecedent condition for several natural hazards. Accurate soil moisture estimates are key to applications such as natural hazard prediction, agriculture, and water management. We explore how to best predict soil moisture at a high resolution in the context of a changing climate. Physics-based hydrological models are promising as they provide distributed soil moisture estimates and allow prediction outside the range of prior observations. This is particularly important considering that the climate is changing, and the available historical records are often too short to capture extreme events. Unfortunately, these models are extremely computationally expensive, which makes their use challenging, especially when dealing with strong uncertainties. These characteristics make them complementary to machine learning approaches, which rely on training data quality/quantity but are typically computationally efficient. We first demonstrate the ability of Convolutional Neural Networks (CNNs) to reproduce soil moisture fields simulated by the hydrological model ParFlow-CLM. Then, we show how these two approaches can be successfully combined to predict future droughts not seen in the historical timeseries. We do this by generating additional ParFlow-CLM simulations with altered forcing mimicking future drought scenarios. Comparing the performance of CNN models trained on historical forcing and CNN models trained also on simulations with altered forcing reveals the potential of combining these two approaches. The CNN can not only reproduce the moisture response to a given forcing but also learn and predict the impact of altered forcing. Given the uncertainties in projected climate change, we can create a limited number of representative ParFlow-CLM simulations (ca. 25 min/water year on 9 CPUs for our case study), train our CNNs, and use them to efficiently (seconds/water-year on 1 CPU) predict additional water years/scenarios and improve our understanding of future drought potential. This framework allows users to explore scenarios beyond past observation and tailor the training data to their application of interest (e.g., wet conditions for flooding, dry conditions for drought, etc…). With the trained ML model they can rely on high resolution soil moisture estimates and explore the impact of uncertainties.

    more » « less
  5. Abstract

    Forest canopies play a critical role in affecting momentum and scalar transfer. Although there have been recent advances in numerical simulations of turbulent flows and scalar transfer across plant canopies and the atmosphere interface, few models have incorporated all important physical and physiological processes in subcanopy layers. Here we describe and evaluate an advanced multiple‐layer canopy module (MCANOPY), which is developed based largely on the Community Land Model version 4.5 and then coupled with the Weather Research and Forecasting model with large‐eddy simulations (WRF‐LES). The MCANOPY includes a suite of subcanopy processes, including radiation transfer, photosynthesis, canopy layer energy balance, momentum drag, and heat, water vapor, and CO2exchange between canopy layers and the canopy atmosphere. Numerical schemes for heat and water transport in soil, ground surface energy balance, and soil respiration are also included. Both the stand‐alone MCANOPY and the coupled system (the WRF‐LES‐MCANOPY) are evaluated against data measured in the Canopy Horizontal Array Turbulence Study field experiment. The MCANOPY performs reasonably well in reproducing vertical profiles of mean and turbulent flows as well as second‐order statistical quantities including heat and scalar fluxes within the canopy under unstable stability conditions. The coupled WRF‐LES‐MCANOPY captures major features of canopy edge flows under both neutral and unstable conditions. Limitations of the MCANOPY are discussed for our further work. Our results suggest that our model can be a promising modeling system for a variety of applications to study canopy flows and scalar transport (e.g., CO2).

    more » « less