An official website of the United States government
Abstract Physics‐based atmosphere‐land models with prescribed sea surface temperature have notable successes but also biases in their ability to represent atmospheric variability compared to observations. Recently, AI emulators and hybrid models have emerged with the potential to overcome these biases, but still require systematic evaluation against metrics grounded in fundamental atmospheric dynamics. We evaluate the representation of four atmospheric variability benchmarking metrics in a fully data‐driven AI emulator (ACE2‐ERA5) and hybrid model (NeuralGCM). The hybrid model and emulator can capture the spectra of large‐scale tropical waves and extratropical eddy‐mean flow interactions, including critical levels. However, both struggle to capture the timescales associated with quasi‐biennial oscillation (QBO, ∼28 months) and Southern annular mode propagation (∼150 days). These dynamical metrics serve as an initial benchmarking tool to inform AI model development and understand their limitations, which may be essential for out‐of‐distribution applications (e.g., extrapolating to unseen climates).
more »
« less
This content will become publicly available on May 28, 2027
Benchmarking Regional Thermodynamic Trends in an AI Emulator, ACE2, and a Hybrid Model, NeuralGCM
Abstract AI models have emerged as potential complements to physics‐based models, but their skill in capturing observed regional trends with important societal impacts remains unexplored. Here, we benchmark satellite‐era regional thermodynamic trends, including extremes, in an AI emulator (ACE2) and a hybrid model (NeuralGCM), against physics‐based models and ERA5. Both AI models capture regional temperature trends such as satellite‐era Arctic warming. ACE2 outperforms other models in capturing midlatitude vertical temperature trends. However, the AI models do not capture trends in heat extremes over the US Southwest. Furthermore, they do not capture drying trends in arid regions, but generally outperform physics‐based models. Our results show that a data‐driven AI emulator can perform comparably to, or better than, hybrid and physics‐based models in capturing regional thermodynamic trends. We also find that ACE2 learns much of the signal from .
more »
« less
- Award ID(s):
- 2531264
- PAR ID:
- 10684033
- Publisher / Repository:
- AGU
- Date Published:
- Journal Name:
- Geophysical Research Letters
- Volume:
- 53
- Issue:
- 10
- ISSN:
- 0094-8276
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Weather extremes produce major impacts on society and ecosystems and are likely to change in likelihood and magnitude with climate change. However, very low-probability events are hard to characterize statistically using observations or even climate model output because of short records/runs. For precipitation, consideration of such events arises in quantifying probable maximum precipitation (PMP), namely, estimating extreme precipitation magnitudes for designing and assessing critical infrastructure. A recent National Academies report on modernizing PMP estimation proposed using very large climate model-based ensembles to estimate extreme quantiles, possibly through machine learning–based ensemble boosting. Here, we assess statistical aspects of such an approach for the contiguous United States using a huge ensemble (10 560 years) produced by a state-of-the-art emulator (ACE2) trained on ERA5 reanalysis. The results indicate that one can practically estimate very extreme precipitation and temperature quantiles, provided one uses appropriate statistical extreme value techniques. More specifically, the results provide evidence for 1) the use of threshold-exceedance methods with a sufficiently high threshold (necessary for precipitation) for reliable estimation, 2) the robustness of results to variation in extremes by season and storm type, and 3) the sufficiency of the ensemble for well-constrained statistical uncertainty. Our results also show that the emulator produces extremes outside the range of the ERA5 training data. While encouraging for emulators’ potential use for quantifying the climatology of extremes, more investigation is needed to assess whether emulators are fit for this purpose. Our focus is on how to use huge ensembles to estimate very extreme statistics; we expect the results to be relevant for future improved emulators. Significance StatementWeather extremes produce major impacts on society and ecosystems and are likely to change in likelihood and magnitude with climate change. Machine learning now provides methods to simulate weather for many hypothetical years at much lower computational expense than traditional models. This could provide the opportunity to estimate the magnitude of very low-probability events using statistical methods applied to the simulation output, for use in planning, risk assessment, and adaptation. Our work finds that when used appropriately, statistical methods designed to analyze extremes can reliably estimate the magnitude of extremely high precipitation and temperature events in the United States, under the critical assumption that the machine learning method is a good mimic of real-world weather.more » « less
-
Abstract Historical observations of Earth’s climate underpin our knowledge and predictions of climate variability and change. However, the observations are incomplete and uncertain, and existing datasets based on these observations typically do not assimilate observations simultaneously across different components of the climate system, yielding inconsistencies that limit understanding of coupled climate dynamics. Here we use coupled data assimilation, which synthesizes observational and dynamical constraints across all climate fields simultaneously, to reconstruct globally resolved sea-surface temperature (SST), near-surface air temperature (T), sea-level pressure (SLP), and sea-ice concentration (SIC), over 1850–2023. We use a Kalman filter and forecasts from an efficient emulator (Linear Inverse Model; LIM) to assimilate observations of SST, land T, marine SLP, and satellite-era SIC. We account for model error by training LIMs on eight CMIP6 models, and we use the LIMs to generate eight independent reanalyses with 200 ensemble members, yielding 1600 total members. Key findings in the Tropics include post-1980 trends in the Walker circulation that are consistent with past variability, whereas the tropical SST contrast (the difference between warmer and colder SSTs) shows a distinct strengthening since 1975. ENSO amplitude exhibits substantial low-frequency variability and a local maximum in variance over 1875–1910. In polar regions, we find a muted cooling trend in the Southern Ocean post-1980 and substantial uncertainty. Changes in Antarctic sea ice are relatively small between 1850 and 2000, while Arctic sea ice declines by 0.5±0.1 (1σ) million km2during the 1920s.more » « less
-
Abstract Building upon recent advancements in AI‐driven atmospheric emulation, we present a novel framework for AI‐based ocean emulation, downscaling, and bias correction, with a specific focus on high‐resolution modeling of the regional ocean in the Gulf of Mexico. Emulating regional ocean dynamics poses distinct challenges due to intricate bathymetry, complex lateral boundary conditions, and inherent limitations of deep learning models, including instability and the potential for hallucinations. In this study, we introduce a deep learning framework that autoregressively integrates ocean surface variables at 8 km spatial resolution over the Gulf of Mexico, maintaining physical consistency over decadal time scales. Simultaneously, the framework downscales and bias‐corrects the outputs to 4 km resolution using a physics‐informed generative model. Our approach demonstrates short‐term predictive skill comparable to high‐resolution physics‐based simulations, while also accurately capturing long‐term statistical properties, including temporal mean and variability.more » « less
-
Abstract Reanalysis data show a significant weakening of summertime circulation in the Northern Hemisphere (NH) midlatitudes in the satellite era with implications for surface weather extremes. Recent work showed the weakening is not significantly affected by changes in the Arctic, but did not examine the role of different anthropogenic forcings such as aerosols. Here we use the Detection and Attribution Model Intercomparison Project (DAMIP) simulations to quantify the impact of anthropogenic aerosol and greenhouse gas forcing. The DAMIP simulations show aerosols and greenhouse gases contribute equally to zonal‐mean circulation weakening. Regionally, aerosol dominates the Pacific storm track weakening whereas greenhouse gas dominates in the Atlantic. Using a regional energetic framework, we show why the impact of aerosol is the largest in the Pacific. Reduced sulfate aerosol emissions over Eurasia and North America increase (clear‐sky) surface shortwave radiation and turbulent fluxes. This enhances land‐to‐ocean energy contrast and energy transport via stationary circulations to the ocean. Consequently, energy converges poleward of oceanic storm tracks, demanding weaker poleward energy transport storm tracks, and the storm tracks weaken. The impact is larger over the Pacific following the larger emission decrease over Eurasia than North America. Similar yet opposite, increased aerosol emissions over South and East Asia decrease shortwave radiation and weaken land‐to‐ocean energy transport. This diverges energy equatorward of the Pacific storm track, further weakening it. Our results show aerosols are a dominant driver of regional circulation weakening during the NH summertime in the satellite era and a regional energetic framework explaining the underlying processes.more » « less
