skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Science Through Machine Learning: Quantification of Post‐Storm Thermospheric Cooling
Abstract Machine learning (ML) models are universal function approximators and—if used correctly—can summarize the information content of observational data sets in a functional form for scientific and engineering applications. A benefit to ML over parametric models is that there are no a priori assumptions about particular basis functions which can potentially limit the phenomena that can be modeled. In this work, we develop ML models on three data sets: the Space Environment Technologies High Accuracy Satellite Drag Model (HASDM) density database, a spatiotemporally matched data set of outputs from the Jacchia‐Bowman 2008 Empirical Thermospheric Density Model (JB2008), and an accelerometer‐derived density data set from CHAllenging Minisatellite Payload (CHAMP). These ML models are compared to the Naval Research Laboratory Mass Spectrometer and Incoherent Scatter radar (NRLMSIS 2.0) model to study the presence of post‐storm cooling in the middle‐thermosphere. We find that both NRLMSIS 2.0 and JB2008‐ML do not account for post‐storm cooling and consequently perform poorly in periods following strong geomagnetic storms (e.g., the 2003 Halloween storms). Conversely, HASDM‐ML and CHAMP‐ML do show evidence of post‐storm cooling indicating that this phenomenon is present in the original data sets. Results show that density reductions up to 40% can occur 1–3 days post‐storm depending on the location and strength of the storm.  more » « less
Award ID(s):
2149747 2140204
PAR ID:
10372655
Author(s) / Creator(s):
 ;  ;  ;  ;  ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Space Weather
Volume:
20
Issue:
9
ISSN:
1542-7390
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The Mass Spectrometer and Incoherent Scatter radar (MSIS) model family has been developed and improved since the early 1970's. The most recent version of MSIS is the Naval Research Laboratory (NRL) MSIS 2.0 empirical atmospheric model. NRLMSIS 2.0 provides species density, mass density, and temperature estimates as function of location and space weather conditions. MSIS models have long been a popular choice of thermosphere model in the research and operations community alike, but—like many models—does not provide uncertainty estimates. In this work, we develop an exospheric temperature model based in machine learning that can be used with NRLMSIS 2.0 to calibrate it relative to high‐fidelity satellite density estimates directly through the exospheric temperature parameter. Instead of providing point estimates, our model (called MSIS‐UQ) outputs a distribution which is assessed using a metric called the calibration error score. We show that MSIS‐UQ debiases NRLMSIS 2.0 resulting in reduced differences between model and satellite density of 25% and is 11% closer to satellite density than the Space Force's High Accuracy Satellite Drag Model. We also show the model's uncertainty estimation capabilities by generating altitude profiles for species density, mass density, and temperature. This explicitly demonstrates how exospheric temperature probabilities affect density and temperature profiles within NRLMSIS 2.0. Another study displays improved post‐storm overcooling capabilities relative to NRLMSIS 2.0 alone, enhancing the phenomena that it can capture. 
    more » « less
  2. Abstract The Starlink satellites launched on 3 February 2022 were lost before they fully arrived in their designated orbits. The loss was attributed to two moderate geomagnetic storms that occurred consecutively on 3–4 February. We investigate the thermospheric neutral mass density variation during these storms with the Multiscale Atmosphere‐Geospace Environment (MAGE) model, a first‐principles, fully coupled geospace model. Simulated neutral density enhancements are validated by Swarm satellite measurements at the altitude of 400–500 km. Comparison with standalone TIEGCM and empirical NRLMSIS 2.0 and DTM‐2013 models suggests better performance by MAGE in predicting the maximum density enhancement and resolving the gradual recovery process. Along the Starlink satellite orbit in the middle thermosphere (∼200 km altitude), MAGE predicts up to 150% density enhancement near the second storm peak while standalone TIEGCM, NRLMSIS 2.0, and DTM‐2013 suggest only ∼50% increase. MAGE also suggests altitudinal, longitudinal, and latitudinal variability of storm‐time percentage density enhancement due to height dependent Joule heating deposition per unit mass, thermospheric circulation changes, and traveling atmospheric disturbances. This study demonstrates that a moderate storm can cause substantial density enhancement in the middle thermosphere. Thermospheric mass density strongly depends on the strength, timing, and location of high‐latitude energy input, which cannot be fully reproduced with empirical models. A physics‐based, fully coupled geospace model that can accurately resolve the high‐latitude energy input and its variability is critical to modeling the dynamic response of thermospheric neutral density during storm time. 
    more » « less
  3. null (Ed.)
    The specification and prediction of density fluctuations in the thermosphere, especially during geomagnetic storms, is a key challenge for space weather observations and modeling. It is of great operational importance for tracking objects orbiting in near-Earth space. For low-Earth orbit, variations in neutral density represent the most important uncertainty for propagation and prediction of satellite orbits. An international conference in 2018 conducted under the auspices of the NASA Community Coordinated Modeling Center (CCMC) included a workshop on neutral density modeling, using both empirical and numerical methods, and resulted in the organization of an initial effort of model comparison and evaluation. Here, we present an updated metric for model assessment under geomagnetic storm conditions by dividing a storm in four phases with respect to the time of minimum Dst and then calculating the mean density ratios and standard deviations and correlations. Comparisons between three empirical (NRLMSISE-00, JB2008 and DTM2013) and two first-principles models (TIE-GCM and CTIPe) and neutral density data sets that include measurements by the CHAMP, GRACE, and GOCE satellites for 13 storms are presented. The models all show reduced performance during storms, notably much increased standard deviations, but DTM2013, JB2008 and CTIPe did not on average reveal a significant bias in the four phases of our metric. DTM2013 and TIE-GCM driven with the Weimer model achieved the best results taking the entire storm event into account, while NRLMSISE-00 systematically and significantly underestimates the storm densities. Numerical models are still catching up to empirical methods on a statistical basis, but as their drivers become more accurate and they become available at higher resolutions, they will surpass them in the foreseeable future. 
    more » « less
  4. Abstract We present results from a study of the time lags between changes in the energy flow into the polar regions and the response of the thermosphere to the heating. Measurements of the neutral density from the Challenging Mini‐satellite Payload (CHAMP) and Gravity Recovery and Climate Experiment (GRACE) missions are used, along with calculations of the total Poynting flux entering the poles. During two major geomagnetic storms in 2003, these data show increased densities are first seen on the dayside edge of the auroral ovals after a surge in the energy input. At lower latitudes, the densities reach their peak values on the dayside earlier than on the night side. A puzzling response seen in the CHAMP measurements during the November 2003 storm was that the density at a fixed location near the “Harang discontinuity” remained at unusually low levels during three sequential orbit passes, while elsewhere the density increased. The entire database of measurements from the CHAMP and GRACE missions were used to derive maps of the density time lags across the globe. The maps show a large gradient between short and long time delays between 60° and 30° geographic latitude. They confirm the findings from the two storm periods, that near the equator, the density on the dayside responds earlier than on the nightside. The time lags are longest near 18–20 hr local time. The time lag maps could be applied to improve the accuracy of empirical thermosphere models, and developers of numerical models may find these results useful for comparisons with their calculations. 
    more » « less
  5. Abstract NRLMSIS® 2.0 is an empirical atmospheric model that extends from the ground to the exobase and describes the average observed behavior of temperature, eight species densities, and mass density via a parametric analytic formulation. The model inputs are location, day of year, time of day, solar activity, and geomagnetic activity. NRLMSIS 2.0 is a major, reformulated upgrade of the previous version, NRLMSISE‐00. The model now couples thermospheric species densities to the entire column, via an effective mass profile that transitions each species from the fully mixed region below ~70 km altitude to the diffusively separated region above ~200 km. Other changes include the extension of atomic oxygen down to 50 km and the use of geopotential height as the internal vertical coordinate. We assimilated extensive new lower and middle atmosphere temperature, O, and H data, along with global average thermospheric mass density derived from satellite orbits, and we validated the model against independent samples of these data. In the mesosphere and below, residual biases and standard deviations are considerably lower than NRLMSISE‐00. The new model is warmer in the upper troposphere and cooler in the stratosphere and mesosphere. In the thermosphere, N2and O densities are lower in NRLMSIS 2.0; otherwise, the NRLMSISE‐00 thermosphere is largely retained. Future advances in thermospheric specification will likely require new in situ mass spectrometer measurements, new techniques for species density measurement between 100 and 200 km, and the reconciliation of systematic biases among thermospheric temperature and composition data sets, including biases attributable to long‐term changes. 
    more » « less