skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Prediction of the SYM‐H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification
Abstract We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short‐term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short‐term forecasts of the SYM‐H index based on 1‐ and 5‐min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM‐H index value at time pointt + whours for a given time pointtwherewis 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM‐H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1‐ and 5‐min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM‐H indices (1 hr in advance) in a large storm (SYM‐H = −393 nT) using 5‐min resolution data. When predicting the SYM‐H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.  more » « less
Award ID(s):
2300341
PAR ID:
10494899
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
American Geophysical Union
Date Published:
Journal Name:
Space Weather
Volume:
22
Issue:
2
ISSN:
1542-7390
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract To assess the effect of uncertainties in solar wind driving on the predictions from the operational configuration of the Space Weather Modeling Framework, we have developed a nonparametric method for generating multiple possible realizations of the solar wind just upstream of the bow shock, based on observations near the first Lagrangian point. We have applied this method to the solar wind inputs at the upstream boundary of Space Weather Modeling Framework and have simulated the geomagnetic storm of 5 April 2010. We ran a 40‐member ensemble for this event and have used this ensemble to quantify the uncertainty in the predicted Sym‐H index and ground magnetic disturbances due to the uncertainty in the upstream boundary conditions. Both the ensemble mean and the unperturbed simulation tend to underpredict the magnitude of Sym‐H in the quiet interval before the storm and overpredict in the storm itself, consistent with previous work. The ensemble mean is a more accurate predictor of Sym‐H, improving the mean absolute error by nearly 2 nT for this interval and displaying a smaller bias. We also examine the uncertainty in predicted maxima in ground magnetic disturbances. The confidence intervals are typically narrow during periods where the predicted dBH/dtis low. The confidence intervals are often much wider where the median prediction is for enhanced dBH/dt. The ensemble also allows us to identify intervals of activity that cannot be explained by uncertainty in the solar wind driver, driving further model improvements. This work demonstrates the feasibility and importance of ensemble modeling for space weather applications. 
    more » « less
  2. Abstract The total energy transfer from the solar wind to the magnetosphere is governed by the reconnection rate at the magnetosphere edges as the Z‐component of interplanetary magnetic field (IMFBz) turns southward. The geomagnetic storm on 21–22 January 2005 is considered to be anomalous as the SYM‐H index that signifies the strength of ring current, decreases and had a sustained trough value of −101 nT lasting more than 6 hr under northward IMFBzconditions. In this work, the standard WINDMI model is utilized to estimate the growth and decay of magnetospheric currents by using several solar wind‐magnetosphere coupling functions. However, it is found that the WINDMI model driven by any of these coupling functions is not fully able to explain the decrease of SYM‐H under northward IMFBz. A dense plasma sheet along with signatures of a highly stretched magnetosphere was observed during this storm. The SYM‐H variations during the entire duration of the storm were only reproduced after modifying the WINDMI model to account for the effects of the dense plasma sheet. The limitations of directly driven models relying purely on the solar wind parameters and not accounting for the state of the magnetosphere are highlighted by this work. 
    more » « less
  3. Abstract The recent superstorm of 2024 May 10–11 is the second largest geomagnetic storm in the space age and the only one that has simultaneous interplanetary data (there were no interplanetary data for the 1989 March storm). The May superstorm was characterized by a sudden impulse (SI+) amplitude of +88 nT, followed by a three-step storm main-phase development, which had a total duration of ∼9 hr. The cause of the first storm main phase with a peak SYM-H intensity of −183 nT was a fast-forward interplanetary shock (magnetosonic Mach numberMms∼ 7.2) and an interplanetary sheath with a southward interplanetary magnetic field componentBsof ∼40 nT. The cause of the second storm's main phase with an SYM-H intensity of −354 nT was a deepening of the sheathBsto ∼43 nT. A magnetosonic wave (Mms∼ 0.6) compressed the sheath to a high magnetic field strength of ∼71 nT. IntensifiedBsof ∼48 nT were the cause of the third and most intense storm main phase, with an SYM-H intensity of −518 nT. Three magnetic cloud events withBsfields of ∼25–40 nT occurred in the storm recovery phase, lengthening the recovery to ∼2.8 days. At geosynchronous orbit, ∼76 keV to ∼1.5 MeV electrons exhibited ∼1–3 orders of magnitude flux decreases following the shock/sheath impingement onto the magnetosphere. The cosmic-ray decreases at Dome C, Antarctica (effective vertical cutoff rigidity <0.01 GV) and Oulu, Finland (rigidity ∼0.8 GV) were ∼17% and ∼11%, respectively, relative to quiet-time values. Strong ionospheric current flows resulted in extreme geomagnetically induced currents of ∼30–40 A in the subauroral region. The storm period is characterized by strong polar-region field-aligned currents, with ∼10 times intensification during the main phase and equatorward expansion down to ∼50° geomagnetic (altitude-adjusted) latitude. 
    more » « less
  4. Abstract EUropean Heliospheric FORecasting Information Asset (EUHFORIA) is a physics‐based data‐driven solar wind and coronal mass ejections (CMEs) propagation model designed for space weather forecasting and event analysis investigations. Although EUHFORIA can predict the solar wind plasma and magnetic field properties at Earth, it is not equipped to quantify the geo‐effectiveness of the solar transients in terms of geomagnetic indices like the disturbance storm time (Dst) index and the auroral indices, that quantify the impact of the magnetized plasma encounters on Earth's magnetosphere. Therefore, we couple EUHFORIA with the Open Geospace General Circulation Model (OpenGGCM), a magnetohydrodynamic model of the response of Earth's magnetosphere, ionosphere, and thermosphere to transient solar wind characteristics. In this coupling, OpenGGCM is driven by the solar wind and interplanetary magnetic field obtained from EUHFORIA simulations to produce the magnetospheric and ionospheric response to the CMEs. This coupling is validated with two observed geo‐effective CME events driven with the spheromak flux‐rope CME model. We compare these simulation results with the indices obtained from OpenGGCM simulations driven by the measured solar wind data from spacecraft. We further employ the dynamic time warping (DTW) technique to assess the model performance in predicting Dst. The main highlight of this study is to use EUHFORIA simulated time series to predict the Dst and auroral indices 1–2 days in advance, as compared to using the observed solar wind data at L1, which only provides predictions 1–2 hr before the actual impact. 
    more » « less
  5. Abstract Radiation Belt Storm Probes (RBSP) data show that seed electrons generated by sub‐storm injections play a role in amplifying chorus waves in the magnetosphere. The wave‐particle interaction leads to rapid heating and acceleration of electrons from 10's of keV to 10's of MeV energies. In this work, we examined the changes in the radiation belt during geomagnetic storm events by studying the RBSP REPT, solar wind, AL, SML, and Dst data in conjunction with the WINDMI model of the magnetosphere. The field‐aligned current output from the model is integrated to generate a proxy E index for various energy bands. These E indices track electron energization from 40 KeV to 20 MeV in the radiation belts. The indices are compared to RBSP data and GOES data. Our proxy indices correspond well to the energization data for electron energy bands between 1.8 and 7.7 MeV. Each E index has a unique empirical loss rate term (τL), an empirical time delay term (τD), and a gain value, that are fit to the observations. These empirical parameters were adjusted to examine the delay and charging rates associated with different energy bands. We observed that theτLandτDvalues are clustered for each energy band.τLandτDconsistently increase going from 1.8 to 7.7 MeV in electron energy fluxEeand the dropout interval increases with increasing energy level. The average trend of ΔτD/ΔEewas 4.1 hr/MeV and the average trend of ΔτL/ΔEewas 2.82 hr/MeV. 
    more » « less