skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Prediction of the SYM‐H Index Using a Bayesian Deep Learning Method With Uncertainty Quantification
Abstract We propose a novel deep learning framework, named SYMHnet, which employs a graph neural network and a bidirectional long short‐term memory network to cooperatively learn patterns from solar wind and interplanetary magnetic field parameters for short‐term forecasts of the SYM‐H index based on 1‐ and 5‐min resolution data. SYMHnet takes, as input, the time series of the parameters' values provided by NASA's Space Science Data Coordinated Archive and predicts, as output, the SYM‐H index value at time pointt + whours for a given time pointtwherewis 1 or 2. By incorporating Bayesian inference into the learning framework, SYMHnet can quantify both aleatoric (data) uncertainty and epistemic (model) uncertainty when predicting future SYM‐H indices. Experimental results show that SYMHnet works well at quiet time and storm time, for both 1‐ and 5‐min resolution data. The results also show that SYMHnet generally performs better than related machine learning methods. For example, SYMHnet achieves a forecast skill score (FSS) of 0.343 compared to the FSS of 0.074 of a recent gradient boosting machine (GBM) method when predicting SYM‐H indices (1 hr in advance) in a large storm (SYM‐H = −393 nT) using 5‐min resolution data. When predicting the SYM‐H indices (2 hr in advance) in the large storm, SYMHnet achieves an FSS of 0.553 compared to the FSS of 0.087 of the GBM method. In addition, SYMHnet can provide results for both data and model uncertainty quantification, whereas the related methods cannot.  more » « less
Award ID(s):
2300341
PAR ID:
10494899
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
American Geophysical Union
Date Published:
Journal Name:
Space Weather
Volume:
22
Issue:
2
ISSN:
1542-7390
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract To assess the effect of uncertainties in solar wind driving on the predictions from the operational configuration of the Space Weather Modeling Framework, we have developed a nonparametric method for generating multiple possible realizations of the solar wind just upstream of the bow shock, based on observations near the first Lagrangian point. We have applied this method to the solar wind inputs at the upstream boundary of Space Weather Modeling Framework and have simulated the geomagnetic storm of 5 April 2010. We ran a 40‐member ensemble for this event and have used this ensemble to quantify the uncertainty in the predicted Sym‐H index and ground magnetic disturbances due to the uncertainty in the upstream boundary conditions. Both the ensemble mean and the unperturbed simulation tend to underpredict the magnitude of Sym‐H in the quiet interval before the storm and overpredict in the storm itself, consistent with previous work. The ensemble mean is a more accurate predictor of Sym‐H, improving the mean absolute error by nearly 2 nT for this interval and displaying a smaller bias. We also examine the uncertainty in predicted maxima in ground magnetic disturbances. The confidence intervals are typically narrow during periods where the predicted dBH/dtis low. The confidence intervals are often much wider where the median prediction is for enhanced dBH/dt. The ensemble also allows us to identify intervals of activity that cannot be explained by uncertainty in the solar wind driver, driving further model improvements. This work demonstrates the feasibility and importance of ensemble modeling for space weather applications. 
    more » « less
  2. Abstract Rapid changes of magnetic fields associated with nighttime magnetic perturbation events (MPEs) with amplitudes |ΔB| of hundreds of nT and 5–10 min duration can induce geomagnetically induced currents (GICs) that can harm technological systems. Here we present superposed epoch analyses of large nighttime MPEs (|dB/dt| ≥ 6 nT/s) observed during 2015 and 2017 at five stations in Arctic Canada ranging from 64.7° to 75.2° in corrected geomagnetic latitude (MLAT) as functions of the interplanetary magnetic field (IMF), solar wind dynamic pressure, density, and velocity, and the SML, SMU, and SYM/H geomagnetic activity indices. Analyses were produced for premidnight and postmidnight events and for three ranges of time after the most recent substorm onset: (a) 0–30 min, (b) 30–60 min, and (c) >60 min. Of the solar wind and IMF parameters studied, only the IMF Bz component showed any consistent temporal variations prior to MPEs: a 1–2 h wide 1–3 nT negative minimum at all stations beginning ∼30–80 min before premidnight MPEs, and minima that were less consistent but often deeper before postmidnight MPEs. Median, 25th, and 75th percentile SuperMAG auroral indices SML (SMU) showed drops (rises) before pre‐ and post‐midnight type A MPEs, but most of the MPEs in categories B and C did not coincide with large‐scale peaks in ionospheric electrojets. Median SYM/H indices were flat near −30 nT for premidnight events and showed no consistent temporal association with any MPE events. More disturbed values of IMF Bz, Psw, Nsw, SML, SMU, and SYM/H appeared postmidnight than premidnight. 
    more » « less
  3. Abstract The total energy transfer from the solar wind to the magnetosphere is governed by the reconnection rate at the magnetosphere edges as the Z‐component of interplanetary magnetic field (IMFBz) turns southward. The geomagnetic storm on 21–22 January 2005 is considered to be anomalous as the SYM‐H index that signifies the strength of ring current, decreases and had a sustained trough value of −101 nT lasting more than 6 hr under northward IMFBzconditions. In this work, the standard WINDMI model is utilized to estimate the growth and decay of magnetospheric currents by using several solar wind‐magnetosphere coupling functions. However, it is found that the WINDMI model driven by any of these coupling functions is not fully able to explain the decrease of SYM‐H under northward IMFBz. A dense plasma sheet along with signatures of a highly stretched magnetosphere was observed during this storm. The SYM‐H variations during the entire duration of the storm were only reproduced after modifying the WINDMI model to account for the effects of the dense plasma sheet. The limitations of directly driven models relying purely on the solar wind parameters and not accounting for the state of the magnetosphere are highlighted by this work. 
    more » « less
  4. Abstract The recent superstorm of 2024 May 10–11 is the second largest geomagnetic storm in the space age and the only one that has simultaneous interplanetary data (there were no interplanetary data for the 1989 March storm). The May superstorm was characterized by a sudden impulse (SI+) amplitude of +88 nT, followed by a three-step storm main-phase development, which had a total duration of ∼9 hr. The cause of the first storm main phase with a peak SYM-H intensity of −183 nT was a fast-forward interplanetary shock (magnetosonic Mach numberMms∼ 7.2) and an interplanetary sheath with a southward interplanetary magnetic field componentBsof ∼40 nT. The cause of the second storm's main phase with an SYM-H intensity of −354 nT was a deepening of the sheathBsto ∼43 nT. A magnetosonic wave (Mms∼ 0.6) compressed the sheath to a high magnetic field strength of ∼71 nT. IntensifiedBsof ∼48 nT were the cause of the third and most intense storm main phase, with an SYM-H intensity of −518 nT. Three magnetic cloud events withBsfields of ∼25–40 nT occurred in the storm recovery phase, lengthening the recovery to ∼2.8 days. At geosynchronous orbit, ∼76 keV to ∼1.5 MeV electrons exhibited ∼1–3 orders of magnitude flux decreases following the shock/sheath impingement onto the magnetosphere. The cosmic-ray decreases at Dome C, Antarctica (effective vertical cutoff rigidity <0.01 GV) and Oulu, Finland (rigidity ∼0.8 GV) were ∼17% and ∼11%, respectively, relative to quiet-time values. Strong ionospheric current flows resulted in extreme geomagnetically induced currents of ∼30–40 A in the subauroral region. The storm period is characterized by strong polar-region field-aligned currents, with ∼10 times intensification during the main phase and equatorward expansion down to ∼50° geomagnetic (altitude-adjusted) latitude. 
    more » « less
  5. Abstract EUropean Heliospheric FORecasting Information Asset (EUHFORIA) is a physics‐based data‐driven solar wind and coronal mass ejections (CMEs) propagation model designed for space weather forecasting and event analysis investigations. Although EUHFORIA can predict the solar wind plasma and magnetic field properties at Earth, it is not equipped to quantify the geo‐effectiveness of the solar transients in terms of geomagnetic indices like the disturbance storm time (Dst) index and the auroral indices, that quantify the impact of the magnetized plasma encounters on Earth's magnetosphere. Therefore, we couple EUHFORIA with the Open Geospace General Circulation Model (OpenGGCM), a magnetohydrodynamic model of the response of Earth's magnetosphere, ionosphere, and thermosphere to transient solar wind characteristics. In this coupling, OpenGGCM is driven by the solar wind and interplanetary magnetic field obtained from EUHFORIA simulations to produce the magnetospheric and ionospheric response to the CMEs. This coupling is validated with two observed geo‐effective CME events driven with the spheromak flux‐rope CME model. We compare these simulation results with the indices obtained from OpenGGCM simulations driven by the measured solar wind data from spacecraft. We further employ the dynamic time warping (DTW) technique to assess the model performance in predicting Dst. The main highlight of this study is to use EUHFORIA simulated time series to predict the Dst and auroral indices 1–2 days in advance, as compared to using the observed solar wind data at L1, which only provides predictions 1–2 hr before the actual impact. 
    more » « less