skip to main content


Title: GMAG: An open-source python package for ground-based magnetometers
Magnetometers are a key component of heliophysics research providing valuable insight into the dynamics of electromagnetic field regimes and their coupling throughout the solar system. On satellites, magnetometers provide detailed observations of the extension of the solar magnetic field into interplanetary space and of planetary environments. At Earth, magnetometers are deployed on the ground in extensive arrays spanning the polar cap, auroral and sub-auroral zone, mid- and low-latitudes and equatorial electrojet with nearly global coverage in azimuth (longitude or magnetic local time—MLT). These multipoint observations are used to diagnose both ionospheric and magnetospheric processes as well as the coupling between the solar wind and these two regimes at a fraction of the cost of in-situ instruments. Despite their utility in research, ground-based magnetometer data can be difficult to use due to a variety of file formats, multiple points of access for the data, and limited software. In this short article we review the Open-Source Python library GMAG which provides rapid access to ground-based magnetometer data from a number of arrays in a Pandas DataFrame, a common data format used throughout scientific research.  more » « less
Award ID(s):
1744828 2027168 2012202
NSF-PAR ID:
10427379
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Astronomy and Space Sciences
Volume:
9
ISSN:
2296-987X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We analyzed the magnetospheric global response to dynamic pressure pulses (DPPs) using the Heliophysics System Observatory (HSO) and ground magnetometers. During northward Interplanetary Magnetic Field (IMF) Bz conditions, the magnetosphere acts as a closed “cavity” and reacts to solar wind DPPs more simply than during southward IMF. In this study we use solar wind data collected by ACE and WIND together with magnetic field observations of Geotail, Cluster, Time History of Events and Macroscale Interactions during Substorms (THEMIS), Magnetospheric Multiscale Mission (MMS), Van Allen Probes, GOES missions, and ground magnetometer arrays to observe the magnetosphere (dayside, nightside, inner magnetosphere, magnetotail, magnetosheath, etc.) and ionosphere response simultaneously in several local time sectors and regions. A total of 37 events were selected during the period between February 2007 to December 2017. We examine the global response of each event and identify systematic behavior of the magnetosphere due to DPPs' compression, such as MHD wave propagation, sudden impulses, and Ultra Low Frequency waves (ULF) in the Pc5 range. Our results confirm statistical studies with a more limited coverage that have been performed at different sectors and/or regions of the magnetosphere. We present observations of the different signatures generated in different regions that propagate through the magnetosphere. The signature of the tailward traveling DPP is observed to move at the same solar wind speed, and in superposition of other known magnetospheric perturbations. It is observed that the DPP also generates or increases the amplitude of Pc4‐5 waves observed in the inner magnetosphere, while similar waves are observed on the ground.

     
    more » « less
  2. null (Ed.)
    Variations of vertical atmospheric electric field E z have been attributed mainly to meteorological processes. On the other hand, the theory of electromagnetic waves in the atmosphere, between the bottom ionosphere and earth’s surface, predicts two modes, magnetic H (TE) and electric E (TH) modes, where the E-mode has a vertical electric field component, E z . Past attempts to find signatures of ULF (periods from fractions to tens of minutes) disturbances in E z gave contradictory results. Recently, study of ULF disturbances of atmospheric electric field became feasible thanks to project GLOCAEM, which united stations with 1 sec measurements of potential gradient. These data enable us to address the long-standing problem of the coupling between atmospheric electricity and space weather disturbances at ULF time scales. Also, we have reexamined results of earlier balloon-born electric field and ground magnetic field measurements in Antarctica. Transmission of storm sudden commencement (SSC) impulses to lower latitudes was often interpreted as excitation of the electric TH 0 mode, instantly propagating along the ionosphere–ground waveguide. According to this theoretical estimate, even a weak magnetic signature of the E-mode ∼1 nT must be accompanied by a burst of E z well exceeding the atmospheric potential gradient. We have examined simultaneous records of magnetometers and electric field-mills during >50 SSC events in 2007–2019 in search for signatures of E-mode. However, the observed E z disturbance never exceeded background fluctuations ∼10 V/m, much less than expected for the TH 0 mode. We constructed a model of the electromagnetic ULF response to an oscillating magnetospheric field-aligned current incident onto the realistic ionosphere and atmosphere. The model is based on numerical solution of the full-wave equations in the atmospheric-ionospheric collisional plasma, using parameters that were reconstructed using the IRI model. We have calculated the vertical and horizontal distributions of magnetic and electric fields of both H- and E-modes excited by magnetospheric field-aligned currents. The model predicts that the excitation rate of the E-mode by magnetospheric disturbances is low, so only a weak E z response with a magnitude of ∼several V/m will be produced by ∼100 nT geomagnetic disturbance. However, at balloon heights (∼30 km), electric field of the E-mode becomes dominating. Predicted amplitudes of horizontal electric field in the atmosphere induced by Pc5 pulsations and travelling convection vortices, about tens of mV/m, are in good agreement with balloon electric field and ground magnetometer observations. 
    more » « less
  3. Abstract

    The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid‐latitude magnetometers to predict the probability thatdB/dtwill exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts ofdB/dtin the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over‐rely ondB/dtvalues in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in thedB/dtthreshold crossings.

     
    more » « less
  4. Abstract

    Our current knowledge of the geomagnetic poleward and equatorward boundary dynamics is limited, particularly, how deep those two latitudinal boundaries can extend into lower geomagnetic latitudes during magnetic storms. We want to understand the motion of the boundary because it is important in terms of the location and magnitude of the effects of geomagnetic disturbances associated with storms on the ground. In this study we derive spherical elementary ionospheric currents from ground magnetometer arrays covering North America and Greenland during six magnetic storms in 2015 and 2018. With two dimensional maps of the auroral region current, we select the equatorward boundary of the region 2 currents by‐eye and fit the boundary with an ellipse to derive the location of the equatorward boundary at magnetic midnight. We have obtained over 500 boundaries and find that the midnight boundary location varies between 45° and 66° magnetic latitude. We examine the influence of the interplanetary magnetic field (IMF), solar wind plasma, and geomagnetic indices on the location of the magnetic midnight equatorial boundary and find that the equatorial boundary location is best correlated with the IMF Bz, VBz, and the Sym‐H index. We demonstrate that as the Bz component becomes more negative, the magnitude of VBz increases, and the magnitude of the Sym‐H index increases, the magnetic midnight equatorial boundary shifts equatorward during periods of moderate to high geomagnetic activity.

     
    more » « less
  5. Abstract

    The auroral substorm has been extensively studied over the last six decades. However, our understanding of its driving mechanisms is still limited and so is our ability to accurately forecast its onset. In this study, we present the first deep learning‐based approach to predict the onset of a magnetic substorm, defined as the signature of the auroral electrojets in ground magnetometer measurements. Specifically, we use a time history of solar wind speed (Vx), proton number density, and interplanetary magnetic field (IMF) components as inputs to forecast the occurrence probability of an onset over the next 1 hr. The model has been trained and tested on a data set derived from the SuperMAG list of magnetic substorm onsets and can correctly identify substorms ∼75% of the time. In contrast, an earlier prediction algorithm correctly identifies ∼21% of the substorms in the same data set. Our model's ability to forecast substorm onsets based on solar wind and IMF inputs prior to the actual onset time, and the trend observed in IMFBzprior to onset together suggest that a majority of the substorms may not be externally triggered by northward turnings of IMF. Furthermore, we find that IMFBzandVxhave the most significant influence on model performance. Finally, principal component analysis shows a significant degree of overlap in the solar wind and IMF parameters prior to both substorm and nonsubstorm intervals, suggesting that solar wind and IMF alone may not be sufficient to forecast all substorms, and preconditioning of the magnetotail may be an important factor.

     
    more » « less