skip to main content


Title: Complete Global Total Electron Content Map Dataset based on a Video Imputation Algorithm VISTA
Abstract

Ionospheric total electron content (TEC) derived from multi-frequency Global Navigation Satellite System (GNSS) signals and the relevant products have become one of the most utilized parameters in the space weather and ionospheric research community. However, there are a couple of challenges in using the global TEC map data including large data gaps over oceans and the potential of losing meso-scale ionospheric structures when applying traditional reconstruction and smoothing algorithms. In this paper, we describe and release a global TEC map database, constructed and completed based on the Madrigal TEC database with a novel video imputation algorithm called VISTA (Video Imputation with SoftImpute, Temporal smoothing and Auxiliary data). The complete TEC maps reveal important large-scale TEC structures and preserve the observed meso-scale structures. Basic ideas and the pipeline of the video imputation algorithm are introduced briefly, followed by discussions on the computational costs and fine tuning of the adopted algorithm. Discussions on potential usages of the complete TEC database are given, together with a concrete example of applying this database.

 
more » « less
Award ID(s):
2113397
NSF-PAR ID:
10408916
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Scientific Data
Volume:
10
Issue:
1
ISSN:
2052-4463
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    This study reconstructs total electron content (TEC) maps in the vicinity of the Korean Peninsula by employing a deep convolutional generative adversarial network and Poisson blending (DCGAN‐PB). Our interest is to rebuild small‐scale ionosphere structures on the TEC map in a local region where pronounced ionospheric structures, such as the equatorial ionization anomaly, are absent. The reconstructed regional TEC maps have a domain of 120°–135.5°E longitude and 25.5°–41°N latitude with 0.5° resolution. To achieve this, we first train a DCGAN model by using the International Reference Ionosphere‐based TEC maps from 2002 to 2019 (except for 2010 and 2014) as a training data set. Next, the trained DCGAN model generates synthetic complete TEC maps from observation‐based incomplete TEC maps. Final TEC maps are produced by blending of synthetic TEC maps with observed TEC data by PB. The performance of the DCGAN‐PB model is evaluated by testing the regeneration of the masked TEC observations in 2010 (solar minimum) and 2014 (solar maximum). Our results show that a good correlation between the masked and model‐generated TEC values is maintained even with a large percentage (∼80%) of masking. The performance of the DCGAN‐PB model is not sensitive to local time, solar activity, and magnetic activity. Thus, the DCGAN‐PB model can reconstruct fine ionospheric structures in regions where observations are sparse and distinguishing ionospheric structures are absent. This model can contribute to near real‐time monitoring of the ionosphere by immediately providing complete TEC maps.

     
    more » « less
  2. Abstract

    Evolution of large‐scale and fine‐scale plasmaspheric plume density structures was examined using space‐ground coordinated observations of a plume during the 7–8 September 2015 storm. The large‐scale plasmaspheric plume density at Van Allen Probes A was roughly proportional to the total electron content (TEC) along the satellite footprint, indicating that TEC distribution represents the large‐scale plume density distribution in the magnetosphere. The plasmaspheric plume contained fine‐scale density structures and subauroral polarization streams (SAPS) velocity fluctuations. High‐resolution TEC data support the interpretation that the fine‐scale plume structures were blobs with ∼300 km size and ∼500–800 m/s in the ionosphere (∼3,000 km size and ∼5–8 km/s speed in the magnetosphere), emerging at the plume base and drifting to the plume. The short‐baseline Global Navigation Satellite System receivers detected smaller‐scale (∼10 km in the ionosphere, ∼100 km in the magnetosphere) TEC gradients and their sunward drift. Fine‐scale density structures were associated with enhanced phase scintillation index. Velocity fluctuations were found to be spatial structures of fine‐scale SAPS flows that drifted sunward with density irregularities down to ∼10 s of meter‐scale. Fine‐scale density structures followed a power law with a slope of ∼−5/3, and smaller‐scale density structures developed slower than the larger‐scale structures. We suggest that turbulent SAPS flows created fine‐scale density structures and their cascading to smaller scales. We also found that the plume fine‐scale density structures were associated with whistler‐mode intensity modulation, and localized electron precipitation in the plume. Structured precipitation in the plume may contribute to ionospheric heating, SAPS velocity reduction, and conductance enhancements.

     
    more » « less
  3. Abstract

    Postsunset midlatitude traveling ionospheric disturbances (TIDs) and equatorial plasma bubbles (EPBs) were simultaneously observed over American sector during the geomagnetic storm on 8 September 2017. The characteristics of TIDs are analyzed by using a combination of the Millstone Hill incoherent scatter radar data and 2‐D detrended total electron content (TEC) from ground‐based Global Navigation Satellite System receivers. The main results associated with EPBs are as follows: (1) stream‐like structures of TEC depletion occurred simultaneously at geomagnetically conjugate points, (2) poleward extension of the TEC irregularities/depletions along the magnetic field lines, (3) severe equatorial and midlatitude electron density (Ne) bite outs observed by Defense Meteorological Satellite Program and Swarm satellites, and (4) enhancements of ionosphereFlayer virtual height and vertical drifts observed by equatorial ionosondes near the EPBs initiation region. The stream‐like TEC depletions reached 46° magnetic latitudes that map to an apex altitude of 6,800 km over the magnetic equator using International Geomagnetic Reference Field. The formation of this extended density depletion structure is suggested to be due to the merging between the altitudinal/latitudinal extension of EPBs driven by strong prompt penetration electric field and midlatitude TIDs. Moreover, the poleward portion of the depletion/irregularity drifted westward and reached the equatorward boundary of the ionospheric main trough. This westward drift occurred at the same time as the sudden expansion of the convection pattern and could be attributed to the strong returning westward flow near the subauroral polarization stream region. Other possible mechanisms for the westward tilt are also discussed.

     
    more » « less
  4. Abstract

    This study has developed a new TEC‐based ionospheric data assimilation system for 3‐D regional ionospheric imaging over the South American sector (TIDAS‐SA) (45°S–15°N, 35°–85°W, and 100–800 km). The TIDAS‐SA data assimilation system utilizes a hybrid Ensemble‐Variational approach to incorporate a diverse set of ionospheric data sources, including dense ground‐based Global Navigation Satellite System (GNSS) line‐of‐sight Total Electron Content (TEC) data, radio occultation data from the Constellation Observing System for Meteorology, Ionosphere, and Climate‐2 (COSMIC‐2), and altimeter TEC data from the JASON‐3 satellite. TIDAS‐SA can produce a reanalyzed three‐dimensional (3‐D) electron density spatial variation with a high time cadence, yielding spatial‐temporal resolution of 1° (latitude) × 1° (longitude) × 20 km (altitude) × 5 min. This allows us to reconstruct and study the 3‐D ionospheric morphology with multi‐scale structures. The performance of the data assimilation system is validated against independent ionosonde and in situ measurements through an experiment for a strong geomagnetic storm event on 03–04 November 2021. The results demonstrate that TIDAS‐SA can provide detailed and altitude‐resolved information that accurately characterizes the storm‐time ionospheric disturbances in vertical and horizontal domains over the equatorial and low‐latitude regions of South America.

     
    more » « less
  5. Abstract

    This study evaluates the performance of deep learning approach in the prediction of the ionospheric total electron content (TEC) during magnetically quiet periods. Two deep learning techniques, long short‐term memory (LSTM) and convolutional LSTM (ConvLSTM), are employed to predict TEC values 24 hr ahead in the vicinity of the Korean Peninsula (26.5°–40°N, 121°–134.5°E). The LSTM method predicts TEC at a single point based on time series of data at that point, whereas the ConvLSTM method simultaneously predicts TEC values at multiple points using spatiotemporal distribution of TEC. Both the LSTM and ConvLSTM models are trained using the complete regional TEC maps reconstructed by applying the Deep Convolutional Generative Adversarial Network–Poisson Blending (DCGAN‐PB) method to observed TEC data. The training period spans from 2002 to 2018, and the model performance is evaluated using 2019 data. Our results show that the ConvLSTM method outperforms the LSTM method, generating more reliable TEC maps with smaller root mean square errors when compared to the ground truth (DCGAN‐PB TEC maps). This outcome indicates that deep learning models can improve the prediction accuracy of TEC at a specific point by taking into account spatial information of TEC. We conclude that ConvLSTM is a reliable and efficient approach for the prompt ionospheric prediction.

     
    more » « less