skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Complete Global Total Electron Content Map Dataset based on a Video Imputation Algorithm VISTA
Abstract Ionospheric total electron content (TEC) derived from multi-frequency Global Navigation Satellite System (GNSS) signals and the relevant products have become one of the most utilized parameters in the space weather and ionospheric research community. However, there are a couple of challenges in using the global TEC map data including large data gaps over oceans and the potential of losing meso-scale ionospheric structures when applying traditional reconstruction and smoothing algorithms. In this paper, we describe and release a global TEC map database, constructed and completed based on the Madrigal TEC database with a novel video imputation algorithm called VISTA (Video Imputation with SoftImpute, Temporal smoothing and Auxiliary data). The complete TEC maps reveal important large-scale TEC structures and preserve the observed meso-scale structures. Basic ideas and the pipeline of the video imputation algorithm are introduced briefly, followed by discussions on the computational costs and fine tuning of the adopted algorithm. Discussions on potential usages of the complete TEC database are given, together with a concrete example of applying this database.  more » « less
Award ID(s):
2113397
PAR ID:
10408916
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Scientific Data
Volume:
10
Issue:
1
ISSN:
2052-4463
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract This study reconstructs total electron content (TEC) maps in the vicinity of the Korean Peninsula by employing a deep convolutional generative adversarial network and Poisson blending (DCGAN‐PB). Our interest is to rebuild small‐scale ionosphere structures on the TEC map in a local region where pronounced ionospheric structures, such as the equatorial ionization anomaly, are absent. The reconstructed regional TEC maps have a domain of 120°–135.5°E longitude and 25.5°–41°N latitude with 0.5° resolution. To achieve this, we first train a DCGAN model by using the International Reference Ionosphere‐based TEC maps from 2002 to 2019 (except for 2010 and 2014) as a training data set. Next, the trained DCGAN model generates synthetic complete TEC maps from observation‐based incomplete TEC maps. Final TEC maps are produced by blending of synthetic TEC maps with observed TEC data by PB. The performance of the DCGAN‐PB model is evaluated by testing the regeneration of the masked TEC observations in 2010 (solar minimum) and 2014 (solar maximum). Our results show that a good correlation between the masked and model‐generated TEC values is maintained even with a large percentage (∼80%) of masking. The performance of the DCGAN‐PB model is not sensitive to local time, solar activity, and magnetic activity. Thus, the DCGAN‐PB model can reconstruct fine ionospheric structures in regions where observations are sparse and distinguishing ionospheric structures are absent. This model can contribute to near real‐time monitoring of the ionosphere by immediately providing complete TEC maps. 
    more » « less
  2. Abstract This study evaluates the performance of deep learning approach in the prediction of the ionospheric total electron content (TEC) during magnetically quiet periods. Two deep learning techniques, long short‐term memory (LSTM) and convolutional LSTM (ConvLSTM), are employed to predict TEC values 24 hr ahead in the vicinity of the Korean Peninsula (26.5°–40°N, 121°–134.5°E). The LSTM method predicts TEC at a single point based on time series of data at that point, whereas the ConvLSTM method simultaneously predicts TEC values at multiple points using spatiotemporal distribution of TEC. Both the LSTM and ConvLSTM models are trained using the complete regional TEC maps reconstructed by applying the Deep Convolutional Generative Adversarial Network–Poisson Blending (DCGAN‐PB) method to observed TEC data. The training period spans from 2002 to 2018, and the model performance is evaluated using 2019 data. Our results show that the ConvLSTM method outperforms the LSTM method, generating more reliable TEC maps with smaller root mean square errors when compared to the ground truth (DCGAN‐PB TEC maps). This outcome indicates that deep learning models can improve the prediction accuracy of TEC at a specific point by taking into account spatial information of TEC. We conclude that ConvLSTM is a reliable and efficient approach for the prompt ionospheric prediction. 
    more » « less
  3. Key Points Validation of ionospheric total electron content (TEC) by the state‐of‐the‐art ionospheric models hosted by NASA Community Coordinated Modeling Center, National Oceanic and Atmospheric Administration Space Weather Prediction Center, and NASA Jet Propulsion Laboratory (JPL) Multiple metrics and skill scores are used to assess the performance of ionospheric models in capturing storm time TEC anomaly GLObal Total Electron Content and JPL Global Ionospheric Map perform best, and physics‐based models perform better than the empirical model in capturing storm TEC variations 
    more » « less
  4. Abstract Evolution of large‐scale and fine‐scale plasmaspheric plume density structures was examined using space‐ground coordinated observations of a plume during the 7–8 September 2015 storm. The large‐scale plasmaspheric plume density at Van Allen Probes A was roughly proportional to the total electron content (TEC) along the satellite footprint, indicating that TEC distribution represents the large‐scale plume density distribution in the magnetosphere. The plasmaspheric plume contained fine‐scale density structures and subauroral polarization streams (SAPS) velocity fluctuations. High‐resolution TEC data support the interpretation that the fine‐scale plume structures were blobs with ∼300 km size and ∼500–800 m/s in the ionosphere (∼3,000 km size and ∼5–8 km/s speed in the magnetosphere), emerging at the plume base and drifting to the plume. The short‐baseline Global Navigation Satellite System receivers detected smaller‐scale (∼10 km in the ionosphere, ∼100 km in the magnetosphere) TEC gradients and their sunward drift. Fine‐scale density structures were associated with enhanced phase scintillation index. Velocity fluctuations were found to be spatial structures of fine‐scale SAPS flows that drifted sunward with density irregularities down to ∼10 s of meter‐scale. Fine‐scale density structures followed a power law with a slope of ∼−5/3, and smaller‐scale density structures developed slower than the larger‐scale structures. We suggest that turbulent SAPS flows created fine‐scale density structures and their cascading to smaller scales. We also found that the plume fine‐scale density structures were associated with whistler‐mode intensity modulation, and localized electron precipitation in the plume. Structured precipitation in the plume may contribute to ionospheric heating, SAPS velocity reduction, and conductance enhancements. 
    more » « less
  5. Abstract This study has developed a new TEC‐based ionospheric data assimilation system for 3‐D regional ionospheric imaging over the South American sector (TIDAS‐SA) (45°S–15°N, 35°–85°W, and 100–800 km). The TIDAS‐SA data assimilation system utilizes a hybrid Ensemble‐Variational approach to incorporate a diverse set of ionospheric data sources, including dense ground‐based Global Navigation Satellite System (GNSS) line‐of‐sight Total Electron Content (TEC) data, radio occultation data from the Constellation Observing System for Meteorology, Ionosphere, and Climate‐2 (COSMIC‐2), and altimeter TEC data from the JASON‐3 satellite. TIDAS‐SA can produce a reanalyzed three‐dimensional (3‐D) electron density spatial variation with a high time cadence, yielding spatial‐temporal resolution of 1° (latitude) × 1° (longitude) × 20 km (altitude) × 5 min. This allows us to reconstruct and study the 3‐D ionospheric morphology with multi‐scale structures. The performance of the data assimilation system is validated against independent ionosonde and in situ measurements through an experiment for a strong geomagnetic storm event on 03–04 November 2021. The results demonstrate that TIDAS‐SA can provide detailed and altitude‐resolved information that accurately characterizes the storm‐time ionospheric disturbances in vertical and horizontal domains over the equatorial and low‐latitude regions of South America. 
    more » « less