skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Unsupervised Clustering and Supervised Machine Learning for Lightning Classification: Application to Identifying EIPs for Ground‐Based TGF Detection
Key Points A framework merging unsupervised clustering and supervised convolutional neural network (CNN) for lightning classification is developed Clustering of positive polarity energetic lightning radio pulses (>150 kA) identifies three processes: +EIPs (6%–7%), +NBEs, and +CGs CNNs detect 95.2% of manually identified +EIPs with up to 98.7% accuracy, enabling studying EIP‐TGF link with lower peak current (>50 kA)  more » « less
Award ID(s):
2026304
PAR ID:
10448563
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Journal of Geophysical Research: Atmospheres
Volume:
128
Issue:
9
ISSN:
2169-897X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract A particular strength of lightning remote sensing is the variety of lightning types observed, each with a unique occurrence context and characteristically different emission. Distinct energetic intracloud (EIC) lightning discharges—compact intracloud lightning discharges (CIDs) and energetic intracloud pulses (EIPs)—produce intense RF radiation, suggesting large currents inside the cloud, and they also have different production mechanisms and occurrence contexts. A Low‐Frequency (LF) lightning remote sensing instrument array was deployed during the RELAMPAGO field campaign in west central Argentina, designed to investigate convective storms that produce high‐impact weather. LF data from the campaign can provide a valuable data set for researching the lightning context of EICs in a variety of subtropical convective storms. This paper describes the production of an LF‐CID data set in RELAMPAGO and includes a preliminary analysis of CID prevalence. Geolocated lightning events and their corresponding observed waveforms from the RELAMPAGO LF data set are used in the classification of EICs. Height estimates based on skywave reflections are computed, where prefit residual data editing is used to improve robustness against outliers. Even if EIPs occurred within the network, given the low number of very high‐peak current events and receiver saturation, automatic classification of EIPs may not be feasible using this data. The classification of CIDs, on the other hand, is straightforward and their properties, for both positive and negative polarity, are investigated. A few RELAMPAGO case studies are also presented, where high variability of CID prevalence in ordinary storms and high‐altitude positive CIDs, possibly in overshooting tops, are observed. 
    more » « less
  2. Abstract Many of the details of how terrestrial gamma‐ray flashes (TGFs) are produced, including their association with upward‐propagating in‐cloud lightning leader channels, remain poorly understood. Measurements of the low‐frequency radio emissions associated with TGF production continue to provide unique views and key insights into the electrodynamics of this process. Here we report further details on the connection between energetic in‐cloud pulses (EIPs) and TGFs. With coordinated measurements from both ground‐based radio sensors and space‐based gamma‐ray detectors on the Fermi and Reuven Ramaty High Energy Solar Spectroscopic Imager spacecraft, we find that all ten +EIPs that occurred within the searched space‐and‐time window are associated with simultaneous TGFs, including two new TGFs that were not previously identified by the gamma‐ray measurements alone. The results in this study not only solidify the tight connection between +EIPs and TGFs, but also demonstrate the practicability of detecting a subpopulation of TGFs with ground‐based radio sensors alone. 
    more » « less
  3. Abstract This review covers selected results of recent observations of lightning discharges performed across the entire electromagnetic spectrum (radiofrequency, optical, and energetic radiation) at the Lightning Observatory in Gainesville, Florida. The most important results include (a) characterization of the preliminary-breakdown, stepped-leader, and return-stroke processes in high-intensity (⩾50 kA) negative lightning discharges, (b) the first high-speed video images of bidirectional leader that made contact with the ground and produced a return stroke, (c) discovery of negative stepped leader branches colliding with the lateral surface of neighboring branches of the same leader, (d) new data on the occurrence context and properties of compact intracloud discharges, and (e) observation of a terrestrial gamma-ray flash that occurred during a bipolar cloud-to-ground lightning discharge. The results serve to improve our understanding of the physics of lightning with important implications for lightning modeling, lightning protection, and high-energy atmospheric physics studies. 
    more » « less
  4. In this study, we analyze 44 terrestrial gamma-ray flashes (TGFs) detected by the Fermi Gamma-ray Burst Monitor (GBM) occurring in 2014–2016 in conjunction with data from the U.S. National Lightning Detection Network (NLDN). We examine the characteristics of magnetic field waveforms measured by NLDN sensors for 61 pulses that occurred within 5 ms of the start-time of the TGF photon flux. For 21 (out of 44) TGFs, the associated NLDN pulse occurred almost simultaneously with (that is, within 200 μs of) the TGF. One TGF had two NLDN pulses within 200 μs. The median absolute time interval between the beginning of these near-simultaneous pulses and the TGF flux start-time is 50 μs. We speculate that these RF pulses are signatures of either TGF-associated relativistic electron avalanches or currents traveling in conducting paths “preconditioned” by TGF-associated electron beams. Compared to pulses that were not simultaneous with TGFs (but within 5 ms of one), simultaneous pulses had higher median absolute peak current (26 kA versus 11 kA), longer median threshold-to-peak rise time (14 μs versus 2.8 μs), and longer median peak-to-zero time (15 μs versus 5.5 μs). A majority (77%) of our simultaneous RF pulses had NLDN-estimated peak currents less than 50 kA indicating that TGF emissions can be associated with moderate-peak-amplitude processes. The lightning flash associated with one of the TGFs in our data set was observed by a Lightning Mapping Array, which reported a relatively high-power source at an altitude of 25 km occurring 101 μs after the GBM-reported TGF discovery-bin start-time. 
    more » « less
  5. Abstract In this paper, we present the first high‐speed video observation of a cloud‐to‐ground lightning flash and its associated downward‐directed Terrestrial Gamma‐ray Flash (TGF). The optical emission of the event was observed by a high‐speed video camera running at 40,000 frames per second in conjunction with the Telescope Array Surface Detector, Lightning Mapping Array, interferometer, electric‐field fast antenna, and the National Lightning Detection Network. The cloud‐to‐ground flash associated with the observed TGF was formed by a fast downward leader followed by a very intense return stroke peak current of −154 kA. The TGF occurred while the downward leader was below cloud base, and even when it was halfway in its propagation to ground. The suite of gamma‐ray and lightning instruments, timing resolution, and source proximity offer us detailed information and therefore a unique look at the TGF phenomena. 
    more » « less