skip to main content


Title: Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
Abstract

Random‐noise‐induced biases are inherent issues to the accurate derivation of second‐order statistical parameters (e.g., variances, fluxes, energy densities, and power spectra) from lidar and radar measurements. We demonstrate here for the first time an altitude‐interleaved method for eliminating such biases, following the original proposals by Gardner and Chu (2020,https://doi.org/10.1364/ao.400375) who demonstrated a time‐interleaved method. Interleaving in altitude bins provides two statistically independent samples over the same time period and nearly the same altitude range, thus enabling the replacement of variances that include the noise‐induced biases with covariances that are intrinsically free of such biases. Comparing the interleaved method with previous variance subtraction (VS) and spectral proportion (SP) methods using gravity wave potential energy density calculated from Antarctic lidar data and from a forward model, this study finds the accuracy and precision of each method differing in various conditions, each with its own strengths and weakness. VS performs well in high‐SNR, yet its accuracy fails at lower‐SNR as it often yields negative values. SP is accurate and precise under high‐SNR, remaining accurate in worse conditions than VS would, yet develops a positive bias under low‐SNR. The interleaved method is accurate in all SNRs but requires a large number of samples to drive random‐noise terms in covariances toward zero and to compensate for the reduced precision due to the splitting of return signals. Therefore, selecting the proper bias removal/elimination method for actual signal and sample conditions is crucial in utilizing lidar/radar data, as neglecting this can conceal trends or overstate atmospheric variability.

 
more » « less
Award ID(s):
2110428 2029162
NSF-PAR ID:
10374452
Author(s) / Creator(s):
 ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Earth and Space Science
Volume:
9
Issue:
1
ISSN:
2333-5084
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Accurate specification of ionization production by energetic electron precipitation is critical for atmospheric chemistry models to assess the resultant atmospheric effects. Recent model‐observation comparison studies have increasingly highlighted the importance of considering precipitation fluxes in the full range of electron energy and pitch angle. However, previous parameterization methods were mostly proposed for isotropically precipitation electrons with energies up to 1 MeV, and the pitch angle dependence has not yet been parameterized. In this paper, we first characterize and tabulate the atmospheric ionization response to monoenergetic electrons with different pitch angles and energies between3 keV and33 MeV. A generalized method that fully accounts for the dependence of ionization production on background atmospheric conditions, electron energy, and pitch angle has been developed based on the parameterization method of Fang et al. (2010,https://doi.org/10.1029/2010GL045406). Moreover, we validate this method using 100 random atmospheric profiles and precipitation fluxes with monoenergetic and exponential energy distributions, and isotropic and sine pitch angle distributions. In a suite of 6,100 validation tests, the error in peak ionization altitude is found to be within 1 km in 91% of all the tests with a mean error of 2.7% in peak ionization rate and 1.9% in total ionization. This method therefore provides a reliable means to convert space‐measured precipitation energy and pitch angle distributions into ionization inputs for atmospheric chemistry models.

     
    more » « less
  2. Abstract

    A very high spatial resolution (25 m pixel at 90 km altitude) OH airglow imager was installed at the Andes Lidar Observatory on Cerro Pachón, Chile, in February 2016. This instrument was collocated with a Na wind‐temperature lidar. On 1 March 2016, the lidar data showed that the atmosphere was dynamically unstable before 0100 UT and thus conducive to the formation of Kelvin‐Helmholtz instabilities (KHIs). The imager revealed the presence of a KHI and an apparent atmospheric gravity wave (AGW) propagating approximately perpendicular to the plane of primary KHI motions. The AGW appears to have induced modulations of the shear layer leading to misalignments of the emerging KHI billows. These enabled strong KHI billow interactions, as they achieved large amplitudes and a rapid transition to turbulence thereafter. The interactions manifested themselves as vortex tube and knot features that were earlier identified in laboratory studies, as discussed in Thorpe (1987,https://doi.org/10.1029/JC092iC05p05231; 2002,https://doi.org/10.1002/qj.200212858307) and inferred to be widespread in the atmosphere based on features seen in tropospheric clouds but which have never been identified in previous upper atmospheric observations. This study presents the first high‐resolution airglow imaging observation of these KHI interaction dynamics that drive rapid transitions to turbulence and suggest the potential importance of these dynamics in the mesosphere and at other altitudes. A companion paper (Fritts et al., 2020,https://doi.org/10.1029/2020JD033412) modeling these dynamics confirms that the vortex tubes and knots yield more rapid and significantly enhanced turbulence relative to the internal instabilities of individual KHI billows.

     
    more » « less
  3. Abstract

    Both high‐power large aperture radars and smaller meteor radars readily observe the dense head plasma produced as a meteoroid ablates. However, determining the mass of such meteors based on the information returned by the radar is challenging. We present a new method for deriving meteor masses from single‐frequency radar measurements, using a physics‐based plasma model and finite‐difference time‐domain (FDTD) simulations. The head plasma model derived in Dimant and Oppenheim (2017),https://doi.org/10.1002/2017ja023963depends on the meteoroids altitude, speed, and size. We use FDTD simulations of a radar pulse interacting with such head plasmas to determine the radar cross section (RCS) that a radar system would observe for a meteor with a given set of physical properties. By performing simulations over the observed parameter space, we construct tables relating meteor size, velocity, and altitude to RCS. We then use these tables to map a set of observations from the MAARSY radar (53.5 MHz) to fully defined plasma distributions, from which masses are calculated. To validate these results, we repeat the analysis using observations of the same meteors by the EISCAT radar (929 MHz). The resulting masses are strongly linearly correlated; however, the masses derived from EISCAT measurements are on average 1.33 times larger than those derived from MAARSY measurements. Since this method does not require dual‐frequency measurements for mass determination, only validation, it can be applied in the future to observations made by many single‐frequency radar systems.

     
    more » « less
  4. Abstract

    In the D‐region, the ionization rate cannot be detected directly with any known measurement technique, therefore it must be estimated. Starting from space‐based measurements of precipitating particle flux, we estimate the ionization rate in the atmosphere using the Electron Precipitation Monte Carlo transport method. This ionization rate is used to calculate the expected electron density in the D‐region with the Glukhov‐Pasko‐Inan five species (GPI5) atmospheric chemistry model. We then compare the simulated electron density with that measured by the Poker Flat Incoherent Scatter Radar (PFISR). From ground‐based radar measurements of electron density enhancements due to sub‐relativistic and relativistic electron precipitation, we present a method to extract the ionization rate altitude profiles using inverse theory. We use this estimation of ionization rate to find the energy distribution of the precipitating particles. With this inverse method, we are able to link ground measurements of electron density to the precipitating flux in a time dependent manner and with uncertainty in the inverted parameters. The method was tested on synthetic data and applied to specific PFISR data sets. The method is able to retrieve the ionization rate altitude profiles that, when forward modeled, return the expected electron densities within ∼7% error as compared to the PFISR data. For the case presented here, the arbitrary energy distribution inversion results are comparable in magnitude and shape to those presented in Turunen et al. (2016,https://doi.org/10.1002/2016jd025015) for the inversion of a single event of pulsating aurora observed by EISCAT.

     
    more » « less
  5. Abstract

    We examine the behavior of natural basaltic and trachytic samples during paleointensity experiments on both the original and laboratory‐acquired thermal remanences and characterize the samples using proxies for domain state including curvature (k) and the bulk domain stability parameters of Paterson (2011,https://doi.org/10.1029/2011JB008369) and Paterson et al. (2017,https://doi.org/10.1073/pnas.1714047114), respectively. A curvature value of 0.164 (suggested by Paterson, 2011,https://doi.org/10.1029/2011JB008369) as a critical threshold that separates single‐domain‐like remanences from multidomain‐like remanances on the original paleointensity data was used to separate samples into “straight” (single‐domain‐like) and “curved” (multidomain‐like) groups. Specimens from the two sample sets were given a “fresh” thermal remanent magnetization in a 70 μT field and subjected to an infield‐zerofield, zerofield‐infield (IZZI)‐type (Yu et al., 2004,https://doi.org/10.1029/2003GC000630) paleointensity experiment. The straight sample set recovered the laboratory field with high precision while the curved set had much more scattered results (70.5 ± 1.5 and 71.9 ± 5.2 μT, respectively). The average intensity of both sets for straight and curved was quite close to the laboratory field of 70 μT, however, suggesting that if experiments contain a sufficient number of specimens, there does not seem to be a large bias in the field estimate. We found that the dependence of the laboratory thermal remanent magnetization on cooling rate was significant in most samples and did not depend on domain states inferred from proxies based on hysteresis measurements and should be estimated for all samples whose cooling rates differ from that used in the laboratory.

     
    more » « less