skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Reconstructing Missing and Anomalous Data Collected from High-Frequency In-Situ Sensors in Fresh Waters
In situ sensors that collect high-frequency data are used increasingly to monitor aquatic environments. These sensors are prone to technical errors, resulting in unrecorded observations and/or anomalous values that are subsequently removed and create gaps in time series data. We present a framework based on generalized additive and auto-regressive models to recover these missing data. To mimic sporadically missing (i) single observations and (ii) periods of contiguous observations, we randomly removed (i) point data and (ii) day- and week-long sequences of data from a two-year time series of nitrate concentration data collected from Arikaree River, USA, where synoptically collected water temperature, turbidity, conductance, elevation, and dissolved oxygen data were available. In 72% of cases with missing point data, predicted values were within the sensor precision interval of the original value, although predictive ability declined when sequences of missing data occurred. Precision also depended on the availability of other water quality covariates. When covariates were available, even a sudden, event-based peak in nitrate concentration was reconstructed well. By providing a promising method for accurate prediction of missing data, the utility and confidence in summary statistics and statistical trends will increase, thereby assisting the effective monitoring and management of fresh waters and other at-risk ecosystems.  more » « less
Award ID(s):
1724433
PAR ID:
10346069
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
International Journal of Environmental Research and Public Health
Volume:
18
Issue:
23
ISSN:
1660-4601
Page Range / eLocation ID:
12803
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. (, Zenodo)
    The Ocean Observatories Initiative (OOI) deployed both the In-Situ Ultraviolet Spectrophotometer (ISUS) and Submersible Underwater Nitrate Sensor (SUNA) for continuous, in-situ measurement of nitrate. At the Pioneer-New England Shelf Array (Pioneer-NES), ISUS/SUNA sensors were deployed at 7-meters depth at the Inshore (ISSM), Central (CNSM), and Offshore (OSSM) Surface Mooring locations. The SUNA sensor replaced the ISUS sensors spring 2018. The SUNA was a major improvement in technology, with significant improvements in accuracy and precision. However, it still suffers from calibration drift due to lamp fatigue and biofouling as well as spectral interference due to bromide and fluorometric CDOM. Drift is corrected by application of post-cruise calibrations to recalculate the temperature-and-salinity corrected nitrate concentration following Sakamoto (2009a) and estimating a linear drift between pre-and-post cruise deployments. Validation is performed by comparison with discrete water samples collected during deployment/recovery of the sensors. These datasets include the nitrate data from the Pioneer-NES ISSM (CP03ISSM-RID26-07-NUTNRB000.nc), CNSM (CP01CNSM-RID26-07-NUTNRB000.nc), and OSSM (CP04OSSM-RID26-07-NUTNRB000.nc) SUNA instruments spanning Spring 2018 through Fall 2022. Each dataset contains the measured nitrate, the temperature-salinity corrected nitrate, the drift-corrected nitrate, and the nitrate following validation with bottle samples. 
    more » « less
  2. ; ; ; (, HydroShare)
    Water quality sensors were placed in 3 urban streams in Cleveland, OH and 4 urban streams in Denver, CO to estimate stream metabolism and assess response to high flow events. MiniDOT (dissolved oxygen and temperature) and Onset (specific conductance) sensors were placed mid-channel near USGS gages. Light was measured as global horizontal irradiance (GHI) and supplied by SolCast. Data collection was part of the NSF STORMS project (PI Jefferson, co-PIs Costello, Bhaskar, Turner). Specific conductance, dissolved oxygen, and light were measured every 10 minutes. Sensors were removed during winter months to avoid damage. Datasets were cleaned to remove values when sensors were out of water, buried, and removed for maintenance/calibration. 
    more » « less
  3. ; ; ; ; ; ; ; ; (, Frontiers in Sensors)
    Water quality monitoring is essential for identifying risks to environmental and human health. Nitrate monitoring is of particular importance, as its anthropogenic point and nonpoint sources are common globally and have deleterious effects on water quality and usability as well as aquatic ecosystem health. Standard methods for assessing nitrate concentrations in water generally involve laboratory techniques, as methods available for field testing face significant tradeoffs between cost, precision, and portability. Given its relatively ubiquitous nature and the widespread regulation of nitrate pollution, it is a prime target for sensor development. The growing field of nanomaterials (e.g., nanoparticles, nanotubes, and 2-dimensional materials) offers the potential to eliminate these tradeoffs through a new generation of field-ready nitrate sensors. However, transitioning nano-sensors from the lab to the field remains challenging. In this perspective we examine the challenges of lab-to-field transition of nano-sensors for nitrate, highlighting the importance of a user-centered design approach under the framework of FOCUS (form factor, operational robustness, cost, user interface, and sensitivity). 
    more » « less
  4. ; ; (, Environmental Data Initiative)
    Temperature data were collected on a daily time-scale from the C1 climate station (3018 m) since 1952. Over time various circumstances have led to days with missing values. Some missing values were estimated from redundant sensors and nearby climate stations using various methods. Greenland 1987 was a basis for the methodology. However when it was not possible to use this methodology, new methods were developed. 
    more » « less
  5. ; ; (, Environmental Data Initiative)
    Temperature data were collected on a daily time-scale from the D1 climate station (3743 m) since 1952. Over time, various circumstances have led to days with missing values. Some missing values were estimated from redundant sensors and nearby climate stations using various methods. Greenland 1987 was a basis for the methodology. However when it was not possible to use this methodology, new methods were developed. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email