Abstract Understanding the nature and origin of errors in satellite precipitation products is important for applications and product improvement. Here we propose a new error decomposition scheme incorporating precipitation event (continuous rainy periods) information to characterize satellite errors. Under this framework, the errors are attributed to the inaccuracies in event occurrence, timing (event start/end time), and intensity. The Integrated MultisatellitE Retrieval for Global Precipitation Measurement (IMERG) is used as our test product to apply the method over CONUS. The above‐listed factors contribute approximately 30%, 20%, and 50% to the total bias, respectively. Significant asymmetry exists in the temporal distribution of biases throughout events: early event endings cause threefold more precipitation amount bias than late event beginnings, while early event beginnings cause fourfold more bias than late event endings. Dominant contributors vary across seasons and regions. The proposed error decomposition provides insight into sources of error for improved retrievals.
more »
« less
Added Value of Environmental Variables for Satellite Precipitation Retrieval: A Temporal Coevolution Perspective and a Machine Learning Integration Assessment
Abstract Satellite precipitation retrieval is inherently an underdetermined inverse problem where additional physical constraints could substantially enhance accuracy. While previous studies have explored static (pixel‐based/spatial‐context‐based) environmental variables at discrete satellite observation times, their temporal dynamic information remains underutilized. Building on our earlier finding that retrieval errors depend on storm progression (event stage), we propose a new, physically interpretable mechanism for improving retrievals, namely, leveraging environmental variables' temporal dynamics as proxies for event stages. Using IMERG satellite product and GV‐MRMS as ground‐truth over CONUS (2018–2020), we first demonstrate robust coevolution patterns of environmental variables and satellite errors throughout events, and show that these variables' temporal gradients reliably infer event stages. We then demonstrate that incorporating these variables and their gradients into a machine‐learning post‐processing framework improves retrieval accuracy. This work inspires and guides more thorough utilization of spatiotemporal atmospheric fields encoding rich physical information within advanced machine‐learning frameworks for further algorithm improvement.
more »
« less
- Award ID(s):
- 2324008
- PAR ID:
- 10595138
- Publisher / Repository:
- DOI PREFIX: 10.1029
- Date Published:
- Journal Name:
- Geophysical Research Letters
- Volume:
- 52
- Issue:
- 11
- ISSN:
- 0094-8276
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Neuromorphic computing, exemplified by breakthroughs in machine vision through concepts like address-event representation and send-on-delta sampling, has revolutionised sensor technology, enabling low-latency and high dynamic range perception with minimal bandwidth. While these advancements are prominent in vision and auditory perception, their potential in machine olfaction remains under-explored, particularly in the context of fast sensing. Here, we outline the perspectives for neuromorphic principles in machine olfaction. Considering the physical characteristics of turbulent odour environments, we argue that event-driven signal processing is optimally suited to the inherent properties of olfactory signals. We highlight the lack of bandwidth limitation due to turbulent dispersal processes, the characteristic temporal and chemical sparsity, as well as the high information density of the odour landscape. Further, we critically review and discuss the literature on neuromorphic olfaction; particularly focusing on neuromorphic principles such as event generation algorithms, information encoding mechanisms, event processing schemes (spiking neural networks), and learning. We discuss that the application of neuromorphic principles may significantly enhance response time and task performance in robotic olfaction, enabling autonomous systems to perform complex tasks in turbulent environments—such as environmental monitoring, odour guided search and rescue operations, and hazard detection.more » « less
-
The current availability of soil moisture data over large areas comes from satellite remote sensing technologies (i.e., radar-based systems), but these data have coarse resolution and often exhibit large spatial information gaps. Where data are too coarse or sparse for a given need (e.g., precision farming), one can leverage machine-learning techniques coupled with other sources of environmental information (e.g., topography) to generate gap-free information at a finer spatial resolution (i.e., increased granularity). To this end, we develop a spatial inference engine consisting of modular stages for processing spatial environmental data, generating predictions with machine-learning techniques, and analyzing these predictions. We demonstrate the functionality of this approach and the effects of data processing choices via multiple prediction maps over a United States ecological region with a highly diverse soil moisture profile (i.e., the Middle Atlantic Coastal Plains). The relevance of our work derives from a pressing need to improve the spatial representation of soil moisture for applications in environmental sciences (e.g., ecological niche modeling, carbon monitoring systems, and other Earth system models) and precision farming (e.g., optimizing irrigation practices and other land management decisions).more » « less
-
Abstract Prediction of the spatial‐temporal dynamics of the fluid flow in complex subsurface systems, such as geologic storage, is typically performed using advanced numerical simulation methods that solve the underlying governing physical equations. However, numerical simulation is computationally demanding and can limit the implementation of standard field management workflows, such as model calibration and optimization. Standard deep learning models, such as RUNET, have recently been proposed to alleviate the computational burden of physics‐based simulation models. Despite their powerful learning capabilities and computational appeal, deep learning models have important limitations, including lack of interpretability, extensive data needs, weak extrapolation capacity, and physical inconsistency that can affect their adoption in practical applications. We develop a Fluid Flow‐based Deep Learning (FFDL) architecture for spatial‐temporal prediction of important state variables in subsurface flow systems. The new architecture consists of a physics‐based encoder to construct physically meaningful latent variables, and a residual‐based processor to predict the evolution of the state variables. It uses physical operators that serve as nonlinear activation functions and imposes the general structure of the fluid flow equations to facilitate its training with data pertaining to the specific subsurface flow application of interest. A comprehensive investigation of FFDL, based on a field‐scale geologic storage model, is used to demonstrate the superior performance of FFDL compared to RUNET as a standard deep learning model. The results show that FFDL outperforms RUNET in terms of prediction accuracy, extrapolation power, and training data needs.more » « less
-
Abstract Prediction of dynamic environmental variables in unmonitored sites remains a long-standing challenge for water resources science. The majority of the world’s freshwater resources have inadequate monitoring of critical environmental variables needed for management. Yet, the need to have widespread predictions of hydrological variables such as river flow and water quality has become increasingly urgent due to climate and land use change over the past decades, and their associated impacts on water resources. Modern machine learning methods increasingly outperform their process-based and empirical model counterparts for hydrologic time series prediction with their ability to extract information from large, diverse data sets. We review relevant state-of-the art applications of machine learning for streamflow, water quality, and other water resources prediction and discuss opportunities to improve the use of machine learning with emerging methods for incorporating watershed characteristics and process knowledge into classical, deep learning, and transfer learning methodologies. The analysis here suggests most prior efforts have been focused on deep learning frameworks built on many sites for predictions at daily time scales in the United States, but that comparisons between different classes of machine learning methods are few and inadequate. We identify several open questions for time series predictions in unmonitored sites that include incorporating dynamic inputs and site characteristics, mechanistic understanding and spatial context, and explainable AI techniques in modern machine learning frameworks.more » « less
An official website of the United States government
