skip to main content

This content will become publicly available on March 1, 2025

Title: Spatiotemporal Data Augmentation of MODIS‐Landsat Water Bodies Using Adversarial Networks

With increasing demands for precise water resource management, there is a growing need for advanced techniques in mapping water bodies. The currently deployed satellites provide complementary data that are either of high spatial or high temporal resolutions. As a result, there is a clear trade‐off between space and time when considering a single data source. For the efficient monitoring of multiple environmental resources, various Earth science applications need data at high spatial and temporal resolutions. To address this need, many data fusion methods have been described in the literature, that rely on combining data snapshots from multiple sources. Traditional methods face limitations due to sensitivity to atmospheric disturbances and other environmental factors, resulting in noise, outliers, and missing data. This paper introduces Hydrological Generative Adversarial Network (Hydro‐GAN), a novel machine learning‐based method that utilizes modified GANs to enhance boundary accuracy when mapping low‐resolution MODIS data to high‐resolution Landsat‐8 images. We propose a new non‐saturating loss function for the Hydro‐GAN generator, which maximizes the log of discriminator probabilities to promote stable updates and aid convergence. By focusing on reducing squared differences between real and synthetic images, our approach enhances training stability and overall performance. We specifically focus on mapping water bodies using MODIS and Landsat‐8 imagery due to their relevance in water resource management tasks. Our experimental results demonstrate the effectiveness of Hydro‐GAN in generating high‐resolution water body maps, outperforming traditional methods in terms of boundary accuracy and overall quality.

more » « less
Award ID(s):
2305781 2153379 2204363 2240022
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Date Published:
Journal Name:
Water Resources Research
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. WaterSmart project is an NSF funded projected seeks water consumption reduction using satellite observations. In order to fit the fine temporal resolution requirement, satellites are required to have a high revisit cycle. MODIS is an ideal platform for monitoring the ground thanks to its daily coverage while the spatial resolution is too coarse. Research has demonstrated the possibility to improve the spatial resolution of MODIS using the Landsat 8 images. This research is aimed to establish a workflow to adapt the data fusion algorithm to achieve automatically processing at real-time in order to support short-term decision making. 
    more » « less
  2. null (Ed.)
    Mapping invasive vegetation species in arid regions is a critical task for managing water resources and understanding threats to ecosystem services. Traditional remote sensing platforms, such as Landsat and MODIS, are ill-suited for distinguishing native and non-native vegetation species in arid regions due to their large pixels compared to plant sizes. Unmanned aircraft systems, or UAS, offer the potential to capture the high spatial resolution imagery needed to differentiate species. However, in order to extract the most benefits from these platforms, there is a need to develop more efficient and effective workflows. This paper presents an integrated spectral–structural workflow for classifying invasive vegetation species in the Lower Salt River region of Arizona, which has been the site of fires and flooding, leading to a proliferation of invasive vegetation species. Visible (RGB) and multispectral images were captured and processed following a typical structure from motion workflow, and the derived datasets were used as inputs in two machine learning classifications—one incorporating only spectral information and one utilizing both spectral data and structural layers (e.g., digital terrain model (DTM) and canopy height model (CHM)). Results show that including structural layers in the classification improved overall accuracy from 80% to 93% compared to the spectral-only model. The most important features for classification were the CHM and DTM, with the blue band and two spectral indices (normalized difference water index (NDWI) and normalized difference salinity index (NDSI)) contributing important spectral information to both models. 
    more » « less
  3. Abstract

    Accurate and timely inland waterbody extent and location data are foundational information to support a variety of hydrological applications and water resources management. Recently, the Cyclone Global Navigation Satellite System (CYGNSS) has emerged as a promising tool for delineating inland water due to distinct surface reflectivity characteristics over dry versus wet land which are observable by CYGNSS’s eight microsatellites with passive bistatic radars that acquire reflected L-band signals from the Global Positioning System (GPS) (i.e., signals of opportunity). This study conducts a baseline 1-km comparison of water masks for the contiguous United States between latitudes of 24°N-37°N for 2019 using three Earth observation systems: CYGNSS (i.e., our baseline water mask data), the Moderate Resolution Imaging Spectroradiometer (MODIS) (i.e., land water mask data), and the Landsat Global Surface Water product (i.e., Pekel data). Spatial performance of the 1-km comparison water mask was assessed using confusion matrix statistics and optical high-resolution commercial satellite imagery. When a mosaic of binary thresholds for 8 sub-basins for CYGNSS data were employed, confusion matrix statistics were improved such as up to a 34% increase in F1-score. Further, a performance metric of ratio of inland water to catchment area showed that inland water area estimates from CYGNSS, MODIS, and Landsat were within 2.3% of each other regardless of the sub-basin observed. Overall, this study provides valuable insight into the spatial similarities and discrepancies of inland water masks derived from optical (visible) versus radar (Global Navigation Satellite System Reflectometry, GNSS-R) based satellite Earth observations.

    more » « less
  4. The long-term variability of lacustrine dynamics is influenced by hydro-climatological factors that affect the depth and spatial extent of water bodies. The primary objective of this study is to delineate lake area extent, utilizing a machine learning approach, and to examine the impact of these hydro-climatological factors on lake dynamics. In situ and remote sensing observations were employed to identify the predominant explanatory pathways for assessing the fluctuations in lake area. The Great Salt Lake (GSL) and Lake Chad (LC) were chosen as study sites due to their semi-arid regional settings, enabling the testing of the proposed approach. The random forest (RF) supervised classification algorithm was applied to estimate the lake area extent using Landsat imagery that was acquired between 1999 and 2021. The long-term lake dynamics were evaluated using remotely sensed evapotranspiration data that were derived from MODIS, precipitation data that were sourced from CHIRPS, and in situ water level measurements. The findings revealed a marked decline in the GSL area extent, exceeding 50% between 1999 and 2021, whereas LC exhibited greater fluctuations with a comparatively lower decrease in its area extent, which was approximately 30% during the same period. The framework that is presented in this study demonstrates the reliability of remote sensing data and machine learning methodologies for monitoring lacustrine dynamics. Furthermore, it provides valuable insights for decision makers and water resource managers in assessing the temporal variability of lake dynamics. 
    more » « less
  5. Mapping crop types and land cover in smallholder farming systems in sub-Saharan Africa remains a challenge due to data costs, high cloud cover, and poor temporal resolution of satellite data. With improvement in satellite technology and image processing techniques, there is a potential for integrating data from sensors with different spectral characteristics and temporal resolutions to effectively map crop types and land cover. In our Malawi study area, it is common that there are no cloud-free images available for the entire crop growth season. The goal of this experiment is to produce detailed crop type and land cover maps in agricultural landscapes using the Sentinel-1 (S-1) radar data, Sentinel-2 (S-2) optical data, S-2 and PlanetScope data fusion, and S-1 C2 matrix and S-1 H/α polarimetric decomposition. We evaluated the ability to combine these data to map crop types and land cover in two smallholder farming locations. The random forest algorithm, trained with crop and land cover type data collected in the field, complemented with samples digitized from Google Earth Pro and DigitalGlobe, was used for the classification experiments. The results show that the S-2 and PlanetScope fused image + S-1 covariance (C2) matrix + H/α polarimetric decomposition (an entropy-based decomposition method) fusion outperformed all other image combinations, producing higher overall accuracies (OAs) (>85%) and Kappa coefficients (>0.80). These OAs represent a 13.53% and 11.7% improvement on the Sentinel-2-only (OAs < 80%) experiment for Thimalala and Edundu, respectively. The experiment also provided accurate insights into the distribution of crop and land cover types in the area. The findings suggest that in cloud-dense and resource-poor locations, fusing high temporal resolution radar data with available optical data presents an opportunity for operational mapping of crop types and land cover to support food security and environmental management decision-making. 
    more » « less