skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Spatiotemporal Data Augmentation of MODIS‐Landsat Water Bodies Using Adversarial Networks
Abstract With increasing demands for precise water resource management, there is a growing need for advanced techniques in mapping water bodies. The currently deployed satellites provide complementary data that are either of high spatial or high temporal resolutions. As a result, there is a clear trade‐off between space and time when considering a single data source. For the efficient monitoring of multiple environmental resources, various Earth science applications need data at high spatial and temporal resolutions. To address this need, many data fusion methods have been described in the literature, that rely on combining data snapshots from multiple sources. Traditional methods face limitations due to sensitivity to atmospheric disturbances and other environmental factors, resulting in noise, outliers, and missing data. This paper introduces Hydrological Generative Adversarial Network (Hydro‐GAN), a novel machine learning‐based method that utilizes modified GANs to enhance boundary accuracy when mapping low‐resolution MODIS data to high‐resolution Landsat‐8 images. We propose a new non‐saturating loss function for the Hydro‐GAN generator, which maximizes the log of discriminator probabilities to promote stable updates and aid convergence. By focusing on reducing squared differences between real and synthetic images, our approach enhances training stability and overall performance. We specifically focus on mapping water bodies using MODIS and Landsat‐8 imagery due to their relevance in water resource management tasks. Our experimental results demonstrate the effectiveness of Hydro‐GAN in generating high‐resolution water body maps, outperforming traditional methods in terms of boundary accuracy and overall quality.  more » « less
Award ID(s):
2305781 2153379 2204363 2240022 2118329
PAR ID:
10509312
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
AGU
Date Published:
Journal Name:
Water Resources Research
Volume:
60
Issue:
3
ISSN:
0043-1397
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Understanding and monitoring nearshore environments is essential, given that these fine-scaled ecosystems are integral to human well-being. While satellites offer an opportunity to gain synchronous and spatially extensive data of coastal areas, off-the-shelf calibrated satellite sea surface temperature (SST) measurements have only been available at coarse resolutions of 1 km or larger. In this study, we develop a novel methodology to create a simple linear equation to calibrate fine-scale Landsat thermal infrared radiation brightness temperatures (calibrated for land sensing) to derive SST at a resolution of 100 m. The constants of this equation are derived from correlations of coincident MODIS SST and Landsat data, which we filter to find optimal pairs. Validation against in situ sensor data at varying distances from the shore in Northern California shows that our SST estimates are more accurate than prior off-the-shelf Landsat data calibrated for land surfaces. These fine-scale SST estimates also demonstrate superior accuracy compared with coincident MODIS SST estimates. The root mean square error for our minimally filtered dataset (n = 557 images) ranges from 0.76 to 1.20 °C with correlation coefficients from r = 0.73 to 0.92, and for our optimal dataset (n = 229 images), the error is from 0.62 to 0.98 °C with correlations from r = 0.83 to 0.92. Potential error sources related to stratification and seasonality are examined and we conclude that Landsat data represent skin temperatures with an error between 0.62 and 0.73 °C. We discuss the utility of our methodology for enhancing coastal monitoring efforts and capturing previously unseen spatial complexity. Testing the calibration methodology on Landsat images before and after the temporal bounds of accurate MODIS SST measurements shows successful calibration with lower errors than the off-the-shelf, land-calibrated Landsat product, extending the applicability of our approach. This new approach for obtaining high-resolution SST data in nearshore waters may be applied to other upwelling regions globally, contributing to improved coastal monitoring, management, and research. 
    more » « less
  2. WaterSmart project is an NSF funded projected seeks water consumption reduction using satellite observations. In order to fit the fine temporal resolution requirement, satellites are required to have a high revisit cycle. MODIS is an ideal platform for monitoring the ground thanks to its daily coverage while the spatial resolution is too coarse. Research has demonstrated the possibility to improve the spatial resolution of MODIS using the Landsat 8 images. This research is aimed to establish a workflow to adapt the data fusion algorithm to achieve automatically processing at real-time in order to support short-term decision making. 
    more » « less
  3. Accurate and timely large-scale paddy rice maps with remote sensing are essential for crop monitoring and management and are used for assessing its impacts on food security, water resource management, and transmission of zoonotic infectious diseases. Optical image-based paddy rice mapping studies employed the unique spectral feature during the flooding/transplanting period of paddy rice. However, the lack of high-quality observations during the flooding/transplanting stage caused by rain and clouds and spectral similarity between paddy rice and natural wetlands often introduce errors in paddy rice identification, especially in paddy rice and wetland coexistent areas. In this study, we used a knowledge-based algorithm and time series observation from optical images (Sentinel-2 and Landsat 7/8) and microwave images (Sentinel-1) to address these issues. The final 10-m paddy rice map had user’s accuracy, producer’s accuracy, F1-score, and overall accuracy of 0.91 ± 0.004, 0.74 ± 0.010, 0.82, and 0.98 ± 0.001 (± value is the standard error), respectively. Over half (62.0%) of the paddy rice pixels had a confidence level of 1 (detected by both optical images and microwave images), while 38.0% had a confidence level of 0.5 (detected by either optical images or microwave images). The estimated paddy rice area in northeast China for 2020 was 60.83 ± 0.86 × 103 km2. Provincial and municipal rice areas in our data set agreed well with other existing paddy rice data sets and the Agricultural Statistical Yearbooks. These findings indicate that knowledge-based paddy rice mapping algorithms and a combination of optical and microwave images hold great potential for timely and frequently accurate paddy rice mapping in large-scale complex landscapes. 
    more » « less
  4. null (Ed.)
    Mapping invasive vegetation species in arid regions is a critical task for managing water resources and understanding threats to ecosystem services. Traditional remote sensing platforms, such as Landsat and MODIS, are ill-suited for distinguishing native and non-native vegetation species in arid regions due to their large pixels compared to plant sizes. Unmanned aircraft systems, or UAS, offer the potential to capture the high spatial resolution imagery needed to differentiate species. However, in order to extract the most benefits from these platforms, there is a need to develop more efficient and effective workflows. This paper presents an integrated spectral–structural workflow for classifying invasive vegetation species in the Lower Salt River region of Arizona, which has been the site of fires and flooding, leading to a proliferation of invasive vegetation species. Visible (RGB) and multispectral images were captured and processed following a typical structure from motion workflow, and the derived datasets were used as inputs in two machine learning classifications—one incorporating only spectral information and one utilizing both spectral data and structural layers (e.g., digital terrain model (DTM) and canopy height model (CHM)). Results show that including structural layers in the classification improved overall accuracy from 80% to 93% compared to the spectral-only model. The most important features for classification were the CHM and DTM, with the blue band and two spectral indices (normalized difference water index (NDWI) and normalized difference salinity index (NDSI)) contributing important spectral information to both models. 
    more » « less
  5. The long-term variability of lacustrine dynamics is influenced by hydro-climatological factors that affect the depth and spatial extent of water bodies. The primary objective of this study is to delineate lake area extent, utilizing a machine learning approach, and to examine the impact of these hydro-climatological factors on lake dynamics. In situ and remote sensing observations were employed to identify the predominant explanatory pathways for assessing the fluctuations in lake area. The Great Salt Lake (GSL) and Lake Chad (LC) were chosen as study sites due to their semi-arid regional settings, enabling the testing of the proposed approach. The random forest (RF) supervised classification algorithm was applied to estimate the lake area extent using Landsat imagery that was acquired between 1999 and 2021. The long-term lake dynamics were evaluated using remotely sensed evapotranspiration data that were derived from MODIS, precipitation data that were sourced from CHIRPS, and in situ water level measurements. The findings revealed a marked decline in the GSL area extent, exceeding 50% between 1999 and 2021, whereas LC exhibited greater fluctuations with a comparatively lower decrease in its area extent, which was approximately 30% during the same period. The framework that is presented in this study demonstrates the reliability of remote sensing data and machine learning methodologies for monitoring lacustrine dynamics. Furthermore, it provides valuable insights for decision makers and water resource managers in assessing the temporal variability of lake dynamics. 
    more » « less