skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Patch Similarity Convolutional Neural Network for Urban Flood Extent Mapping Using Bi-Temporal Satellite Multispectral Imagery
Title: Patch Similarity Convolutional Neural Network for Urban Flood Extent Mapping Using Bi-Temporal Satellite Multispectral Imagery
Urban flooding is a major natural disaster that poses a serious threat to the urban environment. It is highly demanded that the flood extent can be mapped in near real-time for disaster rescue and relief missions, reconstruction efforts, and financial loss evaluation. Many efforts have been taken to identify the flooding zones with remote sensing data and image processing techniques. Unfortunately, the near real-time production of accurate flood maps over impacted urban areas has not been well investigated due to three major issues. (1) Satellite imagery with high spatial resolution over urban areas usually has nonhomogeneous background due to different types of objects such as buildings, moving vehicles, and road networks. As such, classical machine learning approaches hardly can model the spatial relationship between sample pixels in the flooding area. (2) Handcrafted features associated with the data are usually required as input for conventional flood mapping models, which may not be able to fully utilize the underlying patterns of a large number of available data. (3) High-resolution optical imagery often has varied pixel digital numbers (DNs) for the same ground objects as a result of highly inconsistent illumination conditions during a flood. Accordingly, traditional methods of flood mapping have major limitations in generalization based on testing data. To address the aforementioned issues in urban flood mapping, we developed a patch similarity convolutional neural network (PSNet) using satellite multispectral surface reflectance imagery before and after flooding with a spatial resolution of 3 meters. We used spectral reflectance instead of raw pixel DNs so that the influence of inconsistent illumination caused by varied weather conditions at the time of data collection can be greatly reduced. Such consistent spectral reflectance data also enhance the generalization capability of the proposed model. Experiments on the high resolution imagery before and after the urban flooding events (i.e., the 2017 Hurricane Harvey and the 2018 Hurricane Florence) showed that the developed PSNet can produce urban flood maps with consistently high precision, recall, F1 score, and overall accuracy compared with baseline classification models including support vector machine, decision tree, random forest, and AdaBoost, which were often poor in either precision or recall. The study paves the way to fuse bi-temporal remote sensing images for near real-time precision damage mapping associated with other types of natural hazards (e.g., wildfires and earthquakes).  more » « less
Award ID(s):
1940091
NSF-PAR ID:
10207918
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Remote Sensing
Volume:
11
Issue:
21
ISSN:
2072-4292
Page Range / eLocation ID:
2492
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , Scientific Reports)
    Abstract

    Flood nowcasting refers to near-future prediction of flood status as an extreme weather event unfolds to enhance situational awareness. The objective of this study was to adopt and test a novel structured deep-learning model for urban flood nowcasting by integrating physics-based and human-sensed features. We present a new computational modeling framework including an attention-based spatial–temporal graph convolution network (ASTGCN) model and different streams of data that are collected in real-time, preprocessed, and fed into the model to consider spatial and temporal information and dependencies that improve flood nowcasting. The novelty of the computational modeling framework is threefold: first, the model is capable of considering spatial and temporal dependencies in inundation propagation thanks to the spatial and temporal graph convolutional modules; second, it enables capturing the influence of heterogeneous temporal data streams that can signal flooding status, including physics-based features (e.g., rainfall intensity and water elevation) and human-sensed data (e.g., residents’ flood reports and fluctuations of human activity) on flood nowcasting. Third, its attention mechanism enables the model to direct its focus to the most influential features that vary dynamically and influence the flood nowcasting. We show the application of the modeling framework in the context of Harris County, Texas, as the study area and 2017 Hurricane Harvey as the flood event. Three categories of features are used for nowcasting the extent of flood inundation in different census tracts: (i) static features that capture spatial characteristics of various locations and influence their flood status similarity, (ii) physics-based dynamic features that capture changes in hydrodynamic variables, and (iii) heterogeneous human-sensed dynamic features that capture various aspects of residents’ activities that can provide information regarding flood status. Results indicate that the ASTGCN model provides superior performance for nowcasting of urban flood inundation at the census-tract level, with precision 0.808 and recall 0.891, which shows the model performs better compared with other state-of-the-art models. Moreover, ASTGCN model performance improves when heterogeneous dynamic features are added into the model that solely relies on physics-based features, which demonstrates the promise of using heterogenous human-sensed data for flood nowcasting. Given the results of the comparisons of the models, the proposed modeling framework has the potential to be more investigated when more data of historical events are available in order to develop a predictive tool to provide community responders with an enhanced prediction of the flood inundation during urban flood.

     
    more » « less
  2. ; ; ; ( , Hydrology)

    The identification of flood hazards during emerging public safety crises such as hurricanes or flash floods is an invaluable tool for first responders and managers yet remains out of reach in any comprehensive sense when using traditional remote-sensing methods, due to cloud cover and other data-sourcing restrictions. While many remote-sensing techniques exist for floodwater identification and extraction, few studies demonstrate an up-to-day understanding with better techniques in isolating the spectral properties of floodwaters from collected data, which vary for each event. This study introduces a novel method for delineating near-real-time inundation flood extent and depth mapping for storm events, using an inexpensive unmanned aerial vehicle (UAV)-based multispectral remote-sensing platform, which was designed to be applicable for urban environments, under a wide range of atmospheric conditions. The methodology is demonstrated using an actual flooding-event—Hurricane Zeta during the 2020 Atlantic hurricane season. Referred to as the UAV and Floodwater Inundation and Depth Mapper (FIDM), the methodology consists of three major components, including aerial data collection, processing, and flood inundation (water surface extent) and depth mapping. The model results for inundation and depth were compared to a validation dataset and ground-truthing data, respectively. The results suggest that UAV-FIDM is able to predict inundation with a total error (sum of omission and commission errors) of 15.8% and produce flooding depth estimates that are accurate enough to be actionable to determine road closures for a real event.

     
    more » « less
  3. ; ; ; ( , Journal of Flood Risk Management)
    Abstract

    Rescue requests during large‐scale urban flood disasters can be difficult to validate and prioritise. High‐resolution aerial imagery is often unavailable or lacks the necessary geographic extent, making it difficult to obtain real‐time information about where flooding is occurring. In this paper, we present a novel approach to map the extent of urban flooding in Harris County, Texas during Hurricane Harvey (August 25–30, 2017) and identify where people were most likely to need immediate emergency assistance. Using Maximum Entropy, we predict the probability of flooding based on several spatially‐distributed physical and socio‐economic characteristics coupled with crowdsourced data. We compare the results against two alternative flood datasets available after Hurricane Harvey (i.e., Copernicus satellite imagery and riverine flood depths estimated by FEMA), and we validate the performance of the model using a 15% subset of the rescue requests, Houston 311 flood calls, and inundated roadways. We find that the model predicts a much larger area of flooding than was shown by either Copernicus or FEMA when compared against the locations of rescue requests, and that it performs well using both a subset of rescue requests (AUC 0.917) and 311 calls (AUC 0.929) but is less sensitive to inundated roads (AUC 0.721).

     
    more » « less
  4. ; ; ; ; ; ; ; ; ; ; et al ( , Remote Sensing)
    Floods are often associated with hurricanes making landfall. When tropical cyclones/hurricanes make landfall, they are usually accompanied by heavy rainfall and storm surges that inundate coastal areas. The worst natural disaster in the United States, in terms of loss of life and property damage, was caused by hurricane storm surges and their associated coastal flooding. To monitor coastal flooding in the areas affected by hurricanes, we used data from sensors aboard the operational Polar-orbiting and Geostationary Operational Environmental Satellites. This study aims to apply a downscaling model to recent severe coastal flooding events caused by hurricanes. To demonstrate how high-resolution 3D flood mapping can be made from moderate-resolution operational satellite observations, the downscaling model was applied to the catastrophic coastal flooding in Florida due to Hurricane Ian and in New Orleans due to Hurricanes Ida and Laura. The floodwater fraction data derived from the SNPP/NOAA-20 VIIRS (Visible Infrared Imaging Radiometer Suite) observations at the original 375 m resolution were input into the downscaling model to obtain 3D flooding information at 30 m resolution, including flooding extent, water surface level and water depth. Compared to a 2D flood extent map at the VIIRS’ original 375 m resolution, the downscaled 30 m floodwater depth maps, even when shown as 2D images, can provide more details about floodwater distribution, while 3D visualizations can demonstrate floodwater depth more clearly in relative to the terrain and provide a more direct perception of the inundation situations caused by hurricanes. The use of 3D visualization can help users clearly see floodwaters occurring over various types of terrain conditions, thus identifying a hazardous flood from non-hazardous flood types. Furthermore, 3D maps displaying floodwater depth may provide additional information for rescue efforts and damage assessments. The downscaling model can help enhance the capabilities of moderate-to-coarse resolution sensors, such as those used in operational weather satellites, flood detection and monitoring. 
    more » « less
  5. ; ; ; ; ; ( , Remote Sensing)
    null (Ed.)
    Among all the natural hazards throughout the world, floods occur most frequently. They occur in high latitude regions, such as: 82% of the area of North America; most of Russia; Norway, Finland, and Sweden in North Europe; China and Japan in Asia. River flooding due to ice jams may happen during the spring breakup season. The Northeast and North Central region, and some areas of the western United States, are especially harmed by floods due to ice jams and snowmelt. In this study, observations from operational satellites are used to map and monitor floods due to ice jams and snowmelt. For a coarse-to-moderate resolution sensor on board the operational satellites, like the Visible Infrared Imaging Radiometer Suite (VIIRS) on board the National Polar-orbiting Partnership (NPP) and the Joint Polar Satellite System (JPSS) series, and the Advanced Baseline Imager (ABI) on board the GOES-R series, a pixel is usually composed of a mix of water and land. Water fraction can provide more information and can be estimated through mixed-pixel decomposition. The flood map can be derived from the water fraction difference after and before flooding. In high latitude areas, while conventional observations are usually sparse, multiple observations can be available from polar-orbiting satellites during a single day, and river forecasters can observe ice movement, snowmelt status and flood water evolution from satellite-based flood maps, which is very helpful in ice jam determination and flood prediction. The high temporal resolution of geostationary satellite imagery, like that of the ABI, can provide the greatest extent of flood signals, and multi-day composite flood products from higher spatial resolution imagery, such as VIIRS, can pinpoint areas of interest to uncover more details. One unique feature of our JPSS and GOES-R flood products is that they include not only normal flood type, but also a special flood type as the supra-snow/ice flood, and moreover, snow and ice masks. Following the demonstrations in this study, it is expected that the JPSS and GOES-R flood products, with ice and snow information, can allow dynamic monitoring and prediction of floods due to ice jams and snowmelt for wide-end users. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email