skip to main content


Title: A national scale big data analytics pipeline to assess the potential impacts of flooding on critical infrastructures and communities
With the rapid development of the Internet of Things (IoT) and Big Data infrastructure, crowdsourcing techniques have emerged to facilitate data processing and problem solving particularly for flood emergences purposes. A Flood Analytics Information System (FAIS) has been developed as a Python Web application to gather Big Data from multiple servers and analyze flooding impacts during historical and real-time events. The application is smartly designed to integrate crowd intelligence, machine learning (ML), and natural language processing of tweets to provide flood warning with the aim to improve situational awareness for flood risk management. FAIS, a national scale prototype, combines flood peak rates and river level information with geotagged tweets to identify a dynamic set of at-risk locations to flooding. The prototype was successfully tested in real-time during Hurricane Dorian flooding as well as for historical event (Hurricanes Florence) across the Carolinas, USA where the storm made extensive disruption to infrastructure and communities.  more » « less
Award ID(s):
2035685
NSF-PAR ID:
10270712
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Environmental modelling software
ISSN:
1364-8152
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. With the rapid development of the Internet of Things (IoT) and Big Data infrastructure, crowdsourcing techniques have emerged to facilitate data processing and problem solving particularly for flood emergences purposes. A Flood Analytics Information System (FAIS) has been developed as a Python Web application to gather Big Data from multiple servers and analyze flooding impacts during historical and real-time events. The application is smartly designed to integrate crowd intelligence, machine learning (ML), and natural language processing of tweets to provide flood warning with the aim to improve situational awareness for flood risk management. FAIS, a national scale prototype, combines flood peak rates and river level information with geotagged tweets to identify a dynamic set of at-risk locations to flooding. The prototype was successfully tested in real-time during Hurricane Dorian flooding as well as for historical event (Hurricanes Florence) across the Carolinas, USA where the storm made extensive disruption to infrastructure and communities. 
    more » « less
  2. Floods are among the most destructive natural hazard that affect millions of people across the world leading to severe loss of life and damage to property, critical infrastructure, and agriculture. Internet of Things (IoTs), machine learning (ML), and Big Data are exceptionally valuable tools for collecting the catastrophic readiness and countless actionable data. The aim of this presentation is to introduce Flood Analytics Information System (FAIS) as a data gathering and analytics system. FAIS application is smartly designed to integrate crowd intelligence, ML, and natural language processing of tweets to provide warning with the aim to improve flood situational awareness and risk assessment. FAIS has been Beta tested during major hurricane events in US where successive storms made extensive damage and disruption. The prototype successfully identifies a dynamic set of at-risk locations/communities using the USGS river gauge height readings and geotagged tweets intersected with watershed boundary. The list of prioritized locations can be updated, as the river monitoring system and condition change over time (typically every 15 minutes). The prototype also performs flood frequency analysis (FFA) using various probability distributions with the associated uncertainty estimation to assist engineers in designing safe structures. This presentation will discuss about the FAIS functionalities and real-time implementation of the prototype across south and southeast USA. This research is funded by the US National Science Foundation (NSF). 
    more » « less
  3. Successive hurricane events have brought new challenges to human life, critical infrastructure and the environment in the United States. This study introduced Flood Analytics Information System (FAIS) as a national scale data analytics application for real-time flood data collection and analysis. FAIS has been Beta tested across a mixed urban and rural basin in the Carolinas where Hurricane Florence made extensive damages and disruption. Our research aim was to develop and test an integrated solution based on real time Big data for stakeholder map-based dashboard visualizations that can be applicable to other countries and a range of weather-driven emergency situations. The prototype successfully identifies a dynamic set of at-risk locations using web-based river level and flood information. The list of prioritized locations can be updated every 15 minutes, as the environmental information and condition change. FAIS will be extended to collect data from other countries and other kinds of weather-related hazards such as snowstorms and wildfires. 
    more » « less
  4. This community‐based research aims to enhance local‐level flood management by utilising participatory geographic information systems (PGIS) methods to capture the spatial dimensions of community member flooding concerns in Hopkins Village, Belize. We offer a mixed methodology, applying participatory sketch mapping as a way to collect local knowledge about community perceptions of flooding in this data‐scarce context. We combine this local knowledge with quantitative geostatistical hot spot analysis of basic village infrastructure characteristics to reveal insights about community perceptions of and response to flood risk. The significance of this research lies in the application of PGIS methods to create two different primary datasets, which when analysed together offer a more complete story about community understanding and needs for flood management. One set of data (more qualitative in nature) originated from sketch maps with community members and answers descriptive questions about how people spatially conceptualise hydro‐meteorological hazards within their community. The other (more quantitative in nature) is the village's first publicly accessible infrastructure dataset (including information on building structures, roads, and drainage infrastructure) digitised by our research team from high‐resolution drone imagery. Attributes for the infrastructure dataset were developed in collaboration with community members to reflect their desires for data and information suited to conduct flood vulnerability assessment. Application of thematic coding and hot spot analysis to the data reveals concerns about hazards within their community and the measures they have taken to protect themselves in the absence of resources to develop community‐wide mitigation plans. Our work offers contributions to the participatory GIS literature by providing an example of sketch mapping methods to facilitate multi‐level management of community‐level flood risk in a data‐scarce setting, and demonstrating the multiple benefits of applied participatory GIS methods as a means of overcoming data scarcity.

     
    more » « less
  5. Abstract

    This paper presents a Bayesian network model to assess the vulnerability of the flood control infrastructure and to simulate failure cascade based on the topological structure of flood control networks along with hydrological information gathered from sensors. Two measures are proposed to characterize the flood control network vulnerability and failure cascade: (a) node failure probability (NFP), which determines the failure likelihood of each network component under each scenario of rainfall event, and (b) failure cascade susceptibility, which captures the susceptibility of a network component to failure due to failure of other links. The proposed model was tested in both single watershed and multiple watershed scenarios in Harris County, Texas using historical data from three different flooding events, including Hurricane Harvey in 2017. The proposed model was able to identify the most vulnerable flood control network segments prone to flooding in the face of extreme rainfall. The framework and results furnish a new tool and insights to help decision‐makers to prioritize infrastructure enhancement investments and actions. The proposed Bayesian network modeling framework also enables simulation of failure cascades in flood control infrastructures, and thus could be used for scenario planning as well as near‐real‐time inundation forecasting to inform emergency response planning and operation, and hence improve the flood resilience of urban areas.

     
    more » « less