skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 9:30 PM ET on Friday, January 23 until 7:00 AM ET on Saturday, January 24 due to maintenance. We apologize for the inconvenience.


Title: Optimal Control of Combined Sewer Systems to Minimize Sewer Overflows by Using Reinforcement Learning
A combined sewer system (CSS) collects rainwater runoff, domestic sewage, and industrial wastewater in the same pipe. The volume of wastewater can sometimes exceed the system capacity during heavy rainfall events. When this occurs, untreated stormwater and wastewater discharge directly to nearby streams, rivers, and other water bodies. This would threaten public health and the environment, contributing to drinking water contamination and other concerns. Minimizing sewer overflows requires an optimization method that can provide an optimal sequence of decision variables at control gates. Conventional strategies use classical optimization algorithms, such as genetic algorithms and pattern search, to find the optimal sequence of decision variables. However, these conventional frameworks are very time-consuming, and it is almost impossible to achieve near real-time optimal control. This paper presents a faster optimization framework by using a new optimal control tool: reinforcement learning. The environment (flow modeler) used in this paper is the numerical model: Environmental Protection Agency’s Storm Water Management Model (EPA SWMM) to ensure the accuracy of environment response. The reward function is constructed based on the calculated water depth and overflow rate from SWMM. The process keeps minimizing the reward function to obtain the optimal flow release sequence at each controlled orifice gate. The combined sewer system (CSS) of the Puritan-Fenkell 7-mile facility in Detroit, MI, is chosen as the case study.  more » « less
Award ID(s):
2203292
PAR ID:
10459969
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
World Environmental and Water Resources Congress 2023
Page Range / eLocation ID:
711 to 722
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Combined sewer overflows (CSOs) occur when untreated raw sewage mixed with rainwater, runoff, or snowmelt is released during or after a storm in any community with a combined sewer system (CSS). Climate change makes CSOs worse in many locales; as the frequency and severity of wet weather events increases, so do the frequency and volume of CSO events. CSOs pose risks to humans and the environment, and as such, CSS communities are under regulatory pressure to reduce CSOs. Yet, CSS communities lack the tools needed, such as performance indicators, to assess CSS performance. Using the city of Cumberland, Maryland as a case study, we use public data on CSOs and precipitation over a span of 16 years to identify a new critical rainfall intensity threshold that triggers likely CSO incidence, and a multiple linear regression model to predict CSO volume using rainfall event characteristics. Together, this indicator and modeling approach can help CSS communities assess the performance of their CSS over time, especially to evaluate the effectiveness of efforts to reduce CSOs. 
    more » « less
  2. The City of Columbus, Ohio is implementing a tunnel system to reduce the number of episodes of combined sewer overflows into the Scioto River. The tunnel systems provide relief to the existing Olentangy Scioto Interceptor Sewer. Two new tunnels being implemented are the OSIS Augmentation and Relief Sewer (OARS), in service since July 2017, and the Lower Olentangy Tunnel (LOT) that is planned to be in service in 2025. The performance of these tunnels in respect to high inflow conditions was investigated with the use of the HAST mixed flow model and the OpenFOAM CFD model to determine the magnitude of surges, the possibility of air pocket entrapment, air–water surging, and the consequences of uncontrolled air pocket releases through shafts. Inflows into the systems were obtained from a calibrated collection system SWMM model. Modeling results quantified surging in the tunnel dropshafts and their mitigation from built-in surge control chambers. HAST simulations also pointed to locations where air pockets could form. These results were used in OpenFOAM to determine the effects of uncontrolled air release through the shaft that links the two tunnels. It was shown that proper ventilation at the shaft will mitigate the growth of air phase pressure to damaging levels. 
    more » « less
  3. The increasing amount of data and the growing use of them in the information era have raised questions about the quality of data and its impact on the decision-making process. Currently, the importance of high-quality data is widely recognized by researchers and decision-makers. Sewer inspection data have been collected for over three decades, but the reliability of the data was questionable. It was estimated that between 25% and 50% of sewer inspection data is not usable due to data quality problems. In order to address reliability problems, a data quality evaluation framework is developed. Data quality evaluation is a multi-dimensional concept that includes both subjective perceptions and objective measurements. Five data quality metrics were defined to assess different quality dimensions of the sewer inspection data, including Accuracy, Consistency, Completeness, Uniqueness, and Validity. These data quality metrics were calculated for the collected sewer inspection data, and it was found that consistency and uniqueness are the major problems based on the current practices with sewer pipeline inspection. This paper contributes to the overall body of knowledge by providing a robust data quality evaluation framework for sewer system data for the first time, which will result in quality data for sewer asset management. 
    more » « less
  4. In this work, we consider two-stage quadratic optimization problems under ellipsoidal uncertainty. In the first stage, one needs to decide upon the values of a subset of optimization variables (control variables). In the second stage, the uncertainty is revealed, and the rest of the optimization variables (state variables) are set up as a solution to a known system of possibly nonlinear equations. This type of problem occurs, for instance, in optimization for dynamical systems, such as electric power systems as well as gas and water networks. We propose a convergent iterative algorithm to build a sequence of approximately robustly feasible solutions with an improving objective value. At each iteration, the algorithm optimizes over a subset of the feasible set and uses affine approximations of the second-stage equations while preserving the nonlinearity of other constraints. We implement our approach and demonstrate its performance on Matpower instances of AC optimal power flow. Although this paper focuses on quadratic problems, the approach is suitable for more general setups. 
    more » « less
  5. Abstract Untreated sewage discharges leading to environmental contamination are increasingly common in communities across the globe. The cause of these discharges ranges from sewer lines in disrepair, blockages, and in the era of more extreme wet weather events, the infiltration of stormwater into the system during heavy downpours. Regardless of the driver of these events, the aftermath results in raw sewage spilling into local waterways, city streets, and commercial and residential structures. Historical research in public health has thoroughly documented the connection between exposure to untreated sewage and waterborne disease. Recent research has detected antibiotic-resistant bacteria at wastewater treatment facilities at a time when deaths by antibiotic-resistant infections are on the rise. However, no research has explored the exposure pathways of antibiotic-resistant bacteria during sanitary sewer overflows and household-level sewage backups. In this commentary, we aim to introduce this new frontier of environmental health risks and disasters. To do this, we describe the history of modern sanitation and sewer infrastructure with a particular focus on wastewater infrastructure in the U.S. We also explore emerging risks and current methods for identifying antibiotic-resistant bacteria in the environment. We end with future directions for interdisciplinary scholarship at the nexus of urban planning, engineering, and public health by introducing the Water Emergency Team (WET) Project. WET is a community-based multi-method effort to identify environmental risks in the aftermath of household backups through (1) residential surveys, (2) indoor visual inspections, (3) environmental sampling, and (4) laboratory processing and reporting. Our hope is that by introducing this comprehensive approach to environmental risks analysis, other scholars will join us in this effort and ultimately towards addressing this grand challenge of our time. 
    more » « less