skip to main content


Title: Dynamic Adaptation of Water Resources Systems Under Uncertainty by Learning Policy Structure and Indicators
Abstract

The challenge of adapting water resources systems to uncertain hydroclimatic and socioeconomic conditions warrants a dynamic planning approach. Recent studies have designed policies with structures linking infrastructure and management actions to threshold values of indicator variables observed over time. Typically, one or more of these components are held fixed while the others are optimized, constraining the flexibility of policy generation. Here we develop a framework to address this challenge by designing and testing dynamic adaptation policies that combine indicators, actions, and thresholds in a flexible structure. The approach is demonstrated for a case study of northern California, where a mix of infrastructure, management, and operational adaptations are considered over time in response to an ensemble of nonstationary hydrology and water demands. We first identify a subset of non‐dominated policies that are robust to held‐out scenarios, and then analyze their most common actions and indicators compared to non‐robust policies. Results show that the robust policies are not differentiated by the actions they select, but show substantial differences in their indicator variables, which can be interpreted in the context of physical hydrologic trends. In particular, the most frequent statistical transformations of indicator variables highlight the balance between adapting quickly versus correctly. Additionally, we determine the indicators most frequently associated with each action, as well as the distribution of action timing across scenarios. This study presents a new and transferable problem framing for adaptation under uncertainty in which indicator variables, actions, and policy structure are identified simultaneously during the optimization.

 
more » « less
Award ID(s):
1639268 2041826
NSF-PAR ID:
10446461
Author(s) / Creator(s):
 ;  
Publisher / Repository:
DOI PREFIX: 10.1029
Date Published:
Journal Name:
Water Resources Research
Volume:
57
Issue:
11
ISSN:
0043-1397
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Long-term snowpack decline is among the best-understood impacts of climate change on water resources systems. This trend has been observed for decades and is projected to continue even in climate projections in which total runoff volumes do not change significantly. For basins in which snowpack has historically provided intra-annual water storage, snowpack decline creates several issues that may require adaptation to infrastructure, operations, or both. This study develops an approach to analyze vulnerabilities and adaptations specifically focused on the challenge of snowpack decline, using the northern California reservoir system as a case study. We first introduce an open-source daily time-step simulation model of this system, which is validated against historical observations of operations. Multiobjective vulnerabilities to snowpack decline are then examined using a set of downscaled climate scenarios to capture the physically based effects of rising temperatures. A statistical analysis shows that the primary impacts include water supply shortage and lower reservoir storage resulting from the seasonal shift in runoff timing. These challenges identified from the vulnerability assessment inform proposed adaptations to operations to maintain multiobjective performance across the ensemble of plausible future scenarios, which include other uncertain hydrologic changes. To adapt seasonal reservoir management without the cost of additional infrastructure, we specifically propose and test adaptations that parameterize the structure of existing operating policies: a dynamic flood control rule curve and revised snowpack-to-streamflow forecasting methods to improve seasonal runoff predictability given declining snowpack. These adaptations are shown to mitigate the majority of vulnerabilities caused by snowpack decline across the scenario ensemble, with remaining opportunities for improvement using formal policy search and dynamic adaptation techniques. The coupled approach to vulnerability assessment and adaptation is generalizable to other snowmelt-dominated water resources systems facing the loss of seasonal storage due to rising temperatures. 
    more » « less
  2. We study adaptive video streaming for multiple users in wireless access edge networks with unreliable channels. The key challenge is to jointly optimize the video bitrate adaptation and resource allocation such that the users' cumulative quality of experience is maximized. This problem is a finite-horizon restless multi-armed multi-action bandit problem and is provably hard to solve. To overcome this challenge, we propose a computationally appealing index policy entitled Quality Index Policy, which is well-defined without the Whittle indexability condition and is provably asymptotically optimal without the global attractor condition. These two conditions are widely needed in the design of most existing index policies, which are difficult to establish in general. Since the wireless access edge network environment is highly dynamic with system parameters unknown and time-varying, we further develop an index-aware reinforcement learning (RL) algorithm dubbed QA-UCB. We show that QA-UCB achieves a sub-linear regret with a low-complexity since it fully exploits the structure of the Quality Index Policy for making decisions. Extensive simulations using real-world traces demonstrate significant gains of proposed policies over conventional approaches. We note that the proposed framework for designing index policy and index-aware RL algorithm is of independent interest and could be useful for other large-scale multi-user problems. 
    more » « less
  3. Faced with sea level rise and the intensification of extreme events, human populations living on the coasts are developing responses to address local situations. A synthesis of the literature on responses to coastal adaptation allows us to highlight different adaptation strategies. Here, we analyze these strategies according to the complexity of their implementation, both institutionally and technically. First, we distinguish two opposing paradigms – fighting against rising sea levels or adapting to new climatic conditions; and second, we observe the level of integrated management of the strategies. This typology allows a distinction between four archetypes with the most commonly associated governance modalities for each. We then underline the need for hybrid approaches and adaptation trajectories over time to take into account local socio-cultural, geographical, and climatic conditions as well as to integrate stakeholders in the design and implementation of responses. We show that dynamic and participatory policies can foster collective learning processes and enable the evolution of social values and behaviors. Finally, adaptation policies rely on knowledge and participatory engagement, multi-scalar governance, policy monitoring, and territorial solidarity. These conditions are especially relevant for densely populated areas that will be confronted with sea level rise, thus for coastal cities in particular. 
    more » « less
  4. Translating information between the domains of systematics and conservation requires novel information management designs. Such designs should improve interactions across the trading zone between the domains, herein understood as the model according to which knowledge and uncertainty are productively translated in both directions (cf. Collins et al. 2019). Two commonly held attitudes stand in the way of designing a well-functioning systematics-to-conservation trading zone. On one side, there are calls to unify the knowledge signal produced by systematics, underpinned by the argument that such unification is a necessary precondition for conservation policy to be reliably expressed and enacted (e.g., Garnett et al. 2020). As a matter of legal scholarship, the argument for systematic unity by legislative necessity is principally false (Weiss 2003, MacNeil 2009, Chromá 2011), but perhaps effective enough as a strategy to win over audiences unsure about robust law-making practices in light of variable and uncertain knowledge. On the other side, there is an attitude that conservation cannot ever restrict the academic freedom of systematics as a scientific discipline (e.g., Raposo et al. 2017). This otherwise sound argument misses the mark in the context of designing a productive trading zone with conservation. The central interactional challenge is not whether the systematic knowledge can vary at a given time and/or evolve over time, but whether these signal dynamics are tractable in ways that actors can translate into robust maxims for conservation. Redesigning the trading zone should rest on the (historically validated) projection that systematics will continue to attract generations of inspired, productive researchers and broad-based societal support, frequently leading to protracted conflicts and dramatic shifts in how practioners in the field organize and identify organismal lineages subject to conservation. This confident outlook for systematics' future, in turn, should refocus the challenge of designing the trading zone as one of building better information services to model the concurrent conflicts and longer-term evolution of systematic knowledge. It would seem unreasonable to expect the International Union for Conservation of Nature (IUCN) Red List Index to develop better data science models for the dynamics of systematic knowledge (cf. Hoffmann et al. 2011) than are operational in the most reputable information systems designed and used by domain experts (Burgin et al. 2018). The reasonable challenge from conservation to systematics is not to stop being a science but to be a better data science. In this paper, we will review advances in biodiversity data science in relation to representing and reasoning over changes in systematic knowledge with computational logic, i.e., modeling systematic intelligence (Franz et al. 2016). We stress-test this approach with a use case where rapid systematic signal change and high stakes for conservation action intersect, i.e., the Malagasy mouse lemurs ( Microcebus É. Geoffroy, 1834 sec. Schüßler et al. 2020), where the number of recognized species-level concepts has risen from 2 to 25 in the span of 38 years (1982–2020). As much as scientifically defensible, we extend our modeling approach to the level of individual published occurrence records, where the inability to do so sometimes reflects substandard practice but more importantly reveals systemic inadequacies in biodiversity data science or informational modeling. In the absence of shared, sound theoretical foundations to assess taxonomic congruence or incongruence across treatments, and in the absence of biodiversity data platforms capable of propagating logic-enabled, scalable occurrence-to-concept identification events to produce alternative and succeeding distribution maps, there is no robust way to provide a knowledge signal from systematics to conservation that is both consistent in its syntax and acccurate in its semantics, in the sense of accurately reflecting the variation and uncertainty that exists across multiple systematic perspectives. Translating this diagnosis into new designs for the trading zone is only one "half" of the solution, i.e., a technical advancement that then would need to be socially endorsed and incentivized by systematic and conservation communities motivated to elevate their collaborative interactions and trade robustly in inherently variable and uncertain information. 
    more » « less
  5. Many transit agencies operating paratransit and microtransit ser-vices have to respond to trip requests that arrive in real-time, which entails solving hard combinatorial and sequential decision-making problems under uncertainty. To avoid decisions that lead to signifi-cant inefficiency in the long term, vehicles should be allocated to requests by optimizing a non-myopic utility function or by batching requests together and optimizing a myopic utility function. While the former approach is typically offline, the latter can be performed online. We point out two major issues with such approaches when applied to paratransit services in practice. First, it is difficult to batch paratransit requests together as they are temporally sparse. Second, the environment in which transit agencies operate changes dynamically (e.g., traffic conditions can change over time), causing the estimates that are learned offline to become stale. To address these challenges, we propose a fully online approach to solve the dynamic vehicle routing problem (DVRP) with time windows and stochastic trip requests that is robust to changing environmental dynamics by construction. We focus on scenarios where requests are relatively sparse-our problem is motivated by applications to paratransit services. We formulate DVRP as a Markov decision process and use Monte Carlo tree search to evaluate actions for any given state. Accounting for stochastic requests while optimizing a non-myopic utility function is computationally challenging; indeed, the action space for such a problem is intractably large in practice. To tackle the large action space, we leverage the structure of the problem to design heuristics that can sample promising actions for the tree search. Our experiments using real-world data from our partner agency show that the proposed approach outperforms existing state-of-the-art approaches both in terms of performance and robustness. 
    more » « less