skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Multi-agent management of integrated food-energy-water systems using stochastic games: from Nash equilibrium to the social optimum
Abstract System-level integration and optimization of food-energy-water systems (FEWS) require coordination of multiple agencies and decision-makers and incorporating their interdependence. In general, such coordination might be hard to achieve. As a result, the literature on FEWS management either optimizes the operations for one sector (or one decision-maker), or models interdependence among the sectors without optimizing their operations. In this article, we develop a novel multi-agent management optimization approach that is able to incorporate stochasticity and uncertainty in the system’s dynamics and interdependence of the water and energy resources for food production. The proposed method is the first attempt to utilize fundamentals of decision and game theories to optimize operations of multi-agent FEWS. We specifically focus on differentiating between (1) cooperative decision optimization of the operations, where all decision-makers cooperate to achieve the best outcome for the whole system, the social optimum, and (2) non-cooperative decision-making of the agents, the Nash equilibrium. Illustrating with a real-world case study of FEWS in Ventura County, California, we show the difference between the cooperative and non-cooperative decision making in terms of long-term expected cost of managing the system. We further show how the extra costs associated with utilizing the renewable sources of water and energy could be incentivised, so that the non-cooperative solution (the Nash equilibrium) would naturally converge to the best outcome for the whole system (the social optimum).  more » « less
Award ID(s):
1739676
PAR ID:
10190987
Author(s) / Creator(s):
; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Environmental Research Letters
Volume:
15
Issue:
9
ISSN:
1748-9326
Page Range / eLocation ID:
Article No. 0940a4
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The nexus of food, energy, and water systems (FEWS) has become a salient research topic, as well as a pressing societal and policy challenge. Computational modeling is a key tool in addressing these challenges, and FEWS modeling as a subfield is now established. However, social dimensions of FEWS nexus issues, such as individual or social learning, technology adoption decisions, and adaptive behaviors, remain relatively underdeveloped in FEWS modeling and research. Agent-based models (ABMs) have received increasing usage recently in efforts to better represent and integrate human behavior into FEWS research. A systematic review identified 29 articles in which at least two food, energy, or water sectors were explicitly considered with an ABM and/or ABM-coupled modeling approach. Agent decision-making and behavior ranged from reactive to active, motivated by primarily economic objectives to multi-criteria in nature, and implemented with individual-based to highly aggregated entities. However, a significant proportion of models did not contain agent interactions, or did not base agent decision-making on existing behavioral theories. Model design choices imposed by data limitations, structural requirements for coupling with other simulation models, or spatial and/or temporal scales of application resulted in agent representations lacking explicit decision-making processes or social interactions. In contrast, several methodological innovations were also noted, which were catalyzed by the challenges associated with developing multi-scale, cross-sector models. Several avenues for future research with ABMs in FEWS research are suggested based on these findings. The reviewed ABM applications represent progress, yet many opportunities for more behaviorally rich agent-based modeling in the FEWS context remain. 
    more » « less
  2. Shared/buy-in computing systems offer users the option to select between buy-in and shared services. In such systems, idle buy-in resources are made available to other users for sharing. With strategic users, resource purchase and allocation in such systems can be cast as a non-cooperative game, whose corresponding Nash equilibrium does not necessarily result in the optimal social cost. In this study, we first derive the optimal social cost of the game in closed form, by casting it as a convex optimization problem and establishing related properties. Next, we derive a closed-form expression for the social cost at the Nash equilibrium, and show that it can be computed in linear time. We further show that the strategy profiles of users at the optimum and the Nash equilibrium are directly proportional. We measure the inefficiency of the Nash equilibrium through the price of anarchy, and show that it can be quite large in certain cases, e.g., when the operating expense ratio is low or when the distribution of user workloads is relatively homogeneous. To improve the efficiency of the system, we propose and analyze two subsidy policies, which are shown to converge using best-response dynamics. 
    more » « less
  3. Abstract Integrated management of food–energy–water systems (FEWS) requires a unified, flexible and reproducible approach to incorporate the interdependence between sectors, and include the risk of non-stationary environmental variations due to climate change. Most of the recently developed methods in the literature fall short of one or more aspects in such integration. In this article, we propose a novel approach based upon fundamentals of decision theory and reinforcement learning that (1) quantifies and propagates uncertainty, (2) incorporates resource interdependence, (3) includes the impact of uncontrolled variables such as climate variations, and (4) adaptively optimizes management decisions to minimize the costs and environmental impacts of crop production. Moreover, the proposed method is robust to problem-specific complexities and is easily reproducible. We illustrate the framework on a real-world case study in Ventura County, California. 
    more » « less
  4. null (Ed.)
    Most people in the world live in urban areas, and their high population densities, heavy reliance on external sources of food, energy, and water, and disproportionately large waste production result in severe and cumulative negative environmental effects. Integrated study of urban areas requires a system-of-systems analytical framework that includes modeling with social and biophysical data. We describe preliminary work toward an integrated urban food-energy-water systems (FEWS) analysis using co-simulation for assessment of current and future conditions, with an emphasis on local (urban and urban-adjacent) food production. We create a framework to enable simultaneous analyses of climate dynamics, changes in land cover, built forms, energy use, and environmental outcomes associated with a set of drivers of system change related to policy, crop management, technology, social interaction, and market forces affecting food production. The ultimate goal of our research program is to enhance understanding of the urban FEWS nexus so as to improve system function and management, increase resilience, and enhance sustainability. Our approach involves data-driven co-simulation to enable coupling of disparate food, energy and water simulation models across a range of spatial and temporal scales. When complete, these models will quantify energy use and water quality outcomes for current systems, and determine if undesirable environmental effects are decreased and local food supply is increased with different configurations of socioeconomic and biophysical factors in urban and urban-adjacent areas. The effort emphasizes use of open-source simulation models and expert knowledge to guide modeling for individual and combined systems in the urban FEWS nexus. 
    more » « less
  5. null (Ed.)
    Community and stakeholder engagement is increasingly recognized as essential to science at the nexus of food, energy, and water systems (FEWS) to address complex issues surrounding food and energy production and water provision for society. Yet no comprehensive framework exists for supporting best practices in community and stakeholder engagement for FEWS. A review and meta-synthesis were undertaken of a broad range of existing models, frameworks, and toolkits for community and stakeholder engagement. A framework is proposed that comprises situational awareness of the FEWS place or problem, creation of a suitable culture for engagement, focus on power-sharing in the engagement process, co-ownership, co-generation of knowledge and outcomes, the technical process of integration, the monitoring processes of reflective and reflexive experiences, and formative evaluation. The framework is discussed as a scaffolding for supporting the development and application of best practices in community and stakeholder engagement in ways that are arguably essential for sound FEWS science and sustainable management. 
    more » « less