An official website of the United States government
ABSTRACT Agent-based models (ABMs) have become essential tools for simulating complex biological, ecological, and social systems where emergent behaviors arise from the interactions among individual agents. Quantifying uncertainty through global sensitivity analysis is crucial for assessing the robustness and reliability of ABM predictions. However, most global sensitivity methods demand substantial computational resources, making them impractical for highly complex models. Here, we introduce SMoRe GloS (SurrogateModeling forRecapitulatingGlobalSensitivity), a novel, computationally efficient method for performing global sensitivity analysis of ABMs. By leveraging explicitly formulated surrogate models, SMoRe GloS allows for comprehensive parameter space exploration and uncertainty quantification without sacrificing accuracy. We demonstrate our method’s flexibility by applying it to two biological ABMs: a simple 2D cell proliferation assay and a complex 3D vascular tumor growth model. Our results show that SMoRe GloS is compatible with simpler methods like the Morris one-at-a-time method, and more computationally intensive variance-based methods like eFAST. SMoRe GloS accurately recovered global sensitivity indices in each case while achieving substantial speedups, completing analyses in minutes. In contrast, direct implementation of eFAST amounted to several days of CPU time for the complex ABM. Remarkably, our method also estimates sensitivities for ABM parameters representing processes not explicitly included in the surrogate model, further enhancing its utility. By making global sensitivity analysis feasible for computationally expensive models, SMoRe GloS opens up new opportunities for uncertainty quantification in complex systems, allowing for more in depth exploration of model behavior, thereby increasing confidence in model predictions.
more »
« less
Connecting Agent-Based Models with High-Dimensional Parameter Spaces to Multidimensional Data Using SMoRe ParS: A Surrogate Modeling Approach
Abstract Across a broad range of disciplines, agent-based models (ABMs) are increasingly utilized for replicating, predicting, and understanding complex systems and their emergent behavior. In the biological and biomedical sciences, researchers employ ABMs to elucidate complex cellular and molecular interactions across multiple scales under varying conditions. Data generated at these multiple scales, however, presents a computational challenge for robust analysis with ABMs. Indeed, calibrating ABMs remains an open topic of research due to their own high-dimensional parameter spaces. In response to these challenges, we extend and validate our novel methodology, Surrogate Modeling for Reconstructing Parameter Surfaces (SMoRe ParS), arriving at a computationally efficient framework for connecting high dimensional ABM parameter spaces with multidimensional data. Specifically, we modify SMoRe ParS to initially confine high dimensional ABM parameter spaces using unidimensional data, namely, single time-course information of in vitro cancer cell growth assays. Subsequently, we broaden the scope of our approach to encompass more complex ABMs and constrain parameter spaces using multidimensional data. We explore this extension with in vitro cancer cell inhibition assays involving the chemotherapeutic agent oxaliplatin. For each scenario, we validate and evaluate the effectiveness of our approach by comparing how well ABM simulations match the experimental data when using SMoRe ParS-inferred parameters versus parameters inferred by a commonly used direct method. In so doing, we show that our approach of using an explicitly formulated surrogate model as an interlocutor between the ABM and the experimental data effectively calibrates the ABM parameter space to multidimensional data. Our method thus provides a robust and scalable strategy for leveraging multidimensional data to inform multiscale ABMs and explore the uncertainty in their parameters.
more »
« less
- Award ID(s):
- 2324818
- PAR ID:
- 10511365
- Publisher / Repository:
- Springer
- Date Published:
- Journal Name:
- Bulletin of Mathematical Biology
- Volume:
- 86
- Issue:
- 1
- ISSN:
- 0092-8240
- Subject(s) / Keyword(s):
- Agent-based model Cancer Model parameterization Parameter identifiability Surrogate model
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Multiscale systems biology is having an increasingly powerful impact on our understanding of the interconnected molecular, cellular, and microenvironmental drivers of tumor growth and the effects of novel drugs and drug combinations for cancer therapy. Agent-based models (ABMs) that treat cells as autonomous decision-makers, each with their own intrinsic characteristics, are a natural platform for capturing intratumoral heterogeneity. Agent-based models are also useful for integrating the multiple time and spatial scales associated with vascular tumor growth and response to treatment. Despite all their benefits, the computational costs of solving agent-based models escalate and become prohibitive when simulating millions of cells, making parameter exploration and model parameterization from experimental data very challenging. Moreover, such data are typically limited, coarse-grained and may lack any spatial resolution, compounding these challenges. We address these issues by developing a first-of-its-kind method that leverages explicitly formulated surrogate models (SMs) to bridge the current computational divide between agent-based models and experimental data. In our approach, Surrogate Modeling for Reconstructing Parameter Surfaces (SMoRe ParS), we quantify the uncertainty in the relationship between agent-based model inputs and surrogate model parameters, and between surrogate model parameters and experimental data. In this way, surrogate model parameters serve as intermediaries between agent-based model input and data, making it possible to use them for calibration and uncertainty quantification of agent-based model parameters that map directly onto an experimental data set. We illustrate the functionality and novelty of Surrogate Modeling for Reconstructing Parameter Surfaces by applying it to an agent-based model of 3D vascular tumor growth, and experimental data in the form of tumor volume time-courses. Our method is broadly applicable to situations where preserving underlying mechanistic information is of interest, and where computational complexity and sparse, noisy calibration data hinder model parameterization.more » « less
-
null (Ed.)The nexus of food, energy, and water systems (FEWS) has become a salient research topic, as well as a pressing societal and policy challenge. Computational modeling is a key tool in addressing these challenges, and FEWS modeling as a subfield is now established. However, social dimensions of FEWS nexus issues, such as individual or social learning, technology adoption decisions, and adaptive behaviors, remain relatively underdeveloped in FEWS modeling and research. Agent-based models (ABMs) have received increasing usage recently in efforts to better represent and integrate human behavior into FEWS research. A systematic review identified 29 articles in which at least two food, energy, or water sectors were explicitly considered with an ABM and/or ABM-coupled modeling approach. Agent decision-making and behavior ranged from reactive to active, motivated by primarily economic objectives to multi-criteria in nature, and implemented with individual-based to highly aggregated entities. However, a significant proportion of models did not contain agent interactions, or did not base agent decision-making on existing behavioral theories. Model design choices imposed by data limitations, structural requirements for coupling with other simulation models, or spatial and/or temporal scales of application resulted in agent representations lacking explicit decision-making processes or social interactions. In contrast, several methodological innovations were also noted, which were catalyzed by the challenges associated with developing multi-scale, cross-sector models. Several avenues for future research with ABMs in FEWS research are suggested based on these findings. The reviewed ABM applications represent progress, yet many opportunities for more behaviorally rich agent-based modeling in the FEWS context remain.more » « less
-
null (Ed.)Agent-based models (ABM) play a prominent role in guiding critical decision-making and supporting the development of effective policies for better urban resilience and response to the COVID-19 pandemic. However, many ABMs lack realistic representations of human mobility, a key process that leads to physical interaction and subsequent spread of disease. Therefore, we propose the application of Latent Dirichlet Allocation (LDA), a topic modeling technique, to foot-traffic data to develop a realistic model of human mobility in an ABM that simulates the spread of COVID-19. In our novel approach, LDA treats POIs as "words" and agent home census block groups (CBGs) as "documents" to extract "topics" of POIs that frequently appear together in CBG visits. These topics allow us to simulate agent mobility based on the LDA topic distribution of their home CBG. We compare the LDA based mobility model with competitor approaches including a naive mobility model that assumes visits to POIs are random. We find that the naive mobility model is unable to facilitate the spread of COVID-19 at all. Using the LDA informed mobility model, we simulate the spread of COVID-19 and test the effect of changes to the number of topics, various parameters, and public health interventions. By examining the simulated number of cases over time, we find that the number of topics does indeed impact disease spread dynamics, but only in terms of the outbreak's timing. Further analysis of simulation results is needed to better understand the impact of topics on simulated COVID-19 spread. This study contributes to strengthening human mobility representations in ABMs of disease spread.more » « less
-
Responding to the challenges of societal transformation in the face of climate change, efforts to integrate behaviorally rich models of adaptation decision-making into large-scale macroeconomic and Earth system models are growing and agent-based models (ABMs) are an effective tool for doing so. However, behavioral richness in ABMs has been limited to implementations of single decision models for all agents in a simulated population. The main goals of this study were to: 1) implement the ‘building-block processes’ (BBPs) approach for decision model heterogeneity; 2) demonstrate the application of sensitivity and uncertainty analyses to quantify the scope of structural uncertainty produced by alternative decision models under variable price and climate conditions; and 3) apply the Observing System Simulation Experiment (OSSE) approach to validate such a behaviorally rich BBPs model at the level of individual agent decisions. Using an ABM of agricultural producers’ decision-making, we demonstrated that uncertainty in crop and farm management decisions introduced by heterogeneous decision models was equal to and in some instances greater than that due to variable price or precipitation conditions. Unrealistically rapid or stagnant behavioral dynamics were evident in model versions implementing single decision models for all agents. Moreover, interactions among agents with diverse decision models in the same population produced consistently more accurate outcomes and realistic behavioral dynamics. The BBPs framework and accompanying sensitivity and uncertainty analyses demonstrated here offer a path forward for increasing behavioral richness in ABMs, which is key to understanding processes of adaptation central to societal responses to climate change.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1007/s11538-023-01240-6
