Title: A Framework of Digital Twins for Modeling Human-Subject Word Formation Experiments
Agent-based models (ABMs) are used to simulate human-subject experiments. A comprehensive understanding of these human systems often requires executing large numbers of simulations, but these requirements are constrained by computational and other resources. In this work, we build a framework of digital twins for modeling human-subject experiments. The framework has three modules: ABMs of player behaviors built from game data; extensions of these models to represent virtual assistants (agents that are exogenously manipulated to create controlled environments for human agents); and an uncertainty quantification module composed of functional ANOVA and a Gaussian process-based emulator. The emulator is built from the extended ABM; we focus on emulator validation. By incorporating experimental data and agent-based simulation data, our proposed framework enhances the virtual representation of the dynamics in human-subject word formation experiments, which we consider a digital twin. Networked anagram experiments are used as an exemplar to demonstrate the methods.  more » « less
Award ID(s):
2428625
PAR ID:
10561410
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
IEEE
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Beecham, Roger; Long, Jed A.; Smith, Dianna; Zhao, Qunshan; Wise, Sarah (Ed.)
    Agent-based models (ABMs) are powerful tools used for better understanding, predicting, and responding to diseases. ABMs are well-suited to represent human health behaviors, a key driver of disease spread. However, many existing ABMs of infectious respiratory disease spread oversimplify or ignore behavioral aspects due to limited data and the variety of behavioral theories available. Therefore, this study aims to develop and implement a data-driven framework for agent decision-making related to health behaviors in geospatial ABMs of infectious disease spread. The agent decision-making framework uses a logistic regression model expressed in the form of odds ratios to calculate the probability of adopting a behavior. The framework is integrated into a geospatial ABM that simulates the spread of COVID-19 and mask usage among the student population at George Mason University in Fall 2021. The framework leverages odds ratios, which can be derived from surveys or open data, and can be modified to incorporate variables identified by behavioral theories. This advancement will offer the public and decision-makers greater insight into disease transmission, accurate predictions on disease outcomes, and preparation for future infectious disease outbreaks. 
    more » « less
  2. Agent-based models (ABMs) are critical for projecting and responding to infectious disease outbreaks, yet the effectiveness of health interventions heavily relies on individual adherence, underscoring the importance of accurately representing human behavior. While some ABMs have incorporated behaviors, clear guidelines for leveraging the extensive literature on behavioral theories have been lacking. This study addresses this challenge by proposing a modeling framework that integrates classical behavioral theories and their psychological constructs, drawing upon well-established definitions and categorizations from the social sciences to guide operationalization. We present novel and existing modeling approaches to represent these constructs and their interactions with the environment and behavior. Furthermore, we discuss methods for determining an agent’s likelihood of adopting a behavior and how empirical data can be used for calibration and validation. To illustrate the application of the framework to disease-specific behaviors, we provide a modeling example. Ultimately, this proposed framework offers a roadmap for computational modelers to incorporate scientifically grounded behaviors in the design and evaluation of simulation models and interventions. 
    more » « less
  3. Abstract Modeling human–water system interactions is essential for understanding the co‐evolution of human society and hydrological extremes. Agent‐based models (ABMs) are widely used for this purpose, yet they face persistent challenges, including manually coded rules, simplified behavioral assumptions, and limited integration of qualitative information. Recent advances in large language models (LLMs) offer promising opportunities to address these challenges by simulating agents' decisions in natural language reasoning and guided by behavioral theory frameworks. This study presents a proof‐of‐concept LLM‐ABM framework that models household flood adaptations including buying insurance, elevating homes, relocating, or doing nothing in a synthetic flood‐prone city. Agents (i.e., households) are initialized with trust levels and narrative‐style memory. Protection Motivation Theory (PMT) is structured to guide decision‐making as an example. Results show that LLM‐driven ABM generates memory‐mediated, narrative‐driven behavioral adjustments, in contrast to the threshold‐driven, utility‐mediated shifts produced by a traditional stochastic ABM, illustrating how architectural choices shape emergent behavioral dynamics. Year‐by‐year natural‐language appraisals and explicit reasoning can enhance the interpretability and diagnostic visibility of LLM‐driven ABM, which allows scientists to trace how threat perception, coping beliefs, or social cues potentially shape individual decisions. Sensitivity analyses demonstrate that LLM‐driven ABM can evaluate uncertainty across new qualitative and parameter dimensions, including prompt phrasing and memory‐window length. While limitations remain including LLM reliability and architecture choices, output versus process transparency, simplified agent population, and simulation scalability, the findings in this paper illustrate the potential of LLM‐driven ABMs as a complementary tool for socio‐hydrological research. 
    more » « less
  4. Responding to the challenges of societal transformation in the face of climate change, efforts to integrate behaviorally rich models of adaptation decision-making into large-scale macroeconomic and Earth system models are growing and agent-based models (ABMs) are an effective tool for doing so. However, behavioral richness in ABMs has been limited to implementations of single decision models for all agents in a simulated population. The main goals of this study were to: 1) implement the ‘building-block processes’ (BBPs) approach for decision model heterogeneity; 2) demonstrate the application of sensitivity and uncertainty analyses to quantify the scope of structural uncertainty produced by alternative decision models under variable price and climate conditions; and 3) apply the Observing System Simulation Experiment (OSSE) approach to validate such a behaviorally rich BBPs model at the level of individual agent decisions. Using an ABM of agricultural producers’ decision-making, we demonstrated that uncertainty in crop and farm management decisions introduced by heterogeneous decision models was equal to and in some instances greater than that due to variable price or precipitation conditions. Unrealistically rapid or stagnant behavioral dynamics were evident in model versions implementing single decision models for all agents. Moreover, interactions among agents with diverse decision models in the same population produced consistently more accurate outcomes and realistic behavioral dynamics. The BBPs framework and accompanying sensitivity and uncertainty analyses demonstrated here offer a path forward for increasing behavioral richness in ABMs, which is key to understanding processes of adaptation central to societal responses to climate change. 
    more » « less
  5. Abstract Across a broad range of disciplines, agent-based models (ABMs) are increasingly utilized for replicating, predicting, and understanding complex systems and their emergent behavior. In the biological and biomedical sciences, researchers employ ABMs to elucidate complex cellular and molecular interactions across multiple scales under varying conditions. Data generated at these multiple scales, however, presents a computational challenge for robust analysis with ABMs. Indeed, calibrating ABMs remains an open topic of research due to their own high-dimensional parameter spaces. In response to these challenges, we extend and validate our novel methodology, Surrogate Modeling for Reconstructing Parameter Surfaces (SMoRe ParS), arriving at a computationally efficient framework for connecting high dimensional ABM parameter spaces with multidimensional data. Specifically, we modify SMoRe ParS to initially confine high dimensional ABM parameter spaces using unidimensional data, namely, single time-course information of in vitro cancer cell growth assays. Subsequently, we broaden the scope of our approach to encompass more complex ABMs and constrain parameter spaces using multidimensional data. We explore this extension with in vitro cancer cell inhibition assays involving the chemotherapeutic agent oxaliplatin. For each scenario, we validate and evaluate the effectiveness of our approach by comparing how well ABM simulations match the experimental data when using SMoRe ParS-inferred parameters versus parameters inferred by a commonly used direct method. In so doing, we show that our approach of using an explicitly formulated surrogate model as an interlocutor between the ABM and the experimental data effectively calibrates the ABM parameter space to multidimensional data. Our method thus provides a robust and scalable strategy for leveraging multidimensional data to inform multiscale ABMs and explore the uncertainty in their parameters. 
    more » « less