skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Understanding LLMs' Capabilities to Support Spatially-disaggregated Epidemiological Simulations
Evaluating public health interventions during disease outbreaks requires an understanding of the spatial patterns underlying epidemiological processes. In this study, we explore how Large Language Models (LLMs) can leverage spatial understanding and contextual reasoning to support spatially-disaggregated epidemiological simulations. We present an approach in which a system dynamics model queries an LLM at key decision points to determine appropriate mitigation strategies, informed by local profiles and the current outbreak status, and incorporates these strategies into the simulations. Through a series of experiments with COVID-19 data from San Diego County, we show how different LLMs perform in tasks requiring spatial adaptation of mitigation strategies, and how incorporating connectivity information through Retrieval-Augmented Generation (RAG) enhances the performance of these customizations. The results reveal significant differences among LLMs in their ability to account for spatial structure and optimize mitigation strategies accordingly. This highlights the importance of selecting the right model and enhancing it with relevant contextual information for effective public health interventions.  more » « less
Award ID(s):
2200197
PAR ID:
10561167
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Zenodo
Date Published:
Subject(s) / Keyword(s):
Large Language Models (LLMs) Epidemiological Modeling Spatial Reasoning System Dynamics San Diego
Format(s):
Medium: X
Right(s):
Creative Commons Attribution 4.0 International
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Zenodo)
    Evaluating public health interventions during disease outbreaks requires an understanding of the spatial patterns underlying epidemiological processes. In this study, we explore how Large Language Models (LLMs) can leverage spatial understanding and contextual reasoning to support spatially-disaggregated epidemiological simulations. We present an approach in which a system dynamics model queries an LLM at key decision points to determine appropriate mitigation strategies, informed by local profiles and the current outbreak status, and incorporates these strategies into the simulations. Through a series of experiments with COVID-19 data from San Diego County, we show how different LLMs perform in tasks requiring spatial adaptation of mitigation strategies, and how incorporating connectivity information through Retrieval-Augmented Generation (RAG) enhances the performance of these customizations. The results reveal significant differences among LLMs in their ability to account for spatial structure and optimize mitigation strategies accordingly. This highlights the importance of selecting the right model and enhancing it with relevant contextual information for effective public health interventions. 
    more » « less
  2. ; ; ; (, BMC Public Health)
    Abstract Background Individual behavioural decisions are responses to a person’s perceived social norms that could be shaped by both their physical and social environment. In the context of the COVID-19 pandemic, these environments correspond to epidemiological risk from contacts and the social construction of risk by communication within networks of friends. Understanding the circumstances under which the influence of these different social networks can promote the acceptance of non-pharmaceutical interventions and consequently the adoption of protective behaviours is critical for guiding useful, practical public health messaging. Methods We explore how information from both physical contact and social communication layers of a multiplex network can contribute to flattening the epidemic curve in a community. Connections in the physical contact layer represent opportunities for transmission, while connections in the communication layer represent social interactions through which individuals may gain information, e.g. messaging friends. Results We show that maintaining focus on awareness of risk among each individual’s physical contacts promotes the greatest reduction in disease spread, but only when an individual is aware of the symptoms of a non-trivial proportion of their physical contacts (~ ≥ 20%). Information from the social communication layer without was less useful when these connections matched less well with physical contacts and contributed little in combination with accurate information from physical contacts. Conclusions We conclude that maintaining social focus on local outbreak status will allow individuals to structure their perceived social norms appropriately and respond more rapidly when risk increases. Finding ways to relay accurate local information from trusted community leaders could improve mitigation even where more intrusive/costly strategies, such as contact-tracing, are not possible. 
    more » « less
  3. ; ; ; ; (, BMC Public Health)
    Abstract BackgroundCOVID-19 mitigation strategies such as masking, social distancing, avoiding group gatherings, and vaccination uptake are crucial interventions to preventing the spread of COVID-19. At present, COVID-19 data are aggregated and fail to identify subgroup variation in Asian American communities such as Hmong Americans. To understand the acceptance, adoption, and adherence to COVID-19 mitigation behaviors, an investigation of Hmong Americans’ contextual and personal characteristics was conducted. MethodsThis study aims to describe COVID-19 mitigation behaviors among Hmong Americans and the contextual and personal characteristics that influence these behaviors. A cross-sectional online survey was conducted from April 8 till June 1, 2021, with Hmong Americans aged 18 and over. Descriptive statistics were used to summarize the overall characteristics and COVID-19 related behaviors of Hmong Americans. Chi-square and Fisher’s Exact Test were computed to describe COVID-19 mitigation behaviors by gender and generational status (a marker of acculturation). ResultsThe sample included 507 participants who completed the survey. A majority of the Hmong American participants in our study reported masking (449/505, 88.9%), social distancing (270/496, 55.3%), avoiding group gatherings (345/505, 68.3%), avoiding public spaces (366/506, 72.3%), and obtaining the COVID-19 vaccination (350/506, 69.2%) to stay safe from COVID-19. Women were more likely to socially distance (P = .005), and avoid family (P = .005), and social gatherings (P = .009) compared to men. Social influence patterns related to mitigation behaviors varied by sex. Men were more likely compared to women to be influenced by Hmong community leaders to participate in family and group gatherings (P = .026), masking (P = .029), social distancing (P = .022), and vaccination uptake (P = .037), whereas healthcare providers and government officials were social influencers for social distancing and masking for women. Patterns of social distancing and group gatherings were also influenced by generational status. ConclusionContextual and personal characteristics influence COVID-19 mitigation behaviors among English speaking Hmong Americans. These findings have implications for identifying and implementing culturally appropriate health messages, future public health interventions, policy development, and ongoing research with this population. 
    more » « less
  4. ; ; ; (, Journal of The Royal Society Interface)
    null (Ed.)
    SARS-CoV-2 is an international public health emergency; high transmissibility and morbidity and mortality can result in the virus overwhelming health systems. Combinations of social distancing, and test, trace, and isolate strategies can reduce the number of new infections per infected individual below 1, thus driving declines in case numbers, but may be both challenging and costly. These interventions must also be maintained until development and (now likely) mass deployment of a vaccine (or therapeutics), since otherwise, many susceptible individuals are still at risk of infection. We use a simple analytical model to explore how low levels of infection, combined with vaccination, determine the trajectory to community immunity. Understanding the repercussions of the biological characteristics of the viral life cycle in this scenario is of considerable importance. We provide a simple description of this process by modelling the scenario where the effective reproduction number R eff is maintained at 1. Since the additional complexity imposed by the strength and duration of transmission-blocking immunity is not yet clear, we use our framework to probe the impact of these uncertainties. Through intuitive analytical relations, we explore how the necessary magnitude of vaccination rates and mitigation efforts depends crucially on the durations of natural and vaccinal immunity. We also show that our framework can encompass seasonality or preexisting immunity due to epidemic dynamics prior to strong mitigation measures. Taken together, our simple conceptual model illustrates the importance of individual and vaccinal immunity for community immunity, and that the quantification of individuals immunized against SARS-CoV-2 is paramount. 
    more » « less
  5. ; ; (, Journal of The Royal Society Interface)
    null (Ed.)
    As COVID-19 continues to pose significant public health threats, quantifying the effectiveness of different public health interventions is crucial to inform intervention strategies. Using detailed epidemiological and mobility data available for New York City and comprehensive modelling accounting for under-detection, we reconstruct the COVID-19 transmission dynamics therein during the 2020 spring pandemic wave and estimate the effectiveness of two major non-pharmaceutical interventions—lockdown-like measures that reduce contact rates and universal masking. Lockdown-like measures were associated with greater than 50% transmission reduction for all age groups. Universal masking was associated with an approximately 7% transmission reduction overall and up to 20% reduction for 65+ year olds during the first month of implementation. This result suggests that face covering can substantially reduce transmission when lockdown-like measures are lifted but by itself may be insufficient to control SARS-CoV-2 transmission. Overall, findings support the need to implement multiple interventions simultaneously to effectively mitigate COVID-19 spread before the majority of population can be protected through mass-vaccination. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email