skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Differential methods for assessing sensitivity in biological models
Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.  more » « less
Award ID(s):
1835443
PAR ID:
10387790
Author(s) / Creator(s):
; ; ;
Editor(s):
Csikász-Nagy, Attila
Date Published:
Journal Name:
PLOS Computational Biology
Volume:
18
Issue:
6
ISSN:
1553-7358
Page Range / eLocation ID:
e1009598
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract BackgroundThe biophysics of an organism span multiple scales from subcellular to organismal and include processes characterized by spatial properties, such as the diffusion of molecules, cell migration, and flow of intravenous fluids. Mathematical biology seeks to explain biophysical processes in mathematical terms at, and across, all relevant spatial and temporal scales, through the generation of representative models. While non-spatial, ordinary differential equation (ODE) models are often used and readily calibrated to experimental data, they do not explicitly represent the spatial and stochastic features of a biological system, limiting their insights and applications. However, spatial models describing biological systems with spatial information are mathematically complex and computationally expensive, which limits the ability to calibrate and deploy them and highlights the need for simpler methods able to model the spatial features of biological systems. ResultsIn this work, we develop a formal method for deriving cell-based, spatial, multicellular models from ODE models of population dynamics in biological systems, and vice versa. We provide examples of generating spatiotemporal, multicellular models from ODE models of viral infection and immune response. In these models, the determinants of agreement of spatial and non-spatial models are the degree of spatial heterogeneity in viral production and rates of extracellular viral diffusion and decay. We show how ODE model parameters can implicitly represent spatial parameters, and cell-based spatial models can generate uncertain predictions through sensitivity to stochastic cellular events, which is not a feature of ODE models. Using our method, we can test ODE models in a multicellular, spatial context and translate information to and from non-spatial and spatial models, which help to employ spatiotemporal multicellular models using calibrated ODE model parameters. We additionally investigate objects and processes implicitly represented by ODE model terms and parameters and improve the reproducibility of spatial, stochastic models. ConclusionWe developed and demonstrate a method for generating spatiotemporal, multicellular models from non-spatial population dynamics models of multicellular systems. We envision employing our method to generate new ODE model terms from spatiotemporal and multicellular models, recast popular ODE models on a cellular basis, and generate better models for critical applications where spatial and stochastic features affect outcomes. 
    more » « less
  2. In this paper, we present a Renyi Differentially Private stochastic gradient descent (SGD) algorithm for convex empirical risk minimization. The algorithm uses output perturbation and leverages randomness inside SGD, which creates a “randomized sensitivity”, in order to reduce the amount of noise that is added. One of the benefits of output perturbation is that we can incorporate a periodic averaging step that serves to further reduce sensitivity while improving accuracy (reducing the well known oscillating behavior of SGD near the optimum). Renyi Differential Privacy can be used to provide (epsilon, delta)-differential privacy guarantees and hence provide a comparison with prior work. An empirical evaluation demonstrates that the proposed method outperforms prior methods on differentially private ERM. 
    more » « less
  3. Predicting arbovirus re-emergence remains challenging in regions with limited off-season transmission and intermittent epidemics. Current mathematical models treat the depletion and replenishment of susceptible (non-immune) hosts as the principal drivers of re-emergence, based on established understanding of highly transmissible childhood diseases with frequent epidemics. We extend an analytical approach to determine the number of ‘skip’ years preceding re-emergence for diseases with continuous seasonal transmission, population growth and under-reporting. Re-emergence times are shown to be highly sensitive to small changes in low R 0 (secondary cases produced from a primary infection in a fully susceptible population). We then fit a stochastic Susceptible–Infected–Recovered (SIR) model to observed case data for the emergence of dengue serotype DENV1 in Rio de Janeiro. This aggregated city-level model substantially over-estimates observed re-emergence times either in terms of skips or outbreak probability under forward simulation. The inability of susceptible depletion and replenishment to explain re-emergence under ‘well-mixed’ conditions at a city-wide scale demonstrates a key limitation of SIR aggregated models, including those applied to other arboviruses. The predictive uncertainty and high skip sensitivity to epidemiological parameters suggest a need to investigate the relevant spatial scales of susceptible depletion and the scaling of microscale transmission dynamics to formulate simpler models that apply at coarse resolutions. 
    more » « less
  4. Predicting arbovirus re-emergence remains challenging in regions with limited off-season transmission and intermittent epidemics. Current mathematical models treat the depletion and replenishment of susceptible (non-immune) hosts as the principal drivers of re-emergence, based on established understanding of highly transmissible childhood diseases with frequent epidemics. We extend an analytical approach to determine the number of ‘skip’ years preceding re-emergence for diseases with continuous seasonal transmission, population growth and under-reporting. Re-emergence times are shown to be highly sensitive to small changes in low R0 (secondary cases produced from a primary infection in a fully susceptible population). We then fit a stochastic SIR (Susceptible-Infected-Recovered) model to observed case data for the emergence of dengue serotype DENV1 in Rio de Janeiro. This aggregated city-level model substantially over-estimates observed re-emergence times either in terms of skips or outbreak probability under forward simulation. The inability of susceptible depletion and replenishment to explain re-emergence under ‘well-mixed’ conditions at a city-wide scale demonstrates a key limitation of SIR aggregated models including those applied to other arboviruses. The predictive uncertainty and high skip sensitivity to epidemiological parameters suggest a need to investigate the relevant spatial scales of susceptible depletion and the scaling of microscale transmission dynamics to formulate simpler models that apply at coarse resolutions. Introduction: 
    more » « less
  5. Michael, Wooldridge; Dy, Jennifer; Natarajan, Sriraam (Ed.)
    This work undertakes studies to evaluate Interpretability Methods for Time Series Deep Learning. Sensitivity analysis assesses how input changes affect the output, constituting a key component of interpretation. Among the post-hoc interpretation methods such as back-propagation, perturbation, and approximation, my work will investigate perturbation-based sensitivity Analysis methods on modern Transformer models to benchmark their performances. Specifically, my work intends to answer three research questions: 1) Do different sensitivity analysis methods yield comparable outputs and attribute importance rankings? 2) Using the same sensitivity analysis method, do different Deep Learning models impact the output of the sensitivity analysis? 3) How well do the results from sensitivity analysis methods align with the ground truth? 
    more » « less