skip to main content


Title: Differential methods for assessing sensitivity in biological models
Differential sensitivity analysis is indispensable in fitting parameters, understanding uncertainty, and forecasting the results of both thought and lab experiments. Although there are many methods currently available for performing differential sensitivity analysis of biological models, it can be difficult to determine which method is best suited for a particular model. In this paper, we explain a variety of differential sensitivity methods and assess their value in some typical biological models. First, we explain the mathematical basis for three numerical methods: adjoint sensitivity analysis, complex perturbation sensitivity analysis, and forward mode sensitivity analysis. We then carry out four instructive case studies. (a) The CARRGO model for tumor-immune interaction highlights the additional information that differential sensitivity analysis provides beyond traditional naive sensitivity methods, (b) the deterministic SIR model demonstrates the value of using second-order sensitivity in refining model predictions, (c) the stochastic SIR model shows how differential sensitivity can be attacked in stochastic modeling, and (d) a discrete birth-death-migration model illustrates how the complex perturbation method of differential sensitivity can be generalized to a broader range of biological models. Finally, we compare the speed, accuracy, and ease of use of these methods. We find that forward mode automatic differentiation has the quickest computational time, while the complex perturbation method is the simplest to implement and the most generalizable.  more » « less
Award ID(s):
1835443
PAR ID:
10387790
Author(s) / Creator(s):
; ; ;
Editor(s):
Csikász-Nagy, Attila
Date Published:
Journal Name:
PLOS Computational Biology
Volume:
18
Issue:
6
ISSN:
1553-7358
Page Range / eLocation ID:
e1009598
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Background

    The biophysics of an organism span multiple scales from subcellular to organismal and include processes characterized by spatial properties, such as the diffusion of molecules, cell migration, and flow of intravenous fluids. Mathematical biology seeks to explain biophysical processes in mathematical terms at, and across, all relevant spatial and temporal scales, through the generation of representative models. While non-spatial, ordinary differential equation (ODE) models are often used and readily calibrated to experimental data, they do not explicitly represent the spatial and stochastic features of a biological system, limiting their insights and applications. However, spatial models describing biological systems with spatial information are mathematically complex and computationally expensive, which limits the ability to calibrate and deploy them and highlights the need for simpler methods able to model the spatial features of biological systems.

    Results

    In this work, we develop a formal method for deriving cell-based, spatial, multicellular models from ODE models of population dynamics in biological systems, and vice versa. We provide examples of generating spatiotemporal, multicellular models from ODE models of viral infection and immune response. In these models, the determinants of agreement of spatial and non-spatial models are the degree of spatial heterogeneity in viral production and rates of extracellular viral diffusion and decay. We show how ODE model parameters can implicitly represent spatial parameters, and cell-based spatial models can generate uncertain predictions through sensitivity to stochastic cellular events, which is not a feature of ODE models. Using our method, we can test ODE models in a multicellular, spatial context and translate information to and from non-spatial and spatial models, which help to employ spatiotemporal multicellular models using calibrated ODE model parameters. We additionally investigate objects and processes implicitly represented by ODE model terms and parameters and improve the reproducibility of spatial, stochastic models.

    Conclusion

    We developed and demonstrate a method for generating spatiotemporal, multicellular models from non-spatial population dynamics models of multicellular systems. We envision employing our method to generate new ODE model terms from spatiotemporal and multicellular models, recast popular ODE models on a cellular basis, and generate better models for critical applications where spatial and stochastic features affect outcomes.

     
    more » « less
  2. In this paper, we present a Renyi Differentially Private stochastic gradient descent (SGD) algorithm for convex empirical risk minimization. The algorithm uses output perturbation and leverages randomness inside SGD, which creates a “randomized sensitivity”, in order to reduce the amount of noise that is added. One of the benefits of output perturbation is that we can incorporate a periodic averaging step that serves to further reduce sensitivity while improving accuracy (reducing the well known oscillating behavior of SGD near the optimum). Renyi Differential Privacy can be used to provide (epsilon, delta)-differential privacy guarantees and hence provide a comparison with prior work. An empirical evaluation demonstrates that the proposed method outperforms prior methods on differentially private ERM. 
    more » « less
  3. Predicting arbovirus re-emergence remains challenging in regions with limited off-season transmission and intermittent epidemics. Current mathematical models treat the depletion and replenishment of susceptible (non-immune) hosts as the principal drivers of re-emergence, based on established understanding of highly transmissible childhood diseases with frequent epidemics. We extend an analytical approach to determine the number of ‘skip’ years preceding re-emergence for diseases with continuous seasonal transmission, population growth and under-reporting. Re-emergence times are shown to be highly sensitive to small changes in low R 0 (secondary cases produced from a primary infection in a fully susceptible population). We then fit a stochastic Susceptible–Infected–Recovered (SIR) model to observed case data for the emergence of dengue serotype DENV1 in Rio de Janeiro. This aggregated city-level model substantially over-estimates observed re-emergence times either in terms of skips or outbreak probability under forward simulation. The inability of susceptible depletion and replenishment to explain re-emergence under ‘well-mixed’ conditions at a city-wide scale demonstrates a key limitation of SIR aggregated models, including those applied to other arboviruses. The predictive uncertainty and high skip sensitivity to epidemiological parameters suggest a need to investigate the relevant spatial scales of susceptible depletion and the scaling of microscale transmission dynamics to formulate simpler models that apply at coarse resolutions. 
    more » « less
  4. Predicting arbovirus re-emergence remains challenging in regions with limited off-season transmission and intermittent epidemics. Current mathematical models treat the depletion and replenishment of susceptible (non-immune) hosts as the principal drivers of re-emergence, based on established understanding of highly transmissible childhood diseases with frequent epidemics. We extend an analytical approach to determine the number of ‘skip’ years preceding re-emergence for diseases with continuous seasonal transmission, population growth and under-reporting. Re-emergence times are shown to be highly sensitive to small changes in low R0 (secondary cases produced from a primary infection in a fully susceptible population). We then fit a stochastic SIR (Susceptible-Infected-Recovered) model to observed case data for the emergence of dengue serotype DENV1 in Rio de Janeiro. This aggregated city-level model substantially over-estimates observed re-emergence times either in terms of skips or outbreak probability under forward simulation. The inability of susceptible depletion and replenishment to explain re-emergence under ‘well-mixed’ conditions at a city-wide scale demonstrates a key limitation of SIR aggregated models including those applied to other arboviruses. The predictive uncertainty and high skip sensitivity to epidemiological parameters suggest a need to investigate the relevant spatial scales of susceptible depletion and the scaling of microscale transmission dynamics to formulate simpler models that apply at coarse resolutions. Introduction: 
    more » « less
  5. Abstract

    Sensitivity analysis is a popular feature selection approach employed to identify the important features in a dataset. In sensitivity analysis, each input feature is perturbed one-at-a-time and the response of the machine learning model is examined to determine the feature's rank. Note that the existing perturbation techniques may lead to inaccurate feature ranking due to their sensitivity to perturbation parameters. This study proposes a novel approach that involves the perturbation of input features using a complex-step. The implementation of complex-step perturbation in the framework of deep neural networks as a feature selection method is provided in this paper, and its efficacy in determining important features for real-world datasets is demonstrated. Furthermore, the filter-based feature selection methods are employed, and the results obtained from the proposed method are compared. While the results obtained for the classification task indicated that the proposed method outperformed other feature ranking methods, in the case of the regression task, it was found to perform more or less similar to that of other feature ranking methods.

     
    more » « less