skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Primer on Stochastic Partial Differential Equations with Spatially Correlated Noise
With the growing number of microscale devices from computer memory to microelectromechanical systems, such as lab-on-a-chip biosensors, and the increased ability to experimentally measure at the micro- and nanoscale, modeling systems with stochastic processes is a growing need across science. In particular, stochastic partial differential equations (SPDEs) naturally arise from continuum models—for example, a pillar magnet's magnetization or an elastic membrane's mechanical deflection. In this review, I seek to acquaint the reader with SPDEs from the point of view of numerically simulating their finite-difference approximations, without the rigorous mathematical details of assigning probability measures to the random field solutions. I stress that these simulations with spatially uncorrelated noise may not converge as the grid size goes to zero in the way that one expects from deterministic convergence of numerical schemes in two or more spatial dimensions. I then present some models with spatially correlated noise that maintain sampling of the physically relevant equilibrium distribution. Numerical simulations are presented to demonstrate the dynamics; the code is publicly available on GitHub.  more » « less
Award ID(s):
2307297
PAR ID:
10589048
Author(s) / Creator(s):
Publisher / Repository:
Annual Reviews
Date Published:
Journal Name:
Annual Review of Condensed Matter Physics
Volume:
16
Issue:
1
ISSN:
1947-5454
Page Range / eLocation ID:
195 to 208
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Many systems may switch to an undesired state due to internal failures or external perturbations, of which critical transitions toward degraded ecosystem states are prominent examples. Resilience restoration focuses on the ability of spatially-extended systems and the required time to recover to their desired states under stochastic environmental conditions. The difficulty is rooted in the lack of mathematical tools to analyze systems with high dimensionality, nonlinearity, and stochastic effects. Here we show that nucleation theory can be employed to advance resilience restoration in spatially-embedded ecological systems. We find that systems may exhibit single-cluster or multi-cluster phases depending on their sizes and noise strengths. We also discover a scaling law governing the restoration time for arbitrary system sizes and noise strengths in two-dimensional systems. This approach is not limited to ecosystems and has applications in various dynamical systems, from biology to infrastructural systems. 
    more » « less
  2. We apply a perturbative Doi-Peliti field-theoretical analysis to the stochastic spatially extended symmetric Rock-paper-Scissors (RPS) and May-Leonard (ML) models, in which three species compete cyclically. Compared to the two-species Lotka-Volterra predator-prey (LV) model, according to numerical simulations, these cyclical models appear to be less affected by intrinsic stochastic fluctuations. Indeed, we demonstrate that the qualitative features of the ML model are insensitive to intrinsic reaction noise. In contrast, and although not yet observed in numerical simulations, we find that the RPS model acquires significant fluctuation-induced renormalizations in the perturbative regime, similar to the LV model. We also study the formation of spatio-temporal structures in the framework of stability analysis and provide a clearcut explanation for the absence of spatial patterns in the RPS system, whereas the spontaneous emergence of spatio-temporal structures features prominently in the LV and the ML models. 
    more » « less
  3. The out-of-time-ordered correlator (OTOC) has emerged as an interesting object in both classical and quantum systems for probing the spatial spread and temporal growth of initially local perturbations in spatially extended chaotic systems. Here, we study the (classical) OTOC and its “light cone” in the nonlinear Kuramoto-Sivashinsky (KS) equation, using extensive numerical simulations. We also show that the linearized KS equation exhibits a qualitatively similar OTOC and light cone, which can be understood via a saddle-point analysis of the linearly unstable modes. Given the deep connection between the KS (deterministic) and the Kardar-Parisi-Zhang (KPZ, which is stochastic) equations, we also explore the OTOC in the KPZ equation. While our numerical results in the KS case are expected to hold in the continuum limit, for the KPZ case it is valid in a discretized version of the KPZ equation. More broadly, our work unravels the intrinsic interplay between noise/instability, nonlinearity, and dissipation in partial differential equations (deterministic or stochastic) through the lens of OTOC. 
    more » « less
  4. null (Ed.)
    Abstract Objective-driven adaptive sampling is a widely used tool for the optimization of deterministic black-box functions. However, the optimization of stochastic simulation models as found in the engineering, biological, and social sciences is still an elusive task. In this work, we propose a scalable adaptive batch sampling scheme for the optimization of stochastic simulation models with input-dependent noise. The developed algorithm has two primary advantages: (i) by recommending sampling batches, the designer can benefit from parallel computing capabilities, and (ii) by replicating of previously observed sampling locations the method can be scaled to higher-dimensional and more noisy functions. Replication improves numerical tractability as the computational cost of Bayesian optimization methods is known to grow cubicly with the number of unique sampling locations. Deciding when to replicate and when to explore depends on what alternative minimizes the posterior prediction accuracy at and around the spatial locations expected to contain the global optimum. The algorithm explores a new sampling location to reduce the interpolation uncertainty and replicates to improve the accuracy of the mean prediction at a single sampling location. Through the application of the proposed sampling scheme to two numerical test functions and one real engineering problem, we show that we can reliably and efficiently find the global optimum of stochastic simulation models with input-dependent noise. 
    more » « less
  5. null (Ed.)
    Abstract In this study, we propose a scalable batch sampling scheme for optimization of simulation models with spatially varying noise. The proposed scheme has two primary advantages: (i) reduced simulation cost by recommending batches of samples at carefully selected spatial locations and (ii) improved scalability by actively considering replicating at previously observed sampling locations. Replication improves the scalability of the proposed sampling scheme as the computational cost of adaptive sampling schemes grow cubicly with the number of unique sampling locations. Our main consideration for the allocation of computational resources is the minimization of the uncertainty in the optimal design. We analytically derive the relationship between the “exploration versus replication decision” and the posterior variance of the spatial random process used to approximate the simulation model’s mean response. Leveraging this reformulation in a novel objective-driven adaptive sampling scheme, we show that we can identify batches of samples that minimize the prediction uncertainty only in the regions of the design space expected to contain the global optimum. Finally, the proposed sampling scheme adopts a modified preposterior analysis that uses a zeroth-order interpolation of the spatially varying simulation noise to identify sampling batches. Through the optimization of three numerical test functions and one engineering problem, we demonstrate (i) the efficacy and of the proposed sampling scheme to deal with a wide array of stochastic functions, (ii) the superior performance of the proposed method on all test functions compared to existing methods, (iii) the empirical validity of using a zeroth-order approximation for the allocation of sampling batches, and (iv) its applicability to molecular dynamics simulations by optimizing the performance of an organic photovoltaic cell as a function of its processing settings. 
    more » « less