skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Solving Newton’s equations of motion with large timesteps using recurrent neural networks based operators
Abstract Classical molecular dynamics simulations are based on solving Newton’s equations of motion. Using a small timestep, numerical integrators such as Verlet generate trajectories of particles as solutions to Newton’s equations. We introduce operators derived using recurrent neural networks that accurately solve Newton’s equations utilizing sequences of past trajectory data, and produce energy-conserving dynamics of particles using timesteps up to 4000 times larger compared to the Verlet timestep. We demonstrate significant speedup in many example problems including 3D systems of up to 16 particles.  more » « less
Award ID(s):
1753182 1720625
PAR ID:
10365714
Author(s) / Creator(s):
; ;
Publisher / Repository:
IOP Publishing
Date Published:
Journal Name:
Machine Learning: Science and Technology
Volume:
3
Issue:
2
ISSN:
2632-2153
Page Range / eLocation ID:
Article No. 025002
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The Langevin Dynamics (LD) method (also known in the literature as Brownian Dynamics) is routinely used to simulate aerosol particle trajectories for transport rate constant calculations as well as to understand aerosol particle transport in internal and external fluid flows. This tutorial intends to explain the methodological details of setting up a LD simulation of a population of aerosol particles and to deduce rate constants from an ensemble of classical trajectories. We discuss the applicability and limitations of the translational Langevin equation to model the combined stochastic and deterministic motion of particles in fields of force or fluid flow. The drag force and stochastic “diffusion” force terms that appear in the Langevin equation are discussed elaborately, along with a summary of common forces relevant to aerosol systems (electrostatic, gravity, van der Waals, …); a commonly used first order and a fourth order Runge-Kutta time stepping schemes for linear stochastic ordinary differential equations are presented. A MATLAB® implementation of a LD code for simulating particle settling under gravity using the first order scheme is included for illustration. Scaling analysis of aerosol transport processes and the selection of timestep and domain size for trajectory simulations are demonstrated through two specific aerosol processes: particle diffusion charging and coagulation. Fortran® implementations of the first order and fourth order time-stepping schemes are included for simulating the 3D motion of a particle in a periodic domain. Potential applications and caveats to the usage of LD are included as a summary. 
    more » « less
  2. Abstract We propose iterative algorithms to solve adversarial training problems in a variety of supervised learning settings of interest. Our algorithms, which can be interpreted as suitable ascent-descent dynamics in Wasserstein spaces, take the form of a system of interacting particles. These interacting particle dynamics are shown to converge toward appropriate mean-field limit equations in certain large number of particles regimes. In turn, we prove that, under certain regularity assumptions, these mean-field equations converge, in the large time limit, toward approximate Nash equilibria of the original adversarial learning problems. We present results for non-convex non-concave settings, as well as for non-convex concave ones. Numerical experiments illustrate our results. 
    more » « less
  3. Abstract Because of their buoyancy, rigidity, and finite size, inertial particles do not obey the same dynamics as fluid parcels. The motion of small spherical particles in a fluid flow is described by the Maxey–Riley equations and depends nonlinearly on the velocity of the fluid in which the particles are immersed. Fluid velocities in the ocean often have a strong small-scale turbulent component which is difficult to observe or model, presenting a challenge to predicting the evolution of distributions of inertial particles in the ocean. To overcome this challenge, we assume that the turbulent velocity imposes a random force on particles and consider a stochastic analog of the Maxey–Riley equations. By performing a perturbation analysis of the stochastic Maxey–Riley equations, we obtain a simple and accurate partial differential equation for the spatial distribution of particles. The equation is of the advection–diffusion type and handles the uncertainty introduced by unresolved turbulent flow features. In several numerical test cases, distributions of particles obtained by solving the newly derived equation compare favorably with distributions obtained from Monte Carlo simulations of individual particle trajectories and with theoretical predictions. The advection–diffusion form of our newly derived equation is amenable to inclusion within many existing ocean circulation models. Significance StatementWe introduce a new model for describing spatial distributions of small rigid objects, such as plastic debris, in the ocean. The model takes into account the effects of finite particle size and particle buoyancy, which cause particle trajectories to differ from fluid parcel trajectories. Our model also represents small-scale turbulence stochastically. 
    more » « less
  4. This article is about numerical methods for the solution of nonlinear equations. We consider both the fixed-point form $$\mathbf{x}=\mathbf{G}(\mathbf{x})$$ and the equations form $$\mathbf{F}(\mathbf{x})=0$$ and explain why both versions are necessary to understand the solvers. We include the classical methods to make the presentation complete and discuss less familiar topics such as Anderson acceleration, semi-smooth Newton’s method, and pseudo-arclength and pseudo-transient continuation methods. 
    more » « less
  5. Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another. Our framework—which we term “Graph Network-based Simulators” (GNS)—represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands of timesteps, and at least an order of magnitude more particles at test time. Our model was robust to hyperparameter choices across various evaluation metrics: the main determinants of long-term performance were the number of message-passing steps, and mitigating the accumulation of error by corrupting the training data with noise. Our GNS framework advances the state-of-the-art in learned physical simulation, and holds promise for solving a wide range of complex forward and inverse problems. 
    more » « less