Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, October 15th until 12:00 AM ET on Friday, October 16th due to maintenance. We apologize for the inconvenience.


Title: NewtonNet: a Newtonian message passing network for deep learning of interatomic potentials and forces
We report a new deep learning message passing network that takes inspiration from Newton's equations of motion to learn interatomic potentials and forces. With the advantage of directional information from trainable force vectors, and physics-infused operators that are inspired by Newtonian physics, the entire model remains rotationally equivariant, and many-body interactions are inferred by more interpretable physical features. We test NewtonNet on the prediction of several reactive and non-reactive high quality ab initio data sets including single small molecules, a large set of chemically diverse molecules, and methane and hydrogen combustion reactions, achieving state-of-the-art test performance on energies and forces with far greater data and computational efficiency than other deep learning models.  more » « less
Award ID(s):
1955643
PAR ID:
10404545
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Digital Discovery
Volume:
1
Issue:
3
ISSN:
2635-098X
Page Range / eLocation ID:
333 to 343
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Lian, T (Ed.)
    The fast and accurate simulation of chemical reactions is a major goal of computational chemistry. Recently, the pursuit of this goal has been aided by machine learning interatomic potentials (MLIPs), which provide energies and forces at quantum mechanical accuracy but at a fraction of the cost of the reference quantum mechanical calculations. Assembling the training set of relevant configurations is key to building the MLIP. Here, we demonstrate two approaches to training reactive MLIPs based on reaction pathway information. One approach exploits reaction datasets containing reactant, product, and transition state structures. Using an SN2 reaction dataset, we accurately locate reaction pathways and transition state geometries of up to 170 unseen reactions. In another approach, which does not depend on data availability, we present an efficient active learning procedure that yields an accurate MLIP and converged minimum energy path given only the reaction end point structures, avoiding quantum mechanics driven reaction pathway search at any stage of training set construction. We demonstrate this procedure on an SN2 reaction in the gas phase and with a small number of solvating water molecules, predicting reaction barriers within 20 meV of the reference quantum chemistry method. We then apply the active learning procedure on a more complex reaction involving a nucleophilic aromatic substitution and proton transfer, comparing the results against the reactive ReaxFF force field. Our active learning procedure, in addition to rapidly finding reaction paths for individual reactions, provides an approach to building large reaction path databases for training transferable reactive machine learning potentials. 
    more » « less
  2. Current neural networks for predictions of molecular properties use quantum chemistry only as a source of training data. This paper explores models that use quantum chemistry as an integral part of the prediction process. This is done by implementing self-consistent-charge Density-Functional-Tight-Binding (DFTB) theory as a layer for use in deep learning models. The DFTB layer takes, as input, Hamiltonian matrix elements generated from earlier layers and produces, as output, electronic properties from self-consistent field solutions of the corresponding DFTB Hamiltonian. Backpropagation enables efficient training of the model to target electronic properties. Two types of input to the DFTB layer are explored, splines and feed-forward neural networks. Because overfitting can cause models trained on smaller molecules to perform poorly on larger molecules, regularizations are applied that penalize nonmonotonic behavior and deviation of the Hamiltonian matrix elements from those of the published DFTB model used to initialize the model. The approach is evaluated on 15,700 hydrocarbons by comparing the root-mean-square error in energy and dipole moment, on test molecules with eight heavy atoms, to the error from the initial DFTB model. When trained on molecules with up to seven heavy atoms, the spline model reduces the test error in energy by 60% and in dipole moments by 42%. The neural network model performs somewhat better, with error reductions of 67% and 59%, respectively. Training on molecules with up to four heavy atoms reduces performance, with both the spline and neural net models reducing the test error in energy by about 53% and in dipole by about 25%. 
    more » « less
  3. Guided wave testing is a popular approach for monitoring the structural integrity of infrastructures. We focus on the primary task of damage detection, where signal processing techniques are commonly employed. The detection performance is affected by a mismatch between the wave propagation model and experimental wave data. External variations, such as temperature, which are difficult to model, also affect the performance. While deep learning models can be an alternative detection method, there is often a lack of real-world training datasets. In this work, we counter this challenge by training an ensemble of variational autoencoders only on simulation data with a wave physics-guided adversarial component. We set up an experiment with non-uniform temperature variations to test the robustness of the methods. We compare our scheme with existing deep learning detection schemes and observe superior performance on experimental data. 
    more » « less
  4. We develop a deep learning-based algorithm, called DeepForce, to link ab initio physics with the continuum theory to predict concentration profiles of confined water. We show that the deep-learned forces can be used to predict the structural properties of water confined in a nanochannel with quantum scale accuracy by solving the continuum theory given by Nernst–Planck equation. The DeepForce model has an excellent predictive performance with a relative error less than 7.6% not only for confined water in small channel systems (L < 6 nm) but also for confined water in large channel systems (L = 20 nm) which are computationally inaccessible through the high accuracy ab initio molecular dynamics simulations. Finally, we note that classical Molecular dynamics simulations can be inaccurate in capturing the interfacial physics of water in confinement (L < 4.0 nm) when quantum scale physics are neglected. 
    more » « less
  5. Mastering the concept of distributed forces is vital for students who are pursuing a major involving engineering mechanics. Misconceptions related to distributed forces that are typically acquired in introductory Physics courses should be corrected to increase student success in subsequent mechanics coursework. The goal of this study was to develop and assess a guided instructional activity using augmented reality (AR) technology to improve undergraduate engineering students' understanding of distributed forces. The AR app was accompanied by a complementary activity to guide and challenge students to model objects as beams with progressively increasing difficulty. The AR tool allowed students to (a) model a tabletop as a beam with multiple distributed forces, (b) visualize the free body diagram, and (c) compute the external support reactions. To assess the effectiveness of the activity, 43 students were allocated to control and treatment groups using an experimental nonequivalent groups preactivity/postactivity test design. Of the 43 students, 35 participated in their respective activity. Students in the control group collaborated on traditional problem‐solving, while those in the treatment group engaged in a guided activity using AR. Students' knowledge of distributed forces was measured using their scores on a 10‐item test instrument. Analysis of covariance was utilized to analyze postactivity test scores by controlling for the preactivity test scores. The treatment group demonstrated a significantly greater improvement in postactivity test scores than that of the control group. The measured effect size was 0.13, indicating that 13% of the total variance in the postactivity test scores can be attributed to the activity. Though the effect size was small, the results suggest that a guided AR activity can be more effective in improving student learning outcomes than traditional problem‐solving. 
    more » « less