skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Learned multiphysics inversion with differentiable programming and machine learning
We present the Seismic Laboratory for Imaging and Modeling/Monitoring open-source software framework for computational geophysics and, more generally, inverse problems involving the wave equation (e.g., seismic and medical ultrasound), regularization with learned priors, and learned neural surrogates for multiphase flow simulations. By integrating multiple layers of abstraction, the software is designed to be both readable and scalable, allowing researchers to easily formulate problems in an abstract fashion while exploiting the latest developments in high-performance computing. The design principles and their benefits are illustrated and demonstrated by means of building a scalable prototype for permeability inversion from time-lapse crosswell seismic data, which, aside from coupling of wave physics and multiphase flow, involves machine learning.  more » « less
Award ID(s):
2203821
PAR ID:
10436336
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
The Leading Edge
Volume:
42
Issue:
7
ISSN:
1070-485X
Page Range / eLocation ID:
474 to 486
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We experimentally study the transition from droplet to wave regimes in microfluidic liquid–liquid multiphase flows having large differences in viscosity. A unified approach based on periodic pattern analysis is employed to study relationships between dispersed and separated flow regimes, including dripping, jetting, capillary waves, inertial waves and core–annular flows over a wide range of flow rates and viscosity contrasts. We examine the morphology and dynamics of each flow regime based on wavelength, frequency and velocity of repeating unit cells to elucidate their connections and to develop predictive capabilities based on dimensionless control parameters. We demonstrate in particular that pattern selection is contingent upon the propagation velocity of droplets and waves at the transition. We also investigate microfluidic wave breaking phenomena with the formation of ligaments and droplets from wave crests in both capillary and inertial wave regimes. This work expands conventional multiphase flow regimes observed in microchannels and shows new routes to disperse highly viscous materials using interfacial waves dynamics in confined microsystems. 
    more » « less
  2. Abstract Convective flow in the deep mantle controls Earth's dynamic evolution, influences plate tectonics, and has shaped Earth's current surface features. Present and past convection‐induced deformation manifests itself in seismic anisotropy, which is particularly strong in the mantle's uppermost and lowermost portions. While the general patterns of seismic anisotropy have been mapped for the upper mantle, anisotropy in the lowermost mantle (called D′′) is at an earlier stage of exploration. Here we review recent progress in methods to measure and interpret D′′ anisotropy. Our understanding of the limitations of existing methods and the development of new measurement strategies have been aided enormously by the availability of high‐performance computing resources. We give an overview of how measurements of seismic anisotropy can help constrain the mineralogy and fabric of the deep mantle. Specifically, new and creative strategies that combine multiple types of observations provide much tighter constraints on the geometry of anisotropy than have previously been possible. We also discuss how deep mantle seismic anisotropy provides insights into lowermost mantle dynamics. We summarize what we have learned so far from measurements of D′′ anisotropy, how inferences of lowermost mantle flow from measurements of seismic anisotropy relate to geodynamic models of mantle flow, and what challenges we face going forward. Finally, we discuss some of the important unsolved problems related to the dynamics of the lowermost mantle that can be elucidated in the future by combining observations of seismic anisotropy with geodynamic predictions of lowermost mantle flow. 
    more » « less
  3. SUMMARY Geothermal heat flow beneath the Greenland and Antarctic ice sheets is an important boundary condition for ice sheet dynamics, but is rarely measured directly and therefore is inferred indirectly from proxies (e.g. seismic structure, magnetic Curie depth, surface topography). We seek to improve the understanding of the relationship between heat flow and one such proxy—seismic structure—and determine how well heat flow data can be predicted from the structure (the characterization problem). We also seek to quantify the extent to which this relationship can be extrapolated from one continent to another (the transportability problem). To address these problems, we use direct heat flow observations and new seismic structural information in the contiguous United States and Europe, and construct three Machine Learning models of the relationship with different levels of complexity (Linear Regression, Decision Tree and Random Forest). We compare these models in terms of their interpretability, the predicted heat flow accuracy within a continent and the accuracy of the extrapolation between Europe and the United States. The Random Forest and Decision Tree models are the most accurate within a continent, while the Linear Regression and Decision Tree models are the most accurate upon extrapolation between continents. The Decision Tree model uniquely illuminates the regional variations of the relationship between heat flow and seismic structure. From the Decision Tree model, uppermost mantle shear wave speed, crustal shear wave speed and Moho depth together explain more than half of the observed heat flow variations in both the United States [$$r^2 \approx 0.6$$ (coefficient of determination), $$\mathrm{RMSE} \approx 8\, {\rm mW}\,{\rm m}^{-2}$$ (Root Mean Squared Error)] and Europe ($$r^2 \approx 0.5, \mathrm{RMSE} \approx 13\, {\rm mW}\,{\rm m}^{-2}$$), such that uppermost mantle shear wave speed is the most important. Extrapolating the U.S.-trained models to Europe reasonably predicts the geographical distribution of heat flow [$$\rho = 0.48$$ (correlation coefficient)], but not the absolute amplitude of the variations ($r^2 = 0.17$), similarly from Europe to the United States ($$\rho = 0.66, r^2 = 0.24$$). The deterioration of accuracy upon extrapolation is caused by differences between the continents in how seismic structure is imaged, the heat flow data and intrinsic crustal radiogenic heat production. Our methods have the potential to improve the reliability and resolution of heat flow inferences across Antarctica and the validation and cross-validation procedures we present can be applied to heat flow proxies other than seismic structure, which may help resolve inconsistencies between existing subglacial heat flow values inferred using different proxies. 
    more » « less
  4. Wave propagation is fundamental to applications including natural resource exploration, nuclear fusion research, and military defense, among others. However, developing accurate and efficient numerical algorithms for solving time-harmonic wave propagation problems is notoriously difficult. One difficulty is that classical discretization techniques (e.g., Galerkin finite elements, finite difference, etc.) yield indefinite discrete systems that preclude the use of many scalable solution algorithms. Significant progress has been made to develop specialized preconditioners for high-frequency wave propagation problems but robust and scalable solvers for general problems, including non-homogenous media and complex geometries, remain elusive. An alternative approach is to use minimum residual discretization methods—that yield Hermitian positive-definite discrete systems—and may be amenable to more standard preconditioners. Indeed, popularization of the first-order system least-squares methodology (FOSLS) was driven by the applicability of geometric and algebraic multigrid to otherwise indefinite problems. However, for wave propagation problems, FOSLS is known to be highly dissipative and is thus less competitive in the high-frequency regime. The discontinuous Petrov–Galerkin (DPG) method of Demkowicz and Gopalakrishnan is a minimum residual finite element method with several additional attractive properties: mesh-independent stability, a built-in error indicator, and applicability to a number of variational formulations. In the context of high-frequency wave propagation, the ultraweak DPG formulation has been observed to produce pollution error roughly commensurate to Galerkin discretizations. DPG discretizations may thus deliver accuracy typical of classical discretization techniques, but result in Hermitian positive-definite discrete systems that are often more amenable to preconditioning. A multigrid preconditioner for DPG systems, developed in the dissertation work of S. Petrides, was shown to scale efficiently in a shared-memory implementation. The primary objective of this dissertation is development of an efficient, distributed implementation of the DPG multigrid solver (DPG-MG). The distributed DPG-MG solver developed in this work will be demonstrated to be massively scalable, enabling solution of three-dimensional problems with O(10¹²) degrees of freedom on up to 460 000 CPU cores, an unprecedented scale for high-frequency wave propagation. The scalability of the DPG-MG solver will be further combined with hp-adaptivity to enable efficient solution of challenging real-world high-frequency wave propagation problems including optical fiber modeling, simulation of RF heating in tokamak devices, and seismic simulation. These applications include complex three-dimensional geometries, heterogeneous and anisotropic media, and localized features; demonstrating the robustness and versatility of the solver and tools developed in this dissertation. 
    more » « less
  5. The recent application of neural network algorithms to problems in gravitational-wave physics invites the study of how best to build production-ready applications on top of them. By viewing neural networks not as standalone models, but as components or functions in larger data processing pipelines, we can apply lessons learned from both traditional software development practices as well as successful deep learning applications from the private sector. This paper highlights challenges presented by straightforward but naïve deployment strategies for deep learning models, and identifies solutions to them gleaned from these sources. It then presents HERMES, a library of tools for implementing these solutions, and describes how HERMES is being used to develop a particular deep learning application which will be deployed during the next data collection run of the International Gravitational-Wave Observatories. 
    more » « less