skip to main content


Title: Nonlocal Neural Networks, Nonlocal Diffusion and Nonlocal Modeling
Nonlocal neural networks [25] have been proposed and shown to be effective in several computer vision tasks, where the nonlocal operations can directly capture long-range dependencies in the feature space. In this paper, we study the nature of diffusion and damping effect of nonlocal networks by doing spectrum analysis on the weight matrices of the well-trained networks, and then propose a new formulation of the nonlocal block. The new block not only learns the nonlocal interactions but also has stable dynamics, thus allowing deeper nonlocal structures. Moreover, we interpret our formulation from the general nonlocal modeling perspective, where we make connections between the proposed nonlocal network and other nonlocal models, such as nonlocal diffusion process and Markov jump process.  more » « less
Award ID(s):
1740833 1719699
NSF-PAR ID:
10100538
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Advances in Neural Information Processing Systems 31 (NIPS 2018)
Volume:
31
Page Range / eLocation ID:
1-11
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Extensive experimental evidence highlights that scalar turbulence exhibits anomalous diffusion and stronger intermittency levels at small scales compared to that in fluid turbulence. This renders the corresponding subgrid-scale dynamics modeling for scalar turbulence a greater challenge to date. We develop a new large eddy simulation (LES) paradigm for efficiently and dynamically nonlocal LES modeling of the scalar turbulence. To this end, we formulate the underlying nonlocal model starting from the filtered Boltzmann kinetic transport equation, where the divergence of subgrid-scale scalar fluxes emerges as a fractional-order Laplacian term in the filtered advection–diffusion model, coding the corresponding superdiffusive nature of scalar turbulence. Subsequently, we develop a robust data-driven algorithm for estimation of the fractional (noninteger) Laplacian exponent, where we, on the fly, calculate the corresponding model coefficient employing a new dynamic procedure. Our a priori tests show that our new dynamically nonlocal LES paradigm provides better agreement with the ground-truth filtered direct numerical simulation data in comparison to the conventional static and dynamic Prandtl–Smagorinsky models. Moreover, in order to analyze the numerical stability and assessing the model's performance, we carry out comprehensive a posteriori tests. They unanimously illustrate that our new model considerably outperforms other existing functional models, correctly predicting the backscattering phenomena and, at the same time, providing higher correlations at small-to-large filter sizes. We conclude that our proposed nonlocal subgrid-scale model for scalar turbulence is amenable for coarse LES and very large eddy simulation frameworks even with strong anisotropies, applicable to environmental applications.

     
    more » « less
  2. Understanding the factors that drive species to move and develop territorial patterns is at the heart of spatial ecology. In many cases, mechanistic models, where the movement of species is based on local information, have been proposed to study such territorial patterns. In this work, we introduce a nonlocal system of reaction-advection-diffusion equations that incorporate the use of nonlocal information to influence the movement of species. One benefit of this model is that groups are able to maintain coherence without having a home-center. As incorporating nonlocal mechanisms comes with analytical and computational costs, we explore the potential of using long-wave approximations of the nonlocal model to determine if they are suitable alternatives that are more computationally efficient. We use the gradient flow-structure of the both local and nonlocal models to compute the equilibrium solutions of the mechanistic models via energy minimizers. Generally, the minimizers of the local models match the minimizers of the nonlocal model reasonably well, but in some cases, the differences in segregation strength between groups is highlighted. In some cases, as we scale the number of groups, we observe an increased savings in computational time when using the local model versus the nonlocal counterpart. 
    more » « less
  3. null (Ed.)
    Abstract We consider dynamics driven by interaction energies on graphs. We introduce graph analogues of the continuum nonlocal-interaction equation and interpret them as gradient flows with respect to a graph Wasserstein distance. The particular Wasserstein distance we consider arises from the graph analogue of the Benamou–Brenier formulation where the graph continuity equation uses an upwind interpolation to define the density along the edges. While this approach has both theoretical and computational advantages, the resulting distance is only a quasi-metric. We investigate this quasi-metric both on graphs and on more general structures where the set of “vertices” is an arbitrary positive measure. We call the resulting gradient flow of the nonlocal-interaction energy the nonlocal nonlocal-interaction equation (NL $$^2$$ 2 IE). We develop the existence theory for the solutions of the NL $$^2$$ 2 IE as curves of maximal slope with respect to the upwind Wasserstein quasi-metric. Furthermore, we show that the solutions of the NL $$^2$$ 2 IE on graphs converge as the empirical measures of the set of vertices converge weakly, which establishes a valuable discrete-to-continuum convergence result. 
    more » « less
  4. Abstract

    In most practical scenarios, optical susceptibilities can be treated as a local property of a medium. For example, in the context of nonlinear optics we can typically treat the Kerr and Raman response as local, such that optical fields at one location do not produce a nonlinear response at distinct locations in space. This is because the electronic and vibrational disturbances produced within the material are confined to a region that is smaller than an optical wavelength. By comparison, Brillouin interactions, mediated by traveling-wave acoustic phonons, can result in a highly nonlocal nonlinear response as the elastic waves generated in the process can occupy a region in space much larger than an optical wavelength. The unique properties of these interactions can be exploited to engineer new types of processes, where highly delocalized phonon modes serve as an engineerable channel that mediates scattering processes between light waves propagating in distinct optical waveguides. These types of nonlocal optomechanical responses have recently been demonstrated as the basis for information transduction, however the nontrivial dynamics of such systems has yet to be explored. In this work, we show that the third-order nonlinear process resulting from spatially extended Brillouin-active phonon modes involves mixing products from spatially separated, optically decoupled waveguides, yielding a nonlocal susceptibility. Building on these concepts, we illustrate how nontrivial multi-mode acoustic interference can produce a nonlocal susceptibility with a multi-pole frequency response, as the basis for new optical and microwave signal processing schemes within traveling wave systems.

     
    more » « less
  5. Abstract

    In this article we formulate a stable computational nonlocal poromechanics model for dynamic analysis of saturated porous media. As a novelty, the stabilization formulation eliminates zero‐energy modes associated with the original multiphase correspondence constitutive models in the coupled nonlocal poromechanics model. The two‐phase stabilization scheme is formulated based on an energy method that incorporates inhomogeneous solid deformation and fluid flow. In this method, the nonlocal formulations of skeleton strain energy and fluid flow dissipation energy equate to their local formulations. The stable coupled nonlocal poromechanics model is solved for dynamic analysis by an implicit time integration scheme. As a new contribution, we validate the coupled stabilization formulation by comparing numerical results with analytical and finite element solutions for one‐dimensional and two‐dimensional dynamic problems in saturated porous media. Numerical examples of dynamic strain localization in saturated porous media are presented to demonstrate the efficacy of the stable coupled poromechanics framework for localized failure under dynamic loads.

     
    more » « less