Nonlocal neural networks [25] have been proposed and shown to be effective in several computer vision tasks, where the nonlocal operations can directly capture long-range dependencies in the feature space. In this paper, we study the nature of diffusion and damping effect of nonlocal networks by doing spectrum analysis on the weight matrices of the well-trained networks, and then propose a new formulation of the nonlocal block. The new block not only learns the nonlocal interactions but also has stable dynamics, thus allowing deeper nonlocal structures. Moreover, we interpret our formulation from the general nonlocal modeling perspective, where we make connections between the proposed nonlocal network and other nonlocal models, such as nonlocal diffusion process and Markov jump process.
more »
« less
Nonlocal trace spaces and extension results for nonlocal calculus
More Like this
-
-
null (Ed.)Abstract Actively tunable and reconfigurable wavefront shaping by optical metasurfaces poses a significant technical challenge often requiring unconventional materials engineering and nanofabrication. Most wavefront-shaping metasurfaces can be considered “local” in that their operation depends on the responses of individual meta-units. In contrast, “nonlocal” metasurfaces function based on the modes supported by many adjacent meta-units, resulting in sharp spectral features but typically no spatial control of the outgoing wavefront. Recently, nonlocal metasurfaces based on quasi-bound states in the continuum have been shown to produce designer wavefronts only across the narrow bandwidth of the supported Fano resonance. Here, we leverage the enhanced light-matter interactions associated with sharp Fano resonances to explore the active modulation of optical spectra and wavefronts by refractive-index tuning and mechanical stretching. We experimentally demonstrate proof-of-principle thermo-optically tuned nonlocal metasurfaces made of silicon and numerically demonstrate nonlocal metasurfaces that thermo-optically switch between distinct wavefront shapes. This meta-optics platform for thermally reconfigurable wavefront shaping requires neither unusual materials and fabrication nor active control of individual meta-units.more » « less
-
A bstract Asymptotically nonlocal field theories interpolate between Lee-Wick theories with multiple propagator poles, and ghost-free nonlocal theories. Previous work on asymp- totically nonlocal scalar, Abelian, and non-Abelian gauge theories has demonstrated the existence of an emergent regulator scale that is hierarchically smaller than the lightest Lee-Wick partner, in a limit where the Lee-Wick spectrum becomes dense and decoupled. We generalize this construction to linearized gravity, and demonstrate the emergent regula- tor scale in three examples: by studying the resolution of the singularity (i) at the origin in the classical solution for the metric of a point particle, and (ii) in the nonrelativistic gravitational potential computed via a one-graviton exchange amplitude; (iii) we also show how this derived scale regulates the one-loop graviton contribution to the self energy of a real scalar field. We comment briefly on the generalization of our approach to the full, nonlinear theory of gravity.more » « less