An official website of the United States government
When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories
- Award ID(s):
- 2044660
- PAR ID:
- 10462290
- Date Published:
- Journal Name:
- ACL
- Page Range / eLocation ID:
- 9802 to 9822
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
Abstract We present a general class of machine learning algorithms called parametric matrix models. In contrast with most existing machine learning models that imitate the biology of neurons, parametric matrix models use matrix equations that emulate physical systems. Similar to how physics problems are usually solved, parametric matrix models learn the governing equations that lead to the desired outputs. Parametric matrix models can be efficiently trained from empirical data, and the equations may use algebraic, differential, or integral relations. While originally designed for scientific computing, we prove that parametric matrix models are universal function approximators that can be applied to general machine learning problems. After introducing the underlying theory, we apply parametric matrix models to a series of different challenges that show their performance for a wide range of problems. For all the challenges tested here, parametric matrix models produce accurate results within an efficient and interpretable computational framework that allows for input feature extrapolation.more » « less
-
Abstract Topological insulators possess protected boundary states which are robust against disorders and have immense implications in both fermionic and bosonic systems. Harnessing these topological effects in nonequilibrium scenarios is highly desirable and has led to the development of topological lasers. The topologically protected boundary states usually lie within the bulk bandgap, and selectively exciting them without inducing instability in the bulk modes of bosonic systems is challenging. Here, we consider topological parametrically driven nonlinear resonator arrays that possess complex eigenvalues only in the edge modes in spite of the uniform pumping. We show parametric oscillation occurs in the topological boundary modes of one and two dimensional systems as well as in the corner modes of a higher order topological insulator system. Furthermore, we demonstrate squeezing dynamics below the oscillation threshold, where the quantum properties of the topological edge modes are robust against certain disorders. Our work sheds light on the dynamics of weakly nonlinear topological systems driven out-of-equilibrium and reveals their intriguing behavior in the quantum regime.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.18653/v1/2023.acl-long.546
