skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A FUNCTION SPACE VIEW OF BOUNDED NORM INFINITE WIDTH RELU NETS: THE MULTIVARIATE CASE
We give a tight characterization of the (vectorized Euclidean) norm of weights required to realize a function f : R^d -> R as a single hidden-layer ReLU network with an unbounded number of units (infinite width), extending the univariate characterization of Savarese et al. (2019) to the multivariate case.  more » « less
Award ID(s):
1740707 1934637
PAR ID:
10183678
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
International Conference on Learning Representations
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract A local ring R is regular if and only if every finitely generated R -module has finite projective dimension. Moreover, the residue field k is a test module: R is regular if and only if k has finite projective dimension. This characterization can be extended to the bounded derived category $$\mathsf {D}^{\mathsf f}(R)$$ , which contains only small objects if and only if R is regular. Recent results of Pollitz, completing work initiated by Dwyer–Greenlees–Iyengar, yield an analogous characterization for complete intersections: R is a complete intersection if and only if every object in $$\mathsf {D}^{\mathsf f}(R)$$ is proxy small. In this paper, we study a return to the world of R -modules, and search for finitely generated R -modules that are not proxy small whenever R is not a complete intersection. We give an algorithm to construct such modules in certain settings, including over equipresented rings and Stanley–Reisner rings. 
    more » « less
  2. We give a tight characterization of the (vectorized Euclidean) norm of weights required to realize a function f : Rd → R as a single hidden-layer ReLU network with an unbounded number of units (infinite width), extending the univariate characterization of Savarese et al. (2019) to the multivariate case. 
    more » « less
  3. null (Ed.)
    The new PtVO(SOCR) 4 lantern complexes, 1 (R = CH 3 ) and 2 (R = Ph) behave as neutral O-donor ligands to Ln(OR) 3 with Ln = Ce, Nd. Four heterotrimetallic complexes with linear {LnOVPt} units were prepared: [Ln(ODtbp) 3 {PtVO(SOCR) 4 }] (Ln = Ce, 3Ce (R = CH 3 ), 4Ce (R = Ph); Nd, 3Nd (R = CH 3 ), 4Nd (R = Ph); ODtbp = 2,6-ditertbutylphenolate). Magnetic characterization confirms slow magnetic relaxation behaviour and suggests antiferromagnetic coupling across {Ln–OV} in all four complexes, with variations tunable as a function of Ln and R. 
    more » « less
  4. A Noetherian local ring ( R , m ) (R,\frak {m}) is called Buchsbaum if the difference ℓ ( R / q ) − e ( q , R ) \ell (R/\mathfrak {q})-e(\mathfrak {q}, R) , where q \mathfrak {q} is an ideal generated by a system of parameters, is a constant independent of q \mathfrak {q} . In this article, we study the tight closure analog of this condition. We prove that in an unmixed excellent local ring ( R , m ) (R,\frak {m}) of prime characteristic p > 0 p>0 and dimension at least one, the difference e ( q , R ) − ℓ ( R / q ∗ ) e(\mathfrak {q}, R)-\ell (R/\mathfrak {q}^*) is independent of q \mathfrak {q} if and only if the parameter test ideal τ p a r ( R ) \tau _{\mathrm {par}}(R) contains m \frak {m} . We also provide a characterization of this condition via derived category which is analogous to Schenzel’s criterion for Buchsbaum rings. 
    more » « less
  5. There is a vast theory of the asymptotic behavior of orthogonal polynomials with respect to a measure on R \mathbb {R} and its applications to Jacobi matrices. That theory has an obvious affine invariance and a very special role for ∞ \infty . We extend aspects of this theory in the setting of rational functions with poles on R ¯ = R ∪ { ∞ } \overline {\mathbb {R}} = \mathbb {R} \cup \{\infty \} , obtaining a formulation which allows multiple poles and proving an invariance with respect to R ¯ \overline {\mathbb {R}} -preserving Möbius transformations. We obtain a characterization of Stahl–Totik regularity of a GMP matrix in terms of its matrix elements; as an application, we give a proof of a conjecture of Simon – a Cesàro–Nevai property of regular Jacobi matrices on finite gap sets. 
    more » « less