skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Mean Field Analysis of Sparse Reconstruction with Correlated Variables.
Sparse reconstruction algorithms aim to retrieve high-dimensional sparse signals from a limited number of measurements. A common example is LASSO or Basis Pursuit where sparsity is enforced using an `1-penalty together with a cost function ||y − Hx||_2^2. For random design matrices H, a sharp phase transition boundary separates the ‘good’ parameter region where error-free recovery of a sufficiently sparse signal is possible and a ‘bad’ regime where the recovery fails. However, theoretical analysis of phase transition boundary of the correlated variables case lags behind that of uncorrelated variables. Here we use replica trick from statistical physics to show that when an Ndimensional signal x is K-sparse and H is M × N dimensional with the covariance E[H_{ia}H_{jb}] = 1 M C_{ij}D_{ab}, with all D_{aa} = 1, the perfect recovery occurs at M ∼ ψ_K(D)K log(N/M) in the very sparse limit, where ψ_K(D) ≥ 1, indicating need for more observations for the same degree of sparsity.  more » « less
Award ID(s):
1344069
PAR ID:
10019671
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Eusipco
ISSN:
2076-1465
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract We prove an inequality that unifies previous works of the authors on the properties of the Radon transform on convex bodies including an extension of the Busemann–Petty problem and a slicing inequality for arbitrary functions. Let $$K$$ and $$L$$ be star bodies in $${\mathbb R}^n,$$ let $0<k<n$ be an integer, and let $f,g$ be non-negative continuous functions on $$K$$ and $$L$$, respectively, so that $$\|g\|_\infty =g(0)=1.$$ Then $$\begin{align*} & \frac{\int_Kf}{\left(\int_L g\right)^{\frac{n-k}n}|K|^{\frac kn}} \le \frac n{n-k} \left(d_{\textrm{ovr}}(K,\mathcal{B}\mathcal{P}_k^n)\right)^k \max_{H} \frac{\int_{K\cap H} f}{\int_{L\cap H} g}, \end{align*}$$where $|K|$ stands for volume of proper dimension, $$C$$ is an absolute constant, the maximum is taken over all $(n-k)$-dimensional subspaces of $${\mathbb R}^n,$$ and $$d_{\textrm{ovr}}(K,\mathcal{B}\mathcal{P}_k^n)$$ is the outer volume ratio distance from $$K$$ to the class of generalized $$k$$-intersection bodies in $${\mathbb R}^n.$$ Another consequence of this result is a mean value inequality for the Radon transform. We also obtain a generalization of the isomorphic version of the Shephard problem. 
    more » « less
  2. Abstract Let f : ℙ 1 → ℙ 1 {f:\mathbb{P}^{1}\to\mathbb{P}^{1}} be a map of degree > 1 {>1} defined over a function field k = K ⁢ ( X ) {k=K(X)} , where K is a number field and X is a projective curve over K . For each point a ∈ ℙ 1 ⁢ ( k ) {a\in\mathbb{P}^{1}(k)} satisfying a dynamical stability condition, we prove that the Call–Silverman canonical height for specialization f t {f_{t}} at point a t {a_{t}} , for t ∈ X ⁢ ( ℚ ¯ ) {t\in X(\overline{\mathbb{Q}})} outside a finite set, induces a Weil height on the curve X ; i.e., we prove the existence of a ℚ {\mathbb{Q}} -divisor D = D f , a {D=D_{f,a}} on X so that the function t ↦ h ^ f t ⁢ ( a t ) - h D ⁢ ( t ) {t\mapsto\hat{h}_{f_{t}}(a_{t})-h_{D}(t)} is bounded on X ⁢ ( ℚ ¯ ) {X(\overline{\mathbb{Q}})} for any choice of Weil height associated to D . We also prove a local version, that the local canonical heights t ↦ λ ^ f t , v ⁢ ( a t ) {t\mapsto\hat{\lambda}_{f_{t},v}(a_{t})} differ from a Weil function for D by a continuous function on X ⁢ ( ℂ v ) {X(\mathbb{C}_{v})} , at each place v of the number field K . These results were known for polynomial maps f and all points a ∈ ℙ 1 ⁢ ( k ) {a\in\mathbb{P}^{1}(k)} without the stability hypothesis,[21, 14],and for maps f that are quotients of endomorphisms of elliptic curves E over k and all points a ∈ ℙ 1 ⁢ ( k ) {a\in\mathbb{P}^{1}(k)} . [32, 29].Finally, we characterize our stability condition in terms of the geometry of the induced map f ~ : X × ℙ 1 ⇢ X × ℙ 1 {\tilde{f}:X\times\mathbb{P}^{1}\dashrightarrow X\times\mathbb{P}^{1}} over K ; and we prove the existence of relative Néron models for the pair ( f , a ) {(f,a)} , when a is a Fatou point at a place γ of k , where the local canonical height λ ^ f , γ ⁢ ( a ) {\hat{\lambda}_{f,\gamma}(a)} can be computed as an intersection number. 
    more » « less
  3. null (Ed.)
    In this paper we consider the following sparse recovery problem. We have query access to a vector 𝐱 ∈ ℝ^N such that x̂ = 𝐅 𝐱 is k-sparse (or nearly k-sparse) for some orthogonal transform 𝐅. The goal is to output an approximation (in an 𝓁₂ sense) to x̂ in sublinear time. This problem has been well-studied in the special case that 𝐅 is the Discrete Fourier Transform (DFT), and a long line of work has resulted in sparse Fast Fourier Transforms that run in time O(k ⋅ polylog N). However, for transforms 𝐅 other than the DFT (or closely related transforms like the Discrete Cosine Transform), the question is much less settled. In this paper we give sublinear-time algorithms - running in time poly(k log(N)) - for solving the sparse recovery problem for orthogonal transforms 𝐅 that arise from orthogonal polynomials. More precisely, our algorithm works for any 𝐅 that is an orthogonal polynomial transform derived from Jacobi polynomials. The Jacobi polynomials are a large class of classical orthogonal polynomials (and include Chebyshev and Legendre polynomials as special cases), and show up extensively in applications like numerical analysis and signal processing. One caveat of our work is that we require an assumption on the sparsity structure of the sparse vector, although we note that vectors with random support have this property with high probability. Our approach is to give a very general reduction from the k-sparse sparse recovery problem to the 1-sparse sparse recovery problem that holds for any flat orthogonal polynomial transform; then we solve this one-sparse recovery problem for transforms derived from Jacobi polynomials. Frequently, sparse FFT algorithms are described as implementing such a reduction; however, the technical details of such works are quite specific to the Fourier transform and moreover the actual implementations of these algorithms do not use the 1-sparse algorithm as a black box. In this work we give a reduction that works for a broad class of orthogonal polynomial families, and which uses any 1-sparse recovery algorithm as a black box. 
    more » « less
  4. Abstract For any compact connected one-dimensional submanifold $$K\subset \mathbb R^{2\times 2}$$ without boundary that has no rank-one connection and is elliptic, we prove the quantitative rigidity estimate $$\begin{align*} \inf_{M\in K}\int_{B_{1/2}}| Du -M |^2\, \textrm{d}x \leq C \int_{B_1} \operatorname{dist}^2(Du, K)\, \textrm{d}x, \qquad\forall u\in H^1(B_1;\mathbb R^2). \end{align*}$$This is an optimal generalization, for compact connected submanifolds of $$\mathbb R^{2\times 2}$$ without boundary, of the celebrated quantitative rigidity estimate of Friesecke, James, and Müller for the approximate differential inclusion into $SO(n)$. The proof relies on the special properties of elliptic subsets $$K\subset{{\mathbb{R}}}^{2\times 2}$$ with respect to conformal–anticonformal decomposition, which provide a quasilinear elliptic partial differential equation satisfied by solutions of the exact differential inclusion $$Du\in K$$. We also give an example showing that no analogous result can hold true in $$\mathbb R^{n\times n}$$ for $$n\geq 3$$. 
    more » « less
  5. Morin, Pat; Oh, Eunjin (Ed.)
    Let S be a set of n points in ℝ^d, where d ≥ 2 is a constant, and let H₁,H₂,…,H_{m+1} be a sequence of vertical hyperplanes that are sorted by their first coordinates, such that exactly n/m points of S are between any two successive hyperplanes. Let |A(S,m)| be the number of different closest pairs in the {(m+1) choose 2} vertical slabs that are bounded by H_i and H_j, over all 1 ≤ i < j ≤ m+1. We prove tight bounds for the largest possible value of |A(S,m)|, over all point sets of size n, and for all values of 1 ≤ m ≤ n. As a result of these bounds, we obtain, for any constant ε > 0, a data structure of size O(n), such that for any vertical query slab Q, the closest pair in the set Q ∩ S can be reported in O(n^{1/2+ε}) time. Prior to this work, no linear space data structure with sublinear query time was known. 
    more » « less