skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 10:00 PM ET on Friday, December 8 until 2:00 AM ET on Saturday, December 9 due to maintenance. We apologize for the inconvenience.

Title: Wavelet Tree Parsing with Freeform Lensing
We propose an architecture for adaptive sensing of images by progressively measuring its wavelet coefficients. Our approach, commonly referred to as wavelet tree parsing, adaptively selects the specific wavelet coefficients to be sensed by modeling the children of dominant coefficients to be dominant themselves. A key challenge for practical implementation of this technique is that the wavelet patterns, especially at finer scales, occupy a tiny portion of the field of view and, hence, the resulting measurements have very poor light levels and signal-to-noise ratios (SNR). To address this, we propose a novel imaging architecture that uses a phase-only spatial light modulator as a freeform lens to concentrate a light source and create the wavelet patterns. This ensures that the SNR of measurements remain constant across different spatial scales. Using a lab prototype, we demonstrate successful reconstruction on a wide range of real scenes and show that concentrating illumination enables us to outperform non-adaptive techniques as well as adaptive techniques based on traditional projectors.  more » « less
Award ID(s):
1618823 1652569
Author(s) / Creator(s):
Date Published:
Journal Name:
IEEE International Conference on Computational Photography
Page Range / eLocation ID:
1 to 10
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Feature extraction, such as spectral occupancy, interferer energy and type, or direction-of-arrival, from wideband radio-frequency (RF) signals finds use in a growing number of applications as it enhances RF transceivers with cognitive abilities and enables parameter tuning of traditional RF chains. In power and cost limited applications, e.g., for sensor nodes in the Internet of Things, wideband RF feature extraction with conventional, Nyquist-rate analog-to-digital converters is infeasible. However, the structure of many RF features (such as signal sparsity) enables the use of compressive sensing (CS) techniques that acquire such signals at sub-Nyquist rates; while such CS-based analog-to-information (A2I) converters have the potential to enable low-cost and energy-efficient wideband RF sensing, they suffer from a variety of real-world limitations, such as noise folding, low sensitivity, aliasing, and limited flexibility. This paper proposes a novel CS-based A2I architecture called non-uniform wavelet sampling. Our solution extracts a carefully-selected subset of wavelet coefficients directly in the RF domain, which mitigates the main issues of existing A2I converter architectures. For multi-band RF signals, we propose a specialized variant called non-uniform wavelet bandpass sampling (NUWBS), which further improves sensitivity and reduces hardware complexity by leveraging the multi-band signal structure. We use simulations to demonstrate that NUWBS approaches the theoretical performance limits of ℓ₁-norm-based sparse signal recovery. We investigate hardware-design aspects and show ASIC measurement results for the wavelet generation stage, which highlight the efficacy of NUWBS for a broad range of RF feature extraction tasks in cost- and power-limited applications. 
    more » « less
  2. Root systems develop different root types that individually sense cues from their local environment and integrate this information with systemic signals. This complex multi-dimensional amalgam of inputs enables continuous adjustment of root growth rates, direction, and metabolic activity that define a dynamic physical network. Current methods for analyzing root biology balance physiological relevance with imaging capability. To bridge this divide, we developed an integrated-imaging system called Growth and Luminescence Observatory for Roots (GLO-Roots) that uses luminescence-based reporters to enable studies of root architecture and gene expression patterns in soil-grown, light-shielded roots. We have developed image analysis algorithms that allow the spatial integration of soil properties, gene expression, and root system architecture traits. We propose GLO-Roots as a system that has great utility in presenting environmental stimuli to roots in ways that evoke natural adaptive responses and in providing tools for studying the multi-dimensional nature of such processes.

    more » « less
  3. The scarcity of the optical power is the main challenge for underwater visible light communication. It becomes worst for communication across the air-water interface because of the reflection of light from the air-water interface. Differential pulse position modulation (DPPM) is one of the power efficient modulation techniques. In L-DPPM a block of M = log 2 L input data is mapped into one of the L distinct waveforms containing only one 'on' chip. The size of the DPPM packet is variable and depends on the value of input data and L, which makes error detection quite challenging. In this paper, we propose a frame structure that efficiently enables error detection within a packet for various symbol length, L, of DPPM. We also propose an algorithm using such a frame structure to enable effective detection of packet errors and for adaptively changing the value of L for optimal power efficiency while meeting a certain bound on the packet error rate (PER). We have named our proposed protocol as adaptive differential pulse position modulation (ADPPM). The Bit rate and PER have been studied for different signal-to-noise ratio (SNR) through simulation. A comparison between ADPPM and OOK, DPPM with fixed L is provided. 
    more » « less
  4. We consider the problem of efficiently approximating and encoding high-dimensional data sampled from a probability distribution ρ in ℝD, that is nearly supported on a d-dimensional set  - for example supported on a d-dimensional manifold. Geometric Multi-Resolution Analysis (GMRA) provides a robust and computationally efficient procedure to construct low-dimensional geometric approximations of  at varying resolutions. We introduce GMRA approximations that adapt to the unknown regularity of , by introducing a thresholding algorithm on the geometric wavelet coefficients. We show that these data-driven, empirical geometric approximations perform well, when the threshold is chosen as a suitable universal function of the number of samples n, on a large class of measures ρ, that are allowed to exhibit different regularity at different scales and locations, thereby efficiently encoding data from more complex measures than those supported on manifolds. These GMRA approximations are associated to a dictionary, together with a fast transform mapping data to d-dimensional coefficients, and an inverse of such a map, all of which are data-driven. The algorithms for both the dictionary construction and the transforms have complexity CDnlogn with the constant C exponential in d. Our work therefore establishes Adaptive GMRA as a fast dictionary learning algorithm, with approximation guarantees, for intrinsically low-dimensional data. We include several numerical experiments on both synthetic and real data, confirming our theoretical results and demonstrating the effectiveness of Adaptive GMRA. 
    more » « less
  5. Abstract

    Observed ecological responses to climate change are highly individualistic across species and locations, and understanding the drivers of this variability is essential for management and conservation efforts. While it is clear that differences in exposure, sensitivity, and adaptive capacity all contribute to heterogeneity in climate change vulnerability, predicting these features at macroecological scales remains a critical challenge. We explore multiple drivers of heterogeneous vulnerability across the distributions of 96 vegetation types of the ecologically diverse western US, using data on observed climate trends from 1948 to 2014 to highlight emerging patterns of change. We ask three novel questions about factors potentially shaping vulnerability across the region: (a) How does sensitivity to different climate variables vary geographically and across vegetation classes? (b) How do multivariate climate exposure patterns interact with these sensitivities to shape vulnerability patterns? (c) How different are these vulnerability patterns according to three widely implemented vulnerability paradigms—niche novelty (decline in modeled suitability), temporal novelty (standardized anomaly), and spatial novelty (inbound climate velocity)—each of which uses a distinct frame of reference to quantify climate departure? We propose that considering these three novelty paradigms in combination could help improve our understanding and prediction of heterogeneous climate change responses, and we discuss the distinct climate adaptation strategies connected with different combinations of high and low novelty across the three metrics. Our results reveal a diverse mosaic of climate change vulnerability signatures across the region's plant communities. Each of the above factors contributes strongly to this heterogeneity: climate variable sensitivity exhibits clear patterns across vegetation types, multivariate climate change data reveal highly diverse exposure signatures across locations, and the three novelty paradigms diverge widely in their climate change vulnerability predictions. Together, these results shed light on potential drivers of individualistic climate change responses and may help to inform effective management strategies.

    more » « less