skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Demonstrating unambiguous shape from polarization for Mueller imaging
Polarization imaging is highly sensitive to surface shape but is inherently ambiguous, as measurements depend only on the projected surface normal orientation. This shape-from-polarization algorithm introduces a method to recover unique surface normals from monocular Mueller images. We formulate the inverse problem as the estimation of the scattering geometry, enabling the extraction of unambiguous depth information from otherwise ambiguous normal data. Simulations show that while the initial ambiguous surface normal estimates are robust to noise, the subsequent depth recovery and disambiguation are more noise-sensitive. For simple object shapes, the method resolves ambiguities with mean angular errors below 10° at an SNR of 100. However, complex shapes require an SNR of 1,000 to achieve comparable accuracy. Notably, as the polarimetric capture system is simplified, the disambiguation performance approaches that of random selection for linear Stokes images.  more » « less
Award ID(s):
2337915
PAR ID:
10614446
Author(s) / Creator(s):
;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Optics Express
Volume:
33
Issue:
14
ISSN:
1094-4087; OPEXFF
Format(s):
Medium: X Size: Article No. 30418
Size(s):
Article No. 30418
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    The sky exhibits a unique spatial polarization pattern by scattering the unpolarized sun light. Just like insects use this unique angular pattern to navigate, we use it to map pixels to directions on the sky. That is, we show that the unique polarization pattern encoded in the polarimetric appearance of an object captured under the sky can be decoded to reveal the surface normal at each pixel. We derive a polarimetric reflection model of a diffuse plus mirror surface lit by the sun and a clear sky. This model is used to recover the per-pixel surface normal of an object from a single polarimetric image or from multiple polarimetric images captured under the sky at different times of the day. We experimentally evaluate the accuracy of our shape-from-sky method on a number of real objects of different surface compositions. The results clearly show that this passive approach to fine-geometry recovery that fully leverages the unique illumination made by nature is a viable option for 3D sensing. With the advent of quad-Bayer polarization chips, we believe the implications of our method span a wide range of domains. 
    more » « less
  2. null (Ed.)
    While 360° images are becoming ubiquitous due to popularity of panoramic content, they cannot directly work with most of the existing depth estimation techniques developed for perspective images. In this paper, we present a deep-learning-based framework of estimating depth from 360° images. We present an adaptive depth refinement procedure that refines depth estimates using normal estimates and pixel-wise uncertainty scores. We introduce double quaternion approximation to combine the loss of the joint estimation of depth and surface normal. Furthermore, we use the double quaternion formulation to also measure stereo consistency between the horizontally displaced depth maps, leading to a new loss function for training a depth estimation CNN. Results show that the new double-quaternion-based loss and the adaptive depth refinement procedure lead to better network performance. Our proposed method can be used with monocular as well as stereo images. When evaluated on several datasets, our method surpasses state-of-the-art methods on most metrics. 
    more » « less
  3. null (Ed.)
    Objective. Background noise experienced during extracellular neural recording limits the number of spikes that can be reliably detected, which ultimately limits the performance of next-generation neuroscientific work. In this study, we aim to utilize stochastic resonance (SR), a technique that can help identify weak signals in noisy environments, to enhance spike detectability. Approach. Previously, an SR-based pre-emphasis algorithm was proposed, where a particle inside a 1D potential well is exerted by a force defined by the extracellular recording, and the output is obtained as the displacement of the particle. In this study, we investigate how the well shape and damping status impact the output Signal-to-Noise Ratio (SNR). We compare the overdamped and underdamped solutions of shallow- and steep-wall monostable wells and bistable wells in terms of SNR improvement using two synthetic datasets. Then, we assess the spike detection performance when thresholding is applied on the output of the well shape-damping status configuration giving the best SNR enhancement. Main results. The SNR depends on the well-shape and damping-status type as well as the input noise level. The underdamped solution of the shallow-wall monostable well can yield to more than four orders of magnitude greater SNR improvement compared to other configurations for low noise intensities. Using this configuration also results in better spike detection sensitivity and positive predictivity than the state-of-the-art spike detection algorithms for a public synthetic dataset. For larger noise intensities, the overdamped solution of the steep-wall monostable well provides better spike enhancement than the others. Significance. The dependence of SNR improvement on the input signal noise level can be used to design a detector with multiple outputs, each more sensitive to a certain distance from the electrode. Such a detector can potentially enhance the performance of a successive spike sorting stage. 
    more » « less
  4. There are two established methods for measuring rotational Doppler shift: (1) heterodyne and (2) fringe. We identify a key distinction, that only the heterodyne method is sensitive to the rotating object’s phase, which results in significant differences in the signal-to-noise ratio (SNR) when measuring multiple rotating particles. When used to measure randomly distributed rotating particles, the fringe method produces its strongest SNR when a single particle is present and its SNR tends to zero as the number of particles increases, whereas the heterodyne method’s SNR increases proportionally to the number of particles in the beam. 
    more » « less
  5. Convolution and matched filtering are often used to detect a known signal in the presence of noise. The probability of detection and probability of missed detection are well known and widely used statistics. Oftentimes we are not only interested in the probability of detecting a signal but also accurately estimating when the signal occurred and the error statistics associated with that time measurement. Accurately representing the timing error is important for geolocation schemes, such as Time of Arrival (TOA) and Time Difference of Arrival (TDOA), as well as other applications. The Cramér Rao Lower Bound (CRLB) and other, tighter, bounds have been calculated for the error variance on Time of Arrival estimators. However, achieving these bounds requires an amount of interpolation be performed on the signal of interest that may be greater than computational constraints allow. Furthermore, at low Signal to Noise Ratios (SNRs), the probability distribution for the error is non-Gaussian and depends on the shape of the signal of interest. In this paper we introduce a method of characterizing the localization accuracy of the matched filtering operation when used to detect a discrete signal in Additive White Gaussian Noise (AWGN) without additional interpolation. The actual localization accuracy depends on the shape of the signal that is being detected. We develop a statistical method for analyzing the localization error probability mass function for arbitrary signal shapes at any SNR. Finally, we use our proposed analysis method to calculate the error probability mass functions for a few signals commonly used in detection scenarios. These illustrative results serve as examples of the kinds of statistical results that can be generated using our proposed method. The illustrative results demonstrate our method’s unique ability to calculate the non-Gaussian, and signal shape dependent, error distribution at low Signal to Noise Ratios. The error variance calculated using the proposed method is shown to closely track simulation results, deviating from the Cramér Rao Lower Bound at low Signal to Noise Ratios. 
    more » « less