skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Shape From Sky: Polarimetric Normal Recovery Under the Sky
The sky exhibits a unique spatial polarization pattern by scattering the unpolarized sun light. Just like insects use this unique angular pattern to navigate, we use it to map pixels to directions on the sky. That is, we show that the unique polarization pattern encoded in the polarimetric appearance of an object captured under the sky can be decoded to reveal the surface normal at each pixel. We derive a polarimetric reflection model of a diffuse plus mirror surface lit by the sun and a clear sky. This model is used to recover the per-pixel surface normal of an object from a single polarimetric image or from multiple polarimetric images captured under the sky at different times of the day. We experimentally evaluate the accuracy of our shape-from-sky method on a number of real objects of different surface compositions. The results clearly show that this passive approach to fine-geometry recovery that fully leverages the unique illumination made by nature is a viable option for 3D sensing. With the advent of quad-Bayer polarization chips, we believe the implications of our method span a wide range of domains.  more » « less
Award ID(s):
1715195
PAR ID:
10292291
Author(s) / Creator(s):
Date Published:
Journal Name:
IEEE Conference on Computer Vision and Pattern Recognition
ISSN:
2163-6648
Page Range / eLocation ID:
.14832-14841
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. All-sky polarization images were measured from sunrise to sunset and during a cloud-free totality on 21 August 2017 in Rexburg, Idaho using two digital three-camera all-sky polarimeters and a time-sequential liquid-crystal-based all-sky polarimeter. Twenty-five polarimetric images were recorded during totality, revealing a highly dynamic evolution of the distribution of skylight polarization, with the degree of linear polarization becoming nearly zenith-symmetric by the end of totality. The surrounding environment was characterized with an infrared cloud imager that confirmed the complete absence of clouds during totality, an AERONET solar radiometer that measured aerosol properties, a portable weather station, and a hand-held spectrometer with satellite images that measured surface reflectance at and near the observation site. These observations confirm that previously observed totality patterns are general and not unique to those specific eclipses. The high temporal image resolution revealed a transition of a neutral point from the zenith in totality to the normal Babinet point just above the Sun after third contact, providing the first indication that the transition between totality and normal daytime polarization patterns occurs over of a time period of approximately 13 s. 
    more » « less
  2. We report the results of polarimetric observations of the total solar eclipse of 21 August 2017 from Rexburg, Idaho (USA).We use three synchronized DSLR cameras with polarization filters oriented at 0, 60, and 120 to provide high-dynamic-range RGB polarization images of the corona and surrounding sky.We measure tangential coronal polarization and vertical sky polarization, both as expected. These observations provide detailed detections of polarization neutral points above and below the eclipsed Sun where the coronal polarization is canceled by the sky polarization.We name these special polarization neutral points afterMinnaert and Van de Hulst. 
    more » « less
  3. The sky polarization pattern during solar eclipse totality shifts from the usual daytime clear-sky pattern, with maximum polarization in an arc located 90° from the Sun, to one with maximum polarization slightly above the horizon in a ring nominally concentric about the zenith. A sequence of 9 visible-wavelength all-sky images are shown throughout totality for the 21 August 2017 solar eclipse from a site near Rexburg, ID USA (43.8294°N, 111.8849°W). A neutral region appeared in the southwest quadrant of the all-sky images, directly opposite the eclipsed Sun, and evolved in size and radial position throughout the 2 min 17 s of totality. 
    more » « less
  4. This paper presents an absolute phase unwrapping method for high-speed three-dimensional (3D) shape measurement. This method uses three phase-shifted patterns and one binary random pattern on a single-camera, single-projector structured light system. We calculate the wrapped phase from phase-shifted images and determine the coarse correspondence through the digital image correlation (DIC) between the captured binary random pattern of the object and the pre-captured binary random pattern of a flat surface. We then developed a computational framework to determine fringe order number pixel by pixel using the coarse correspondence information. Since only one additional pattern is used, the proposed method can be used for high-speed 3D shape measurement. Experimental results successfully demonstrated that the proposed method can achieve high-speed and high-quality measurement of complex scenes. 
    more » « less
  5. The segmentation of sky images into regions of cloud and clear sky allows atmospheric scientists to determine the fraction of cloud cover and the distribution of cloud without resorting to subjective estimates by a human observer. This is a challenging problem because cloud boundaries and cirroform cloud regions are often semi-transparent and indistinct. In this study, we propose a lightweight, unsupervised methodology to identify cloud regions in ground-based hemispherical sky images. Our method offers a fast and adaptive approach without the necessity of fixed thresholds by utilizing K-means clustering on transformed pixel values. We present the results of our method for two data sets and compare them with three different methods in the literature. 
    more » « less