skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Seeing around corners with edge-resolved transient imaging
Abstract Non-line-of-sight (NLOS) imaging is a rapidly growing field seeking to form images of objects outside the field of view, with potential applications in autonomous navigation, reconnaissance, and even medical imaging. The critical challenge of NLOS imaging is that diffuse reflections scatter light in all directions, resulting in weak signals and a loss of directional information. To address this problem, we propose a method for seeing around corners that derives angular resolution from vertical edges and longitudinal resolution from the temporal response to a pulsed light source. We introduce an acquisition strategy, scene response model, and reconstruction algorithm that enable the formation of 2.5-dimensional representations—a plan view plus heights—and a 180field of view for large-scale scenes. Our experiments demonstrate accurate reconstructions of hidden rooms up to 3 meters in each dimension despite a small scan aperture (1.5-centimeter radius) and only 45 measurement locations.  more » « less
Award ID(s):
1815896 1955219
PAR ID:
10360572
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Volume:
11
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Non-line-of-sight (NLOS) imaging is a rapidly advancing technology that provides asymmetric vision: seeing without being seen. Though limited in accuracy, resolution, and depth recovery compared to active methods, the capabilities of passive methods are especially surprising because they typically use only a single, inexpensive digital camera. One of the largest challenges in passive NLOS imaging is ambient background light, which limits the dynamic range of the measurement while carrying no useful information about the hidden part of the scene. In this work we propose a new reconstruction approach that uses an optimized linear transformation to balance the rejection of uninformative light with the retention of informative light, resulting in fast (video-rate) reconstructions of hidden scenes from photographs of a blank wall under high ambient light conditions. 
    more » « less
  2. Abstract One of the most significant developments in life sciences—the discovery of bacteria and protists—was accomplished by Antoni van Leeuwenhoek in the 17thcentury using a single ball lens microscope. It is shown that the full potential of single lens designs can be realized in a contact mode of imaging by ball lenses with a refractive index of n≈ 2, suitable for developing compact cellphone‐based microscopes. The quality of imaging is comparable to basic compound microscopes, but with a narrower field‐of‐view, and is demonstrated for various biomedical samples. The maximal magnification (M > 50) with the highest resolution (≈0.66 µm atλ= 589 nm) is achieved for imaging of nanoplasmonic structures by ball lenses made from LASFN35 glass, the index of which is tuned nearn =2 using chromatic dispersion. Due to limitations of geometrical optics, the imaging theory is developed based on an exact numerical solution of the Maxwell equations, including spherical aberration and the nearfield coupling of a point source. The modeling is performed using multiscale analysis: from the field propagation inside ball lenses with diameters 30 < D/λ < 4000 to the formation of the diffracted field at distances of ≈105λ. It is shown that such imaging enables the transition from pixel‐ to diffraction‐limited resolution in cellphone microscopy. 
    more » « less
  3. The study of non-line-of-sight (NLOS) imaging is growing due to its many potential applications, including rescue operations and pedestrian detection by self-driving cars. However, implementing NLOS imaging on a moving camera remains an open area of research. Existing NLOS imaging methods rely on time-resolved detectors and laser configurations that require precise optical alignment, making it difficult to deploy them in dynamic environments. This work proposes a data-driven approach to NLOS imaging, PathFinder, that can be used with a standard RGB camera mounted on a small, power-constrained mobile robot, such as an aerial drone. Our experimental pipeline is designed to accurately estimate the 2D trajectory of a person who moves in a Manhattan-world environment while remaining hidden from the camera’s fieldof- view. We introduce a novel approach to process a sequence of dynamic successive frames in a line-of-sight (LOS) video using an attention-based neural network that performs inference in real-time. The method also includes a preprocessing selection metric that analyzes images from a moving camera which contain multiple vertical planar surfaces, such as walls and building facades, and extracts planes that return maximum NLOS information. We validate the approach on in-the-wild scenes using a drone for video capture, thus demonstrating low-cost NLOS imaging in dynamic capture environments. 
    more » « less
  4. Abstract We analyze high-resolution observations of an X-1.0 white-light flare, triggered by a filament eruption, on 2022 October 2. The full process of filament formation and subsequent eruption was captured in the Hαpassband by the Visible Imaging Spectrograph (VIS) on board the Goode Solar Telescope (GST) within its center field of view. White-light emissions appear in flare ribbons following the filament eruption and Hαribbon brightening. GST Broadband Filter Imager data show that the continuum intensity, as compared to the nearby quiet-Sun area, has increased by up to 20% in the photospheric TiO band around 7057 Å. The Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory reported 10% contrast enhancement in the continuum near Fei6173 Å line. The separation motion of two white-light kernels is recorded by the high-cadence GST/TiO images and is well accompanied by the motion of the VIS Hαflare ribbon leading edge. One kernel, located in a 150 Gauss field within a granulation area, exhibited an average apparent motion speed of 55 km s−1, which is the highest average speed ever reported. The other kernel drifted at 9 km s−1in an 800 Gauss magnetic field area. Hard X-ray (HXR) emissions reaching up to 300 keV have been observed for this flare. The simultaneous occurrence of high-cadence HXR, microwave, and white-light emissions strongly suggests that the energetic particles from the flare directly contribute to the heating. The inverted HXR energy flux density corresponding to 10% TiO brightening is 2.07 ± 0.23 × 1011erg cm−2s−1during the flare peak. 
    more » « less
  5. Abstract Metalenses, with their ultrathin thicknesses and their ease for achieving ultra small diameters, offer a promising alternative to refractive lenses in miniaturized imaging systems, such as endoscopes, potentially enabling applications in tightly confined spaces. However, traditional metalenses suffer from strong chromatic aberrations, limiting their utility in multi-color imaging. To address this limitation, here we present an inverse-designed polychromatic metalens with a diameter of 680 μm, focal length of 400 μm, and low dispersion across 3 distinct wavelengths at 643 nm, 532 nm, and 444 nm. The metalens collimates and steers light emitted from a scanning fiber tip, generating scanning beams across a 70° field-of-view to provide illumination for a scan-based imaging. The metalens provides a close-to-diffraction-limited 0.5° angular resolution, only restricted by the effective aperture of the system. The average relative efficiency among three design wavelengths is around 32% for on-axis angle and 13% averaged across the entire field-of-view. This work holds promise for the application of metalenses in endoscopes and other miniaturized imaging systems. 
    more » « less