skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Edge-Resolved Transient Imaging: Performance Analyses, Optimizations, and Simulations
Edge-resolved transient imaging (ERTI) is a method for non-line-of-sight imaging that combines the use of direct time of flight for measuring distances with the azimuthal angular resolution afforded by a vertical edge occluder. Recently conceived and demonstrated for the first time, no performance analyses or optimizations of ERTI have appeared in published papers. This paper explains how the difficulty of detection of hidden scene objects with ERTI depends on a variety of parameters, including illumination power, acquisition time, ambient light, visible-side reflectivity, hidden-side reflectivity, target range, and target azimuthal angular position. Based on this analysis, optimization of the acquisition process is introduced whereby the illumination dwell times are varied to counteract decreasing signal-to-noise ratio at deeper angles into the hidden volume. Inaccuracy caused by a coaxial approximation is also analyzed and simulated.  more » « less
Award ID(s):
1955219
PAR ID:
10339855
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
IEEE International Conference on Image Processing (ICIP)
Page Range / eLocation ID:
2858 to 2862
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We present a real-time spectral-scanning frequency-modulated continuous wave (FMCW) 3D imaging and velocimetry system that can produce 3D depth maps at 33 Hz, with 48° × 68° field of view (FOV) and 32.8-cm depth range. Each depth map consists of 507 × 500 pixels, with 0.095° × 0.14° angular resolution and 2.82-mm depth resolution. The system employs a grating for beam steering and a telescope for angular FOV magnification. Quantitative depth, reflectivity, and axial velocity measurements of a static 3D printed depth variation target and a moving robotic arm are demonstrated. 
    more » « less
  2. Pesce, Luca (Ed.)
    Expansion microscopy (ExM) enables sub-diffraction imaging by physically expanding labeled tissue samples. This increases the tissue volume relative to the instrument point spread function (PSF), thereby improving the effective resolution by reported factors of 4 - 20X. However, this volume increase dilutes the fluorescence signal, reducing both signal-to-noise ratio (SNR) and acquisition speed. This paper proposes and validates a method for mitigating these challenges. We overcame the limitations of ExM by developing a fast photo-stable protocol to enable scalable widefield three-dimensional imaging with ExM. We combined widefield imaging with quantum dots (QDots). Widefield imaging provides a significantly faster acquisition of a single field-of-view (FOV). However, the uncontrolled incoherent illumination induces photobleaching. We mitigated this challenge using QDots, which exhibit a long fluorescence lifetime and improved photostability. First, we developed a protocol for QDot labeling. Next, we utilized widefield imaging to obtain 3D image stacks and applied deconvolution, which is feasible due to reduced scattering in ExM samples. We show that increased transparency, which is a side-effect of ExM, enables widefield deconvolution, dramatically reducing the acquisition time for three-dimensional images compared to laser scanning microscopy. The proposed QDot labeling protocol is compatible with ExM and provides enhanced photostability compared to traditional fluorescent dyes. Widefield imaging significantly improves SNR and acquisition speed compared to conventional confocal microscopy. Combining widefield imaging with QDot labeling and deconvolution has the potential to be applied to ExM for faster imaging of large three-dimensional samples with improved SNR. 
    more » « less
  3. Banterle, Francesco; Caggianese, Giuseppe; Capece, Nicola; Erra, Ugo; Lupinetti, Katia; Manfredi, Gilda (Ed.)
    We introduce VarIS, our Variable Illumination Sphere – a multi-purpose system for acquiring and processing real-world geometric and appearance data for computer-graphics research and production. Its key applications among many are (1) human-face capture, (2) model scanning, and (3) spatially varying material acquisition. Facial capture requires high-resolution cameras at multiple viewpoints, photometric capabilities, and a swift process due to human movement. Acquiring a digital version of a physical model is somewhat similar but with different constraints for image processing and more allowable time. Each requires detailed estimations of geometry and physically based shading properties. Measuring spatially varying light-scattering properties requires spanning four dimensions of illumination and viewpoint with angular, spatial, and spectral accuracy, and this process can also be assisted using multiple, simultaneous viewpoints or rapid switching of lights with no movement necessary. VarIS is a system of hardware and software for spherical illumination and imaging that has been custom designed and developed by our team. It has been inspired by Light Stages and goniophotometers, but costs less through use of primarily off-the-shelf components, and additionally extends capabilities beyond these devices. In this paper we describe the unique system and contributions, including practical details that could assist other researchers and practitioners. 
    more » « less
  4. In a built environment, wanting to see without direct line of sight is often due to being outside a doorway. The two vertical edges of the doorway provide occlusions that can be exploited for non-line-of-sight imaging by forming corner cameras. While each corner camera can separately yield a robust 1D reconstruction, joint processing suggests novelties in both forward modeling and inversion. The resulting doorway camera provides accurate and robust 2D reconstructions of the hidden scene. This work provides a novel inversion algorithm to jointly estimate two views of change in the hidden scene, using the temporal difference between photographs acquired on the visible side of the doorway. Successful reconstruction is demonstrated in a variety of real and rendered scenarios, including different hidden scenes and lighting conditions. A Cramer-Rao bound analysis is used to demonstrate the 2D resolving power of the doorway camera over other passive acquisition strategies and to motivate the novel biangular reconstruction grid. 
    more » « less
  5. Abstract By fitting observed data with predicted seismograms, least‐squares migration (LSM) computes a generalized inverse for a subsurface reflectivity model, which can improve image resolution and reduce artifacts caused by incomplete acquisition. However, the large computational cost of LSM required for simulations and migrations limits its wide applications for large‐scale imaging problems. Using point‐spread function (PSF) deconvolution, we present an efficient and stable high‐resolution imaging method. The PSFs are first computed on a coarse grid using local ray‐based Gaussian beam Born modeling and migration. Then, we interpolate the PSFs onto a fine‐image grid and apply a high‐dimensional Gaussian function to attenuate artifacts far away from the PSF centers. With 2D/3D partition of unity, we decompose the traditional adjoint migration results into local images with the same window size as the PSFs. Then, these local images are deconvolved by the PSFs in the wavenumber domain to reduce the effects of the band‐limited source function and compensate for irregular subsurface illumination. The final assembled image is obtained by applying the inverse of the partitions for the deconvolved local images. Numerical examples for both synthetic and field data demonstrate that the proposed PSF deconvolution can significantly improve image resolution and amplitudes for deep structures, while not being sensitive to velocity errors as the data‐domain LSM. 
    more » « less