skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Ptycho-endoscopy on a lensless ultrathin fiber bundle tip
Abstract Synthetic aperture radar (SAR) utilizes an aircraft-carried antenna to emit electromagnetic pulses and detect the returning echoes. As the aircraft travels across a designated area, it synthesizes a large virtual aperture to improve image resolution. Inspired by SAR, we introduce synthetic aperture ptycho-endoscopy (SAPE) for micro-endoscopic imaging beyond the diffraction limit. SAPE operates by hand-holding a lensless fiber bundle tip to record coherent diffraction patterns from specimens. The fiber cores at the distal tip modulate the diffracted wavefield within a confined area, emulating the role of the ‘airborne antenna’ in SAR. The handheld operation introduces positional shifts to the tip, analogous to the aircraft’s movement. These shifts facilitate the acquisition of a ptychogram and synthesize a large virtual aperture extending beyond the bundle’s physical limit. We mitigate the influences of hand motion and fiber bending through a low-rank spatiotemporal decomposition of the bundle’s modulation profile. Our tests demonstrate the ability to resolve a 548-nm linewidth on a resolution target. The achieved space-bandwidth product is ~1.1 million effective pixels, representing a 36-fold increase compared to that of the original fiber bundle. Furthermore, SAPE’s refocusing capability enables imaging over an extended depth of field exceeding 2 cm. The aperture synthesizing process in SAPE surpasses the diffraction limit set by the probe’s maximum collection angle, opening new opportunities for both fiber-based and distal-chip endoscopy in applications such as medical diagnostics and industrial inspection.  more » « less
Award ID(s):
2012140
PAR ID:
10524328
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Light: Science & Applications
Volume:
13
Issue:
1
ISSN:
2047-7538
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Quantitative phase imaging (QPI) recovers the exact wavefront of light from intensity measurements. Topographical and optical density maps of translucent microscopic bodies can be extracted from these quantified phase shifts. We demonstrate quantitative phase imaging at the tip of a coherent fiber bundle using chromatic aberrations inherent in a silicon nitride hyperboloid metalens. Our method leverages spectral multiplexing to recover phase from multiple defocus planes in a single capture using a color camera. Our 0.5 mm aperture metalens shows robust quantitative phase imaging capability with a$${28}^{\circ}$$ 28 field of view and 0.$${2}{\pi}$$ 2 π phase resolution ( ~ 0.$${1}{\lambda}$$ 1 λ in air) for experiments with an endoscopic fiber bundle. Since the spectral functionality is encoded directly in the imaging lens, the metalens acts both as a focusing element and a spectral filter. The use of a simple computational backend will enable real-time operation. Key limitations in the adoption of phase imaging methods for endoscopy such as multiple acquisition, interferometric alignment or mechanical scanning are completely mitigated in the reported metalens based QPI. 
    more » « less
  2. This paper proposes SquiggleMilli, a system that approximates traditional Synthetic Aperture Radar (SAR) imaging on mobile millimeter-wave (mmWave) devices. The system is capable of imaging through obstructions, such as clothing, and under low visibility conditions. Unlike traditional SAR that relies on mechanical controllers or rigid bodies, SquiggleMilli is based on the hand-held, fluidic motion of the mmWave device. It enables mmWave imaging in hand-held settings by re-thinking existing motion compensation, compressed sensing, and voxel segmentation. Since mmWave imaging suffers from poor resolution due to specularity and weak reflectivity, the reconstructed shapes could be imperceptible by machines and humans. To this end, SquiggleMilli designs a machine learning model to recover the high spatial frequencies in the object to reconstruct an accurate 2D shape and predict its 3D features and category. We have customized SquiggleMilli for security applications, but the model is adaptable to other applications with limited training samples. We implement SquiggleMilli on off-the-shelf components and demonstrate its performance improvement over the traditional SAR qualitatively and quantitatively. 
    more » « less
  3. The popularity of smartphones has grown at an unprecedented rate, which makes smartphone based imaging especially appealing. In this paper, we develop a novel acoustic imaging system using only an off-the-shelf smartphone. It is an attractive alternative to camera based imaging under darkness and obstruction. Our system is based on Synthetic Aperture Radar (SAR). To image an object, a user moves a phone along a predefined trajectory to mimic a virtual sensor array. SAR based imaging poses several new challenges in our context, including strong self and background interference, deviation from the desired trajectory due to hand jitters, and severe speaker/microphone distortion. We address these challenges by developing a 2-stage interference cancellation scheme, a new algorithm to compensate trajectory errors, and an effective method to minimize the impact of signal distortion. We implement a proof- of-concept system on Samsung S7. Our results demonstrate the feasibility and effectiveness of acoustic imaging on a mobile. 
    more » « less
  4. null (Ed.)
    The ubiquity of millimeter-wave (mmWave) technology in 5G-and-beyond devices enable opportunities to bring through-obstruction imaging in hand-held, ad-hoc settings. This imaging technique will require manually scanning the scene to emulate a Synthetic Aperture Radar (SAR) [4] and measure back-scattered signals. Appropriate signal focusing can reveal hidden items and can be used to detect and classify shapes automatically. Such hidden object detection and classification could enable multiple applications, such as in-situ security check without pat-down search, baggage discrimination without opening the baggage, packaged inventory item counting without intrusions, etc. 
    more » « less
  5. The ubiquity of millimeter-wave (mmWave) technology could bring through-obstruction imaging to portable, mobile systems. Existing through-obstruction imaging systems rely on Synthetic Aperture Radar (SAR) technique, but emulating the SAR principle on hand-held devices has been challenging. We propose ViSAR, a portable platform that integrates an optical camera and mmWave radar to emulate the SAR principle and enable through-obstruction 3D imaging. ViSAR synchronizes the devices at the software-level and uses the Time Domain Backprojection algorithm to generate vision-augmented mmWave images. We have experimentally evaluated ViSAR by imaging several indoor objects. 
    more » « less