skip to main content


Title: Synthetic aperture ptychography: coded sensor translation for joint spatial-Fourier bandwidth expansion

Conventional ptychography translates an object through a localized probe beam to widen the field of view in real space. Fourier ptychography translates the object spectrum through a pupil aperture to expand the Fourier bandwidth in reciprocal space. Here we report an imaging modality, termed synthetic aperture ptychography (SAP), to get the best of both techniques. In SAP, we illuminate a stationary object using an extended plane wave and translate a coded image sensor at the far field for data acquisition. The coded layer attached on the sensor modulates the object exit waves and serves as an effective ptychographic probe for phase retrieval. The sensor translation process in SAP synthesizes a large complex-valued wavefront at the intermediate aperture plane. By propagating this wavefront back to the object plane, we can widen the field of view in real space and expand the Fourier bandwidth in reciprocal space simultaneously. We validate the SAP approach with transmission targets and reflection silicon microchips. A 20-mm aperture was synthesized using a 5-mm sensor, achieving a fourfold gain in resolution and 16-fold gain in field of view for object recovery. In addition, the thin sample requirement in ptychography is no longer required in SAP. One can digitally propagate the recovered exit wave to any axial position for post-acquisition refocusing. The SAP scheme offers a solution for far-field sub-diffraction imaging without using lenses. It can be adopted in coherent diffraction imaging setups with radiation sources from visible light, extreme ultraviolet, and X-ray, to electron.

 
more » « less
NSF-PAR ID:
10369502
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Photonics Research
Volume:
10
Issue:
7
ISSN:
2327-9125
Page Range / eLocation ID:
Article No. 1624
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. We report a novel lensless on-chip microscopy platform based on near-field blind ptychographic modulation. In this platform, we place a thin diffuser in between the object and the image sensor for light wave modulation. By blindly scanning the unknown diffuser to different x – y positions, we acquire a sequence of modulated intensity images for quantitative object recovery. Different from previous ptychographic implementations, we employ a unit magnification configuration with a Fresnel number of ∼50 000, which is orders of magnitude higher than those of previous ptychographic setups. The unit magnification configuration allows us to have the entire sensor area, 6.4 mm by 4.6 mm, as the imaging field of view. The ultra-high Fresnel number enables us to directly recover the positional shift of the diffuser in the phase retrieval process, addressing the positioning accuracy issue plaguing regular ptychographic experiments. In our implementation, we use a low-cost, DIY scanning stage to perform blind diffuser modulation. Precise mechanical scanning that is critical in conventional ptychography experiments is no longer needed in our setup. We further employ an up-sampling phase retrieval scheme to bypass the resolution limit set by the imager pixel size and demonstrate a half-pitch resolution of 0.78 μm. We validate the imaging performance via in vitro cell cultures, transparent and stained tissue sections, and a thick biological sample. We show that the recovered quantitative phase map can be used to perform effective cell segmentation of a dense yeast culture. We also demonstrate 3D digital refocusing of the thick biological sample based on the recovered wavefront. The reported platform provides a cost-effective and turnkey solution for large field-of-view, high-resolution, and quantitative on-chip microscopy. It is adaptable for a wide range of point-of-care-, global-health-, and telemedicine-related applications. 
    more » « less
  2. Acousto-optic imaging (AOI) enables optical-contrast imaging deep inside scattering samples via localized ultrasound-modulation of scattered light. While AOI allows optical investigations at depths, its imaging resolution is inherently limited by the ultrasound wavelength, prohibiting microscopic investigations. Here, we propose a computational imaging approach that allows optical diffraction-limited imaging using a conventional AOI system. We achieve this by extracting diffraction-limited imaging information from speckle correlations in the conventionally detected ultrasound-modulated scattered-light fields. Specifically, we identify that since “memory-effect” speckle correlations allow estimation of the Fourier magnitude of the field inside the ultrasound focus, scanning the ultrasound focus enables robust diffraction-limited reconstruction of extended objects using ptychography (i.e., we exploit the ultrasound focus as the scanned spatial-gate probe required for ptychographic phase retrieval). Moreover, we exploit the short speckle decorrelation-time in dynamic media, which is usually considered a hurdle for wavefront-shaping- based approaches, for improved ptychographic reconstruction. We experimentally demonstrate noninvasive imaging of targets that extend well beyond the memory-effect range, with a 40-times resolution improvement over conventional AOI.

     
    more » « less
  3. The applications of conventional ptychography are limited by its relatively low resolution and throughput in the visible light regime. The new development of coded ptychography (CP) has addressed these issues and achieved the highest numerical aperture for large-area optical imaging in a lensless configuration. A high-quality reconstruction of CP relies on precise tracking of the coded sensor’s positional shifts. The coded layer on the sensor, however, prevents the use of cross correlation analysis for motion tracking. Here we derive and analyze the motion tracking model of CP. A novel, to the best of our knowledge, remote referencing scheme and its subsequent refinement pipeline are developed for blind image acquisition. By using this approach, we can suppress the correlation peak caused by the coded surface and recover the positional shifts with deep sub-pixel accuracy. In contrast with common positional refinement methods, the reported approach can be disentangled from the iterative phase retrieval process and is computationally efficient. It allows blind image acquisition without motion feedback from the scanning process. It also provides a robust and reliable solution for implementing ptychography with high imaging throughput. We validate this approach by performing high-resolution whole slide imaging of bio-specimens.

     
    more » « less
  4. Evans, Christopher J. ; Bryant, Julia J. ; Motohara, Kentaro (Ed.)
    We present the current design of WFOS, a wide-field UV/optical (0.31-1.0 µm) imaging spectrograph planned for first-light on the TMT International Observatory 30 m telescope. WFOS is optimized for high sensitivity across the entire optical waveband for low-to-moderate resolution (R ∼ 1500-5000) long-slit and multi-slit spectroscopy of very faint targets over a contiguous field of view of 8′ .3×3 ′ .0 at the f/15 Nasmyth focus of TMT. A key design goal for WFOS is stability and repeatability in all observing modes, made possible by its gravity-invariant opto-mechanical structure, with a vertical rotation axis and all reconfigurable components moving only in planes defined by tiered optical benches parallel to the Nasmyth platform. WFOS’s optics include a linear ADC correcting a 9′ diameter field, including both the science FoV and 4 patrolling acquisition, guiding, and wavefront sensing camera systems; a novel 2-mirror reflective collimator allowing the science FoV to be centered on the telescope optical axis; a dichroic beamsplitter dividing the collimated beam into 2 wavelength-optimized spectrometer channels (blue: 0.31-0.56 µm; red: 0.54-1.04 µm); selectable transmissive dispersers (VPH and/or VBG) with remotely configurable grating tilt (angle of incidence) and camera articulation that enable optimization of diffraction efficiency and wavelength coverage in each channel; all-refractive, wavelength-optimized f/2 spectrograph cameras, and UV/blue and red-optimized detector systems. The predicted instrumental through put of WFOS for spectroscopy averages > 56% over the full 0.31-1 µm range, from the ADC to the detector. When combined with the 30 m TMT aperture, WFOS will realize a factor of ∼20 gain in sensitivity compared to the current state of the art on 8-10 m-class telescopes. 
    more » « less
  5. We experimentally demonstrate a camera whose primary optic is a cannula/needle (diameter=0.22mmandlength=12.5mm) that acts as a light pipe transporting light intensity from an object plane (35 cm away) to its opposite end. Deep neural networks (DNNs) are used to reconstruct color and grayscale images with a field of view of 18° and angular resolution of∼<#comment/>0.4∘<#comment/>. We showed a large effective demagnification of127×<#comment/>. Most interestingly, we showed that such a camera could achieve close to diffraction-limited performance with an effective numerical aperture of 0.045, depth of focus∼<#comment/>16µ<#comment/>m, and resolution close to the sensor pixel size (3.2 µm). When trained on images with depth information, the DNN can create depth maps. Finally, we show DNN-based classification of the EMNIST dataset before and after image reconstructions. The former could be useful for imaging with enhanced privacy.

     
    more » « less