Attention:The NSF Public Access Repository (PAR) system and access will be unavailable from 5:00 PM ET until 8:00 PM ET on Friday, September 11 due to maintenance. We apologize for the inconvenience.


Title: Super-Resolution Ptychography with Small Segmented Detectors
Abstract To overcome the spatial resolution limit set by aperture-limited diffraction in traditional scanning transmission electron microscopy, microscopists have developed ptychography enabled by iterative phase retrieval algorithms and high-dynamic-range pixel array detectors. Current detector designs are limited by the data rate off chip, so a high-pixel-count detector has a proportionally lower frame rate than the few-segment detectors used for differential phase contrast (DPC) imaging. This slower acquisition speed leads to heightened vulnerability to scan noise, drift, and potential sample damage. This creates opportunities for repurposing fast segmented detectors for ptychography by trading a reduction in reciprocal space pixels for an increase in real space pixels. Here, we explore a strategy of oversampling in real space and instead apply detector pixel upsampling during the reconstruction process. We demonstrate the viability of achieving super-resolution ptychography on thin objects using only 2 × 2 detector pixels, surpassing the resolution of integrated DPC (iDPC) imaging. With optimization using simulated datasets and experiments on MoTe2/WSe2 bilayer moiré superlattices, we achieved super-resolution ptychography reconstructions under rapid acquisition conditions (37.5 pA, 1 μs dwell time), yielding over 50% improvements in contrast and information limit compared to annular dark field and iDPC imaging on the same detectors.  more » « less
Award ID(s):
2039380
PAR ID:
10597624
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Oxford University Press
Date Published:
Journal Name:
Microscopy and Microanalysis
Volume:
31
Issue:
1
ISSN:
1431-9276
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Tilt-corrected imaging methods in four-dimensional scanning transmission electron microscopy (4D-STEM) have recently emerged as a new class of direct ptychography methods that are especially useful at low dose. The operation of tilt correction unfolds the contrast transfer functions (CTFs) of the virtual bright-field images and retains coherence by correcting aberration-induced spatial shifts. By performing summation or subtraction of the tilt-corrected images, the real or imaginary parts of the complex phase-contrast transfer functions are recovered, producing a tilt-corrected bright field image (tcBF) or a differential phase contrast image (tcDPC). However, the CTF can be strongly damped by the introduction of higher-order aberrations than defocus. In this paper, we show how aberration-corrected bright-field imaging (acBF), which combines tcBF and tcDPC, enables continuously-nonzero contrast transfer within the information limit, even in the presence of higher-order aberrations. In fact, higher-order aberrations can be beneficial, removing oscillations from the acBF CTF. We demonstrate acBF on both simulated and experimental data, showing it produces superior performance to tcBF or DPC methods alone, and discuss its limitations, including estimates for the number of pixels needed on the detector. 
    more » « less
  2. The applications of conventional ptychography are limited by its relatively low resolution and throughput in the visible light regime. The new development of coded ptychography (CP) has addressed these issues and achieved the highest numerical aperture for large-area optical imaging in a lensless configuration. A high-quality reconstruction of CP relies on precise tracking of the coded sensor’s positional shifts. The coded layer on the sensor, however, prevents the use of cross correlation analysis for motion tracking. Here we derive and analyze the motion tracking model of CP. A novel, to the best of our knowledge, remote referencing scheme and its subsequent refinement pipeline are developed for blind image acquisition. By using this approach, we can suppress the correlation peak caused by the coded surface and recover the positional shifts with deep sub-pixel accuracy. In contrast with common positional refinement methods, the reported approach can be disentangled from the iterative phase retrieval process and is computationally efficient. It allows blind image acquisition without motion feedback from the scanning process. It also provides a robust and reliable solution for implementing ptychography with high imaging throughput. We validate this approach by performing high-resolution whole slide imaging of bio-specimens. 
    more » « less
  3. ABSTRACT Linear phase‐contrast scanning transmission electron microscopy (STEM) techniques compatible with high‐throughput 4D‐STEM acquisition are widely used to enhance phase contrast in weakly scattering and beam‐sensitive materials. In these modalities, contrast transfer is often suppressed at low spatial frequencies, resulting in a characteristic contrast gap that limits contrast. Approaches that retain low‐frequency phase contrast exist but typically require substantially increased experimental complexity, restricting routine use. Dark‐field STEM imaging captures this missing low‐frequency information through electrons scattered outside the bright‐field disk, but discards a large fraction of the scattered signal and is therefore dose‐inefficient. Fused Full‐field STEM (FF‐STEM) is introduced as a 4D‐STEM imaging modality that overcomes these limitations by combining ptychographic phase reconstruction with tilt‐corrected dark‐field imaging within a single acquisition. Bright‐field data are used to estimate probe aberrations and reconstruct a high‐resolution phase image, while dark‐field data provide complementary low‐frequency contrast. The two channels are fused in Fourier space using Wiener‐band weighting based on the spectral signal‐to‐noise ratio, yielding transfer‐gap‐free images with high contrast. FF‐STEM preserves the upsampling and depth‐sectioning capabilities of ptychography, adds robust low‐frequency contrast characteristic of dark‐field imaging, and enables dose‐efficient, near–real‐time reconstruction. 
    more » « less
  4. With the development of high repetition rate laser sources and advanced multi-particle correlation analyses, such as covariance mapping, particle detection techniques, including velocity map imaging (VMI), are poised to offer unprecedented views into molecular phenomena. Taking full advantage of the high count rates in these experiments requires the development of detectors with sufficient spatial and temporal resolution that can process data in real time. The Timepix3 camera (TPX3CAM) is an event-based pixel detector capable of spatio-temporally localizing many simultaneous particle hits in an efficient manner. While the sparse nature of the data stream allows for compact representation of particle hits, it also presents algorithmic and computational challenges for clustering individual pixels into hits. Here, we present the theory and application of a rapid data processing and centroiding algorithm for ion and electron hits collected in a VMI instrument. The array-based computations that comprise the algorithm take full advantage of the data sparsity of the Timepix3 data stream and localize particle hits on the microchannel plate to better than single pixel on the pixel detector. Centroiding can be parallelized on a commercially available graphics processing unit for additional speed. Using these innovations, data processing occurs about 25 times faster than data acquisition, for a 1 kHz repetition rate instrument and tens of particles per shot. In addition to its speed, the TPX3CAM detector excels at discriminating multiple simultaneous hits, enabling high-fidelity coincidence and covariance studies in the near future. 
    more » « less
  5. We demonstrate, for the first time to the best of our knowledge, the implementation of Spatial Frequency Modulated Imaging (SPIFI) microscopy in the mid-infrared region using a Quantum Cascade Laser (QCL) source. Hyperspectral imaging in the mid-infrared (3–20 μm) enables chemically specific mapping and structural imaging based on molecular contrast, which is otherwise inaccessible in the visible or near-infrared region. But mid-infrared microscopes are often limited by slow raster scanning and costly detector arrays. Our approach uses spatial frequency-encoded structured illumination and a low-cost single-pixel mid-infrared detector to acquire hyperspectral images in transflection mode. The system—structured illumination single-pixel imaging system in the mid-infrared—provides a practical trade-off between speed and complexity, offering acquisition speeds comparable to selected QCL-based point-scanning implementations, while maintaining a simple, cost-effective optical design utilizing off-the-shelf components. We present a preliminary resolution measurement as well as absorption images of coronal sections of a mouse brain at both 6 and 7 μm, demonstrating chemically selective contrast and robust image formation suitable for future high-resolution and compressive implementations. 
    more » « less