Traditional miniaturized fluorescence microscopes are critical tools for modern biology. Invariably, they struggle to simultaneously image with a high spatial resolution and a large field of view (FOV). Lensless microscopes offer a solution to this limitation. However, real-time visualization of samples is not possible with lensless imaging, as image reconstruction can take minutes to complete. This poses a challenge for usability, as real-time visualization is a crucial feature that assists users in identifying and locating the imaging target. The issue is particularly pronounced in lensless microscopes that operate at close imaging distances. Imaging at close distances requires shift-varying deconvolution to account for the variation of the point spread function (PSF) across the FOV. Here, we present a lensless microscope that achieves real-time image reconstruction by eliminating the use of an iterative reconstruction algorithm. The neural network-based reconstruction method we show here, achieves more than 10000 times increase in reconstruction speed compared to iterative reconstruction. The increased reconstruction speed allows us to visualize the results of our lensless microscope at more than 25 frames per second (fps), while achieving better than 7 µm resolution over a FOV of 10 mm2. This ability to reconstruct and visualize samples in real-time empowers amore »
This paper experimentally examines different configurations of a multi-camera array microscope (MCAM) imaging technology. The MCAM is based upon a densely packed array of “micro-cameras” to jointly image across a large field-of-view (FOV) at high resolution. Each micro-camera within the array images a unique area of a sample of interest, and then all acquired data with 54 micro-cameras are digitally combined into composite frames, whose total pixel counts significantly exceed the pixel counts of standard microscope systems. We present results from three unique MCAM configurations for different use cases. First, we demonstrate a configuration that simultaneously images and estimates the 3D object depth across a 100×135mm2FOV at approximately 20 µm resolution, which results in 0.15 gigapixels (GP) per snapshot. Second, we demonstrate an MCAM configuration that records video across a continuous 83×123mm2FOV with twofold increased resolution (0.48 GP per frame). Finally, we report a third high-resolution configuration (2 µm resolution) that can rapidly produce 9.8 GP composites of large histopathology specimens.
- Authors:
- ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »
- Publication Date:
- NSF-PAR ID:
- 10405611
- Journal Name:
- Optica
- Volume:
- 10
- Issue:
- 4
- Page Range or eLocation-ID:
- Article No. 471
- ISSN:
- 2334-2536
- Publisher:
- Optical Society of America
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Modern high-throughput nanopatterning techniques, such as nanoimprint lithography, make it possible to fabricate arrays of nanostructures (features with dimensions of 10’s to 100’s of nm) over large area substrates (cm2to m2scale) such as Si wafers, glass sheets, and flexible roll-to-roll webs. The ability to make such large-area nanostructure arrays (LNAs) has created an extensive design space, enabling a wide array of applications including optical devices, such as wire-grid polarizers, transparent conductors, color filters, and anti-reflection surfaces, and building blocks for electronic components, such as ultracapacitors, sensors, and memory storage architectures. However, existing metrology methods will have trouble scaling alongside fabrication methods. Scanning electron microscopy (SEM) and atomic force microscopy (AFM), for instance, have micron scale fields of view (FOV) that preclude comprehensive characterization of LNAs, which may be manufactured at m2per minute rates. Scatterometry approaches have larger FOVs (typically 100’s of µm to a few mm), but traditional scatterometry systems measure samples one point at a time, which also makes them too slow for large-scale LNA manufacturing. In this work, we demonstrate parallelization of the traditional spectroscopic scatterometry approach using hyperspectral imaging, increasing the throughput of the technique by a factor of 106-107. We demonstrate this approach by using hyperspectralmore »
-
Evans, Christopher J. ; Bryant, Julia J. ; Motohara, Kentaro (Ed.)We present the current design of WFOS, a wide-field UV/optical (0.31-1.0 µm) imaging spectrograph planned for first-light on the TMT International Observatory 30 m telescope. WFOS is optimized for high sensitivity across the entire optical waveband for low-to-moderate resolution (R ∼ 1500-5000) long-slit and multi-slit spectroscopy of very faint targets over a contiguous field of view of 8′ .3×3 ′ .0 at the f/15 Nasmyth focus of TMT. A key design goal for WFOS is stability and repeatability in all observing modes, made possible by its gravity-invariant opto-mechanical structure, with a vertical rotation axis and all reconfigurable components moving only in planes defined by tiered optical benches parallel to the Nasmyth platform. WFOS’s optics include a linear ADC correcting a 9′ diameter field, including both the science FoV and 4 patrolling acquisition, guiding, and wavefront sensing camera systems; a novel 2-mirror reflective collimator allowing the science FoV to be centered on the telescope optical axis; a dichroic beamsplitter dividing the collimated beam into 2 wavelength-optimized spectrometer channels (blue: 0.31-0.56 µm; red: 0.54-1.04 µm); selectable transmissive dispersers (VPH and/or VBG) with remotely configurable grating tilt (angle of incidence) and camera articulation that enable optimization of diffraction efficiency and wavelength coverage inmore »
-
Deep-ultraviolet (UV) microscopy enables label-free, high-resolution, quantitative molecular imaging and enables unique applications in biomedicine, including the potential for fast hematological analysis at the point-of-care. UV microscopy has been shown to quantify hemoglobin content and white blood cells (five-part differential), providing a simple alternative to the current gold standard, the hematological analyzer. Previously, however, the UV system comprised a bulky broadband laser-driven plasma light source along with a large and expensive camera and 3D translation stage. Here, we present a modified deep-UV microscope system with a compact footprint and low-cost components. We detail the novel design with simple, inexpensive optics and hardware to enable fast and accurate automated imaging. We characterize the system, including a modified low-cost web-camera and custom automated 3D translation stage, and demonstrate its ability to scan and capture large area images. We further demonstrate the capability of the system by imaging and analyzing blood smears, using previously trained networks for automatic segmentation, classification (including 5-part white blood cell differential), and colorization. The developed system is approximately 10 times less expensive than previous configurations and can serve as a point-of-care hematology analyzer, as well as be applied broadly in biomedicine as a simple compact, low-cost, quantitative molecularmore »
-
Machine learning image recognition and classification of particles and materials is a rapidly expanding field. However, nanomaterial identification and classification are dependent on the image resolution, the image field of view, and the processing time. Optical microscopes are one of the most widely utilized technologies in laboratories across the world, due to their nondestructive abilities to identify and classify critical micro-sized objects and processes, but identifying and classifying critical nano-sized objects and processes with a conventional microscope are outside of its capabilities, due to the diffraction limit of the optics and small field of view. To overcome these challenges of nanomaterial identification and classification, we developed an intelligent nanoscope that combines machine learning and microsphere array-based imaging to: (1) surpass the diffraction limit of the microscope objective with microsphere imaging to provide high-resolution images; (2) provide large field-of-view imaging without the sacrifice of resolution by utilizing a microsphere array; and (3) rapidly classify nanomaterials using a deep convolution neural network. The intelligent nanoscope delivers more than 46 magnified images from a single image frame so that we collected more than 1000 images within 2 seconds. Moreover, the intelligent nanoscope achieves a 95% nanomaterial classification accuracy using 1000 images of trainingmore »