skip to main content

Title: Imaging across multiple spatial scales with the multi-camera array microscope

This paper experimentally examines different configurations of a multi-camera array microscope (MCAM) imaging technology. The MCAM is based upon a densely packed array of “micro-cameras” to jointly image across a large field-of-view (FOV) at high resolution. Each micro-camera within the array images a unique area of a sample of interest, and then all acquired data with 54 micro-cameras are digitally combined into composite frames, whose total pixel counts significantly exceed the pixel counts of standard microscope systems. We present results from three unique MCAM configurations for different use cases. First, we demonstrate a configuration that simultaneously images and estimates the 3D object depth across a 100×135mm2FOV at approximately 20 µm resolution, which results in 0.15 gigapixels (GP) per snapshot. Second, we demonstrate an MCAM configuration that records video across a continuous 83×123mm2FOV with twofold increased resolution (0.48 GP per frame). Finally, we report a third high-resolution configuration (2 µm resolution) that can rapidly produce 9.8 GP composites of large histopathology specimens.

Authors:
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more » ; ; ; ; ; « less
Publication Date:
NSF-PAR ID:
10405611
Journal Name:
Optica
Volume:
10
Issue:
4
Page Range or eLocation-ID:
Article No. 471
ISSN:
2334-2536
Publisher:
Optical Society of America
Sponsoring Org:
National Science Foundation
More Like this
  1. Traditional miniaturized fluorescence microscopes are critical tools for modern biology. Invariably, they struggle to simultaneously image with a high spatial resolution and a large field of view (FOV). Lensless microscopes offer a solution to this limitation. However, real-time visualization of samples is not possible with lensless imaging, as image reconstruction can take minutes to complete. This poses a challenge for usability, as real-time visualization is a crucial feature that assists users in identifying and locating the imaging target. The issue is particularly pronounced in lensless microscopes that operate at close imaging distances. Imaging at close distances requires shift-varying deconvolution to account for the variation of the point spread function (PSF) across the FOV. Here, we present a lensless microscope that achieves real-time image reconstruction by eliminating the use of an iterative reconstruction algorithm. The neural network-based reconstruction method we show here, achieves more than 10000 times increase in reconstruction speed compared to iterative reconstruction. The increased reconstruction speed allows us to visualize the results of our lensless microscope at more than 25 frames per second (fps), while achieving better than 7 µm resolution over a FOV of 10 mm2. This ability to reconstruct and visualize samples in real-time empowers amore »more user-friendly interaction with lensless microscopes. The users are able to use these microscopes much like they currently do with conventional microscopes.

    « less
  2. Modern high-throughput nanopatterning techniques, such as nanoimprint lithography, make it possible to fabricate arrays of nanostructures (features with dimensions of 10’s to 100’s of nm) over large area substrates (cm2to m2scale) such as Si wafers, glass sheets, and flexible roll-to-roll webs. The ability to make such large-area nanostructure arrays (LNAs) has created an extensive design space, enabling a wide array of applications including optical devices, such as wire-grid polarizers, transparent conductors, color filters, and anti-reflection surfaces, and building blocks for electronic components, such as ultracapacitors, sensors, and memory storage architectures. However, existing metrology methods will have trouble scaling alongside fabrication methods. Scanning electron microscopy (SEM) and atomic force microscopy (AFM), for instance, have micron scale fields of view (FOV) that preclude comprehensive characterization of LNAs, which may be manufactured at m2per minute rates. Scatterometry approaches have larger FOVs (typically 100’s of µm to a few mm), but traditional scatterometry systems measure samples one point at a time, which also makes them too slow for large-scale LNA manufacturing. In this work, we demonstrate parallelization of the traditional spectroscopic scatterometry approach using hyperspectral imaging, increasing the throughput of the technique by a factor of 106-107. We demonstrate this approach by using hyperspectralmore »imaging and inverse modeling of reflectance spectra to derive 3-dimensional geometric data for Si nanopillar array structures over both mm and cm-scale with µm-scale spatial resolution. This work suggests that geometric measurements for a variety of LNAs can be performed with the potential for high speed over large areas which may be critical for future LNA manufacturing.

    « less
  3. Evans, Christopher J. ; Bryant, Julia J. ; Motohara, Kentaro (Ed.)
    We present the current design of WFOS, a wide-field UV/optical (0.31-1.0 µm) imaging spectrograph planned for first-light on the TMT International Observatory 30 m telescope. WFOS is optimized for high sensitivity across the entire optical waveband for low-to-moderate resolution (R ∼ 1500-5000) long-slit and multi-slit spectroscopy of very faint targets over a contiguous field of view of 8′ .3×3 ′ .0 at the f/15 Nasmyth focus of TMT. A key design goal for WFOS is stability and repeatability in all observing modes, made possible by its gravity-invariant opto-mechanical structure, with a vertical rotation axis and all reconfigurable components moving only in planes defined by tiered optical benches parallel to the Nasmyth platform. WFOS’s optics include a linear ADC correcting a 9′ diameter field, including both the science FoV and 4 patrolling acquisition, guiding, and wavefront sensing camera systems; a novel 2-mirror reflective collimator allowing the science FoV to be centered on the telescope optical axis; a dichroic beamsplitter dividing the collimated beam into 2 wavelength-optimized spectrometer channels (blue: 0.31-0.56 µm; red: 0.54-1.04 µm); selectable transmissive dispersers (VPH and/or VBG) with remotely configurable grating tilt (angle of incidence) and camera articulation that enable optimization of diffraction efficiency and wavelength coverage inmore »each channel; all-refractive, wavelength-optimized f/2 spectrograph cameras, and UV/blue and red-optimized detector systems. The predicted instrumental through put of WFOS for spectroscopy averages > 56% over the full 0.31-1 µm range, from the ADC to the detector. When combined with the 30 m TMT aperture, WFOS will realize a factor of ∼20 gain in sensitivity compared to the current state of the art on 8-10 m-class telescopes.« less
  4. Deep-ultraviolet (UV) microscopy enables label-free, high-resolution, quantitative molecular imaging and enables unique applications in biomedicine, including the potential for fast hematological analysis at the point-of-care. UV microscopy has been shown to quantify hemoglobin content and white blood cells (five-part differential), providing a simple alternative to the current gold standard, the hematological analyzer. Previously, however, the UV system comprised a bulky broadband laser-driven plasma light source along with a large and expensive camera and 3D translation stage. Here, we present a modified deep-UV microscope system with a compact footprint and low-cost components. We detail the novel design with simple, inexpensive optics and hardware to enable fast and accurate automated imaging. We characterize the system, including a modified low-cost web-camera and custom automated 3D translation stage, and demonstrate its ability to scan and capture large area images. We further demonstrate the capability of the system by imaging and analyzing blood smears, using previously trained networks for automatic segmentation, classification (including 5-part white blood cell differential), and colorization. The developed system is approximately 10 times less expensive than previous configurations and can serve as a point-of-care hematology analyzer, as well as be applied broadly in biomedicine as a simple compact, low-cost, quantitative molecularmore »imaging system.

    « less
  5. Machine learning image recognition and classification of particles and materials is a rapidly expanding field. However, nanomaterial identification and classification are dependent on the image resolution, the image field of view, and the processing time. Optical microscopes are one of the most widely utilized technologies in laboratories across the world, due to their nondestructive abilities to identify and classify critical micro-sized objects and processes, but identifying and classifying critical nano-sized objects and processes with a conventional microscope are outside of its capabilities, due to the diffraction limit of the optics and small field of view. To overcome these challenges of nanomaterial identification and classification, we developed an intelligent nanoscope that combines machine learning and microsphere array-based imaging to: (1) surpass the diffraction limit of the microscope objective with microsphere imaging to provide high-resolution images; (2) provide large field-of-view imaging without the sacrifice of resolution by utilizing a microsphere array; and (3) rapidly classify nanomaterials using a deep convolution neural network. The intelligent nanoscope delivers more than 46 magnified images from a single image frame so that we collected more than 1000 images within 2 seconds. Moreover, the intelligent nanoscope achieves a 95% nanomaterial classification accuracy using 1000 images of trainingmore »sets, which is 45% more accurate than without the microsphere array. The intelligent nanoscope also achieves a 92% bacteria classification accuracy using 50 000 images of training sets, which is 35% more accurate than without the microsphere array. This platform accomplished rapid, accurate detection and classification of nanomaterials with miniscule size differences. The capabilities of this device wield the potential to further detect and classify smaller biological nanomaterial, such as viruses or extracellular vesicles.« less