skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Intelligent nanoscope for rapid nanomaterial identification and classification
Machine learning image recognition and classification of particles and materials is a rapidly expanding field. However, nanomaterial identification and classification are dependent on the image resolution, the image field of view, and the processing time. Optical microscopes are one of the most widely utilized technologies in laboratories across the world, due to their nondestructive abilities to identify and classify critical micro-sized objects and processes, but identifying and classifying critical nano-sized objects and processes with a conventional microscope are outside of its capabilities, due to the diffraction limit of the optics and small field of view. To overcome these challenges of nanomaterial identification and classification, we developed an intelligent nanoscope that combines machine learning and microsphere array-based imaging to: (1) surpass the diffraction limit of the microscope objective with microsphere imaging to provide high-resolution images; (2) provide large field-of-view imaging without the sacrifice of resolution by utilizing a microsphere array; and (3) rapidly classify nanomaterials using a deep convolution neural network. The intelligent nanoscope delivers more than 46 magnified images from a single image frame so that we collected more than 1000 images within 2 seconds. Moreover, the intelligent nanoscope achieves a 95% nanomaterial classification accuracy using 1000 images of training sets, which is 45% more accurate than without the microsphere array. The intelligent nanoscope also achieves a 92% bacteria classification accuracy using 50 000 images of training sets, which is 35% more accurate than without the microsphere array. This platform accomplished rapid, accurate detection and classification of nanomaterials with miniscule size differences. The capabilities of this device wield the potential to further detect and classify smaller biological nanomaterial, such as viruses or extracellular vesicles.  more » « less
Award ID(s):
2104295 1807601
PAR ID:
10332074
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Lab on a Chip
ISSN:
1473-0197
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Optical imaging with nanoscale resolution and a large field of view is highly desirable in many research areas. Unfortunately, it is challenging to achieve these two features simultaneously while using a conventional microscope. An objective lens with a low numerical aperture (NA) has a large field of view but poor resolution. In contrast, a high NA objective lens will have a higher resolution but reduced field of view. In an effort to close the gap between these trade-offs, we introduce an acoustofluidic scanning nanoscope (AS-nanoscope) that can simultaneously achieve high resolution with a large field of view. The AS-nanoscope relies on acoustofluidic-assisted scanning of multiple microsized particles. A scanned 2D image is then compiled by processing the microparticle images using an automated big-data image algorithm. The AS-nanoscope has the potential to be integrated into a conventional microscope or could serve as a stand-alone instrument for a wide range of applications where both high resolution and large field of view are required. 
    more » « less
  2. Abstract Wavefront sensing is the simultaneous measurement of the amplitude and phase of an incoming optical field. Traditional wavefront sensors such as Shack-Hartmann wavefront sensor (SHWFS) suffer from a fundamental tradeoff between spatial resolution and phase estimation and consequently can only achieve a resolution of a few thousand pixels. To break this tradeoff, we present a novel computational-imaging-based technique, namely, the Wavefront Imaging Sensor with High resolution (WISH). We replace the microlens array in SHWFS with a spatial light modulator (SLM) and use a computational phase-retrieval algorithm to recover the incident wavefront. This wavefront sensor can measure highly varying optical fields at more than 10-megapixel resolution with the fine phase estimation. To the best of our knowledge, this resolution is an order of magnitude higher than the current noninterferometric wavefront sensors. To demonstrate the capability of WISH, we present three applications, which cover a wide range of spatial scales. First, we produce the diffraction-limited reconstruction for long-distance imaging by combining WISH with a large-aperture, low-quality Fresnel lens. Second, we show the recovery of high-resolution images of objects that are obscured by scattering. Third, we show that WISH can be used as a microscope without an objective lens. Our study suggests that the designing principle of WISH, which combines optical modulators and computational algorithms to sense high-resolution optical fields, enables improved capabilities in many existing applications while revealing entirely new, hitherto unexplored application areas. 
    more » « less
  3. Optical projection tomography (OPT) is a three-dimensional (3D) fluorescence imaging technique, in which projection images are acquired for varying orientations of a sample using a large depth of field. OPT is typically applied to a millimeter-sized specimen, because the rotation of a microscopic specimen is challenging and not compatible with live cell imaging. In this Letter, we demonstrate fluorescence optical tomography of a microscopic specimen by laterally translating the tube lens of a wide-field optical microscope, which allows for high-resolution OPT without rotating the sample. The cost is the reduction of the field of view to about halfway along the direction of the tube lens translation. Using bovine pulmonary artery endothelial cells and 0.1 µm beads, we compare the 3D imaging performance of the proposed method with that of the conventional objective-focus scan method. 
    more » « less
  4. Diffraction-limited optical imaging through scattering media has the potential to transform many applications such as airborne and space-based imaging (through the atmosphere), bioimaging (through skin and human tissue), and fiber-based imaging (through fiber bundles). Existing wavefront shaping methods can image through scattering media and other obscurants by optically correcting wavefront aberrations using high-resolution spatial light modulators—but these methods generally require (i) guidestars, (ii) controlled illumination, (iii) point scanning, and/or (iv) statics scenes and aberrations. We propose neural wavefront shaping (NeuWS), a scanning-free wavefront shaping technique that integrates maximum likelihood estimation, measurement modulation, and neural signal representations to reconstruct diffraction-limited images through strong static and dynamic scattering media without guidestars, sparse targets, controlled illumination, nor specialized image sensors. We experimentally demonstrate guidestar-free, wide field-of-view, high-resolution, diffraction-limited imaging of extended, nonsparse, and static/dynamic scenes captured through static/dynamic aberrations. 
    more » « less
  5. Fluorescence and, more generally, photoluminescence enable high contrast imaging of targeted regions of interest through the use of photoluminescent probes with high specificity for different targets. Fluorescence can be used for rare cell imaging; however, this often requires a high space-bandwidth product: simultaneous high resolution and large field of view. With bulky traditional microscopes, high space-bandwidth product images require time-consuming mechanical scanning and stitching. Lensfree imaging can compactly and cost-effectively achieve a high space-bandwidth product in a single image through computational reconstruction of images from diffraction patterns recorded over the full field of view of standard image sensors. Many methods of lensfree photoluminescent imaging exist, where the excitation light is filtered before the image sensor, often by placing spectral filters between the sample and sensor. However, the sample-to-sensor distance is one of the limiting factors on resolution in lensfree systems and so more competitive performance can be obtained if this distance is reduced. Here, we show a time-gated lensfree photoluminescent imaging system that can achieve a resolution of 8.77 µm. We use europium chelate fluorophores because of their long lifetime (642 µs) and trigger camera exposure ∼50 µs after excitation. Because the excitation light is filtered temporally, there is no need for physical filters, enabling reduced sample-to-sensor distances and higher resolutions. 
    more » « less