skip to main content


Title: A modular microscopic smartphone attachment for imaging and quantification of multiple fluorescent probes using machine learning
Portable smartphone-based fluorescent microscopes are becoming popular owing to their ability to provide major functionalities offered by regular benchtop microscopes at a fraction of the cost. However, smartphone-based microscopes are still limited to a single fluorophore, fixed magnification, the inability to work with a different smartphones, and limited usability to either glass slides or cover slips. To overcome these challenges, here we present a modular smartphone-based microscopic attachment. The modular design allows the user to easily swap between different sets of filters and lenses, thereby enabling utility of multiple fluorophores and magnification levels. Our microscopic smartphone attachment can also be used with different smartphones and was tested with Nokia Lumia 1020, Samsung Galaxy S9+, and an iPhone XS. Further, we showed imaging results of samples on glass slides, cover slips, and microfluidic devices. A 1951 USAF resolution test target was used to quantify the maximum resolution of the microscope which was found to be 3.9 μm. The performance of the smartphone-based microscope was compared with a benchtop microscope and we found an R 2 value of 0.99 using polystyrene beads and blood cells isolated from human blood samples collected from Robert Wood Johnson Medical Hospital. Additionally, to count the particles (cells and beads) imaged from the smartphone-based fluorescent microscope, we developed artificial neural networks (ANNs) using multiple training algorithms, and evaluated their performances compared to the control (ImageJ). Finally, we did ANOVA and Tukey's post-hoc analysis and found a p -value of 0.97 which shows that no statistical significant difference exists between the performance of the trained ANN and control (ImageJ).  more » « less
Award ID(s):
2002511
NSF-PAR ID:
10312273
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
The Analyst
Volume:
146
Issue:
8
ISSN:
0003-2654
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    We have created an open‐source 3D printable microscope automatic stage and integrated camera system capable of providing a means for imaging microscope slides—the PiAutoStage. The PiAutoStage was developed to interface with the high‐quality optics of existing microscopes by creating an adaptable system that can be used in conjunction with a range of microscope configurations. The PiAutoStage automatically captures the entire area of a microscope slide in a series of overlapping high‐resolution images, which can then be stitched into a single panoramic image. We have demonstrated the utility of the PiAutoStage when attached to a transmitted light microscope by creating high‐fidelity image stacks of rock specimens in plane polarized and cross‐polarized light. We have shown that the PiAutoStage is compatible with microscopes that do not currently have a camera attachment by using two different optical trains within the same microscope: one set of imagery collected through the photography tube of a trinocular microscope, and a second set through a camera mounted to an ocular. We furthermore establish the broad adaptability of the PiAutoStage system by attaching it to a reflected light stereo dissection microscope to capture images of microfossils. We discuss strategies for the online delivery of these large‐sized images in a data efficient manner through the application of tiled imagery and open‐source Java‐based web viewers. The low cost of the PiAutoStage system, combined with the data‐efficient mechanisms of online delivery make this system an important tool in promoting the universal accessibility of high‐resolution microscope imagery.

     
    more » « less
  2. Abstract

    One of the most significant developments in life sciences—the discovery of bacteria and protists—was accomplished by Antoni van Leeuwenhoek in the 17thcentury using a single ball lens microscope. It is shown that the full potential of single lens designs can be realized in a contact mode of imaging by ball lenses with a refractive index of n≈ 2, suitable for developing compact cellphone‐based microscopes. The quality of imaging is comparable to basic compound microscopes, but with a narrower field‐of‐view, and is demonstrated for various biomedical samples. The maximal magnification (M > 50) with the highest resolution (≈0.66 µm atλ= 589 nm) is achieved for imaging of nanoplasmonic structures by ball lenses made from LASFN35 glass, the index of which is tuned nearn =2 using chromatic dispersion. Due to limitations of geometrical optics, the imaging theory is developed based on an exact numerical solution of the Maxwell equations, including spherical aberration and the nearfield coupling of a point source. The modeling is performed using multiscale analysis: from the field propagation inside ball lenses with diameters 30 < D/λ < 4000 to the formation of the diffracted field at distances of ≈105λ. It is shown that such imaging enables the transition from pixel‐ to diffraction‐limited resolution in cellphone microscopy.

     
    more » « less
  3. null (Ed.)
    Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells—a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings. 
    more » « less
  4. Abstract

    Sickle cell disease (SCD) is a major public health priority throughout much of the world, affecting millions of people. In many regions, particularly those in resource-limited settings, SCD is not consistently diagnosed. In Africa, where the majority of SCD patients reside, more than 50% of the 0.2–0.3 million children born with SCD each year will die from it; many of these deaths are in fact preventable with correct diagnosis and treatment. Here, we present a deep learning framework which can perform automatic screening of sickle cells in blood smears using a smartphone microscope. This framework uses two distinct, complementary deep neural networks. The first neural network enhances and standardizes the blood smear images captured by the smartphone microscope, spatially and spectrally matching the image quality of a laboratory-grade benchtop microscope. The second network acts on the output of the first image enhancement neural network and is used to perform the semantic segmentation between healthy and sickle cells within a blood smear. These segmented images are then used to rapidly determine the SCD diagnosis per patient. We blindly tested this mobile sickle cell detection method using blood smears from 96 unique patients (including 32 SCD patients) that were imaged by our smartphone microscope, and achieved ~98% accuracy, with an area-under-the-curve of 0.998. With its high accuracy, this mobile and cost-effective method has the potential to be used as a screening tool for SCD and other blood cell disorders in resource-limited settings.

     
    more » « less
  5. Spectroscopic image data has provided molecular discrimination for numerous fields including: remote sensing, food safety and biomedical imaging. Despite the various technologies for acquiring spectral data, there remains a trade-off when acquiring data. Typically, spectral imaging either requires long acquisition times to collect an image stack with high spectral specificity or acquisition times are shortened at the expense of fewer spectral bands or reduced spatial sampling. Hence, new spectral imaging microscope platforms are needed to help mitigate these limitations. Fluorescence excitation-scanning spectral imaging is one such new technology, which allows more of the emitted signal to be detected than comparable emission-scanning spectral imaging systems. Here, we have developed a new optical geometry that provides spectral illumination for use in excitation-scanning spectral imaging microscope systems. This was accomplished using a wavelength-specific LED array to acquire spectral image data. Feasibility of the LED-based spectral illuminator was evaluated through simulation and benchtop testing and assessment of imaging performance when integrated with a widefield fluorescence microscope. Ray tracing simulations (TracePro) were used to determine optimal optical component selection and geometry. Spectral imaging feasibility was evaluated using a series of 6-label fluorescent slides. The LED-based system response was compared to a previously tested thin-film tunable filter (TFTF)-based system. Spectral unmixing successfully discriminated all fluorescent components in spectral image data acquired from both the LED and TFTF systems. Therefore, the LED-based spectral illuminator provided spectral image data sets with comparable information content so as to allow identification of each fluorescent component. These results provide proof-of-principle demonstration of the ability to combine output from many discrete wavelength LED sources using a double-mirror (Cassegrain style) optical configuration that can be further modified to allow for high speed, video-rate spectral image acquisition. Real-time spectral fluorescence microscopy would allow monitoring of rapid cell signaling processes (i.e., Ca2+and other second messenger signaling) and has potential to be translated to clinical imaging platforms.

     
    more » « less