Background
Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution).
Findings
Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing.
Conclusions
Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM.
more »
« less
Artifact-free whole-slide imaging with structured illumination microscopy and Bayesian image reconstruction
Abstract Background Structured illumination microscopy (SIM) is a method that can be used to image biological samples and can achieve both optical sectioning and super-resolution effects. Optimization of the imaging set-up and data-processing methods results in high-quality images without artifacts due to mosaicking or due to the use of SIM methods. Reconstruction methods based on Bayesian estimation can be used to produce images with a resolution beyond that dictated by the optical system. Findings Five complete datasets are presented including large panoramic SIM images of human tissues in pathophysiological conditions. Cancers of the prostate, skin, ovary, and breast, as well as tuberculosis of the lung, were imaged using SIM. The samples are available commercially and are standard histological preparations stained with hematoxylin-eosin. Conclusion The use of fluorescence microscopy is increasing in histopathology. There is a need for methods that reduce artifacts caused by the use of image-stitching methods or optical sectioning methods such as SIM. Stitched SIM images produce results that may be useful for intraoperative histology. Releasing high-quality, full-slide images and related data will aid researchers in furthering the field of fluorescent histopathology.
more »
« less
- Award ID(s):
- 1727033
- NSF-PAR ID:
- 10175283
- Date Published:
- Journal Name:
- GigaScience
- Volume:
- 9
- Issue:
- 4
- ISSN:
- 2047-217X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Confocal microscopy is a standard approach for obtaining volumetric images of a sample with high axial and lateral resolution, especially when dealing with scattering samples. Unfortunately, a confocal microscope is quite expensive compared to traditional microscopes. In addition, the point scanning in confocal microscopy leads to slow imaging speed and photobleaching due to the high dose of laser energy. In this paper, we demonstrate how the advances in machine learning can be exploited to teach a traditional wide-field microscope, one that’s available in every lab, into producing 3D volumetric images like a confocal microscope. The key idea is to obtain multiple images with different focus settings using a wide-field microscope and use a 3D generative adversarial network (GAN) based neural network to learn the mapping between the blurry low-contrast image stacks obtained using a wide-field microscope and the sharp, high-contrast image stacks obtained using a confocal microscope. After training the network with widefield-confocal stack pairs, the network can reliably and accurately reconstruct 3D volumetric images that rival confocal images in terms of its lateral resolution, z-sectioning and image contrast. Our experimental results demonstrate generalization ability to handle unseen data, stability in the reconstruction results, high spatial resolution even when imaging thick (∼40 microns) highly-scattering samples. We believe that such learning-based microscopes have the potential to bring confocal imaging quality to every lab that has a wide-field microscope.
-
more » « less
Abstract Optical coherence tomography (OCT) is a widely used non-invasive biomedical imaging modality that can rapidly provide volumetric images of samples. Here, we present a deep learning-based image reconstruction framework that can generate swept-source OCT (SS-OCT) images using undersampled spectral data, without any spatial aliasing artifacts. This neural network-based image reconstruction does not require any hardware changes to the optical setup and can be easily integrated with existing swept-source or spectral-domain OCT systems to reduce the amount of raw spectral data to be acquired. To show the efficacy of this framework, we trained and blindly tested a deep neural network using mouse embryo samples imaged by an SS-OCT system. Using 2-fold undersampled spectral data (i.e., 640 spectral points per A-line), the trained neural network can blindly reconstruct 512 A-lines in 0.59 ms using multiple graphics-processing units (GPUs), removing spatial aliasing artifacts due to spectral undersampling, also presenting a very good match to the images of the same samples, reconstructed using the full spectral OCT data (i.e., 1280 spectral points per A-line). We also successfully demonstrate that this framework can be further extended to process 3× undersampled spectral data per A-line, with some performance degradation in the reconstructed image quality compared to 2× spectral undersampling. Furthermore, an A-line-optimized undersampling method is presented by jointly optimizing the spectral sampling locations and the corresponding image reconstruction network, which improved the overall imaging performance using less spectral data points per A-line compared to 2× or 3× spectral undersampling results. This deep learning-enabled image reconstruction approach can be broadly used in various forms of spectral-domain OCT systems, helping to increase their imaging speed without sacrificing image resolution and signal-to-noise ratio.
-
As it stands, the state-of-the-art techniques for obtaining in-depth images of packaged microelectronic circuits are X-ray imaging and scanning acoustic microscopy. Both of these methods successfully synthesize high-resolution images of transistor features, bond wires and pads, and defects such as silicon voids. Although the procedures allow for the necessary quality control and failure analysis that is necessary for a company to uphold product guarantees, they are both destructive methods of analysis. In the case of X-ray imaging, the high energy electromagnetic waves ionize the silicon, destroying the carefully doped PN junctions of the circuit. Scanning acoustic microscopy, on the other hand, requires that the sample is placed in an impedance matching medium, usually being a gel or liquid of some kind. For an integrated circuit, the submersion in this medium could be damaging to functionality. There exists a band of the electromagnetic spectrum that has been rarely utilized due to a lack of manufacturable technology known as the “Terahertz Gap”. Lying between the microwave and optical bands, the wavelengths of this spectrum are small enough so that they provide relatively good imaging resolution, but they are large enough that they are able to penetrate through electrically non-conductive samples and are non-ionizing. Because terahertz band waves heavily reflect from conductive materials, but transmit and are absorbed by dielectrics, it is proposed that a focused terahertz pulse containing electromagnetic frequencies ranging from 0.1 to 4 terahertz is delivered to an array of spatial locations within an area of the depth of packaged devices so that the reflected signal can be used to nondestructively recreate an image of the packaged die and bond wire connections.more » « less
-
more » « less
Optical sectioning structured illumination microscopy (OS-SIM) provides optical sectioning capability in wide-field microscopy. The required illumination patterns have traditionally been generated using spatial light modulators (SLM), laser interference patterns, or digital micromirror devices (DMDs) which are too complex to implement in miniscope systems. MicroLEDs have emerged as an alternative light source for patterned illumination due to their extreme brightness capability and small emitter sizes. This paper presents a directly addressable striped microLED microdisplay with 100 rows on a flexible cable (70 cm long) for use as an OS-SIM light source in a benchtop setup. The overall design of the microdisplay is described in detail with luminance-current-voltage characterization. OS-SIM implementation with a benchtop setup shows the optical sectioning capability of the system by imaging within a 500 µm thick fixed brain slice from a transgenic mouse where oligodendrocytes are labeled with a green fluorescent protein (GFP). Results show improved contrast in reconstructed optically sectioned images of 86.92% (OS-SIM) compared with 44.31% (pseudo-widefield). MicroLED based OS-SIM therefore offers a new capability for deep tissue widefield imaging.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1093/gigascience/giaa035
