An official website of the United States government
Optical sectioning structured illumination microscopy (OS-SIM) provides optical sectioning capability in wide-field microscopy. The required illumination patterns have traditionally been generated using spatial light modulators (SLM), laser interference patterns, or digital micromirror devices (DMDs) which are too complex to implement in miniscope systems. MicroLEDs have emerged as an alternative light source for patterned illumination due to their extreme brightness capability and small emitter sizes. This paper presents a directly addressable striped microLED microdisplay with 100 rows on a flexible cable (70 cm long) for use as an OS-SIM light source in a benchtop setup. The overall design of the microdisplay is described in detail with luminance-current-voltage characterization. OS-SIM implementation with a benchtop setup shows the optical sectioning capability of the system by imaging within a 500 µm thick fixed brain slice from a transgenic mouse where oligodendrocytes are labeled with a green fluorescent protein (GFP). Results show improved contrast in reconstructed optically sectioned images of 86.92% (OS-SIM) compared with 44.31% (pseudo-widefield). MicroLED based OS-SIM therefore offers a new capability for deep tissue widefield imaging.
more »
« less
Deep learning 2D and 3D optical sectioning microscopy using cross-modality Pix2Pix cGAN image translation
Structured illumination microscopy (SIM) reconstructs optically-sectioned images of a sample from multiple spatially-patterned wide-field images, but the traditional single non-patterned wide-field images are more inexpensively obtained since they do not require generation of specialized illumination patterns. In this work, we translated wide-field fluorescence microscopy images to optically-sectioned SIM images by a Pix2Pix conditional generative adversarial network (cGAN). Our model shows the capability of both 2D cross-modality image translation from wide-field images to optical sections, and further demonstrates potential to recover 3D optically-sectioned volumes from wide-field image stacks. The utility of the model was tested on a variety of samples including fluorescent beads and fresh human tissue samples.
more »
« less
- Award ID(s):
- 2136744
- PAR ID:
- 10308034
- Publisher / Repository:
- Optical Society of America
- Date Published:
- Journal Name:
- Biomedical Optics Express
- Volume:
- 12
- Issue:
- 12
- ISSN:
- 2156-7085
- Format(s):
- Medium: X Size: Article No. 7526
- Size(s):
- Article No. 7526
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Background Structured illumination microscopy (SIM) is a method that can be used to image biological samples and can achieve both optical sectioning and super-resolution effects. Optimization of the imaging set-up and data-processing methods results in high-quality images without artifacts due to mosaicking or due to the use of SIM methods. Reconstruction methods based on Bayesian estimation can be used to produce images with a resolution beyond that dictated by the optical system. Findings Five complete datasets are presented including large panoramic SIM images of human tissues in pathophysiological conditions. Cancers of the prostate, skin, ovary, and breast, as well as tuberculosis of the lung, were imaged using SIM. The samples are available commercially and are standard histological preparations stained with hematoxylin-eosin. Conclusion The use of fluorescence microscopy is increasing in histopathology. There is a need for methods that reduce artifacts caused by the use of image-stitching methods or optical sectioning methods such as SIM. Stitched SIM images produce results that may be useful for intraoperative histology. Releasing high-quality, full-slide images and related data will aid researchers in furthering the field of fluorescent histopathology.more » « less
-
Background Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution). Findings Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing. Conclusions Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM.more » « less
-
The inherent constraints on resolution, speed and field of view have hindered the development of high-speed, three-dimensional microscopy techniques over large scales. Here, we present a multiplane line-scan imaging strategy, which uses a series of axially distributed reflecting slits to probe different depths within a sample volume. Our technique enables the simultaneous imaging of an optically sectioned image stack with a single camera at frame rates of hundreds of hertz, without the need for axial scanning. We demonstrate the applicability of our system to monitor fast dynamics in biological samples by performing calcium imaging of neuronal activity in mouse brains and voltage imaging of cardiomyocytes in cardiac samples.more » « less
-
Confocal microscopy is a standard approach for obtaining volumetric images of a sample with high axial and lateral resolution, especially when dealing with scattering samples. Unfortunately, a confocal microscope is quite expensive compared to traditional microscopes. In addition, the point scanning in confocal microscopy leads to slow imaging speed and photobleaching due to the high dose of laser energy. In this paper, we demonstrate how the advances in machine learning can be exploited to teach a traditional wide-field microscope, one that’s available in every lab, into producing 3D volumetric images like a confocal microscope. The key idea is to obtain multiple images with different focus settings using a wide-field microscope and use a 3D generative adversarial network (GAN) based neural network to learn the mapping between the blurry low-contrast image stacks obtained using a wide-field microscope and the sharp, high-contrast image stacks obtained using a confocal microscope. After training the network with widefield-confocal stack pairs, the network can reliably and accurately reconstruct 3D volumetric images that rival confocal images in terms of its lateral resolution, z-sectioning and image contrast. Our experimental results demonstrate generalization ability to handle unseen data, stability in the reconstruction results, high spatial resolution even when imaging thick (∼40 microns) highly-scattering samples. We believe that such learning-based microscopes have the potential to bring confocal imaging quality to every lab that has a wide-field microscope.more » « less
