skip to main content


Title: Signal, noise and resolution in linear and nonlinear structured‐illumination microscopy
Summary Lay Description

Structured‐illumination microscopy (SIM) is a high‐resolution light microscopy technique that allows imaging of fluorescence at a resolution about twice the classical diffraction limit. There are various ways that the illumination can be structured, but it is not obvious how the choice of illumination pattern affects the final image quality, especially in view of the noise. We present a detailed performance analysis considering two illumination techniques: sequential illumination with line‐gratings that are shifted and rotated during image acquisition and two‐dimensional (2D) illumination structures requiring only shift operations. Our analysis is based on analytical theory, supported by simulations of images considering noise. We also extend our analysis to a nonlinear variant of SIM, with which enhanced resolution can be achieved, limited only by noise. This includes nonlinear SIM based on the light‐induced switching of the fluorescent molecules between a bright and a dark state. We find sequential illumination with line‐gratings to be advantageous in ordinary (linear) SIM, whereas 2D patterns provides a slight signal‐to‐noise advantage under idealised conditions in nonlinear SIM if there is no nonswitching background.

 
more » « less
NSF-PAR ID:
10073633
Author(s) / Creator(s):
 ;  ;  ;  
Publisher / Repository:
Wiley-Blackwell
Date Published:
Journal Name:
Journal of Microscopy
Volume:
273
Issue:
1
ISSN:
0022-2720
Page Range / eLocation ID:
p. 3-25
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution). Findings Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing. Conclusions Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM. 
    more » « less
  2. Abstract

    Mapping 3D plasma membrane topology in live cells can bring unprecedented insights into cell biology. Widefield-based super-resolution methods such as 3D-structured illumination microscopy (3D-SIM) can achieve twice the axial ( ~ 300 nm) and lateral ( ~ 100 nm) resolution of widefield microscopy in real time in live cells. However, twice-resolution enhancement cannot sufficiently visualize nanoscale fine structures of the plasma membrane. Axial interferometry methods including fluorescence light interference contrast microscopy and its derivatives (e.g., scanning angle interference microscopy) can determine nanoscale axial locations of proteins on and near the plasma membrane. Thus, by combining super-resolution lateral imaging of 2D-SIM with axial interferometry, we developed multi-angle-crossing structured illumination microscopy (MAxSIM) to generate multiple incident angles by fast, optoelectronic creation of diffraction patterns. Axial localization accuracy can be enhanced by placing cells on a bottom glass substrate, locating a custom height-controlled mirror (HCM) at a fixed axial position above the glass substrate, and optimizing the height reconstruction algorithm for noisy experimental data. The HCM also enables imaging of both the apical and basal surfaces of a cell. MAxSIM with HCM offers high-fidelity nanoscale 3D topological mapping of cell plasma membranes with near-real-time ( ~ 0.5 Hz) imaging of live cells and 3D single-molecule tracking.

     
    more » « less
  3. Light-field fluorescence microscopy can record large-scale population activity of neurons expressing genetically-encoded fluorescent indicators within volumes of tissue. Conventional light-field microscopy (LFM) suffers from poor lateral resolution when using wide-field illumination. Here, we demonstrate a structured-illumination light-field microscopy (SI-LFM) modality that enhances spatial resolution over the imaging volume. This modality increases resolution by illuminating sample volume with grating patterns that are invariant over the axial direction. The size of the SI-LFM point-spread-function (PSF) was approximately half the size of the conventional LFM PSF when imaging fluorescent beads. SI-LFM also resolved fine spatial features in lens tissue samples and fixed mouse retina samples. Finally, SI-LFM reported neural activity with approximately three times the signal-to-noise ratio of conventional LFM when imaging live zebrafish expressing a genetically encoded calcium sensor.

     
    more » « less
  4. Structured illumination microscopy (SIM) reconstructs optically-sectioned images of a sample from multiple spatially-patterned wide-field images, but the traditional single non-patterned wide-field images are more inexpensively obtained since they do not require generation of specialized illumination patterns. In this work, we translated wide-field fluorescence microscopy images to optically-sectioned SIM images by a Pix2Pix conditional generative adversarial network (cGAN). Our model shows the capability of both 2D cross-modality image translation from wide-field images to optical sections, and further demonstrates potential to recover 3D optically-sectioned volumes from wide-field image stacks. The utility of the model was tested on a variety of samples including fluorescent beads and fresh human tissue samples.

     
    more » « less
  5. Abstract Background Structured illumination microscopy (SIM) is a method that can be used to image biological samples and can achieve both optical sectioning and super-resolution effects. Optimization of the imaging set-up and data-processing methods results in high-quality images without artifacts due to mosaicking or due to the use of SIM methods. Reconstruction methods based on Bayesian estimation can be used to produce images with a resolution beyond that dictated by the optical system. Findings Five complete datasets are presented including large panoramic SIM images of human tissues in pathophysiological conditions. Cancers of the prostate, skin, ovary, and breast, as well as tuberculosis of the lung, were imaged using SIM. The samples are available commercially and are standard histological preparations stained with hematoxylin-eosin. Conclusion The use of fluorescence microscopy is increasing in histopathology. There is a need for methods that reduce artifacts caused by the use of image-stitching methods or optical sectioning methods such as SIM. Stitched SIM images produce results that may be useful for intraoperative histology. Releasing high-quality, full-slide images and related data will aid researchers in furthering the field of fluorescent histopathology. 
    more » « less