skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: High-speed in vivo calcium recording using structured illumination with self-supervised denoising
High-speed widefield fluorescence imaging of neural activity in vivo is fundamentally limited by fluctuations in recorded signal due to background contamination and stochastic noise. In this study, we show background and shot noise-reduced imaging of the ultrafast genetically encoded Ca2+indicator GCaMP8f in CA1 pyramidal neurons using periodic structured illumination (SI) with computational image reconstruction. We implement what we believe to be a novel reconstruction method for data acquired using periodic structured illumination, termed pseudo-HiLo (pHiLo), that combines a pseudo-widefield (pWF) reconstruction with individual SI frames to perform a HiLo reconstruction. We compare this new technique to interleaved optical sectioning structured illumination microscopy (OS-SIM) and pWF reconstruction. We quantify the performance of each reconstruction by evaluating contrast, transient peak-to-noise ratio (PNR), pairwise correlation coefficients between ΔF/F time courses extracted from individual in-focus cells, and correlation coefficients between each cell with surrounding cell-free background pixels. We additionally incorporate a self-supervised deep learning method for real-time noise suppression (DeepCAD-RT) into our data preprocessing pipeline. At 500 Hz frame rates, we demonstrate a 75% increase in PNR using the denoised pHiLo reconstruction compared to pWF. Utilizing DeepCAD-RT, we show significant PNR improvements using both structured illumination (SI) reconstruction methods with OS-SIM showing a 59% increase in PNR after denoising. Both pHiLo and OS-SIM reconstructions result in a ≈65% decrease in the mean correlation coefficient of the ΔF/F time courses between ROIs in comparison with pWF, indicating the potential to remove background fluorescent transients from out-of-focus cells.  more » « less
Award ID(s):
2319405 2319406
PAR ID:
10553238
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Publisher / Repository:
Optical Society of America
Date Published:
Journal Name:
Optics Continuum
Volume:
3
Issue:
11
ISSN:
2770-0208
Format(s):
Medium: X Size: Article No. 2044
Size(s):
Article No. 2044
Sponsoring Org:
National Science Foundation
More Like this
  1. Optical sectioning structured illumination microscopy (OS-SIM) provides optical sectioning capability in wide-field microscopy. The required illumination patterns have traditionally been generated using spatial light modulators (SLM), laser interference patterns, or digital micromirror devices (DMDs) which are too complex to implement in miniscope systems. MicroLEDs have emerged as an alternative light source for patterned illumination due to their extreme brightness capability and small emitter sizes. This paper presents a directly addressable striped microLED microdisplay with 100 rows on a flexible cable (70 cm long) for use as an OS-SIM light source in a benchtop setup. The overall design of the microdisplay is described in detail with luminance-current-voltage characterization. OS-SIM implementation with a benchtop setup shows the optical sectioning capability of the system by imaging within a 500 µm thick fixed brain slice from a transgenic mouse where oligodendrocytes are labeled with a green fluorescent protein (GFP). Results show improved contrast in reconstructed optically sectioned images of 86.92% (OS-SIM) compared with 44.31% (pseudo-widefield). MicroLED based OS-SIM therefore offers a new capability for deep tissue widefield imaging. 
    more » « less
  2. We utilize pseudo-HiLo (pHiLo) for voltage imaging in awake mice expressing Voltron2552 in parvalbumin (PV) interneurons in the somatosensory cortex. We demonstrate increased signal-to-background ratio using pHiLo compared to traditional widefield neural recording. 
    more » « less
  3. Abstract Mapping 3D plasma membrane topology in live cells can bring unprecedented insights into cell biology. Widefield-based super-resolution methods such as 3D-structured illumination microscopy (3D-SIM) can achieve twice the axial ( ~ 300 nm) and lateral ( ~ 100 nm) resolution of widefield microscopy in real time in live cells. However, twice-resolution enhancement cannot sufficiently visualize nanoscale fine structures of the plasma membrane. Axial interferometry methods including fluorescence light interference contrast microscopy and its derivatives (e.g., scanning angle interference microscopy) can determine nanoscale axial locations of proteins on and near the plasma membrane. Thus, by combining super-resolution lateral imaging of 2D-SIM with axial interferometry, we developed multi-angle-crossing structured illumination microscopy (MAxSIM) to generate multiple incident angles by fast, optoelectronic creation of diffraction patterns. Axial localization accuracy can be enhanced by placing cells on a bottom glass substrate, locating a custom height-controlled mirror (HCM) at a fixed axial position above the glass substrate, and optimizing the height reconstruction algorithm for noisy experimental data. The HCM also enables imaging of both the apical and basal surfaces of a cell. MAxSIM with HCM offers high-fidelity nanoscale 3D topological mapping of cell plasma membranes with near-real-time ( ~ 0.5 Hz) imaging of live cells and 3D single-molecule tracking. 
    more » « less
  4. null (Ed.)
    Abstract We demonstrate that structured illumination microscopy has the potential to enhance fluorescence lifetime imaging microscopy (FLIM) as an early detection method for oral squamous cell carcinoma. FLIM can be used to monitor or detect changes in the fluorescence lifetime of metabolic cofactors (e.g. NADH and FAD) associated with the onset of carcinogenesis. However, out of focus fluorescence often interferes with this lifetime measurement. Structured illumination fluorescence lifetime imaging (SI-FLIM) addresses this by providing depth-resolved lifetime measurements, and applied to oral mucosa, can localize the collected signal to the epithelium. In this study, the hamster model of oral carcinogenesis was used to evaluate SI-FLIM in premalignant and malignant oral mucosa. Cheek pouches were imaged in vivo and correlated to histopathological diagnoses. The potential of NADH fluorescence signal and lifetime, as measured by widefield FLIM and SI-FLIM, to differentiate dysplasia (pre-malignancy) from normal tissue was evaluated. ROC analysis was carried out with the task of discriminating between normal tissue and mild dysplasia, when changes in fluorescence characteristics are localized to the epithelium only. The results demonstrate that SI-FLIM (AUC = 0.83) is a significantly better (p-value = 0.031) marker for mild dysplasia when compared to widefield FLIM (AUC = 0.63). 
    more » « less
  5. Background Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution). Findings Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing. Conclusions Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM. 
    more » « less