skip to main content


Title: Fast and accurate sCMOS noise correction for fluorescence microscopy
Abstract

The rapid development of scientific CMOS (sCMOS) technology has greatly advanced optical microscopy for biomedical research with superior sensitivity, resolution, field-of-view, and frame rates. However, for sCMOS sensors, the parallel charge-voltage conversion and different responsivity at each pixel induces extra readout and pattern noise compared to charge-coupled devices (CCD) and electron-multiplying CCD (EM-CCD) sensors. This can produce artifacts, deteriorate imaging capability, and hinder quantification of fluorescent signals, thereby compromising strategies to reduce photo-damage to live samples. Here, we propose a content-adaptive algorithm for the automatic correction of sCMOS-related noise (ACsN) for fluorescence microscopy. ACsN combines camera physics and layered sparse filtering to significantly reduce the most relevant noise sources in a sCMOS sensor while preserving the fine details of the signal. The method improves the camera performance, enabling fast, low-light and quantitative optical microscopy with video-rate denoising for a broad range of imaging conditions and modalities.

 
more » « less
Award ID(s):
1830941
PAR ID:
10154277
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Volume:
11
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Confocal laser scanning microscopy (CLSM) is a preferred method for obtaining optical images with submicrometer resolution. Replacing the pinhole and detector of a CLSM with a digital camera [charge-coupled device (CCD) or complementary metal oxide semiconductor (CMOS)] has the potential to simplify the design and reduce cost. However, the relatively slow speed of a typical camera results in long scans. To address this issue, in the present investigation a microlens array was used to split the laser beam into 48 beamlets that are focused onto the sample. In essence, 48 pinhole-detector measurements were performed in parallel. Images obtained from the 48 laser spots were stitched together into a final image.

     
    more » « less
  2. Abstract

    Fluorescence imaging in centimeter-deep tissues with high resolution is highly desirable for many biomedical applications. Recently, we have developed a new imaging modality, ultrasound-switchable fluorescence (USF) imaging, for achieving this goal. In our previous work, we successfully achieved USF imaging with several types of USF contrast agents and imaging systems. In this study, we introduced a new USF imaging system: an intensified charge-coupled device (ICCD) camera-based, time-domain USF imaging system. We demonstrated the principle of time-domain USF imaging by using two USF contrast agents. With a series of USF imaging experiments, we demonstrated the tradeoffs among different experimental parameters (i.e., data acquisition time, including CCD camera recording time and intensifier gate delay; focused ultrasound (FU) power; and imaging depth) and the image qualities (i.e., signal-to-noise ratio, spatial resolution, and temporal resolution). In this study, we also discussed several imaging strategies for achieving a high-quality USF image via this time-domain system.

     
    more » « less
  3. The emerging technique of mid-infrared optical coherence tomography (MIR-OCT) takes advantage of the reduced scattering of MIR light in various materials and devices, enabling tomographic imaging at deeper penetration depths. Because of challenges in MIR detection technology, the image acquisition time is, however, significantly longer than for tomographic imaging methods in the visible/near-infrared. Here we demonstrate an alternative approach to MIR tomography with high-speed imaging capabilities. Through femtosecond nondegenerate two-photon absorption of MIR light in a conventional Si-based CCD camera, we achieve wide-field, high-definition tomographic imaging with chemical selectivity of structured materials and biological samples in mere seconds.

     
    more » « less
  4. Abstract Background Non-invasive reporter systems are powerful tools to query physiological and transcriptional responses in organisms. For example, fluorescent and bioluminescent reporters have revolutionized cellular and organismal assays and have been used to study plant responses to abiotic and biotic stressors. Integrated, cooled charge-coupled device (CCD) camera systems have been developed to image bioluminescent and fluorescent signals in a variety of organisms; however, these integrated long-term imaging systems are expensive. Results We have developed self-assembled systems for both growing and monitoring plant fluorescence and bioluminescence for long-term experiments under controlled environmental conditions. This system combines environmental growth chambers with high-sensitivity CCD cameras, multi-wavelength LEDs, open-source software, and several options for coordinating lights with imaging. This easy-to-assemble system can be used for short and long-term imaging of bioluminescent reporters, acute light-response, circadian rhythms, delayed fluorescence, and fluorescent-protein-based assays in vivo. Conclusions We have developed two self-assembled imaging systems that will be useful to researchers interested in continuously monitoring in vivo reporter systems in various plant species. 
    more » « less
  5. Fluorescence microscopy is one of the most indispensable and informative driving forces for biological research, but the extent of observable biological phenomena is essentially determined by the content and quality of the acquired images. To address the different noise sources that can degrade these images, we introduce an algorithm for multiscale image restoration through optimally sparse representation (MIRO). MIRO is a deterministic framework that models the acquisition process and uses pixelwise noise correction to improve image quality. Our study demonstrates that this approach yields a remarkable restoration of the fluorescence signal for a wide range of microscopy systems, regardless of the detector used (e.g., electron-multiplying charge-coupled device, scientific complementary metal-oxide semiconductor, or photomultiplier tube). MIRO improves current imaging capabilities, enabling fast, low-light optical microscopy, accurate image analysis, and robust machine intelligence when integrated with deep neural networks. This expands the range of biological knowledge that can be obtained from fluorescence microscopy.

     
    more » « less