An official website of the United States government
Abstract MotivationMultispectral biological fluorescence microscopy has enabled the identification of multiple targets in complex samples. The accuracy in the unmixing result degrades (i) as the number of fluorophores used in any experiment increases and (ii) as the signal-to-noise ratio in the recorded images decreases. Further, the availability of prior knowledge regarding the expected spatial distributions of fluorophores in images of labeled cells provides an opportunity to improve the accuracy of fluorophore identification and abundance. ResultsWe propose a regularized sparse and low-rank Poisson regression unmixing approach (SL-PRU) to deconvolve spectral images labeled with highly overlapping fluorophores which are recorded in low signal-to-noise regimes. First, SL-PRU implements multipenalty terms when pursuing sparseness and spatial correlation of the resulting abundances in small neighborhoods simultaneously. Second, SL-PRU makes use of Poisson regression for unmixing instead of least squares regression to better estimate photon abundance. Third, we propose a method to tune the SL-PRU parameters involved in the unmixing procedure in the absence of knowledge of the ground truth abundance information in a recorded image. By validating on simulated and real-world images, we show that our proposed method leads to improved accuracy in unmixing fluorophores with highly overlapping spectra. Availability and implementationThe source code used for this article was written in MATLAB and is available with the test data at https://github.com/WANGRUOGU/SL-PRU.
more »
« less
A framework of multi-view machine learning for biological spectral unmixing of fluorophores with overlapping excitation and emission spectra
Abstract The accuracy of assigning fluorophore identity and abundance, known as spectral unmixing, in biological fluorescence microscopy images remains a significant challenge due to the substantial overlap in emission spectra among fluorophores. In traditional laser scanning confocal spectral microscopy, fluorophore information is acquired by recording emission spectra with a single combination of discrete excitation wavelengths. However, organic fluorophores possess characteristic excitation spectra in addition to their unique emission spectral signatures. In this paper, we propose a generalized multi-view machine learning approach that leverages both excitation and emission spectra to significantly improve the accuracy in differentiating multiple highly overlapping fluorophores in a single image. By recording emission spectra of the same field with multiple combinations of excitation wavelengths, we obtain data representing different views of the underlying fluorophore distribution in the sample. We then propose a multi-view machine learning framework that allows for the flexible incorporation of noise information and abundance constraints, enabling the extraction of spectral signatures from reference images and efficient recovery of corresponding abundances in unknown mixed images. Numerical experiments on simulated image data demonstrate the method’s efficacy in improving accuracy, allowing for the discrimination of 100 fluorophores with highly overlapping spectra. Furthermore, validation on images of mixtures of fluorescently labeled Escherichia coli highlights the power of the proposed multi-view strategy in discriminating fluorophores with spectral overlap in real biological images.
more »
« less
- Award ID(s):
- 2111080
- PAR ID:
- 10566142
- Publisher / Repository:
- Oxford University Press
- Date Published:
- Journal Name:
- Briefings in Bioinformatics
- Volume:
- 26
- Issue:
- 1
- ISSN:
- 1467-5463
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract MotivationSpectral unmixing methods attempt to determine the concentrations of different fluorophores present at each pixel location in an image by analyzing a set of measured emission spectra. Unmixing algorithms have shown great promise for applications where samples contain many fluorescent labels; however, existing methods perform poorly when confronted with autofluorescence-contaminated images. ResultsWe propose an unmixing algorithm designed to separate fluorophores with overlapping emission spectra from contamination by autofluorescence and background fluorescence. First, we formally define a generalization of the linear mixing model, called the affine mixture model (AMM), that specifically accounts for background fluorescence. Second, we use the AMM to derive an affine nonnegative matrix factorization method for estimating fluorophore endmember spectra from reference images. Lastly, we propose a semi-blind sparse affine spectral unmixing (SSASU) algorithm that uses knowledge of the estimated endmembers to learn the autofluorescence and background fluorescence spectra on a per-image basis. When unmixing real-world spectral images contaminated by autofluorescence, SSASU greatly improved proportion indeterminacy as compared to existing methods for a given relative reconstruction error. Availability and implementationThe source code used for this paper was written in Julia and is available with the test data at https://github.com/brossetti/ssasu.more » « less
-
A major benefit of fluorescence microscopy is the now plentiful selection of fluorescent markers. These labels can be chosen to serve complementary functions, such as tracking labeled subcellular molecules near demarcated organelles. However, with the standard 3 or 4 emission channels, multiple label detection is restricted to segregated regions of the electromagnetic spectrum, as in RGB coloring. Hyperspectral imaging allows the user to discern many fluorescence labels by their unique spectral properties, provided there is significant differentiation of their emission spectra. The cost of this technique is often an increase in gain or exposure time to accommodate the signal reduction from separating the signal into many discrete excitation or emission channels. Recent advances in hyperspectral imaging have allowed the acquisition of more signal in a shorter time period by scanning the excitation spectra of fluorophores. Here, we explore the selection of optimal channels for both significant signal separation and sufficient signal detection using excitation-scanning hyperspectral imaging. Excitation spectra were obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with a Xe arc lamp and thin film tunable filter array (VersaChrome, Semrock, Inc.) Tunable filters had bandwidths between 13 and 17 nm. Scans utilized excitation wavelengths between 340 nm and 550 nm. Hyperspectral image stacks were generated and analyzed using ENVI and custom MATLAB scripts. Among channel consideration criteria were: number of channels, spectral range of scan, spacing of center wavelengths, and acquisition time.more » « less
-
The intrinsic fluorescence of bacterial samples has a proven potential for label-free bacterial characterization, monitoring bacterial metabolic functions, and as a mechanism for tracking the transport of relevant components through vesicles. The reduced scattering and axial confinement of the excitation offered by multiphoton imaging can be used to overcome some of the limitations of single-photon excitation (e.g., scattering and out-of-plane photobleaching) to the imaging of bacterial communities. In this work, we demonstrate in vivo multi-photon microscopy imaging of Streptomyces bacterial communities, based on the excitation of blue endogenous fluorophores, using an ultrafast Yb-fiber laser amplifier. Its parameters, such as the pulse energy, duration, wavelength, and repetition rate, enable in vivo multicolor imaging with a single source through the simultaneous two- and three-photon excitation of different fluorophores. Three-photon excitation at 1040 nm allows fluorophores with blue and green emission spectra to be addressed (and their corresponding ultraviolet and blue single-photon excitation wavelengths, respectively), and two-photon excitation at the same wavelength allows fluorophores with yellow, orange, or red emission spectra to be addressed (and their corresponding green, yellow, and orange single-photon excitation wavelengths). We demonstrate that three-photon excitation allows imaging over a depth range of more than 6 effective attenuation lengths to take place, corresponding to an 800 micrometer depth of imaging, in samples with a high density of fluorescent structures.more » « less
-
The ability to combine microscopy and spectroscopy is beneficial for directly monitoring physical and biological processes. Spectral imaging approaches, where a transmission diffraction grating is placed near an imaging sensor to collect both the spatial image and spectrum for each object in the field of view, provide a relatively simple method to simultaneously collect images and spectroscopic responses on the same sensor. Initially demonstrated with fluorescence spectroscopy, the use of spectral imaging in Raman spectroscopy and surface-enhanced Raman spectroscopy (SERS) can provide a vibrational spectrum containing molecularly specific information that can inform on chemical changes. However, a major complication to this approach is the spectral overlap that occurs when objects are spaced closely together horizontally. In this work, we add a dove prism to a spectral imaging instrument developed for SERS imaging, enabling rotation of the collected SERS image and dispersed spectrum onto the imaging complementary metal-oxide semiconductor (CMOS) sensor. We demonstrate that this effectively reduces spectral overlap for emitters with clear separation between them and emitters with slightly overlapping point spread functions thereby facilitating collection of unambiguous spectra from each emitter.more » « less
