An official website of the United States government
Abstract The accuracy of assigning fluorophore identity and abundance, known as spectral unmixing, in biological fluorescence microscopy images remains a significant challenge due to the substantial overlap in emission spectra among fluorophores. In traditional laser scanning confocal spectral microscopy, fluorophore information is acquired by recording emission spectra with a single combination of discrete excitation wavelengths. However, organic fluorophores possess characteristic excitation spectra in addition to their unique emission spectral signatures. In this paper, we propose a generalized multi-view machine learning approach that leverages both excitation and emission spectra to significantly improve the accuracy in differentiating multiple highly overlapping fluorophores in a single image. By recording emission spectra of the same field with multiple combinations of excitation wavelengths, we obtain data representing different views of the underlying fluorophore distribution in the sample. We then propose a multi-view machine learning framework that allows for the flexible incorporation of noise information and abundance constraints, enabling the extraction of spectral signatures from reference images and efficient recovery of corresponding abundances in unknown mixed images. Numerical experiments on simulated image data demonstrate the method’s efficacy in improving accuracy, allowing for the discrimination of 100 fluorophores with highly overlapping spectra. Furthermore, validation on images of mixtures of fluorescently labeled Escherichia coli highlights the power of the proposed multi-view strategy in discriminating fluorophores with spectral overlap in real biological images.
more »
« less
Semi-blind sparse affine spectral unmixing of autofluorescence-contaminated micrographs
Abstract MotivationSpectral unmixing methods attempt to determine the concentrations of different fluorophores present at each pixel location in an image by analyzing a set of measured emission spectra. Unmixing algorithms have shown great promise for applications where samples contain many fluorescent labels; however, existing methods perform poorly when confronted with autofluorescence-contaminated images. ResultsWe propose an unmixing algorithm designed to separate fluorophores with overlapping emission spectra from contamination by autofluorescence and background fluorescence. First, we formally define a generalization of the linear mixing model, called the affine mixture model (AMM), that specifically accounts for background fluorescence. Second, we use the AMM to derive an affine nonnegative matrix factorization method for estimating fluorophore endmember spectra from reference images. Lastly, we propose a semi-blind sparse affine spectral unmixing (SSASU) algorithm that uses knowledge of the estimated endmembers to learn the autofluorescence and background fluorescence spectra on a per-image basis. When unmixing real-world spectral images contaminated by autofluorescence, SSASU greatly improved proportion indeterminacy as compared to existing methods for a given relative reconstruction error. Availability and implementationThe source code used for this paper was written in Julia and is available with the test data at https://github.com/brossetti/ssasu.
more »
« less
- Award ID(s):
- 1819042
- PAR ID:
- 10115275
- Publisher / Repository:
- Oxford University Press
- Date Published:
- Journal Name:
- Bioinformatics
- ISSN:
- 1367-4803
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract MotivationMultispectral biological fluorescence microscopy has enabled the identification of multiple targets in complex samples. The accuracy in the unmixing result degrades (i) as the number of fluorophores used in any experiment increases and (ii) as the signal-to-noise ratio in the recorded images decreases. Further, the availability of prior knowledge regarding the expected spatial distributions of fluorophores in images of labeled cells provides an opportunity to improve the accuracy of fluorophore identification and abundance. ResultsWe propose a regularized sparse and low-rank Poisson regression unmixing approach (SL-PRU) to deconvolve spectral images labeled with highly overlapping fluorophores which are recorded in low signal-to-noise regimes. First, SL-PRU implements multipenalty terms when pursuing sparseness and spatial correlation of the resulting abundances in small neighborhoods simultaneously. Second, SL-PRU makes use of Poisson regression for unmixing instead of least squares regression to better estimate photon abundance. Third, we propose a method to tune the SL-PRU parameters involved in the unmixing procedure in the absence of knowledge of the ground truth abundance information in a recorded image. By validating on simulated and real-world images, we show that our proposed method leads to improved accuracy in unmixing fluorophores with highly overlapping spectra. Availability and implementationThe source code used for this article was written in MATLAB and is available with the test data at https://github.com/WANGRUOGU/SL-PRU.more » « less
-
Autofluorescence has historically been considered a nuisance in medical imaging. Many endogenous fluorophores, specifically, collagen, elastin, NADH, and FAD, are found throughout the human body. Diagnostically, these signals can be prohibitive since they can outcompete signals introduced for diagnostic purposes. Recent advances in hyperspectral imaging have allowed the acquisition of significantly more data in a shorter time period by scanning the excitation spectra of fluorophores. The reduced acquisition time and increased signal-to-noise ratio allow for separation of significantly more fluorophores than previously possible. Here, we propose to utilize excitation-scanning of autofluorescence to examine tissues and diagnose pathologies. Spectra of autofluorescent molecules were obtained using a custom inverted microscope (TE-2000, Nikon Instruments) with a Xe arc lamp and thin film tunable filter array (VersaChrome, Semrock, Inc.) Scans utilized excitation wavelengths from 360 nm to 550 nm in 5 nm increments. The resultant spectra were used to examine hyperspectral image stacks from various collaborative studies, including an atherosclerotic rat model and a colon cancer study. Hyperspectral images were analyzed with ENVI and custom Matlab scripts including linear spectral unmixing (LSU) and principal component analysis (PCA). Initial results suggest the ability to separate the signals of endogenous fluorophores and measure the relative concentrations of fluorophores among healthy and diseased states of similar tissues. These results suggest pathology-specific changes to endogenous fluorophores can be detected using excitationscanning hyperspectral imaging. Future work will expand the library of pure molecules and will examine more defined disease states.more » « less
-
Multiplexed fluorescence detection has become increasingly important in the fields of biosensing and bioimaging. Although a variety of excitation/detection optical designs and fluorescence unmixing schemes have been proposed to allow for multiplexed imaging, rapid and reliable differentiation and quantification of multiple fluorescent species at each imaging pixel is still challenging. Here we present a pulsed interleaved excitation spectral fluorescence lifetime microscopic (PIE-sFLIM) system that can simultaneously image six fluorescent tags in live cells in a single hyperspectral snapshot. Using an alternating pulsed laser excitation scheme at two different wavelengths and a synchronized 16-channel time-resolved spectral detector, our PIE-sFLIM system can effectively excite multiple fluorophores and collect their emission over a broad spectrum for analysis. Combining our system with the advanced live-cell labeling techniques and the lifetime/spectral phasor analysis, our PIE-sFLIM approach can well unmix the fluorescence of six fluorophores acquired in a single measurement, thus improving the imaging speed in live-specimen investigation.more » « less
-
ABSTRACT Caenorhabditis elegans gut and cuticle produce a disruptive amount of autofluorescence during imaging. Although C. elegans autofluorescence has been characterized, it has not been characterized at high resolution using both spectral and fluorescence lifetime-based approaches. We performed high resolution spectral scans of whole, living animals to characterize autofluorescence of adult C. elegans. By scanning animals at 405 nm, 473 nm, 561 nm, and 647 nm excitations, we produced spectral profiles that confirm the brightest autofluorescence has a clear spectral overlap with the emission of green fluorescent protein (GFP). We then used fluorescence lifetime imaging microscopy (FLIM) to further characterize autofluorescence in the cuticle and the gut. Using FLIM, we were able to isolate and quantify dim GFP signal within the sensory cilia of a single pair of neurons that is often obscured by cuticle autofluorescence. In the gut, we found distinct spectral populations of autofluorescence that could be excited by 405 nm and 473 nm lasers. Further, we found lifetime differences between subregions of this autofluorescence when stimulated at 473 nm. Our results suggest that FLIM can be used to differentiate biochemically unique populations of gut autofluorescence without labeling. Further studies involving C. elegans may benefit from combining high resolution spectral and lifetime imaging to isolate fluorescent protein signal that is mixed with background autofluorescence and to perform useful characterization of subcellular structures in a label-free manner.more » « less
