Two-photon calcium imaging provides large-scale recordings of neuronal activities at cellular resolution. A robust, automated and high-speed pipeline to simultaneously segment the spatial footprints of neurons and extract their temporal activity traces while decontaminating them from background, noise and overlapping neurons is highly desirable to analyse calcium imaging data. Here we demonstrate DeepCaImX, an end-to-end deep learning method based on an iterative shrinkage-thresholding algorithm and a long short-term memory neural network to achieve the above goals altogether at a very high speed and without any manually tuned hyperparameter. DeepCaImX is a multi-task, multi-class and multi-label segmentation method composed of a compressed sensing-inspired neural network with a recurrent layer and fully connected layers. The neural network can simultaneously generate accurate neuronal footprints and extract clean neuronal activity traces from calcium imaging data. We trained the neural network with simulated datasets and benchmarked it against existing state-of-the-art methods with in vivo experimental data. DeepCaImX outperforms existing methods in the quality of segmentation and temporal trace extraction as well as processing speed. DeepCaImX is highly scalable and will benefit the analysis of mesoscale calcium imaging.
more »
« less
FARCI: Fast and Robust Connectome Inference
The inference of neuronal connectome from large-scale neuronal activity recordings, such as two-photon Calcium imaging, represents an active area of research in computational neuroscience. In this work, we developed FARCI (Fast and Robust Connectome Inference), a MATLAB package for neuronal connectome inference from high-dimensional two-photon Calcium fluorescence data. We employed partial correlations as a measure of the functional association strength between pairs of neurons to reconstruct a neuronal connectome. We demonstrated using in silico datasets from the Neural Connectomics Challenge (NCC) and those generated using the state-of-the-art simulator of Neural Anatomy and Optimal Microscopy (NAOMi) that FARCI provides an accurate connectome and its performance is robust to network sizes, missing neurons, and noise levels. Moreover, FARCI is computationally efficient and highly scalable to large networks. In comparison with the best performing connectome inference algorithm in the NCC, Generalized Transfer Entropy (GTE), and Fluorescence Single Neuron and Network Analysis Package (FluoroSNNAP), FARCI produces more accurate networks over different network sizes, while providing significantly better computational speed and scaling.
more »
« less
- PAR ID:
- 10391002
- Date Published:
- Journal Name:
- Brain Sciences
- Volume:
- 11
- Issue:
- 12
- ISSN:
- 2076-3425
- Page Range / eLocation ID:
- 1556
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Modern neural interfaces allow access to the activity of up to a million neurons within brain circuits. However, bandwidth limits often create a trade-off between greater spatial sampling (more channels or pixels) and the temporal frequency of sampling. Here we demonstrate that it is possible to obtain spatio-temporal super-resolution in neuronal time series by exploiting relationships among neurons, embedded in latent low-dimensional population dynamics. Our novel neural network training strategy, selective backpropagation through time (SBTT), enables learning of deep generative models of latent dynamics from data in which the set of observed variables changes at each time step. The resulting models are able to infer activity for missing samples by combining observations with learned latent dynamics. We test SBTT applied to sequential autoencoders and demonstrate more efficient and higher-fidelity characterization of neural population dynamics in electrophysiological and calcium imaging data. In electrophysiology, SBTT enables accurate inference of neuronal population dynamics with lower interface bandwidths, providing an avenue to significant power savings for implanted neuroelectronic interfaces. In applications to two-photon calcium imaging, SBTT accurately uncovers high-frequency temporal structure underlying neural population activity, substantially outperforming the current state-of-the-art. Finally, we demonstrate that performance could be further improved by using limited, high-bandwidth sampling to pretrain dynamics models, and then using SBTT to adapt these models for sparsely-sampled data.more » « less
-
null (Ed.)Neuronal activity correlations are key to understanding how populations of neurons collectively encode information. While two-photon calcium imaging has created a unique opportunity to record the activity of large populations of neurons, existing methods for inferring correlations from these data face several challenges. First, the observations of spiking activity produced by two-photon imaging are temporally blurred and noisy. Secondly, even if the spiking data were perfectly recovered via deconvolution, inferring network-level features from binary spiking data is a challenging task due to the non-linear relation of neuronal spiking to endogenous and exogenous inputs. In this work, we propose a methodology to explicitly model and directly estimate signal and noise correlations from two-photon fluorescence observations, without requiring intermediate spike deconvolution. We provide theoretical guarantees on the performance of the proposed estimator and demonstrate its utility through applications to simulated and experimentally recorded data from the mouse auditory cortex.more » « less
-
Abstract Multiphoton microscopy has emerged as the primary imaging tool for studying the structural and functional dynamics of neural circuits in brain tissue, which is highly scattering to light. Recently, three-photon microscopy has enabled high-resolution fluorescence imaging of neurons in deeper brain areas that lie beyond the reach of conventional two-photon microscopy, which is typically limited to ~ 450 µm. Three-photon imaging of neuronal calcium signals, through the genetically-encoded calcium indicator GCaMP6, has been used to successfully record neuronal activity in deeper neocortical layers and parts of the hippocampus in rodents. Bulk-loading cells in deeper cortical layers with synthetic calcium indicators could provide an alternative strategy for labelling that obviates dependence on viral tropism and promoter penetration, particularly in non-rodent species. Here we report a strategy for visualized injection of a calcium dye, Oregon Green BAPTA-1 AM (OGB-1 AM), at 500–600 µm below the surface of the mouse visual cortex in vivo. We demonstrate successful OGB-1 AM loading of cells in cortical layers 5–6 and subsequent three-photon imaging of orientation- and direction- selective visual responses from these cells.more » « less
-
Understanding how networks of neurons transmit information is crucial to uncovering the underlying mechanisms of brain function. A common measure of communication in neuronal networks is functional connectivity. But, due to the presence of many latent confounding factors in existing experimental paradigms, functional connectivity estimates do not allow a direct interpretation of causal interactions in a network. Here, we aim at addressing this challenge using a quasi-experimental approach, namely Instrumental Variables, in a concurrent optogenetic stimulation of two-photon calcium imaging paradigm. We propose a methodology based on variational inference that allows estimating the spiking activity from blurred and noisy two-photon observations. We then use maximum likelihood estimation to construct a statistical testing framework that allows to distinguish between direct and confounding pairwise effects, by taking a set of random stimulation patterns as the instrumental variables. We demonstrate the utility of our approach using simulated data and compare its performance with existing work. Our results show that the proposed method can achieve high sensitivity and specificity in functional network discovery in presence of confounding effects and using a limited number of stimulation patterns and trials.more » « less
An official website of the United States government

