skip to main content


Title: Deep-learning two-photon fiberscopy for video-rate brain imaging in freely-behaving mice
Abstract

Scanning two-photon (2P) fiberscopes (also termed endomicroscopes) have the potential to transform our understanding of how discrete neural activity patterns result in distinct behaviors, as they are capable of high resolution, sub cellular imaging yet small and light enough to allow free movement of mice. However, their acquisition speed is currently suboptimal, due to opto-mechanical size and weight constraints. Here we demonstrate significant advances in 2P fiberscopy that allow high resolution imaging at high speeds (26 fps) in freely-behaving mice. A high-speed scanner and a down-sampling scheme are developed to boost imaging speed, and a deep learning (DL) algorithm is introduced to recover image quality. For the DL algorithm, a two-stage learning transfer strategy is established to generate proper training datasets for enhancing the quality of in vivo images. Implementation enables video-rate imaging at ~26 fps, representing 10-fold improvement in imaging speed over the previous 2P fiberscopy technology while maintaining a high signal-to-noise ratio and imaging resolution. This DL-assisted 2P fiberscope is capable of imaging the arousal-induced activity changes in populations of layer2/3 pyramidal neurons in the primary motor cortex of freely-behaving mice, providing opportunities to define the neural basis of behavior.

 
more » « less
NSF-PAR ID:
10373155
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Publisher / Repository:
Nature Publishing Group
Date Published:
Journal Name:
Nature Communications
Volume:
13
Issue:
1
ISSN:
2041-1723
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Lightweight and head-mountable scanning nonlinear fiberscope technologies offer an exciting opportunity for enabling mechanistic exploration of ensemble neural activities with subcellular resolution on freely behaving rodents. The tether of the fiberscope, consisting of an optical fiber and scanner drive wires, however, restricts the mouse’s movement and consequently precludes free rotation and limits the freedom of walking. Here we present the first twist-free two-photon fiberscope technology for enabling neuroimaging on freely rotating/walking mice. The technology equips a scanning fiberscope with active rotational tracking and compensation capabilities through an optoelectrical commutator (OEC) to allow the animal to rotate and walk in arbitrary patterns during two-photon fluorescence (TPF) imaging of neural activities. The OEC provides excellent optical coupling stability (<<#comment/>±<#comment/>1%<#comment/>fluctuation during rotation) and an extremely high torque sensitivity (<<#comment/>8mN⋅<#comment/>m). In addition, the new technology is equipped with a custom grating and prism to effectively manage the temporal properties of the femtosecond excitation pulses through the fiber-optic system, which improved neuroimaging signal by more than2X. This TPF fiberscope imaging platform has been tested forin vivoimaging, and the results demonstrate that it enables reliable recording of calcium dynamics of more than 50 neurons simultaneously in the motor cortices of freely behaving mice in a twist-free fashion. With active tracking function of the OEC enabled, we observed considerable increase in both behavior and neural activities in the motor cortices of the mice during freely behaving neuroimaging experiments.

     
    more » « less
  2. Imaging sub-diffraction dynamics of neural nanostructures involved in behaviors such as learning and memory in a freely moving animal is not possible with existing techniques. Here, we present a solution in the form of a two-photon (2P), fiber-coupled, stimulated emission depletion microscope and demonstrate its capabilities by acquiring super-resolution imaging of mammalian cells. A polarization-maintaining fiber is used to transport both the 2P excitation light (915 nm) and the donut-shaped depletion beam (592 nm), which is constructed by adding two temporally incoherent and orthogonally polarized Hermite–Gaussian fiber modes. The fiber output is insensitive to bending or temperature changes and is the first demonstration toward deep tissue super-resolution imaging in awake behaving animals. 
    more » « less
  3. Gutkin, Boris S. (Ed.)
    Measuring the activity of neuronal populations with calcium imaging can capture emergent functional properties of neuronal circuits with single cell resolution. However, the motion of freely behaving animals, together with the intermittent detectability of calcium sensors, can hinder automatic monitoring of neuronal activity and their subsequent functional characterization. We report the development and open-source implementation of a multi-step cellular tracking algorithm (Elastic Motion Correction and Concatenation or EMC 2 ) that compensates for the intermittent disappearance of moving neurons by integrating local deformation information from detectable neurons. We demonstrate the accuracy and versatility of our algorithm using calcium imaging data from two-photon volumetric microscopy in visual cortex of awake mice, and from confocal microscopy in behaving Hydra , which experiences major body deformation during its contractions. We quantify the performance of our algorithm using ground truth manual tracking of neurons, along with synthetic time-lapse sequences, covering a wide range of particle motions and detectability parameters. As a demonstration of the utility of the algorithm, we monitor for several days calcium activity of the same neurons in layer 2/3 of mouse visual cortex in vivo , finding significant turnover within the active neurons across days, with only few neurons that remained active across days. Also, combining automatic tracking of single neuron activity with statistical clustering, we characterize and map neuronal ensembles in behaving Hydra , finding three major non-overlapping ensembles of neurons (CB, RP1 and RP2) whose activity correlates with contractions and elongations. Our results show that the EMC 2 algorithm can be used as a robust and versatile platform for neuronal tracking in behaving animals. 
    more » « less
  4. null (Ed.)
    Measurements of neuronal activity across brain areas are important for understanding the neural correlates of cognitive and motor processes such as attention, decision-making and action selection. However, techniques that allow cellular resolution measurements are expensive and require a high degree of technical expertise, which limits their broad use. Wide-field imaging of genetically encoded indicators is a high-throughput, cost-effective and flexible approach to measure activity of specific cell populations with high temporal resolution and a cortex-wide field of view. Here we outline our protocol for assembling a wide-field macroscope setup, performing surgery to prepare the intact skull and imaging neural activity chronically in behaving, transgenic mice. Further, we highlight a processing pipeline that leverages novel, cloud-based methods to analyze large-scale imaging datasets. The protocol targets laboratories that are seeking to build macroscopes, optimize surgical procedures for long-term chronic imaging and/or analyze cortex-wide neuronal recordings. The entire protocol, including steps for assembly and calibration of the macroscope, surgical preparation, imaging and data analysis, requires a total of 8 h. It is designed to be accessible to laboratories with limited expertise in imaging methods or interest in high-throughput imaging during behavior. 
    more » « less
  5. Abstract

    Objective. Understanding neural activity patterns in the developing brain remains one of the grand challenges in neuroscience. Developing neural networks are likely to be endowed with functionally important variability associated with the environmental context, age, gender, and other variables. Therefore, we conducted experiments with typically developing children in a stimulating museum setting and tested the feasibility of using deep learning techniques to help identify patterns of brain activity associated with different conditions.Approach. A four-channel dry EEG-based Mobile brain-body imaging data of children at rest and during videogame play (VGP) was acquired at the Children’s Museum of Houston. A data-driven approach based on convolutional neural networks (CNN) was used to describe underlying feature representations in the EEG and their ability to discern task and gender. The variability of the spectral features of EEG during the rest condition as a function of age was also analyzed.Main results. Alpha power (7–13 Hz) was higher during rest whereas theta power (4–7 Hz) was higher during VGP. Beta (13–18 Hz) power was the most significant feature, higher in females, when differentiating between males and females. Using data from both temporoparietal channels to classify between VGP and rest condition, leave-one-subject-out cross-validation accuracy of 67% was obtained. Age-related changes in EEG spectral content during rest were consistent with previous developmental studies conducted in laboratory settings showing an inverse relationship between age and EEG power.Significance. These findings are the first to acquire, quantify and explain brain patterns observed during VGP and rest in freely behaving children in a museum setting using a deep learning framework. The study shows how deep learning can be used as a data driven approach to identify patterns in the data and explores the issues and the potential of conducting experiments involving children in a natural and engaging environment.

     
    more » « less