The transformation and transmission of brain stimuli reflect the dynamical brain activity in space and time. Compared with functional magnetic resonance imaging (fMRI), magneto- or electroencephalography (M/EEG) fast couples to the neural activity through generated magnetic fields. However, the MEG signal is inhomogeneous throughout the whole brain, which is affected by the signal-to-noise ratio, the sensors’ location and distance. Current non-invasive neuroimaging modalities such as fMRI and M/EEG excel high resolution in space or time but not in both. To solve the main limitations of current technique for brain activity recording, we propose a novel recurrent memory optimization approach to predict the internal behavioral states in space and time. The proposed method uses Optimal Polynomial Projections to capture the long temporal history with robust online compression. The training process takes the pairs of fMRI and MEG data as inputs and predicts the recurrent brain states through the Siamese network. In the testing process, the framework only uses fMRI data to generate the corresponding neural response in space and time. The experimental results with Human connectome project (HCP) show that the predicted signal could reflect the neural activity with high spatial resolution as fMRI and high temporal resolution as MEG signal. The experimental results demonstrate for the first time that the proposed method is able to predict the brain response in both milliseconds and millimeters using only fMRI signal.
more »
« less
Human brain mapping with multithousand-channel PtNRGrids resolves spatiotemporal dynamics
Cortex in high resolution Recording brain cortical activity with high spatial and temporal resolution is critical for understanding brain circuitry in physiological and pathological conditions. In this study, Tchoe et al. developed a reconfigurable and scalable thin-film, multithousand-channel neurophysiological recording grids using platinum nanorods, called PtNRGrids, that could record thousands of channels with submillimeter resolution in the rat barrel cortex. In human subjects, PtNRGrids were able to provide high-resolution recordings of large and curvilinear brain areas and to resolve spatiotemporal dynamics of motor and sensory activities. The results suggest that PtNRGrids could be used in the preclinical and clinical setting for high spatial and temporal recording of neural activity.
more »
« less
- Award ID(s):
- 1728497
- PAR ID:
- 10392410
- Date Published:
- Journal Name:
- Science Translational Medicine
- Volume:
- 14
- Issue:
- 628
- ISSN:
- 1946-6234
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Understanding the intrinsic patterns of human brain is important to make inferences about the mind and brain-behavior association. Electrophysiological methods (i.e. MEG/EEG) provide direct measures of neural activity without the effect of vascular confounds. The blood oxygenated level-dependent (BOLD) signal of functional MRI (fMRI) reveals the spatial and temporal brain activity across different brain regions. However, it is unclear how to associate the high temporal resolution Electrophysiological measures with high spatial resolution fMRI signals. Here, we present a novel interpretable model for coupling the structure and function activity of brain based on heterogeneous contrastive graph representation. The proposed method is able to link manifest variables of the brain (i.e. MEG, MRI, fMRI and behavior performance) and quantify the intrinsic coupling strength of different modal signals. The proposed method learns the heterogeneous node and graph representations by contrasting the structural and temporal views through the mind to multimodal brain data. The first experiment with 1200 subjects from Human connectome Project (HCP) shows that the proposed method outperforms the existing approaches in predicting individual gender and enabling the location of the importance of brain regions with sex difference. The second experiment associates the structure and temporal views between the low-level sensory regions and high-level cognitive ones. The experimental results demonstrate that the dependence of structural and temporal views varied spatially through different modal variants. The proposed method enables the heterogeneous biomarkers explanation for different brain measurements.more » « less
-
Genetically encoded voltage indicators (GEVIs) enable monitoring of neuronal activity at high spatial and temporal resolution. However, the utility of existing GEVIs has been limited by the brightness and photostability of fluorescent proteins and rhodopsins. We engineered a GEVI, called Voltron, that uses bright and photostable synthetic dyes instead of protein-based fluorophores, thereby extending the number of neurons imaged simultaneously in vivo by a factor of 10 and enabling imaging for significantly longer durations relative to existing GEVIs. We used Voltron for in vivo voltage imaging in mice, zebrafish, and fruit flies. In the mouse cortex, Voltron allowed single-trial recording of spikes and subthreshold voltage signals from dozens of neurons simultaneously over a 15-minute period of continuous imaging. In larval zebrafish, Voltron enabled the precise correlation of spike timing with behavior.more » « less
-
more » « less
Active sampling in the olfactory domain is an important aspect of mouse behaviour, and there is increasing evidence that respiration-entrained neural activity outside of the olfactory system sets an important global brain rhythm. It is therefore important to accurately measure breathing during natural behaviours. We develop a new approach to do this in freely moving animals, by implanting a telemetry-based pressure sensor into the right jugular vein, which allows for wireless monitoring of thoracic pressure. After verifying this technique against standard head-fixed respiration measurements, we combined it with EEG and EMG recording and used evolving partial coherence analysis to investigate the relationship between respiration and brain activity across a range of experiments in which the mice could move freely. During voluntary exploration of odours and objects, we found that the association between respiration and cortical delta and theta rhythms decreased, while the association between respiration and cortical alpha rhythm increased. During sleep, however, the presentation of an odour was able to cause a transient increase in sniffing without changing dominant sleep rhythms (delta and theta) in the cortex. Our data align with the emerging idea that the respiration rhythm could act as a synchronising scaffold for specific brain rhythms during wakefulness and exploration, but suggest that respiratory changes are less able to impact brain activity during sleep. Combining wireless respiration monitoring with different types of brain recording across a variety of behaviours will further increase our understanding of the important links between active sampling, passive respiration, and neural activity.
-
more » « less
Abstract Organisms process sensory information in the context of their own moving bodies, an idea referred to as embodiment. This idea is important for developmental neuroscience, robotics and systems neuroscience. The mechanisms supporting embodiment are unknown, but a manifestation could be the observation in mice of brain-wide neuromodulation, including in the primary visual cortex, driven by task-irrelevant spontaneous body movements. We tested this hypothesis in macaque monkeys (
Macaca mulatta ), a primate model for human vision, by simultaneously recording visual cortex activity and facial and body movements. We also sought a direct comparison using an analogous approach to those used in mouse studies. Here we found that activity in the primate visual cortex (V1, V2 and V3/V3A) was associated with the animals’ own movements, but this modulation was largely explained by the impact of the movements on the retinal image, that is, by changes in visual input. These results indicate that visual cortex in primates is minimally driven by spontaneous movements and may reflect species-specific sensorimotor strategies.
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1126/scitranslmed.abj1441
