Graph theoretical analyses have become standard tools in modeling functional and anatomical connectivity in the brain. With the advent of connectomics, the primary graphs or networks of interest are structural connectome (derived from DTI tractography) and functional connectome (derived from resting-state fMRI). However, most published connectome studies have focused on either structural or functional connectome, yet complementary information between them, when available in the same dataset, can be jointly leveraged to improve our understanding of the brain. To this end, we propose a function-constrained structural graph variational autoencoder (FCS-GVAE) capable of incorporating information from both functional and structural connectome in an unsupervised fashion. This leads to a joint low-dimensional embedding that establishes a unified spatial coordinate system for comparing across different subjects. We evaluate our approach using the publicly available OASIS-3 Alzheimer’s disease (AD) dataset and show that a variational formulation is necessary to optimally encode functional brain dynamics. Further, the proposed joint embedding approach can more accurately distinguish different patient sub-populations than approaches that do not use complementary connectome information.
more »
« less
A Matrix Autoencoder Framework to Align the Functional and Structural Connectivity Manifolds as Guided by Behavioral Phenotypes
We propose a novel matrix autoencoder to map functional connectomes from resting state fMRI (rs-fMRI) to structural connectomes from Diffusion Tensor Imaging (DTI), as guided by subject-level phenotypic measures. Our specialized autoencoder infers a low dimensional manifold embedding for the rs-fMRI correlation matrices that mimics a canonical outer-product decomposition. The embedding is simultaneously used to reconstruct DTI tractography matrices via a second manifold alignment decoder and to predict inter-subject phenotypic
variability via an artificial neural network. We validate our framework on a dataset of 275 healthy individuals from the Human Connectome Project database and on a second clinical dataset consisting of 57 subjects with Autism Spectrum Disorder. We demonstrate that the model reliably recovers structural connectivity patterns across individuals, while
robustly extracting predictive and interpretable brain biomarkers in a cross-validated setting. Finally, our framework outperforms several baselines at predicting behavioral phenotypes in both real-world datasets.
more »
« less
- NSF-PAR ID:
- 10379196
- Date Published:
- Journal Name:
- Medical Image Computing and Computer Assisted Intervention
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
more » « less
Abstract Functional network connectivity has been widely acknowledged to characterize brain functions, which can be regarded as “brain fingerprinting” to identify an individual from a pool of subjects. Both common and unique information has been shown to exist in the connectomes across individuals. However, very little is known about whether and how this information can be used to predict the individual variability of the brain. In this paper, we propose to enhance the uniqueness of individual connectome based on an autoencoder network. Specifically, we hypothesize that the common neural activities shared across individuals may reduce the individual identification. By removing contributions from shared activities, inter‐subject variability can be enhanced. Our experimental results on HCP data show that the refined connectomes obtained by utilizing autoencoder with sparse dictionary learning can distinguish an individual from the remaining participants with high accuracy (up to 99.5% for the rest–rest pair). Furthermore, high‐level cognitive behaviors (e.g., fluid intelligence, executive function, and language comprehension) can also be better predicted with the obtained refined connectomes. We also find that high‐order association cortices contribute more to both individual discrimination and behavior prediction. In summary, our proposed framework provides a promising way to leverage functional connectivity networks for cognition and behavior study, in addition to a better understanding of brain functions.
-
more » « less
The amygdala is central to the pathophysiology of many psychiatric illnesses. An imprecise understanding of how the amygdala fits into the larger network organization of the human brain, however, limits our ability to create models of dysfunction in individual patients to guide personalized treatment. Therefore, we investigated the position of the amygdala and its functional subdivisions within the network organization of the brain in 10 highly sampled individuals (5 h of fMRI data per person). We characterized three functional subdivisions within the amygdala of each individual. We discovered that one subdivision is preferentially correlated with the default mode network; a second is preferentially correlated with the dorsal attention and fronto-parietal networks; and third subdivision does not have any networks to which it is preferentially correlated relative to the other two subdivisions. All three subdivisions are positively correlated with ventral attention and somatomotor networks and negatively correlated with salience and cingulo-opercular networks. These observations were replicated in an independent group dataset of 120 individuals. We also found substantial across-subject variation in the distribution and magnitude of amygdala functional connectivity with the cerebral cortex that related to individual differences in the stereotactic locations both of amygdala subdivisions and of cortical functional brain networks. Finally, using lag analyses, we found consistent temporal ordering of fMRI signals in the cortex relative to amygdala subdivisions. Altogether, this work provides a detailed framework of amygdala–cortical interactions that can be used as a foundation for models relating aberrations in amygdala connectivity to psychiatric symptoms in individual patients.
-
more » « less
Abstract Context. Large multi-site neuroimaging datasets have significantly advanced our quest to understand brain-behavior relationships and to develop biomarkers of psychiatric and neurodegenerative disorders. Yet, such data collections come at a cost, as the inevitable differences across samples may lead to biased or erroneous conclusions.Objective. We aim to validate the estimation of individual brain network dynamics fingerprints and appraise sources of variability in large resting-state functional magnetic resonance imaging (rs-fMRI) datasets by providing a novel point of view based on data-driven dynamical models.Approach. Previous work has investigated this critical issue in terms of effects on static measures, such as functional connectivity and brain parcellations. Here, we utilize dynamical models (hidden Markov models—HMM) to examine how diverse scanning factors in multi-site fMRI recordings affect our ability to infer the brain’s spatiotemporal wandering between large-scale networks of activity. Specifically, we leverage a stable HMM trained on the Human Connectome Project (homogeneous) dataset, which we then apply to an heterogeneous dataset of traveling subjects scanned under a multitude of conditions.Main Results. Building upon this premise, we first replicate previous work on the emergence of non-random sequences of brain states. We next highlight how these time-varying brain activity patterns are robust subject-specific fingerprints. Finally, we suggest these fingerprints may be used to assess which scanning factors induce high variability in the data.Significance. These results demonstrate that we can (i) use large scale dataset to train models that can be then used to interrogate subject-specific data, (ii) recover the unique trajectories of brain activity changes in each individual, but also (iii) urge caution as our ability to infer such patterns is affected by how, where and when we do so. -
The structural network of the brain, or structural connectome, can be represented by fiber bundles generated by a variety of tractography methods. While such methods give qualitative insights into brain structure, there is controversy over whether they can provide quantitative information, especially at the population level. In order to enable population-level statistical analysis of the structural connectome, we propose representing a connectome as a Riemannian metric, which is a point on an infinite-dimensional manifold. We equip this manifold with the Ebin metric, a natural metric structure for this space, to get a Riemannian manifold along with its associated geometric properties. We then use this Riemannian framework to apply object-oriented statistical analysis to define an atlas as the Fréchet mean of a population of Riemannian metrics. This formulation ties into the existing framework for diffeomorphic construction of image atlases, allowing us to construct a multimodal atlas by simultaneously integrating complementary white matter structure details from DWMRI and cortical details from T1-weighted MRI. We illustrate our framework with 2D data examples of connectome registration and atlas formation. Finally, we build an example 3D multimodal atlas using T1 images and connectomes derived from diffusion tensors estimated from a subset of subjects from the Human Connectome Project.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
