skip to main content


Title: Integrated Construction of Multimodal Atlases with Structural Connectomes in the Space of Riemannian Metrics.
The structural network of the brain, or structural connectome, can be represented by fiber bundles generated by a variety of tractography methods. While such methods give qualitative insights into brain structure, there is controversy over whether they can provide quantitative information, especially at the population level. In order to enable population-level statistical analysis of the structural connectome, we propose representing a connectome as a Riemannian metric, which is a point on an infinite-dimensional manifold. We equip this manifold with the Ebin metric, a natural metric structure for this space, to get a Riemannian manifold along with its associated geometric properties. We then use this Riemannian framework to apply object-oriented statistical analysis to define an atlas as the Fréchet mean of a population of Riemannian metrics. This formulation ties into the existing framework for diffeomorphic construction of image atlases, allowing us to construct a multimodal atlas by simultaneously integrating complementary white matter structure details from DWMRI and cortical details from T1-weighted MRI. We illustrate our framework with 2D data examples of connectome registration and atlas formation. Finally, we build an example 3D multimodal atlas using T1 images and connectomes derived from diffusion tensors estimated from a subset of subjects from the Human Connectome Project.  more » « less
Award ID(s):
1912037 1953244
NSF-PAR ID:
10341133
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
The journal of machine learning for biomedical imaging
Volume:
1
ISSN:
2766-905X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Neural activity coordinated across different scales from neuronal circuits to large-scale brain networks gives rise to complex cognitive functions. Bridging the gap between micro- and macro-scale processes, we present a novel framework based on the maximum entropy model to infer a hybrid resting state structural connectome, representing functional interactions constrained by structural connectivity. We demonstrate that the structurally informed network outperforms the unconstrained model in simulating brain dynamics; wherein by constraining the inference model with the network structure we may improve the estimation of pairwise BOLD signal interactions. Further, we simulate brain network dynamics using Monte Carlo simulations with the new hybrid connectome to probe connectome-level differences in excitation-inhibition balance between apolipoprotein E (APOE)-ε4 carriers and noncarriers. Our results reveal sex differences among APOE-ε4 carriers in functional dynamics at criticality; specifically, female carriers appear to exhibit a lower tolerance to network disruptions resulting from increased excitatory interactions. In sum, the new multimodal network explored here enables analysis of brain dynamics through the integration of structure and function, providing insight into the complex interactions underlying neural activity such as the balance of excitation and inhibition. 
    more » « less
  2. Understanding the intrinsic patterns of human brain is important to make inferences about the mind and brain-behavior association. Electrophysiological methods (i.e. MEG/EEG) provide direct measures of neural activity without the effect of vascular confounds. The blood oxygenated level-dependent (BOLD) signal of functional MRI (fMRI) reveals the spatial and temporal brain activity across different brain regions. However, it is unclear how to associate the high temporal resolution Electrophysiological measures with high spatial resolution fMRI signals. Here, we present a novel interpretable model for coupling the structure and function activity of brain based on heterogeneous contrastive graph representation. The proposed method is able to link manifest variables of the brain (i.e. MEG, MRI, fMRI and behavior performance) and quantify the intrinsic coupling strength of different modal signals. The proposed method learns the heterogeneous node and graph representations by contrasting the structural and temporal views through the mind to multimodal brain data. The first experiment with 1200 subjects from Human connectome Project (HCP) shows that the proposed method outperforms the existing approaches in predicting individual gender and enabling the location of the importance of brain regions with sex difference. The second experiment associates the structure and temporal views between the low-level sensory regions and high-level cognitive ones. The experimental results demonstrate that the dependence of structural and temporal views varied spatially through different modal variants. The proposed method enables the heterogeneous biomarkers explanation for different brain measurements. 
    more » « less
  3. Abstract

    Modern data collection often entails longitudinal repeated measurements that assume values on a Riemannian manifold. Analyzing such longitudinal Riemannian data is challenging, because of both the sparsity of the observations and the nonlinear manifold constraint. Addressing this challenge, we propose an intrinsic functional principal component analysis for longitudinal Riemannian data. Information is pooled across subjects by estimating the mean curve with local Fréchet regression and smoothing the covariance structure of the linearized data on tangent spaces around the mean. Dimension reduction and imputation of the manifold‐valued trajectories are achieved by utilizing the leading principal components and applying best linear unbiased prediction. We show that the proposed mean and covariance function estimates achieve state‐of‐the‐art convergence rates. For illustration, we study the development of brain connectivity in a longitudinal cohort of Alzheimer's disease and normal participants by modeling the connectivity on the manifold of symmetric positive definite matrices with the affine‐invariant metric. In a second illustration for irregularly recorded longitudinal emotion compositional data for unemployed workers, we show that the proposed method leads to nicely interpretable eigenfunctions and principal component scores. Data used in preparation of this article were obtained from the Alzheimer's Disease Neuroimaging Initiative database.

     
    more » « less
  4. We propose a novel matrix autoencoder to map functional connectomes from resting state fMRI (rs-fMRI) to structural connectomes from Diffusion Tensor Imaging (DTI), as guided by subject-level phenotypic measures. Our specialized autoencoder infers a low dimensional manifold embedding for the rs-fMRI correlation matrices that mimics a canonical outer-product decomposition. The embedding is simultaneously used to reconstruct DTI tractography matrices via a second manifold alignment decoder and to predict inter-subject phenotypic variability via an artificial neural network. We validate our framework on a dataset of 275 healthy individuals from the Human Connectome Project database and on a second clinical dataset consisting of 57 subjects with Autism Spectrum Disorder. We demonstrate that the model reliably recovers structural connectivity patterns across individuals, while robustly extracting predictive and interpretable brain biomarkers in a cross-validated setting. Finally, our framework outperforms several baselines at predicting behavioral phenotypes in both real-world datasets. 
    more » « less
  5. Background

    A lack of in utero imaging data hampers our understanding of the connections in the human fetal brain. Generalizing observations from postmortem subjects and premature newborns is inaccurate due to technical and biological differences.

    Purpose

    To evaluate changes in fetal brain structural connectivity between 23 and 35 weeks postconceptional age using a spatiotemporal atlas of diffusion tensor imaging (DTI).

    Study Type

    Retrospective.

    Population

    Publicly available diffusion atlases, based on 60 healthy women (age 18–45 years) with normal prenatal care, from 23 and 35 weeks of gestation.

    Field Strength/Sequence

    3.0 Tesla/DTI acquired with diffusion‐weighted echo planar imaging (EPI).

    Assessment

    We performed whole‐brain fiber tractography from DTI images. The cortical plate of each diffusion atlas was segmented and parcellated into 78 regions derived from the Edinburgh Neonatal Atlas (ENA33). Connectivity matrices were computed, representing normalized fiber connections between nodes. We examined the relationship between global efficiency (GE), local efficiency (LE), small‐worldness (SW), nodal efficiency (NE), and betweenness centrality (BC) with gestational age (GA) and with laterality.

    Statistical Tests

    Linear regression was used to analyze changes in GE, LE, NE, and BC throughout gestation, and to assess changes in laterality. Thet‐tests were used to assess SW.P‐values were corrected using Holm‐Bonferroni method. A correctedP‐value <0.05 was considered statistically significant.

    Results

    Network analysis revealed a significant weekly increase in GE (5.83%/week, 95% CI 4.32–7.37), LE (5.43%/week, 95% CI 3.63–7.25), and presence of SW across GA. No significant hemisphere differences were found in GE (P = 0.971) or LE (P = 0.458). Increasing GA was significantly associated with increasing NE in 41 nodes, increasing BC in 3 nodes, and decreasing BC in 2 nodes.

    Data Conclusion

    Extensive network development and refinement occur in the second and third trimesters, marked by a rapid increase in global integration and local segregation.

    Level of Evidence

    3

    Technical Efficacy

    Stage 2

     
    more » « less