skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Mapping Brain Structural Connectivities to Functional Networks Via Graph Encoder-Decoder With Interpretable Latent Embeddings
Title: Mapping Brain Structural Connectivities to Functional Networks Via Graph Encoder-Decoder With Interpretable Latent Embeddings
In this paper, the relationship between functional and structural brain networks is investigated by training a graph encoder-decoder system to learn the mapping from brain structural connectivity (SC) to functional connectivity (FC). Our work leverages a graph convolutional network (GCN) model in the encoder which integrates both nodal attributes and the network topology information to generate new graph representations in lower dimensions. Using brain SC graphs as inputs, the novel GCN-based encoder-decoder system manages to account for both direct and indirect interactions between brain regions to reconstruct the empirical FC networks. In doing so, the latent variables within the system (i.e., the learnt low-dimensional embeddings) capture important information regarding the relation between functional and structural networks. By decomposing the reconstructed functional networks in terms of the output of each graph convolution filter, we can extract those brain regions which contribute most to the generation of FC networks from their SC counterparts. Experiments on a large population of healthy subjects from the Human Connectome Project show our model can learn a generalizable and interpretable SC-FC relationship. Overall, results here support the promising prospect of using GCNs to discover more about the complex nature of human brain activity and function.  more » « less
Award ID(s):
1750428
NSF-PAR ID:
10142017
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Page Range / eLocation ID:
1 - 5
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ( , 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP))
    null (Ed.)
    In this paper, we propose a supervised graph representation learning method to model the relationship between brain functional connectivity (FC) and structural connectivity (SC) through a graph encoder-decoder system. The graph convolutional network (GCN) model is leveraged in the encoder to learn lower-dimensional node representations (i.e. node embeddings) integrating information from both node attributes and network topology. In doing so, the encoder manages to capture both direct and indirect interactions between brain regions in the node embeddings which later help reconstruct empirical FC networks. From node embeddings, graph representations are learnt to embed the entire graphs into a vector space. Our end-to-end model utilizes a multi-objective loss function to simultaneously learn node representations for FC network reconstruction and graph representations for subject classification. The experiment on a large population of non-drinkers and heavy drinkers shows that our model can provide a characterization of the population pattern in the SC-FC relationship, while also learning features that capture individual uniqueness for subject classification. The identified key brain subnetworks show significant between-group difference and support the promising prospect of GCN-based graph representation learning on brain networks to model human brain activity and function. 
    more » « less
  2. ; ( , 2022 30th European Signal Processing Conference (EUSIPCO))
    Advances in graph signal processing for network neuroscience offer a unique pathway to integrate brain structure and function, with the goal of revealing some of the brain's organizing principles at the system level. In this direction, we develop a supervised graph representation learning framework to model the relationship between brain structural connectivity (SC) and functional connectivity (FC) via a graph encoder-decoder system. Specifically, we propose a Siamese network architecture equipped with graph convolutional encoders to learn graph (i.e., subject)-level embeddings that preserve application-dependent similarity measures between brain networks. This way, we effectively increase the number of training samples and bring in the flexibility to incorporate additional prior information via the prescribed target graph-level distance. While information on the brain structure-function coupling is implicitly distilled via reconstruction of brain FC from SC, our model also manages to learn representations that preserve the similarity between input graphs. The superior discriminative power of the learnt representations is demonstrated in downstream tasks including subject classification and visualization. All in all, this work advocates the prospect of leveraging learnt graph-level, similarity-preserving embeddings for brain network analysis, by bringing to bear standard tools of metric data analysis. 
    more » « less
  3. ; ; ; ( , Nature Communications)
    Abstract

    White matter structural connections are likely to support flow of functional activation or functional connectivity. While the relationship between structural and functional connectivity profiles, here called SC-FC coupling, has been studied on a whole-brain, global level, few studies have investigated this relationship at a regional scale. Here we quantify regional SC-FC coupling in healthy young adults using diffusion-weighted MRI and resting-state functional MRI data from the Human Connectome Project and study how SC-FC coupling may be heritable and varies between individuals. We show that regional SC-FC coupling strength varies widely across brain regions, but was strongest in highly structurally connected visual and subcortical areas. We also show interindividual regional differences based on age, sex and composite cognitive scores, and that SC-FC coupling was highly heritable within certain networks. These results suggest regional structure-function coupling is an idiosyncratic feature of brain organisation that may be influenced by genetic factors.

     
    more » « less
  4. ; ( , Human Brain Mapping)
    Abstract

    The study of human brain connectivity, including structural connectivity (SC) and functional connectivity (FC), provides insights into the neurophysiological mechanism of brain function and its relationship to human behavior and cognition. Both types of connectivity measurements provide crucial yet complementary information. However, integrating these two modalities into a single framework remains a challenge, because of the differences in their quantitative interdependencies as well as their anatomical representations due to distinctive imaging mechanisms. In this study, we introduced a new method, joint connectivity matrix independent component analysis (cmICA), which provides a data‐driven parcellation and automated‐linking of SC and FC information simultaneously using a joint analysis of functional magnetic resonance imaging (MRI) and diffusion‐weighted MRI data. We showed that these two connectivity modalities produce common cortical segregation, though with various degrees of (dis)similarity. Moreover, we show conjoint FC networks and structural white matter tracts that directly link these cortical parcellations/sources, within one analysis. Overall, data‐driven joint cmICA provides a new approach for integrating or fusing structural connectivity and FC systematically and conveniently, and provides an effective tool for connectivity‐based multimodal data fusion in brain.

     
    more » « less
  5. ; ; ; ; ; ; ; ; ; ( , Human Brain Mapping)
    Abstract

    Cellular studies indicate that endocannabinoid type‐1 retrograde signaling plays a major role in synaptic plasticity. Disruption of these processes by delta‐9‐tetrahydrocannabinol (THC) could produce alterations either in structural and functional brain connectivity or in their association in cannabis (CB) users. Graph theoretic structural and functional networks were generated with diffusion tensor imaging and resting‐state functional imaging in 37 current CB users and 31 healthy non‐users. The primary outcome measures were coupling between structural and functional connectivity, global network characteristics, association between the coupling and network properties, and measures of rich‐club organization. Structural–functional (SC–FC) coupling was globally preserved showing a positive association in current CB users. However, the users had disrupted associations between SC–FC coupling and network topological characteristics, most perturbed for shorter connections implying region‐specific disruption by CB use. Rich‐club analysis revealed impaired SC–FC coupling in the hippocampus and caudate of users. This study provides evidence of the abnormal SC–FC association in CB users. The effect was predominant in shorter connections of the brain network, suggesting that the impact of CB use or predispositional factors may be most apparent in local interconnections. Notably, the hippocampus and caudate specifically showed aberrant structural and functional coupling. These structures have high CB1 receptor density and may also be associated with changes in learning and habit formation that occur with chronic cannabis use.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email