skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Mapping Brain Structural Connectivities to Functional Networks Via Graph Encoder-Decoder With Interpretable Latent Embeddings
Title: Mapping Brain Structural Connectivities to Functional Networks Via Graph Encoder-Decoder With Interpretable Latent Embeddings
In this paper, the relationship between functional and structural brain networks is investigated by training a graph encoder-decoder system to learn the mapping from brain structural connectivity (SC) to functional connectivity (FC). Our work leverages a graph convolutional network (GCN) model in the encoder which integrates both nodal attributes and the network topology information to generate new graph representations in lower dimensions. Using brain SC graphs as inputs, the novel GCN-based encoder-decoder system manages to account for both direct and indirect interactions between brain regions to reconstruct the empirical FC networks. In doing so, the latent variables within the system (i.e., the learnt low-dimensional embeddings) capture important information regarding the relation between functional and structural networks. By decomposing the reconstructed functional networks in terms of the output of each graph convolution filter, we can extract those brain regions which contribute most to the generation of FC networks from their SC counterparts. Experiments on a large population of healthy subjects from the Human Connectome Project show our model can learn a generalizable and interpretable SC-FC relationship. Overall, results here support the promising prospect of using GCNs to discover more about the complex nature of human brain activity and function.  more » « less
Award ID(s):
1750428
NSF-PAR ID:
10142017
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2019 IEEE Global Conference on Signal and Information Processing (GlobalSIP)
Page Range / eLocation ID:
1 - 5
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ( , 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP))
    null (Ed.)
    In this paper, we propose a supervised graph representation learning method to model the relationship between brain functional connectivity (FC) and structural connectivity (SC) through a graph encoder-decoder system. The graph convolutional network (GCN) model is leveraged in the encoder to learn lower-dimensional node representations (i.e. node embeddings) integrating information from both node attributes and network topology. In doing so, the encoder manages to capture both direct and indirect interactions between brain regions in the node embeddings which later help reconstruct empirical FC networks. From node embeddings, graph representations are learnt to embed the entire graphs into a vector space. Our end-to-end model utilizes a multi-objective loss function to simultaneously learn node representations for FC network reconstruction and graph representations for subject classification. The experiment on a large population of non-drinkers and heavy drinkers shows that our model can provide a characterization of the population pattern in the SC-FC relationship, while also learning features that capture individual uniqueness for subject classification. The identified key brain subnetworks show significant between-group difference and support the promising prospect of GCN-based graph representation learning on brain networks to model human brain activity and function. 
    more » « less
  2. ; ( , 2022 30th European Signal Processing Conference (EUSIPCO))
    Advances in graph signal processing for network neuroscience offer a unique pathway to integrate brain structure and function, with the goal of revealing some of the brain's organizing principles at the system level. In this direction, we develop a supervised graph representation learning framework to model the relationship between brain structural connectivity (SC) and functional connectivity (FC) via a graph encoder-decoder system. Specifically, we propose a Siamese network architecture equipped with graph convolutional encoders to learn graph (i.e., subject)-level embeddings that preserve application-dependent similarity measures between brain networks. This way, we effectively increase the number of training samples and bring in the flexibility to incorporate additional prior information via the prescribed target graph-level distance. While information on the brain structure-function coupling is implicitly distilled via reconstruction of brain FC from SC, our model also manages to learn representations that preserve the similarity between input graphs. The superior discriminative power of the learnt representations is demonstrated in downstream tasks including subject classification and visualization. All in all, this work advocates the prospect of leveraging learnt graph-level, similarity-preserving embeddings for brain network analysis, by bringing to bear standard tools of metric data analysis. 
    more » « less
  3. ; ; ; ( , Nature Communications)
    Abstract

    White matter structural connections are likely to support flow of functional activation or functional connectivity. While the relationship between structural and functional connectivity profiles, here called SC-FC coupling, has been studied on a whole-brain, global level, few studies have investigated this relationship at a regional scale. Here we quantify regional SC-FC coupling in healthy young adults using diffusion-weighted MRI and resting-state functional MRI data from the Human Connectome Project and study how SC-FC coupling may be heritable and varies between individuals. We show that regional SC-FC coupling strength varies widely across brain regions, but was strongest in highly structurally connected visual and subcortical areas. We also show interindividual regional differences based on age, sex and composite cognitive scores, and that SC-FC coupling was highly heritable within certain networks. These results suggest regional structure-function coupling is an idiosyncratic feature of brain organisation that may be influenced by genetic factors.

     
    more » « less
  4. ; ; ; ; ; ( , The Journal of Neuroscience)
    Prior research points to a positive concurrent relationship between reasoning ability and both frontoparietal structural connectivity (SC) as measured by diffusion tensor imaging (Tamnes et al., 2010) and frontoparietal functional connectivity (FC) as measured by fMRI (Cocchi et al., 2014). Further, recent research demonstrates a link between reasoning ability and FC of two brain regions in particular: rostrolateral prefrontal cortex (RLPFC) and the inferior parietal lobe (IPL) (Wendelken et al., 2016). Here, we sought to investigate the concurrent and dynamic, lead-lag relationships among frontoparietal SC, FC, and reasoning ability in humans. To this end, we combined three longitudinal developmental datasets with behavioral and neuroimaging data from 523 male and female participants between 6 and 22 years of age. Cross-sectionally, reasoning ability was most strongly related to FC between RLPFC and IPL in adolescents and adults, but to frontoparietal SC in children. Longitudinal analysis revealed that RLPFC-IPL SC, but not FC, was a positive predictor of future changes in reasoning ability. Moreover, we found that RLPFC-IPL SC at one time point positively predicted future changes in RLPFC-IPL FC, whereas, in contrast, FC did not predict future changes in SC. Our results demonstrate the importance of strong white matter connectivity between RLPFC and IPL during middle childhood for the subsequent development of both robust FC and good reasoning ability.SIGNIFICANCE STATEMENT The human capacity for reasoning develops substantially during childhood and has a profound impact on achievement in school and in cognitively challenging careers. Reasoning ability depends on communication between lateral prefrontal and parietal cortices. Therefore, to understand how this capacity develops, we examined the dynamic relationships over time among white matter tracts connecting frontoparietal cortices (i.e., structural connectivity, SC), coordinated frontoparietal activation (functional connectivity, FC), and reasoning ability in a large longitudinal sample of subjects 6-22 years of age. We found that greater frontoparietal SC in childhood predicts future increases in both FC and reasoning ability, demonstrating the importance of white matter development during childhood for subsequent brain and cognitive functioning. 
    more » « less
  5. ; ( , Human Brain Mapping)
    Abstract

    The study of human brain connectivity, including structural connectivity (SC) and functional connectivity (FC), provides insights into the neurophysiological mechanism of brain function and its relationship to human behavior and cognition. Both types of connectivity measurements provide crucial yet complementary information. However, integrating these two modalities into a single framework remains a challenge, because of the differences in their quantitative interdependencies as well as their anatomical representations due to distinctive imaging mechanisms. In this study, we introduced a new method, joint connectivity matrix independent component analysis (cmICA), which provides a data‐driven parcellation and automated‐linking of SC and FC information simultaneously using a joint analysis of functional magnetic resonance imaging (MRI) and diffusion‐weighted MRI data. We showed that these two connectivity modalities produce common cortical segregation, though with various degrees of (dis)similarity. Moreover, we show conjoint FC networks and structural white matter tracts that directly link these cortical parcellations/sources, within one analysis. Overall, data‐driven joint cmICA provides a new approach for integrating or fusing structural connectivity and FC systematically and conveniently, and provides an effective tool for connectivity‐based multimodal data fusion in brain.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email