skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 11:00 PM ET on Friday, April 12 until 2:00 AM ET on Saturday, April 13 due to maintenance. We apologize for the inconvenience.

Title: Analysis of population functional connectivity data via multilayer network embeddings
Abstract Population analyses of functional connectivity have provided a rich understanding of how brain function differs across time, individual, and cognitive task. An important but challenging task in such population analyses is the identification of reliable features that describe the function of the brain, while accounting for individual heterogeneity. Our work is motivated by two particularly important challenges in this area: first, how can one analyze functional connectivity data over populations of individuals, and second, how can one use these analyses to infer group similarities and differences. Motivated by these challenges, we model population connectivity data as a multilayer network and develop the multi-node2vec algorithm, an efficient and scalable embedding method that automatically learns continuous node feature representations from multilayer networks. We use multi-node2vec to analyze resting state fMRI scans over a group of 74 healthy individuals and 60 patients with schizophrenia. We demonstrate how multilayer network embeddings can be used to visualize, cluster, and classify functional regions of the brain for these individuals. We furthermore compare the multilayer network embeddings of the two groups. We identify significant differences between the groups in the default mode network and salience network—findings that are supported by the triple network model theory of cognitive organization. Our findings reveal that multi-node2vec is a powerful and reliable method for analyzing multilayer networks. Data and publicly available code are available at .  more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Network Science
Page Range / eLocation ID:
99 to 122
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Although most dramatic structural changes occur in the perinatal period, a growing body of evidences demonstrates that adolescence and early adulthood are also important for substantial neurodevelopment. We were thus motivated to explore brain development during puberty by evaluating functional connectivity network (FCN) differences between childhood and young adulthood using multi‐paradigm task‐based functional magnetic resonance imaging (fMRI) measurements. Different from conventional multigraph based FCN construction methods where the graph network was built independently for each modality/paradigm, we proposed a multigraph learning model in this work. It promises a better fitting to FCN construction by jointly estimating brain network from multi‐paradigm fMRI time series, which may share common graph structures. To investigate the hub regions of the brain, we further conducted graph Fourier transform (GFT) to divide the fMRI BOLD time series of a node within the brain network into a range of frequencies. Then we identified the hub regions characterizing brain maturity through eigen‐analysis of the low frequency components, which were believed to represent the organized structures shared by a large population. The proposed method was evaluated using both synthetic and real data, which demonstrated its effectiveness in extracting informative brain connectivity patterns. We detected 14 hub regions from the child group and 12 hub regions from the young adult group. We show the significance of these findings with a discussion of their functions and activation patterns as a function of age. In summary, our proposed method can extract brain connectivity network more accurately by considering the latent common structures between different fMRI paradigms, which are significant for both understanding brain development and recognizing population groups of different ages.

    more » « less
  2. INTRODUCTION: Apollo-11 (A-11) was the first manned space mission to successfully bring astronauts to the moon and return them safely. Effective team based communications is required for mission specialists to work collaboratively to learn, engage, and solve complex problems. As part of NASA’s goal in assessing team and mission success, all vital speech communications between these personnel were recorded using the multi-track SoundScriber system onto analog tapes, preserving their contribution in the success of one of the greatest achievements in human history. More than +400 personnel served as mission specialists/support who communicated across 30 audio loops, resulting in +9k hours of data for A-11. To ensure success of this mission, it was necessary for teams to communicate, learn, and address problems in a timely manner. Previous research has found that compatibility of individual personalities within teams is important for effective team collaboration of those individuals. Hence, it is essential to identify each speaker’s role during an Apollo mission and analyze group communications for knowledge exchange and problem solving to achieve a common goal. Assessing and analyzing speaker roles during the mission can allow for exploring engagement analysis for multi-party speaker situations. METHOD: The UTDallas Fearless steps Apollo data is comprised of 19,000 hours (A-11,A-13,A-1) possessing unique and multiple challenges as it is characterized by severe noise and degradation as well as overlap instances over the 30 channels. For our study, we have selected a subset of 100 hours manually transcribed by professional annotators for speaker labels. The 100 hours are obtained from three mission critical events: 1. Lift-Off (25 hours) 2. Lunar-Landing (50 hours) 3. Lunar-Walking (25 hours). Five channels of interest, out of 30 channels were selected with the most speech activity, the primary speakers operating these five channels are command/owners of these channels. For our analysis, we select five speaker roles: Flight Director (FD), Capsule Communicator (CAPCOM), Guidance, Navigation and, Control (GNC), Electrical, environmental, and consumables manager (EECOM), and Network (NTWK). To track and tag individual speakers across our Fearless Steps audio dataset, we use the concept of ‘where’s Waldo’ to identify all instances of our speakers-of-interest across a cluster of other speakers. Also, to understand speaker roles of our speaker-of-interests, we use speaker duration of primary speaker vs secondary speaker and speaker turns as our metrics to determine the role of the speaker and to understand their responsibility during the three critical phases of the mission. This enables a content linking capability as well as provide a pathway to analyzing group engagement, group dynamics of people working together in an enclosed space, psychological effects, and cognitive analysis in such individuals. IMPACT: NASA’s Apollo Program stands as one of the most significant contributions to humankind. This collection opens new research options for recognizing team communication, group dynamics, and human engagement/psychology for future deep space missions. Analyzing team communications to achieve such goals would allow for the formulation of educational and training technologies for assessment of STEM knowledge, task learning, and educational feedback. Also, identifying these personnel can help pay tribute and yield personal recognition to the hundreds of notable engineers and scientist who made this feat possible. ILLUSTRATION: In this work, we propose to illustrate how a pre-trained speech/language network can be used to obtain powerful speaker embeddings needed for speaker diarization. This framework is used to build these learned embeddings to label unique speakers over sustained audio streams. To train and test our system, we will make use of Fearless Steps Apollo corpus, allowing us to effectively leverage a limited label information resource (100 hours of labeled data out of +9000 hours). Furthermore, we use the concept of 'Finding Waldo' to identify key speakers of interest (SOI) throughout the Apollo-11 mission audio across multiple channel audio streams. 
    more » « less
  3. The amygdala is central to the pathophysiology of many psychiatric illnesses. An imprecise understanding of how the amygdala fits into the larger network organization of the human brain, however, limits our ability to create models of dysfunction in individual patients to guide personalized treatment. Therefore, we investigated the position of the amygdala and its functional subdivisions within the network organization of the brain in 10 highly sampled individuals (5 h of fMRI data per person). We characterized three functional subdivisions within the amygdala of each individual. We discovered that one subdivision is preferentially correlated with the default mode network; a second is preferentially correlated with the dorsal attention and fronto-parietal networks; and third subdivision does not have any networks to which it is preferentially correlated relative to the other two subdivisions. All three subdivisions are positively correlated with ventral attention and somatomotor networks and negatively correlated with salience and cingulo-opercular networks. These observations were replicated in an independent group dataset of 120 individuals. We also found substantial across-subject variation in the distribution and magnitude of amygdala functional connectivity with the cerebral cortex that related to individual differences in the stereotactic locations both of amygdala subdivisions and of cortical functional brain networks. Finally, using lag analyses, we found consistent temporal ordering of fMRI signals in the cortex relative to amygdala subdivisions. Altogether, this work provides a detailed framework of amygdala–cortical interactions that can be used as a foundation for models relating aberrations in amygdala connectivity to psychiatric symptoms in individual patients.

    more » « less
  4. null (Ed.)
    In this paper, we propose a supervised graph representation learning method to model the relationship between brain functional connectivity (FC) and structural connectivity (SC) through a graph encoder-decoder system. The graph convolutional network (GCN) model is leveraged in the encoder to learn lower-dimensional node representations (i.e. node embeddings) integrating information from both node attributes and network topology. In doing so, the encoder manages to capture both direct and indirect interactions between brain regions in the node embeddings which later help reconstruct empirical FC networks. From node embeddings, graph representations are learnt to embed the entire graphs into a vector space. Our end-to-end model utilizes a multi-objective loss function to simultaneously learn node representations for FC network reconstruction and graph representations for subject classification. The experiment on a large population of non-drinkers and heavy drinkers shows that our model can provide a characterization of the population pattern in the SC-FC relationship, while also learning features that capture individual uniqueness for subject classification. The identified key brain subnetworks show significant between-group difference and support the promising prospect of GCN-based graph representation learning on brain networks to model human brain activity and function. 
    more » « less
  5. Abstract

    Patterns of whole-brain fMRI functional connectivity, or connectomes, are unique to individuals. Previous work has identified subsets of functional connections within these patterns whose strength predicts aspects of attention and cognition. However, overall features of these connectomes, such as how stable they are over time and how similar they are to a group-average (typical) or high-performance (optimal) connectivity pattern, may also reflect cognitive and attentional abilities. Here, we test whether individuals who express more stable, typical, optimal, and distinctive patterns of functional connectivity perform better on cognitive tasks using data from three independent samples. We find that individuals with more stable task-based functional connectivity patterns perform better on attention and working memory tasks, even when controlling for behavioral performance stability. Additionally, we find initial evidence that individuals with more typical and optimal patterns of functional connectivity also perform better on these tasks. These results demonstrate that functional connectome stability within individuals and similarity across individuals predicts individual differences in cognition.

    more » « less