skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Consecutive Independence and Correlation Transform for Multimodal Data Fusion: Discovery of One-to-Many Associations in Structural and Functional Imaging Data
Title: Consecutive Independence and Correlation Transform for Multimodal Data Fusion: Discovery of One-to-Many Associations in Structural and Functional Imaging Data
Brain signals can be measured using multiple imaging modalities, such as magnetic resonance imaging (MRI)-based techniques. Different modalities convey distinct yet complementary information; thus, their joint analyses can provide valuable insight into how the brain functions in both healthy and diseased conditions. Data-driven approaches have proven most useful for multimodal fusion as they minimize assumptions imposed on the data, and there are a number of methods that have been developed to uncover relationships across modalities. However, none of these methods, to the best of our knowledge, can discover “one-to-many associations”, meaning one component from one modality is linked with more than one component from another modality. However, such “one-to-many associations” are likely to exist, since the same brain region can be involved in multiple neurological processes. Additionally, most existing data fusion methods require the signal subspace order to be identical for all modalities—a severe restriction for real-world data of different modalities. Here, we propose a new fusion technique—the consecutive independence and correlation transform (C-ICT) model—which successively performs independent component analysis and independent vector analysis and is uniquely flexible in terms of the number of datasets, signal subspace order, and the opportunity to find “one-to-many associations”. We apply C-ICT to fuse diffusion MRI, structural MRI, and functional MRI datasets collected from healthy controls (HCs) and patients with schizophrenia (SZs). We identify six interpretable triplets of components, each of which consists of three associated components from the three modalities. Besides, components from these triplets that show significant group differences between the HCs and SZs are identified, which could be seen as putative biomarkers in schizophrenia.  more » « less
Award ID(s):
1631838
PAR ID:
10388431
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Applied Sciences
Volume:
11
Issue:
18
ISSN:
2076-3417
Page Range / eLocation ID:
8382
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; ; (, Human Brain Mapping)
    ABSTRACT With the increasing availability of large‐scale multimodal neuroimaging datasets, it is necessary to develop data fusion methods which can extract cross‐modal features. A general framework, multidataset independent subspace analysis (MISA), has been developed to encompass multiple blind source separation approaches and identify linked cross‐modal sources in multiple datasets. In this work, we utilized the multimodal independent vector analysis (MMIVA) model in MISA to directly identify meaningful linked features across three neuroimaging modalities—structural magnetic resonance imaging (MRI), resting state functional MRI and diffusion MRI—in two large independent datasets, one comprising of control subjects and the other including patients with schizophrenia. Results show several linked subject profiles (sources) that capture age‐associated decline, schizophrenia‐related biomarkers, sex effects, and cognitive performance. For sources associated with age, both shared and modality‐specific brain‐age deltas were evaluated for association with non‐imaging variables. In addition, each set of linked sources reveals a corresponding set of cross‐modal spatial patterns that can be studied jointly. We demonstrate that the MMIVA fusion model can identify linked sources across multiple modalities, and that at least one set of linked, age‐related sources replicates across two independent and separately analyzed datasets. The same set also presented age‐adjusted group differences, with schizophrenia patients indicating lower multimodal source levels. Linked sets associated with sex and cognition are also reported for the UK Biobank dataset. 
    more » « less
  2. ; ; ; (, Sensors)
    It is becoming increasingly common to collect multiple related neuroimaging datasets either from different modalities or from different tasks and conditions. In addition, we have non-imaging data such as cognitive or behavioral variables, and it is through the association of these two sets of data—neuroimaging and non-neuroimaging—that we can understand and explain the evolution of neural and cognitive processes, and predict outcomes for intervention and treatment. Multiple methods for the joint analysis or fusion of multiple neuroimaging datasets or modalities exist; however, methods for the joint analysis of imaging and non-imaging data are still in their infancy. Current approaches for identifying brain networks related to cognitive assessments are still largely based on simple one-to-one correlation analyses and do not use the cross information available across multiple datasets. This work proposes two approaches based on independent vector analysis (IVA) to jointly analyze the imaging datasets and behavioral variables such that multivariate relationships across imaging data and behavioral features can be identified. The simulation results show that our proposed methods provide better accuracy in identifying associations across imaging and behavioral components than current approaches. With functional magnetic resonance imaging (fMRI) task data collected from 138 healthy controls and 109 patients with schizophrenia, results reveal that the central executive network (CEN) estimated in multiple datasets shows a strong correlation with the behavioral variable that measures working memory, a result that is not identified by traditional approaches. Most of the identified fMRI maps also show significant differences in activations across healthy controls and patients potentially providing a useful signature of mental disorders. 
    more » « less
  3. ; ; ; ; ; (, IEEE)
    Large amounts of neuroimaging and omics data have been generated for studies of mental health. Collaborations among research groups that share data have shown increased power for new discoveries of brain abnormalities, genetic mutations, and associations among genetics, neuroimaging and behavior. However, sharing raw data can be challenging for various reasons. A federated data analysis allowing for collaboration without exposing the raw dataset of each site becomes ideal. Following this strategy, a decentralized parallel independent component analysis (dpICA) is proposed in this study which is an extension of the state-of-art Parallel ICA (pICA). pICA is an effective method to analyze two data modalities simultaneously by jointly extracting independent components of each modality and maximizing connections between modalities. We evaluated the dpICA algorithm using neuroimage and genetic data from patients with schizophrenia and health controls, and compared its performances under various conditions with the centralized pICA. The results showed dpICA is robust to sample distribution across sites as long as numbers of samples in each site are sufficient. It can produce the same imaging and genetic components and the same connections between those components as the centralized pICA. Thus our study supports dpICA is an accurate and effective decentralized algorithm to extract connections from two data modalities. 
    more » « less
  4. ; (, Human Brain Mapping)
    Abstract The study of human brain connectivity, including structural connectivity (SC) and functional connectivity (FC), provides insights into the neurophysiological mechanism of brain function and its relationship to human behavior and cognition. Both types of connectivity measurements provide crucial yet complementary information. However, integrating these two modalities into a single framework remains a challenge, because of the differences in their quantitative interdependencies as well as their anatomical representations due to distinctive imaging mechanisms. In this study, we introduced a new method, joint connectivity matrix independent component analysis (cmICA), which provides a data‐driven parcellation and automated‐linking of SC and FC information simultaneously using a joint analysis of functional magnetic resonance imaging (MRI) and diffusion‐weighted MRI data. We showed that these two connectivity modalities produce common cortical segregation, though with various degrees of (dis)similarity. Moreover, we show conjoint FC networks and structural white matter tracts that directly link these cortical parcellations/sources, within one analysis. Overall, data‐driven joint cmICA provides a new approach for integrating or fusing structural connectivity and FC systematically and conveniently, and provides an effective tool for connectivity‐based multimodal data fusion in brain. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; ; et al (, Frontiers in Neural Circuits)
    Background: Schizophrenia affects around 1% of the global population. Functional connectivity extracted from resting-state functional magnetic resonance imaging (rs-fMRI) has previously been used to study schizophrenia and has great potential to provide novel insights into the disorder. Some studies have shown abnormal functional connectivity in the default mode network (DMN) of individuals with schizophrenia, and more recent studies have shown abnormal dynamic functional connectivity (dFC) in individuals with schizophrenia. However, DMN dFC and the link between abnormal DMN dFC and symptom severity have not been well-characterized. Method: Resting-state fMRI data from subjects with schizophrenia (SZ) and healthy controls (HC) across two datasets were analyzed independently. We captured seven maximally independent subnodes in the DMN by applying group independent component analysis and estimated dFC between subnode time courses using a sliding window approach. A clustering method separated the dFCs into five reoccurring brain states. A feature selection method modeled the difference between SZs and HCs using the state-specific FC features. Finally, we used the transition probability of a hidden Markov model to characterize the link between symptom severity and dFC in SZ subjects. Results: We found decreases in the connectivity of the anterior cingulate cortex (ACC) and increases in the connectivity between the precuneus (PCu) and the posterior cingulate cortex (PCC) (i.e., PCu/PCC) of SZ subjects. In SZ, the transition probability from a state with weaker PCu/PCC and stronger ACC connectivity to a state with stronger PCu/PCC and weaker ACC connectivity increased with symptom severity. Conclusions: To our knowledge, this was the first study to investigate DMN dFC and its link to schizophrenia symptom severity. We identified reproducible neural states in a data-driven manner and demonstrated that the strength of connectivity within those states differed between SZs and HCs. Additionally, we identified a relationship between SZ symptom severity and the dynamics of DMN functional connectivity. We validated our results across two datasets. These results support the potential of dFC for use as a biomarker of schizophrenia and shed new light upon the relationship between schizophrenia and DMN dynamics. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email