skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Merging fNIRS-EEG Brain Monitoring and Body Motion Capture to Distinguish Parkinson’s Disease
Functional connectivity between the brain and body kinematics has largely not been investigated due to the requirement of motionlessness in neuroimaging techniques such as functional magnetic resonance imaging (fMRI). However, this connectivity is disrupted in many neurodegenerative disorders, including Parkinson’s Disease (PD), a neurological progressive disorder characterized by movement symptoms including slowness of movement, stiffness, tremors at rest, and walking and standing instability. In this study, brain activity is recorded through functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), and body kinematics were captured by a motion capture system (Mocap) based on an inertial measurement unit (IMU) for gross movements (large movements such as limb kinematics), and the WearUp glove for fine movements (small range movements such as finger kinematics). PD and neurotypical (NT) participants were recruited to perform 8 different movement tasks. The recorded data from each modality have been analyzed individually, and the processed data has been used for classification between the PD and NT groups. The average changes in oxygenated hemoglobin (HbO2) from fNIRS, EEG power spectral density in the Theta, Alpha, and Beta bands, acceleration vector from Mocap, and normalized WearUp flex sensor data were used for classification. 12 different support vector machine (SVM) classifiers have been used on different datasets such as only fNIRS data, only EEG data, hybrid fNIRS/EEG data, and all the fused data for two classification scenarios: classifying PD and NT based on individual activities, and all activity data fused together. The PD and NT group could be distinguished with more than 83% accuracy for each individual activity. For all the fused data, the PD and NT groups are classified with 81.23%, 92.79%, 92.27%, and 93.40% accuracy for the fNIRS only, EEG only, hybrid fNIRS/EEG, and all fused data, respectively. The results indicate that the overall performance of classification in distinguishing PD and NT groups improves when using both brain and body data.  more » « less
Award ID(s):
1652538
PAR ID:
10154597
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
IEEE Transactions on Neural Systems and Rehabilitation Engineering
ISSN:
1534-4320
Page Range / eLocation ID:
1 to 1
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract Objective. Transcutaneous spinal cord stimulation (TSS) has been shown to be a promising non-invasive alternative to epidural spinal cord stimulation for improving outcomes of people with spinal cord injury (SCI). However, studies on the effects of TSS on cortical activation are limited. Our objectives were to evaluate the spatiotemporal effects of TSS on brain activity, and determine changes in functional connectivity under several different stimulation conditions. As a control, we also assessed the effects of functional electrical stimulation (FES) on cortical activity. Approach . Non-invasive scalp electroencephalography (EEG) was recorded during TSS or FES while five neurologically intact participants performed one of three lower-limb tasks while in the supine position: (1) A no contraction control task, (2) a rhythmic contraction task, or (3) a tonic contraction task. After EEG denoising and segmentation, independent components (ICs) were clustered across subjects to characterize sensorimotor networks in the time and frequency domains. ICs of the event related potentials (ERPs) were calculated for each cluster and condition. Next, a Generalized Partial Directed Coherence (gPDC) analysis was performed on each cluster to compare the functional connectivity between conditions and tasks. Main results . IC analysis of EEG during TSS resulted in three clusters identified at Brodmann areas (BA) 9, BA 6, and BA 4, which are areas associated with working memory, planning, and movement control. Lastly, we found significant ( p  < 0.05, adjusted for multiple comparisons) increases and decreases in functional connectivity of clusters during TSS, but not during FES when compared to the no stimulation conditions. Significance. The findings from this study provide evidence of how TSS recruits cortical networks during tonic and rhythmic lower limb movements. These results have implications for the development of spinal cord-based computer interfaces, and the design of neural stimulation devices for the treatment of pain and sensorimotor deficit. 
    more » « less
  2. The prospect of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) in the presence of topological information of participants is often left unexplored in most of the brain-computer interface (BCI) systems. Additionally, the usage of these modalities together in the field of multimodality analysis to support multiple brain signals toward improving BCI performance is not fully examined. This study first presents a multimodal data fusion framework to exploit and decode the complementary synergistic properties in multimodal neural signals. Moreover, the relations among different subjects and their observations also play critical roles in classifying unknown subjects. We developed a context-aware graph neural network (GNN) model utilizing the pairwise relationship among participants to investigate the performance on an auditory task classification. We explored standard and deviant auditory EEG and fNIRS data where each subject was asked to perform an auditory oddball task and has multiple trials regarded as context-aware nodes in our graph construction. In experiments, our multimodal data fusion strategy showed an improvement up to 8.40% via SVM and 2.02% via GNN, compared to the single-modal EEG or fNIRS. In addition, our context-aware GNN achieved 5.3%, 4.07% and 4.53% higher accuracy for EEG, fNIRS and multimodal data based experiments, compared to the baseline models. 
    more » « less
  3. The goal of this paper is to use graph theory network measures derived from non-invasive electroencephalography (EEG) to develop neural decoders that can differentiate Parkinson's disease (PD) patients from healthy controls (HC). EEG signals from 27 patients and 27 demographically matched controls from New Mexico were analyzed by estimating their functional networks. Data recorded from the patients during ON and OFF levodopa sessions were included in the analysis for comparison. We used betweenness centrality of estimated functional networks to classify the HC and PD groups. The classifiers were evaluated using leave-one-out cross-validation. We observed that the PD patients (on and off medication) could be distinguished from healthy controls with 89% accuracy – approximately 4% higher than the state-of-the-art on the same dataset. This work shows that brain network analysis using extracranial resting-state EEG can discover patterns of interactions indicative of PD. This approach can also be extended to other neurological disorders. 
    more » « less
  4. Abstract Objective. Spontaneous fluctuations of cerebral hemodynamics measured by functional magnetic resonance imaging (fMRI) are widely used to study the network organization of the brain. The temporal correlations among the ultra-slow, <0.1 Hz fluctuations across the brain regions are interpreted as functional connectivity maps and used for diagnostics of neurological disorders. However, despite the interest narrowed in the ultra-slow fluctuations, hemodynamic activity that exists beyond the ultra-slow frequency range could contribute to the functional connectivity, which remains unclear.Approach. In the present study, we have measured the brain-wide hemodynamics in the human participants with functional near-infrared spectroscopy (fNIRS) in a whole-head, cap-based and high-density montage at a sampling rate of 6.25 Hz. In addition, we have acquired resting state fMRI scans in the same group of participants for cross-modal evaluation of the connectivity maps. Then fNIRS data were deliberately down-sampled to a typical fMRI sampling rate of ∼0.5 Hz and the resulted differential connectivity maps were subject to a k-means clustering.Main results. Our diffuse optical topographical analysis of fNIRS data have revealed a default mode network (DMN) in the spontaneous deoxygenated and oxygenated hemoglobin changes, which remarkably resemble the same fMRI network derived from participants. Moreover, we have shown that the aliased activities in the down-sampled optical signals have altered the connectivity patterns, resulting in a network organization of aliased functional connectivity in the cerebral hemodynamics.Significance.The results have for the first time demonstrated that fNIRS as a broadly accessible modality can image the resting-state functional connectivity in the posterior midline, prefrontal and parietal structures of the DMN in the human brain, in a consistent pattern with fMRI. Further empowered by the fast sampling rate of fNIRS, our findings suggest the presence of aliased connectivity in the current understanding of the human brain organization. 
    more » « less
  5. Multimodal data fusion is one of the current primary neuroimaging research directions to overcome the fundamental limitations of individual modalities by exploiting complementary information from different modalities. Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) are especially compelling modalities due to their potentially complementary features reflecting the electro-hemodynamic characteristics of neural responses. However, the current multimodal studies lack a comprehensive systematic approach to properly merge the complementary features from their multimodal data. Identifying a systematic approach to properly fuse EEG-fNIRS data and exploit their complementary potential is crucial in improving performance. This paper proposes a framework for classifying fused EEG-fNIRS data at the feature level, relying on a mutual information-based feature selection approach with respect to the complementarity between features. The goal is to optimize the complementarity, redundancy and relevance between multimodal features with respect to the class labels as belonging to a pathological condition or healthy control. Nine amyotrophic lateral sclerosis (ALS) patients and nine controls underwent multimodal data recording during a visuo-mental task. Multiple spectral and temporal features were extracted and fed to a feature selection algorithm followed by a classifier, which selected the optimized subset of features through a cross-validation process. The results demonstrated considerably improved hybrid classification performance compared to the individual modalities and compared to conventional classification without feature selection, suggesting a potential efficacy of our proposed framework for wider neuro-clinical applications. 
    more » « less