Abstract Objective. Transcutaneous spinal cord stimulation (TSS) has been shown to be a promising non-invasive alternative to epidural spinal cord stimulation for improving outcomes of people with spinal cord injury (SCI). However, studies on the effects of TSS on cortical activation are limited. Our objectives were to evaluate the spatiotemporal effects of TSS on brain activity, and determine changes in functional connectivity under several different stimulation conditions. As a control, we also assessed the effects of functional electrical stimulation (FES) on cortical activity. Approach . Non-invasive scalp electroencephalography (EEG) was recorded during TSS or FES while five neurologically intact participants performed one of three lower-limb tasks while in the supine position: (1) A no contraction control task, (2) a rhythmic contraction task, or (3) a tonic contraction task. After EEG denoising and segmentation, independent components (ICs) were clustered across subjects to characterize sensorimotor networks in the time and frequency domains. ICs of the event related potentials (ERPs) were calculated for each cluster and condition. Next, a Generalized Partial Directed Coherence (gPDC) analysis was performed on each cluster to compare the functional connectivity between conditions and tasks. Main results . IC analysis of EEG during TSS resulted in three clusters identified at Brodmann areas (BA) 9, BA 6, and BA 4, which are areas associated with working memory, planning, and movement control. Lastly, we found significant ( p < 0.05, adjusted for multiple comparisons) increases and decreases in functional connectivity of clusters during TSS, but not during FES when compared to the no stimulation conditions. Significance. The findings from this study provide evidence of how TSS recruits cortical networks during tonic and rhythmic lower limb movements. These results have implications for the development of spinal cord-based computer interfaces, and the design of neural stimulation devices for the treatment of pain and sensorimotor deficit.
more »
« less
Merging fNIRS-EEG Brain Monitoring and Body Motion Capture to Distinguish Parkinson’s Disease
Functional connectivity between the brain and body kinematics has largely not been investigated due to the requirement of motionlessness in neuroimaging techniques such as functional magnetic resonance imaging (fMRI). However, this connectivity is disrupted in many neurodegenerative disorders, including Parkinson’s Disease (PD), a neurological progressive disorder characterized by movement symptoms including slowness of movement, stiffness, tremors at rest, and walking and standing instability. In this study, brain activity is recorded through functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG), and body kinematics were captured by a motion capture system (Mocap) based on an inertial measurement unit (IMU) for gross movements (large movements such as limb kinematics), and the WearUp glove for fine movements (small range movements such as finger kinematics). PD and neurotypical (NT) participants were recruited to perform 8 different movement tasks. The recorded data from each modality have been analyzed individually, and the processed data has been used for classification between the PD and NT groups. The average changes in oxygenated hemoglobin (HbO2) from fNIRS, EEG power spectral density in the Theta, Alpha, and Beta bands, acceleration vector from Mocap, and normalized WearUp flex sensor data were used for classification. 12 different support vector machine (SVM) classifiers have been used on different datasets such as only fNIRS data, only EEG data, hybrid fNIRS/EEG data, and all the fused data for two classification scenarios: classifying PD and NT based on individual activities, and all activity data fused together. The PD and NT group could be distinguished with more than 83% accuracy for each individual activity. For all the fused data, the PD and NT groups are classified with 81.23%, 92.79%, 92.27%, and 93.40% accuracy for the fNIRS only, EEG only, hybrid fNIRS/EEG, and all fused data, respectively. The results indicate that the overall performance of classification in distinguishing PD and NT groups improves when using both brain and body data.
more »
« less
- Award ID(s):
- 1652538
- PAR ID:
- 10154597
- Date Published:
- Journal Name:
- IEEE Transactions on Neural Systems and Rehabilitation Engineering
- ISSN:
- 1534-4320
- Page Range / eLocation ID:
- 1 to 1
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The prospect of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) in the presence of topological information of participants is often left unexplored in most of the brain-computer interface (BCI) systems. Additionally, the usage of these modalities together in the field of multimodality analysis to support multiple brain signals toward improving BCI performance is not fully examined. This study first presents a multimodal data fusion framework to exploit and decode the complementary synergistic properties in multimodal neural signals. Moreover, the relations among different subjects and their observations also play critical roles in classifying unknown subjects. We developed a context-aware graph neural network (GNN) model utilizing the pairwise relationship among participants to investigate the performance on an auditory task classification. We explored standard and deviant auditory EEG and fNIRS data where each subject was asked to perform an auditory oddball task and has multiple trials regarded as context-aware nodes in our graph construction. In experiments, our multimodal data fusion strategy showed an improvement up to 8.40% via SVM and 2.02% via GNN, compared to the single-modal EEG or fNIRS. In addition, our context-aware GNN achieved 5.3%, 4.07% and 4.53% higher accuracy for EEG, fNIRS and multimodal data based experiments, compared to the baseline models.more » « less
-
Abstract Objective . Spontaneous fluctuations of cerebral hemodynamics measured by functional magnetic resonance imaging (fMRI) are widely used to study the network organization of the brain. The temporal correlations among the ultra-slow, <0.1 Hz fluctuations across the brain regions are interpreted as functional connectivity maps and used for diagnostics of neurological disorders. However, despite the interest narrowed in the ultra-slow fluctuations, hemodynamic activity that exists beyond the ultra-slow frequency range could contribute to the functional connectivity, which remains unclear. Approach . In the present study, we have measured the brain-wide hemodynamics in the human participants with functional near-infrared spectroscopy (fNIRS) in a whole-head, cap-based and high-density montage at a sampling rate of 6.25 Hz. In addition, we have acquired resting state fMRI scans in the same group of participants for cross-modal evaluation of the connectivity maps. Then fNIRS data were deliberately down-sampled to a typical fMRI sampling rate of ∼0.5 Hz and the resulted differential connectivity maps were subject to a k-means clustering. Main results . Our diffuse optical topographical analysis of fNIRS data have revealed a default mode network (DMN) in the spontaneous deoxygenated and oxygenated hemoglobin changes, which remarkably resemble the same fMRI network derived from participants. Moreover, we have shown that the aliased activities in the down-sampled optical signals have altered the connectivity patterns, resulting in a network organization of aliased functional connectivity in the cerebral hemodynamics. Significance. The results have for the first time demonstrated that fNIRS as a broadly accessible modality can image the resting-state functional connectivity in the posterior midline, prefrontal and parietal structures of the DMN in the human brain, in a consistent pattern with fMRI. Further empowered by the fast sampling rate of fNIRS, our findings suggest the presence of aliased connectivity in the current understanding of the human brain organization.more » « less
-
The goal of this paper is to use graph theory network measures derived from non-invasive electroencephalography (EEG) to develop neural decoders that can differentiate Parkinson's disease (PD) patients from healthy controls (HC). EEG signals from 27 patients and 27 demographically matched controls from New Mexico were analyzed by estimating their functional networks. Data recorded from the patients during ON and OFF levodopa sessions were included in the analysis for comparison. We used betweenness centrality of estimated functional networks to classify the HC and PD groups. The classifiers were evaluated using leave-one-out cross-validation. We observed that the PD patients (on and off medication) could be distinguished from healthy controls with 89% accuracy – approximately 4% higher than the state-of-the-art on the same dataset. This work shows that brain network analysis using extracranial resting-state EEG can discover patterns of interactions indicative of PD. This approach can also be extended to other neurological disorders.more » « less
-
Dataset files related to the paper ULTRA-MoCap: A Multimodal IMU and sEMG Dataset for Upper Body Joint Kinematics AnalysisAuthors:Oliver Fritsche, Steven Camacho, Md Sanzid Bin Hossain, Tyler Halpenny, Carlos Archniegas, Joseph Dranetz, Dexter Hadley, Zhishan Guo, and Hwan ChoiAbstract: Predicting human kinematics from multi-modal sensor data has applications in rehabilitation, sports analysis, assistive device control, and human-computer interaction, offering less intrusive alternatives to camera-based motion capture (MoCap) systems. However, current datasets often lack comprehensive multi-modal data integrating both IMU and sEMG sensors, with limited coverage for upper limb kinematics and insufficient capture of high-fidelity muscle activation and joint dynamics, especially for complex shoulder and elbow movements. These limitations impede the development of robust models for advanced applications. To address these gaps, we introduce the Upper Limb Tracking with Multi-modal Capture (ULTra-MoCap) dataset. It includes IMUs on the hand, wrist, and forearm, and combined sEMG/IMU sensors on the biceps brachii, triceps brachii, and deltoid, enabling detailed tracking of multiple degrees of freedom upper limb kinematics. Data was collected from 13 healthy subjects using Vicon Vero motion capture cameras and Delsys Trigno sEMG/IMU sensors with various upper limb movements. This paper details the data collection, sensor placement, and processing pipeline, establishing ULTRA-MoCap as a benchmark for deep learning applications.________________________________________________________ULTra-MoCap-processed contains already processed data reading for downstream deep learning.ULTra-MoCap-raw contains subjects [1-6](0) and [7-13](1) raw data for reproducibility._________________________________________________________________more » « less
An official website of the United States government

