skip to main content


Title: Experimental Exploration of Objective Human Pain Assessment Using Multimodal Sensing Signals
Optimization of pain assessment and treatment is an active area of research in healthcare. The purpose of this research is to create an objective pain intensity estimation system based on multimodal sensing signals through experimental studies. Twenty eight healthy subjects were recruited at Northeastern University. Nine physiological modalities were utilized in this research, namely facial expressions (FE), electroencephalography (EEG), eye movement (EM), skin conductance (SC), and blood volume pulse (BVP), electromyography (EMG), respiration rate (RR), skin temperature (ST), blood pressure (BP). Statistical analysis and machine learning algorithms were deployed to analyze the physiological data. FE, EEG, SC, BVP, and BP proved to be able to detect different pain states from healthy subjects. Multi-modalities proved to be promising in detecting different levels of painful states. A decision-level multi-modal fusion also proved to be efficient and accurate in classifying painful states.  more » « less
Award ID(s):
1838796 1838621
NSF-PAR ID:
10343698
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Frontiers in Neuroscience
Volume:
16
ISSN:
1662-453X
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. In an attempt to understand human physiological signals when an individual is subjected to pain, we set up a tonic pain experiment in a laboratory setting. The subjects’ physiological signals were recorded, timestamped, and compared to an initial 30 second baseline measurement. Subjects were also asked to verbally state their level of pain based on a visual analog scale in order to compare reported pain levels with physiological signals. The physiological signals measured were: Electroencephalography (EEG), Pupillary Unrest Under Ambient Light (PUAL), Skin Conductance (SC), Electromyography (EMG), Respiration Rate (RR), Blood Volume Pulse (BVP), Skin Temperature (ST), Blood Pressure (BP), and Facial Expression (FE). ANOVA and frequency domain analyses were conducted on the data in order to determine whether there was a significant difference between the ‘pain’ and ‘no pain’ (baseline) states of an individual. Based on our results, skin conductance, PUAL, facial expression, and EEG signals were theorized to be good signals for the classification of tonic pain, or any pain applied directly to an individual.

     
    more » « less
  2. Objective: Accurate implementation of real-time non-invasive Brain-Machine / Computer Interfaces (BMI / BCI) requires handling physiological and non-physiological artifacts associated with the measurement modalities. For example, scalp electroencephalographic (EEG) measurements are often considered prone to excessive motion artifacts and other types of artifacts that contaminate the EEG recordings. Although the magnitude of such artifacts heavily depends on the task and the setup, complete minimization or isolation of such artifacts is generally not possible. Approach: We present an adaptive de-noising framework with robustness properties, using a Volterra based non-linear mapping to characterize and handle the motion artifact contamination in EEG measurements. We asked healthy able-bodied subjects to walk on a treadmill at gait speeds of 1-to-4 mph, while we tracked the motion of select EEG electrodes with an infrared video-based motion tracking system. We also placed Inertial Measurement Unit (IMU) sensors on the forehead and feet of the subjects for assessing the overall head movement and segmenting the gait. Main Results: We discuss in detail the characteristics of the motion artifacts and propose a real-time compatible solution to filter them. We report the effective handling of both the fundamental frequency of contamination (synchronized to the walking speed) and its harmonics. Event-Related Spectral Perturbation (ERSP) analysis for walking shows that the gait dependency of artifact contamination is also eliminated on all target frequencies. Significance: The real-time compatibility and generalizability of our adaptive filtering framework allows for the effective use of non-invasive BMI/BCI systems and greatly expands the implementation type and application domains to other types of problems where signal denoising is desirable. Combined with our previous efforts of filtering ocular artifacts, the presented technique allows for a comprehensive adaptive filtering framework to increase the EEG Signal to Noise Ratio (SNR). We believe the implementation will benefit all non-invasive neural measurement modalities, including studies discussing neural correlates of movement and other internal states, not necessarily of BMI focus. 
    more » « less
  3. null (Ed.)
    We have tested the feasibility of thermal grills, a harmless method to induce pain. The thermal grills consist of interlaced tubes that are set at cool or warm temperatures, creating a painful “illusion” (no tissue injury is caused) in the brain when the cool and warm stimuli are presented collectively. Advancement in objective pain assessment research is limited because the gold standard, the self-reporting pain scale, is highly subjective and only works for alert and cooperative patients. However, the main difficulty for pain studies is the potential harm caused to participants. We have recruited 23 subjects in whom we induced electric pulses and thermal grill (TG) stimulation. The TG effectively induced three different levels of pain, as evidenced by the visual analog scale (VAS) provided by the subjects after each stimulus. Furthermore, objective physiological measurements based on electrodermal activity showed a significant increase in levels as stimulation level increased. We found that VAS was highly correlated with the TG stimulation level. The TG stimulation safely elicited pain levels up to 9 out of 10. The TG stimulation allows for extending studies of pain to ranges of pain in which other stimuli are harmful. 
    more » « less
  4. Abstract

    Objective.Reorienting is central to how humans direct attention to different stimuli in their environment. Previous studies typically employ well-controlled paradigms with limited eye and head movements to study the neural and physiological processes underlying attention reorienting. Here, we aim to better understand the relationship between gaze and attention reorienting using a naturalistic virtual reality (VR)-based target detection paradigm.Approach.Subjects were navigated through a city and instructed to count the number of targets that appeared on the street. Subjects performed the task in a fixed condition with no head movement and in a free condition where head movements were allowed. Electroencephalography (EEG), gaze and pupil data were collected. To investigate how neural and physiological reorienting signals are distributed across different gaze events, we used hierarchical discriminant component analysis (HDCA) to identify EEG and pupil-based discriminating components. Mixed-effects general linear models (GLM) were used to determine the correlation between these discriminating components and the different gaze events time. HDCA was also used to combine EEG, pupil and dwell time signals to classify reorienting events.Main results.In both EEG and pupil, dwell time contributes most significantly to the reorienting signals. However, when dwell times were orthogonalized against other gaze events, the distributions of the reorienting signals were different across the two modalities, with EEG reorienting signals leading that of the pupil reorienting signals. We also found that the hybrid classifier that integrates EEG, pupil and dwell time features detects the reorienting signals in both the fixed (AUC = 0.79) and the free (AUC = 0.77) condition.Significance.We show that the neural and ocular reorienting signals are distributed differently across gaze events when a subject is immersed in VR, but nevertheless can be captured and integrated to classify target vs. distractor objects to which the human subject orients.

     
    more » « less
  5. Isenberg, Jeffrey S (Ed.)
    Different levels of arterial occlusive disease (aortoiliac, femoropopliteal, multi-level disease) can produce claudication symptoms in different leg muscle groups (buttocks, thighs, calves) in patients with peripheral artery disease (PAD). We tested the hypothesis that different locations of occlusive disease uniquely affect the muscles of PAD legs and produce distinctive patterns in the way claudicating patients walk. Ninety-seven PAD patients and 35 healthy controls were recruited. PAD patients were categorized to aortoiliac, femoropopliteal and multi-level disease groups using computerized tomographic angiography. Subjects performed walking trials both pain-free and during claudication pain and joint kinematics, kinetics, and spatiotemporal parameters were calculated to evaluate the net contribution of the calf, thigh and buttock muscles. PAD patients with occlusive disease affecting different segments of the arterial tree (aortoiliac, femoropopliteal, multi-level disease) presented with symptoms affecting different muscle groups of the lower extremity (calves, thighs and buttocks alone or in combination). However, no significant biomechanical differences were found between PAD groups during the pain-free conditions with minimal differences between PAD groups in the claudicating state. All statistical differences in the pain-free condition occurred between healthy controls and one or more PAD groups. A discriminant analysis function was able to adequately predict if a subject was a control with over 70% accuracy, but the function was unable to differentiate between PAD groups. In-depth gait analyses of claudicating PAD patients indicate that different locations of arterial disease produce claudication symptoms that affect different muscle groups across the lower extremity but impact the function of the leg muscles in a diffuse manner generating similar walking impairments. 
    more » « less