skip to main content


Title: An Objective System for Quantifying the Effect of Cognitive Load on Movement in Individuals with Autism Spectrum Disorder
For someone with Autism Spectrum Disorder, performance on tasks that require coordinated motor and cognitive activities, such as walking while talking (or texting) on our phones, can take substantially more effort to accomplish. While it is more common to isolate and examine motor and cognitive skill in separate experiments, we propose a dual task experiment to allow us to examine performance in people with autism more realistically. We designed a system composed of three task types and accompanying hardware to simultaneously quantify balance, fine motor skill, and cognitive ability. We hypothesized that the additional demands of the balance and speeded finger-tapping tasks would degrade motor performance in the simultaneous conditions, but not impact cognitive (N-Back task) performance. Movement data were evaluated by comparing the change of each group across 3 levels of cognitive load (0-, 1-, and 2-back). We tested the task on a small sample of young adults with autism spectrum disorder (ASD; n=4) and matched controls (n=4). We observed a trend largely consistent with our hypotheses. The system's temporal precision and modular design also allow for the incorporation of other sensors as needed, like EEG or heart rate variability. We propose that a version of this system be tested as a putative outcome measure for interventions involving attention, cognitive load or certain types of motor skill training.  more » « less
Award ID(s):
1640909
NSF-PAR ID:
10114046
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
IEEE/EMBS Conference on Neural Engineering
Page Range / eLocation ID:
1042 to 1045
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Many daily activities require performance of multiple tasks integrating cognitive and motor processes. While the fact that both processes go through deterioration and changes with aging has been generally accepted, not much is known about how aging interacts with stages of motor skill acquisition under a cognitively demanding situation. To address this question, we combined a visuomotor adaptation task with a secondary cognitive task. We made two primary findings beyond the expected age-related performance deterioration. First, while young adults showed classical dual-task cost in the early motor learning phase dominated by explicit processes, older adults instead strikingly displayed enhanced performance in the later stage, dominated by implicit processes. For older adults, the secondary task may have facilitated a shift to their relatively intact implicit learning processes that reduced reliance on their already-deficient explicit processes during visuomotor adaptation. Second, we demonstrated that consistently performing the secondary task in learning and re-learning phases can operate as an internal task-context and facilitate visuomotor memory retrieval later regardless of age groups. Therefore, our study demonstrated age-related similarities and differences in integrating concurrent cognitive load with motor skill acquisition which, may in turn, contributes to the understanding of a shift in balance across multiple systems.

     
    more » « less
  2. Abstract Background

    Repetitive action, resistance to environmental change and fine motor disruptions are hallmarks of autism spectrum disorder (ASD) and other neurodevelopmental disorders, and vary considerably from individual to individual. In animal models, conventional behavioral phenotyping captures such fine-scale variations incompletely. Here we observed male and female C57BL/6J mice to methodically catalog adaptive movement over multiple days and examined two rodent models of developmental disorders against this dynamic baseline. We then investigated the behavioral consequences of a cerebellum-specific deletion in Tsc1 protein and a whole-brain knockout in Cntnap2 protein in mice. Both of these mutations are found in clinical conditions and have been associated with ASD.

    Methods

    We used advances in computer vision and deep learning, namely a generalized form of high-dimensional statistical analysis, to develop a framework for characterizing mouse movement on multiple timescales using a single popular behavioral assay, the open-field test. The pipeline takes virtual markers from pose estimation to find behavior clusters and generate wavelet signatures of behavior classes. We measured spatial and temporal habituation to a new environment across minutes and days, different types of self-grooming, locomotion and gait.

    Results

    Both Cntnap2 knockouts and L7-Tsc1 mutants showed forelimb lag during gait. L7-Tsc1 mutants and Cntnap2 knockouts showed complex defects in multi-day adaptation, lacking the tendency of wild-type mice to spend progressively more time in corners of the arena. In L7-Tsc1 mutant mice, failure to adapt took the form of maintained ambling, turning and locomotion, and an overall decrease in grooming. However, adaptation in these traits was similar between wild-type mice and Cntnap2 knockouts. L7-Tsc1 mutant and Cntnap2 knockout mouse models showed different patterns of behavioral state occupancy.

    Limitations

    Genetic risk factors for autism are numerous, and we tested only two. Our pipeline was only done under conditions of free behavior. Testing under task or social conditions would reveal more information about behavioral dynamics and variability.

    Conclusions

    Our automated pipeline for deep phenotyping successfully captures model-specific deviations in adaptation and movement as well as differences in the detailed structure of behavioral dynamics. The reported deficits indicate that deep phenotyping constitutes a robust set of ASD symptoms that may be considered for implementation in clinical settings as quantitative diagnosis criteria.

     
    more » « less
  3. Autism spectrum disorder (ASD) is a neurodevelopmental syndrome characterized by impairments in social perception and communication. Growing evidence suggests that the relationship between deficits in social perception and ASD may extend into the neurotypical population. In electroencephalography (EEG), high autism-spectrum traits in both ASD and neurotypical samples are associated with changes to the mu rhythm, an alpha-band (8–12 Hz) oscillation measured over sensorimotor cortex which typically shows reductions in spectral power during both one’s own movements and observation of others’ actions. This mu suppression is thought to reflect integration of perceptual and motor representations for understanding of others’ mental states, which may be disrupted in individuals with autism-spectrum traits. However, because spectral power is usually quantified at the group level, it has limited usefulness for characterizing individual variation in the mu rhythm, particularly with respect to autism-spectrum traits. Instead, individual peak frequency may provide a better measure of mu rhythm variability across participants. Previous developmental studies have linked ASD to slowing of individual peak frequency in the alpha band, or peak alpha frequency (PAF), predominantly associated with selective attention. Yet individual variability in the peak mu frequency (PMF) remains largely unexplored, particularly with respect to autism-spectrum traits. Here we quantified peak frequency of occipitoparietal alpha and sensorimotor mu rhythms across neurotypical individuals as a function of autism-spectrum traits. High-density 128-channel EEG data were collected from 60 participants while they completed two tasks previously reported to reliably index the sensorimotor mu rhythm: motor execution (bimanual finger tapping) and action observation (viewing of whole-body human movements). We found that individual measurement in the peak oscillatory frequency of the mu rhythm was highly reliable within participants, was not driven by resting vs. task states, and showed good correlation across action execution and observation tasks. Within our neurotypical sample, higher autism-spectrum traits were associated with slowing of the PMF, as predicted. This effect was not likely explained by volume conduction of the occipitoparietal PAF associated with attention. Together, these data support individual peak oscillatory alpha-band frequency as a correlate of autism-spectrum traits, warranting further research with larger samples and clinical populations. 
    more » « less
  4. Principles from human-human physical interaction may be necessary to design more intuitive and seamless robotic devices to aid human movement. Previous studies have shown that light touch can aid balance and that haptic communication can improve performance of physical tasks, but the effects of touch between two humans on walking balance has not been previously characterized. This study examines physical interaction between two persons when one person aids another in performing a beam-walking task. 12 pairs of healthy young adults held a force sensor with one hand while one person walked on a narrow balance beam (2 cm wide x 3.7 m long) and the other person walked overground by their side. We compare balance performance during partnered vs. solo beam-walking to examine the effects of haptic interaction, and we compare hand interaction mechanics during partnered beam-walking vs. overground walking to examine how the interaction aided balance. While holding the hand of a partner, participants were able to walk further on the beam without falling, reduce lateral sway, and decrease angular momentum in the frontal plane. We measured small hand force magnitudes (mean of 2.2 N laterally and 3.4 N vertically) that created opposing torque components about the beam axis and calculated the interaction torque, the overlapping opposing torque that does not contribute to motion of the beam-walker’s body. We found higher interaction torque magnitudes during partnered beam-walking vs . partnered overground walking, and correlation between interaction torque magnitude and reductions in lateral sway. To gain insight into feasible controller designs to emulate human-human physical interactions for aiding walking balance, we modeled the relationship between each torque component and motion of the beam-walker’s body as a mass-spring-damper system. Our model results show opposite types of mechanical elements (active vs . passive) for the two torque components. Our results demonstrate that hand interactions aid balance during partnered beam-walking by creating opposing torques that primarily serve haptic communication, and our model of the torques suggest control parameters for implementing human-human balance aid in human-robot interactions. 
    more » « less
  5. Background

    In Physical Human–Robot Interaction (pHRI), the need to learn the robot’s motor-control dynamics is associated with increased cognitive load. Eye-tracking metrics can help understand the dynamics of fluctuating mental workload over the course of learning.

    Objective

    The aim of this study was to test eye-tracking measures’ sensitivity and reliability to variations in task difficulty, as well as their performance-prediction capability, in physical human–robot collaboration tasks involving an industrial robot for object comanipulation.

    Methods

    Participants (9M, 9F) learned to coperform a virtual pick-and-place task with a bimanual robot over multiple trials. Joint stiffness of the robot was manipulated to increase motor-coordination demands. The psychometric properties of eye-tracking measures and their ability to predict performance was investigated.

    Results

    Stationary Gaze Entropy and pupil diameter were the most reliable and sensitive measures of workload associated with changes in task difficulty and learning. Increased task difficulty was more likely to result in a robot-monitoring strategy. Eye-tracking measures were able to predict the occurrence of success or failure in each trial with 70% sensitivity and 71% accuracy.

    Conclusion

    The sensitivity and reliability of eye-tracking measures was acceptable, although values were lower than those observed in cognitive domains. Measures of gaze behaviors indicative of visual monitoring strategies were most sensitive to task difficulty manipulations, and should be explored further for the pHRI domain where motor-control and internal-model formation will likely be strong contributors to workload.

    Application

    Future collaborative robots can adapt to human cognitive state and skill-level measured using eye-tracking measures of workload and visual attention.

     
    more » « less