skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A Novel Application of Levenshtein Distance for Assessment of High-Level Motor Planning Underlying Performance During Learning of Complex Motor Sequences
Few studies have examined high-level motor plans underlying cognitive-motor performance during practice of complex action sequences. These investigations have assessed performance through fairly simple metrics without examining how practice affects the structures of action sequences. By adapting the Levenshtein distance (LD) method to the motor domain, we propose a computational approach to accurately capture performance dynamics during practice of action sequences. Practice performance dynamics were assessed by computing the LD based on the number of insertions, deletions, and substitutions of actions needed to transform any sequence into a reference sequence (having a minimal number of actions to complete the task). Also, combining LD-based performance with mental workload metrics allowed assessment of cognitive-motor efficiency dynamics. This approach was tested on the Tower of Hanoi task. The findings revealed that throughout practice this method could capture: i) action sequence performance improvements as indexed by a reduced LD (decrease of insertions and substitutions), ii) structural modifications of the high-level plans, iii) an attenuation of mental workload, and iv) enhanced cognitive-motor efficiency. This effort complements prior work examining the practice of complex action sequences in healthy adults and has potential for probing cognitive-motor impairment in clinical populations as well as the development/assessment of cognitive robotic controllers.  more » « less
Award ID(s):
1632976
PAR ID:
10287974
Author(s) / Creator(s):
; ; ; ; ; ; ;
Date Published:
Journal Name:
Journal of Motor Learning and Development
Volume:
8
Issue:
1
ISSN:
2325-3193
Page Range / eLocation ID:
67 to 86
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Abstract Compared to blocked practice, interleaved practice of different tasks leads to superior long-term retention despite poorer initial acquisition performance. This phenomenon, the contextual interference effect, is well documented in various domains but it is not yet clear if it persists in the absence of explicit knowledge in terms of fine motor sequence learning. Additionally, while there is some evidence that interleaved practice leads to improved transfer of learning to similar actions, transfer of implicit motor sequence learning has not been explored. The present studies used a serial reaction time task where participants practiced three different eight-item sequences that were either interleaved or blocked on Day 1 (training) and Day 2 (testing). In Experiment 1, the retention of the three training sequences was tested on Day 2 and in Experiment 2, three novel sequences were performed on Day 2 to measure transfer. We assessed whether subjects were aware of the sequences to determine whether the benefit of interleaved practice extends to implicitly learned sequences. Even for participants who reported no awareness of the sequences, interleaving led to a benefit for both retention and transfer compared to participants who practiced blocked sequences. Those who trained with blocked sequences were left unprepared for interleaved sequences at test, while those who trained with interleaved sequences were unaffected by testing condition, revealing that learning resulting from blocked practice may be less flexible and more vulnerable to testing conditions. These results indicate that the benefit of interleaved practice extends to implicit motor sequence learning and transfer. 
    more » « less
  2. Abstract This primer describes research on the development of motor behavior. We focus on infancy when basic action systems are acquired—posture, locomotion, manual actions, and facial actions—and we adopt a developmental systems perspective to understand the causes and consequences of developmental change. Experience facilitates improvements in motor behavior and infants accumulate immense amounts of varied everyday experience with all the basic action systems. At every point in development, perception guides behavior by providing feedback about the results of just prior movements and information about what to do next. Across development, new motor behaviors provide new inputs for perception. Thus, motor development opens up new opportunities for acquiring knowledge and acting on the world, instigating cascades of developmental changes in perceptual, cognitive, and social domains. This article is categorized under:Cognitive Biology > Cognitive DevelopmentPsychology > Motor Skill and PerformanceNeuroscience > Development 
    more » « less
  3. Computerized assessments and interactive simulation tasks are increasingly popular and afford the collection of process data, i.e., an examinee’s sequence of actions (e.g., clickstreams, keystrokes) that arises from interactions with each task. Action sequence data contain rich information on the problem-solving process but are in a nonstandard, variable-length discrete sequence format. Two methods that directly extract features from the raw action sequences, namely multidimensional scaling and sequence-to-sequence autoencoders, produce multidimensional numerical features that summarize original sequence information. This study explores the utility of action sequence features in understanding how problem-solving behavior relates to cognitive proficiencies and demographic characteristics. This is empirically illustrated with the process data from the 2012 PIAAC PSTRE digital assessment. Regularized regression results showed that action sequence features are more predictive of examinees’ demographic and cognitive characteristics compared to final outcomes. Partial least squares analysis further aided the identification of behavioral patterns systematically associated with demographic/cognitive characteristics. 
    more » « less
  4. We develop a hybrid control approach for robot learning based on combining learned predictive models with experience-based state-action policy mappings to improve the learning capabilities of robotic systems. Predictive models provide an understanding of the task and the physics (which improves sample-efficiency), while experience-based pol-icy mappings are treated as “muscle memory” that encode favorable actions as experiences that override planned actions. Hybrid control tools are used to create an algorithmic approach for combining learned predictive models with experience-based learning. Hybrid learning is presented as a method for efficiently learning motor skills by systematically combining and improving the performance of predictive models and experience-based policies. A deterministic variation of hybrid learning is derived and extended into a stochastic implementation that relaxes some of the key assumptions in the original derivation. Each variation is tested on experience-based learning methods (where the robot interacts with the environment to gain experience) as well as imitation learning methods(where experience is provided through demonstrations and tested in the environment). The results show that our method is capable of improving the performance and sample-efficiency of learning motor skills in a variety of experimental domains. 
    more » « less
  5. It is generally understood that the main role of the cerebellum is in movement planning and coordination, but neuroimaging has led to striking findings of its involvement in many aspects of cognitive processing. Mental visualization is such a cognitive process, extensively involved in learning and memory, artistic and inventive creativity, etc. Here, our aim was to conduct a multidimensional study of cerebellar involvement in the non-motor cognitive tasks. First, we used fMRI to investigate whether the cognitive task of visualization from an immediate memory of complex spatial structures (line drawings) engages the cerebellum, and identified a cerebellar network of both strongly activated and suppressed regions. Second, the task-specificity of these regions was examined by comparative analysis with the task of perceptual exploration and memorization of the drawings to be later visualized from memory. BOLD response patterns over the iterations of each task differed significantly; unexpectedly, the suppression grew markedly stronger in visualization. Third, to gain insights in the organization of these regions into cerebellar networks, we determined the directed inter-regional causal influences using Granger Causal Connectivity analysis. Additionally, the causal interactions of the cerebellar networks with a large-scale cortical network, the Default Mode Network (DMN), were studied. Fourth, we investigated rapid cognitive learning in the cerebellum at the level of short-term BOLD response evolution within each region of interest, and at the higher level of network reorganization. Our paradigm of interleaved sequences of iteration between two tasks combined with some innovative analyses were instrumental in addressing these questions. In particular, rapid forms of non-motor learning that strongly drive cerebellar plasticity through mental visualization were uncovered and characterized at both sub-lobular and network levels. Collectively, these findings provide novel and expansive insights into high-order cognitive functions in the cerebellum, and its macroscale functional neuroanatomy. They represent a basis for a framework of rapid cerebellar reorganization driven by non-motor learning, with implications for the enhancement of cognitive abilities such as learning and memory. 
    more » « less