skip to main content


Title: First Demonstration of Functional Task Performance Using a Sonomyographic Prosthesis: A Case Study
Ultrasound-based sensing of muscle deformation, known as sonomyography, has shown promise for accurately classifying the intended hand grasps of individuals with upper limb loss in offline settings. Building upon this previous work, we present the first demonstration of real-time prosthetic hand control using sonomyography to perform functional tasks. An individual with congenital bilateral limb absence was fitted with sockets containing a low-profile ultrasound transducer placed over forearm muscle tissue in the residual limbs. A classifier was trained using linear discriminant analysis to recognize ultrasound images of muscle contractions for three discrete hand configurations (rest, tripod grasp, index finger point) under a variety of arm positions designed to cover the reachable workspace. A prosthetic hand mounted to the socket was then controlled using this classifier. Using this real-time sonomyographic control, the participant was able to complete three functional tasks that required selecting different hand grasps in order to grasp and move one-inch wooden blocks over a broad range of arm positions. Additionally, these tests were successfully repeated without retraining the classifier across 3 hours of prosthesis use and following simulated donning and doffing of the socket. This study supports the feasibility of using sonomyography to control upper limb prostheses in real-world applications.  more » « less
Award ID(s):
1922598
NSF-PAR ID:
10352061
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
Frontiers in Bioengineering and Biotechnology
Volume:
10
ISSN:
2296-4185
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract

    Children with a unilateral congenital below elbow deficiency (UCBED) have one typical upper limb and one that lacks a hand, ending below the elbow at the proximal/mid forearm. UCBED is an isolated condition, and affected children otherwise develop normal sensorimotor control. Unlike adults with upper limb absence, the majority of whom have an acquired loss, children with UCBED never developed a hand, so their residual muscles have never actuated an intact limb. Their ability to purposefully modulate affected muscle activity is often assumed to be limited, and this assumption has influenced prosthetic design and prescription practices for this population as many modern devices derive control signals from affected muscle activity. To better understand the motor capabilities of the affected muscles, we used ultrasound imaging to study 6 children with UCBED. We examined the extent to which subjects activate their affected muscles when performing mirrored movements with their typical and missing hands. We demonstrate that all subjects could intentionally and consistently enact at least five distinct muscle patterns when attempting different missing hand movements (e.g., power grasp) and found similar performance across affected and typically developed limbs. These results suggest that although participants had never actuated the missing hand they could distinctively and consistently activate the residual muscle patterns associated with actions on the unaffected side. These findings indicate that motor control still develops in the absence of the normal effector, and can serve as a guide for developing prostheses that leverage the full extent of these children’s motor control capabilities.

     
    more » « less
  2. Abstract Background After above-knee amputation, the missing biological knee and ankle are replaced with passive prosthetic devices. Passive prostheses are able to dissipate limited amounts of energy using resistive damper systems during “negative energy” tasks like sit-down. However, passive prosthetic knees are not able to provide high levels of resistance at the end of the sit-down movement when the knee is flexed, and users need the most support. Consequently, users are forced to over-compensate with their upper body, residual hip, and intact leg, and/or sit down with a ballistic and uncontrolled movement. Powered prostheses have the potential to solve this problem. Powered prosthetic joints are controlled by motors, which can produce higher levels of resistance at a larger range of joint positions than passive damper systems. Therefore, powered prostheses have the potential to make sitting down more controlled and less difficult for above-knee amputees, improving their functional mobility. Methods Ten individuals with above-knee amputations sat down using their prescribed passive prosthesis and a research powered knee-ankle prosthesis. Subjects performed three sit-downs with each prosthesis while we recorded joint angles, forces, and muscle activity from the intact quadricep muscle. Our main outcome measures were weight-bearing symmetry and muscle effort of the intact quadricep muscle. We performed paired t-tests on these outcome measures to test for significant differences between passive and powered prostheses. Results We found that the average weight-bearing symmetry improved by 42.1% when subjects sat down with the powered prosthesis compared to their passive prostheses. This difference was significant (p = 0.0012), and every subject’s weight-bearing symmetry improved when using the powered prosthesis. Although the intact quadricep muscle contraction differed in shape, neither the integral nor the peak of the signal was significantly different between conditions (integral p > 0.01, peak p > 0.01). Conclusions In this study, we found that a powered knee-ankle prosthesis significantly improved weight-bearing symmetry during sit-down compared to passive prostheses. However, we did not observe a corresponding decrease in intact-limb muscle effort. These results indicate that powered prosthetic devices have the potential to improve balance during sit-down for individuals with above-knee amputation and provide insight for future development of powered prosthetics. 
    more » « less
  3. Abstract Objective. Brain–machine interfaces (BMIs) have shown promise in extracting upper extremity movement intention from the thoughts of nonhuman primates and people with tetraplegia. Attempts to restore a user’s own hand and arm function have employed functional electrical stimulation (FES), but most work has restored discrete grasps. Little is known about how well FES can control continuous finger movements. Here, we use a low-power brain-controlled functional electrical stimulation (BCFES) system to restore continuous volitional control of finger positions to a monkey with a temporarily paralyzed hand. Approach. We delivered a nerve block to the median, radial, and ulnar nerves just proximal to the elbow to simulate finger paralysis, then used a closed-loop BMI to predict finger movements the monkey was attempting to make in two tasks. The BCFES task was one-dimensional in which all fingers moved together, and we used the BMI’s predictions to control FES of the monkey’s finger muscles. The virtual two-finger task was two-dimensional in which the index finger moved simultaneously and independently from the middle, ring, and small fingers, and we used the BMI’s predictions to control movements of virtual fingers, with no FES. Main results. In the BCFES task, the monkey improved his success rate to 83% (1.5 s median acquisition time) when using the BCFES system during temporary paralysis from 8.8% (9.5 s median acquisition time, equal to the trial timeout) when attempting to use his temporarily paralyzed hand. In one monkey performing the virtual two-finger task with no FES, we found BMI performance (task success rate and completion time) could be completely recovered following temporary paralysis by executing recalibrated feedback-intention training one time. Significance. These results suggest that BCFES can restore continuous finger function during temporary paralysis using existing low-power technologies and brain-control may not be the limiting factor in a BCFES neuroprosthesis. 
    more » « less
  4. Generative Attention Learning (GenerAL) is a framework for high-DOF multi-fingered grasping that is not only robust to dense clutter and novel objects but also effective with a variety of different parallel-jaw and multi-fingered robot hands. This framework introduces a novel attention mechanism that substantially improves the grasp success rate in clutter. Its generative nature allows the learning of full-DOF grasps with flexible end-effector positions and orientations, as well as all finger joint angles of the hand. Trained purely in simulation, this framework skillfully closes the sim-to-real gap. To close the visual sim-to-real gap, this framework uses a single depth image as input. To close the dynamics sim-to-real gap, this framework circumvents continuous motor control with a direct mapping from pixel to Cartesian space inferred from the same depth image. Finally, this framework demonstrates inter-robot generality by achieving over 92% real-world grasp success rates in cluttered scenes with novel objects using two multi-fingered robotic hand-arm systems with different degrees of freedom. 
    more » « less
  5. Although beginning to emerge, multiarticulate upper limb prostheses for children remain sparse despite the continued advancement of mechatronic technologies that have benefited adults with upper limb amputations. Upper limb prosthesis research is primarily focused on adults, even though rates of pediatric prosthetic abandonment far surpass those seen in adults. The implicit goal of a prosthesis is to provide effective functionality while promoting healthy social interaction. Yet most current pediatric devices offer a single degree of freedom open/close grasping function, a stark departure from the multiple grasp configurations provided in advanced adult devices. Although comparable child-sized devices are on the clinical horizon, understanding how to effectively translate these technologies to the pediatric population is vital. This includes exploring grasping movements that may provide the most functional benefits and techniques to control the newly available dexterity. Currently, no dexterous pediatric research platforms exist that offer open access to hardware and programming to facilitate the investigation and provision of multi-grasp function. Our objective was to deliver a child-sized multi-grasp prosthesis that may serve as a robust research platform. In anticipation of an open-source release, we performed a comprehensive set of benchtop and functional tests with common household objects to quantify the performance of our device. This work discusses and evaluates our pediatric-sized multiarticulate prosthetic hand that provides 6 degrees of actuation, weighs 177 g and was designed specifically for ease of implementation in a research or clinical-research setting. Through the benchtop and validated functional tests, the pediatric hand produced grasping forces ranging from 0.424–7.216 N and was found to be comparable to the functional capabilities of similar adult devices. As mechatronic technologies advance and multiarticulate prostheses continue to evolve, translating many of these emerging technologies may help provide children with more useful and functional prosthesis options. Effective translation will inevitably require a solid scientific foundation to inform how best to prescribe advanced prosthetic devices and control systems for children. This work begins addressing these current gaps by providing a much-needed research platform with supporting data to facilitate its use in laboratory and clinical research settings. 
    more » « less