Electrical muscle stimulation (EMS) is an emergent technique that miniaturizes force feedback, especially popular for untethered haptic devices, such as mobile gaming, VR, or AR. However, the actuation displayed by interactive systems based on EMS is coarse and imprecise. EMS systems mostly focus on inducing movements in large muscle groups such as legs, arms, and wrists; whereas individual finger poses, which would be required, for example, to actuate a user's fingers to fingerspell even the simplest letters in sign language, are not possible. The lack of dexterity in EMS stems from two fundamental limitations: (1) lack of independence: when a particular finger is actuated by EMS, the current runs through nearby muscles, causing unwanted actuation of adjacent fingers; and, (2) unwanted oscillations: while it is relatively easy for EMS to start moving a finger, it is very hard for EMS to stop and hold that finger at a precise angle; because, to stop a finger, virtually all EMS systems contract the opposing muscle, typically achieved via controllers (e.g., PID)—unfortunately, even with the best controller tuning, this often results in unwanted oscillations. To tackle these limitations, we propose dextrEMS, an EMS-based haptic device featuring mechanical brakes attached to each finger joint. The key idea behind dextrEMS is that while the EMS actuates the fingers, it is our mechanical brake that stops the finger in a precise position. Moreover, it is also the brakes that allow dextrEMS to select which fingers are moved by EMS, eliminating unwanted movements by preventing adjacent fingers from moving. We implemented dextrEMS as an untethered haptic device, weighing only 68g, that actuates eight finger joints independently (metacarpophalangeal and proximal interphalangeal joints for four fingers), which we demonstrate in a wide range of haptic applications, such as assisted fingerspelling, a piano tutorial, guitar tutorial, and a VR game. Finally, in our technical evaluation, we found that dextrEMS outperformed EMS alone by doubling its independence and reducing unwanted oscillations.
more »
« less
Increasing Electrical Muscle Stimulation's Dexterity by means of Back of the Hand Actuation
We propose a technique that allows an unprecedented level of dexterity in electrical muscle stimulation (EMS), i.e., it allows interactive EMS-based devices to flex the user's fingers independently of each other. EMS is a promising technique for force feedback because of its small form factor when compared to mechanical actuators. However, the current EMS approach to flexing the user's fingers (i.e., attaching electrodes to the base of the forearm, where finger muscles anchor) is limited by its inability to flex a target finger's metacarpophalangeal (MCP) joint independently of the other fingers. In other words, current EMS devices cannot flex one finger alone, they always induce unwanted actuation to adjacent fingers. To tackle the lack of dexterity, we propose and validate a new electrode layout that places the electrodes on the back of the hand, where they stimulate the interossei/lumbricals muscles in the palm, which have never received attention with regards to EMS. In our user study, we found that our technique offers four key benefits when compared to existing EMS electrode layouts: our technique (1) flexes all four fingers around the MCP joint more independently; (2) has less unwanted flexion of other joints (such as the proximal interphalangeal joint); (3) is more robust to wrist rotations; and (4) reduces calibration time. Therefore, our EMS technique enables applications for interactive EMS systems that require a level of flexion dexterity not available until now. We demonstrate the improved dexterity with four example applications: three musical instrumental tutorials (piano, drum, and guitar) and a VR application that renders force feedback in individual fingers while manipulating a yo-yo.
more »
« less
- Award ID(s):
- 2047189
- NSF-PAR ID:
- 10317683
- Date Published:
- Journal Name:
- CHI Conference on Human Factors in Computing Systems
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Stable precision grips using the fingertips are a cornerstone of human hand dexterity. However, our fingers become unstable sometimes and snap into a hyperextended posture. This is because multilink mechanisms like our fingers can buckle under tip forces. Suppressing this instability is crucial for hand dexterity, but how the neuromuscular system does so is unknown. Here we show that people rely on the stiffness from muscle contraction for finger stability. We measured buckling time constants of 50 ms or less during maximal force application with the index finger—quicker than feedback latencies—which suggests that muscle-induced stiffness may underlie stability. However, a biomechanical model of the finger predicts that muscle-induced stiffness cannot stabilize at maximal force unless we add springs to stiffen the joints or people reduce their force to enable cocontraction. We tested this prediction in 38 volunteers. Upon adding stiffness, maximal force increased by 34 ± 3%, and muscle electromyography readings were 21 ± 3% higher for the finger flexors (mean ± SE). Muscle recordings and mathematical modeling show that adding stiffness offloads the demand for muscle cocontraction, thus freeing up muscle capacity for fingertip force. Hence, people refrain from applying truly maximal force unless an external stabilizing stiffness allows their muscles to apply higher force without losing stability. But more stiffness is not always better. Stiff fingers would affect the ability to adapt passively to complex object geometries and precisely regulate force. Thus, our results show how hand function arises from neurally tuned muscle stiffness that balances finger stability with compliance.more » « less
-
null (Ed.)A reliable neural-machine interface is essential for humans to intuitively interact with advanced robotic hands in an unconstrained environment. Existing neural decoding approaches utilize either discrete hand gesture-based pattern recognition or continuous force decoding with one finger at a time. We developed a neural decoding technique that allowed continuous and concurrent prediction of forces of different fingers based on spinal motoneuron firing information. High-density skin-surface electromyogram (HD-EMG) signals of finger extensor muscle were recorded, while human participants produced isometric flexion forces in a dexterous manner (i.e. produced varying forces using either a single finger or multiple fingers concurrently). Motoneuron firing information was extracted from the EMG signals using a blind source separation technique, and each identified neuron was further classified to be associated with a given finger. The forces of individual fingers were then predicted concurrently by utilizing the corresponding motoneuron pool firing frequency of individual fingers. Compared with conventional approaches, our technique led to better prediction performances, i.e. a higher correlation ([Formula: see text] versus [Formula: see text]), a lower prediction error ([Formula: see text]% MVC versus [Formula: see text]% MVC), and a higher accuracy in finger state (rest/active) prediction ([Formula: see text]% versus [Formula: see text]%). Our decoding method demonstrated the possibility of classifying motoneurons for different fingers, which significantly alleviated the cross-talk issue of EMG recordings from neighboring hand muscles, and allowed the decoding of finger forces individually and concurrently. The outcomes offered a robust neural-machine interface that could allow users to intuitively control robotic hands in a dexterous manner.more » « less
-
null (Ed.)Objective: Functional electrical stimulation (FES) is a common technique to elicit muscle contraction and help improve muscle strength. Traditional FES over the muscle belly typically only activates superficial muscle regions. In the case of hand FES, this prevents the activation of the deeper flexor muscles which control the distal finger joints. Here, we evaluated whether an alternative transcutaneous nerve-bundle stimulation approach can activate both superficial and deep extrinsic finger flexors using a high-density stimulation grid. Methods: Transverse ultrasound of the forearm muscles was used to obtain cross-sectional images of the underlying finger flexors during stimulated finger flexions and kinematically-matched voluntary motions. Finger kinematics were recorded, and an image registration method was used to capture the large deformation of the muscle regions during each flexion. This deformation was used as a surrogate measure of the contraction of muscle tissue, and the regions of expanding tissue can identify activated muscles. Results: The nerve-bundle stimulation elicited contractions in the superficial and deep finger flexors. Both separate and concurrent activation of these two muscles were observed. Joint kinematics of the fingers also matched the expected regions of muscle contractions. Conclusions: Our results showed that the nerve-bundle stimulation technique can activate the deep extrinsic finger flexors, which are typically not accessible via traditional surface FES. Significance: Our nerve-bundle stimulation method enables us to produce the full range of motion of different joints necessary for various functional grasps, which could benefit future neuroprosthetic applications.more » « less
-
null (Ed.)With the development of advanced robotic hands, a reliable neural-machine interface is essential to take full advantage of the functional dexterity of the robots. In this preliminary study, we developed a novel method to estimate isometric forces of individual fingers continuously and concurrently during dexterous finger flexion and extension. Specifically, motor unit (MU) discharge activity was extracted from the surface high-density electromyogram (EMG) signals recorded from the finger extensors and flexors, respectively. The MU information was separated into different groups to be associated with the flexion or extension of individual fingers and was then used to predict individual finger forces during multi-finger flexion and extension tasks. Compared with the conventional EMG amplitude-based method, our method can obtain a better force estimation performance (a higher correlation and a smaller estimation error between the predicted and the measured force) when a linear regression model was used. Further exploration of our method can potentially provide a robust neural-machine interface for intuitive control of robotic hands.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3411764.3445761
