skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Biohybrid Robotic Hand to Investigate Tactile Encoding and Sensorimotor Integration
For people who have experienced a spinal cord injury or an amputation, the recovery of sensation and motor control could be incomplete despite noteworthy advances with invasive neural interfaces. Our objective is to explore the feasibility of a novel biohybrid robotic hand model to investigate aspects of tactile sensation and sensorimotor integration with a pre-clinical research platform. Our new biohybrid model couples an artificial hand with biological neural networks (BNN) cultured in a multichannel microelectrode array (MEA). We decoded neural activity to control a finger of the artificial hand that was outfitted with a tactile sensor. The fingertip sensations were encoded into rapidly adapting (RA) or slowly adapting (SA) mechanoreceptor firing patterns that were used to electrically stimulate the BNN. We classified the coherence between afferent and efferent electrodes in the MEA with a convolutional neural network (CNN) using a transfer learning approach. The BNN exhibited the capacity for functional specialization with the RA and SA patterns, represented by significantly different robotic behavior of the biohybrid hand with respect to the tactile encoding method. Furthermore, the CNN was able to distinguish between RA and SA encoding methods with 97.84% ± 0.65% accuracy when the BNN was provided tactile feedback, averaged across three days in vitro (DIV). This novel biohybrid research platform demonstrates that BNNs are sensitive to tactile encoding methods and can integrate robotic tactile sensations with the motor control of an artificial hand. This opens the possibility of using biohybrid research platforms in the future to study aspects of neural interfaces with minimal human risk.  more » « less
Award ID(s):
2205205
PAR ID:
10522105
Author(s) / Creator(s):
; ; ; ; ; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
Biomimetics
Volume:
9
Issue:
2
ISSN:
2313-7673
Page Range / eLocation ID:
78
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Robotics)
    People use their hands for intricate tasks like playing musical instruments, employing myriad touch sensations to inform motor control. In contrast, current prosthetic hands lack comprehensive haptic feedback and exhibit rudimentary multitasking functionality. Limited research has explored the potential of upper limb amputees to feel, perceive, and respond to multiple channels of simultaneously activated haptic feedback to concurrently control the individual fingers of dexterous prosthetic hands. This study introduces a novel control architecture for three amputees and nine additional subjects to concurrently control individual fingers of an artificial hand using two channels of context-specific haptic feedback. Artificial neural networks (ANNs) recognize subjects’ electromyogram (EMG) patterns governing the artificial hand controller. ANNs also classify the directions objects slip across tactile sensors on the robotic fingertips, which are encoded via the vibration frequency of wearable vibrotactile actuators. Subjects implement control strategies with each finger simultaneously to prevent or permit slip as desired, achieving a 94.49% ± 8.79% overall success rate. Although no statistically significant difference exists between amputees’ and non-amputees’ success rates, amputees require more time to respond to simultaneous haptic feedback signals, suggesting a higher cognitive load. Nevertheless, amputees can accurately interpret multiple channels of nuanced haptic feedback to concurrently control individual robotic fingers, addressing the challenge of multitasking with dexterous prosthetic hands. 
    more » « less
  2. ; (, Physiological Reviews)
    Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ; et al (, Nature Electronics)
    Haptic interfaces can be used to add sensations of touch to virtual and augmented reality experiences. Soft, flexible devices that deliver spatiotemporal patterns of touch across the body, potentially with full-body coverage, are of particular interest for a range of applications in medicine, sports and gaming. Here we report a wireless haptic interface of this type, with the ability to display vibro-tactile patterns across large areas of the skin in single units or through a wirelessly coordinated collection of them. The lightweight and flexible designs of these systems incorporate arrays of vibro-haptic actuators at a density of 0.73 actuators per square centimetre, which exceeds the two-point discrimination threshold for mechanical sensation on the skin across nearly all the regions of the body except the hands and face. A range of vibrant sensations and information content can be passed to mechanoreceptors in the skin via time-dependent patterns and amplitudes of actuation controlled through the pressure-sensitive touchscreens of smart devices, in real-time with negligible latency. We show that this technology can be used to convey navigation instructions, to translate musical tracks into tactile patterns and to support sensory replacement feedback for the control of robotic prosthetics. 
    more » « less
  4. ; ; ; ; ; (, IEEE)
    High-spatial-resolution wearable tactile arrays have drawn interest from both industry and research, thanks to their capacity for delivering detailed tactile sensations. However, investigations of human tactile perception with high resolution tactile displays remain limited, primarily due to the high costs of multi-channel control systems and the complex fabrication required for fingertip-sized actuators. In this work, we introduce the Soft Haptic Display (SHD) toolkit, designed to enable students and researchers from diverse technical backgrounds to explore high-density tactile feedback in extended reality (XR), robotic teleoperation, braille displays, navigation aid, MR-compatible somatosensory stimulation, and remote palpation. The toolkit provides a rapid prototyping approach and real-time wireless control for a low-cost, 4×4 soft wearable fingertip tactile display with a spatial resolution of 4 mm. We characterized the display’s performance with a maximum vertical displacement of 1.8 mm, a rise time of 0.25 second, and a maximum refresh rate of 8 Hz. All materials and code are open-sourced to foster broader human tactile perception research of high-resolution haptic displays. 
    more » « less
  5. ; ; ; ; ; ; ; (, IEEE)
    Adversarial bit-flip attack (BFA), a type of powerful adversarial weight attack demonstrated in real computer systems has shown enormous success in compromising Deep Neural Network (DNN) performance with a minimal amount of model parameter perturbation through rowhammer-based computer main memory bit-flip. For the first time in this work, we demonstrate to defeat adversarial bit-flip attacks by developing a Robust and Accurate Binary Neural Network (RA-BNN) that adopts a complete BNN (i.e., weights and activations are both in binary). Prior works have demonstrated that binary or clustered weights could intrinsically improve a network's robustness against BFA, while in this work, we further reveal that binary activation could improve such robustness even better. However, with both aggressive binary weight and activation representations, the complete BNN suffers from poor clean (i.e., no attack) inference accuracy. To counter this, we propose an efficient two-stage complete BNN growing method for constructing simultaneously robust and accurate BNN, named RA-Growth. It selectively grows the channel size of each BNN layer based on trainable channel-wise binary mask learning with a Gumbel-Sigmoid function. The wider binary network (i.e., RA-BNN) has dual benefits: it can recover clean inference accuracy and significantly higher resistance against BFA. Our evaluation of the CIFAR-10 dataset shows that the proposed RA-BNN can improve the resistance to BFA by up to 100 x. On ImageNet, with a sufficiently large (e.g., 5,000) number of bit-flips, the baseline BNN accuracy drops to 4.3 % from 51.9 %, while our RA-BNN accuracy only drops to 37.1 % from 60.9 %, making it the best defense performance. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email