An official website of the United States government
Abstract Innovative human–machine interfaces (HMIs) have attracted increasing attention in the field of system control and assistive devices for disabled people. Conventional HMIs that are designed based on the interaction of physical movements or language communication are not effective or appliable to severely disabled users. Here, a breath‐driven triboelectric sensor is reported consisting of a soft fixator and two circular‐shaped triboelectric nanogenerators (TENGs) for self‐powered respiratory monitoring and smart system control. The sensor device is capable of effectively detecting the breath variation and generates responsive electrical signals based on different breath patterns without affecting the normal respiration. A breathing‐driven HMI system is demonstrated for severely disabled people to control electrical household appliances and shows an intelligent respiration monitoring system for emergence alarm. The new system provides the advantages of high sensitivity, good stability, low cost, and ease of use. This work will not only expand the development of the TENGs in self‐powered sensors, but also opens a new avenue to develop assistive devices for disabled people through innovation of advanced HMIs.
more »
« less
Self‐Powered, Soft and Breathable Human–Machine Interface Based on Piezoelectric Sensors
Abstract Wearable electronics revolutionize human–machine interfaces (HMIs) for robotic or prosthetic control. Yet, the challenge lies in eliminating conventional rigid and impermeable electronic components, such as batteries, while considering the comfort and usability of HMIs over prolonged periods. Herein, a self‐powered, flexible, and breathable HMI is developed based on piezoelectric sensors. This interface is designed to accurately monitor subtle changes in body and muscle movements, facilitating effective communication and control of robotic prosthetic hands for various applications. Utilizing engineered porous structures within the polymeric material, the piezoelectric sensor demonstrates a significantly enhanced sensitivity, flexibility, and permeability, highlighting its outstanding HMI applications. Furthermore, the developed control algorithm enables a single sensor to comprehensively control robotic hands. By successfully translating piezoelectric signals generated from bicep muscle movements into Morse Code, this HMI serves as an efficient communication device. Additionally, the process is demonstrated by illustrating the execution of the daily task of “drinking a cup of water” using the developed HMI to enable the control of a human‐interactive robotic prosthetic hand through the detection of bicep muscle movements. Such HMIs pave the way toward self‐powered and comfortable biomimetic systems, making a significant contribution to the future evolution of prosthetics.
more »
« less
- Award ID(s):
- 2106459
- PAR ID:
- 10641229
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Advanced Sensor Research
- Volume:
- 3
- Issue:
- 12
- ISSN:
- 2751-1219
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Medical robotics has revolutionized healthcare by enhancing precision, adaptability, and clinical outcomes. This field has further evolved with the advent of human–machine interfaces (HMIs), which facilitate seamless interactions between users and robotic systems. However, traditional HMIs rely on rigid sensing components and bulky wiring, causing mechanical mismatches that limit user comfort, accuracy, and wearability. Flexible sensors offer a transformative solution by enabling the integration of adaptable sensing technology into HMIs, enhancing overall system functionality. Further integrating artificial intelligence (AI) into these systems addresses key limitations of conventional HMI, including challenges in complex data interpretations and multimodal sensing integration. In this review, we systematically explore the convergence of flexible sensor‐based HMIs and AI for medical robotics. Specifically, we analyze core flexible sensing mechanisms, AI‐driven advancements in healthcare, and applications in prosthetics, exoskeletons, and surgical robotics. By bridging the gap between flexible sensing technologies and AI‐driven intelligence, this review presents a roadmap for developing next‐generation smart medical robotic systems, advancing personalized healthcare and adaptive human–robot interactions.more » « less
-
Abstract Soft robots have attracted great attention in the past decades owing to their unique flexibility and adaptability for accomplishing tasks via simple control strategies, as well as their inherent safety for interactions with humans and environments. Here, a soft robotic manipulation system capable of stiffness variation and dexterous operations through a remotely controlled manner is reported. The smart manipulation system consists of a soft omnidirectional arm, a dexterous multimaterial gripper, and a self‐powered human–machine interface (HMI) for teleoperation. The cable‐driven soft arm is made of soft elastomers and embedded with low melting point alloy as a stiffness‐tuning mechanism. The self‐powered HMI patches are designed based on the triboelectric nanogenerator that utilizes a sliding mode of tribo‐layers made of copper and polytetrafluoroethylene. The novel soft manipulation system has great potential for soft and remote manipulation and human machine interactions in a variety of applications from elderly care to surgical operation to agriculture harvesting.more » « less
-
Robotic prostheses and powered exoskeletons are novel assistive robotic devices for modern medicine. Muscle activity sensing plays an important role in controlling assistive robotics devices. Most devices measure the surface electromyography (sEMG) signal for myoelectric control. However, sEMG is an integrated signal from muscle activities. It is difficult to sense muscle movements in specific small regions, particularly at different depths. Alternatively, traditional ultrasound imaging has recently been proposed to monitor muscle activity due to its ability to directly visualize superficial and at-depth muscles. Despite their advantages, traditional ultrasound probes lack wearability. In this paper, a wearable ultrasound (US) transducer, based on lead zirconate titanate (PZT) and a polyimide substrate, was developed for a muscle activity sensing demonstration. The fabricated PZT-5A elements were arranged into a 4 × 4 array and then packaged in polydimethylsiloxane (PDMS). In vitro porcine tissue experiments were carried out by generating the muscle activities artificially, and the muscle movements were detected by the proposed wearable US transducer via muscle movement imaging. Experimental results showed that all 16 elements had very similar acoustic behaviors: the averaged central frequency, −6 dB bandwidth, and electrical impedance in water were 10.59 MHz, 37.69%, and 78.41 Ω, respectively. The in vitro study successfully demonstrated the capability of monitoring local muscle activity using the prototyped wearable transducer. The findings indicate that ultrasonic sensing may be an alternative to standardize myoelectric control for assistive robotics applications.more » « less
-
Abstract In recent years, commercially available dexterous upper limb prostheses for children have begun to emerge. These devices derive control signals from surface electromyography (measure of affected muscle electrical activity, sEMG) to drive a variety of grasping motions. However, the ability for children with congenital upper limb deficiency to actuate their affected muscles to achieve naturalistic prosthetic control is not well understood, as compared to adults or children with acquired hand loss. To address this gap, we collected sEMG data from 9 congenital one-handed participants ages 8–20 years as they envisioned and attempted to perform 10 different movements with their missing hands. Seven sEMG electrodes were adhered circumferentially around the participant’s affected and unaffected limbs and participants mirrored the attempted missing hand motions with their intact side. To analyze the collected sEMG data, we used time and frequency domain analyses. We found that for the majority of participants, attempted hand movements produced detectable and consistent muscle activity, and the capacity to achieve this was not dissimilar across the affected and unaffected sides. These data suggest that children with congenital hand absence retain a degree of control over their affected muscles, which has important implications for translating and refining advanced prosthetic control technologies for children.more » « less
