Innovative human–machine interfaces (HMIs) have attracted increasing attention in the field of system control and assistive devices for disabled people. Conventional HMIs that are designed based on the interaction of physical movements or language communication are not effective or appliable to severely disabled users. Here, a breath‐driven triboelectric sensor is reported consisting of a soft fixator and two circular‐shaped triboelectric nanogenerators (TENGs) for self‐powered respiratory monitoring and smart system control. The sensor device is capable of effectively detecting the breath variation and generates responsive electrical signals based on different breath patterns without affecting the normal respiration. A breathing‐driven HMI system is demonstrated for severely disabled people to control electrical household appliances and shows an intelligent respiration monitoring system for emergence alarm. The new system provides the advantages of high sensitivity, good stability, low cost, and ease of use. This work will not only expand the development of the TENGs in self‐powered sensors, but also opens a new avenue to develop assistive devices for disabled people through innovation of advanced HMIs.
Soft robots have attracted great attention in the past decades owing to their unique flexibility and adaptability for accomplishing tasks via simple control strategies, as well as their inherent safety for interactions with humans and environments. Here, a soft robotic manipulation system capable of stiffness variation and dexterous operations through a remotely controlled manner is reported. The smart manipulation system consists of a soft omnidirectional arm, a dexterous multimaterial gripper, and a self‐powered human–machine interface (HMI) for teleoperation. The cable‐driven soft arm is made of soft elastomers and embedded with low melting point alloy as a stiffness‐tuning mechanism. The self‐powered HMI patches are designed based on the triboelectric nanogenerator that utilizes a sliding mode of tribo‐layers made of copper and polytetrafluoroethylene. The novel soft manipulation system has great potential for soft and remote manipulation and human machine interactions in a variety of applications from elderly care to surgical operation to agriculture harvesting.
more » « less- Award ID(s):
- 2024649
- NSF-PAR ID:
- 10453361
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Advanced Materials Technologies
- Volume:
- 6
- Issue:
- 5
- ISSN:
- 2365-709X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
more » « less
Abstract Modern marine biologists seeking to study or interact with deep-sea organisms are confronted with few options beyond industrial robotic arms, claws, and suction samplers. This limits biological interactions to a subset of “rugged” and mostly immotile fauna. As the deep sea is one of the most biologically diverse and least studied ecosystems on the planet, there is much room for innovation in facilitating delicate interactions with a multitude of organisms. The biodiversity and physiology of shallow marine systems, such as coral reefs, are common study targets due to the easier nature of access; SCUBA diving allows for
in situ delicate human interactions. Beyond the range of technical SCUBA (~150 m), the ability to achieve the same level of human dexterity using robotic systems becomes critically important. The deep ocean is navigated primarily by manned submersibles or remotely operated vehicles, which currently offer few options for delicate manipulation. Here we present results in developing a soft robotic manipulator for deep-sea biological sampling. This low-power glove-controlled soft robot was designed with the future marine biologist in mind, where science can be conducted at a comparable or better means than via a human diver and at depths well beyond the limits of SCUBA. The technology relies on compliant materials that are matched with the soft and fragile nature of marine organisms, and uses seawater as the working fluid. Actuators are driven by a custom proportional-control hydraulic engine that requires less than 50 W of electrical power, making it suitable for battery-powered operation. A wearable glove master allows for intuitive control of the arm. The manipulator system has been successfully operated in depths exceeding 2300 m (3500 psi) and has been field-tested onboard a manned submersible and unmanned remotely operated vehicles. The design, development, testing, and field trials of the soft manipulator is placed in context with existing systems and we offer suggestions for future work based on these findings. -
We build a system that enables any human to control a robot hand and arm, simply by demonstrating motions with their own hand. The robot observes the human operator via a single RGB camera and imitates their actions in real-time. Human hands and robot hands differ in shape, size, and joint structure, and performing this translation from a single uncalibrated camera is a highly underconstrained problem. Moreover, the retargeted trajectories must effectively execute tasks on a physical robot, which requires them to be temporally smooth and free of self-collisions. Our key insight is that while paired human-robot correspondence data is expensive to collect, the internet contains a massive corpus of rich and diverse human hand videos. We leverage this data to train a system that understands human hands and retargets a human video stream into a robot hand-arm trajectory that is smooth, swift, safe, and semantically similar to the guiding demonstration. We demonstrate that it enables previously untrained people to teleoperate a robot on various dexterous manipulation tasks. Our low-cost, glove-free, marker-free remote teleoperation system makes robot teaching more accessible and we hope that it can aid robots that learn to act autonomously in the real world.more » « less
-
null (Ed.)Traditional parallel-jaw grippers are insufficient for delicate object manipulation due to their stiffness and lack of dexterity. Other dexterous robotic hands often have bulky fingers, rely on complex time-varying cable drives, or are prohibitively expensive. In this paper, we introduce a novel low-cost compliant gripper with two centimeter-scaled 3-DOF delta robots using off-the-shelf linear actuators and 3D-printed soft materials. To model the kinematics of delta robots with soft compliant links, which diverge from typical rigid links, we train neural networks using a perception system. Furthermore, we analyze the delta robot’s force profile by varying the starting position in its workspace and measuring the resulting force from a push action. Finally, we demonstrate the compliance and dexterity of our gripper through six dexterous manipulation tasks involving small and delicate objects. Thus, we present the groundwork for creating modular multi-fingered hands that can execute precise and low-inertia manipulations.more » « less
-
null (Ed.)Development of highly stretchable and sensitive soft strain sensors is of great importance for broad applications in artificial intelligence, wearable devices, and soft robotics, but it proved to be a profound challenge to integrate the two seemingly opposite properties of high stretchability and sensitivity into a single material. Herein, we designed and synthesized a new fully polymeric conductive hydrogel with an interpenetrating polymer network (IPN) structure made of conductive PEDOT:PSS polymers and zwitterionic poly(HEAA- co -SBAA) polymers to achieve a combination of high mechanical, biocompatible, and sensing properties. The presence of hydrogen bonding, electrostatic interactions, and IPN structures enabled poly(HEAA- co -SBAA)/PEDOT:PSS hydrogels to achieve an ultra-high stretchability of 4000–5000%, a tensile strength of ∼0.5 MPa, a rapid mechanical recovery of 70–80% within 5 min, fast self-healing in 3 min, and a strong surface adhesion of ∼1700 J m −2 on different hard and soft substrates. Moreover, the integration of zwitterionic polySBAA and conductive PEDOT:PSS facilitated charge transfer via optimal conductive pathways. Due to the unique combination of superior stretchable, self-adhesive, and conductive properties, the hydrogels were further designed into strain sensors with high sensing stability and robustness for rapidly and accurately detecting subtle strain- and pressure-induced deformation and human motions. Moreover, an in-house mechanosensing platform provides a new tool to real-time explore the changes and relationship between network structures, tensile stress, and electronic resistance. This new fully polymeric hydrogel strain sensor, without any conductive fillers, holds great promise for broad human-machine interface applications.more » « less
