Creating soft robots with sophisticated, autonomous capabilities requires these systems to possess reliable, on-line proprioception of 3D configuration through integrated soft sensors. We present a framework for predicting a soft robot’s 3D configuration via deep learning using feedback from a soft, proprioceptive sensor skin. Our framework introduces a kirigami-enabled strategy for rapidly sensorizing soft robots using off-the-shelf materials, a general kinematic description for soft robot geometry, and an investigation of neural network designs for predicting soft robot configuration. Even with hysteretic, non-monotonic feedback from the piezoresistive sensors, recurrent neural networks show potential for predicting our new kinematic parameters and, thus, the robot’s configuration. One trained neural network closely predicts steady-state configuration during operation, though complete dynamic behavior is not fully captured. We validate our methods on a trunk-like arm with 12 discrete actuators and 12 proprioceptive sensors. As an essential advance in soft robotic perception, we anticipate our framework will open new avenues towards closed loop control in soft robotics.
more »
« less
Fault Detection and Response for Safe Control of Artificial Muscles in Soft Robots
Robots built from soft materials have the potential for intuitively-safer interactions with humans and the environment. However, soft robots’ embodiments have many sources of failure that could lead to unsafe conditions in closed-loop control, such as degradation of sensors or fracture of actuators. This letter proposes a fault detection system for sensors attached to artificial muscle actuators that satisfies a formal safety condition. Our approach combines redundant sensing, model-based state estimation, and Gaussian process regression to determine when one sensor’s reading statistically diverges from another, indicating a fault condition. We apply the approach to electrothermal shape memory alloy (SMA) artificial muscles, demonstrating that our method prevents the overheating and fire damage risk that could otherwise occur. Experiments show that when the muscle’s nominal sensor (temperature via a thermocouple) is fractured from the robot, the redundant sensor (electrical resistance) combined with our method prevents violation of state constraints. Deploying this system in real-world human-robot interaction could help make soft robots more robust and reliable.
more »
« less
- PAR ID:
- 10654847
- Publisher / Repository:
- IEEE
- Date Published:
- Journal Name:
- IEEE Control Systems Letters
- Volume:
- 9
- ISSN:
- 2475-1456
- Page Range / eLocation ID:
- 2321 to 2326
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Due to their ability to move without sliding relative to their environment, soft growing robots are attractive for deploying distributed sensor networks in confined spaces. Sensing of the state of such robots would add to their capabilities as human-safe, adaptable manipulators. However, incorporation of distributed sensors onto soft growing robots is challenging because it requires an interface between stiff and soft materials, and the sensor network needs to undergo significant strain. In this work, we present a method for adding sensors to soft growing robots that uses flexible printed circuit boards with self-contained units of microcontrollers and sensors encased in a laminate armor that protects them from unsafe curvatures. We demonstrate the ability of this system to relay directional temperature and humidity information in hard-to-access spaces. We also demonstrate and characterize a method for sensing the growing robot shape using inertial measurement units deployed along its length, and develop a mathematical model to predict its accuracy. This work advances the capabilities of soft growing robots, as well as the field of soft robot sensing.more » « less
-
Sensing and actuation are intricately connected in soft robotics, where contact may change actuator mechanics and robot behavior. To improve soft robotic control and performance, proprioception and contact sensors are needed to report robot state without altering actuation mechanics or introducing bulky, rigid components. For bioinspired McKibben-style fluidic actuators, prior work in sensing has focused on sensing the strain of the actuator by embedding sensors in the actuator bladder during fabrication, or by adhering sensors to the actuator surface after fabrication. However, material property mismatches between sensors and actuators can impede actuator performance, and many soft sensors available for use with fluidic actuators rely on costly or labor-intensive fabrication methods. Here, we demonstrate a low-cost and easy-to manufacture-tubular liquid metal strain sensor for use with soft actuators that can be used to detect actuator strain and contact between the actuator and external objects. The sensor is flexible, can be fabricated with commercial-off-the-shelf components, and can be easily integrated with existing soft actuators to supplement sensing, regardless of actuator shape or size. Furthermore, the soft tubular strain sensor exhibits low hysteresis and high sensitivity. The approach presented in this work provides a low-cost, soft sensing solution for broad application in soft robotics.more » « less
-
Soft robotics has witnessed increased attention from the robotic community due to their desirable features in compliant manipulation in unstructured spaces and human-friendly applications. Their light-weight designs and low-stiffness are ideally suited for environments with fragile and sensitive objects without causing damage. Deformation sensing of soft robots so far has relied on highly nonlinear bending sensors and vision-based methods that are not suitable for obtaining precise and reliable state feedback. In this work, for the first time, we explore the use of a state-of-the-art high fidelity deformation sensor that is based on optical frequency domain reflcctometry in soft bending actuators. These sensors are capable of providing spatial coordinate feedback along the length of the sensor at every 0.8 mm at up to 250 Hz. This work systematically analyzes the sensor feedback for soft bending actuator deformation and then introduces a reduced order kinematic model, together with cubic spline interpolation, which could be used to reconstruct the continuous deformation of the soft bending actuators. The kinematic model is then extended to derive an efficient dynamic model which runs at 1.5 kHz and validated against the experimental data.more » « less
-
Mattoli, Virgilio (Ed.)Pneumatically-actuated soft robots have advantages over traditional rigid robots in many applications. In particular, their flexible bodies and gentle air-powered movements make them more suitable for use around humans and other objects that could be injured or damaged by traditional robots. However, existing systems for controlling soft robots currently require dedicated electromechanical hardware (usually solenoid valves) to maintain the actuation state (expanded or contracted) of each independent actuator. When combined with power, computation, and sensing components, this control hardware adds considerable cost, size, and power demands to the robot, thereby limiting the feasibility of soft robots in many important application areas. In this work, we introduce a pneumatic memory that uses air (not electricity) to set and maintain the states of large numbers of soft robotic actuators without dedicated electromechanical hardware. These pneumatic logic circuits use normally-closed microfluidic valves as transistor-like elements; this enables our circuits to support more complex computational functions than those built from normally-open valves. We demonstrate an eight-bit nonvolatile random-access pneumatic memory (RAM) that can maintain the states of multiple actuators, control both individual actuators and multiple actuators simultaneously using a pneumatic version of time division multiplexing (TDM), and set actuators to any intermediate position using a pneumatic version of analog-to-digital conversion. We perform proof-of-concept experimental testing of our pneumatic RAM by using it to control soft robotic hands playing individual notes, chords, and songs on a piano keyboard. By dramatically reducing the amount of hardware required to control multiple independent actuators in pneumatic soft robots, our pneumatic RAM can accelerate the spread of soft robotic technologies to a wide range of important application areas.more » « less
An official website of the United States government

