skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Distributed Proprioception of 3D Configuration in Soft, Sensorized Robots via Deep Learning
Creating soft robots with sophisticated, autonomous capabilities requires these systems to possess reliable, on-line proprioception of 3D configuration through integrated soft sensors. We present a framework for predicting a soft robot’s 3D configuration via deep learning using feedback from a soft, proprioceptive sensor skin. Our framework introduces a kirigami-enabled strategy for rapidly sensorizing soft robots using off-the-shelf materials, a general kinematic description for soft robot geometry, and an investigation of neural network designs for predicting soft robot configuration. Even with hysteretic, non-monotonic feedback from the piezoresistive sensors, recurrent neural networks show potential for predicting our new kinematic parameters and, thus, the robot’s configuration. One trained neural network closely predicts steady-state configuration during operation, though complete dynamic behavior is not fully captured. We validate our methods on a trunk-like arm with 12 discrete actuators and 12 proprioceptive sensors. As an essential advance in soft robotic perception, we anticipate our framework will open new avenues towards closed loop control in soft robotics.  more » « less
Award ID(s):
1830901
PAR ID:
10188441
Author(s) / Creator(s):
Date Published:
Journal Name:
IEEE robotics automation letters
Volume:
5
Issue:
2
ISSN:
2377-3766
Page Range / eLocation ID:
3299-3306
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; (, Science Advances)
    Robots typically interact with their environments via feedback loops consisting of electronic sensors, microcontrollers, and actuators, which can be bulky and complex. Researchers have sought new strategies for achieving autonomous sensing and control in next-generation soft robots. We describe here an electronics-free approach for autonomous control of soft robots, whose compositional and structural features embody the sensing, control, and actuation feedback loop of their soft bodies. Specifically, we design multiple modular control units that are regulated by responsive materials such as liquid crystal elastomers. These modules enable the robot to sense and respond to different external stimuli (light, heat, and solvents), causing autonomous changes to the robot’s trajectory. By combining multiple types of control modules, complex responses can be achieved, such as logical evaluations that require multiple events to occur in the environment before an action is performed. This framework for embodied control offers a new strategy toward autonomous soft robots that operate in uncertain or dynamic environments. 
    more » « less
  2. ; ; ; ; ; ; ; ; (, Frontiers in Robotics and AI)
    Snake robotics is an important research topic with a wide range of applications, including inspection in confined spaces, search-and-rescue, and disaster response. Snake robots are well-suited to these applications because of their versatility and adaptability to unstructured and constrained environments. In this paper, we introduce a soft pneumatic robotic snake that can imitate the capabilities of biological snakes, its soft body can provide flexibility and adaptability to the environment. This paper combines soft mobile robot modeling, proprioceptive feedback control, and motion planning to pave the way for functional soft robotic snake autonomy. We propose a pressure-operated soft robotic snake with a high degree of modularity that makes use of customized embedded flexible curvature sensing. On this platform, we introduce the use of iterative learning control using feedback from the on-board curvature sensors to enable the snake to automatically correct its gait for superior locomotion. We also present a motion planning and trajectory tracking algorithm using an adaptive bounding box, which allows for efficient motion planning that still takes into account the kinematic state of the soft robotic snake. We test this algorithm experimentally, and demonstrate its performance in obstacle avoidance scenarios. 
    more » « less
  3. ; ; ; ; ; (, Robotics Science and Systems)
    Many-legged elongated robots show promise for reliable mobility on rugged landscapes. However, most studies on these systems focus on planar motion planning without addressing rapid vertical motion. Despite their success on mild rugged terrains, recent field tests reveal a critical need for 3D behaviors (e.g., climbing or traversing tall obstacles). The challenges of 3D motion planning partially lie in designing sensing and control for a complex high-degree-of-freedom system, typically with over 25 degrees of freedom. To address the first challenge regarding sensing, we propose a tactile antenna system that enables the robot to probe obstacles to gather information about their structure. Building on this sensory input, we develop a control framework that integrates data from the antenna and foot contact sensors to dynamically adjust the robot’s vertical body undulation for effective climbing. With the addition of simple, low-bandwidth tactile sensors, a robot with high static stability and redundancy exhibits predictable climbing performance in complex environments using a simple feedback controller. Laboratory and outdoor experiments demonstrate the robot’s ability to climb obstacles up to five times its height. Moreover, the robot exhibits robust climbing capabilities on obstacles covered with shifting, robot-sized random items and those characterized by rapidly changing curvatures. These findings demonstrate an alternative solution to perceive the environment and facilitate effective response for legged robots, paving ways towards future highly capable, low-profile many-legged robots. 
    more » « less
  4. ; ; ; ; ; (, Frontiers in Robotics and AI)
    Kyriakopoulos, Kostas J; Polygerinos, Panagiotis (Ed.)
    We demonstrate proprioceptive feedback control of a one degree of freedom soft, pneumatically actuated origami robot and an assembly of two robots into a two degree of freedom system. The base unit of the robot is a 41 mm long, 3-D printed Kresling-inspired structure with six sets of sidewall folds and one degree of freedom. Pneumatic actuation, provided by negative fluidic pressure, causes the robot to contract. Capacitive sensors patterned onto the robot provide position estimation and serve as input to a feedback controller. Using a finite element approach, the electrode shapes are optimized for sensitivity at larger (more obtuse) fold angles to improve control across the actuation range. We demonstrate stable position control through discrete-time proportional-integral-derivative (PID) control on a single unit Kresling robot via a series of static set points to 17 mm, dynamic set point stepping, and sinusoidal signal following, with error under 3 mm up to 10 mm contraction. We also demonstrate a two-unit Kresling robot with two degree of freedom extension and rotation control, which has error of 1.7 mm and 6.1°. This work contributes optimized capacitive electrode design and the demonstration of closed-loop feedback position control without visual tracking as an input. This approach to capacitance sensing and modeling constitutes a major step towards proprioceptive state estimation and feedback control in soft origami robotics. 
    more » « less
  5. ; ; ; (, Proceedings of the American Control Conference)
    Soft robots have recently drawn extensive attention thanks to their unique ability of adapting to complicated environments. Soft robots are designed in a variety of shapes of aiming for many different applications. However, accurate modelling and control of soft robots is still an open problem due to the complex robot structure and uncertain interaction with the environment. In fact, there is no unified framework for the modeling and control of generic soft robots. In this paper, we present a novel data-driven machine learning method for modeling a cable-driven soft robot. This machine learning algorithm, named deterministic learning (DL), uses soft robot motion data to train a radial basis function neural network (RBFNN). The soft robot motion dynamics are then guaranteed to be accurately identified, represented, and stored as an RBFNN model with converged constant neural network weights. To validate our method, We have built a simulated soft robot almost identical to our real inchworm soft robot, and we have tested the DL algorithm in simulation. Furthermore, a neural network weight combining technique is used which can extract and combine useful dynamics information from multiple robot motion trajectories. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email