skip to main content


Title: Learning to Locomote with Artificial Neural-Network and CPG-based Control in a Soft Snake Robot
In this paper, we present a new locomotion control method for soft robot snakes. Inspired by biological snakes, our control architecture is composed of two key modules: A reinforcement learning (RL) module for achieving adaptive goal-tracking behaviors with changing goals, and a central pattern generator (CPG) system with Matsuoka oscillators for generating stable and diverse locomotion patterns. The two modules are interconnected into a closed-loop system: The RL module, analogizing the locomotion region located in the midbrain of vertebrate animals, regulates the input to the CPG system given state feedback from the robot. The output of the CPG system is then translated into pressure inputs to the pneumatic actuators of the soft snake robot. Based on the fact that the oscillation frequency and wave amplitude of the Matsuoka oscillator can be independently controlled under different time scales, we further adapt the option-critic framework to improve the learning performance measured by optimality and data efficiency. The performance of the proposed controller is experimentally validated with both simulated and real soft snake robots.  more » « less
Award ID(s):
1728412
NSF-PAR ID:
10301484
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Page Range / eLocation ID:
7758 to 7765
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Snake robotics is an important research topic with a wide range of applications, including inspection in confined spaces, search-and-rescue, and disaster response. Snake robots are well-suited to these applications because of their versatility and adaptability to unstructured and constrained environments. In this paper, we introduce a soft pneumatic robotic snake that can imitate the capabilities of biological snakes, its soft body can provide flexibility and adaptability to the environment. This paper combines soft mobile robot modeling, proprioceptive feedback control, and motion planning to pave the way for functional soft robotic snake autonomy. We propose a pressure-operated soft robotic snake with a high degree of modularity that makes use of customized embedded flexible curvature sensing. On this platform, we introduce the use of iterative learning control using feedback from the on-board curvature sensors to enable the snake to automatically correct its gait for superior locomotion. We also present a motion planning and trajectory tracking algorithm using an adaptive bounding box, which allows for efficient motion planning that still takes into account the kinematic state of the soft robotic snake. We test this algorithm experimentally, and demonstrate its performance in obstacle avoidance scenarios. 
    more » « less
  2. Martínez-García, Edgar (Ed.)
    This paper presents the design, development, and testing of a robot that combines soft-body grasping and crawling locomotion to navigate tubular objects. Inspired by the natural snakes’ climbing locomotion of tubular objects, the soft robot includes proximal and distal modules with radial expansion/contraction for grasping around the objects and a longitudinal contractile–expandable driving module in-between for providing a bi-directional crawling movement along the length of the object. The robot’s grasping modules are made of fabrics, and the crawling module is made of an extensible pneumatic soft actuator (ePSA). Conceptual designs and CAD models of the robot parts, textile-based inflatable structures, and pneumatic driving mechanisms were developed. The mechanical parts were fabricated using advanced and conventional manufacturing techniques. An Arduino-based electro-pneumatic control board was developed for generating cyclic patterns of grasping and locomotion. Different reinforcing patterns and materials characterize the locomotor actuators’ dynamical responses to the varying input pressures. The robot was tested in a laboratory setting to navigate a cable, and the collected data were used to modify the designs and control software and hardware. The capability of the soft robot for navigating cables in vertical, horizontal, and curved path scenarios was successfully demonstrated. Compared to the initial design, the forward speed is improved three-fold. 
    more » « less
  3. The locomotion of soft snake robots is dependent on frictional interactions with the environment. Frictional anisotropy is a morphological characteristic of snakeskin that allows snakes to engage selectively with surfaces and generate propulsive forces. The prototypical slithering gait of most snakes is lateral undulation, which requires a significant lateral resistance that is lacking in artificial skins of existing soft snake robots. We designed a set of kirigami lattices with curvilinearly-arranged cuts to take advantage of in-plane rotations of the 3D structures when wrapped around a soft bending actuator. By changing the initial orientation of the scales, the kirigami skin produces high lateral friction upon engagement with surface asperities, with lateral to cranial anisotropic friction ratios above 4. The proposed design increased the overall velocity of the soft snake robot more than fivefold compared to robots without skin. 
    more » « less
  4. Soft robotic snakes made of compliant materials can continuously deform their bodies and, therefore, mimic the biological snakes' flexible and agile locomotion gaits better than their rigid-bodied counterparts. Without wheel support, to date, soft robotic snakes are limited to emulating planar locomotion gaits, which are derived via kinematic modeling and tested on robotic prototypes. Given that the snake locomotion results from the reaction forces due to the distributed contact between their skin and the ground, it is essential to investigate the locomotion gaits through efficient dynamic models capable of accommodating distributed contact forces. We present a complete spatial dynamic model that utilizes a floating-base kinematic model with distributed contact dynamics for a pneumatically powered soft robotic snake. We numerically evaluate the feasibility of the planar and spatial rolling gaits utilizing the proposed model and experimentally validate the corresponding locomotion gait trajectories on a soft robotic snake prototype. We qualitatively and quantitatively compare the numerical and experimental results which confirm the validity of the proposed dynamic model. 
    more » « less
  5. Conventional catheter- or probe-based in vivo biomedical sensing is uncomfortable, inconvenient, and sometimes infeasible for longterm monitoring. Existing implantable sensors often require an invasive procedure for sensor placement. Untethered soft robots with the capability to deliver the sensor to the desired monitoring point hold great promise for minimally invasive biomedical sensing. Inspired by the locomotion modes of snakes, we present here a soft kirigami robot for sensor deployment and real-time wireless sensing. The locomotion mechanism of the soft robot is achieved by kirigami patterns that offer asymmetric tribological properties that mimic the skin of the snake. The robot exhibits good deployability, excellent load capacity (up to 150 times its own weight), high-speed locomotion (0.25 body length per step), and wide environmental adaptability with multimodal movements (obstacle crossing, locomotion in wet and dry conditions, climbing, and inverted crawling). When integrated with passive sensors, the versatile soft robot can locomote inside the human body, deliver the passive sensor to the desired location, and hold the sensor in place for real-time monitoring in a minimally invasive manner. The proof-of-concept prototype demonstrates that the platform can perform real-time impedance monitoring for the diagnosis of gastroesophageal reflux disease. 
    more » « less