skip to main content


This content will become publicly available on May 31, 2024

Title: Controlling the Shape of Soft Robots Using the Koopman Operator
In nature, animals with soft body parts demonstrate remarkable control over their shape, such as an elephant trunk wrapping around a tree branch to pick it up. However, most research on robotic manipulators focuses on controlling the end effector, partly because the manipulator’s arm is rigidly articulated. With recent advances in soft robotics research, controlling a soft manipulator into many different shapes will significantly improve the robot’s functionality, such as medical robots morphing their shape to navigate the digestive system and deliver drugs to specific locations. However, controlling the shape of soft robots is challenging due to their highly nonlinear dynamics that are computationally intensive. In this paper, we leverage a physics-informed, data-driven approach using the Koopman operator to realize the shape control of soft robots. We simulate the dynamics of a soft manipulator using a physics-based simulator (PyElastica) to generate the input-output data, which is then used to identify an approximated linear model based on the Koopman operator. We then formulate the shapecontrol problem as a convex optimization problem that is computationally efficient. Our linear model is over 12 times faster than the physics-based model in simulating the manipulator’s motion. Further, we can control a soft manipulator into different shapes using model predictive control. We envision that the proposed method can be effectively used to control the shapes of soft robots to interact with uncertain environments or enable shape-morphing robots to fulfill diverse tasks.  more » « less
Award ID(s):
2126039
NSF-PAR ID:
10477135
Author(s) / Creator(s):
; ;
Publisher / Repository:
IEEE
Date Published:
Journal Name:
2023 American Control Conference (ACC)
Page Range / eLocation ID:
153 to 158
Format(s):
Medium: X
Location:
San Diego, CA, USA
Sponsoring Org:
National Science Foundation
More Like this
  1. Soft robots promise improved safety and capability over rigid robots when deployed near humans or in complex, delicate, and dynamic environments. However, infinite degrees of freedom and the potential for highly nonlinear dynamics severely complicate their modeling and control. Analytical and machine learning methodologies have been applied to model soft robots but with constraints: quasi-static motions, quasi-linear deflections, or both. Here, we advance the modeling and control of soft robots into the inertial, nonlinear regime. We controlled motions of a soft, continuum arm with velocities 10 times larger and accelerations 40 times larger than those of previous work and did so for high-deflection shapes with more than 110° of curvature. We leveraged a data-driven learning approach for modeling, based on Koopman operator theory, and we introduce the concept of the static Koopman operator as a pregain term in optimal control. Our approach is rapid, requiring less than 5 min of training; is computationally low cost, requiring as little as 0.5 s to build the model; and is design agnostic, learning and accurately controlling two morphologically different soft robots. This work advances rapid modeling and control for soft robots from the realm of quasi-static to inertial, laying the groundwork for the next generation of compliant and highly dynamic robots.

     
    more » « less
  2. Abstract Purpose of Review

    We review recent advances in algorithmic development and validation for modeling and control of soft robots leveraging the Koopman operator theory.

    Recent Findings

    We identify the following trends in recent research efforts in this area. (1) The design of lifting functions used in the data-driven approximation of the Koopman operator is critical for soft robots. (2) Robustness considerations are emphasized. Works are proposed to reduce the effect of uncertainty and noise during the process of modeling and control. (3) The Koopman operator has been embedded into different model-based control structures to drive the soft robots.

    Summary

    Because of their compliance and nonlinearities, modeling and control of soft robots face key challenges. To resolve these challenges, Koopman operator-based approaches have been proposed, in an effort to express the nonlinear system in a linear manner. The Koopman operator enables global linearization to reduce nonlinearities and/or serves as model constraints in model-based control algorithms for soft robots. Various implementations in soft robotic systems are illustrated and summarized in the review.

     
    more » « less
  3. null (Ed.)
    Thanks to their flexibility, soft robotic devices offer critical advantages over rigid robots, allowing adaptation to uncertainties in the environment. As such, soft robots enable various intriguing applications, including human-safe interaction devices, soft active rehabilitation devices, and soft grippers for pick-and-place tasks in industrial environments. In most cases, soft robots use pneumatic actuation to inflate the channels in a compliant material to obtain the movement of the structure. However, due to their flexibility and nonlinear behavior, as well as the compressibility of air, controlled movements of the soft robotic structure are difficult to attain. Obtaining physically-based mathematical models, which would enable the development of suitable control approaches for soft robots, constitutes thus a critical challenge in the field. The aim of this work is, therefore, to predict the movement of a pneumatic soft robot by using a data-driven approach based on the Koopman operator framework. The Koopman operator allows simplifying a nonlinear system by“lifting” its dynamics into a higher dimensional space, where its behavior can be accurately approximated by a linear model, thus allowing a significant reduction of the complexity of the design of the resulting controllers. 
    more » « less
  4. Abstract

    Controlling the deformation of a soft body has potential applications in fields requiring precise control over the shape of the body. Areas such as medical robotics can use the shape control of soft robots to repair aneurysms in humans, deliver medicines within the body, among other applications. However, given known external loading, it is usually not possible to deform a soft body into arbitrary shapes if it is fabricated using only a single material. In this work, we propose a new physics-based method for the computational design of soft hyperelastic bodies to address this problem. The method takes as input an undeformed shape of a body, a specified external load, and a user desired final shape. It then solves an inverse problem in design using nonlinear optimization subject to physics constraints. The nonlinear program is solved using a gradient-based interior-point method. Analytical gradients are computed for efficiency. The method outputs fields of material properties which can be used to fabricate a soft body. A body fabricated to match this material field is expected to deform into a user-desired shape, given the same external loading input. Two regularizers are used to ascribea prioricharacteristics of smoothness and contrast, respectively, to the spatial distribution of material fields. The performance of the method is tested on three example cases in silico.

     
    more » « less
  5. Interest in soft robotics has increased in recent years due to their potential in a myriad of applications. A wide variety of soft robots has emerged, including bio-inspired robotic swimmers such as jellyfish, rays, and robotic fish. However, the highly nonlinear fluid-structure interactions pose considerable challenges in the analysis, modeling, and feedback control of these soft robotic swimmers. In particular, developing models that are of high fidelity but are also amenable to control for such robots remains an open problem. In this work, we pro- pose a data-driven approach that exploits Koopman operators to obtain a linear representation of the soft swimmer dynamics. Specifically, two methodologies are explored for obtaining the basis functions of the the operator, one based on data-based derivatives estimated using high-gain observers, and the other based on the dynamics structure of a tail-actuated rigid-body robotic fish. The resulting approximate finite-dimensional operators are trained and evaluated using data from high-fidelity CFD simulations that incorporate fluid-structure interactions. Validation results demonstrate that, while both methods are promising in producing control-oriented models, the approach based on derivative estimates shows higher accuracy in state prediction. 
    more » « less