An official website of the United States government
Recent studies on quadruped robots have focused on either locomotion or mobile manipulation using a robotic arm. However, legged robots can manipulate large objects using non-prehensile manipulation primitives, such as planar pushing, to drive the object to the desired location. This paper presents a novel hierarchical model predictive control (MPC) for contact optimization of the manipulation task. Using two cascading MPCs, we split the loco-manipulation problem into two parts: the first to optimize both contact force and contact location between the robot and the object, and the second to regulate the desired interaction force through the robot locomotion. Our method is successfully validated in both simulation and hardware experiments. While the baseline locomotion MPC fails to follow the desired trajectory of the object, our proposed approach can effectively control both object's position and orientation with minimal tracking error. This capability also allows us to perform obstacle avoidance for both the robot and the object during the loco-manipulation task.
more »
« less
Hierarchical Optimization-based Control for Whole-body Loco-manipulation of Heavy Objects
In recent years, the field of legged robotics has seen growing interest in enhancing the capabilities of these robots through the integration of articulated robotic arms. However, achieving successful loco-manipulation, especially involving interaction with heavy objects, is far from straightforward, as object manipulation can introduce substantial disturbances that impact the robot’s locomotion. This paper presents a novel framework for legged loco-manipulation that considers whole-body coordination through a hierarchical optimization-based control framework. First, an online manipulation planner computes the manipulation forces and manipulated object task-based reference trajectory. Then, pose optimization aligns the robot’s trajectory with kinematic constraints. The resultant robot reference trajectory is executed via a linear MPC controller incorporating the desired manipulation forces into its prediction model. Our approach has been validated in simulation and hardware experiments, highlighting the necessity of whole-body optimization compared to the baseline locomotion MPC when interacting with heavy objects. Experimental results with Unitree Aliengo, equipped with a custom-made robotic arm, showcase its ability to lift and carry an 8kg payload and manipulate doors.
more »
« less
- Award ID(s):
- 2133091
- PAR ID:
- 10534277
- Publisher / Repository:
- IEEE
- Date Published:
- ISBN:
- 979-8-3503-8457-4
- Page Range / eLocation ID:
- 15322 to 15328
- Format(s):
- Medium: X
- Location:
- Yokohama, Japan
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Legged robots have shown remarkable advantages in navigating uneven terrain. However, realizing effective loco-motion and manipulation tasks on quadruped robots is still challenging. In addition, object and terrain parameters are generally unknown to the robot in these problems. Therefore, this paper proposes a hierarchical adaptive control framework that enables legged robots to perform loco-manipulation tasks without any given assumption on the object's mass, the friction coefficient, or the slope of the terrain. In our approach, we first present an adaptive manipulation control to regulate the contact force to manipulate an unknown object on unknown terrain. We then introduce a unified model predictive control (MPC) for loco-manipulation that takes into account the manipulation force in our robot dynamics. The proposed MPC framework thus can effectively regulate the interaction force between the robot and the object while keeping the robot balance. Experimental validation of our proposed approach is successfully conducted on a Unitree A1 robot, allowing it to manipulate an unknown time-varying load up to 7 kg (60% of the robot's weight). Moreover, our framework enables fast adaptation to unknown slopes or different surfaces with different friction coefficients.more » « less
-
Legged robots have the advantage of being able to maneuver rough, unstructured terrains unlike their wheeled counterparts. However, many legged robots require multiple sensors and online computations to specify the gait, trajectory or contact forces in real-time for a given terrain, and these methods can break down when sensory information is unreliable or not available. Over the years, underactuated mechanisms have demonstrated great success in object grasping and manipulation tasks due to their ability to passively adapt to the geometry of the objects without sensors. In this paper, we present an application of underactuation in the design of a legged robot with prismatic legs that maneuvers unstructured terrains under open-loop control using only four actuators – one for stance for each half of the robot, one for forward translation, and one for steering. Through experimental results, we show that prismatic legs can support a statically stable stance and can facilitate locomotion over unstructured terrain while maintaining its body posture.more » « less
-
We introduce Vysics, a vision-and-physics framework for a robot to build an expressive geometry and dynamics model of a single rigid body, using a seconds-long RGBD video and the robot’s proprioception. While the computer vision community has built powerful visual 3D perception algorithms, cluttered environments with heavy occlusions can limit the visibility of objects of interest. However, observed motion of partially occluded objects can imply physical interactions took place, such as contact with a robot or the environment. These inferred contacts can supplement the visible geometry with "physible geometry," which best explains the observed object motion through physics. Vysics uses a vision-based tracking and reconstruction method, BundleSDF, to estimate the trajectory and the visible geometry from an RGBD video, and an odometry-based model learning method, Physics Learning Library (PLL), to infer the "physible" geometry from the trajectory through implicit contact dynamics optimization. The visible and "physible" geometries jointly factor into optimizing a signed distance function (SDF) to represent the object shape. Vysics does not require pretraining, nor tactile or force sensors. Compared with vision-only methods, Vysics yields object models with higher geometric accuracy and better dynamics prediction in experiments where the object interacts with the robot and the environment under heavy occlusion.more » « less
-
Abstract Legged robots have a unique capability of traversing rough terrains and negotiating cluttered environments. Recent control development of legged robots has enabled robust locomotion on rough terrains. However, such approaches mainly focus on maintaining balance for the robot body. In this work, we are interested in leveraging the whole body of the robot to pass through a permeable obstacle (e.g., a small confined opening) with height, width, and terrain constraints. This paper presents a planning framework for legged robots manipulating their body and legs to perform collision-free locomotion through a permeable obstacle. The planner incorporates quadrupedal gait constraint, biasing scheme, and safety margin for the simultaneous body and foothold motion planning. We perform informed sampling for the body poses and swing foot position based on the gait constraint while ensuring stability and collision avoidance. The footholds are planned based on the terrain and the contact constraint. We also integrate the planner with robot control to execute the planned trajectory successfully. We validated our approach in high-fidelity simulation and hardware experiments on the Unitree A1 robot navigating through different representative permeable obstacles.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/ICRA57147.2024.10611656
