In this paper, we develop a novel and safe control design approach that takes demonstrations provided by a human teacher to enable a robot to accomplish complex manipulation scenarios in dynamic environments. First, an overall task is divided into multiple simpler subtasks that are more appropriate for learning and control objectives. Then, by collecting human demonstrations, the subtasks that require robot movement are modeled by probabilistic movement primitives (ProMPs). We also study two strategies for modifying the ProMPs to avoid collisions with environmental obstacles. Finally, we introduce a rule-base control technique by utilizing a finite-state machine along with a unique means of control design for ProMPs. For the ProMP controller, we propose control barrier and Lyapunov functions to guide the system along a trajectory within the distribution defined by a ProMP while guaranteeing that the system state never leaves more than a desired distance from the distribution mean. This allows for better performance on nonlinear systems and offers solid stability and known bounds on the system state. A series of simulations and experimental studies demonstrate the efficacy of our approach and show that it can run in real time. Note to Practitioners —This paper is motivated by the need to create a teach-by-demonstration framework that captures the strengths of movement primitives and verifiable, safe control. We provide a framework that learns safe control laws from a probability distribution of robot trajectories through the use of advanced nonlinear control that incorporates safety constraints. Typically, such distributions are stochastic, making it difficult to offer any guarantees on safe operation. Our approach ensures that the distribution of allowed robot trajectories is within an envelope of safety and allows for robust operation of a robot. Furthermore, using our framework various probability distributions can be combined to represent complex scenarios in the environment. It will benefit practitioners by making it substantially easier to test and deploy accurate, efficient, and safe robots in complex real-world scenarios. The approach is currently limited to scenarios involving static obstacles, with dynamic obstacle avoidance an avenue of future effort.
more »
« less
Learning Environment Constraints in Collaborative Robotics: A Decentralized Leader-Follower Approach
In this paper, we propose a leader-follower hierarchical strategy for two robots collaboratively transporting an object in a partially known environment with obstacles. Both robots sense the local surrounding environment and react to obstacles in their proximity. We consider no explicit communication, so the local environment information and the control actions are not shared between the robots. At any given time step, the leader solves a model predictive control (MPC) problem with its known set of obstacles and plans a feasible trajectory to complete the task. The follower estimates the inputs of the leader and uses a policy to assist the leader while reacting to obstacles in its proximity. The leader infers obstacles in the follower’s vicinity by using the difference between the predicted and the real-time estimated follower control action. A method to switch the leader-follower roles is used to improve the control performance in tight environments. The efficacy of our approach is demonstrated with detailed comparisons to two alternative strategies, where it achieves the highest success rate, while completing the task fastest.
more »
« less
- Award ID(s):
- 1931853
- NSF-PAR ID:
- 10338160
- Date Published:
- Journal Name:
- 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
- Page Range / eLocation ID:
- 1636 to 1641
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
During in-hand manipulation, robots must be able to continuously estimate the pose of the object in order to generate appropriate control actions. The performance of algorithms for pose estimation hinges on the robot's sensors being able to detect discriminative geometric object features, but previous sensing modalities are unable to make such measurements robustly. The robot's fingers can occlude the view of environment- or robot-mounted image sensors, and tactile sensors can only measure at the local areas of contact. Motivated by fingertip-embedded proximity sensors' robustness to occlusion and ability to measure beyond the local areas of contact, we present the first evaluation of proximity sensor based pose estimation for in-hand manipulation. We develop a novel two-fingered hand with fingertip-embedded optical time-of-flight proximity sensors as a testbed for pose estimation during planar in-hand manipulation. Here, the in-hand manipulation task consists of the robot moving a cylindrical object from one end of its workspace to the other. We demonstrate, with statistical significance, that proximity-sensor based pose estimation via particle filtering during in-hand manipulation: a) exhibits 50% lower average pose error than a tactile-sensor based baseline; b) empowers a model predictive controller to achieve 30% lower final positioning error compared to when using tactile-sensor based pose estimates.more » « less
-
more » « less
Abstract Leader-follower relationships are commonly hypothesized as a fundamental mechanism underlying collective behaviour in many biological and physical systems. Understanding the emergence of such behaviour is relevant in science and engineering to control the dynamics of complex systems toward a desired state. In prior works, due in part to the limitations of existing methods for dissecting intermittent causal relationships, leadership is assumed to be consistent in time and space. This assumption has been contradicted by recent progress in the study of animal behaviour. In this work, we leverage information theory and time series analysis to propose a novel and simple method for dissecting changes in causal influence. Our approach computes the cumulative influence function of a given individual on the rest of the group in consecutive time intervals and identify change in the monotonicity of the function as a change in its leadership status. We demonstrate the effectiveness of our approach to dissect potential changes in leadership on self-propelled particles where the emergence of leader-follower relationship can be controlled and on tandem flights of birds recorded in their natural environment. Our method is expected to provide a novel methodological tool to further our understanding of collective behaviour.
-
Grab bars have been widely used for assisting elderly people with mobility and providing support for daily activities. This work aims to expand the notion of grab bars beyond fixed installations by the use of a mobile robot that can place a handlebar at any point in space, to optimally support postural transitions. A survey of elderly people and care professionals indicated that such a device must be sturdy, providing secure support without sliding or tipping over, yet also have a compact footprint to be maneuverable within confined spaces. Here, we propose a novel two-body robot structure, consisting of two small-footprint mobile bases connected by a four bar linkage where handlebars are mounted. Each base measures only 29.2 cm wide, making the robot likely the slimmest ever developed for mobile postural assistance. Through kinematic analysis, it is shown that the two-body structure can bear the entire weight of a human body, meeting required load bearing specifications as a handlebar. A control plan is proposed that is generalizable to all robots with two nonholonomic mobile bases connected by a coupling mechanism. This consists of a leader-follower scheme, in which the bases are connected by a virtual spring, as well as various enhancements to waypoint tracking and dead reckoning that allow the robot to smoothly and accurately follow a series of waypoints. A prototype robot is constructed, and its performance is validated experimentally.more » « less
-
This work provides a decentralized approach to safety by combining tools from control barrier functions (CBF) and nonlinear model predictive control (NMPC). It is shown how leveraging backup safety controllers allows for the robust implementation of CBF over the NMPC computation horizon, ensuring safety in nonlinear systems with actuation constraints. A leader-follower approach to control barrier functions (LFCBF) enforcement will be introduced as a strategy to enable a robot leader, in a multi-robot interactions, to complete its task in minimum time, hence aggressively maneuvering. An algorithmic implementation of the proposed solution is provided and safety is verified via simulation.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/IROS51168.2021.9636444
