skip to main content


Title: Automated Design of Simple and Robust Manipulators for Dexterous In-Hand Manipulation Tasks using Evolutionary Strategies
In spite of substantial progress, robust and dexterous in-hand manipulation remains a robotics grand challenge. Recent research has shown that optimization of robot hand morphology for specific tasks can result in custom hand designs that are low-cost, easy to maintain, and highly capable. However, the resulting manipulation strategies may not be very robust or generalizable in real-world situations. This paper shows that robustness can be improved dramatically by optimizing controls instead of contact force / trajectories and by considering uncertainty explicitly during the optimization process. We present a evolutionary algorithm based pipeline for co-optimizing hand morphology and control strategy over families of problems and initial states in order to achieve robust in-hand manipulation. We demonstrate that this approach produces robust results which utilize all surfaces of the hand and surprising dynamic motions. We showcase the advantage of optimizing joint limit values to create robust designs. Furthermore, we demonstrate that our approach is complementary to trajectory optimization based approaches and can be utilized to improve robustness of such results as well as to create custom hand designs from scratch. Results are shown for repositioning and reorienting diverse objects relative to the palm of the hand.  more » « less
Award ID(s):
1637853
NSF-PAR ID:
10201825
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
2019 IEEE-RAS 19th International Conference on Humanoid Robots (Humanoids)
Page Range / eLocation ID:
281 to 288
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    There has been an explosion of ideas in soft robotics over the past decade, resulting in unprecedented opportunities for end effector design. Soft robot hands offer benefits of low-cost, compliance, and customized design, with the promise of dexterity and robustness. The space of opportunities is vast and exciting. However, new tools are needed to understand the capabilities of such manipulators and to facilitate manipulation planning with soft manipulators that exhibit free-form deformations. To address this challenge, we introduce a sampling based approach to discover and model continuous families of manipulations for soft robot hands. We give an overview of the soft foam robots in production in our lab and describe novel algorithms developed to characterize manipulation families for such robots. Our approach consists of sampling a space of manipulation actions, constructing Gaussian Mixture Model representations covering successful regions, and refining the results to create continuous successful regions representing the manipulation family. The space of manipulation actions is very high dimensional; we consider models with and without dimensionality reduction and provide a rigorous approach to compare models across different dimensions by comparing coverage of an unbiased test dataset in the full dimensional parameter space. Results show that some dimensionality reduction is typically useful in populating the models, but without our technique, the amount of dimensionality reduction to use is difficult to predict ahead of time and can depend on the hand and task. The models we produce can be used to plan and carry out successful, robust manipulation actions and to compare competing robot hand designs. 
    more » « less
  2. null (Ed.)
    Grasp planning and motion synthesis for dexterous manipulation tasks are traditionally done given a pre-existing kinematic model for the robotic hand. In this paper, we introduce a framework for automatically designing hand topologies best suited for manipulation tasks given high-level objectives as input. Our pipeline is capable of building custom hand designs around specific manipulation tasks based on high-level user input. Our framework comprises of a sequence of trajectory optimizations chained together to translate a sequence of objective poses into an optimized hand mechanism along with a physically feasible motion plan involving both the constructed hand and the object. We demonstrate the feasibility of this approach by synthesizing a series of hand designs optimized to perform specified in-hand manipulation tasks of varying difficulty. We extend our original pipeline 32 to accommodate the construction of hands suitable for multiple distinct manipulation tasks as well as provide an in depth discussion of the effects of each non-trivial optimization term. 
    more » « less
  3. A robust multi-functional framework for widespread planning of nature-based solutions (NBS) must incorporate components of social equity and hydro-environmental performance in a cost-effective manner. NBS systems address stormwater mitigation by increasing on-site infiltration and evaporation through enhanced greenspace while also improving various components of societal well-being, such as physical health (e.g., heart disease, diabetes), mental health (e.g., post-traumatic stress disorder, depression), and social cohesion. However, current optimization tools for NBS systems rely on stormwater quantity abatement and, to a lesser extent, economic costs and environmental pollutant mitigation. Therefore, the objective of this study is to explore how NBS planning may be improved to maximize hydrological, environmental, and social co-benefits in an unequivocal and equitable manner. Here, a novel equity-based indexing framework is proposed to better understand how we might optimize social and physical functionalities of NBS systems as a function of transdisciplinary characteristics. Specifically, this study explores the spatial tradeoffs associated with NBS allocation by first optimizing a local watershed-scale model according to traditional metrics of stormwater efficacy (e.g., cost efficiency, hydrological runoff reduction, and pollutant load reduction) using SWMM modeling. The statistical dispersion of social health is then identified using the Area Deprivation Index (ADI), which is a high-resolution spatial account of socioeconomic disadvantages that have been linked to adverse health outcomes, according to United States census properties. As NBSs have been shown to mitigate various adverse health conditions through increased urban greening, this improved understanding of geospatial health characteristics may be leveraged to inform an explicit representation of social wellness within NBS planning frameworks. This study presents and demonstrates a novel framework for integrating hydro-environmental modeling, economic efficiency, and social health deprivation using a dimensionless Gini coefficient, which is intended to spur the positive connection of social and physical influences within robust NBS planning. Hydro-environmental risk (according to hydro-dynamic modeling) and social disparity (according to ADI distribution) are combined within a common measurement unit to capture variation across spatial domains and to optimize fair distribution across the study area. A comparison between traditional SWMM-based optimization and the proposed Gini-based framework reveals how the spatial allocation of NBSs within the watershed may be structured to address significantly more areas of social health deprivation while achieving similar hydro-environmental performance and cost-efficiency. The results of a case study for NBS planning in the White Oak Bayou watershed in Houston, Texas, USA revealed runoff volume reductions of 3.45% and 3.38%, pollutant load reductions of 11.15% and 11.28%, and ADI mitigation metrics of 16.84% and 35.32% for the SWMM-based and the Gini-based approaches, respectively, according to similar cost expenditures. As such, the proposed framework enables an analytical approach for balancing the spatial tradeoffs of overlapping human-water goals in NBS planning while maintaining hydro-environmental robustness and economic efficiency. 
    more » « less
  4. Graph neural networks (GNNs) are widely used in many applications. However, their robustness against adversarial attacks is criticized. Prior studies show that using unnoticeable modifications on graph topology or nodal features can significantly reduce the performances of GNNs. It is very challenging to design robust graph neural networks against poisoning attack and several efforts have been taken. Existing work aims at reducing the negative impact from adversarial edges only with the poisoned graph, which is sub-optimal since they fail to discriminate adversarial edges from normal ones. On the other hand, clean graphs from similar domains as the target poisoned graph are usually available in the real world. By perturbing these clean graphs, we create supervised knowledge to train the ability to detect adversarial edges so that the robustness of GNNs is elevated. However, such potential for clean graphs is neglected by existing work. To this end, we investigate a novel problem of improving the robustness of GNNs against poisoning attacks by exploring clean graphs. Specifically, we propose PA-GNN, which relies on a penalized aggregation mechanism that directly restrict the negative impact of adversarial edges by assigning them lower attention coefficients. To optimize PA-GNN for a poisoned graph, we design a meta-optimization algorithm that trains PA-GNN to penalize perturbations using clean graphs and their adversarial counterparts, and transfers such ability to improve the robustness of PA-GNN on the poisoned graph. Experimental results on four real-world datasets demonstrate the robustness of PA-GNN against poisoning attacks on graphs. 
    more » « less
  5. This paper presents SVIn2, a novel tightly-coupled keyframe-based Simultaneous Localization and Mapping (SLAM) system, which fuses Scanning Profiling Sonar, Visual, Inertial, and water-pressure information in a non-linear optimization framework for small and large scale challenging underwater environments. The developed real-time system features robust initialization, loop-closing, and relocalization capabilities, which make the system reliable in the presence of haze, blurriness, low light, and lighting variations, typically observed in underwater scenarios. Over the last decade, Visual-Inertial Odometry and SLAM systems have shown excellent performance for mobile robots in indoor and outdoor environments, but often fail underwater due to the inherent difficulties in such environments. Our approach combats the weaknesses of previous approaches by utilizing additional sensors and exploiting their complementary characteristics. In particular, we use (1) acoustic range information for improved reconstruction and localization, thanks to the reliable distance measurement; (2) depth information from water-pressure sensor for robust initialization, refining the scale, and assisting to limit the drift in the tightly-coupled integration. The developed software—made open source—has been successfully used to test and validate the proposed system in both benchmark datasets and numerous real world underwater scenarios, including datasets collected with a custom-made underwater sensor suite and an autonomous underwater vehicle Aqua2. SVIn2 demonstrated outstanding performance in terms of accuracy and robustness on those datasets and enabled other robotic tasks, for example, planning for underwater robots in presence of obstacles.

     
    more » « less