skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Contact Edit: Artist Tools for Intuitive Modeling of Hand-Object Interactions
Posing high-contact interactions is challenging and time-consuming, with hand-object interactions being especially difficult due to the large number of degrees of freedom (DOF) of the hand and the fact that humans are experts at judging hand poses. This paper addresses this challenge by elevating contact areas to first-class primitives. We provideend-to-end art-directable(EAD) tools to model interactions based on contact areas, directly manipulate contact areas, and compute corresponding poses automatically. To make these operations intuitive and fast, we present a novel axis-based contact model that supports real-time approximately isometry-preserving operations on triangulated surfaces, permits movement between surfaces, and is both robust and scalable to large areas. We show that use of our contact model facilitates high quality posing even for unconstrained, high-DOF custom rigs intended for traditional keyframe-based animation pipelines. We additionally evaluate our approach with comparisons to prior art, ablation studies, user studies, qualitative assessments, and extensions to full-body interaction.  more » « less
Award ID(s):
1925130
PAR ID:
10601475
Author(s) / Creator(s):
 ;  ;  ;  ;  
Publisher / Repository:
Association for Computing Machinery (ACM)
Date Published:
Journal Name:
ACM Transactions on Graphics
Volume:
42
Issue:
4
ISSN:
0730-0301
Format(s):
Medium: X Size: p. 1-20
Size(s):
p. 1-20
Sponsoring Org:
National Science Foundation
More Like this
  1. Ground contact modeling for multilegged locomotion is challenging due to the possibility of multiple slipping legs. To understand the interplay of contact forces among multiple legs, we integrated a robot with six high-precision 6 degree-of-freedom (DoF) force-torque sensors, and measured the wrenches (forces and torques) produced in practice. Here, we present an in situ calibration procedure for simultaneously measuring all foot contact wrenches of a hexapod using 6-DoF load cells installed at the hips. We characterized transducer offset, leg gravity offset, and the wrench transformation error in our calibration model. Our calibration reduced the root-mean-square-error (RSME) by 63% for forces and 90% for torques in the residuals of the robot standing in different poses, compared with naive constant offset removal. 
    more » « less
  2. Past decades featured significant advancements in additive and micromanufacturing that facilitated the creation of functional patterned surfaces with impressive spatial resolutions. However, these techniques are expensive and require a considerable amount of time and energy, and hence lack scalability to practical surfaces. Recent techniques employing spinodal decomposition and instabilities amplified via centrifugal acceleration offer viable and cheaper alternatives. The patterns created by those techniques, however, vary randomly in geometry. When interfacing those patterned surfaces with other components and under self-contact scenarios, geometric variations lead to stress concentration and abrupt failure around the contact. In this study, we investigate numerically real contact areas, contact tractions, and stress concentration. We generate patterned surfaces in congruence with actual surfaces created by those techniques. Then, we conduct normal-contact analyses of those surfaces boundary element method (BEM) under nominal mean pressures ranging from 0.001E* toE*, whereE* is the contact modulus. We record real contact areas and stress concentration as a function of nominal mean pressures. We compare these values with the analytical solutions from sinusoidally-patterned and randomly rough surfaces. Randomness in pattern geometry is primarily influenced by the processing parameters such as the degree of anisotropy in spinodal decomposition and acceleration in amplified instabilities. To understand the influence of the processing parameters, we perform a parametric study. We find isotropic spinodal decomposition creates patterns that deliver contact area and traction distributions similar to randomly rough surfaces, and lead to high-stress concentrations. Such high-stress concentrations are expected to occur under self-contact loading scenarios, and thus can explain the compromised resilience and strength in recently-proposed spinodal metamaterials. For patterned surfaces created by amplified instabilities, high-stress concentrations are obtained for the surfaces created at high accelerations. At high accelerations, increased elastic instabilities and stochastic growth result in a more skewed and broader distribution in heights. Therefore, high-stress concentrations are inevitable. To account for combined loading scenarios, we conduct additional simulations on the same surface patterns with frictional pre-sliding contacts. We find the frictional tractions play a secondary role in stress concentrations where the primary factor is the processing parameters determining the degree of randomness in pattern geometry. 
    more » « less
  3. Across a plethora of social situations, we touch others in natural and intuitive ways to share thoughts and emotions, such as tapping to get one’s attention or caressing to soothe one’s anxiety. A deeper understanding of these human-to-human interactions will require, in part, the precise measurement of skin-to-skin physical contact. Among prior efforts, each measurement approach exhibits certain constraints, e.g., motion trackers do not capture the precise shape of skin surfaces, while pressure sensors impede skin-to-skin contact. In contrast, this work develops an interference-free 3D visual tracking system using a depth camera to measure the contact attributes between the bare hand of a toucher and the forearm of a receiver. The toucher’s hand is tracked as a posed and positioned mesh by fitting a hand model to detected 3D hand joints, whereas a receiver’s forearm is extracted as a 3D surface updated upon repeated skin contact. Based on a contact model involving point clouds, the spatiotemporal changes of hand-to-forearm contact are decomposed as six, high-resolution, time-series contact attributes, i.e., contact area, indentation depth, absolute velocity, and three orthogonal velocity components, together with contact duration. To examine the system’s capabilities and limitations, two types of experiments were performed. First, to evaluate its ability to discern human touches, one person delivered cued social messages, e.g., happiness, anger, sympathy, to another person using their preferred gestures. The results indicated that messages and gestures, as well as the identities of the touchers, were readily discerned from their contact attributes. Second, the system’s spatiotemporal accuracy was validated against measurements from independent devices, including an electromagnetic motion tracker, sensorized pressure mat, and laser displacement sensor. While validated here in the context of social communication, this system is extendable to human touch interactions such as maternal care of infants and massage therapy. 
    more » « less
  4. We consider the problem of in-hand dexterous manipulation with a focus on unknown or uncertain hand–object parameters, such as hand configuration, object pose within hand, and contact positions. In particular, in this work we formulate a generic framework for hand–object configuration estimation using underactuated hands as an example. Owing to the passive reconfigurability and the lack of encoders in the hand’s joints, it is challenging to estimate, plan, and actively control underactuated manipulation. By modeling the grasp constraints, we present a particle filter-based framework to estimate the hand configuration. Specifically, given an arbitrary grasp, we start by sampling a set of hand configuration hypotheses and then randomly manipulate the object within the hand. While observing the object’s movements as evidence using an external camera, which is not necessarily calibrated with the hand frame, our estimator calculates the likelihood of each hypothesis to iteratively estimate the hand configuration. Once converged, the estimator is used to track the hand configuration in real time for future manipulations. Thereafter, we develop an algorithm to precisely plan and control the underactuated manipulation to move the grasped object to desired poses. In contrast to most other dexterous manipulation approaches, our framework does not require any tactile sensing or joint encoders, and can directly operate on any novel objects, without requiring a model of the object a priori. We implemented our framework on both the Yale Model O hand and the Yale T42 hand. The results show that the estimation is accurate for different objects, and that the framework can be easily adapted across different underactuated hand models. In the end, we evaluated our planning and control algorithm with handwriting tasks, and demonstrated the effectiveness of the proposed framework. 
    more » « less
  5. During in-hand manipulation, robots must be able to continuously estimate the pose of the object in order to generate appropriate control actions. The performance of algorithms for pose estimation hinges on the robot's sensors being able to detect discriminative geometric object features, but previous sensing modalities are unable to make such measurements robustly. The robot's fingers can occlude the view of environment- or robot-mounted image sensors, and tactile sensors can only measure at the local areas of contact. Motivated by fingertip-embedded proximity sensors' robustness to occlusion and ability to measure beyond the local areas of contact, we present the first evaluation of proximity sensor based pose estimation for in-hand manipulation. We develop a novel two-fingered hand with fingertip-embedded optical time-of-flight proximity sensors as a testbed for pose estimation during planar in-hand manipulation. Here, the in-hand manipulation task consists of the robot moving a cylindrical object from one end of its workspace to the other. We demonstrate, with statistical significance, that proximity-sensor based pose estimation via particle filtering during in-hand manipulation: a) exhibits 50% lower average pose error than a tactile-sensor based baseline; b) empowers a model predictive controller to achieve 30% lower final positioning error compared to when using tactile-sensor based pose estimates. 
    more » « less