skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: The Pinch Sensor: An Input Device for In-Hand Manipulation with the Index Finger and Thumb
This paper presents the Pinch Sensor, an elastic input device to sense the fine motion and pinch force of the index finger and thumb - the two most used digits of human hands for in-hand object manipulation skills. In addition to open and close, the device would allow a user to control a robotic or simulated two-finger hand to reorient an object in three different ways and their combinations. A unique design of elastic sensing provides the users a high degree of perception resolution, as well as the sensation of holding an object with a certain level of stiffness between the index finger and thumb. These characteristics help the users to fine control the pinch force while carrying out manipulation skills. The design features a small size that allows it to be integrated to a handheld controller. Commonly available off-the-shelf components for consumer electronics are used to achieve affordability and reliability.  more » « less
Award ID(s):
1944069
PAR ID:
10505985
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
IEEE
Date Published:
Journal Name:
2023 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM)
ISBN:
978-1-6654-7633-1
Page Range / eLocation ID:
822 to 827
Subject(s) / Keyword(s):
input devices in-hand manipulation haptics teleoperation virtual reality design sensing
Format(s):
Medium: X
Location:
Seattle, WA, USA
Sponsoring Org:
National Science Foundation
More Like this
  1. Humans use all surfaces of the hand for contact-rich manipulation. Robot hands, in contrast, typically use only the fingertips, which can limit dexterity. In this work, we leveraged a potential energy–based whole-hand manipulation model, which does not depend on contact wrench modeling like traditional approaches, to design a robotic manipulator. Inspired by robotic caging grasps and the high levels of dexterity observed in human manipulation, a metric was developed and used in conjunction with the manipulation model to design a two-fingered dexterous hand, the Model W. This was accomplished by simulating all planar finger topologies composed of open kinematic chains of up to three serial revolute and prismatic joints, forming symmetric two-fingered hands, and evaluating their performance according to the metric. We present the best design, an unconventional robot hand capable of performing continuous object reorientation, as well as repeatedly alternating between power and pinch grasps—two contact-rich skills that have often eluded robotic hands—and we experimentally characterize the hand’s manipulation capability. This hand realizes manipulation motions reminiscent of thumb–index finger manipulative movement in humans, and its topology provides the foundation for a general-purpose dexterous robot hand. 
    more » « less
  2. Jara, C; Borras_Sol, J (Ed.)
    Deep Reinforcement Learning (DRL) has shown its capability to solve the high degrees of freedom in control and the complex interaction with the object in the multi-finger dexterous in-hand manipulation tasks. Current DRL approaches lack behavior constraints during the learning process, leading to aggressive and unstable policies that are insufficient for safety-critical in-hand manipulation tasks. The centralized learning strategy also limits the flexibility to fine-tune each robot finger's behavior. This work proposes the Finger-specific Multi-agent Shadow Critic Consensus (FMSC) method, which models the in-hand manipulation as a multi-agent collaboration task where each finger is an individual agent and trains the policies for the fingers to achieve a consensus across the critic networks through the Information Sharing (IS) across the neighboring agents and finger-specific stable manipulation objectives based on the state-action occupancy measure, a general utility of DRL that is approximated during the learning process. The methods are evaluated in two in-hand manipulation tasks on the Shadow Hand. The results show that FMSC+IS converges faster in training, achieving a comparable success rate and much better manipulation stability than conventional DRL methods. 
    more » « less
  3. null (Ed.)
    Current designs of powered prosthetic limbs are limited by the nearly exclusive use of DC motor technology. Soft actuators promise new design freedom to create prosthetic limbs which more closely mimic intact neuromuscular systems and improve the capabilities of prosthetic users. This work evaluates the performance of a hydraulically amplified self-healing electrostatic (HASEL) soft actuator for use in a prosthetic hand. We compare a linearly-contracting HASEL actuator, termed a Peano-HASEL, to an existing actuator (DC motor) when driving a prosthetic finger like those utilized in multi-functional prosthetic hands. A kinematic model of the prosthetic finger is developed and validated, and is used to customize a prosthetic finger that is tuned to complement the force-strain characteristics of the Peano-HASEL actuators. An analytical model is used to inform the design of an improved Peano-HASEL actuator with the goal of increasing the fingertip pinch force of the prosthetic finger. When compared to a weight-matched DC motor actuator, the Peano-HASEL and custom finger is 10.6 times faster, has 11.1 times higher bandwidth, and consumes 8.7 times less electrical energy to grasp. It reaches 91% of the maximum range of motion of the original finger. However, the DC motor actuator produces 10 times the fingertip force at a relevant grip position. In this body of work, we present ways to further increase the force output of the Peano-HASEL driven prosthetic finger system, and discuss the significance of the unique properties of Peano-HASELs when applied to the field of upper-limb prosthetic design. This approach toward clinically-relevant actuator performance paired with a substantially different form-factor compared to DC motors presents new opportunities to advance the field of prosthetic limb design. 
    more » « less
  4. null (Ed.)
    Haptic feedback allows an individual to identify various object properties. In this preliminary study, we determined the performance of stiffness recognition using transcutaneous nerve stimulation when a prosthetic hand was moved passively or was controlled actively by the subjects. Using a 2×8 electrode grid placed along the subject's upper arm, electrical stimulation was delivered to evoke somatotopic sensation along their index finger. Stimulation intensity, i.e. sensation strength, was modulated using the fingertip forces from a sensorized prosthetic hand. Object stiffness was encoded based on the rate of change of the evoked sensation as the prosthesis grasped one of three objects of different stiffness levels. During active control, sensation was modulated in real time as recorded forces were converted to stimulation amplitudes. During passive control, prerecorded force traces were randomly selected from a pool. Our results showed that the accuracy of object stiffness recognition was similar in both active and passive conditions. A slightly lower accuracy was observed during active control in one subject, which indicated that the sensorimotor integration processes could affect haptic perception for some users. 
    more » « less
  5. Constraining contacts to remain fixed on an object during manipulation limits the potential workspace size, as motion is subject to the hand’s kinematic topology. Finger gaiting is one way to alleviate such restraints. It allows contacts to be freely broken and remade so as to operate on different manipulation manifolds. This capability, however, has traditionally been difficult or impossible to practically realize. A finger gaiting system must simultaneously plan for and control forces on the object while maintaining stability during contact switching. This letter alleviates the traditional requirement by taking advantage of system compliance, allowing the hand to more easily switch contacts while maintaining a stable grasp. Our method achieves complete SO(3) finger gaiting control of grasped objects against gravity by developing a manipulation planner that operates via orthogonal safe modes of a compliant, underactuated hand absent of tactile sensors or joint encoders. During manipulation, a low-latency 6D pose object tracker provides feedback via vision, allowing the planner to update its plan online so as to adaptively recover from trajectory deviations. The efficacy of this method is showcased by manipulating both convex and non-convex objects on a real robot. Its robustness is evaluated via perturbation rejection and long trajectory goals. To the best of the authors’ knowledge, this is the first work that has autonomously achieved full SO(3) control of objects within-hand via finger gaiting and without a support surface, elucidating a valuable step towards realizing true robot in-hand manipulation capabilities. 
    more » « less