skip to main content


The NSF Public Access Repository (NSF-PAR) system and access will be unavailable from 5:00 PM ET until 11:00 PM ET on Friday, June 21 due to maintenance. We apologize for the inconvenience.

Title: Humans Need Augmented Feedback to Physically Track Non-Biological Robot Movements
An important component for the effective collaboration of humans with robots is the compatibility of their movements, especially when humans physically collaborate with a robot partner. Following previous findings that humans interact more seamlessly with a robot that moves with humanlike or biological velocity profiles, this study examined whether humans can adapt to a robot that violates human signatures. The specific focus was on the role of extensive practice and realtime augmented feedback. Six groups of participants physically tracked a robot tracing an ellipse with profiles where velocity scaled with the curvature of the path in biological and nonbiological ways, while instructed to minimize the interaction force with the robot. Three of the 6 groups received real-time visual feedback about their force error. Results showed that with 3 daily practice sessions, when given feedback about their force errors, humans could decrease their interaction forces when the robot’s trajectory violated human-like velocity patterns. Conversely, when augmented feedback was not provided, there were no improvements despite this extensive practice. The biological profile showed no improvements, even with feedback, indicating that the (non-zero) force had already reached a floor level. These findings highlight the importance of biological robot trajectories and augmented feedback to guide humans to adapt to non-biological movements in physical human-robot interaction. These results have implications on various fields of robotics, such as surgical applications and collaborative robots for industry.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
IEEE International Conference on Robotics and Automation
Page Range / eLocation ID:
9872 to 9878
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Physical human–robot collaboration is becoming more common, both in industrial and service robotics. Cooperative execution of a task requires intuitive and efficient interaction between both actors. For humans, this means being able to predict and adapt to robot movements. Given that natural human movement exhibits several robust features, we examined whether human–robot physical interaction is facilitated when these features are considered in robot control. The present study investigated how humans adapt to biological and nonbiological velocity patterns in robot movements. Participants held the end-effector of a robot that traced an elliptic path with either biological (twothirds power law) or nonbiological velocity profiles. Participants were instructed to minimize the force applied on the robot endeffector. Results showed that the applied force was significantly lower when the robot moved with a biological velocity pattern. With extensive practice and enhanced feedback, participants were able to decrease their force when following a nonbiological velocity pattern, but never reached forces below those obtained with the 2/3 power law profile. These results suggest that some robust features observed in natural human movements are also a strong preference in guided movements. Therefore, such features should be considered in human–robot physical collaboration. 
    more » « less
  2. null (Ed.)
    Robotic social intelligence is increasingly important. However, measures of human social intelligence omit basic skills, and robot-specific scales do not focus on social intelligence. We combined human robot interaction concepts of beliefs, desires, and intentions with psychology concepts of behaviors, cognitions, and emotions to create 20 Perceived Social Intelligence (PSI) Scales to comprehensively measure perceptions of robots with a wide range of embodiments and behaviors. Participants rated humanoid and non-humanoid robots interacting with people in five videos. Each scale had one factor and high internal consistency, indicating each measures a coherent construct. Scales capturing perceived social information processing skills (appearing to recognize, adapt to, and predict behaviors, cognitions, and emotions) and scales capturing perceived skills for identifying people (appearing to identify humans, individuals, and groups) correlated strongly with social competence and constituted the Mind and Behavior factors. Social presentation scales (appearing friendly, caring, helpful, trustworthy, and not rude, conceited, or hostile) relate more to Social Response to Robots Scales and Godspeed Indices, form a separate factor, and predict positive feelings about robots and wanting social interaction with them. For a comprehensive measure, researchers can use all PSI 20 scales for free. Alternatively, they can select the most relevant scales for their projects. 
    more » « less
  3. Tactile sensing has been increasingly utilized in robot control of unknown objects to infer physical properties and optimize manipulation. However, there is limited understanding about the contribution of different sensory modalities during interactive perception in complex interaction both in robots and in humans. This study investigated the effect of visual and haptic information on humans’ exploratory interactions with a ‘cup of coffee’, an object with nonlinear internal dynamics. Subjects were instructed to rhythmically transport a virtual cup with a rolling ball inside between two targets at a specified frequency, using a robotic interface. The cup and targets were displayed on a screen, and force feedback from the cup-andball dynamics was provided via the robotic manipulandum. Subjects were encouraged to explore and prepare the dynamics by “shaking” the cup-and-ball system to find the best initial conditions prior to the task. Two groups of subjects received the full haptic feedback about the cup-and-ball movement during the task; however, for one group the ball movement was visually occluded. Visual information about the ball movement had two distinctive effects on the performance: it reduced preparation time needed to understand the dynamics and, importantly, it led to simpler, more linear input-output interactions between hand and object. The results highlight how visual and haptic information regarding nonlinear internal dynamics have distinct roles for the interactive perception of complex objects. 
    more » « less
  4. While the study of unconstrained movements has revealed important features of neural control, generalizing those insights to more sophisticated object manipulation is challenging. Humans excel at physical interaction with objects, even when those objects introduce complex dynamics and kinematic constraints. This study examined humans turning a horizontal planar crank (radius 10.29 cm) at their preferred and three instructed speeds (with visual feedback), both in clockwise and counterclockwise directions. To explore the role of neuromechanical dynamics, the instructed speeds covered a wide range: fast (near the limits of performance), medium (near preferred speed), and very slow (rendering dynamic effects negligible). Because kinematically constrained movements involve significant physical interaction, disentangling neural control from the influences of biomechanics presents a challenge. To address it, we modeled the interactive dynamics to “subtract off” peripheral biomechanics from observed force and kinematic data, thereby estimating aspects of underlying neural action that may be expressed in terms of motion. We demonstrate the value of this method: remarkably, an approximately elliptical path emerged, and speed minima coincided with curvature maxima, similar to what is seen in unconstrained movements, even though the hand moved at nearly constant speed along a constant-curvature path. These findings suggest that the neural controller takes advantage of peripheral biomechanics to simplify physical interaction. As a result, patterns seen in unconstrained movements persist even when physical interaction prevents their expression in hand kinematics. The reemergence of a speed-curvature relation indicates that it is due, at least in part, to neural processes that emphasize smoothness and predictability. NEW & NOTEWORTHY Physically interacting with kinematic constraints is commonplace in everyday actions. We report a study of humans turning a crank, a circular constraint that imposes constant hand path curvature and hence should suppress variations of hand speed due to the power-law speed-curvature relation widely reported for unconstrained motions. Remarkably, we found that, when peripheral biomechanical factors are removed, a speed-curvature relation reemerges, indicating that it is, at least in part, of neural origin. 
    more » « less
  5. Abstract Humans can physically interact with other humans adeptly. Some overground interaction tasks, such as guiding a partner across a room, occur without visual and verbal communication, which suggests that the information exchanges occur through sensing movements and forces. To understand the process of motor communication during overground physical interaction, we hypothesized that humans modulate the mechanical properties of their arms for increased awareness and sensitivity to ongoing interaction. For this, we used an overground interactive robot to guide a human partner across one of three randomly chosen paths while occasionally providing force perturbations to measure the arm stiffness. We observed that the arm stiffness was lower at instants when the robot’s upcoming trajectory was unknown compared to instants when it was predicable - the first evidence of arm stiffness modulation for better motor communication during overground physical interaction. 
    more » « less