Despite non-co-location, haptic stimulation at the wrist can potentially provide feedback regarding interactions at the fingertips without encumbering the user’s hand. Here we investigate how two types of skin deformation at the wrist (normal and shear) relate to the perception of the mechanical properties of virtual objects. We hypothesized that a congruent mapping (i.e. when the most relevant interaction forces during a virtual interaction spatially match the haptic feedback at the wrist) would result in better perception than other map- pings.We performed an experiment where haptic devices at the wrist rendered either normal or shear feedback during manipulation of virtual objects with varying stiffness, mass, or friction properties. Perception of mechanical properties was more accurate with congruent skin stimulation than noncongruent. In addition, discrimination performance and subjective reports were positively influenced by congruence. This study demonstrates that users can perceive mechanical properties via haptic feedback provided at the wrist with a consistent mapping between haptic feedback and interaction forces at the fingertips, regardless of congruence.
more »
« less
Decoding roughness perception in distributed haptic devices
The ability to render realistic texture perception using haptic devices has been consistently challenging. A key component of texture perception is roughness. When we touch surfaces, mechanoreceptors present under the skin are activated and the information is processed by the nervous system, enabling perception of roughness/smoothness. Several distributed haptic devices capable of producing localized skin stretch have been developed with the aim of rendering realistic roughness perception; however, current state-of-the-art devices rely on device fabrication and psychophysical experimentation to determine whether a device configuration will perform as desired. Predictive models can elucidate physical mechanisms, providing insight and a more effective design iteration process. Since existing models (1, 2) are derived from responses to normal stimuli only, they cannot predict the performance of laterally actuated devices which rely on frictional shear forces to produce localized skin stretch. They are also unable to predict the augmentation of roughness perception when the actuators are spatially dispersed across the contact patch or actuated with a relative phase difference (3). In this study, we have developed a model that can predict the perceived roughness for arbitrary external stimuli and validated it against psychophysical experimental results from different haptic devices reported in the literature. The model elucidates two key mechanisms: (i) the variation in the change of strain across the contact patch can predict roughness perception with strong correlation and (ii) the inclusion of lateral shear forces is essential to correctly predict roughness perception. Using the model can accelerate device optimization by obviating the reliance on trial-and-error approaches.
more » « less- PAR ID:
- 10552740
- Publisher / Repository:
- Oxford University Press
- Date Published:
- Journal Name:
- PNAS Nexus
- Volume:
- 3
- Issue:
- 10
- ISSN:
- 2752-6542
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Wearable fingertip haptic interfaces provide tac- tile stimuli on the fingerpads by applying skin pressure, linear and rotational shear, and vibration. Designing and fabricating a compact, multi-degree-of-freedom, and forceful fingertip haptic interface is challenging due to trade-offs among miniatur- ization, multifunctionality, and manufacturability. Downsizing electromagnetic actuators that produce high torques is infea- sible, and integrating multiple actuators, links, joints, and transmission elements increases device size and weight. 3-D printing enables rapid manufacturing of complex devices with minimal assembly in large batches. However, it requires a careful arrangement of material properties, geometry, scale, and printer capabilities. Here we present a fully 3-D printed, soft, monolithic fingertip haptic device based on an origami pattern known as the “waterbomb” base that embeds foldable vacuum actuation and produces 4-DoF of motion on the fingerpad with tunable haptic forces (up to 1.3 N shear and 7 N normal) and torque (up to 25 N-mm). Including the thimble mounting, the compact device is 40 mm long and 20 mm wide. This demonstrates the efficacy of origami design and soft material 3D printing for designing and rapidly fabricating miniature yet complex wearable mechanisms with force output appropriate for haptic interaction.more » « less
-
While tremendous advances in visual and auditory realism have been made for virtual and augmented reality (VR/AR), introducing a plausible sense of physicality into the virtual world remains challenging. Closing the gap between real-world physicality and immersive virtual experience requires a closed interaction loop: applying user-exerted physical forces to the virtual environment and generating haptic sensations back to the users. However, existing VR/AR solutions either completely ignore the force inputs from the users or rely on obtrusive sensing devices that compromise user experience. By identifying users' muscle activation patterns while engaging in VR/AR, we design a learning-based neural interface for natural and intuitive force inputs. Specifically, we show that lightweight electromyography sensors, resting non-invasively on users' forearm skin, inform and establish a robust understanding of their complex hand activities. Fuelled by a neural-network-based model, our interface can decode finger-wise forces in real-time with 3.3% mean error, and generalize to new users with little calibration. Through an interactive psychophysical study, we show that human perception of virtual objects' physical properties, such as stiffness, can be significantly enhanced by our interface. We further demonstrate that our interface enables ubiquitous control via finger tapping. Ultimately, we envision our findings to push forward research towards more realistic physicality in future VR/AR.more » « less
-
Resonant frequency skin stretch uses cyclic lateral skin stretches matching the skin’s resonant frequency to create highly noticeable stimuli, signifying a new approach for wearable haptic stimulation. Four experiments were performed to explore biomechanical and perceptual aspects of resonant frequency skin stretch. In the first experiment, effective skin resonant frequencies were quantified at the forearm, shank, and foot. In the second experiment, perceived haptic stimuli were characterized for skin stretch actuations across a spectrum of frequencies. In the third experiment, perceived haptic stimuli were characterized for different actuator masses. In the fourth experiment, haptic classification ability was determined as subjects differentiated haptic stimulation cues while sitting, walking, and jogging. Results showed that subjects perceived stimulations at, above, and below the skin’s resonant frequency differently: stimulations lower than the skin resonant frequency felt like distinct impacts, stimulations at the skin resonant frequency felt like cyclic skin stretches, and stimulations higher than the skin resonant frequency felt like standard vibrations. Subjects successfully classified stimulations while sitting, walking, and jogging, perceived haptic stimuli was affected by actuator mass, and classification accuracy decreased with increasing speed, especially for stimulations at the shank. This work could facilitate more widespread use of wearable skin stretch. Potential applications include gaming, medical simulation, and surgical augmentation, and for training to reduce injury risk or improve sports performance.more » « less
-
more » « less
Abstract Skin-integrated haptic interfaces that can relay a wealth of information from the machine to the human are of great interest. However, existing haptic devices are not yet able to produce haptic cues that are compatible with the skin. In this work, we present the stretchable soft actuators for haptic feedback, which can match the perception range, spatial resolution, and stretchability of the skin. Pressure-amplification structures are fabricated using a scalable self-assembly process to ensure an output pressure beyond the skin perception threshold. Due to the minimized device size, the actuator array can be fabricated with a sufficiently high spatial resolution, which makes the haptic device applicable for skin locations with the highest spatial acuity. A haptic feedback system is demonstrated by employing the developed soft actuators and highly sensitive pressure sensors. Two proof-of-concept applications are developed to illustrate the capability of transferring information related to surface textures and object shapes acquired at the robot side to the user side.
