Physical touch, a fundamental aspect of human social interaction, remains largely absent in real-time virtual communication. We present a haptic-enabled multi-user Virtual Reality (VR) system that facilitates real-time, bi-directional social touch communication among physically distant users. We developed wearable gloves and forearm sleeves, embedded with 26 vibrotactile actuators for each hand and arm, actuated via a WiFi-based communication system. The system enables VR-transmitted data to be universally interpreted by haptic devices, allowing feedback rendering based on their capabilities. Users can perform and receive social touch gestures such as stroke, pat, poke, and squeeze, with other users within a shared virtual space or interact with other virtual objects, and they receive vibrotactile feedback. Through a two-part user study involving six pairs of participants, we investigate the impact of gesture speed, haptic feedback modality, and user roles, during real-time haptic communication in VR, on affective and sensory experiences, as well as evaluate the overall system usability. Our findings highlight key design considerations that significantly improve affective experiences, presence, embodiment, pleasantness, and naturalness, to foster more immersive and expressive mediated social touch experiences in VR.
more »
« less
CrazyJoystick: A Handheld Flyable Joystick for Providing On-Demand Haptic Feedback in Extended Reality
We present CrazyJoystick, a flyable handheld joystick allowing seamless interaction methods to change between joystick and hand-tracking while displaying on-demand haptic feedback in extended reality (XR). Our system comprises a quadrotor that can autonomously approach the user when needed, addressing the limitations of conventional handheld and wearable devices that require continuous carrying throughout interactions. CrazyJoystick dynamically reallocates all thrust for haptic rendering during stationary states, eliminating the need to hover while delivering feedback. A customized cage allows users to grasp the device and interact with virtual objects, receiving 3.5 degree-of-freedom feedback. This novel transition method allows us to harvest the aerial mobility from multi-rotor based haptic devices, while having high force-to-weight ratios from being handheld during interaction. This paper describes the design and implementation of CrazyJoystick, evaluates its force and torque performance, and usability of the system in three VR applications. Our evaluation of torque rendering found that users can perceive the direction with an accuracy of 92.2%. User studies further indicated that the system significantly improves presence in VR environments. Participants found on-demand haptic feedback intuitive and enjoyable, emphasizing the potential of CrazyJoystick to redefine immersive interactions in XR through portable and adaptive feedback mechanisms.
more »
« less
- Award ID(s):
- 2232382
- PAR ID:
- 10612471
- Publisher / Repository:
- IEEE World Haptics Conference
- Date Published:
- Subject(s) / Keyword(s):
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
To enhance learning and training, VR haptic devices must provide safe and physically accurate feedback that helps users build intuitions about force and motion. We present TrueForce, a method for rendering force feedback by capturing user input and reconfiguring a compliant mechanism in real time to align perceived with expected forces. We implemented TrueForce in a grounded Encountered-Type Haptic Display (ETHD) and demonstrated its versatility through three representative physics scenarios: pushing a stationary object, experiencing electrostatic repulsion, and bouncing a moving object. A user study with 29 participants showed that users adapted to new interaction profiles within 2–3 trials, and that rendered forces remained within perceptual thresholds except in the heaviest and most dynamic conditions. These results suggest that users can rapidly adapt to the system’s force-motion mappings, providing the consistent sensorimotor feedback necessary for building physical intuitions when interacting with moving virtual objects.more » « less
-
Handheld haptic devices are often limited in rendering capability, as compared to traditional grounded devices. Strenuous design criteria on weight, size, power consumption, and the ungrounded nature of handheld devices, can drive designers to prioritize actuator force or torque production over other components of dynamic range like bandwidth, transparency, and the range of stable impedances. Hybrid actuation, the use of passive and active actuators together, has the potential to increase the dynamic range of handheld haptic devices due to the large passive torque capability, the stabilizing effects of passive actuators, the high bandwidth of conventional DC servomotors, and the synergy between actuators. However, to date the use of hybrid actuation has been limited due to the highly nonlinear torque characteristics of available passive actuators that result in poor rendering accuracy. This paper describes a hybrid actuation approach and novel control topology which aims to solve actuation challenges associated with nonlinear passive actuators in hybrid and handheld haptic devices. The performance of the device is assessed experimentally, and the approach is compared to existing handheld devices.more » « less
-
We present VRHapticDrones, a system utilizing quadcopters as levitating haptic feedback proxy. A touchable surface is attached to the side of the quadcopters to provide unintrusive, flexible, and programmable haptic feedback in virtual reality. Since the users' sense of presence in virtual reality is a crucial factor for the overall user experience, our system simulates haptic feedback of virtual objects. Quadcopters are dynamically positioned to provide haptic feedback relative to the physical interaction space of the user. In a first user study, we demonstrate that haptic feedback provided by VRHapticDrones significantly increases users' sense of presence compared to vibrotactile controllers and interactions without additional haptic feedback. In a second user study, we explored the quality of induced feedback regarding the expected feeling of different objects. Results show that VRHapticDrones is best suited to simulate objects that are expected to feel either light-weight or have yielding surfaces. With VRHapticDrones we contribute a solution to provide unintrusive and flexible feedback as well as insights for future VR haptic feedback systems.more » « less
-
Robot teleoperation is an emerging field of study with wide applications in exploration, manufacturing, and healthcare, because it allows users to perform complex remote tasks while remaining distanced and safe. Haptic feedback offers an immersive user experience and expands the range of tasks that can be accomplished through teleoperation. In this paper, we present a novel wearable haptic feedback device for a teleoperation system that applies kinesthetic force feedback to the fingers of a user. The proposed device, called a ‘haptic muscle’, is a soft pneumatic actuator constructed from a fabric-silicone composite in a toroidal structure. We explore the requirements of the ideal haptic feedback mechanism, construct several haptic muscles using different materials, and experimentally determine their dynamic pressure response as well as sensitivity (their ability to communicate small changes in haptic feedback). Finally, we integrate the haptic muscles into a data glove and a teleoperation system and perform several user tests. Our results show that most users could detect detect force changes as low as 3% of the working range of the haptic muscles. We also find that the haptic feedback causes users to apply up to 52% less force on an object while handling soft and fragile objects with a teleoperation system.more » « less
An official website of the United States government

