skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on July 8, 2026

Title: CrazyJoystick: A Handheld Flyable Joystick for Providing On-Demand Haptic Feedback in Extended Reality
We present CrazyJoystick, a flyable handheld joystick allowing seamless interaction methods to change between joystick and hand-tracking while displaying on-demand haptic feedback in extended reality (XR). Our system comprises a quadrotor that can autonomously approach the user when needed, addressing the limitations of conventional handheld and wearable devices that require continuous carrying throughout interactions. CrazyJoystick dynamically reallocates all thrust for haptic rendering during stationary states, eliminating the need to hover while delivering feedback. A customized cage allows users to grasp the device and interact with virtual objects, receiving 3.5 degree-of-freedom feedback. This novel transition method allows us to harvest the aerial mobility from multi-rotor based haptic devices, while having high force-to-weight ratios from being handheld during interaction. This paper describes the design and implementation of CrazyJoystick, evaluates its force and torque performance, and usability of the system in three VR applications. Our evaluation of torque rendering found that users can perceive the direction with an accuracy of 92.2%. User studies further indicated that the system significantly improves presence in VR environments. Participants found on-demand haptic feedback intuitive and enjoyable, emphasizing the potential of CrazyJoystick to redefine immersive interactions in XR through portable and adaptive feedback mechanisms.  more » « less
Award ID(s):
2232382
PAR ID:
10612471
Author(s) / Creator(s):
; ;
Publisher / Repository:
IEEE World Haptics Conference
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Handheld haptic devices are often limited in rendering capability, as compared to traditional grounded devices. Strenuous design criteria on weight, size, power consumption, and the ungrounded nature of handheld devices, can drive designers to prioritize actuator force or torque production over other components of dynamic range like bandwidth, transparency, and the range of stable impedances. Hybrid actuation, the use of passive and active actuators together, has the potential to increase the dynamic range of handheld haptic devices due to the large passive torque capability, the stabilizing effects of passive actuators, the high bandwidth of conventional DC servomotors, and the synergy between actuators. However, to date the use of hybrid actuation has been limited due to the highly nonlinear torque characteristics of available passive actuators that result in poor rendering accuracy. This paper describes a hybrid actuation approach and novel control topology which aims to solve actuation challenges associated with nonlinear passive actuators in hybrid and handheld haptic devices. The performance of the device is assessed experimentally, and the approach is compared to existing handheld devices. 
    more » « less
  2. We present VRHapticDrones, a system utilizing quadcopters as levitating haptic feedback proxy. A touchable surface is attached to the side of the quadcopters to provide unintrusive, flexible, and programmable haptic feedback in virtual reality. Since the users' sense of presence in virtual reality is a crucial factor for the overall user experience, our system simulates haptic feedback of virtual objects. Quadcopters are dynamically positioned to provide haptic feedback relative to the physical interaction space of the user. In a first user study, we demonstrate that haptic feedback provided by VRHapticDrones significantly increases users' sense of presence compared to vibrotactile controllers and interactions without additional haptic feedback. In a second user study, we explored the quality of induced feedback regarding the expected feeling of different objects. Results show that VRHapticDrones is best suited to simulate objects that are expected to feel either light-weight or have yielding surfaces. With VRHapticDrones we contribute a solution to provide unintrusive and flexible feedback as well as insights for future VR haptic feedback systems. 
    more » « less
  3. Robot teleoperation is an emerging field of study with wide applications in exploration, manufacturing, and healthcare, because it allows users to perform complex remote tasks while remaining distanced and safe. Haptic feedback offers an immersive user experience and expands the range of tasks that can be accomplished through teleoperation. In this paper, we present a novel wearable haptic feedback device for a teleoperation system that applies kinesthetic force feedback to the fingers of a user. The proposed device, called a ‘haptic muscle’, is a soft pneumatic actuator constructed from a fabric-silicone composite in a toroidal structure. We explore the requirements of the ideal haptic feedback mechanism, construct several haptic muscles using different materials, and experimentally determine their dynamic pressure response as well as sensitivity (their ability to communicate small changes in haptic feedback). Finally, we integrate the haptic muscles into a data glove and a teleoperation system and perform several user tests. Our results show that most users could detect detect force changes as low as 3% of the working range of the haptic muscles. We also find that the haptic feedback causes users to apply up to 52% less force on an object while handling soft and fragile objects with a teleoperation system. 
    more » « less
  4. Relocation of haptic feedback from the fingertips to the wrist has been considered as a way to enable haptic interaction with mixed reality virtual environments while leaving the fingers free for other tasks. We present a pair of wrist-worn tactile haptic devices and a virtual environment to study how various mappings between fingers and tactors affect task performance. The haptic feedback rendered to the wrist reflects the interaction forces occurring between a virtual object and virtual avatars controlled by the index finger and thumb. We performed a user study comparing four different finger-to-tactor haptic feedback mappings and one no-feedback condition as a control. We evaluated users' ability to perform a simple pick-and-place task via the metrics of task completion time, path length of the fingers and virtual cube, and magnitudes of normal and shear forces at the fingertips. We found that multiple mappings were effective, and there was a greater impact when visual cues were limited. We discuss the limitations of our approach and describe next steps toward multi-degree-of-freedom haptic rendering for wrist-worn devices to improve task performance in virtual environments. 
    more » « less
  5. Vibration is a widely used mode of haptic communication, as vibrotactile cues provide salient haptic notifications to users and are easily integrated into wearable or handheld devices. Fluidic textile-based devices offer an appealing platform for the incorporation of vibrotactile haptic feedback, as they can be integrated into clothing and other conforming and compliant wearables. Fluidically driven vibrotactile feedback has primarily relied on valves to regulate actuating frequencies in wearable devices. The mechanical bandwidth of such valves limits the range of frequencies that can be achieved, particularly in attempting to reach the higher frequencies realized with electromechanical vibration actuators ( > 100 Hz). In this paper, we introduce a soft vibrotactile wearable device, constructed entirely of textiles and capable of rendering vibration frequencies between 183 and 233 Hz with amplitudes ranging from 23 to 114 g . We describe our methods of design and fabrication and the mechanism of vibration, which is realized by controlling inlet pressure and harnessing a mechanofluidic instability. Our design allows for controllable vibrotactile feedback that is comparable in frequency and greater in amplitude relative to state-of-the-art electromechanical actuators while offering the compliance and conformity of fully soft wearable devices. 
    more » « less