An official website of the United States government
Current VR/AR systems are unable to reproduce the physical sensation of fluid vessels, due to the shifting nature of fluid motion. To this end, we introduce SWISH, an ungrounded mixed-reality interface, capable of affording the users a realistic haptic sensation of fluid behaviors in vessels. The chief mechanism behind SWISH is in the use of virtual reality tracking and motor actuation to actively relocate the center of gravity of a handheld vessel, emulating the moving center of gravity of a handheld vessel that contains fluid. In addition to solving challenges related to reliable and efficient motor actuation, our SWISH designs place an emphasis on reproducibility, scalability, and availability to the maker culture. Our virtual-to-physical coupling uses Nvidia Flex's Unity integration for virtual fluid dynamics with a 3D printed augmented vessel containing a motorized mechanical actuation system. To evaluate the effectiveness and perceptual efficacy of SWISH, we conduct a user study with 24 participants, 7 vessel actions, and 2 virtual fluid viscosities in a virtual reality environment. In all cases, the users on average reported that the SWISH bucket generates accurate tactile sensations for the fluid behavior. This opens the potential for multi-modal interactions with programmable fluids in virtual environments for chemistry education, worker training, and immersive entertainment.
more »
« less
Exoskeleton Training through Haptic Sensation Transfer in Immersive Virtual Environment
Exoskeleton as a human augmentation technology has shown a great potential for transforming the future civil engineering operations. However, the inappropriate use of exoskeleton could cause injuries and damages if the user is not well trained. An effective procedural and operational training will make users more aware of the capabilities, restrictions and risks associated with exoskeleton in civil engineering operations. At present, the low availability and high cost of exoskeleton systems make hands-on training less feasible. In addition, different designs of exoskeleton correspond with different activation procedures, muscular engagement and motion boundaries, posing further challenges to exoskeleton training. We propose an “sensation transfer” approach that migrates the physical experience of wearing a real exoskeleton system to first-time users via a passive haptic system in an immersive virtual environment. The body motion and muscular engagement data of 15 experienced exoskeleton users were recorded and replayed in a virtual reality environment. Then a set of haptic devices on key parts of the body (shoulders, elbows, hands, and waist) generate different patterns of haptic cues depending on the trainees’ accuracy of mimicking the actions. The sensation transfer method will enhance the haptic learning experience and therefore accelerate the training.
more »
« less
- Award ID(s):
- 2024784
- PAR ID:
- 10348916
- Date Published:
- Journal Name:
- ASCE Construction Research Congress (CRC) 2022
- Page Range / eLocation ID:
- 560 to 569
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Experiences of Virtual Reality training and architectural virtual environments benefit when provided a higher sensation of stair climbing. Passive haptic props can add that sensation. These methods present a safe approach by placing short ramps on the floor rather than a physical staircase. To improve a user’s level of immersion, we conducted an experiment to explore the shape of physical props to change the way users were aligned and moved while traveling up or down a virtual set of stairs. We investigated three methods for physical props while ascending and descending virtual stairs. Results suggest that elongated props provide a better experience and are more preferred.more » « less
-
This paper discusses the key elements of a research study that focused on training an important procedure called “Endotracheal intubation” to novice students. Such a procedure is a virtual part of treating patients who are infected with the covid-19 virus. A virtual reality environment was created to facilitate the training of novice nurses (or nurse trainees) using the HTC Vive platform. The primary interaction with the virtual objects inside this simulation-based training environment was using the hand controller. However, the small mouth of the virtual patient and the necessity of utilizing both hands to pick up the laryngoscope and endotracheal tube at the same time (during training), led to collisions involving the hand controllers and hampered the immersive experience of the participants. A multi-sensory conflict notion-based approach was proposed to address this problem. We used “Haptic retargeting” method to solve this issue. And we compared the result of the haptic retargeting method with reference condtion. Initial Results (through a questionnaire) suggest that this Haptic retargeting approach increases the participants’ sense of presence in the virtual environment.more » « less
-
Abstract The recent advancement in additive manufacturing (AM) leads to an extensive need for an industrial workforce in the near future. Workforce training in AM requires expensive capital investment for installing and maintaining this technology and proper knowledge about potential safety hazards. Traditional classroom settings often fail to bridge the critical gap between textbook learning and practical applications. Virtual reality (VR) training can simulate real‐world scenarios in a safe and controlled environment and improve student involvement to foster practical learning. In this paper, a virtual training platform for 3D printing has been developed and studied to improve AM education. The developed environment contains a selective laser sintering printer, a preparation station with necessary supplies, a control panel for process planning, and a post‐processing station. This platform provides students with excellent learning opportunities to gain hands‐on experiences and critical engineering skills on operating process parameters and safety measures. Undergraduate students majoring in industrial engineering were exposed to this learning approach to enhance their engagement and cognitive processing skills. Students' attentions were measured using eye metrics (fixation duration and preference index), and their exposure experiences were collected through the simulation sickness questionnaire, presence questionnaire, and system usability scale. Pre‐ and post‐VR training questionnaires and performance metrics (task completion time and accuracy) evaluated students' learning outcomes. Results provide valuable insights into students' attention, performance, and satisfaction with virtual training environments. Users' gaze behavior and subjective responses revealed many challenges that will help future researchers develop assistive instructions within this virtual educational platform.more » « less
-
null (Ed.)When individuals interact with the environment, sensory feedback is a critical aspect of the experience. Individuals using prosthesis often have difficulty controlling their device, partly due to a lack of sensory information. Transcutaneous nerve stimulation has the potential to elicit focal haptic sensation when controlled electrical current was delivered to a pair of electrodes in proximity to the nerve. The objective of this preliminary study was to evaluate how different elicited focal haptic sensation were altered, when multiple concurrent electrical stimuli were delivered to different portions of the median and ulnar nerve bundles. The delay between the individual stimulation during concurrent stimuli was also varied to identify if this parameter could alter the resulting sensation region. Lastly, the stability/repeatability of the perceived sensation during concurrent stimuli was determined. Our preliminary results showed that the spatial distribution of the haptic sensation was largely a direct summation/merge of the sensation regions from the individual nerve stimulation when comparing the regions to that of the concurrent double stimulation. Our results also showed that merged sensation region was not sensitive to different time delays the two concurrent stimuli. Lastly, the sensation regions remained stable and showed repeatable sensation in the hand even with 20-60 minutes between repeated stimulations.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1061/9780784483961.059
