An official website of the United States government
Abstract Since the modern concepts for virtual and augmented reality are first introduced in the 1960's, the field has strived to develop technologies for immersive user experience in a fully or partially virtual environment. Despite the great progress in visual and auditory technologies, haptics has seen much slower technological advances. The challenge is because skin has densely packed mechanoreceptors distributed over a very large area with complex topography; devising an apparatus as targeted as an audio speaker or television for the localized sensory input of an ear canal or iris is more difficult. Furthermore, the soft and sensitive nature of the skin makes it difficult to apply solid state electronic solutions that can address large areas without causing discomfort. The maturing field of soft robotics offers potential solutions toward this challenge. In this article, the definition and history of virtual (VR) and augmented reality (AR) is first reviewed. Then an overview of haptic output and input technologies is presented, opportunities for soft robotics are identified, and mechanisms of intrinsically soft actuators and sensors are introduced. Finally, soft haptic output and input devices are reviewed with categorization by device forms, and examples of soft haptic devices in VR/AR environments are presented.
more »
« less
Recent Advances in Wearable Sensors and Integrated Functional Devices for Virtual and Augmented Reality Applications
Abstract The advancement in virtual reality/augmented reality (VR/AR) has been achieved by breakthroughs in the realistic perception of virtual elements. Although VR/AR technology is advancing fast, enhanced sensor functions, long‐term wearability, and seamless integration with other electronic components are still required for more natural interactions with the virtual world. Here, this report reviews the recent advances in multifunctional wearable sensors and integrated functional devices for VR/AR applications. Specified device designs, packaging strategies, and interactive physiological sensors are summarized based on their methodological approaches for sensory inputs and virtual feedback. In addition, limitations of the existing systems, key challenges, and future directions are discussed. It is envisioned that this progress report's outcomes will expand the insights on wearable functional sensors and device interfaces toward next‐generation VR/AR technologies.
more »
« less
- Award ID(s):
- 1707056
- PAR ID:
- 10381446
- Publisher / Repository:
- Wiley Blackwell (John Wiley & Sons)
- Date Published:
- Journal Name:
- Advanced Functional Materials
- Volume:
- 31
- Issue:
- 39
- ISSN:
- 1616-301X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Physical therapy is often essential for complete recovery after injury. However, a significant population of patients fail to adhere to prescribed exercise regimens. Lack of motivation and inconsistent in-person visits to physical therapy are major contributing factors to suboptimal exercise adherence, slowing the recovery process. With the advancement of virtual reality (VR), researchers have developed remote virtual rehabilitation systems with sensors such as inertial measurement units. A functional garment with an integrated wearable sensor can also be used for real-time sensory feedback in VR-based therapeutic exercise and offers affordable remote rehabilitation to patients. Sensors integrated into wearable garments offer the potential for a quantitative range of motion measurements during VR rehabilitation. In this research, we developed and validated a carbon nanocomposite-coated knit fabric-based sensor worn on a compression sleeve that can be integrated with upper-extremity virtual rehabilitation systems. The sensor was created by coating a commercially available weft knitted fabric consisting of polyester, nylon, and elastane fibers. A thin carbon nanotube composite coating applied to the fibers makes the fabric electrically conductive and functions as a piezoresistive sensor. The nanocomposite sensor, which is soft to the touch and breathable, demonstrated high sensitivity to stretching deformations, with an average gauge factor of ~35 in the warp direction of the fabric sensor. Multiple tests are performed with a Kinarm end point robot to validate the sensor for repeatable response with a change in elbow joint angle. A task was also created in a VR environment and replicated by the Kinarm. The wearable sensor can measure the change in elbow angle with more than 90% accuracy while performing these tasks, and the sensor shows a proportional resistance change with varying joint angles while performing different exercises. The potential use of wearable sensors in at-home virtual therapy/exercise was demonstrated using a Meta Quest 2 VR system with a virtual exercise program to show the potential for at-home measurements.more » « less
-
Augmented reality (AR) is a technology that integrates 3D virtual objects into the physical world in real-time, while virtual reality (VR) is a technology that immerses users in an interactive 3D virtual environment. The fast development of augmented reality (AR) and virtual reality (VR) technologies has reshaped how people interact with the physical world. This presentation will outline the results from two unique AR and one Web-based VR coastal engineering projects, motivating the next stage in the development of the augmented reality package for coastal students, engineers, and planners.more » « less
-
Green, Phil (Ed.)Head‐mounted virtual reality (VR) and augmented reality (AR) systems deliver colour imagery directly to a user's eyes, presenting position‐aware, real‐time computer graphics to create the illusion of interacting with a virtual world. In some respects, colour in AR and VR can be modelled and controlled much like colour in other display technologies. However, it is complicated by the optics required for near‐eye display, and in the case of AR, by the merging of real‐world and virtual visual stimuli. Methods have been developed to provide predictable colour in VR, and ongoing research has exposed details of the visual perception of real and virtual in AR. Yet, more work is required to make colour appearance predictable and AR and VR display systems more robust.more » « less
-
In many complex tasks, a remote expert may need to assist a local user or to guide his or her actions in the local user's environment. Existing solutions also allow multiple users to collaborate remotely using high-end Augmented Reality (AR) and Virtual Reality (VR) head-mounted displays (HMD). In this paper, we propose a portable remote collaboration approach, with the integration of AR and VR devices, both running on mobile platforms, to tackle the challenges of existing approaches. The AR mobile platform processes the live video and measures the 3D geometry of the local environment of a local user. The 3D scene is then transited and rendered in the remote side on a mobile VR device, along with a simple and effective user interface, which allows a remote expert to easily manipulate the 3D scene on the VR platform and to guide the local user to complete tasks in the local environment.more » « less
