Domain users (DUs) with a knowledge base in specialized fields are frequently excluded from authoring virtual reality (VR)-based applications in corresponding fields. This is largely due to the requirement of VR programming expertise needed to author these applications. To address this concern, we developed VRFromX, a system workflow design to make the virtual content creation process accessible to DUs irrespective of their programming skills and experience. VRFromX provides an in situ process of content creation in VR that (a) allows users to select regions of interest in scanned point clouds or sketch in mid-air using a brush tool to retrieve virtual models and (b) then attach behavioral properties to those objects. Using a welding use case, we performed a usability evaluation of VRFromX with 20 DUs from which 12 were novices in VR programming. Study results indicated positive user ratings for the system features with no significant differences across users with or without VR programming expertise. Based on the qualitative feedback, we also implemented two other use cases to demonstrate potential applications. We envision that the solution can facilitate the adoption of the immersive technology to create meaningful virtual environments.
VRFromX: From Scanned Reality to Interactive Virtual Experience with Human-in-the-Loop
There is an increasing trend of Virtual-Reality (VR) applications found in education, entertainment, and industry. Many of them utilize real world tools, environments, and interactions as bases for creation. However, creating such applications is tedious, fragmented, and involves expertise in authoring VR using programming and 3D-modelling softwares. This hinders VR adoption by decoupling subject matter experts from the actual process of authoring while increasing cost and time. We present VRFromX, an in-situ Do-It-Yourself (DIY) platform for content creation in VR that allows users to create interactive virtual experiences. Using our system, users can select region(s) of interest (ROI) in scanned point cloud or sketch in mid-air using a brush tool to retrieve virtual models and then attach behavioral properties to them. We ran an exploratory study to evaluate usability of VRFromX and the results demonstrate feasibility of the framework as an authoring tool. Finally, we implemented three possible use-cases to showcase potential applications.
more »
« less
- Award ID(s):
- 1839971
- NSF-PAR ID:
- 10297573
- Date Published:
- Journal Name:
- Conference on Human Factors in Computing Systems (CHI EA '21)
- Page Range / eLocation ID:
- 1 to 7
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
Abstract -
null (Ed.)Recognition of human behavior plays an important role in context-aware applications. However, it is still a challenge for end-users to build personalized applications that accurately recognize their own activities. Therefore, we present CAPturAR, an in-situ programming tool that supports users to rapidly author context-aware applications by referring to their previous activities. We customize an AR head-mounted device with multiple camera systems that allow for non-intrusive capturing of user's daily activities. During authoring, we reconstruct the captured data in AR with an animated avatar and use virtual icons to represent the surrounding environment. With our visual programming interface, users create human-centered rules for the applications and experience them instantly in AR. We further demonstrate four use cases enabled by CAPturAR. Also, we verify the effectiveness of the AR-HMD and the authoring workflow with a system evaluation using our prototype. Moreover, we conduct a remote user study in an AR simulator to evaluate the usability.more » « less
-
Augmented/Virtual reality and video-based media play a vital role in the digital learning revolution to train novices in spatial tasks. However, creating content for these different media requires expertise in several fields. We present EditAR, a unified authoring, and editing environment to create content for AR, VR, and video based on a single demonstration. EditAR captures the user’s interaction within an environment and creates a digital twin, enabling users without programming backgrounds to develop content. We conducted formative interviews with both subject and media experts to design the system. The prototype was developed and reviewed by experts. We also performed a user study comparing traditional video creation with 2D video creation from 3D recordings, via a 3D editor, which uses freehand interaction for in-headset editing. Users took 5 times less time to record instructions and preferred EditAR, along with giving significantly higher usability scores.more » « less
-
Familiarity with manufacturing environments is an essential aspect for many engineering students. However, such environments in real world often contain expensive equipment making them difficult to recreate in an educational setting. For this reason, simulated physical environments where the process is approximated using scaled-down representations are usually used in education. However, such physical simulations alone may not capture all the details of a real environment. Virtual reality (VR) technology nowadays allows for the creation of fully immersive environments, bringing simulations to the next level. Using rapidly advancing gaming technology, this research paper explores the applicability of creating multiplayer serious games for manufacturing simulation. First, we create and validate a hands-on activity that engages groups of students in the design and assembly of toy cars. Then, a corresponding multiplayer VR game is developed, which allows for the collaboration of multiple VR users in the same virtual environment. With a VR headset and proper infrastructure, a user can participate in a simulation game from any location. This paper explores whether multiplayer VR simulations could be used as an alternative to physical simulations.more » « less
-
Familiarity with manufacturing environments is an essential aspect for many engineering students. However, such environments in real world often contain expensive equipment making them difficult to recreate in an educational setting. For this reason, simulated physical environments where the process is approximated using scaled-down representations are usually used in education. However, such physical simulations alone may not capture all the details of a real environment. Virtual reality (VR) technology nowadays allows for the creation of fully immersive environments, bringing simulations to the next level. Using rapidly advancing gaming technology, this research paper explores the applicability of creating multiplayer serious games for manufacturing simulation. First, we create and validate a hands-on activity that engages groups of students in the design and assembly of toy cars. Then, a corresponding multiplayer VR game is developed, which allows for the collaboration of multiple VR users in the same virtual environment. With a VR headset and proper infrastructure, a user can participate in a simulation game from any location. This paper explores whether multiplayer VR simulations could be used as an alternative to physical simulations.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3411763.3451747
