skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Thursday, January 16 until 2:00 AM ET on Friday, January 17 due to maintenance. We apologize for the inconvenience.


Title: Virtual Reality Instructional (VRI) module for training and patient safety
Healthcare practitioners, social workers, and care coordinators must work together seamlessly, safely and efficiently. Within the context of the COVID-19 pandemic, understanding relevant evidence-based and best practices as well as identification of barriers and facilitators of care for vulnerable populations are of crucial importance. A current gap exists in the lack of specific training for these specialized personnel to facilitate care for socially vulnerable populations, particularly racial and ethnic minorities. With continuing advancements in technology, VR based training incorporates real-life experience and creates a “sense of presence” in the environment. Furthermore, immersive virtual environments offer considerable advantages over traditional training exercises such as reduction in the time and cost for different what-if scenarios and opportunities for more frequent practice. This paper proposes the development of Virtual Reality Instructional (VRI) training modules geared for COVID-19 testing. The VRI modules are developed for immersive, non-immersive, and mobile environment. This paper describes the development and testing of the VRI module using the Unity gaming engine. These VRI modules are developed to help increase safety preparedness and mitigate the social distancing related risks for safety management.  more » « less
Award ID(s):
2032344 2026412 1923986
PAR ID:
10244736
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Electronic Imaging
ISSN:
2470-1173
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Active shooter events are not emergencies that can be reasonably anticipated. However, these events do occur more than we think, and there is a critical need for an effective emergency preparedness plan that can increase the likelihood of saving lives and reducing casualties in the event of an active shooting incident. There has been a major concern about the lack of tools available to allow for modeling and simulation of human behavior during emergency response training. Over the past few decades, virtual reality-based training for emergency response and decision making has been recognized as a novel alternative for disaster preparedness. This paper presents an immersive virtual reality (VR) training module for active shooter events for a building emergency response. There are two immersive active shooter modules developed: occupant’s module and Security personnel module. We have developed an immersive virtual reality training module for active shooter events using an Oculus for the course of action, visualization, and situational awareness for active shooter events. The immersive environment is implemented in Unity 3D where the user has an option to enter the environment as security personnel or as an occupant in the building. The immersive VR training module offers a unique platform for emergency response and decision making training. The platform allows for collecting data on different what-if scenarios in response to active shooter events that impact the actions of security personnel and occupants in a building. The data collected can be used to educate security personnel on how to reduce response times. Moreover, security personnel can be trained to respond to a variety of emergencies safely and securely without ever being exposed to real-world dangers. 
    more » « less
  2. null (Ed.)
    Situational awareness provides the decision making capability to identify, process, and comprehend big data. In our approach, situational awareness is achieved by integrating and analyzing multiple aspects of data using stacked bar graphs and geographic representations of the data. We provide a data visualization tool to represent COVID pandemic data on top of the geographical information. The combination of geospatial and temporal data provides the information needed to conduct situational analysis for the COVID-19 pandemic. By providing interactivity, geographical maps can be viewed from different perspectives and offer insight into the dynamical aspects of the COVID-19 pandemic for the fifty states in the USA. We have overlaid dynamic information on top of a geographical representation in an intuitive way for decision making. We describe how modeling and simulation of data increase situational awareness, especially when coupled with immersive virtual reality interaction. This paper presents an immersive virtual reality (VR) environment and mobile environment for data visualization using Oculus Rift head-mounted display and smartphones. This work combines neural network predictions with human-centric situational awareness and data analytics to provide accurate, timely, and scientific strategies in combatting and mitigating the spread of the coronavirus pandemic. Testing and evaluation of the data visualization tool have been done with real-time feed of COVID pandemic data set for immersive environment, non-immersive environment, and mobile environment. 
    more » « less
  3. Abstract

    Health care delivery is undergoing an accelerated period of digital transformation, spurred in part by the COVID-19 pandemic and the use of “virtual-first” care delivery models such as telemedicine. Medical education has responded to this shift with calls for improved digital health training, but there is as yet no universal understanding of the needed competencies, domains, and best practices for teaching these skills. In this paper, we argue that a “digital determinants of health” (DDoH) framework for understanding the intersections of health outcomes, technology, and training is critical to the development of comprehensive digital health competencies in medical education. Much like current social determinants of health models, the DDoH framework can be integrated into undergraduate, graduate, and professional education to guide training interventions as well as competency development and evaluation. We provide possible approaches to integrating this framework into training programs and explore priorities for future research in digitally-competent medical education.

     
    more » « less
  4. null (Ed.)
    Real-time data visualization can enhance decision making and empower teams with human-centric situational awareness insights. Decision making relies on data which comes in overwhelming velocity and volume, that one cannot comprehend it without some layer of abstraction. This research effort aims to demonstrate the data visualization of the COVID pandemic in real-time for the fifty states in the USA. Our proposed data visualization tool includes both conceptual and data-driven information. The data visualization includes stacked bar graphs, geographic representations of the data, and offers situational awareness of the COVID-19 pandemic. This paper describes the development and testing of the data visualization tool using the Unity gaming engine. Testing has been done with a real-time feed of the COVID-19 data set for immersive environment, non-immersive environment, and mobile environment. 
    more » « less
  5. null (Ed.)
    The COVID-19 pandemic has placed an overwhelming strain on our Nation's ability to treat patients; the number of patients who need to be tested continues to rise. With nurses also becoming infected, the number of trained professionals who can perform tasks such as testing of patients along with providing care involving hooking up patients to ventilators continues to decrease as well. There is a need to explore the adoption of virtual computer based training mediums which will enable new nurses and others to be trained in safe and efficient procedures involving patients during this pandemic period. In this paper, the design of a VR based simulator based on Human Centered Computing (HCC) principles is discussed. The role of HCC factors such as affordance and cognitive load on the comprehension and scene understanding of nurses during training and the acquisition of knowledge of safety procedures and detailed steps (pertaining to nasal sample collection and use of ventilators on patients) has been studied with the involvement of nurse and nurse trainee participants. Adoption of a participatory design approach involving experts (nurses, doctors involved in covid-19 testing and treatment) has provided a foundational basis for design of the training environments and assessment activities. Formal information centric process models of the nasal swabbing procedures and ventilator hookup tasks were created using the engineering Enterprise Modeling Language (eEML). The preliminary results from the assessment activities indicate the positive impact of such HCC based 3Dsimulators in such training of first responders. 
    more » « less