skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic
Title: Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic
The COVID-19 pandemic has placed an overwhelming strain on our Nation's ability to treat patients; the number of patients who need to be tested continues to rise. With nurses also becoming infected, the number of trained professionals who can perform tasks such as testing of patients along with providing care involving hooking up patients to ventilators continues to decrease as well. There is a need to explore the adoption of virtual computer based training mediums which will enable new nurses and others to be trained in safe and efficient procedures involving patients during this pandemic period. In this paper, the design of a VR based simulator based on Human Centered Computing (HCC) principles is discussed. The role of HCC factors such as affordance and cognitive load on the comprehension and scene understanding of nurses during training and the acquisition of knowledge of safety procedures and detailed steps (pertaining to nasal sample collection and use of ventilators on patients) has been studied with the involvement of nurse and nurse trainee participants. Adoption of a participatory design approach involving experts (nurses, doctors involved in covid-19 testing and treatment) has provided a foundational basis for design of the training environments and assessment activities. Formal information centric process models of the nasal swabbing procedures and ventilator hookup tasks were created using the engineering Enterprise Modeling Language (eEML). The preliminary results from the assessment activities indicate the positive impact of such HCC based 3Dsimulators in such training of first responders.  more » « less
Award ID(s):
2028077
PAR ID:
10226042
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2021 IEEE International Systems Conference (SysCon),
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; (, PLOS ONE)
    Fernández-Alcántara, Manuel (Ed.)
    Background Nurse identification of patient deterioration is critical, particularly during the COVID-19 pandemic, as patients can deteriorate quickly. While the literature has shown that nurses rely on intuition to make decisions, there is limited information on what sources of data experienced nurses utilize to inform their intuition. The objectives of this study were to identify sources of data that inform nurse decision-making related to recognition of deteriorating patients, and explore how COVID-19 has impacted nurse decision-making. Methods In this qualitative study, experienced nurses voluntarily participated in focused interviews. During focused interviews, expert nurses were asked to share descriptions of memorable patient encounters, and questions were posed to facilitate reflections on thoughts and actions that hindered or helped their decision-making. They were also asked to consider the impact of COVID-19 on nursing and decision-making. Interviews were transcribed verbatim, study team members reviewed transcripts and coded responses, and organized key findings into themes. Results Several themes related to decision-making were identified by the research team, including: identifying patient care needs, workload management, and reflecting on missed care opportunities to inform learning. Participants (n = 10) also indicated that COVID-19 presented a number of unique barriers to nurse decision-making. Conclusions Findings from this study indicate that experienced nurses utilize several sources of information to inform their intuition. It is apparent that the demands on nurses in response to pandemics are heightened. Decision-making themes drawn from participants’ experiences can to assist nurse educators for training nursing students on decision-making for deteriorating patients and how to manage the potential barriers (e.g., resource constraints, lack of family) associated with caring for patients during these challenging times prior to encountering these issues in the clinical environment. Nurse practice can utilize these findings to increase awareness among experienced nurses on recognizing how pandemic situations can impact to their decision-making capability. 
    more » « less
  2. ; ; ; ; ; ; (, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN))
    An ongoing nurse labor shortage has the potential to impact patient care well-being in the entire healthcare system. Moreover, more complex and sophisticated nursing care is required today for patients in hospitals forcing hospital-based nurses to carry out frequent training and assessment procedures, both to onboard new nurses and to validate skills of existing staff that guarantees best practices and safety. In this paper, we recognize an opportunity for the development and integration of intelligent robot tutoring technology into nursing education to tackle the growing challenges of nurse deficit. To this end, we identify specific research problems in the area of human-robot interaction that will need to be addressed to enable robot tutors for nurse training. 
    more » « less
  3. ; ; ; ; ; ; (, Robotics: Science and Systems)
    Carlone, Luca; Kulic, Dana; Venture, Gentiane; Strader, Jared (Ed.)
    The central line dressing change is a life-critical procedure performed by nurses to provide patients with rapid infusion of fluids, such as blood and medications. Due to their complexity and the heavy workloads nurses face, dressing changes are prone to preventable errors that can result in central line-associated bloodstream infections (CLABSIs), leading to serious health complications or, in the worst cases, patient death. In the post-COVID-19 era, CLABSI rates have increased, partly due to the heightened nursing workload caused by shortages of both registered nurses and nurse educators. To address this challenge, healthcare facilities are seeking innovative nurse training solutions to complement expert nurse educators. In response, we present the design, development and evaluation of a robotic tutoring system, ASTRID: the Automated Sterile Technique Review and Instruction Device. ASTRID, which is the outcome of a two-year participatory design process, is designed to aid in the training of nursing skills essential for CLABSI prevention. First, we describe insights gained from interviews with nurse educators and nurses, which revealed the gaps of current training methods and requirements for new training tools. Based on these findings, we outline the development of our robotic tutor, which interacts with nursing students, providing real-time interventions and summary feedback to support skill acquisition. Finally, we present evaluations of the system's performance and perceived usefulness, conducted in a simulated clinical setting with nurse participants. These evaluations demonstrate the potential of our robotic tutor in nursing education. Our work highlights the importance of participatory design for robotics systems, and motivates new avenues for foundational research in robotics. 
    more » « less
  4. ; ; ; ; ; (, 2022 International Conference on Digital Transformation and Intelligence)
    This paper discusses the key elements of a research study that focused on training an important procedure called “Endotracheal intubation” to novice students. Such a procedure is a virtual part of treating patients who are infected with the covid-19 virus. A virtual reality environment was created to facilitate the training of novice nurses (or nurse trainees) using the HTC Vive platform. The primary interaction with the virtual objects inside this simulation-based training environment was using the hand controller. However, the small mouth of the virtual patient and the necessity of utilizing both hands to pick up the laryngoscope and endotracheal tube at the same time (during training), led to collisions involving the hand controllers and hampered the immersive experience of the participants. A multi-sensory conflict notion-based approach was proposed to address this problem. We used “Haptic retargeting” method to solve this issue. And we compared the result of the haptic retargeting method with reference condtion. Initial Results (through a questionnaire) suggest that this Haptic retargeting approach increases the participants’ sense of presence in the virtual environment. 
    more » « less
  5. ; ; ; (, Frontiers in Robotics and AI)
    null (Ed.)
    The unprecedented shock caused by the COVID-19 pandemic has severely influenced the delivery of regular healthcare services. Most non-urgent medical activities, including elective surgeries, have been paused to mitigate the risk of infection and to dedicate medical resources to managing the pandemic. In this regard, not only surgeries are substantially influenced, but also pre- and post-operative assessment of patients and training for surgical procedures have been significantly impacted due to the pandemic. Many countries are planning a phased reopening, which includes the resumption of some surgical procedures. However, it is not clear how the reopening safe-practice guidelines will impact the quality of healthcare delivery. This perspective article evaluates the use of robotics and AI in 1) robotics-assisted surgery, 2) tele-examination of patients for pre- and post-surgery, and 3) tele-training for surgical procedures. Surgeons interact with a large number of staff and patients on a daily basis. Thus, the risk of infection transmission between them raises concerns. In addition, pre- and post-operative assessment also raises concerns about increasing the risk of disease transmission, in particular, since many patients may have other underlying conditions, which can increase their chances of mortality due to the virus. The pandemic has also limited the time and access that trainee surgeons have for training in the OR and/or in the presence of an expert. In this article, we describe existing challenges and possible solutions and suggest future research directions that may be relevant for robotics and AI in addressing the three tasks mentioned above. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email