skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic
Title: Design of a Human Centered Computing (HCC) based Virtual Reality Simulator to train First Responders Involved in the COVID-19 Pandemic
The COVID-19 pandemic has placed an overwhelming strain on our Nation's ability to treat patients; the number of patients who need to be tested continues to rise. With nurses also becoming infected, the number of trained professionals who can perform tasks such as testing of patients along with providing care involving hooking up patients to ventilators continues to decrease as well. There is a need to explore the adoption of virtual computer based training mediums which will enable new nurses and others to be trained in safe and efficient procedures involving patients during this pandemic period. In this paper, the design of a VR based simulator based on Human Centered Computing (HCC) principles is discussed. The role of HCC factors such as affordance and cognitive load on the comprehension and scene understanding of nurses during training and the acquisition of knowledge of safety procedures and detailed steps (pertaining to nasal sample collection and use of ventilators on patients) has been studied with the involvement of nurse and nurse trainee participants. Adoption of a participatory design approach involving experts (nurses, doctors involved in covid-19 testing and treatment) has provided a foundational basis for design of the training environments and assessment activities. Formal information centric process models of the nasal swabbing procedures and ventilator hookup tasks were created using the engineering Enterprise Modeling Language (eEML). The preliminary results from the assessment activities indicate the positive impact of such HCC based 3Dsimulators in such training of first responders.  more » « less
Award ID(s):
2028077
NSF-PAR ID:
10226042
Author(s) / Creator(s):
; ; ; ;
Date Published:
Journal Name:
2021 IEEE International Systems Conference (SysCon),
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ( , PLOS ONE)
    Fernández-Alcántara, Manuel (Ed.)
    Background Nurse identification of patient deterioration is critical, particularly during the COVID-19 pandemic, as patients can deteriorate quickly. While the literature has shown that nurses rely on intuition to make decisions, there is limited information on what sources of data experienced nurses utilize to inform their intuition. The objectives of this study were to identify sources of data that inform nurse decision-making related to recognition of deteriorating patients, and explore how COVID-19 has impacted nurse decision-making. Methods In this qualitative study, experienced nurses voluntarily participated in focused interviews. During focused interviews, expert nurses were asked to share descriptions of memorable patient encounters, and questions were posed to facilitate reflections on thoughts and actions that hindered or helped their decision-making. They were also asked to consider the impact of COVID-19 on nursing and decision-making. Interviews were transcribed verbatim, study team members reviewed transcripts and coded responses, and organized key findings into themes. Results Several themes related to decision-making were identified by the research team, including: identifying patient care needs, workload management, and reflecting on missed care opportunities to inform learning. Participants (n = 10) also indicated that COVID-19 presented a number of unique barriers to nurse decision-making. Conclusions Findings from this study indicate that experienced nurses utilize several sources of information to inform their intuition. It is apparent that the demands on nurses in response to pandemics are heightened. Decision-making themes drawn from participants’ experiences can to assist nurse educators for training nursing students on decision-making for deteriorating patients and how to manage the potential barriers (e.g., resource constraints, lack of family) associated with caring for patients during these challenging times prior to encountering these issues in the clinical environment. Nurse practice can utilize these findings to increase awareness among experienced nurses on recognizing how pandemic situations can impact to their decision-making capability. 
    more » « less
  2. ; ; ; ( , Frontiers in Robotics and AI)
    null (Ed.)
    The unprecedented shock caused by the COVID-19 pandemic has severely influenced the delivery of regular healthcare services. Most non-urgent medical activities, including elective surgeries, have been paused to mitigate the risk of infection and to dedicate medical resources to managing the pandemic. In this regard, not only surgeries are substantially influenced, but also pre- and post-operative assessment of patients and training for surgical procedures have been significantly impacted due to the pandemic. Many countries are planning a phased reopening, which includes the resumption of some surgical procedures. However, it is not clear how the reopening safe-practice guidelines will impact the quality of healthcare delivery. This perspective article evaluates the use of robotics and AI in 1) robotics-assisted surgery, 2) tele-examination of patients for pre- and post-surgery, and 3) tele-training for surgical procedures. Surgeons interact with a large number of staff and patients on a daily basis. Thus, the risk of infection transmission between them raises concerns. In addition, pre- and post-operative assessment also raises concerns about increasing the risk of disease transmission, in particular, since many patients may have other underlying conditions, which can increase their chances of mortality due to the virus. The pandemic has also limited the time and access that trainee surgeons have for training in the OR and/or in the presence of an expert. In this article, we describe existing challenges and possible solutions and suggest future research directions that may be relevant for robotics and AI in addressing the three tasks mentioned above. 
    more » « less
  3. ; ; ; ; ; ; ; ; ; ( , JMIR Nursing)
    null (Ed.)
    Background Clinical alarm system safety is a national patient safety goal in the United States. Physiologic monitors are associated with the highest number of device alarms and alarm-related deaths. However, research involving nurses’ use of physiologic monitors is rare. Hence, the identification of critical usability issues for monitors, especially those related to patient safety, is a nursing imperative. Objective This study examined nurses’ usability of physiologic monitors in intensive care units with respect to the effectiveness and efficiency of monitor use. Methods In total, 30 nurses from 4 adult intensive care units completed 40 tasks in a simulation environment. The tasks were common monitoring tasks that were crucial for appropriate monitoring and safe alarm management across four categories of competencies: admitting, transferring, and discharging patients using the monitors (7 tasks); managing measurements and monitor settings (23 tasks); performing electrocardiogram (ECG) analysis (7 tasks); and troubleshooting alarm conditions (3 tasks). The nurse-monitor interaction was video-recorded. The principal investigator and two expert intensive care units nurse educators identified, classified, and validated task success (effectiveness) and the time of task completion (efficiency). Results Among the 40 tasks, only 2 (5%) were successfully completed by all the nurses. At least 1-27 (3%-90%) nurses abandoned or did not correctly perform 38 tasks. The task with the shortest completion time was “take monitor out of standby” (mean 0:02, SD 0:01 min:s), whereas the task “record a 25 mm/s ECG strip of any of the ECG leads” had the longest completion time (mean 1:14, SD 0:32 min:s). The total time to complete 37 navigation-related tasks ranged from a minimum of 3 min 57 s to a maximum of 32 min 42 s. Regression analysis showed that it took 6 s per click or step to successfully complete a task. To understand the nurses’ thought processes during monitor navigation, the authors analyzed the paths of the 2 tasks with the lowest successful completion rates, where only 13% (4/30) of the nurses correctly completed these 2 tasks. Although 30% (9/30) of the nurses accessed the correct screen first for task 1 and task 2, they could not find their way easily from there to successfully complete the 2 tasks. Conclusions Usability testing of physiologic monitors revealed major ineffectiveness and inefficiencies in the current nurse-monitor interactions. The results indicate the potential for safety and productivity issues in completing routine tasks. Training on monitor use should include critical monitoring functions that are necessary for safe, effective, efficient, and appropriate monitoring to include knowledge of the shortest navigation path. It is imperative that vendors’ future monitor designs mimic clinicians’ thought processes for successful, safe, and efficient monitor navigation. 
    more » « less
  4. ; ; ; ; ; ( , 2022 International Conference on Digital Transformation and Intelligence)
    This paper discusses the key elements of a research study that focused on training an important procedure called “Endotracheal intubation” to novice students. Such a procedure is a virtual part of treating patients who are infected with the covid-19 virus. A virtual reality environment was created to facilitate the training of novice nurses (or nurse trainees) using the HTC Vive platform. The primary interaction with the virtual objects inside this simulation-based training environment was using the hand controller. However, the small mouth of the virtual patient and the necessity of utilizing both hands to pick up the laryngoscope and endotracheal tube at the same time (during training), led to collisions involving the hand controllers and hampered the immersive experience of the participants. A multi-sensory conflict notion-based approach was proposed to address this problem. We used “Haptic retargeting” method to solve this issue. And we compared the result of the haptic retargeting method with reference condtion. Initial Results (through a questionnaire) suggest that this Haptic retargeting approach increases the participants’ sense of presence in the virtual environment. 
    more » « less
  5. ; ; ; ; ; ; ( , IEEE International Conference on Robot and Human Interactive Communication (RO-MAN))
    An ongoing nurse labor shortage has the potential to impact patient care well-being in the entire healthcare system. Moreover, more complex and sophisticated nursing care is required today for patients in hospitals forcing hospital-based nurses to carry out frequent training and assessment procedures, both to onboard new nurses and to validate skills of existing staff that guarantees best practices and safety. In this paper, we recognize an opportunity for the development and integration of intelligent robot tutoring technology into nursing education to tackle the growing challenges of nurse deficit. To this end, we identify specific research problems in the area of human-robot interaction that will need to be addressed to enable robot tutors for nurse training. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email