Title: Nurse Perceptions of the Usability of Augmented Reality to Support Clinical Decision Making: Results of a Pilot Study
Clinically, nurses must rapidly identify deteriorating patients and escalate patient care to adverse events. Novices, however, can easily succumb to cognitive overload. Augmented-reality (AR) devices, such as the Microsoft HoloLens 2, may help nurses attend to task-relevant information more effectively. The aim of this pilot study was to assess experienced nurses’ perceptions on the usability of AR. Practicing nurses were recruited for this study. Following a brief tutorial, demonstration and hands-on use of the HoloLens, nurses completed the system-usability scale (SUS) to rate usability. Additionally, interviews were conducted after the simulated use session. Experienced nurses (n=11) rated the usability of AR as 62.5±7.8. Themes that emerged from our open-ended interviews included the need for AR in nursing education and the potential benefit of a patient care checklist. Use of AR to support nurse decision making may reduce cognitive workload and focus attention on critical areas to recognize patient deterioration.  more » « less
Award ID(s):
1928661
PAR ID:
10323511
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Page Range / eLocation ID:
517 to 520
Subject(s) / Keyword(s):
Sponsoring Org:
National Science Foundation
More Like this
  1. Fernández-Alcántara, Manuel (Ed.)
    Background Nurse identification of patient deterioration is critical, particularly during the COVID-19 pandemic, as patients can deteriorate quickly. While the literature has shown that nurses rely on intuition to make decisions, there is limited information on what sources of data experienced nurses utilize to inform their intuition. The objectives of this study were to identify sources of data that inform nurse decision-making related to recognition of deteriorating patients, and explore how COVID-19 has impacted nurse decision-making. Methods In this qualitative study, experienced nurses voluntarily participated in focused interviews. During focused interviews, expert nurses were asked to share descriptions of memorable patient encounters, and questions were posed to facilitate reflections on thoughts and actions that hindered or helped their decision-making. They were also asked to consider the impact of COVID-19 on nursing and decision-making. Interviews were transcribed verbatim, study team members reviewed transcripts and coded responses, and organized key findings into themes. Results Several themes related to decision-making were identified by the research team, including: identifying patient care needs, workload management, and reflecting on missed care opportunities to inform learning. Participants (n = 10) also indicated that COVID-19 presented a number of unique barriers to nurse decision-making. Conclusions Findings from this study indicate that experienced nurses utilize several sources of information to inform their intuition. It is apparent that the demands on nurses in response to pandemics are heightened. Decision-making themes drawn from participants’ experiences can to assist nurse educators for training nursing students on decision-making for deteriorating patients and how to manage the potential barriers (e.g., resource constraints, lack of family) associated with caring for patients during these challenging times prior to encountering these issues in the clinical environment. Nurse practice can utilize these findings to increase awareness among experienced nurses on recognizing how pandemic situations can impact to their decision-making capability. 
    more » « less
  2. Abstract Rapid nurse decision-making is needed to detect patient deterioration and prevent mortality. Current approaches to support nurses’ decisions involve diagnostic data processing and providing a decision with little explanation. Our team aimed to demonstrate the utility of attention architecture to model sequential nurse–patient care actions. Experienced nurses and students completed patient care simulations. Nurse actions were systematically coded and analyzed using our model, consisting of an attention encoder to sequentially process and predict nurse behavior. Performance of our model was compared to recurrent neural networks and long-short term memory models based on accuracy, precision, recall, and F1 score. Behavioral data from 24 nurses (11 experienced nurses and 13 nursing students) were collected during patient care simulations. Nineteen unique types of actions were distilled down to 8 common actions. There were 33 episodes captured (i.e., 33 unique sequences of patient care actions), including a total of 1024 actions (i.e., an average of 31 ± 11 actions). Results showed that the attention model outperformed the other models on all metrics except for precision. Our team demonstrated that machine learning can model sequential nurse actions. These results could be leveraged to provide real-time guidance to support novice nurses’ decision-making in the simulated environment. 
    more » « less
  3. This study investigates how clinical experience shapes nurses’ visual cue-gathering during acute patient deterioration. Using wearable eye-trackers, expert and student nurses’ visual behaviors were analyzed across pre- and post-deterioration phases in a simulated patient care scenario. Expert nurses fixated more on clinically relevant areas and exhibited more focused, sequential gaze patterns. In contrast, student nurses displayed greater fixation variability and higher gaze transition entropy, indicating less efficient scanning and increased cognitive load. These findings offer an objective, sensor-based understanding of how experience influences clinical decision-making and highlight eye-tracking’s potential for nursing education. 
    more » « less
  4. null (Ed.)
    Background Clinical alarm system safety is a national patient safety goal in the United States. Physiologic monitors are associated with the highest number of device alarms and alarm-related deaths. However, research involving nurses’ use of physiologic monitors is rare. Hence, the identification of critical usability issues for monitors, especially those related to patient safety, is a nursing imperative. Objective This study examined nurses’ usability of physiologic monitors in intensive care units with respect to the effectiveness and efficiency of monitor use. Methods In total, 30 nurses from 4 adult intensive care units completed 40 tasks in a simulation environment. The tasks were common monitoring tasks that were crucial for appropriate monitoring and safe alarm management across four categories of competencies: admitting, transferring, and discharging patients using the monitors (7 tasks); managing measurements and monitor settings (23 tasks); performing electrocardiogram (ECG) analysis (7 tasks); and troubleshooting alarm conditions (3 tasks). The nurse-monitor interaction was video-recorded. The principal investigator and two expert intensive care units nurse educators identified, classified, and validated task success (effectiveness) and the time of task completion (efficiency). Results Among the 40 tasks, only 2 (5%) were successfully completed by all the nurses. At least 1-27 (3%-90%) nurses abandoned or did not correctly perform 38 tasks. The task with the shortest completion time was “take monitor out of standby” (mean 0:02, SD 0:01 min:s), whereas the task “record a 25 mm/s ECG strip of any of the ECG leads” had the longest completion time (mean 1:14, SD 0:32 min:s). The total time to complete 37 navigation-related tasks ranged from a minimum of 3 min 57 s to a maximum of 32 min 42 s. Regression analysis showed that it took 6 s per click or step to successfully complete a task. To understand the nurses’ thought processes during monitor navigation, the authors analyzed the paths of the 2 tasks with the lowest successful completion rates, where only 13% (4/30) of the nurses correctly completed these 2 tasks. Although 30% (9/30) of the nurses accessed the correct screen first for task 1 and task 2, they could not find their way easily from there to successfully complete the 2 tasks. Conclusions Usability testing of physiologic monitors revealed major ineffectiveness and inefficiencies in the current nurse-monitor interactions. The results indicate the potential for safety and productivity issues in completing routine tasks. Training on monitor use should include critical monitoring functions that are necessary for safe, effective, efficient, and appropriate monitoring to include knowledge of the shortest navigation path. It is imperative that vendors’ future monitor designs mimic clinicians’ thought processes for successful, safe, and efficient monitor navigation. 
    more » « less
  5. Nurses face significant physical demands during patient care, leading to high rates of musculoskeletal disorders (MSDs) among nurses in long-term care. Exoskeletons demonstrate promise in supporting nurses and nurse managers with MSDs; however, social contextual factors are crucial to their design and implementation. Through thematic analysis of 17 semi-structured interviews, this paper reveals social contextual factors important to exoskeleton use among nurses and nurse managers in long-term care. Participants expressed concerns about workplace discrimination, co-worker perceptions of their capabilities, and patient confidence. Our findings highlight the need for supportive organizational cultures and open communication channels. Recommendations include in-depth systems analysis to assess exoskeleton feasibility and efficacy, involving input from frontline nurses/managers, management, and patients. These findings can aid human factors and ergonomics (HF/E) experts in balancing social contextual factors and other work system elements to design work system contexts and exoskeletons that promote optimal outcomes in long-term care settings. 
    more » « less