skip to main content


Title: Nurse Perceptions of the Usability of Augmented Reality to Support Clinical Decision Making: Results of a Pilot Study
Clinically, nurses must rapidly identify deteriorating patients and escalate patient care to adverse events. Novices, however, can easily succumb to cognitive overload. Augmented-reality (AR) devices, such as the Microsoft HoloLens 2, may help nurses attend to task-relevant information more effectively. The aim of this pilot study was to assess experienced nurses’ perceptions on the usability of AR. Practicing nurses were recruited for this study. Following a brief tutorial, demonstration and hands-on use of the HoloLens, nurses completed the system-usability scale (SUS) to rate usability. Additionally, interviews were conducted after the simulated use session. Experienced nurses (n=11) rated the usability of AR as 62.5±7.8. Themes that emerged from our open-ended interviews included the need for AR in nursing education and the potential benefit of a patient care checklist. Use of AR to support nurse decision making may reduce cognitive workload and focus attention on critical areas to recognize patient deterioration.  more » « less
Award ID(s):
1928661
NSF-PAR ID:
10323511
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)
Page Range / eLocation ID:
517 to 520
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Fernández-Alcántara, Manuel (Ed.)
    Background Nurse identification of patient deterioration is critical, particularly during the COVID-19 pandemic, as patients can deteriorate quickly. While the literature has shown that nurses rely on intuition to make decisions, there is limited information on what sources of data experienced nurses utilize to inform their intuition. The objectives of this study were to identify sources of data that inform nurse decision-making related to recognition of deteriorating patients, and explore how COVID-19 has impacted nurse decision-making. Methods In this qualitative study, experienced nurses voluntarily participated in focused interviews. During focused interviews, expert nurses were asked to share descriptions of memorable patient encounters, and questions were posed to facilitate reflections on thoughts and actions that hindered or helped their decision-making. They were also asked to consider the impact of COVID-19 on nursing and decision-making. Interviews were transcribed verbatim, study team members reviewed transcripts and coded responses, and organized key findings into themes. Results Several themes related to decision-making were identified by the research team, including: identifying patient care needs, workload management, and reflecting on missed care opportunities to inform learning. Participants (n = 10) also indicated that COVID-19 presented a number of unique barriers to nurse decision-making. Conclusions Findings from this study indicate that experienced nurses utilize several sources of information to inform their intuition. It is apparent that the demands on nurses in response to pandemics are heightened. Decision-making themes drawn from participants’ experiences can to assist nurse educators for training nursing students on decision-making for deteriorating patients and how to manage the potential barriers (e.g., resource constraints, lack of family) associated with caring for patients during these challenging times prior to encountering these issues in the clinical environment. Nurse practice can utilize these findings to increase awareness among experienced nurses on recognizing how pandemic situations can impact to their decision-making capability. 
    more » « less
  2. null (Ed.)
    Background Clinical alarm system safety is a national patient safety goal in the United States. Physiologic monitors are associated with the highest number of device alarms and alarm-related deaths. However, research involving nurses’ use of physiologic monitors is rare. Hence, the identification of critical usability issues for monitors, especially those related to patient safety, is a nursing imperative. Objective This study examined nurses’ usability of physiologic monitors in intensive care units with respect to the effectiveness and efficiency of monitor use. Methods In total, 30 nurses from 4 adult intensive care units completed 40 tasks in a simulation environment. The tasks were common monitoring tasks that were crucial for appropriate monitoring and safe alarm management across four categories of competencies: admitting, transferring, and discharging patients using the monitors (7 tasks); managing measurements and monitor settings (23 tasks); performing electrocardiogram (ECG) analysis (7 tasks); and troubleshooting alarm conditions (3 tasks). The nurse-monitor interaction was video-recorded. The principal investigator and two expert intensive care units nurse educators identified, classified, and validated task success (effectiveness) and the time of task completion (efficiency). Results Among the 40 tasks, only 2 (5%) were successfully completed by all the nurses. At least 1-27 (3%-90%) nurses abandoned or did not correctly perform 38 tasks. The task with the shortest completion time was “take monitor out of standby” (mean 0:02, SD 0:01 min:s), whereas the task “record a 25 mm/s ECG strip of any of the ECG leads” had the longest completion time (mean 1:14, SD 0:32 min:s). The total time to complete 37 navigation-related tasks ranged from a minimum of 3 min 57 s to a maximum of 32 min 42 s. Regression analysis showed that it took 6 s per click or step to successfully complete a task. To understand the nurses’ thought processes during monitor navigation, the authors analyzed the paths of the 2 tasks with the lowest successful completion rates, where only 13% (4/30) of the nurses correctly completed these 2 tasks. Although 30% (9/30) of the nurses accessed the correct screen first for task 1 and task 2, they could not find their way easily from there to successfully complete the 2 tasks. Conclusions Usability testing of physiologic monitors revealed major ineffectiveness and inefficiencies in the current nurse-monitor interactions. The results indicate the potential for safety and productivity issues in completing routine tasks. Training on monitor use should include critical monitoring functions that are necessary for safe, effective, efficient, and appropriate monitoring to include knowledge of the shortest navigation path. It is imperative that vendors’ future monitor designs mimic clinicians’ thought processes for successful, safe, and efficient monitor navigation. 
    more » « less
  3. NA (Ed.)
    Problem Definition Moral distress (MoD) is a vital clinical indicator linked to clinician burnout and provider concerns about declining patient care quality. Yet it is not routinely assessed. Earlier, real-time recognition may better target interventions aimed at alleviating MoD and thereby increase provider well-being and improve patient care quality. Initial Approach and Testing Combining two validated MoD instruments (the Moral Distress Thermometer [MDT] and the Measure of Moral Distress for Healthcare Professionals [MMD-HP]), the authors developed a novel mobile and Web-based application environment to measure and report levels MoD and their associated causes. This app was tested for basic feasibility and acceptability in two groups: graduate nursing students and practicing critical care nurses. Results The MDT app appears feasible and acceptable for future use. All participants (n = 34) indicated the MDT app was satisfying to use, and 91.2% (n = 31) indicated the app was “very appropriate” for measuring MoD. In addition, 84.2% (n =16) of practicing nurses indicated the app fit either “somewhat well” (47.4%, n = 9) or “very well” (36.8%, n = 7) into their typical workday, and 68.4% (n = 13) said they were either “extremely likely” or “somewhat likely” to use the app daily in clinical practice. Key Insights and Next Steps Education about moral distress and its associated causes proved important to the MDT app's success. It is ready for future validity and reliability testing, as well as examining usability beyond nursing, longitudinal data monitoring, and possible leveraging to pre- and postintervention evaluation studies. 
    more » « less
  4. Objective This study investigates how team cognition occurs in care transitions from operating room (OR) to intensive care unit (ICU). We then seek to understand how the sociotechnical system and team cognition are related. Background Effective handoffs are critical to ensuring patient safety and have been the subject of many improvement efforts. However, the types of team-level cognitive processing during handoffs have not been explored, nor is it clear how the sociotechnical system shapes team cognition. Method We conducted this study in an academic, Level 1 trauma center in the Midwestern United States. Twenty-eight physicians (surgery, anesthesia, pediatric critical care) and nurses (OR, ICU) participated in semi-structured interviews. We performed qualitative content analysis and epistemic network analysis to understand the relationships between system factors, team cognition in handoffs and outcomes. Results Participants described three team cognition functions in handoffs—(1) information exchange, (2) assessment, and (3) planning and decision making; information exchange was mentioned most. Work system factors influenced team cognition. Inter-professional handoffs facilitated information exchange but included large teams with diverse backgrounds communicating, which can be inefficient. Intra-professional handoffs decreased team size and role diversity, which may simplify communication but increase information loss. Participants in inter-professional handoffs reflected on outcomes significantly more in relation to system factors and team cognition ( p < 0.001), while participants in intra-professional handoffs discussed handoffs as a task. Conclusion Handoffs include team cognition, which was influenced by work system design. Opportunities for handoff improvement include a flexibly standardized process and supportive tools/technologies. We recommend incorporating perspectives of the patient and family in future work. 
    more » « less
  5. null (Ed.)
    Background According to the US Bureau of Labor Statistics, nurses will be the largest labor pool in the United States by 2022, and more than 1.1 million nursing positions have to be filled by then in order to avoid a nursing shortage. In addition, the incidence rate of musculoskeletal disorders in nurses is above average in comparison with other occupations. Robot-assisted health care has the potential to alleviate the nursing shortage by automating mundane and routine nursing tasks. Furthermore, robots in health care environments may assist with safe patient mobility and handling and may thereby reduce the likelihood of musculoskeletal disorders. Objective This pilot study investigates the perceived ease of use and perceived usefulness (acceptability) of a customized service robot as determined by nursing students (as proxies for nursing staff in health care environments). This service robot, referred to as the Adaptive Robotic Nurse Assistant (ARNA), was developed to enhance the productivity of nurses through cooperation during physical tasks (eg, patient walking, item fetching, object delivery) as well as nonphysical tasks (eg, patient observation and feedback). This pilot study evaluated the acceptability of ARNA to provide ambulatory assistance to patients. Methods We conducted a trial with 24 participants to collect data and address the following research question: Is the use of ARNA as an ambulatory assistive device for patients acceptable to nurses? The experiments were conducted in a simulated hospital environment. Nursing students (as proxies for nursing staff) were grouped in dyads, with one participant serving as a nurse and the other acting as a patient. Two questionnaires were developed and administrated to the participants based on the Technology Acceptance Model with respect to the two subscales of perceived usefulness and perceived ease of use metrics. In order to evaluate the internal consistency/reliability of the questionnaires, we calculated Cronbach alpha coefficients. Furthermore, statistical analyses were conducted to evaluate the relation of each variable in the questionnaires with the overall perceived usefulness and perceived ease of use metrics. Results Both Cronbach alpha values were acceptably high (.93 and .82 for perceived usefulness and perceived ease of use questionnaires, respectively), indicating high internal consistency of the questionnaires. The correlation between the variables and the overall perceived usefulness and perceived ease of use metrics was moderate. The average perceived usefulness and perceived ease of use metrics among the participants were 4.13 and 5.42, respectively, out of possible score of 7, indicating a higher-than-average acceptability of this service robot. Conclusions The results served to identify factors that could affect nurses’ acceptance of ARNA and aspects needing improvement (eg, flexibility, ease of operation, and autonomy level). 
    more » « less