skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Improving the Safety, Effectiveness, and Efficiency of Clinical Alarm Systems: Simulation-Based Usability Testing of Physiologic Monitors
Title: Improving the Safety, Effectiveness, and Efficiency of Clinical Alarm Systems: Simulation-Based Usability Testing of Physiologic Monitors
Background Clinical alarm system safety is a national patient safety goal in the United States. Physiologic monitors are associated with the highest number of device alarms and alarm-related deaths. However, research involving nurses’ use of physiologic monitors is rare. Hence, the identification of critical usability issues for monitors, especially those related to patient safety, is a nursing imperative. Objective This study examined nurses’ usability of physiologic monitors in intensive care units with respect to the effectiveness and efficiency of monitor use. Methods In total, 30 nurses from 4 adult intensive care units completed 40 tasks in a simulation environment. The tasks were common monitoring tasks that were crucial for appropriate monitoring and safe alarm management across four categories of competencies: admitting, transferring, and discharging patients using the monitors (7 tasks); managing measurements and monitor settings (23 tasks); performing electrocardiogram (ECG) analysis (7 tasks); and troubleshooting alarm conditions (3 tasks). The nurse-monitor interaction was video-recorded. The principal investigator and two expert intensive care units nurse educators identified, classified, and validated task success (effectiveness) and the time of task completion (efficiency). Results Among the 40 tasks, only 2 (5%) were successfully completed by all the nurses. At least 1-27 (3%-90%) nurses abandoned or did not correctly perform 38 tasks. The task with the shortest completion time was “take monitor out of standby” (mean 0:02, SD 0:01 min:s), whereas the task “record a 25 mm/s ECG strip of any of the ECG leads” had the longest completion time (mean 1:14, SD 0:32 min:s). The total time to complete 37 navigation-related tasks ranged from a minimum of 3 min 57 s to a maximum of 32 min 42 s. Regression analysis showed that it took 6 s per click or step to successfully complete a task. To understand the nurses’ thought processes during monitor navigation, the authors analyzed the paths of the 2 tasks with the lowest successful completion rates, where only 13% (4/30) of the nurses correctly completed these 2 tasks. Although 30% (9/30) of the nurses accessed the correct screen first for task 1 and task 2, they could not find their way easily from there to successfully complete the 2 tasks. Conclusions Usability testing of physiologic monitors revealed major ineffectiveness and inefficiencies in the current nurse-monitor interactions. The results indicate the potential for safety and productivity issues in completing routine tasks. Training on monitor use should include critical monitoring functions that are necessary for safe, effective, efficient, and appropriate monitoring to include knowledge of the shortest navigation path. It is imperative that vendors’ future monitor designs mimic clinicians’ thought processes for successful, safe, and efficient monitor navigation.  more » « less
Award ID(s):
1812599
PAR ID:
10232739
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
JMIR Nursing
Volume:
4
Issue:
1
ISSN:
2562-7600
Page Range / eLocation ID:
e20584
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; (, Biomedical Instrumentation & Technology)
    Abstract Alarm fatigue is a complex phenomenon that needs to be assessed within the context of the clinical setting. Considering that complexity, the available information on how to address alarm fatigue and improve alarm system safety is relatively scarce. This article summarizes the state of science in alarm system safety based on the eight dimensions of a sociotechnical model for studying health information technology in complex adaptive healthcare systems. The summary and recommendations were guided by available systematic reviews on the topic, interventional studies published between January 2019 and February 2022, and recommendations and evidence-based practice interventions published by professional organizations. The current article suggests implications to help researchers respond to the gap in science related to alarm safety, help vendors design safe monitoring systems, and help clinical leaders apply evidence-based strategies to improve alarm safety in their settings. Physiologic monitors in intensive care units—the devices most commonly used in complex care environments and associated with the highest number of alarms and deaths—are the focus of the current work. 
    more » « less
  2. ; ; ; (, 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW))
    Clinically, nurses must rapidly identify deteriorating patients and escalate patient care to adverse events. Novices, however, can easily succumb to cognitive overload. Augmented-reality (AR) devices, such as the Microsoft HoloLens 2, may help nurses attend to task-relevant information more effectively. The aim of this pilot study was to assess experienced nurses’ perceptions on the usability of AR. Practicing nurses were recruited for this study. Following a brief tutorial, demonstration and hands-on use of the HoloLens, nurses completed the system-usability scale (SUS) to rate usability. Additionally, interviews were conducted after the simulated use session. Experienced nurses (n=11) rated the usability of AR as 62.5±7.8. Themes that emerged from our open-ended interviews included the need for AR in nursing education and the potential benefit of a patient care checklist. Use of AR to support nurse decision making may reduce cognitive workload and focus attention on critical areas to recognize patient deterioration. 
    more » « less
  3. ; ; ; ; (, 2021 IEEE International Systems Conference (SysCon),)
    null (Ed.)
    The COVID-19 pandemic has placed an overwhelming strain on our Nation's ability to treat patients; the number of patients who need to be tested continues to rise. With nurses also becoming infected, the number of trained professionals who can perform tasks such as testing of patients along with providing care involving hooking up patients to ventilators continues to decrease as well. There is a need to explore the adoption of virtual computer based training mediums which will enable new nurses and others to be trained in safe and efficient procedures involving patients during this pandemic period. In this paper, the design of a VR based simulator based on Human Centered Computing (HCC) principles is discussed. The role of HCC factors such as affordance and cognitive load on the comprehension and scene understanding of nurses during training and the acquisition of knowledge of safety procedures and detailed steps (pertaining to nasal sample collection and use of ventilators on patients) has been studied with the involvement of nurse and nurse trainee participants. Adoption of a participatory design approach involving experts (nurses, doctors involved in covid-19 testing and treatment) has provided a foundational basis for design of the training environments and assessment activities. Formal information centric process models of the nasal swabbing procedures and ventilator hookup tasks were created using the engineering Enterprise Modeling Language (eEML). The preliminary results from the assessment activities indicate the positive impact of such HCC based 3Dsimulators in such training of first responders. 
    more » « less
  4. ; ; ; ; ; ; (, IEEE International Conference on Robot and Human Interactive Communication (RO-MAN))
    An ongoing nurse labor shortage has the potential to impact patient care well-being in the entire healthcare system. Moreover, more complex and sophisticated nursing care is required today for patients in hospitals forcing hospital-based nurses to carry out frequent training and assessment procedures, both to onboard new nurses and to validate skills of existing staff that guarantees best practices and safety. In this paper, we recognize an opportunity for the development and integration of intelligent robot tutoring technology into nursing education to tackle the growing challenges of nurse deficit. To this end, we identify specific research problems in the area of human-robot interaction that will need to be addressed to enable robot tutors for nurse training. 
    more » « less
  5. ; ; ; ; (, Advances in Neonatal Care)
    Background: Early-life pain is associated with adverse neurodevelopmental consequences; and current pain assessment practices are discontinuous, inconsistent, and highly dependent on nurses’ availability. Furthermore, facial expressions in commonly used pain assessment tools are not associated with brain-based evidence of pain. Purpose: To develop and validate a machine learning (ML) model to classify pain. Methods: In this retrospective validation study, using a human-centered design for Embedded Machine Learning Solutions approach and the Neonatal Facial Coding System (NFCS), 6 experienced neonatal intensive care unit (NICU) nurses labeled data from randomly assigned iCOPEvid (infant Classification Of Pain Expression video) sequences of 49 neonates undergoing heel lance. NFCS is the only observational pain assessment tool associated with brain-based evidence of pain. A standard 70% training and 30% testing split of the data was used to train and test several ML models. NICU nurses’ interrater reliability was evaluated, and NICU nurses’ area under the receiver operating characteristic curve (AUC) was compared with the ML models’ AUC. Results: Nurses weighted mean interrater reliability was 68% (63%-79%) for NFCS tasks, 77.7% (74%-83%) for pain intensity, and 48.6% (15%-59%) for frame and 78.4% (64%-100%) for video pain classification, with AUC of 0.68. The best performing ML model had 97.7% precision, 98% accuracy, 98.5% recall, and AUC of 0.98. Implications for Practice and Research: The pain classification ML model AUC far exceeded that of NICU nurses for identifying neonatal pain. These findings will inform the development of a continuous, unbiased, brain-based, nurse-in-the-loop Pain Recognition Automated Monitoring System (PRAMS) for neonates and infants. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email