skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


This content will become publicly available on June 3, 2026

Title: Development of a Surrogate Model for the Assessment of Crew Workload in Emergency Medical Services
One commonly used workload metric in Emergency Medical Services (EMS) is the Unit Hour Utilization (UHU). The UHU is a productivity measure that, by definition, represents the ratio of patient transport calls to the total hours that ambulances are staffed. It is often misinterpreted as a utilization measure representing the percentage of crews’ available working hours that are spent performing work. This paper investigates a surrogate model to estimate a measure of EMS crew utilization that considers not only call response, but also indirect work tasks, such as documentation and shift start activities. We explored Kriging, KPLS, RBF, and physics-based models based on EMS work dynamics. The true measure of utilization was based on Montecarlo samples of estimated work time patterns associated with a year’s worth of dispatch data augmented with the results of a work measurement study. The best performing model in terms of the root mean square error (RSME), the symmetric mean absolute percent error (sMAPE), and Pearson correlation estimates, was the physics-based model. This model requires time studies to estimate the average time spent in shift start activities and documenting calls, geographic information systems to estimate the average time driving back to the post, and dispatch data analysis to estimate the average time to respond to calls. Sensitivity analysis was used to provide recommendations for when to update these parameters and general recommendations were given to implement this approach in other EMS systems.  more » « less
Award ID(s):
2138995
PAR ID:
10625845
Author(s) / Creator(s):
;
Editor(s):
Gentry, E; Ju, F; Liu, X
Publisher / Repository:
Proceedings of the IISE Anual Conference and Expo 2025
Date Published:
Subject(s) / Keyword(s):
Emergency Medical Services, Workload, Surrogate Modeling
Format(s):
Medium: X
Location:
Atlanta, GA
Sponsoring Org:
National Science Foundation
More Like this
  1. While crew configuration in primary care settings has been studied in terms of its impact on patient outcomes, less is known about how it influences the members' workload experience. This study investigates the workload implications of crew configuration based on members' certification in emergency medical services (EMS). Advanced life support (ALS) ambulance crews are commonly comprised of two paramedics (homogeneous crew) or an emergency medical technician (EMT) and a paramedic (heterogeneous crew). The goals of this study were the following: (1) to investigate differences in workload among members of the same crew, and (2) to use workload assessments to inform crew configuration strategies. We mapped one year of an EMS system's dispatch data to members' workload estimates using the visual, auditory, cognitive, and psychomotor (VACP) approach. We found that lead members (lead paramedics) experience higher workload levels compared to support members (support paramedics or EMTs) in both types of crews. Neither configuration had a consistently lower workload than the other, but differences varied for different shifts and stations. These results informed crew configuration recommendations for stations and shifts in the collaborating system, and in terms of more generalizable variables. A minimum number of staffed crews, half-half shift type (covering both day and night hours), and 30-day frequency of calls with priority P7 most significantly impacted the recommended crew configurations. 
    more » « less
  2. null (Ed.)
    Abstract The average lifetime or the mean time to failure (MTTF) of a product is an important metric to measure the product reliability. Current methods of evaluating the MTTF are mainly based on statistics or data. They need lifetime testing on a number of products to get the lifetime samples, which are then used to estimate the MTTF. The lifetime testing, however, is expensive in terms of both time and cost. The efficiency is also low because it cannot be effectively incorporated in the early design stage where many physics-based models are available. We propose to predict the MTTF in the design stage by means of a physics-based Gaussian process (GP) method. Since the physics-based models are usually computationally demanding, we face a problem with both big data (on the model input side) and small data (on the model output side). The proposed adaptive supervised training method with the Gaussian process regression can quickly predict the MTTF with a reduced number of physical model calls. The proposed method can enable continually improved design by changing design variables until reliability measures, including the MTTF, are satisfied. The effectiveness of the method is demonstrated by three examples. 
    more » « less
  3. null (Ed.)
    Background Increased work through electronic health record (EHR) messaging is frequently cited as a factor of physician burnout. However, studies to date have relied on anecdotal or self-reported measures, which limit the ability to match EHR use patterns with continuous stress patterns throughout the day. Objective The aim of this study is to collect EHR use and physiologic stress data through unobtrusive means that provide objective and continuous measures, cluster distinct patterns of EHR inbox work, identify physicians’ daily physiologic stress patterns, and evaluate the association between EHR inbox work patterns and physician physiologic stress. Methods Physicians were recruited from 5 medical centers. Participants (N=47) were given wrist-worn devices (Garmin Vivosmart 3) with heart rate sensors to wear for 7 days. The devices measured physiological stress throughout the day based on heart rate variability (HRV). Perceived stress was also measured with self-reports through experience sampling and a one-time survey. From the EHR system logs, the time attributed to different activities was quantified. By using a clustering algorithm, distinct inbox work patterns were identified and their associated stress measures were compared. The effects of EHR use on physician stress were examined using a generalized linear mixed effects model. Results Physicians spent an average of 1.08 hours doing EHR inbox work out of an average total EHR time of 3.5 hours. Patient messages accounted for most of the inbox work time (mean 37%, SD 11%). A total of 3 patterns of inbox work emerged: inbox work mostly outside work hours, inbox work mostly during work hours, and inbox work extending after hours that were mostly contiguous to work hours. Across these 3 groups, physiologic stress patterns showed 3 periods in which stress increased: in the first hour of work, early in the afternoon, and in the evening. Physicians in group 1 had the longest average stress duration during work hours (80 out of 243 min of valid HRV data; P=.02), as measured by physiological sensors. Inbox work duration, the rate of EHR window switching (moving from one screen to another), the proportion of inbox work done outside of work hours, inbox work batching, and the day of the week were each independently associated with daily stress duration (marginal R2=15%). Individual-level random effects were significant and explained most of the variation in stress (conditional R2=98%). Conclusions This study is among the first to demonstrate associations between electronic inbox work and physiological stress. We identified 3 potentially modifiable factors associated with stress: EHR window switching, inbox work duration, and inbox work outside work hours. Organizations seeking to reduce physician stress may consider system-based changes to reduce EHR window switching or inbox work duration or the incorporation of inbox management time into work hours. 
    more » « less
  4. The use of sit-stand desks (SSD) has shown positive results in reducing sitting time for office workers. Different factors can help with the use of the table, such as participatory ergonomics and an SSD reminder system. However, little is known about the influence of social factors at work, such as the influence of peers or supervisors using the device. The aim of this study was to investigate the use of SSDs and how the location and proximity of office workers affects SSD utilization over the course of two months. One-hundred eighty workers with SSDs participated in this study, and their desk locations and utilization were documented. It was observed that office workers spent on average (standard deviation) 7.1% (20.8%) of their time standing at their desks each day. Among these users, 12 participants were categorized as high SSD users, which spent more than two hours a day standing on average. It was found that during the study period, participants located next to high SSD utilizers did not change the SSD usage by increasing or decreasing their time spent standing. The results from the study suggest that the relative locations and proximity of workers do not significantly influence users to increase SSD use, and high users do not impact the SSD use of other users. These results showed that SSD use by peers or supervisors is not a strong social factor in improving the worker’s behavior of using the table and that other combined strategies are necessary. 
    more » « less
  5. Refractory complex concentrated alloys (RCCAs) have drawn increasing attention recently owing to their balanced mechanical properties, including excellent creep resistance, ductility, and oxidation resistance. The mechanical and thermal properties of RCCAs are directly linked with the elastic constants. However, it is time consuming and expensive to obtain the elastic constants of RCCAs with conventional trial-and-error experiments. The elastic constants of RCCAs are predicted using a combination of density functional theory simulation data and machine learning (ML) algorithms in this study. The elastic constants of several RCCAs are predicted using the random forest regressor, gradient boosting regressor (GBR), and XGBoost regression models. Based on performance metrics R-squared, mean average error and root mean square error, the GBR model was found to be most promising in predicting the elastic constant of RCCAs among the three ML models. Additionally, GBR model accuracy was verified using the other four RHEAs dataset which was never seen by the GBR model, and reasonable agreements between ML prediction and available results were found. The present findings show that the GBR model can be used to predict the elastic constant of new RHEAs more accurately without performing any expensive computational and experimental work. 
    more » « less