This content will become publicly available on December 11, 2026

Title: Statistical Modeling of Psychophysiological and Personality Factors to Predict Construction Workers’ Near-Miss Recognition Performance
Due to the industry’s high-risk nature, construction workers often encounter hazardous conditions. Past studies have shown that recognizing near-miss incidents is crucial for minimizing injuries, yet predicting workers’ near-miss recognition performance remains a research gap. Therefore, this study aims to develop models using psychological factors (Big 5 personality traits), physiological measures (heart rate and electrodermal activity), and eye-tracking metrics (time to first fixation and fixation duration) to predict near-miss recognition. A total of 35 participants with eye-tracking glasses, a heart rate sensor, and an E4 wristband underwent an experiment to identify near-miss incidents from stimulus images. Some statistical models were trained on their recognition performance. The results show that random forest (70%), KNN (69%), and decision tree (65%) showcased high test accuracy, while logistic regression (59%) had the lowest performance. These findings inform the development of pre-employment safety assessments and guide workforce management in effectively distributing individuals with efficient near-miss recognition attributes.  more » « less
Award ID(s):
2222881
PAR ID:
10716605
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society of Civil Engineers
Date Published:
ISBN:
9780784486139
Page Range / eLocation ID:
1051 to 1060
Subject(s) / Keyword(s):
Location:
Pittsburgh, Pennsylvania
Sponsoring Org:
National Science Foundation
More Like this
  1. Despite the introduction of preventive safety measures, such as near-miss reporting, to mitigate accidents and minimize fatalities, construction workers are constantly exposed to stressful situations that negatively affect their safety behavior and reporting efficiency. Occupational stress is induced by various factors, with mental stress and auditory stress being common workplace stressors that impact workers on the job site. While previous studies have demonstrated the effect of stressor conditions on workers’ hazard recognition and safety performance, research gaps persist regarding the direct impact of workplace stressors on workers’ stress levels and near-miss recognition performance. This study investigates workers’ near-miss recognition ability through an eye-tracking experiment conducted in a controlled environment under mental and auditory stress conditions. The findings from this study reveal that workplace stressors triggered by mental and auditory stress can adversely affect worker stress levels, safety behavior, and cognitive processing toward near-miss recognition. Visual attention towards near-miss scenarios was reduced by 26% for mental stress conditions and by 46% for auditory stress conditions compared to baseline. The results may potentially open avenues for developing wearable stress prediction and safety intervention models using bio-sensing technology and personalized safety training programs tailored to individuals with low identification abilities. 
    more » « less
  2. Given the dynamic and complex nature of the construction industry, maintaining situation awareness at job sites is critical. To react properly, workers must identify dynamic safety hazards within the scene. The majority of studies assessing construction workers’ situation awareness have utilized static images, virtual reality, and other types of simulation methods, but questions remain as to whether these formats are able to capture and monitor workers’ naturalistic behaviors and hazard identification abilities. To identify whether the format of hazardous stimuli (i.e., static, image-based vs. dynamic, and video-based formats) impact workers’ subjective and objective hazard identification and situation awareness metrics, this study developed 23 safety hazard scenarios utilizing state-of-the-art augmented 360° panoramas and then tracked differences in workers’ visual search patterns and hazard identification abilities using eye-tracking technology. The workers’ cognitive responses, evidenced by their eye movements, showed that workers had significantly varied cognitive processes and abilities depending on the format of stimuli: Workers with lower hazard identification skills were more likely to miss hazards in a dynamic environment. This result suggests that the experimental setting should be carefully designed to determine construction workers’ natural cognitive process. 
    more » « less
  3. Pilot fatigue is a critical reason for aviation accidents related to human errors. Human-related accidents might be reduced if the pilots’ eye movement measures can be leveraged to predict fatigue. Eye tracking can be a non-intrusive viable approach that does not require the pilots to pause their current task, and the device does not need to be in direct contact with the pilots. In this study, the positive or negative correlations among the psychomotor vigilance test (PVT) measures (i.e., reaction times, number of false alarms, and number of lapses) and eye movement measures (i.e., pupil size, eye fixation number, eye fixation duration, visual entropy) were investigated. Then, fatigue predictive models were developed to predict fatigue using eye movement measures identified through forward and backward stepwise regressions. The proposed approach was implemented in a simulated short-haul multiphase flight mission involving novice and expert pilots. The results showed that the correlations among the measures were different based on expertise (i.e., novices vs. experts); thus, two predictive models were developed accordingly. In addition, the results from the regressions showed that either a single or a subset of the eye movement measures might be sufficient to predict fatigue. The results show the promise of using non-intrusive eye movements as an indicator for fatigue prediction and provides a foundation that can lead us closer to developing a near real-time warning system to prevent critical accidents. 
    more » « less
  4. which can assure the security of the country boarder and aid in search and rescue missions. This paper offers a novel “handsfree” tool for aerial border surveillance, search and rescue missions using head-mounted eye tracking technology. The contributions of this work are: i) a gaze based aerial boarder surveillance object classification and recognition framework; ii) real-time object detection and identification system in nonscanned regions; iii) investigating the scan-path (fixation and non-scanned) provided by mobile eye tracker can help improve training professional search and rescue organizations or even artificial intelligence robots for searching and rescuing missions. The proposed system architecture is further demonstrated using a dataset of large-scale real-life head-mounted eye tracking data. Keywords—Head-mounted eye tracking technology, Aerial border surveillance, and search and rescue missions 
    more » « less
  5. Cognitive processes have been found to contribute substantially to the human errors that lead to construction accidents. Working memory—a cognitive system with a limited capacity that is responsible for temporarily holding information available for processing—plays an important role in reasoning and decision-making. Since eye movements indicate where a worker directs his/her attention, tracking such movements provides a practical way to measure workers’ attention and comprehension of construction hazards. As a departure in construction industry research, this study correlates attentional allocation with working memory to assess workers’ situation awareness under different scenarios that expose workers to various hazards. To achieve this goal, this study merges research linking eye movements and workers’ attention with research focused on working-memory load and decision making and evaluates what, how, and where a worker distributes his/her attention while performing a task under different working-memory loads. Path analysis models then examined the direct and indirect effect of different working-memory loads on hazard identification performance. The independent variable (working-memory load) is linked to the dependent variable (hazard identification) through the set of mediators (attention metrics). The results showed that the high-memory load condition delayed workers’ hazard identification. The findings of this study emphasize the important role working memory plays in determining how and why workers in dynamic work environments fail to detect, comprehend, and/or respond to physical risks. 
    more » « less