skip to main content


Title: Toward Personalized Safety Training: Automating the Classification of Construction Workers’ Cognitive Failures
Safety training has long been considered a promising method to enhance workers’ hazard identification skills within construction sites. To improve the effectiveness of safety training, such varied features as a training environment, individuals’ learning ability, and lesson personalization have been investigated. However, as records show workers still miss hazards even after receiving safety training, understanding the fundamental cognitive reasons for unrecognized hazards becomes a crucial step toward developing effective personalized safety training. This study used various 360° panoramas of construction scenarios to empirically examine 30 workers’ visual search strategies and assess workers’ hazard identification skills. Results suggest several cognitive limitations caused failures in hazard recognition, including attentional failure, inattentional blindness, and low perceived risk. Based on these findings, this study proposes a personalized safety training framework to address such cognitive limitations to improve occupational safety in the construction industry  more » « less
Award ID(s):
2049711
NSF-PAR ID:
10392306
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
ISARC. Proceedings of the International Symposium on Automation and Robotics in Construction; Waterloo
Volume:
39
Page Range / eLocation ID:
268-275
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. One of the main contributors to the human errors that lead to catastrophic injuries in the construction workplace is the failure to identify hazards as a result of poor attention or cognitive lapses. To address this safety concern, the present study used eye-tracking technology to assess how the association between work experience and hazard identification may be mediated due to inattention. A mediation analysis was conducted and tested using a bias-corrected bootstrapping technique with 5000 resamples. The results estimate the direct and indirect effects of work experience on the hazard identification skills of construction workers observing varying hazardous conditions. The results of the mediation analysis confirm that inattention—demonstrated via inattentiveness toward hazards—mediates the relationship between work experience and hazard identification. Specifically, though work experience and dwell time positively correlate with hazard identification, the direct effect of work experience on hazard identification is attenuated with the inclusion of the mediator variables in the model, thus suggesting attentional impairment offsets the benefits of work experience. The outcomes of this study will enable researchers and safety practitioners to harness real-time eye-movement patterns to identify the precursors of cognitive failure, deficient attentional allocation, and poor visual search strategies, all of which may put workers at risk on construction sites. The results also facilitate the provision of personalized safety feedback to workers and the design of training interventions that will address unique performance deficiencies in workers to prevent the human errors that cause injuries in dynamic environments. 
    more » « less
  2. Given the dynamic and complex nature of the construction industry, maintaining situation awareness at job sites is critical. To react properly, workers must identify dynamic safety hazards within the scene. The majority of studies assessing construction workers’ situation awareness have utilized static images, virtual reality, and other types of simulation methods, but questions remain as to whether these formats are able to capture and monitor workers’ naturalistic behaviors and hazard identification abilities. To identify whether the format of hazardous stimuli (i.e., static, image-based vs. dynamic, and video-based formats) impact workers’ subjective and objective hazard identification and situation awareness metrics, this study developed 23 safety hazard scenarios utilizing state-of-the-art augmented 360° panoramas and then tracked differences in workers’ visual search patterns and hazard identification abilities using eye-tracking technology. The workers’ cognitive responses, evidenced by their eye movements, showed that workers had significantly varied cognitive processes and abilities depending on the format of stimuli: Workers with lower hazard identification skills were more likely to miss hazards in a dynamic environment. This result suggests that the experimental setting should be carefully designed to determine construction workers’ natural cognitive process. 
    more » « less
  3. Cognitive processes have been found to contribute substantially to the human errors that lead to construction accidents. Working memory—a cognitive system with a limited capacity that is responsible for temporarily holding information available for processing—plays an important role in reasoning and decision-making. Since eye movements indicate where a worker directs his/her attention, tracking such movements provides a practical way to measure workers’ attention and comprehension of construction hazards. As a departure in construction industry research, this study correlates attentional allocation with working memory to assess workers’ situation awareness under different scenarios that expose workers to various hazards. To achieve this goal, this study merges research linking eye movements and workers’ attention with research focused on working-memory load and decision making and evaluates what, how, and where a worker distributes his/her attention while performing a task under different working-memory loads. Path analysis models then examined the direct and indirect effect of different working-memory loads on hazard identification performance. The independent variable (working-memory load) is linked to the dependent variable (hazard identification) through the set of mediators (attention metrics). The results showed that the high-memory load condition delayed workers’ hazard identification. The findings of this study emphasize the important role working memory plays in determining how and why workers in dynamic work environments fail to detect, comprehend, and/or respond to physical risks. 
    more » « less
  4. Electrocution is one of the major causes of fatalities in the construction industry. Despite periodic safety training aimed at retaining workers’ vigilance (i.e., sustained attention) to electrical hazards, workers tend to fail to maintain vigilance toward frequent encounters with electrical hazards. Providing an effective intervention that restores workers’ vigilance is thus critical to reducing electrocution accidents. To this end, this study proposes a Virtual Reality (VR) safety training environment that exposes workers to repeated electrical hazards and simulates an electrocution accident when workers come in contact with the hazards. A pilot experiment was conducted, and participants’ vigilance (i.e., eye fixations on the hazard) was measured using eye-tracking sensors. The results reveal the potential effect of experiencing VR-simulated electrocution on enhancing workers’ vigilance to electrical hazards. The outcomes of this study will lay the foundation for further studies to employ VR as a safety training environment that allows workers to experience a simulated electrocution, thereby contributing to a potential reduction in fatal electrocutions. 
    more » « less
  5. Recent research suggests construction workers fall prey to the cognitive biases of risk compensation, wherein workers offset safety improvements by taking more risks. Parallel previous literature indicates that time pressure and mental load may increase workers’ arousal and stress. However, it is unclear whether time, productivity, and/or cognitive demands can worsen risk compensation behaviors by stimulating workers to make riskier decisions to complete tasks faster. Combining a multi-modal mixed-reality environment with wearable neuro-psychophysiological sensors, this study examines changes in safety and task performance for high-risk electrical-line tasks simulated under time/performance pressure and cognitive demand. The results show risk-compensation is in play as subjects over-rely on safety technologies and maintain their risk perception even while undertaking more risks to adapt to increased time pressure and/or cognitive demand. This paper contributes to body of knowledge by affecting safety-training approaches and the controls needed when providing workers with safety protection and new technological advances. 
    more » « less