skip to main content


Title: The Impact of Engineering Information Complexity on Working Memory Development of Construction Workers: An Eye-Tracking Investigation
Owing to the increasing complexity of construction tasks and operations performed in confined workplaces, workers rely progressively on working memory, i.e., the short-term and temporary storage of information pertaining to near future events, to ensure the seamless execution of construction tasks. Although literature has discovered a strong relationship between engineering information formats and the quality of working memory, there is still a clear theoretical disagreement on the implications of the complexity of engineering information in the development of working memory. This study addresses the knowledge gap with a human-subject experiment (n=60). Participants were required to review one of the two instructions for a pipe maintenance task: a simple 2D isometric drawing with bulletins (2D-simple) and a complex 2D isometric drawing with rich text (2D-complex). After the review session, the participants were asked to perform the pipe maintenance task in a Virtual Reality (VR) environment. Collected data include participants’ task performance (accuracy and time), pupillary dilations and gaze movements. The results show that the 2D-simple group outperformed the 2D-complex group in terms of both accuracy and time. An attention pattern analysis using Approximate Entropy (ApEn) of gaze movements suggests that a higher ApEn in the vertical axis, i.e. a more irregular and complex gaze movement between instructions, may result in a more efficient use of working memory and thus contributes to a better performance. This study provides preliminary evidence regarding the impact of engineering information complexity on the working memory development of construction workers.  more » « less
Award ID(s):
1937878
NSF-PAR ID:
10152106
Author(s) / Creator(s):
Date Published:
Journal Name:
Construction Research Congress 2020
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Owing to the increasing dynamics and complexity of construction tasks, workers often need to memorize a big amount of engineering information prior to the operations, such as spatial orientations and operational procedures. The working memory development, as a result, is critical to the performance and safety of many construction tasks. This study investigates how the format of engineering information affects human working memory based on a human-subject Virtual Reality (VR) experiment (n=90). A VR model was created to simulate a pipe maintenance task. First, participants were asked to review the task procedures in one of the following formats, including 2D isometric drawings, 3D model, and VR model. After the review session, participants were asked to perform the pipe maintenance task in the virtual environment based on their working memory. The operation accuracy and time were used as the key performance indicators of the working memory development. The experiment results indicate that the 3D and VR groups outperformed the 2D group in both operation accuracy and time, suggesting that a more immersive instruction leads to a better working memory. A further examination finds that the 2D group presented a significantly higher level of intrinsic cognitive load and extraneous cognitive load in the working memory development compared to the 3D and VR groups, indicating that different engineering information formats can cause different levels of cognitive load in working memory development, and ultimately affect the final performance. The findings are expected to inspire the design of intelligent information systems that adapt to the cognitive load of construction workers for improved working memory development. 
    more » « less
  2. In emergency events, first responders often have to build an accurate spatial working memory of unfamiliar spaces in a short time period. This study investigates the impact of information format on first responders’ short-term spatial memory of large-scale spaces via a human-subject experiment (n=63). A virtual model was created to simulate a real building on Texas A&M University campus. A total of 28 building components were modified in the virtual model. Participants were asked to review the virtual model with one of the three methods: 2D drawing, 3D model, and VR model. After the review session, the participants were sent to the real building to identify the discrepancies, and accuracy was documented as the performance measure. The results reveal that the 3D and VR groups both significantly outperformed the 2D group in spatial working memory. This study sets the foundation to further understand how instructional information affects the performance of first responders in emergency response. 
    more » « less
  3. An extensive framework has been developed for studying the behavior of motor vehicle drivers using eye tracking technology. Previous work has revealed strong relationships between driver eye movements and performance, which has resulted in widely accepted guidance within the transportation industry. In this work, the same eye tracking analysis methods were applied to investigate 20 professional pipefitters’ interactions with traditional isometric assembly drawings during a construction pipe model assembly task, in order to begin to understand the strategies that construction craft professionals use to gather visual information from engineering deliverables. A custom web application was developed to quantify and compare the pipefitters’ interactions with the assembly drawings through several visit metrics. Results indicated that the pipefitters’ interactions with the assembly drawings were associated with their performance and spatial cognition; however, the results did not suggest that the pipefitters were adhering to any particular visual information gathering strategies. The authors also investigated whether age or industry experience were associated with differences in visual information gathering strategies, but no significant relationships were observed. The primary contribution of this work is a demonstration of how existing eye tracking analysis methods can be applied to investigate how construction craft professionals extract visual information from engineering deliverables. 
    more » « less
  4. Bilinguals learn to resolve conflict between their two languages and that skill has been hypothesized to create long-term adaptive changes in cognitive functioning. Yet, little is known about how bilinguals recruit cognitive control to enable efficient use of one of their languages, especially in the less skilled and more effortful second language (L2). Here we examined how real-time cognitive control engagement influences L2 sentence comprehension (i.e., conflict adaptation). We tested a group of English monolinguals and a group of L2 English speakers using a recently-developed cross-task adaptation paradigm. Stroop sequences were pseudo-randomly interleaved with a visual-world paradigm in which participants were asked to carry out spoken instructions that were either syntactically ambiguous or unambiguous. Consistent with previous research, eye-movement results showed that Stroop-related conflict improved the ability to engage correct-goal interpretations, and disengage incorrect-goal interpretations, during ambiguous instructions. Such cognitive-to-language modulations were similar in both groups, but only in the engagement piece. In the disengagement portion, the modulation emerged earlier in bilinguals than in monolinguals, suggesting group differences in attentional disengagement following cognitive control recruitment. Additionally, incorrect-goal eye-movements were modulated by individual differences in working memory, although differently for each group, suggesting an involvement of both language-specific and domain-general resources. 
    more » « less
  5. Cognitive processes have been found to contribute substantially to the human errors that lead to construction accidents. Working memory—a cognitive system with a limited capacity that is responsible for temporarily holding information available for processing—plays an important role in reasoning and decision-making. Since eye movements indicate where a worker directs his/her attention, tracking such movements provides a practical way to measure workers’ attention and comprehension of construction hazards. As a departure in construction industry research, this study correlates attentional allocation with working memory to assess workers’ situation awareness under different scenarios that expose workers to various hazards. To achieve this goal, this study merges research linking eye movements and workers’ attention with research focused on working-memory load and decision making and evaluates what, how, and where a worker distributes his/her attention while performing a task under different working-memory loads. Path analysis models then examined the direct and indirect effect of different working-memory loads on hazard identification performance. The independent variable (working-memory load) is linked to the dependent variable (hazard identification) through the set of mediators (attention metrics). The results showed that the high-memory load condition delayed workers’ hazard identification. The findings of this study emphasize the important role working memory plays in determining how and why workers in dynamic work environments fail to detect, comprehend, and/or respond to physical risks. 
    more » « less