The integration of robots, particularly drones, into future construction sites introduces new safety challenges requiring enhanced situational awareness (SA) among workers. To address these challenges, this study explores the effectiveness of an AI-driven assistant designed to inform workers about dynamic environmental changes via auditory and visual channels. A mixed-reality bricklaying experiment was developed, simulating worker-drone interactions across three interaction levels: coexistence, cooperation, and collaboration. One hundred five construction-background students participated in tasks with and without the AI assistant, during which their eye-tracking data, productivity, and subjective perceptions were collected. Results indicated that the AI assistant significantly expedited workers’ awareness of approaching drones but concurrently reduced bricklaying productivity. Although participants reported high perceived usefulness and low distraction by the AI assistant itself, findings revealed a trade-off: improved SA toward drones came at the cost of decreased task performance, likely due to increased attentional shifts toward drones. Furthermore, the effectiveness of the assistant varied depending on the interaction level with drones. This study highlights both the opportunities and challenges of applying AI-driven informational systems in future construction environments, offering critical insights for designing human-centered AI technologies that balance safety enhancement with productivity maintenance.
more »
« less
Towards Intelligent Agents to Assist in Modular Construction: Evaluation of Datasets Generated in Virtual Environments for AI training
Modular construction aims at overcoming challenges faced by the traditional construction process such as the shortage of skilled workers, fast-track project requirements, and cost associated with on-site productivity losses and recurrent rework. Since manufacturing is done off-site in controlled factory settings, modular construction is associated with increased productivity and better quality control. However, because every construction project is unique and results in distinct work pieces and building elements to be assembled, modular construction factories necessitate better mechanisms to assist workers during the assembly process in order to minimize errors in selecting the pieces to be assembled and idle times while figuring out the next step in an assembly sequence. Machine intelligence provides opportunities for such assistance; however, a challenge is to rapidly generate large datasets with rich contextual data to train such intelligent agents. This work overviews a mechanism to generate such datasets in virtual environments and evaluates the performance of AI models trained using data generated in virtual environments in recognizing the next installation step in modular assembly sequences. Performance of the trained MV-CNN models (with accuracy of 0.97) shows that virtual environments can potentially be used to generate the required datasets for AI without the costly, time-consuming, and labor-intensive investments needed upfront for capturing real-world data.
more »
« less
- Award ID(s):
- 2036870
- PAR ID:
- 10388386
- Date Published:
- Journal Name:
- Proceedings of the ISARC
- ISSN:
- 2413-5844
- Page Range / eLocation ID:
- 327-333
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
With the construction sector primed to incorporate such advanced technologies as artificial intelligence (AI), robots, and machines, these advanced tools will require a deep understanding of human–robot trust dynamics to support safety and productivity. Although other disciplines have broadly investigated human trust-building with robots, the discussion within the construction domain is still nascent, raising concerns because construction workers are increasingly expected to work alongside robots or cobots, and to communicate and interact with drones. Without a better understanding of how construction workers can appropriately develop and calibrate their trust in their robotic counterparts, the implementation of advanced technologies may raise safety and productivity issues within these already-hazardous jobsites. Consequently, this study conducted a systematic review of the human–robot trust literature to (1) understand human–robot trust-building in construction and other domains; and (2) establish a roadmap for investigating and fostering worker–robot trust in the construction industry. The proposed worker–robot trust-building roadmap includes three phases: static trust based on the factors related to workers, robots, and construction sites; dynamic trust understood via measuring, modeling, and interpreting real-time trust behaviors; and adaptive trust, wherein adaptive calibration strategies and adaptive training facilitate appropriate trust-building. This roadmap sheds light on a progressive procedure to uncover the appropriate trust-building between workers and robots in the construction industry.more » « less
-
Yan, C; Chai, H; Sun, T; Yuan, PF (Ed.)Abstract. The building industry is facing environmental, technological, and economic challenges, placing significant pressure on preparing the workforce for Industry 4.0 needs. The fields of Architecture, Engineering, and Construction (AEC) are being reshaped by robotics technologies which demand new skills and creating disruptive change to job markets. Addressing the learning needs of AEC students, professionals, and industry workers is critical to ensuring the competitiveness of the future workforce. In recent years advancements in Information Technology, Augmented Reality (AR), Virtual Reality (VR), and Artificial Intelligence (AI) have led to new research and theories on virtual learning environments. In the AEC fields researchers are beginning to rethink current robotics training to counteract costly and resource-intensive in-person learning. However, much of this work has been focused on simulation physics and has yet to adequately address how to engage AEC learners with different learning abilities, styles, and diverse backgrounds.This paper presents the advantages and difficulties associated with using new technologies to develop virtual reality (VR) learning games for robotics. It describes an ongoing project for creating performance driven curriculum. Drawing on the Constructivist Learning Theory, the affordances of Adaptive Learning Systems, and data collection methods from the VR game environment, the project provides a customized and performance-oriented approach to carrying out practical robotics tasks in real-world scenarios.more » « less
-
Modern advances in AI have increased employer interest in tracking workers’ biometric signals — e.g., their brainwaves and facial expressions — to evaluate and make predictions about their performance and productivity. These technologies afford managers information about internal emotional and physiological states that were previously accessible only to individual workers, raising new concerns around worker privacy and autonomy. Yet, the research literature on the impact of AI-powered biometric work monitoring (AI-BWM) technologies on workers remains fragmented across disciplines and industry sectors, limiting our understanding of its impacts on workers at large. In this paper, we sytematically review 129 papers, spanning varied disciplines and industry sectors, that discuss and analyze the impact of AI-powered biometric monitoring technologies in occupational settings. We situate this literature across a process model that spans the development, deployment, and usage phases of these technologies. We further draw on Shelby et al.’s Taxonomy of Socio-technical Harms in AI systems to systematize the harms experienced by workers across the three phases of our process model. We find that the development, deployment, and sustained use of AI-powered biometric work monitoring technologies put workers at risk of a number of the socio-technical harms specified by Shelby et al.: e.g., by forcing workers to exert additional emotional labor to avoid flagging unreliable affect monitoring systems, or through the use of these data to make inferences about productivity. Our research contributes to the field of critical AI studies by highlighting the potential for a cascade of harms to occur when the impact of these technologies on workers is not considered at all phases of our process model.more » « less
-
Abstract Modular cloning systems streamline laboratory workflows by consolidating genetic ‘parts’ into reusable and modular collections, enabling researchers to fast-track strain construction. The GoldenBraid 2.0 modular cloning system utilizes the cutting property of type IIS restriction enzymes to create defined genetic ‘grammars’, which facilitate the reuse of standardized genetic parts and assembly of genetic parts in the right order. Here, we present a GoldenBraid 2.0 toolkit of genetic parts designed to accelerate cloning in the model bacterium Escherichia coli. This toolkit features 478 pre-made parts for gene expression and protein tagging as well as strains to expedite cloning and strain construction, enabling researchers to quickly generate functional plasmid-borne or chromosome-integrated expression constructs. In addition, we provide a complete laboratory manual with overviews of common reagent recipes, E. coli protocols, and community resources to promote toolkit utilization. By streamlining the assembly process, this resource will reduce the financial and temporal burdens of cloning and strain building in many laboratory settings.more » « less
An official website of the United States government

