skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Robotics, Automation, and Control
Construction robots have drawn increased attention as a potential means of improving construction safety and productivity. However, it is still challenging to ensure safe human-robot collaboration on dynamic and unstructured construction workspaces. On construction sites, multiple entities dynamically collaborate with each other and the situational context between them evolves continually. Construction robots must therefore be equipped to visually understand the scene’s contexts (i.e., semantic relations to surrounding entities), thereby safely collaborating with humans, as a human vision system does. Toward this end, this study builds a unique deep neural network architecture and develops a construction-specialized model by experimenting multiple fine-tuning scenarios. Also, this study evaluates its performance on real construction operations data in order to examine its potential toward real-world applications. The results showed the promising performance of the tuned model: the recall@5 on training and validation dataset reached 92% and 67%, respectively. The proposed method, which supports construction co-robots with the holistic scene understanding, is expected to contribute to promoting safer human-robot collaboration in construction.  more » « less
Award ID(s):
1734266
PAR ID:
10110139
Author(s) / Creator(s):
; ; ; ; ;
Date Published:
Journal Name:
Semantic Relation Detection Between Construction Entities to Support Safe Human-Robot Collaboration in Construction
Page Range / eLocation ID:
265 to 272
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Frontiers of Engineering Management)
    Robots present an innovative solution to the construction industry’s challenges, including safety concerns, skilled worker shortages, and productivity issues. Successfully collaborating with robots requires new competencies to ensure safety, smooth interaction, and accelerated adoption of robotic technologies. However, limited research exists on the specific competencies needed for human—robot collaboration in construction. Moreover, the perspectives of construction industry professionals on these competencies remain underexplored. This study examines the perceptions of construction industry professionals regarding the knowledge, skills, and abilities necessary for the effective implementation of human—robot collaboration in construction. A two-round Delphi survey was conducted with expert panel members from the construction industry to assess their views on the competencies for human—robot collaboration. The results reveal that the most critical competencies include knowledge areas such as human—robot interface, construction robot applications, human—robot collaboration safety and standards, task planning and robot control system; skills such as task planning, safety management, technical expertise, human—robot interface, and communication; and abilities such as safety awareness, continuous learning, problemsolving, critical thinking, and spatial awareness. This study contributes to knowledge by identifying the most significant competencies for human—robot collaboration in construction and highlighting their relative importance. These competencies could inform the design of educational and training programs and facilitate the integration of robotic technologies in construction. The findings also provide a foundation for future research to further explore and enhance these competencies, ultimately supporting safer, more efficient, and more productive construction practices. 
    more » « less
  2. ; ; ; ; ; ; ; ; (, International Educational Data Mining Society)
    Benjamin, Paaßen; Carrie, Demmans Epp (Ed.)
    One of the keys to the success of collaborative learning is balanced participation by all learners, but this does not always happen naturally. Pedagogical robots have the potential to facilitate balance. However, it remains unclear what participation balance robots should aim at; various metrics have been proposed, but it is still an open question whether we should balance human participation in human-human interactions (HHI) or human-robot interactions (HRI) and whether we should consider robots' participation in collaborative learning involving multiple humans and a robot. This paper examines collaborative learning between a pair of students and a teachable robot that acts as a peer tutee to answer the aforementioned question. Through an exploratory study, we hypothesize which balance metrics in the literature and which portions of dialogues (including vs. excluding robots' participation and human participation in HHI vs. HRI) will better predict learning as a group. We test the hypotheses with another study and replicate them with automatically obtained units of participation to simulate the information available to robots when they adaptively fix imbalances in real-time. Finally, we discuss recommendations on which metrics learning science researchers should choose when trying to understand how to facilitate collaboration. 
    more » « less
  3. ; (, Proceedings of the 2020 American Control Conference)
    null (Ed.)
    We analyze a human and multi-robot collaboration system and propose a method to optimally schedule the human attention when a human operator receives collaboration requests from multiple robots at the same time. We formulate the human attention scheduling problem as a binary optimization problem which aims to maximize the overall performance among all the robots, under the constraint that a human has limited attention capacity. We first present the optimal schedule for the human to determine when to collaborate with a robot if there is no contention occurring among robots' collaboration requests. For the moments when contentions occur, we present a contention-resolving Model Predictive Control (MPC) method to dynamically schedule the human attention and determine which robot the human should collaborate with first. The optimal schedule can then be determined using a sampling based approach. The effectiveness of the proposed method is validated through simulation that shows improvements. 
    more » « less
  4. ; ; ; (, Experimental Evaluation of Human Motion Prediction Toward Safe and Efficient Human Robot Collaboration)
    null (Ed.)
    Human motion prediction is non-trivial in modern industrial settings. Accurate prediction of human motion can not only improve efficiency in human-robot collaboration, but also enhance human safety in close proximity to robots. Although many prediction models have been proposed with various parameterization and identification approaches, some fundamental questions remain unclear: what is the necessary parameterization of a prediction model? Is online adaptation of models necessary? Can a prediction model help improve safety and efficiency during human-robot collaboration? These unaddressed questions result from the difficulty of quantitatively evaluating different prediction models in a closed-loop fashion in real human-robot interaction. This paper develops a method to evaluate the closed-loop performance of different prediction models. In particular, we compare models with different parameterizations and models with or without online parameter adaptation. Extensive experiments were conducted on a human-robot collaboration platform. The experimental results demonstrate that human motion prediction significantly enhance the collaboration efficiency and human safety. Adaptable prediction models that are parameterized by neural networks achieve better performance. 
    more » « less
  5. ; (, Journal of Computing in Civil Engineering)
    With the construction sector primed to incorporate such advanced technologies as artificial intelligence (AI), robots, and machines, these advanced tools will require a deep understanding of human–robot trust dynamics to support safety and productivity. Although other disciplines have broadly investigated human trust-building with robots, the discussion within the construction domain is still nascent, raising concerns because construction workers are increasingly expected to work alongside robots or cobots, and to communicate and interact with drones. Without a better understanding of how construction workers can appropriately develop and calibrate their trust in their robotic counterparts, the implementation of advanced technologies may raise safety and productivity issues within these already-hazardous jobsites. Consequently, this study conducted a systematic review of the human–robot trust literature to (1) understand human–robot trust-building in construction and other domains; and (2) establish a roadmap for investigating and fostering worker–robot trust in the construction industry. The proposed worker–robot trust-building roadmap includes three phases: static trust based on the factors related to workers, robots, and construction sites; dynamic trust understood via measuring, modeling, and interpreting real-time trust behaviors; and adaptive trust, wherein adaptive calibration strategies and adaptive training facilitate appropriate trust-building. This roadmap sheds light on a progressive procedure to uncover the appropriate trust-building between workers and robots in the construction industry. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email