skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Computer Vision-Based Geometry Mapping and Matching of Building Elements for Construction Robotic Applications
Robotic automation of construction tasks is a growing area of research. For robots to successfully operate in a construction environment, sensing technology must be developed which allows for accurate detection of site geometry in a wide range of conditions. Much of the existing body of research on computer vision systems for construction automation focuses on pick-and-place operations such as stacking blocks or placing masonry elements. Very little research has focused on framing and related tasks. The research presented here aims to address this gap by designing and implementing computer vision algorithms for detection and measurement of building framing elements and testing those algorithms using realistic framing structures. These algorithms allow for a stationary RGB-D camera to accurately detect, identify, and measure the geometry of framing elements in a construction environment and match the detected geometry to provided building information modeling (BIM) data. The algorithms reduce identified framing elements to a simplified 3D geometric model, which allows for robust and accurate measurement and comparison with BIM data. This data can then be used to direct operations of construction robotic systems or other machines/equipment. The proposed algorithms were tested in a laboratory setting using an Intel RealSense D455 RGB-D camera, and initial results indicate that the system is capable of measuring the geometry of timber-frame structures with accuracy on the order of a few centimeters.  more » « less
Award ID(s):
1827733
PAR ID:
10324509
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Construction Research Congress 2022
Page Range / eLocation ID:
541 to 549
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; (, Proceedings Canadian Society for Civil Engineering)
    The adoption of robotics into the construction industry has been progressing slower than in the manufacturing and industrial sectors. Current shortfalls in skilled labor, productivity trends, and ongoing safety challenges point to the need for a drastic shift toward adopting robotics. Addressing these shortfalls would be a necessary component of the shift toward industrializing the construction industry. Despite this lag in technology adoption, the interest and development of robotic technology targeting the construction industry has grown in recent years and is ranging from the use of drones for tracking to advances in offsite fabrication. However, the integration into fundamental site construction necessitates reconsidering the information technology infrastructure needed to support detailed task execution information needs in the change from craft labor to robotic operations. This research presents the identification and mapping of the Information Technology (IT) system architecture required to support building information modeling (BIM) to robotic construction. Combining elements of BIM architecture and information exchanges with the needed construction task decomposition is required. These elements are mapped to the robotic system elements vital for mobile robotic operations. In addition to defining the functions and integration required to support the BIM to robotic Construction Workflow, shortcomings in existing infrastructure, notably regarding the ability to decompose construction fabrication and assembly means and methods, are defined. 
    more » « less
  2. ; ; (, Proceedings Canadian Society for Civil Engineering)
    The adoption of robotics into the construction industry has been much slower than in manufacturing and industrial sectors. Current shortfalls in skilled labor, productivity trends, and ongoing safety challenges point to the need for a drastic shift toward the adoption of robotics as a component of a shift toward industrialized construction. Despite this lag, the interest and development of robotic technology targeting construction has grown in recent years, ranging from the use of drones for tracking to use in offsite fabrication. However, the integration into fundamental site construction requires reconsideration of the information technology infrastructure needed to support detailed task execution information needs in the transition from craft labor to robotic operations. This research presents the identification and mapping of the IT System Architecture required to support BIM to Robotic Construction. Combining elements of the Building Information Modeling architecture and information exchanges with the needed construction task decomposition is required. These elements are mapped to the robotic system elements required for mobile robotic operations. In addition to defining the functions and integration required to support the BIM to Robotic Construction Workflow, shortcomings in existing infrastructure, notably regarding the ability to decompose construction fabrication and assembly means and methods are defined. 
    more » « less
  3. ; ; ; (, ASCE Construction Research Congress)
    In the past, the construction industry has been slow to adopt new technology. There has been a rapid expansion of technologies, often referred to as Industry 4.0, to aid in the use of automation. One challenge paralleling these new technologies is implementing how a robot interprets design information, specifically information from a Building Information Model (BIM). This paper presents a method for identifying and transforming information from BIM to support robotic material placement on the construction site. This research will include a review of what information can be directly extracted from the model and what must be supplemented to the model for the robot to perform defined tasks within a construction site. The construction sites’ dynamic nature poses multiple challenges that must be addressed for the information extracted from a model to be used by a robot in daily construction operations. This research also identifies barriers and limitations based upon current practice, such as different levels of development or model content as well as needed precision within the information provided for a mobile robot to complete a defined task. 
    more » « less
  4. ; ; (, American Society of Civil Engineers)
    Building information modeling (BIM) technology in construction has become increasingly prevalent in recent years, and integrating robotics is seen as a natural step to improve efficiency. To increase the level of development (LOD) of a BIM model to support a construction robot, parametric modeling can be used to create highly detailed models by supplementing and defining the geometric and physical properties of the construction elements, such as the components’ size, shape, and material parameters, which are used as inputs for designing robotic tasks. Component information and data are stored as extractable parameters within the BIM model, allowing a robot to perform highly precise and repeatable tasks. This study develops a framework for implementing computational parametric modeling for masonry wall systems with Dynamo. This study tested six wall configurations constructed of 8″ × 8″ × 16″ concrete masonry units (CMUs). Dynamo successfully interpreted most wall geometries placing full-sized CMUs into the correct design locations. Errors occurred when placing partial-sized CMUs, typically at wall intersections, revealing a need for future refinement. The study shows the careful planning and considerations needed to implement computational modeling to generate model content for creating robotic tasks. 
    more » « less
  5. ; ; ; (, Engineering, Construction and Architectural Management)
    null (Ed.)
    Purpose The purpose is two-fold: (1) to explore the interactions of robotic systems and lean construction in the context of offsite construction (OC) that were addressed in the literature published between 2008 and 2019 and (2) to identify the gaps in such interactions while discussing how addressing those gaps can benefit not only OC but the architecture, engineering and construction (AEC) industry as a whole. Design/methodology/approach First, a systematic literature review (SLR) identified journal papers addressing the interactions of automation and lean in OC. Then, the researchers focused the analysis on the under-researched subtopic of robotic systems. The focused analysis includes discussing the interactions identified in the SLR through a matrix of interactions and utilizing literature beyond the previously identified articles for future research directions on robotic systems and lean construction in OC. Findings The study found 35 journal papers that addressed automation and lean in the context of OC. Most of the identified literature focused on interactions of BIM and lean construction, while only nine focused on the interactions of robotic systems and lean construction. Identified literature related to robotic systems mainly addressed robots and automated equipment. Additional interactions were identified in the realm of wearable devices, unmanned aerial vehicles/automated guided vehicles and digital fabrication/computer numerical control (CNC) machines. Originality/value This is one of the first studies dedicated to exploring the interactions of robotic systems and lean construction in OC. Also, it proposes a categorization for construction automation and a matrix of interactions between construction automation and lean construction. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email