skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Object Detectors for Construction Resources Using Unmanned Aerial Vehicles
Project control operations in construction are mostly executed via direct observations and the manual monitoring of progress and performance of construction tasks on the job site. Project engineers move physically within job-site areas to ensure activities are executed as planned. Such physical displacements are error-prone and ineffective in cost and time, particularly in larger construction zones. It is critical to explore new methods and technologies to effectively assist performance control operations by rapidly capturing data from materials and equipment on the job site. Motivated by the ubiquitous use of unmanned aerial vehicles (UAVs) in construction projects and the maturity of computer-vision-based machine-learning (ML) techniques, this research investigates the challenges of object detection—the process of predicting classes of objects (specified construction materials and equipment)—in real time. The study addresses the challenges of data collection and predictions for remote monitoring in project control activities. It uses these two proven and robust technologies by exploring factors that impact the use of UAV aerial images to design and implement object detectors through an analytical conceptualization and a showcase demonstration. The approach sheds light on the applications of deep-learning techniques to access and rapidly identify and classify resources in real-time. It paves the way to shift from costly and time-consuming job-site walkthroughs that are coupled with manual data processing and input to more automated, streamlined operations. The research found that the critical factor to develop object detectors with acceptable levels of accuracy is collecting aerial images with for adequate scales with high frequencies from different positions of the same construction areas.  more » « less
Award ID(s):
1550833
PAR ID:
10584104
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society of Civil Engineers.
Date Published:
Journal Name:
Practice Periodical on Structural Design and Construction
Volume:
26
Issue:
4
ISSN:
1084-0680
Subject(s) / Keyword(s):
Unmanned aerial vehicles (UAVs) Project controls Monitoring Deep learning Single-shot detector (SSD)
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Robert Amor (Ed.)
    Integrating complex spatio-temporal cognitive tasks such as in-situ planning and trade coordination of job site activities is a continuous challenge to learners in Construction Engineering (CE) courses. Spatial information in this context addresses how physical resources are related to one another at a job site, whereas temporal information defines work sequences and hierarchies that transform physical resources. This paper discusses the impacts of using an innovative learning environment for supporting spatio-temporal cognition in CE education using aerial visualizations from Unmanned Aerial Vehicles (UAVs). Learners experience a unique, ‘birds-eye view’ of the spatio-temporal dynamics of a job site. The effects were on improved abilities to apply, analyze, and synthesize any form of design representation to situations and physical contexts. Our findings demonstrate that participants in the intervention group outperformed the control group on measures of learning and motivation, which underscores the potential of UAVs as an educational technology system in CE education. 
    more » « less
  2. Amor, Robert (Ed.)
    Integrating complex spatio-temporal cognitive tasks such as in-situ planning and trade coordination of job site activities is a continuous challenge to learners in Construction Engineering (CE) courses. Spatial information in this context addresses how physical resources are related to one another at a job site, whereas temporal information defines work sequences and hierarchies that transform physical resources. This paper discusses the impacts of using an innovative learning environment for supporting spatio-temporal cognition in CE education using aerial visualizations from Unmanned Aerial Vehicles (UAVs). Learners experience a unique, ‘birds-eye view’ of the spatio-temporal dynamics of a job site. The effects were on improved abilities to apply, analyze, and synthesize any form of design representation to situations and physical contexts. Our findings demonstrate that participants in the intervention group outperformed the control group on measures of learning and motivation, which underscores the potential of UAVs as an educational technology system in CE education. 
    more » « less
  3. Construction project management requires frequent inspections to ensure the quality and progress of the construction work. Multiple stakeholders are involved in the inspection process during the project lifecycle. Some project stakeholders, such as architects, owners, structural engineers are involved with multiple construction projects at a time and are responsible to conduct timely inspection and monitoring tasks. This paper studies the potential of Virtual Reality (VR) and robotics for real-time remote inspection. The benefits and challenges of using VR for construction inspection and monitoring were identified and ranked through a systematic literature review. The top 5 benefits were found to be enhanced collaboration, realistic and immersive visualization, remote presence, reduction in inspection time, and support for decision-making. The top 5 challenges identified in this study include low- resolution displays, limited integration with existing technologies (such as BIM), causing disorientation and dizziness for the user, cost of adoption, and job site internet access limitations. Finally, a new approach was investigated for using VR to enable an immersive experience in remote inspection with an inspector assistant robot for real-time remote construction inspection. The experimental investigation verified the identified benefits and challenges. 
    more » « less
  4. Environmental monitoring of marine environments presents several challenges: the harshness of the environment, the often remote location, and most importantly, the vast area it covers. Manual operations are time consuming, often dangerous, and labor intensive. Operations from oceanographic vessels are costly and limited to open seas and generally deeper bodies of water. In addition, with lake, river, and ocean shoreline being a finite resource, waterfront property presents an ever increasing valued commodity, requiring exploration and continued monitoring of remote waterways. In order to efficiently explore and monitor currently known marine environments as well as reach and explore remote areas of interest, we present a design of an autonomous surface vehicle (ASV) with the power to cover large areas, the payload capacity to carry sufficient power and sensor equipment, and enough fuel to remain on task for extended periods. An analysis of the design and a discussion on lessons learned during deployments is presented in this paper. 
    more » « less
  5. Aerial drones are becoming an integral part of application domains including but not limited to, military operations, package delivery, construction, monitoring and search/rescue operations. It is critical to ensure the cyber security of networked aerial drone systems in these applications. Standard cryptographic services can be deployed to provide basic security services; however, they have been shown to be inefficient in terms of energy and time consumption, especially for small aerial drones with resource-limited processors. Therefore, there is a significant need for an efficient cryptographic framework that can meet the requirements of small aerial drones. We propose an improved cryptographic framework for small aerial drones, which offers significant energy efficiency and speed advantages over standard cryptographic techniques. (i) We create (to the best of our knowledge) the first optimized public key infrastructure (PKI) based framework for small aerial drones, which provides energy efficient techniques by harnessing special precomputation methods and optimized elliptic curves. (ii) We also integrate recent light-weight symmetric primitives into our PKI techniques to provide a full-fledged cryptographic framework. (iii) We implemented standard counterparts and our proposed techniques on an actual small aerial drone (Crazyflie 2.0), and provided an in-depth energy analysis. Our experiments showed that our improved cryptographic framework achieves up to 35× lower energy consumption than its standard counterpart. 
    more » « less