An official website of the United States government
Decaying infrastructure maintenance cost allocation depends heavily on accurate and safe inspection in the field. New tools to conduct inspections can assist in prioritizing investments in maintenance and repairs. The industrial revolution termed as “Industry 4.0” is based on the intelligence of machines working with humans in a collaborative workspace. Contrarily, infrastructure management has relied on the human for making day-to-day decisions. New emerging technologies can assist during infrastructure inspections, to quantify structural condition with more objective data. However, today’s owners agree in trusting the inspector’s decision in the field over data collected with sensors. If data collected in the field is accessible during the inspections, the inspector decisions can be improved with sensors. New research opportunities in the human–infrastructure interface would allow researchers to improve the human awareness of their surrounding environment during inspections. This article studies the role of Augmented Reality (AR) technology as a tool to increase human awareness of infrastructure in their inspection work. The domains of interest of this research include both infrastructure inspections (emphasis on the collection of data of structures to inform management decisions) and emergency management (focus on the data collection of the environment to inform human actions). This article describes the use of a head-mounted device to access real-time data and information during their field inspection. The authors leverage the use of low-cost smart sensors and QR code scanners integrated with Augmented Reality applications for augmented human interface with the physical environment. This article presents a novel interface architecture for developing Augmented Reality–enabled inspection to assist the inspector’s workflow in conducting infrastructure inspection works with two new applications and summarizes the results from various experiments. The main contributions of this work to computer-aided community are enabling inspectors to visualize data files from database and real-time data access using an Augmented Reality environment.
more »
« less
AI‐enabled airport runway pavement distress detection using dashcam imagery
Abstract Maintaining airport runways is crucial for safety and efficiency, yet traditional monitoring relies on manual inspections, prone to time consumption and inaccuracy. This study pioneers the utilization of low‐cost dashcam imagery for the detection and geolocation of airport runway pavement distresses, employing novel deep‐learning frameworks. A significant contribution of our work is the creation of the first public dataset specifically designed for this purpose, addressing a critical gap in the field. This dataset, enriched with diverse distress types under various environmental conditions, enables the development of an automated, cost‐effective method that substantially enhances airport maintenance operations. Leveraging low‐cost dashcam technology in this unique scenario, our approach demonstrates remarkable potential in improving the efficiency and safety of airport runway inspections, offering a scalable solution for infrastructure management. Our findings underscore the benefits of integrating advanced imaging and artificial intelligence technologies, paving the way for advancements in airport maintenance practices.
more »
« less
- Award ID(s):
- 2311954
- PAR ID:
- 10499179
- Publisher / Repository:
- Wiley-Blackwell
- Date Published:
- Journal Name:
- Computer-Aided Civil and Infrastructure Engineering
- ISSN:
- 1093-9687
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Airports facilitate the fastest mode of transportation and connect local communities and businesses with national and international destinations. The American Society of Civil Engineers (ASCE) 2021 infrastructure report card rated the aviation infrastructure category with a D+. This highlights the need for frequent monitoring and performing timely preservation techniques to ensure the optimal performance of the asset. The Texas Department of Transportation (TxDOT) periodically inspects the regional airports in Texas through visual surveys and estimates the pavement condition index (PCI) for each airport on a network scale. These ratings are used to assess the need for rehabilitation in a timely manner. In this study, an attempt was made to use an unmanned aerial vehicle (UAV) mounted with an optical camera to inspect and evaluate the condition of various airport assets. Several observations were outlined to conduct a safe inspection of airport assets using UAVs. A comparison of PCI values, grouped into three categories, obtained from traditional and aerial inspections was made to understand the feasibility of using this new technology for airport asset management. It was observed that both inspections classified most of the airport assets similarly. The traditional inspection was observed to be quicker as it requires inspection of only sampled units, however, UAV data processing takes a relatively long time to offer a comprehensive digital footprint and immersive visualization experience of the whole airport assets. Overall, UAVs are identified to have a great potential as a data collection tool supplementary to the current traditional practices.more » « less
-
Abstract We introduce a novel digital twin framework for predictive maintenance of physical systems with long term operations. Using monitoring tire health as an application, we show how the digital twin framework is used to enhance automotive safety and efficiency, while overcoming technical challenges using a three-step approach. Firstly, for managing the data complexity over a long operation span, we employ data reduction techniques to concisely represent physical tires using historical performance and usage data. Relying on this data, for fast real-time prediction, we train a transformer-based model offline on our concise dataset to predict future tire health over time, represented as Remaining Casing Potential (RCP). Based on our architecture, our model quantifies both epistemic and aleatoric uncertainty, providing reliable confidence intervals around predicted RCP. Secondly, we incorporate real-time data by updating the predictive model in the digital twin framework, ensuring its accuracy throughout its life span with the aid of hybrid modeling and the use of a discrepancy function. Thirdly, to assist decision making in predictive maintenance, we implement a Tire State Decision Algorithm, which strategically determines the optimal timing for tire replacement based on RCP forecasted by our transformer model. This three-step approach ensures that our digital twin not only accurately predicts the health of a system, but also continually refines its digital representation and makes predictive maintenance decisions for removal from service. Our proposed digital twin framework embodies a physical system accurately and leverages big data and machine learning for predictive maintenance, model update and decision making.more » « less
-
IEOM Society (Ed.)Fleet maintenance is the process fleet manager utilizes to manage fleet and asset information from acquisition to disposal. It helps the companies reduce costs, improve efficiency and safety. Second Harvest of Metrolina Food Bank (SHMETROLINA) distributed over 70 million pounds of food and household items to approximately 800 partner agencies in 2019. With the critical need for transportation for distribution, a vehicle experiencing downtime will disrupt scheduled routes to partner agencies and increase repair costs for SHMETROLINA. This research developed an interactive dashboard using R shiny to help non-profit food bank fleet managers make informed decisions for effective fleet maintenance operations and support the food bank operations to meet hunger needs. The dashboard consists of the visualizations of the maintenance cost, mileage, and operational cost for individual and fleet vehicles from the data collected by the food bank.more » « less
-
Bridges play a key role in supporting the transportation network in the United States. The 2021 infrastructure report card prepared by ASCE highlighted that more than 40% of bridges in the U.S. are over 50 years old. Some of these bridges are classified as structurally deficient, even though they are safe to travel. To address these challenges, highway agencies are exploring innovative technologies to conduct inspections and realize benefits in relation to access, cost, and safety. Federal and state DOTs have conducted several studies on the application of uncrewed aerial vehicles (UAVs) for bridge health monitoring. This study identified the existing knowledge gap in performing 360° inspection of bridges. In this current research, UAVs were demonstrated for conducting 360° inspections of three different bridges in Alaska. The locations of the aerial images during the inspections were also pictographically represented to provide a holistic idea for the highway agencies and practitioners. Three-dimensional models representing the actual conditions of the bridge were generated and used for comparing the bridge condition assessments with traditional inspection reports. Infrared imagery was also collected to identify the effect of thermal loading in assessing the conditions of the bridge elements. The applicability and recommendation scale for the use of UAVs for different bridge inspections was provided. The approach demonstrated in this study is expected to result in more than 90% savings in storage requirements and contribute to an increase in the applications of UAVs for conducting 360° bridge inspections across the U.S.more » « less
