Road authorities worldwide can leverage the advances in vehicle technology by continuously monitoring their roads’ conditions to minimize road maintenance costs. The existing methods for carrying out road condition surveys involve manual observations using standard survey forms, performed by qualified personnel. These methods are expensive, time-consuming, infrequent, and can hardly provide real-time information. Some automated approaches also exist but are very expensive since they require special vehicles equipped with computing devices and sensors for data collection and processing. This research aims to leverage the advances in vehicle technology in providing a cheap and real-time approach to carry out road condition monitoring (RCM). This study developed a deep learning model using the You Only Look Once, Version 5 (YOLOv5) algorithm that was trained to capture and categorize flexible pavement distresses (FPD) and reached 95% precision, 93.4% recall, and 97.2% mean Average Precision. Using vehicle built-in cameras and GPS sensors, these distresses were detected, images were captured, and locations were recorded. This was validated on campus roads and parking lots using a car featured with a built-in camera and GPS. The vehicles’ built-in technologies provided a more cost-effective and efficient road condition monitoring approach that could also provide real-time road conditions.
Pavement Distress Identification Based on Computer Vision and Controller Area Network (CAN) Sensor Models
Recent technological developments have attracted the use of machine learning technologies and sensors in various pavement maintenance and rehabilitation studies. To avoid excessive road damages, which cause high road maintenance costs, reduced mobility, vehicle damages, and safety concerns, the periodic maintenance of roads is necessary. As part of maintenance works, road pavement conditions should be monitored continuously. This monitoring is possible using modern distress detection methods that are simple to use, comparatively cheap, less labor-intensive, faster, safer, and able to provide data on a real-time basis. This paper proposed and developed two models: computer vision and sensor-based. The computer vision model was developed using the You Only Look Once (YOLOv5) algorithm for detecting and classifying pavement distresses into nine classes. The sensor-based model combined eight Controller Area Network (CAN) bus sensors available in most new vehicles to predict pavement distress. This research employed an extreme gradient boosting model (XGBoost) to train the sensor-based model. The results showed that the model achieved 98.42% and 97.99% area under the curve (AUC) metrics for training and validation datasets, respectively. The computer vision model attained an accuracy of 81.28% and an F1-score of 76.40%, which agree with past studies. The results indicated that both computer vision and sensor-based models proved highly efficient in predicting pavement distress and can be used to complement each other. Overall, computer vision and sensor-based tools provide cheap and practical road condition monitoring compared to traditional manual instruments.
more »
« less
- NSF-PAR ID:
- 10431852
- Date Published:
- Journal Name:
- Sustainability
- Volume:
- 15
- Issue:
- 8
- ISSN:
- 2071-1050
- Page Range / eLocation ID:
- 6438
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
more » « less
-
more » « less
Abstract Pavement condition monitoring is required to identify pavements in need of maintenance or rehabilitation. Early identification of reduction in pavement's structural resistance and improving the structural resistance by minor repairs can lead to significantly lower maintenance costs for transportation agencies. In this study, a cost‐effective wireless sensor that can be embedded in the road to measure the transient vibrations due to different applied loads was tested to determine its effectiveness in terms of pavement displacement measurements. Test results show that the vibration sensor, combined with the algorithms, can be embedded in new or existing pavements and used as an accurate wireless displacement sensor. The low cost of the sensor system allows the use of these sensors at high densities for monitoring the performance of an entire road network. Outputs from the developed system can be directly used to evaluate the condition and performance of pavement structure (increasing displacement over time indicating increasing pavement damage). In addition, displacement data from the system can be used to backcalculate pavement layer stiffnesses, which can be used to predict long‐term performance of the pavement structure. Reduction in pavement layer stiffness over time can be used to determine long‐term damage accumulation.
-
Pavement surveying and distress mapping is completed by roadway authorities to quantify the topical and structural damage levels for strategic preventative or rehabilitative action. The failure to time the preventative or rehabilitative action and control distress propagation can lead to severe structural and financial loss of the asset requiring complete reconstruction. Continuous and computer-aided surveying measures not only can eliminate human error when analyzing, identifying, defining, and mapping pavement surface distresses, but also can provide a database of road damage patterns and their locations. The database can be used for timely road repairs to gain the maximum durability of the asphalt and the minimum cost of maintenance. This paper introduces an autonomous surveying scheme to collect, analyze, and map the image-based distress data in real time. A descriptive approach is considered for identifying cracks from collected images using a convolutional neural network (CNN) that classifies several types of cracks. Typically, CNN-based schemes require a relatively large processing power to detect desired objects in images in real time. However, the portability objective of this work requires to utilize low-weight processing units. To that end, the CNN training was optimized by the Bayesian optimization algorithm (BOA) to achieve the maximum accuracy and minimum processing time with minimum neural network layers. First, a database consisting of a diverse population of crack distress types such as longitudinal, transverse, and alligator cracks, photographed at multiple angles, was prepared. Then, the database was used to train a CNN whose hyperparameters were optimized using BOA. Finally, a heuristic algorithm is introduced to process the CNN’s output and produce the crack map. The performance of the classifier and mapping algorithm is examined against still images and videos captured by a drone from cracked pavement. In both instances, the proposed CNN was able to classify the cracks with 97% accuracy. The mapping algorithm is able to map a diverse population of surface cracks patterns in real time at the speed of 11.1 km per hour.more » « less
-
Sensors in and around the environment becoming ubiquitous has ushered in the concept of smart animal agriculture which has the potential to greatly improve animal health and productivity using the concepts of remote health monitoring which is a necessity in times when there is a great demand for animal products. The data from in and around animals gathered from sensors dwelling in animal agriculture settings have made farms a part of the Internet of Things space. This has led to active research in developing efficient communication methodologies for farm networks. This study focuses on the first hop of any such farm network where the data from inside the body of the animals is to be communicated to a node dwelling outside the body of the animal. In this paper, we use novel experimental methods to calculate the channel loss of signal at sub-GHz frequencies of 100 - 900 MHz to characterize the in-body to out-of-body communication channel in large animals. A first-of-its-kind 3D bovine modeling is done with computer vision techniques for detailed morphological features of the animal body is used to perform Finite Element Method based Electromagnetic simulations. The results of the simulations are experimentally validated to come up with a complete channel modeling methodology for in-body to out-of-body animal body communication. The experimentally validated 3D bovine model is made available publicly on https://github.com/SparcLab/Bovine-FEM-Model.git GitHub. The results illustrate that an in-body to out-of-body communication channel is realizable from the rumen to the collar of ruminants with $\leq {90}~{\rm dB}$ path loss at sub-GHz frequencies ( $100-900~MHz$ ) making communication feasible. The developed methodology has been illustrated for ruminants but can also be used for other related in-body to out-of-body studies. Using the developed channel modeling technique, an efficient communication architecture can be formed for in-body to out-of-body communication in animals which paves the way for the design and development of future smart animal agriculture systems.more » « less
-
High testosterone is associated with increased physical performance in sports due to its stimulation with body-muscle ratio, lean mass (muscle and bone), and bone density. Several studies show athletes with better explosive strength and sprint running performances in football, have a higher basal level of testosterone. The results suggest a relationship between testosterone production and the development of fast-twitch muscle fibers, endurance training, lean mass, resistance training in athletes as well as motivation for competition. Thus, monitoring testosterone levels is gaining attention to evaluate athletic performance of one's physical performance in sport, fitness, and bodybuilding as well as prevent health risk factors for low levels of testosterone. There have been attempts using optical, electrical and biochemical sensors to monitor testosterone but are difficult to reproduce in large quantities and suffer from limitations of sensitivity, and detection limits. This can be addressed using Molecularly Imprinted Polymers (MIPs) in a point of care (POC) system. Molecularly Imprinted Polymers (MIPs) are a synthetic polymer with cavities in the polymer matrix serve as recognition sites for a specific template molecule, which are detected using electrochemical amperometry. In this paper, we have used MIPs in conjunction with cyclic voltammetry, to produce a viable, ultrasensitive electrochemical sensor for the detection of testosterone from a human sweat sample. This combination of MIPs and cyclic voltammetry allows for a simple, low-cost, mass-producible, and non-invasive method for detecting testosterone in human males. This method is extremely simple and cheap, allowing for consistent measurement of Testosterone levels in humans and allows for the detection of Testosterone in a POC. In our work, a Screen-printed carbon electrode (SPCE) using polypropylene fabric was used as the base working electrode in a three-electrode system. The screen-printing technique was implemented to layer a carbon paste over both sides of the fabric and was air-dried for one hour at 75⁰C. The SPCE was immersed into an acetate buffer solution that contains a 2.0mM monomer called o-phenylenediamine and with a 0.1mM testosterone template. Electropolymerization was carried out with cyclic voltammetry from a range of 0V to 1.0V, at a scan rate of 50 mV/s, a sensitivity (A/V) of 1e-5A, and for a total of 30 cycles. The set concentration tested was 100-1600 ng/ml of testosterone. The electrochemical characterization will have a potential sweep of -1.2 V to 1.2 V, a scan rate of 0.05 (V/s), a sensitivity (A/V) of 1e-5A, and a singular cycle. The wearable biosensor showed a detection range for testosterone from 100ng to 1600ng, electrochemical results also showed a clear and measurable result with an R-square value of 0.9417 which proves the accuracy of the developed sensor. Although this is not the complete saturation point and theoretically maximum limit of 28,842ng/ml can be achieved although this was not tested. The detectable lowest concentration of testosterone was found to be ~100ng/ml, and it was noted that lower than 100ng gives a weaker signal, In conclusion a novel electrochemical sensor based on a molecularly imprinted polymer used as the extended gate of a field effect transistor was developed for the ultrasensitive detection of sweat Testosterone. This sensing technology paves the way for the low cost, label-free, and point of care detection which can be used for evaluating ang monitoring athletic performance.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3390/su15086438
