skip to main content


Title: Osprey: A mmWave Approach to TireWear Sensing
Tire wear is a leading cause of automobile accidents globally. Beyond safety, tire wear affects performance and is an important metric that decides tire replacement, one of the biggest maintenance expense of the global trucking industry. We believe that it is important to measure and monitor tire wear in all automobiles. The current approach to measure tire wear is manual and extremely tedious. Embedding sensor electronics in tires to measure tire wear is challenging, given the inhospitable temperature, pressure, and dynamics of the tire. Further, off-tire sensors placed in the well such as laser range-finders are vulnerable to road debris that may settle in tire grooves. This paper presents Osprey, the first on-automobile, mmWave sensing system that can measure accurate tire wear continuously and is robust to road debris. Osprey’s key innovation is to leverage existing, high-volume, automobile mmWave radar, place it in the tire well of automobiles, and observe reflections of the radar’s signal from the tire surface and grooves to measure tire wear, even in the presence of debris. We achieve this through a super-resolution Inverse Synthetic Aperture Radar algorithm that exploits the natural rotation of the tire and improves range resolution to sub-mm. We show how our system can eliminate debris by attaching specialized metallic structures in the grooves that behave as spatial codes and offer a unique signature, when coupled with the rotation of the tire. In addition to tire wear sensing, we demonstrate the ability to detect and locate unsafe, metallic foreign objects such as nails lodged in the tire. We evaluate Osprey on commercial tires mounted on a mechanical, tire-rotation rig and a passenger car.We test Osprey at different speeds, in the presence of different types of debris, different levels of debris, on different terrains, and different levels of automobile vibration. We achieve a median absolute tire wear error of 0.68 mm across all our experiments. Osprey also locates foreign objects lodged in the tire with an error of 1.7 cm and detects metallic foreign objects with an accuracy of 92%.  more » « less
Award ID(s):
1823235
NSF-PAR ID:
10195728
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
The 18th ACM International Conference on Mobile Systems, Applications, and Services
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Tire wear particles (TWPs) are a major category of microplastic pollution produced by friction between tires and road surfaces. This non-exhaust particulate matter (PM) is transported through the air and with runoff leading to environmental pollution and health concerns. Here, we collected airborne PM along paved roads with different traffic volumes and speeds using Sigma-2 passive samplers. Particles entering the samplers deposit onto substrates for analysis, or, as we modified it, directly into small (60 ml) separatory funnels, which is particularly useful with high particle loads, where a density separation aids in isolating the microplastics. We quantified putative TWPs (∼10–80 µm) deposited on the substrates (primarily adhesive tape on glass slides) and in the funnels using stereomicroscopy. Putative TWP deposition rates (particles/cm 2 /day ± SD) at 5 m from the road were highest near a busy highway (324 ± 129), followed by a boulevard with moderate traffic (184 ± 93), and a slow traffic avenue (29 ± 7). We observed that deposition rates increased within proximity to the highway: 99 ± 54, 180 ± 88, and 340 ± 145 at 30, 15, and 5 m, respectively. We show that TWP abundances (i.e., deposition and mass concentration) increase with vehicle braking (driving behavior). We observed no differences ( p > 0.05) between the separatory funnel and adhesive tape collection methods. In addition, we were able to obtain FTIR spectra of TWPs (>10 µm) using µ-ATR-FTIR. Both deserve further scrutiny as novel sampling and analytical approaches. In a separate sampling campaign, we differentiated 1438 particles (∼1–80 µm) deposited on boron substrates into TWP, metal, mineral, and biogenic/organic classes with single particle SEM/EDX analysis based on morpho-textural-chemical classification and machine learning. The results revealed similar concentration trends with traffic (high > moderate > low), with the distribution of particle sources alike for the highway and the moderate road: TWPs (∼38–39%) > biogenic (∼34–35%) > minerals (∼23–26%), and metallic particles (∼2–3%). The low traffic road yielded a much different distribution: biogenic (65%) > minerals (27%) > TWPs (7%) > metallic particles (1%). Overall, this work provides much-needed empirical data on airborne TWPs along different types of roads. 
    more » « less
  2. Vehicles are becoming more intelligent and automated. To achieve higher automation levels, vehicles are being equipped with more and more sensors. High data rate connectivity seems critical to allow vehicles and road infrastructure exchanging all these sensor data to enlarge their sensing range and make better safety related decisions. Connectivity also enables other applications such as infotainment or high levels of traffic coordination. Current solutions for vehicular communications though do not support the gigabit-per-second data rates. This presentation makes the case that millimeter wave communication is the only viable approach for high bandwidth connected vehicles. The motivation and challenges associated with using mmWave for vehicle-to-vehicle and vehicle-to-infrastructure applications are highlighted. Examples from recent work are provided including new theoretical results that enable mmWave communication in high mobility scenarios and innovative architectural concepts like position and radar-aided communication. 
    more » « less
  3. Abstract

    The transition of autonomous vehicles into fleets requires an advanced control system design that relies on continuous feedback from the tires. Smart tires enable continuous monitoring of dynamic parameters by combining strain sensing with traditional tire functions. Here, we provide breakthrough in this direction by demonstrating tire-integrated system that combines direct mask-less 3D printed strain gauges, flexible piezoelectric energy harvester for powering the sensors and secure wireless data transfer electronics, and machine learning for predictive data analysis. Ink of graphene based material was designed to directly print strain sensor for measuring tire-road interactions under varying driving speeds, normal load, and tire pressure. A secure wireless data transfer hardware powered by a piezoelectric patch is implemented to demonstrate self-powered sensing and wireless communication capability. Combined, this study significantly advances the design and fabrication of cost-effective smart tires by demonstrating practical self-powered wireless strain sensing capability.

     
    more » « less
  4. Abstract—Robotic geo-fencing and surveillance systems require accurate monitoring of objects if/when they violate perimeter restrictions. In this paper, we seek a solution for depth imaging of such objects of interest at high accuracy (few tens of cm) over extended ranges (up to 300 meters) from a single vantage point, such as a pole mounted platform. Unfortunately, the rich literature in depth imaging using camera, lidar and radar in isolation struggles to meet these tight requirements in real-world conditions. This paper proposes Metamoran, a solution that explores long-range depth imaging of objects of interest by fusing the strengths of two complementary technologies: mmWave radar and camera. Unlike cameras, mmWave radars offer excellent cm-scale depth resolution even at very long ranges. However, their angular resolution is at least 10× worse than camera systems. Fusing these two modalities is natural, but in scenes with high clutter and at long ranges, radar reflections are weak and experience spurious artifacts. Metamoran’s core contribution is to leverage image segmentation and monocular depth estimation on camera images to help declutter radar and discover true object reflections.We perform a detailed evaluation of Metamoran’s depth imaging capabilities in 400 diverse scenarios. Our evaluation shows that Metamoran estimates the depth of static objects up to 90 m away and moving objects up to 305 m away and with a median error of 28 cm, an improvement of 13× over a naive radar+camera baseline and 23× compared to monocular depth estimation. 
    more » « less
  5. Abstract

    Wearable sensing platforms have been rapidly advanced over recent years, thanks to numerous achievements in a variety of sensor fabrication techniques. However, the development of a flexible proximity sensor that can perform in a large range of object mobility remains a challenge. Here, a polymer-based sensor that utilizes a nanostructure composite as the sensing element has been presented for forthcoming usage in healthcare and automotive applications. Thermoplastic Polyurethane (TPU)/Carbon Nanotubes (CNTs) composites are capable of detecting presence of an external object in a wide range of distance. The proximity sensor exhibits an unprecedented detection distance of 120 mm with a resolution of 0.3%/mm. The architecture and manufacturing procedures of TPU/CNTs sensor are straightforward and performance of the proximity sensor shows robustness to reproducibility as well as excellent electrical and mechanical flexibility under different bending radii and over hundreds of bending cycles with variation of 4.7% and 4.2%, respectively. Tunneling and fringing effects are addressed as the sensing mechanism to explain significant capacitance changes. Percolation threshold analysis of different TPU/CNT contents indicated that nanocomposites having 2 wt% carbon nanotubes are exhibiting excellent sensing capabilities to achieve maximum detection accuracy and least noise among others. Fringing capacitance effect of the structure has been systematically analyzed by ANSYS Maxwell (Ansoft) simulation, as the experiments precisely supports the sensitivity trend in simulation. Our results introduce a new mainstream platform to realize an ultrasensitive perception of objects, presenting a promising prototype for application in wearable proximity sensors for motion analysis and artificial electronic skin.

     
    more » « less