In this paper we derive a new capability for robots to measure relative direction, or Angle-of-Arrival (AOA), to other robots, while operating in non-line-of-sight and unmapped environments, without requiring external infrastructure. We do so by capturing all of the paths that a WiFi signal traverses as it travels from a transmitting to a receiving robot in the team, which we term as an AOA profile. The key intuition behind our approach is to emulate antenna arrays in the air as a robot moves freely in 2D or 3D space. The small differences in the phase and amplitude of WiFi signals are thus processed with knowledge of a robots’ local displacements (often provided via inertial sensors) to obtain the profile, via a method akin to Synthetic Aperture Radar (SAR). The main contribution of this work is the development of i) a framework to accommodate arbitrary 2D and 3D trajectories, as well as continuous mobility of both transmitting and receiving robots, while computing AOA profiles between them and ii) an accompanying analysis that provides a lower bound on
variance of AOA estimation as a function of robot trajectory geometry that is based on the Cramer Rao Bound and antenna array theory. This is a critical distinction with previous work on SAR that restricts robot mobility to prescribed motion patterns, does not generalize to the full 3D space, and/or requires transmitting robots to be static during data
acquisition periods. In fact, we find that allowing robots to use their full mobility in 3D space while performing SAR, results in more accurate AOA profiles and thus better AOA estimation. We formally characterize this observation as the informativeness of the trajectory; a computable quantity for which we derive a closed form. All theoretical developments are substantiated by extensive simulation and hardware experiments on air/ground robot platforms. Our experimental results bolster our theoretical findings, demonstrating that 3D trajectories provide enhanced and consistent accuracy,
with AOA error of less than 10 deg for 95% of trials. We also show that our formulation can be used with an off-the-shelf trajectory estimation sensor (Intel RealSense T265 tracking camera), for estimating the robots’ local displacements, and we provide theoretical as well as empirical results that show the impact of typical trajectory estimation errors on the
measured AOA. Finally, we demonstrate the performance of our system on a multi-robot task where a heterogeneous air/ground pair of robots continuously measure AOA profiles over a WiFi link to achieve dynamic rendezvous in an unmapped, 300 square meter environment with occlusions.
more »
« less
A wireless signal-based sensing framework for robotics
In this paper, we develop the analytical framework for a novel Wireless signal-based Sensing capability for Robotics (WSR) by leveraging a robots’ mobility in 3D space. It allows robots to primarily measure relative direction, or Angle-of-Arrival (AOA), to other robots, while operating in non-line-of-sight unmapped environments and without requiring external infrastructure. We do so by capturing all of the paths that a wireless signal traverses as it travels from a transmitting to a receiving robot in the team, which we term as an AOA profile. The key intuition behind our approach is to enable a robot to emulate antenna arrays as it moves freely in 2D and 3D space. The small differences in the phase of the wireless signals are thus processed with knowledge of robots’ local displacement to obtain the profile, via a method akin to Synthetic Aperture Radar (SAR). The main contribution of this work is the development of (i) a framework to accommodate arbitrary 2D and 3D motion, as well as continuous mobility of both signal transmitting and receiving robots, while computing AOA profiles between them and (ii) a Cramer–Rao Bound analysis, based on antenna array theory, that provides a lower bound on the variance in AOA estimation as a function of the geometry of robot motion. This is a critical distinction with previous work on SAR-based methods that restrict robot mobility to prescribed motion patterns, do not generalize to the full 3D space, and require transmitting robots to be stationary during data acquisition periods. We show that allowing robots to use their full mobility in 3D space while performing SAR results in more accurate AOA profiles and thus better AOA estimation. We formally characterize this observation as the informativeness of the robots’ motion, a computable quantity for which we derive a closed form. All analytical developments are substantiated by extensive simulation and hardware experiments on air/ground robot platforms using 5 GHz WiFi. Our experimental results bolster our analytical findings, demonstrating that 3D motion provides enhanced and consistent accuracy, with a total AOA error of less than 10◦for 95% of trials. We also analytically characterize the impact of displacement estimation errors on the measured AOA and validate this theory empirically using robot displacements obtained using an off-the-shelf Intel Tracking Camera T265. Finally, we demonstrate the performance of our system on a multi-robot task where a heterogeneous air/ground pair of robots continuously measure AOA profiles over a WiFi link to achieve dynamic rendezvous in an unmapped, 300 m2environment with occlusions.
more » « less- Award ID(s):
- 2114733
- NSF-PAR ID:
- 10373448
- Publisher / Repository:
- SAGE Publications
- Date Published:
- Journal Name:
- The International Journal of Robotics Research
- Volume:
- 41
- Issue:
- 11-12
- ISSN:
- 0278-3649
- Page Range / eLocation ID:
- p. 955-992
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
UAVs need to communicate along three dimensions (3D) with other aerial vehicles, ranging from above to below, and often need to connect to ground stations. However, wireless transmission in 3D space significantly dissipates power, often hindering the range required for these types of links. Directional transmission is one way to efficiently use available wireless channels to achieve the desired range. While multiple-input multiple-output (MIMO) systems can digitally steer the beam through channel matrix manipulation without needing directional awareness, the power resources required for operating multiple radios on a UAV are often logistically challenging. An alternative approach to streamline resources is the use of phased arrays to achieve directionality in the analog domain, but this requires beam sweeping and results in search-time delay. The complexity and search time can increase with the dynamic mobility pattern of the UAVs in aerial networks. However, if the direction of the receiver is known at the transmitter, the search time can be significantly reduced. In this work, multi-antenna channels between two UAVs in A2A links are analyzed, and based on these findings, an efficient machine learning-based method for estimating the direction of a transmitting node using channel estimates of 4 antennas (2 × 2 MIMO) is proposed. The performance of the proposed method is validated and verified through in-field drone-to-drone measurements. Findings indicate that the proposed method can estimate the direction of the transmitter in the A2A link with 86% accuracy. Further, the proposed direction estimation method is deployable for UAV-based massive MIMO systems to select the directional beam without the need to sweep or search for optimal communication performance.more » « less
-
In this work, we present a battery-less wireless Micro-Electro-Mechanical (MEMS)-based respiration sensor capable of measuring the respiration profile of a human subject from up to 2 m distance from the transceiver unit for a mean excitation power of 80 µW and a measured SNR of 124.8 dB at 0.5 m measurement distance. The sensor with a footprint of ~10 cm2 is designed to be inexpensive, maximize user mobility, and cater to applications where disposability is desirable to minimize the sanitation burden. The sensing system is composed of a custom UHF RFID antenna, a low-loss piezoelectric MEMS resonator with two modes within the frequency range of interest, and a base transceiver unit. The difference in temperature and moisture content of inhaled and exhaled air modulates the resonance frequency of the MEMS resonator which in turn is used to monitor respiration. To detect changes in the resonance frequency of the MEMS devices, the sensor is excited by a pulsed sinusoidal signal received through an external antenna directly coupled to the device. The signal reflected from the device through the antenna is then analyzed via Fast Fourier Transform (FFT) to extract and monitor the resonance frequency of the resonator. By tracking the resonance frequency over time, the respiration profile of a patient is tracked. A compensation method for the removal of motion-induced artifacts and drift is proposed and implemented using the difference in the resonance frequency of two resonance modes of the same resonator.more » « less
-
This paper presents GoPose, a 3D skeleton-based human pose estimation system that uses WiFi devices at home. Our system leverages the WiFi signals reflected off the human body for 3D pose estimation. In contrast to prior systems that need specialized hardware or dedicated sensors, our system does not require a user to wear or carry any sensors and can reuse the WiFi devices that already exist in a home environment for mass adoption. To realize such a system, we leverage the 2D AoA spectrum of the signals reflected from the human body and the deep learning techniques. In particular, the 2D AoA spectrum is proposed to locate different parts of the human body as well as to enable environment-independent pose estimation. Deep learning is incorporated to model the complex relationship between the 2D AoA spectrums and the 3D skeletons of the human body for pose tracking. Our evaluation results show GoPose achieves around 4.7cm of accuracy under various scenarios including tracking unseen activities and under NLoS scenarios.more » « less
-
null (Ed.)Unmanned Aerial Vehicles (UAVs) often lack the size, weight, and power to support large antenna arrays or a large number of radio chains. Despite such limitations, emerging applications that require the use of swarms, where UAVs form a pattern and coordinate towards a common goal, must have the capability to transmit in any direction in three-dimensional (3D) space from moment to moment. In this work, we design a measurement study to evaluate the role of antenna polarization diversity on UAV systems communicating in arbitrary 3D space. To do so, we construct flight patterns where one transmitting UAV is hovering at a high altitude (80 m) and a receiving UAV hovers at 114 different positions that span 3D space at a radial distance of approximately 20 m along equally-spaced elevation and azimuth angles. To understand the role of diverse antenna polarizations, both UAVs have a horizontally-mounted antenna and a vertically-mounted antenna-each attached to a dedicated radio chain-creating four wireless channels. With this measurement campaign, we seek to understand how to optimally select an antenna orientation and quantify the gains in such selections.more » « less
