An official website of the United States government
We propose MiShape, a millimeter-wave (mmWave) wireless signal based imaging system that generates high-resolution human silhouettes and predicts 3D locations of body joints. The system can capture human motions in real-time under low light and low-visibility conditions. Unlike existing vision-based motion capture systems, MiShape is privacy non-invasive and can generalize to a wide range of motion tracking applications at-home. To overcome the challenges with low-resolution, specularity, and aliasing in images from Commercial-Off-The-Shelf (COTS) mmWave systems, MiShape designs deep learning models based on conditional Generative Adversarial Networks and incorporates the rules of human biomechanics. We have customized MiShape for gait monitoring, but the model is well adaptive to any tracking applications with limited fine-tuning samples. We experimentally evaluate MiShape with real data collected from a COTS mmWave system for 10 volunteers, with diverse ages, gender, height, and somatotype, performing different poses. Our experimental results demonstrate that MiShape delivers high-resolution silhouettes and accurate body poses on par with an existing vision-based system, and unlocks the potential of mmWave systems, such as 5G home wireless routers, for privacy-noninvasive healthcare applications.
more »
« less
Passive Millimeter-Wave Imaging Toward 1K Resolution
Existing millimeter wave imaging systems have not lived up to expectations, neither in performance nor in achieving manageable size, weight, and power (SWAP). As in airports, they remain bulky, time consuming to use and not useful in preventing threats as their promise might have been. We need a small camera-like, low cost, compact, sensitive, and versatile Passive Millimeter-Wave Imaging (PMWI) enable a broader field of imaging applications. The main challenge with existing PMWI is the need for scanning causing bulkiness and time-delays for standoff applications. Similarly, secure communication at long distances is extremely important for all government and commercial applications, but the development of low power and wideband transceivers that operate across large distances is technically a very challenging task;
more »
« less
- Award ID(s):
- 1809728
- PAR ID:
- 10271609
- Date Published:
- Journal Name:
- 2020 IEEE International Symposium on Antennas and Propagation and USNC-URSI Radio Science Meeting
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Hexagonal semiconductors such as 4H SiC have important high-frequency, high-power, and high-temperature applications. The applications require accurate knowledge of both ordinary and extraordinary relative permittivities, ε and ε||, perpendicular and parallel, respectively, to the c axis of these semiconductors. However, due to challenges for suitable test setups and precision high-frequency measurements, little reliable data exists for these semiconductors especially at millimeter-wave frequencies. Recently, we reported ε|| of 4H SiC from 110 to 170 GHz. This paper expands on the previous report to include both ε and ε|| of the same material from 55 to 330 GHz, as well as their temperature and humidity dependence enabled by improving the measurement precision to two decimal points. For example, at room temperature, real ε and ε|| are constant at 9.77 ± 0.01 and 10.20 ± 0.05, respectively. By contrast, the ordinary loss tangent increases linearly with the frequency f in the form of (4.9 ± 0.1) 10−16 f. The loss tangent, less than 1 10−4 over most millimeter-wave frequencies, is significantly lower than that of sapphire, our previous low-loss standard. Finally, both ε and ε|| have weak temperature coefficients on the order of 10−4 /°C. The knowledge reported here is especially critical to millimeter-wave applications of 4H SiC, not only for solid-state devices and circuits, but also as windows for high-power vacuum electronics.more » « less
-
This paper proposes SquiggleMilli, a system that approximates traditional Synthetic Aperture Radar (SAR) imaging on mobile millimeter-wave (mmWave) devices. The system is capable of imaging through obstructions, such as clothing, and under low visibility conditions. Unlike traditional SAR that relies on mechanical controllers or rigid bodies, SquiggleMilli is based on the hand-held, fluidic motion of the mmWave device. It enables mmWave imaging in hand-held settings by re-thinking existing motion compensation, compressed sensing, and voxel segmentation. Since mmWave imaging suffers from poor resolution due to specularity and weak reflectivity, the reconstructed shapes could be imperceptible by machines and humans. To this end, SquiggleMilli designs a machine learning model to recover the high spatial frequencies in the object to reconstruct an accurate 2D shape and predict its 3D features and category. We have customized SquiggleMilli for security applications, but the model is adaptable to other applications with limited training samples. We implement SquiggleMilli on off-the-shelf components and demonstrate its performance improvement over the traditional SAR qualitatively and quantitatively.more » « less
-
The use of electromagnetic waves at microwave and millimeter-wave (mm-wave) frequencies in imaging has been growing rapidly in the last two decades with applications in security screening, biomedical imaging, nondestructive testing, and the inspection of goods and packages. The nonionizing nature of the radiation renders microwave and mm-wave imaging (MMI) safe for humans and, thus, attractive, especially for frequent imaging of living tissue and humans. At the same time, the radiation penetrates many materials, which are optically opaque: e.g., fog and foliage, soil and living tissue, brick and drywall, wood, fabrics, and plastics. Importantly, modern MMI systems offer compact and relatively low-cost hardware due to advancements in high-frequency microelectronics.more » « less
-
Abstract In droplet-on-demand liquid metal jetting (DoD-LMJ) additive manufacturing, complex physical interactions govern the droplet characteristics, such as size, velocity, and shape. These droplet characteristics, in turn, determine the functional quality of the printed parts. Hence, to ensure repeatable and reliable part quality it is necessary to monitor and control the droplet characteristics. Existing approaches for in-situ monitoring of droplet behavior in DoD-LMJ rely on high-speed imaging sensors. The resulting high volume of droplet images acquired is computationally demanding to analyze and hinders real-time control of the process. To overcome this challenge, the objective of this work is to use time series data acquired from an in-process millimeter-wave sensor for predicting the size, velocity, and shape characteristics of droplets in DoD-LMJ process. As opposed to high-speed imaging, this sensor produces data-efficient time series signatures that allows rapid, real-time process monitoring. We devise machine learning models that use the millimeter-wave sensor data to predict the droplet characteristics. Specifically, we developed multilayer perceptron-based non-linear autoregressive models to predict the size and velocity of droplets. Likewise, a supervised machine learning model was trained to classify the droplet shape using the frequency spectrum information contained in the millimeter-wave sensor signatures. High-speed imaging data served as ground truth for model training and validation. These models captured the droplet characteristics with a statistical fidelity exceeding 90%, and vastly outperformed conventional statistical modeling approaches. Thus, this work achieves a practically viable sensing approach for real-time quality monitoring of the DoD-LMJ process, in lieu of the existing data-intensive image-based techniques.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
