skip to main content

Explore Research Products in the NSF-PAR

Title: Deep Neural Network Feature Designs for RF Data-Driven Wireless Device Classification
Most prior works on deep learning-based wireless device classification using radio frequency (RF) data apply off-the-shelf deep neural network (DNN) models, which were matured mainly for domains like vision and language. However, wireless RF data possesses unique characteristics that differentiate it from these other domains. For instance, RF data encompasses intermingled time and frequency features that are dictated by the underlying hardware and protocol configurations. In addition, wireless RF communication signals exhibit cyclostationarity due to repeated patterns (PHY pilots, frame prefixes, and so on) that these signals inherently contain. In this article, we begin by explaining and showing the unsuitability as well as limitations of existing DNN feature design approaches currently proposed to be used for wireless device classification. We then present novel feature design approaches that exploit the distinct structures of RF communication signals and the spectrum emissions caused by transmitter hardware impairments to custom-make DNN models suitable for classifying wireless devices using RF signal data. Our proposed DNN feature designs substantially improve classification robustness in terms of scalability, accuracy, signature anti-cloning, and insensitivity to environment perturbations. We end the article by presenting other feature design strategies that have great potential for providing further performance improvements of the DNN-based wireless device classification, and discuss the open research challenges related to these proposed strategies.  more » « less
Award ID(s):
2003273
NSF-PAR ID:
10245791
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
IEEE Network
ISSN:
0890-8044
Page Range / eLocation ID:
1 to 7
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ( , 2020 IEEE Global Communications Conference)
    null (Ed.)
    Wireless device classification techniques play a vital role in supporting spectrum awareness applications, such as spectrum access policy enforcement and unauthorized network access monitoring. Recent works proposed to exploit distortions in the transmitted signals caused by hardware impairments of the devices to provide device identification and classification using deep learning. As technology advances, the manufacturing impairment variations among devices become extremely insignificant, and hence the need for more sophisticated device classification techniques becomes inescapable. This paper proposes a scalable, RF data-driven deep learning-based device classification technique that efficiently classifies transmitting radios from a large pool of bit-similar, high-end, high-performance devices with same hardware, protocol, and/or software configurations. Unlike existing techniques, the novelty of the proposed approach lies in exploiting both the in-band and out-of-band distortion information, caused by inherent hardware impairments, to enable scalable and accurate device classification. Using convolutional neural network (CNN) model for classification, our results show that the proposed technique substantially outperforms conventional approaches in terms of both classification accuracy and learning times. In our experiments, the testing accuracy obtained under the proposed technique is about 96% whereas that obtained under the conventional approach is only about 50% when the devices exhibit very similar hardware impairments. The proposed technique can be implemented with minimum receiver design tuning, as radio technologies, such as cognitive radios, can easily allow for both in-band and out-of band sampling. 
    more » « less
  2. ( , IEEE International Conference on Communications)
    The accurate identification of wireless devices is critical for enabling automated network access monitoring and authenticated data communication in large-scale networks; e.g., IoT networks. RF fingerprinting has emerged as a potential solution for device identification by leveraging the transmitter unique manufacturing impairments of the RF components. Although deep learning is proven efficient in classifying devices based on the hardware impairments, trained models perform poorly due to channel variations. That is, although training and testing neural networks using data generated during the same period achieve reliable classification, testing them on data generated at different times degrades the accuracy substantially. To the best of our knowledge, we are the first to propose to leverage MIMO capabilities to mitigate the channel effect and provide a channelresilient device classification. For the proposed technique we show that, for Rayleigh channels, blind partial channel estimation enabled by MIMO increases the testing accuracy by up to 40% when the models are trained and tested over the same channel, and by up to 60% when the models are tested on a channel that is different from that used for training. 
    more » « less
  3. ; ; ; ; ( , IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems)
    This paper presents a design approach for the modeling and simulation of ultra-low power (ULP) analog computing machine learning (ML) circuits for seizure detection using EEG signals in wearable health monitoring applications. In this paper, we describe a new analog system modeling and simulation technique to associate power consumption, noise, linearity, and other critical performance parameters of analog circuits with the classification accuracy of a given ML network, which allows to realize a power and performance optimized analog ML hardware implementation based on diverse application-specific needs. We carried out circuit simulations to obtain non-idealities, which are then mathematically modeled for an accurate mapping. We have modeled noise, non-linearity, resolution, and process variations such that the model can accurately obtain the classification accuracy of the analog computing based seizure detection system. Noise has been modeled as an input-referred white noise that can be directly added at the input. Device process and temperature variations were modeled as random fluctuations in circuit parameters such as gain and cut-off frequency. Nonlinearity was mathematically modeled as a power series. The combined system level model was then simulated for classification accuracy assessments. The design approach helps to optimize power and area during the development of tailored analog circuits for ML networks with the ability to potentially trade power and performance goals while still ensuring the required classification accuracy. The simulation technique also enables to determine target specifications for each circuit block in the analog computing hardware. This is achieved by developing the ML hardware model, and investigating the effect of circuit nonidealities on classification accuracy. Simulation of an analog computing EEG seizure detection block shows a classification accuracy of 91%. The proposed modeling approach will significantly reduce design time and complexity of large analog computing systems. Two feature extraction approaches are also compared for an analog computing architecture. 
    more » « less
  4. ; ; ; ; ( , Proc. SPIE 11408, Radar Sensor Technology XXIV)
    Deep neural networks have become increasingly popular in radar micro-Doppler classification; yet, a key challenge, which has limited potential gains, is the lack of large amounts of measured data that can facilitate the design of deeper networks with greater robustness and performance. Several approaches have been proposed in the literature to address this problem, such as unsupervised pre-training and transfer learning from optical imagery or synthetic RF data. This work investigates an alternative approach to training which involves exploitation of “datasets of opportunity” – micro-Doppler datasets collected using other RF sensors, which may be of a different frequency, bandwidth or waveform - for the purposes of training. Specifically, this work compares in detail the cross-frequency training degradation incurred for several different training approaches and deep neural network (DNN) architectures. Results show a 70% drop in classification accuracy when the RF sensors for pre-training, fine-tuning, and testing are different, and a 15% degradation when only the pre-training data is different, but the fine-tuning and test data are from the same sensor. By using generative adversarial networks (GANs), a large amount of synthetic data is generated for pre-training. Results show that cross-frequency performance degradation is reduced by 50% when kinematically-sifted GAN-synthesized signatures are used in pre-training. 
    more » « less
  5. ; ; ( , ACM Computing Surveys)

    Mobile devices such as smartphones and autonomous vehicles increasingly rely on deep neural networks (DNNs) to execute complex inference tasks such as image classification and speech recognition, among others. However, continuously executing the entire DNN on mobile devices can quickly deplete their battery. Although task offloading to cloud/edge servers may decrease the mobile device’s computational burden, erratic patterns in channel quality, network, and edge server load can lead to a significant delay in task execution. Recently, approaches based on split computing (SC) have been proposed, where the DNN is split into a head and a tail model, executed respectively on the mobile device and on the edge server. Ultimately, this may reduce bandwidth usage as well as energy consumption. Another approach, called early exiting (EE), trains models to embed multiple “exits” earlier in the architecture, each providing increasingly higher target accuracy. Therefore, the tradeoff between accuracy and delay can be tuned according to the current conditions or application demands. In this article, we provide a comprehensive survey of the state of the art in SC and EE strategies by presenting a comparison of the most relevant approaches. We conclude the article by providing a set of compelling research challenges.

     
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email