<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Real-time Classification of Jamming Attacks against UAVs via on-board Software-defined Radio and Machine Learning-based Receiver Module</title></titleStmt>
			<publicationStmt>
				<publisher></publisher>
				<date>05/19/2022</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10346141</idno>
					<idno type="doi">10.1109/eIT53891.2022.9813923</idno>
					<title level='j'>2022 IEEE International Conference on Electro Information Technology (eIT)</title>
<idno></idno>
<biblScope unit="volume"></biblScope>
<biblScope unit="issue"></biblScope>					

					<author>J. Price</author><author>Y. Li</author><author>K. Al Shamaileh</author><author>Q. Niyaz</author><author>N. Kaabouch</author><author>V. Devabhaktuni</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[In this article, real-time jamming detection against unmanned aerial vehicles (UAVs) is proposed via the integration of a software-defined radio (SDR) with an on-board Raspberry Pi processor. The SDR is utilized for capturing and forwarding the radio frequency signals to a receiver module hosted in the processor. This module extracts signal features characterized by orthogonal frequency division multiplexing (OFDM) parameters, energy parameters, and signal-to-noise ratio (SNR) parameters. Upon feature extraction, the aforementioned module exploits a machine learning (ML) classifier for detecting and classifying four jamming types; namely, barrage, single-tone, successive-pulse, and protocol-aware. The resulting configuration yielded in an overall detection rate (DR) of 93% and a false alarm rate (FAR) of 1.1%, which are in proximity to their counterparts obtained during the validation stage of the receiver module.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>I. INTRODUCTION</head><p>NMANNED arial vehicles (UAVs) have recently seen a widespread use for a variety of applications, such as research missions, mailing delivery, and disaster management. With autonomous control, UAVs (e.g., drones) are inherently susceptible to a variety of cyberattacks aiming for sabotaging their operations or accessing their data and trajectory information. In other words, a malfunction resulting from a cyberattack (i.e., jamming) potentially compromises sensitive payloads or, in some extreme scenarios, leads to aerial collisions. Hence, the risks of cyberattacks associated with the functionality of UAVs must be acknowledged and mitigated.</p><p>Cyberattacks on UAVs branch into data interception, data manipulation, and denial-of-service. Data interception is often encountered with broadcast authentication protocols, which use cryptographic and non-cryptographic techniques <ref type="bibr">[1]</ref><ref type="bibr">[2]</ref><ref type="bibr">[3]</ref><ref type="bibr">[4]</ref><ref type="bibr">[5]</ref>. On the other hand, secure location verification (e.g., multilateration) were adopted to sideline the impacts of data manipulation attacks <ref type="bibr">[6,</ref><ref type="bibr">7]</ref>. However, these solutions are inefficient for jamming detection provided that attackers can easily launch interference with software-defined radios (SDRs) to disrupt the trajectory of a UAV. As a result, developing jamming detection techniques that also adhere to the existing standards is of grave importance. In this work, radiometric transmissions (i.e., signal features) are used to train a machine learning (ML) algorithm within a receiver module for jamming detection and classification. To this end, SDR units are exploited to launch jamming attacks and collect signal features. The underlying approach facilitates minimal modifications to standards and considers realistic attack setups unlike other reported efforts that assume software/hardware changes and simulation-based scenarios <ref type="bibr">[8]</ref><ref type="bibr">[9]</ref><ref type="bibr">[10]</ref><ref type="bibr">[11]</ref><ref type="bibr">[12]</ref><ref type="bibr">[13]</ref><ref type="bibr">[14]</ref><ref type="bibr">[15]</ref><ref type="bibr">[16]</ref><ref type="bibr">[17]</ref>. It is noteworthy to point out that ML was proposed for satellite communications, vehicle Ad Hoc networks, 5G networks, Internet of Things, and UAVs with applications to jamming detection, trajectory optimization, swarm communication, situational awareness, and malicious attack mitigation <ref type="bibr">[18]</ref><ref type="bibr">[19]</ref><ref type="bibr">[20]</ref><ref type="bibr">[21]</ref><ref type="bibr">[22]</ref><ref type="bibr">[23]</ref><ref type="bibr">[24]</ref><ref type="bibr">[25]</ref>.</p><p>The groundwork of this research was laid for in a previous effort that resulted in large experimental datasets of signal features <ref type="bibr">[26]</ref>. These features were obtained via SDRs and GNURadio flowgraphs built with an external computer. Feature extraction was followed by training and validating multiple ML algorithms for detecting/classifying different jamming attacks. The work herein extends on <ref type="bibr">[26]</ref> in the following aspects:</p><p>1. The ML algorithm with the highest detection rate (DR) is integrated with the GNURadio feature extraction flowgraph to create an all-inclusive seamless receiver module that is capable of preforming real-time decision-making for jamming detection/classification. 2. The developed module is incorporated into a drone via onboard Raspberry Pi processor paired with a low-profile SDR (i.e., HackRF One). This entails loading the processor with the Python code generated from the overall module and verifying the jamming classification process. This article is organized as follows: Section II details the integration of the ML algorithm and GNURadio feature extraction flowgraph into one receiver module. Here, the extracted features are fed directly to the classification algorithm. Section III elaborates on exploiting the module to enable a drone for detecting and classifying specific jamming types. This setup is realized with on-board SDR and Raspberry Pi processer. Conclusions are provided in Section IV. U Fig. <ref type="figure">1</ref>. Simplified GNURadio flowgraphs for (a) launching jamming attacks and (b) receiver module for extracting signal features and executing jamming detection/classification. Further details on each jamming attack and ML training/testing are available in <ref type="bibr">[26]</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>II. MODULE DEVELOPMENT AND VALIDATION</head><p>In this section, a real-time jamming detection/classification module is developed and tested on a computer prior porting to the drone's on-board processor. This module enables the detection and classification of four types of jamming attacks: barrage, single-tone, successive-pulse, and protocol-aware. This module also considers IEEE 802.11 orthogonal frequency division multiplexing (OFDM) communication technology at 2.4 GHz center frequency. Fig. <ref type="figure">1</ref>(a) shows a simplified GNURadio flowgraph that conveys how each jamming type is launched, whereas Fig. <ref type="figure">1(b)</ref> illustrates the feature extraction and ML classification blocks at the receiver side. The five-class random forest (RF) classifier developed in a previous effort is utilized here for its high DR, i.e., 92% in comparison to the other investigated algorithms <ref type="bibr">[26]</ref>. In this setup, eight signal features are extracted. Of these features, three are OFDMspecific (i.e., subcarrier length, cyclic prefix length, subcarrier spacing). The subcarrier length indicates the number of the subcarriers being used. The cyclic prefix length controls symbol overlapping, and the subcarrier spacing is the frequency separation among subcarriers <ref type="bibr">[27]</ref>. The OFDM Estimator block shown in Fig. <ref type="figure">1(b</ref>) is used to extract these features <ref type="bibr">[28]</ref>. Two other features are energy-specific; namely, average received power and threshold. The latter is a binary indicator that returns 1 once the average received power exceeds a certain level and returns 0 otherwise. Such features are extracted with the use of the Energy Detector block <ref type="bibr">[28]</ref>. Finally, three additional features; specifically, signal-to-noise ratio (SNR), average signal power, and average noise power are extracted from the SNR Estimator Probe block. It is worthy to be pointed out that the average received power obtained from the Energy Detector block conveys noise energy; whereas the average signal power obtained from the SNR Estimator Probe presents the estimated signal power excluding noise power. For the training and validation of the RF classifier, a total of 23,565 signal samples were collected following the attack scenario reported in [26, Fig. <ref type="figure">2</ref>]. Of these samples, 10,071 were obtained under no jamming, whereas 3,392, 3,367, 3,378, and 3,357 were obtained in the presence of barrage, single-tone, successive-pulse, and protocolaware jamming, respectively. The complete dataset with the 23,565 samples is provided in <ref type="bibr">[29]</ref>. While developing the classifier, 10-fold cross-validation was used and grid search is utilized for finding the optimal hyper-parameters.</p><p>The jamming classifcation block receives all features from the feature extraction block and writes classification parameter C, C = 0, 1 &#8230; 4, to a file according to the jamming type as depicted in Table <ref type="table">1</ref>. The resulting C values are utilized in evaluating the classification accuracy (i.e., DR) by comparing the predictions of the module with the actual launched jamming type. Fig. <ref type="figure">2</ref> illustrates the pseudo code for the receiver module. Also, Fig. <ref type="figure">3</ref> shows a sample output file with prediction results for C = 0 (i.e., No Jamming), which results in 100% DR. This DR is calculated and updated for every set of extracted features. The Prediction together with the Jamming Type are printed to validate the functionality of the developed receiver module.  The receiver module in Fig. <ref type="figure">1(b</ref>) is also tested by calculating the DR while a jammer is in proximity to a receiver terminal (i.e., computer). To collect experimental data, two computers are utilized. The first computer uses an SDR to function as a receiver running the developed module. This computer has a 64-bit Windows 10 machine with Intel &#174; Core TM i7-7700HQ CPU @ 2.8 GHz processor and 32 GB of memory. The second computer is for launching each of the jamming attacks via another SDR. Fig. <ref type="figure">4</ref> presents sample outputs of 15 predictions for each attack type. The receiver module demonstrates a DR of 100% for barrage and successive-pulse types. Moreover, the resulting DR for single-tone and protocol-aware are 93.33% and 40%, respectively. The high misprediction in protocol-aware is attributed to its spectral similarities to barrage jamming and is expected to improve with the increase of samples. It is to be stressed that the DR is updated as samples are added. For instance, Fig. <ref type="figure">4</ref>(b) shows that sample 1 is mispredicted. Hence, DR assumes one misprediction out of a single attempt, i.e., 0%. After correctly predicting sample 2, the DR is updated with one correct prediction out of two attempts, i.e., 50%. Finally, after receiving all samples, the overall DR is found to be 14 correct predictions of 15 predictions, i.e., 93.33%. Accordingly, the DR can be expressed as follows:  </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>III. MODULE IMPLEMENTATION</head><p>The receiver module depicted in Fig. <ref type="figure">1(b</ref>) is adopted in a Clover 4.2 open-source drone from COEX, as featured in Fig. <ref type="figure">5</ref>. This drone is equipped with Raspberry Pi 4 that facilitates 64-bit ARM Cortex-A72 quad-core CPU @ 1.5 GHz processor and 1 GB of memory <ref type="bibr">[30]</ref>. This processor is interfaced with HackRF One SDR via micro-USB cable for receiving the radio frequency transmissions at 2.4 GHz (i.e., drone operating frequency). Once these transmissions are captured, two Python-based subroutines are executed: Feature_Extraction.py for extracting the eight above-mentioned features and Jamming_Classification.py for exploiting these features for running, in real-time, a five-class ML classifier for detecting jamming presence and specifying its type.</p><p>Prior implementing the module, the training and validation of the RF classifier are repeated using the Raspberry processor to calculate the detection/classification time and to establish a comparison between the computer and Raspberry processors considering DR, F-score (FS), and false-alarm rate (FAR). The calculations of these evaluation metrics are performed as follows:</p><p>False Positive Samples FAR False Positive+True Negative Samples  In (2), the "Precision" is defined as the number of positive samples predicted as positive (i.e., true positive) divided by the sum of true positive and negative samples predicted as positive (i.e., false positive). Also, the "Recall" is the number of true positive samples divided by the sum of true positive and positive samples predicted as negative (i.e., false negative). F-score is computed from the Precision and Recall to represent their harmonic mean. Finally, the FAR is the number of false positive samples divided by the sum of false positive and true negative samples predicted by the classifier. Table <ref type="table">II</ref> illustrates that the validation accuracy (VA) and DR of the developed classifier are higher than 92% for both processors. In addition, the testing time with the use of the Raspberry processor is 10.64 seconds. Since this testing time results from classifying nearly 7,070 samples (i.e., 30% of the overall dataset), the average processing time of the five-class RF model to classify a sample is 1.5 ms, enabling real-time jamming detection/classification. Fig. <ref type="figure">6</ref> illustrates the resulting confusion matrices of the classifier after completing the training/testing with the computer and Raspberry Pi processors. Such matrices indicate that none of the jamming attacks are misclassified as No Jamming. Misclassification, however, occurs mostly among barrage and protocol-aware jamming types mainly due to their similar spectral properties. The weighted FARs are computed from these matrices to be 1.33% and 1.10% for the computer and raspberry Pi processors, respectively. Furthermore,   it can be inferred from the confusion matrix in Fig. <ref type="figure">6</ref>(b) that, of the 7,070 testing samples, the resulting DRs of the classifier for C = 0, 1, 2, 3, and 4 are 100%, 83.7%, 95.1%, 99.9%, and 77%, respectively. After validating the classifier using Raspberry, the Python code obtained from the overall GNURadio receiver module is built in the drone as described in Fig. <ref type="figure">5</ref>. All five scenarios (i.e., no jamming, barrage, single-tone, successive-pulse, protocolaware) are tested while the drone is idling. In these tests, an SDR is used to launch each jamming type considering a 1.5-meter jammer-drone separation to enable the receiver module for capturing and classifying 100 samples per scenario. The DR for all scenarios is calculated and updated as elaborated in Section II and is summarized in Table <ref type="table">III</ref>. The developed module showed 100% accuracy in detecting jamming presence. Also, no misclassification occurs when there is no jamming or when either single-tone or successive-pulse is launched. On the other hand, barrage is misclassified 31% of the time (18% as single-tone, 13% as protocol-aware); whereas protocol-aware is misclassified 40% of the time (33% as barrage, 5% as single-tone, 2% as successivepulse). Such results suggest that the proposed receiver module provides a viable solution for jamming detection and classification.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>V. CONCLUSION</head><p>Real-time jamming detection and classification configuration with applications to UAVs is proposed via the integration of an SDR with on-board Raspberry Pi processor. The SDR is utilized for capturing and forwarding the radio frequency signals to a receiver module hosted in the processor. This module extracts OFDM, energy, and SNR signal features and exploits an ML algorithm for detecting and classifying four jamming types: barrage, single-tone, successive-pulse, and protocol-aware. The resulting configuration yielded in an overall DR and FAR of 93% and 1.10%, respectively. These values are in proximity to their counterparts obtained during the validation of the receiver module. Future work entails testing the developed module while the drone is in operation and implementing jamming mitigation protocols such as path rescheduling and beamforming front-end circuitry.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0"><p>Authorized licensed use limited to: Purdue University Northwest. Downloaded on August 03,2022 at 00:34:17 UTC from IEEE Xplore. Restrictions apply.</p></note>
		</body>
		</text>
</TEI>
