Title: Air traffic controller workload level prediction using conformalized dynamical graph learning
Air traffic control (ATC) is a safety-critical service system that demands constant attention from ground air traffic controllers (ATCos) to maintain daily aviation operations. The workload of the ATCos can have negative effects on operational safety and airspace usage. To avoid overloading and ensure an acceptable workload level for the ATCos, it is important to predict the ATCos’ workload accurately for mitigation actions. In this paper, we first perform a review of research on ATCo workload, mostly from the air traffic perspective. Then, we briefly introduce the setup of the human-in-the-loop (HITL) simulations with retired ATCos, where the air traffic data and workload labels are obtained. The simulations are conducted under three Phoenix approach scenarios while the human ATCos are requested to self-evaluate their workload ratings (i.e., low-1 to high-7). Preliminary data analysis is conducted. Next, we propose a graph-based deep-learning framework with conformal prediction to identify the ATCo workload levels. The number of aircraft under the controller’s control varies both spatially and temporally, resulting in dynamically evolving graphs. The experiment results suggest that (a) besides the traffic density feature, the traffic conflict feature contributes to the workload prediction capabilities (i.e., minimum horizontal/vertical separation distance); (b) directly learning from the spatiotemporal graph layout of airspace with graph neural network can achieve higher prediction accuracy, compare to hand-crafted traffic complexity features; (c) conformal prediction is a valuable tool to further boost model prediction accuracy, resulting a range of predicted workload labels. The code used is available at Link. more »« less
The current National Airspace System (NAS) is reaching capacity due to increased air traffic, and is based on outdated pre-tactical planning. This study proposes a more dynamic airspace configuration (DAC) approach that could increase throughput and accommodate fluctuating traffic, ideal for emergencies. The proposed approach constructs the airspace as a constraints-embedded graph, compresses its dimensions, and applies a spectral clustering-enabled adaptive algorithm to generate collaborative airport groups and evenly distribute workloads among them. Under various traffic conditions, our experiments demonstrate a 50% reduction in workload imbalances. This research could ultimately form the basis for a recommendation system for optimized airspace configuration. Code available at https://github.com/KeFenge2022/GraphDAC.git
Deniz, Meryem; Zhao, Lu; Wan, Yan; Lewis, Frank L
(, Unmanned Systems)
Safety and efficiency are primary goals of air traffic management. With the integration of unmanned aerial vehicles (UAVs) into the airspace, UAV traffic management (UTM) has attracted significant interest in the research community to maintain the capacity of three-dimensional (3D) airspace, provide information, and avoid collisions. We propose a new decision-making architecture for UAVs to avoid collision by formulating the problem into a multi-agent game in a 3D airspace. In the proposed game-theoretic approach, the Ego UAV plays a repeated two-player normal-form game, and the payoff functions are designed to capture both the safety and efficiency of feasible actions. An optimal decision in the form of Nash equilibrium (NE) is obtained. Simulation studies are conducted to demonstrate the performance of the proposed game-theoretic collision avoidance approach in several representative multi-UAV scenarios.
The Automatic Dependent Surveillance Broadcast (ADS-B) system is a critical communication and surveillance technology used in the Next Generation (NextGen) project as it improves the accuracy and efficiency of air navigation. These systems allow air traffic controllers to have more precise and real-time information on the location and movement of aircraft, leading to increased safety and improved efficiency in the airspace. While ADS-B has been made mandatory for all aircraft in the Federal Aviation Administration (FAA) monitored airspace, its lack of security measures leaves it vulnerable to cybersecurity threats. Particularly, ADS-B signals are susceptible to false data injection attacks due to the lack of authentication and integrity measures, which poses a serious threat to the safety of the National Airspace System (NAS). Many studies have attempted to address these vulnerabilities; however, machine learning and deep learning approaches have gained significant interest due to their ability to enhance security without modifying the existing infrastructure. This paper investigates the use of Recurrent Neural Networks for detecting injection attacks in ADS-B data, leveraging the time-dependent nature of the data. The paper reviews previous studies that used different machine learning and deep learning techniques and presents the potential benefits of using RNN algorithms to improve ADS-B security.
Advanced air mobility (AAM) has introduced a new mode of air transportation that can be integrated, providing services including air taxis, which can quickly transport people and cargo from one place to another. However, urban airspace is already congested with commercial air traffic, so there is a need for an efficient and autonomous airspace management system. Establishing structured air corridors and enabling UAS-to-UAS (U2U) communications are essential to achieve autonomy. Air corridors are designated airspace primarily reserved for AAM traffic, which will streamline the movement of unmanned aircraft systems (UAS). Meanwhile, U2U communications facilitate efficient collision avoidance strategies (CAS). A key aspect of this system is the development of CAS, which requires advanced communication protocols to monitor traffic patterns and detect potential collisions. This paper explores designing and implementing CAS using U2U communications. Use cases for U2U communications include merging, minimum separation, information relay, collaborative sensing, and rerouting. All these use cases demand real-time solutions for managing traffic conflicts involving multiple UAS. The CAS discussed in this paper utilizes U2U communications to mitigate the risk of collisions in the airspace and demonstrates how U2U communications can assist in efficient AAM traffic management through simulations.
Jeyakumar, Jeya_Vikranth; Sarker, Ankur; Garcia, Luis_Antonio; Srivastava, Mani
(, Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies)
End-to-end deep learning models are increasingly applied to safety-critical human activity recognition (HAR) applications, e.g., healthcare monitoring and smart home control, to reduce developer burden and increase the performance and robustness of prediction models. However, integrating HAR models in safety-critical applications requires trust, and recent approaches have aimed to balance the performance of deep learning models with explainable decision-making for complex activity recognition. Prior works have exploited the compositionality of complex HAR (i.e., higher-level activities composed of lower-level activities) to form models with symbolic interfaces, such as concept-bottleneck architectures, that facilitate inherently interpretable models. However, feature engineering for symbolic concepts-as well as the relationship between the concepts-requires precise annotation of lower-level activities by domain experts, usually with fixed time windows, all of which induce a heavy and error-prone workload on the domain expert. In this paper, we introduce X-CHAR, an eXplainable Complex Human Activity Recognition model that doesn't require precise annotation of low-level activities, offers explanations in the form of human-understandable, high-level concepts, while maintaining the robust performance of end-to-end deep learning models for time series data. X-CHAR learns to model complex activity recognition in the form of a sequence of concepts. For each classification, X-CHAR outputs a sequence of concepts and a counterfactual example as the explanation. We show that the sequence information of the concepts can be modeled using Connectionist Temporal Classification (CTC) loss without having accurate start and end times of low-level annotations in the training dataset-significantly reducing developer burden. We evaluate our model on several complex activity datasets and demonstrate that our model offers explanations without compromising the prediction accuracy in comparison to baseline models. Finally, we conducted a mechanical Turk study to show that the explanations provided by our model are more understandable than the explanations from existing methods for complex activity recognition.
@article{osti_10514497,
place = {Country unknown/Code not available},
title = {Air traffic controller workload level prediction using conformalized dynamical graph learning},
url = {https://par.nsf.gov/biblio/10514497},
DOI = {10.1016/j.aei.2023.102113},
abstractNote = {Air traffic control (ATC) is a safety-critical service system that demands constant attention from ground air traffic controllers (ATCos) to maintain daily aviation operations. The workload of the ATCos can have negative effects on operational safety and airspace usage. To avoid overloading and ensure an acceptable workload level for the ATCos, it is important to predict the ATCos’ workload accurately for mitigation actions. In this paper, we first perform a review of research on ATCo workload, mostly from the air traffic perspective. Then, we briefly introduce the setup of the human-in-the-loop (HITL) simulations with retired ATCos, where the air traffic data and workload labels are obtained. The simulations are conducted under three Phoenix approach scenarios while the human ATCos are requested to self-evaluate their workload ratings (i.e., low-1 to high-7). Preliminary data analysis is conducted. Next, we propose a graph-based deep-learning framework with conformal prediction to identify the ATCo workload levels. The number of aircraft under the controller’s control varies both spatially and temporally, resulting in dynamically evolving graphs. The experiment results suggest that (a) besides the traffic density feature, the traffic conflict feature contributes to the workload prediction capabilities (i.e., minimum horizontal/vertical separation distance); (b) directly learning from the spatiotemporal graph layout of airspace with graph neural network can achieve higher prediction accuracy, compare to hand-crafted traffic complexity features; (c) conformal prediction is a valuable tool to further boost model prediction accuracy, resulting a range of predicted workload labels. The code used is available at Link.},
journal = {Advanced Engineering Informatics},
volume = {57},
number = {C},
publisher = {Elsevier},
author = {Pang, Yutian and Hu, Jueming and Lieber, Christopher S and Cooke, Nancy J and Liu, Yongming},
}
Warning: Leaving National Science Foundation Website
You are now leaving the National Science Foundation website to go to a non-government website.
Website:
NSF takes no responsibility for and exercises no control over the views expressed or the accuracy of
the information contained on this site. Also be aware that NSF's privacy policy does not apply to this site.