More Like this

1. Change Point Models for Real-time V2I Cyber Attack Detection in a Connected Vehicle Environment

   Comert, G. (January 2019, Transportation Research Board Annual Meeting 2019)

   Connected vehicle (CV) systems are cognizant of potential cyber attacks because of increasing connectivity between its different components such as vehicles, roadside infrastructure and traffic management centers. However, it is a challenge to detect security threats in real-time and develop appropriate/effective countermeasures for a CV system because of the dynamic behavior of such attacks, high computational power requirement and a historical data requirement for training detection models. To address these challenges, statistical models, especially change point models, have potentials for real-time anomaly detections. Thus, the objective of this study is to investigate the efficacy of two change point models, Expectation Maximization (EM) and two forms of Cumulative Summation (CUSUM) algorithms (i.e., typical and adaptive), for real-time V2I cyber attack detection in a CV Environment. To prove the efficacy of these models, we evaluated these two models for three different type of cyber attack, denial of service (DOS), impersonation, and false information, using basic safety messages (BSMs) generated from CVs through simulation. Results from numerical analysis revealed that EM, CUSUM, and adaptive CUSUM could detect these cyber attacks, DOS, impersonation, and false information, with an accuracy of (99\%, 100\%, 100\%), (98\%, 100\%, 100\%), and (100\%, 98\%, 100\%) respectively. 

   more » « less
2. Online Health Monitoring of Electronic Components Subjected to Repeated High-Energy Shock

   https://doi.org/10.1115/smasis2024-139950  

   Satme, Joud N; Coble, Daniel; Downey, Austin_R J (September 2024, American Society of Mechanical Engineers)

   Abstract Electronic components that undergo shock and vibration are susceptible to failure caused by damage in the base printed circuit board that makes up the substrate of these systems. In certain applications, it may become paramount to know in real-time if the electronic components are damaged to enable a next-generation active system to take immediate responses. Broad examples of such systems include blast mitigation systems or safety systems in car accidents. These systems on classified under the term “high-rate” as they experience high shock levels on short time scales. This work proposes a long short-term memory neural network to enable real-time damage detection and assessment of electronic assemblies subjected to shock. The long short-term memory neural network is able to infer the state of the structure in approximately 4 milliseconds following the impact. The model obtains perfect classification results at 4 milliseconds for the data used in this work. This work is supported by experimentation that indicates damage to electronic packages can be quantified through the in situ monitoring of the impedance of electrical connections. Changes in impedance correlate to alterations in the physical properties of electronic components which indicate the occurrence of damage. On this basis, a comprehensive dataset is created to monitor the impedance changes of a daisy-chained connection through repeated high-energy shocks. Meanwhile, the shock response of the electronic components is captured using an accelerometer, enabling a detailed analysis of the effects of high-rate shock on the components’ performance. A dataset is developed to encompass 30 repeated impacts experiencing 10,000 gn during impact with an average half-sine time of 322 microseconds. The paper outlines the proposed real-time machine learning framework while performance metrics are presented and discussed in detail. 

   more » « less
3. A Generalized Apprenticeship Learning Framework for Modeling Heterogeneous Student Pedagogical Strategies

   Islam, M_M; Yang, X; Hostetter, J_W; Saha, A_S; Chi, M (July 2024, Proceedings of the 17th International Conference on Educational Data Mining / International Educational Data Mining Society)

   Introduces EM‑EDM, an AL framework using expectation‑maximization to model heterogeneous student pedagogical strategies across large continuous state spaces. EM‑EDM outperforms four AL baselines and two DRL policies on two pedagogical action prediction tasks. 

   more » « less
4. A Generalized Apprenticeship Learning Framework for Modeling Heterogeneous Student Pedagogical Strategies

   Islam, M M; Yang, X; Hostetter, J W; Saha, A S; Chi, M (July 2024, EDM)

   A key challenge in e-learning environments like Intelligent Tutoring Systems (ITSs) is to induce effective pedagogical policies efficiently. While Deep Reinforcement Learning (DRL) often suffers from \textbf{\emph{sample inefficiency}} and \textbf{\emph{reward function}} design difficulty, Apprenticeship Learning (AL) algorithms can overcome them. However, most AL algorithms can not handle heterogeneity as they assume all demonstrations are generated with a homogeneous policy driven by a single reward function. Still, some AL algorithms which consider heterogeneity, often can not generalize to large continuous state space and only work with discrete states. In this paper, we propose an expectation-maximization(EM)-EDM, a general AL framework to induce effective pedagogical policies from given optimal or near-optimal demonstrations, which are assumed to be driven by heterogeneous reward functions. We compare the effectiveness of the policies induced by our proposed EM-EDM against four AL-based baselines and two policies induced by DRL on two different but related tasks that involve pedagogical action prediction. Our overall results showed that, for both tasks, EM-EDM outperforms the four AL baselines across all performance metrics and the two DRL baselines. This suggests that EM-EDM can effectively model complex student pedagogical decision-making processes through the ability to manage a large, continuous state space and adapt to handle diverse and heterogeneous reward functions with very few given demonstrations. 

   more » « less
5. Learning Stochastic Dynamical Systems via Bridge Sampling

   https://doi.org/10.1007/978-3-030-39098-3_14  

   Bhat, Harish S; Rawat, Shagun (January 2020, Advanced Analytics and Learning on Temporal Data. AALTD 2019. Lecture Notes in Computer Science)

   We develop algorithms to automate discovery of stochastic dynamical system models from noisy, vector-valued time series. By discovery, we mean learning both a nonlinear drift vector field and a diagonal diffusion matrix for an Itô stochastic differential equation in Rd . We parameterize the vector field using tensor products of Hermite polynomials, enabling the model to capture highly nonlinear and/or coupled dynamics. We solve the resulting estimation problem using expectation maximization (EM). This involves two steps. We augment the data via diffusion bridge sampling, with the goal of producing time series observed at a higher frequency than the original data. With this augmented data, the resulting expected log likelihood maximization problem reduces to a least squares problem. We provide an open-source implementation of this algorithm. Through experiments on systems with dimensions one through eight, we show that this EM approach enables accurate estimation for multiple time series with possibly irregular observation times. We study how the EM method performs as a function of the amount of data augmentation, as well as the volume and noisiness of the data. 

   more » « less