skip to main content

Title: Semi-supervised Constrained Hidden Markov Model Using Multiple Sensors for Remaining Useful Life Prediction and Optimal Predictive Maintenance: for Remaining Useful Life Prediction and Optimal Predictive Maintenance
Remaining Useful Life (RUL) estimation is critical in many engineering systems where proper predictive maintenance is needed to increase a unit's effectiveness and reduce time and cost of repairing. Typically for such systems, multiple sensors are normally used to monitor performance, which create difficulties for system state identification. In this paper, we develop a semi-supervised left-to-right constrained Hidden Markov Model (HMM) model, which is effective in estimating the RUL, while capturing the jumps among states in condition dynamics. In addition, based on the HMM model learned from multiple sensors, we build a Partial Observable Markov Decision Process (POMDP) to demonstrate how such RUL estimation can be effectively used for optimal preventative maintenance decision making. We apply this technique to the NASA Engine degradation data and demonstrate the effectiveness of the proposed method.  more » « less
Award ID(s):
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Annual Conference of the PHM Society
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Wang, Dong (Ed.)
    Lithium-ion batteries have been extensively used to power portable electronics, electric vehicles, and unmanned aerial vehicles over the past decade. Aging decreases the capacity of Lithium-ion batteries. Therefore, accurate remaining useful life (RUL) prediction is critical to the reliability, safety, and efficiency of the Lithium-ion battery-powered systems. However, battery aging is a complex electrochemical process affected by internal aging mechanisms and operating conditions (e.g., cycle time, environmental temperature, and loading condition). In this paper, a physics-informed machine learning method is proposed to model the degradation trend and predict the RUL of Lithium-ion batteries while accounting for battery health and operating conditions. The proposed physics-informed long short-term memory (PI-LSTM) model combines a physics-based calendar and cycle aging (CCA) model with an LSTM layer. The CCA model measures the aging effect of Lithium-ion batteries by combining five operating stress factor models. The PI-LSTM uses an LSTM layer to learn the relationship between the degradation trend determined by the CCA model and the online monitoring data of different cycles (i.e., voltage, current, and cell temperature). After the degradation pattern of a battery is estimated by the PI-LSTM model, another LSTM model is then used to predict the future degradation and remaining useful life (RUL) of the battery by learning the degradation trend estimated by the PI-LSTM model. Monitoring data of eleven Lithium-ion batteries under different operating conditions was used to demonstrate the proposed method. Experimental results have shown that the proposed method can accurately model the degradation behavior as well as predict the RUL of Lithium-ion batteries under different operating conditions. 
    more » « less
  2. Rotating machines, such as pumps and compressors, are critical components in refineries and chemical plants used to transport fluids between processing units. Bearings are often the critical parts of rotating machinery, and their failure could result in economic loss and/or safety issues. Therefore, estimation of the remaining useful life (RUL) of a bearing plays an important role in reducing production losses and avoiding machine damage. Because bearing failure mechanisms tend to be complex and stochastic, data-driven RUL estimation approaches have found more applications. This work proposes a novel RUL estimation method based on systematic feature engineering and extreme learning machine (ELM). The PRONOSTIA dataset is used to demonstrate the effectiveness of the proposed method. 
    more » « less
  3. Ellis, K ; Ferrell, W. ; Knapp, J. (Ed.)
    Failure identification and prediction in a power system are essential components that are prerequisites for optimizing the maintenance of the system. The incidences of power system failures have increased dramatically in recent times due to the uncertainties inherent in the advent of both man-made and natural disasters. This problem is further exacerbated due to the increasing demand for higher operational efficiency in power systems. Currently, there is a paucity of studies that predict and identify failure in a distribution power system. In this paper, we propose an integrated methodology for selecting the optimal maintenance plan based on predicting and identifying failure modes with the aid of Hidden Markov Models (HMM) and a probabilistic decision-making tool. While the model parameters of previous studies were determined utilizing observable prior knowledge, the use of HMM offers a different approach especially in the absence of such observable prior distributions. Thus, we determine the status of health of a power system by using an HMM to capture the relationship between unobservable degradation state and observed parameters. The preliminary outcome is instructive for the management of power systems especially in response to fortifying the system against aging and degradation. 
    more » « less
  4. null (Ed.)
    Optimal exploration of engineering systems can be guided by the principle of Value of Information (VoI), which accounts for the topological important of components, their reliability and the management costs. For series systems, in most cases higher inspection priority should be given to unreliable components. For redundant systems such as parallel systems, analysis of one-shot decision problems shows that higher inspection priority should be given to more reliable components. This paper investigates the optimal exploration of redundant systems in long-term decision making with sequential inspection and repairing. When the expected, cumulated, discounted cost is considered, it may become more efficient to give higher inspection priority to less reliable components, in order to preserve system redundancy. To investigate this problem, we develop a Partially Observable Markov Decision Process (POMDP) framework for sequential inspection and maintenance of redundant systems, where the VoI analysis is embedded in the optimal selection of exploratory actions. We investigate the use of alternative approximate POMDP solvers for parallel and more general systems, compare their computation complexities and performance, and show how the inspection priorities depend on the economic discount factor, the degradation rate, the inspection precision, and the repair cost. 
    more » « less
  5. Abstract

    Human intention prediction plays a critical role in human–robot collaboration, as it helps robots improve efficiency and safety by accurately anticipating human intentions and proactively assisting with tasks. While current applications often focus on predicting intent once human action is completed, recognizing human intent in advance has received less attention. This study aims to equip robots with the capability to forecast human intent before completing an action, i.e., early intent prediction. To achieve this objective, we first extract features from human motion trajectories by analyzing changes in human joint distances. These features are then utilized in a Hidden Markov Model (HMM) to determine the state transition times from uncertain intent to certain intent. Second, we propose two models including a Transformer and a Bi-LSTM for classifying motion intentions. Then, we design a human–robot collaboration experiment in which the operator reaches multiple targets while the robot moves continuously following a predetermined path. The data collected through the experiment were divided into two groups: full-length data and partial data before state transitions detected by the HMM. Finally, the effectiveness of the suggested framework for predicting intentions is assessed using two different datasets, particularly in a scenario when motion trajectories are similar but underlying intentions vary. The results indicate that using partial data prior to the motion completion yields better accuracy compared to using full-length data. Specifically, the transformer model exhibits a 2% improvement in accuracy, while the Bi-LSTM model demonstrates a 6% increase in accuracy.

    more » « less