skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Anomaly Detection and Inter-Sensor Transfer Learning on Smart Manufacturing Datasets
Smart manufacturing systems are considered the next generation of manufacturing applications. One important goal of the smart manufacturing system is to rapidly detect and anticipate failures to reduce maintenance cost and minimize machine downtime. This often boils down to detecting anomalies within the sensor data acquired from the system which has different characteristics with respect to the operating point of the environment or machines, such as, the RPM of the motor. In this paper, we analyze four datasets from sensors deployed in manufacturing testbeds. We detect the level of defect for each sensor data leveraging deep learning techniques. We also evaluate the performance of several traditional and ML-based forecasting models for predicting the time series of sensor data. We show that careful selection of training data by aggregating multiple predictive RPM values is beneficial. Then, considering the sparse data from one kind of sensor, we perform transfer learning from a high data rate sensor to perform defect type classification. We release our manufacturing database corpus (4 datasets) and codes for anomaly detection and defect type classification for the community to build on it. Taken together, we show that predictive failure classification can be achieved, paving the way for predictive maintenance.  more » « less
Award ID(s):
2016704
PAR ID:
10495797
Author(s) / Creator(s):
; ; ; ; ; ; ;
Publisher / Repository:
MDPI
Date Published:
Journal Name:
Sensors
Volume:
23
Issue:
1
ISSN:
1424-8220
Page Range / eLocation ID:
486
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The quality of the processed products in CNC machining centers is a critical factor in manufacturing equipment. The anomaly detection and predictive maintenance functions are essential for improving efficiency and reducing time and costs. This study aims to strengthen service competitiveness by reducing quality assurance costs and implementing AI-based predictive maintenance services, as well as establishing a predictive maintenance system for CNC manufacturing equipment. The proposed system integrates preventive maintenance, time-based maintenance, and condition-based maintenance strategies. Using continuous learning based on long short-term memory (LSTM), the system enables anomaly detection, failure prediction, cause analysis, root cause identification, remaining useful life (RUL) prediction, and optimal maintenance timing decisions. In addition, this study focuses on roller-cutting devices that are essential in packaging processes, such as food, pharmaceutical, and cosmetic production. When rolling pins are machining with CNC equipment, a sensor system is installed to collect acoustic data, analyze failure patterns, and apply RUL prediction algorithms. The AI-based predictive maintenance system developed ensures the reliability and operational efficiency of CNC equipment, while also laying the foundation for a smart factory monitoring platform, thus enhancing competitiveness in intelligent manufacturing environments. 
    more » « less
  2. Abstract Monitoring machine health and product quality enables predictive maintenance that optimizes repairs to minimize factory downtime. Data-driven intelligent manufacturing often relies on probabilistic techniques with intractable distributions. For example, generative models of data distributions can balance fault classes with synthetic data, and sampling the posterior distribution of hidden model parameters enables prognosis of degradation trends. Normalizing flows can address these problems while avoiding the training instability or long inference times of other generative Deep Learning (DL) models like Generative Adversarial Networks (GAN), Variational Autoencoders (VAE), and diffusion networks. To evaluate normalizing flows for manufacturing, experiments are conducted to synthesize surface defect images from an imbalanced data set and estimate parameters of a tool wear degradation model from limited observations. Results show that normalizing flows are an effective, multi-purpose DL architecture for solving these problems in manufacturing. Future work should explore normalizing flows for more complex degradation models and develop a framework for likelihood-based anomaly detection. Code is available at https://github.com/uky-aism/flows-for-manufacturing. 
    more » « less
  3. In many modern enterprises, factory managers monitor their machinery and processes to prevent faults and product defects, and maximize the productivity and efficiency. Asset condition, product quality and system productivity monitoring consume some 40-70% of the production costs. Oftentimes, resource constraints have prevented the adoption and implementation of these practices in small businesses. Recent evolution of manufacturing-as-a-service and increased digitalization opens opportunities for small and medium scale companies to adopt smart manufacturing practices, and thereby surmount these constraints. Specifically, sensor wrappers that delineate the specifications of sensor integration into manufacturing machinery, with appropriate edge-cloud computing and communication architecture can provide even small businesses with a real-time data pipeline to monitor their manufacturing machines. However, the data in itself is difficult to interpret locally. Additionally, proprietary standards and products of the various components of a sensor wrapper make it difficult to implement a sensor wrapper schema. In this paper, we report an open-source method to integrate sensors into legacy manufacturing equipment and hardware. We had implemented this pipeline with off-the-shelf sensors to a polisher (from Buehler), a shaft grinding machine (from Micromatic), and a hybrid manufacturing machine (from Optomec), and used hardware and software components such as a National Instruments Data Acquisition (NI-DAQ) module to collect and stream live data. We evaluate the performance of the data pipeline as it connects to the Smart Manufacturing Innovation Platform (SMIP)—web-based data ingestion platform part of the Clean Energy Smart Manufacturing Innovation Institute (CESMII), a U.S. Department of Energy-sponsored initiative—in terms of data volume versus latency tradeoffs. We demonstrate a viable implementation of Smart Manufacturing by creating a vendor-agnostic web dashboard that fuses multiple sensors to perform real-time performance analysis with lossless data integrity. 
    more » « less
  4. Wang, Yan; Yang, Hui (Ed.)
    Abstract The scarcity of measured data for defect identification often challenges the development and certification of additive manufacturing processes. Knowledge transfer and sharing have become emerging solutions to small-data challenges in quality control to improve machine learning with limited data, but this strategy raises concerns regarding privacy protection. Existing zero-shot learning and federated learning methods are insufficient to represent, select, and mask data to share and control privacy loss quantification. This study integrates differential privacy in cybersecurity with federated learning to investigate sharing strategies of manufacturing defect ontology. The method first proposes using multilevel attributes masked by noise in defect ontology as the sharing data structure to characterize manufacturing defects. Information leaks due to the sharing of ontology branches and data are estimated by epsilon differential privacy (DP). Under federated learning, the proposed method optimizes sharing defect ontology and image data strategies to improve zero-shot defect classification given privacy budget limits. The proposed framework includes (1) developing a sharing strategy based on multilevel attributes in defect ontology with controllable privacy leaks, (2) optimizing joint decisions in differential privacy, zero-shot defect classification, and federated learning, and (3) developing a two-stage algorithm to solve the joint optimization, combining stochastic gradient descent search for classification models and an evolutionary algorithm for exploring data-sharing strategies. A case study on zero-shot learning of additive manufacturing defects demonstrated the effectiveness of the proposed method in data-sharing strategies, such as ontology sharing, defect classification, and cloud information use. 
    more » « less
  5. The application of cutting-edge technologies such as AI, smart sensors, and IoT in factories is revolutionizing the manufacturing industry. This emerging trend, so called smart manufacturing, is a collection of various technologies that support decision-making in real-time in the presence of changing conditions in manufacturing activities; this may advance manufacturing competitiveness and sustainability. As a factory becomes highly automated, physical asset management comes to be a critical part of an operational life-cycle. Maintenance is one area where the collection of technologies may be applied to enhance operational reliability using a machine condition monitoring system. Data-driven models have been extensively applied to machine condition data to build a fault detection system. Most existing studies on fault detection were developed under a fixed set of operating conditions and tested with data obtained from that set of conditions. Therefore, variability in a model’s performance from data obtained from different operating settings is not well reported. There have been limited studies considering changing operational conditions in a data-driven model. For practical applications, a model must identify a targeted fault under variable operational conditions. With this in mind, the goal of this paper is to study invariance of model to changing speed via a deep learning method, which can detect a mechanical imbalance, i.e., targeted fault, under varying speed settings. To study the speed invariance, experimental data obtained from a motor test-bed are processed, and time-series data and time–frequency data are applied to long short-term memory and convolutional neural network, respectively, to evaluate their performance. 
    more » « less