skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Morphological Dynamics-Based Anomaly Detection Towards In Situ Layer-Wise Certification for Directed Energy Deposition Processes
Title: Morphological Dynamics-Based Anomaly Detection Towards In Situ Layer-Wise Certification for Directed Energy Deposition Processes
Abstract The process uncertainty induced quality issue remains the major challenge that hinders the wider adoption of additive manufacturing (AM) technology. The defects occurred significantly compromise structural integrity and mechanical properties of fabricated parts. Therefore, there is an urgent need in fast, yet reliable AM component certification. Most finite element analysis related methods characterize defects based on the thermomechanical relationships, which are computationally inefficient and cannot capture process uncertainty. In addition, there is a growing trend in data-driven approaches on characterizing the empirical relationships between thermal history and anomaly occurrences, which focus on modeling an individual image basis to identify local defects. Despite their effectiveness in local anomaly detection, these methods are quite cumbersome when applied to layer-wise anomaly detection. This paper proposes a novel in situ layer-wise anomaly detection method by analyzing the layer-by-layer morphological dynamics of melt pools and heat affected zones (HAZs). Specifically, the thermal images are first preprocessed based on the g-code to assure unified orientation. Subsequently, the melt pool and HAZ are segmented, and the global and morphological transition metrics are developed to characterize the morphological dynamics. New layer-wise features are extracted, and supervised machine learning methods are applied for layer-wise anomaly detection. The proposed method is validated using the directed energy deposition (DED) process, which demonstrates superior performance comparing with the benchmark methods. The average computational time is significantly shorter than the average build time, enabling in situ layer-wise certification and real-time process control.  more » « less
Award ID(s):
2046515
PAR ID:
10399062
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Journal of Manufacturing Science and Engineering
Volume:
144
Issue:
11
ISSN:
1087-1357
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; (, Journal of Manufacturing Science and Engineering)
    null (Ed.)
    Abstract Laser-based additive manufacturing (LBAM) provides unrivalled design freedom with the ability to manufacture complicated parts for a wide range of engineering applications. Melt pool is one of the most important signatures in LBAM and is indicative of process anomalies and part defects. High-speed thermal images of the melt pool captured during LBAM make it possible for in situ melt pool monitoring and porosity prediction. This paper aims to broaden current knowledge of the underlying relationship between process and porosity in LBAM and provide new possibilities for efficient and accurate porosity prediction. We present a deep learning-based data fusion method to predict porosity in LBAM parts by leveraging the measured melt pool thermal history and two newly created deep learning neural networks. A PyroNet, based on Convolutional Neural Networks, is developed to correlate in-process pyrometry images with layer-wise porosity; an IRNet, based on Long-term Recurrent Convolutional Networks, is developed to correlate sequential thermal images from an infrared camera with layer-wise porosity. Predictions from PyroNet and IRNet are fused at the decision-level to obtain a more accurate prediction of layer-wise porosity. The model fidelity is validated with LBAM Ti–6Al–4V thin-wall structure. This is the first work that manages to fuse pyrometer data and infrared camera data for metal additive manufacturing (AM). The case study results based on benchmark datasets show that our method can achieve high accuracy with relatively high efficiency, demonstrating the applicability of the method for in situ porosity detection in LBAM. 
    more » « less
  2. ; ; ; (, Journal of Computational Design and Engineering)
    Abstract Wire arc additive manufacturing (WAAM) has gained attention as a feasible process in large-scale metal additive manufacturing due to its high deposition rate, cost efficiency, and material diversity. However, WAAM induces a degree of uncertainty in the process stability and the part quality owing to its non-equilibrium thermal cycles and layer-by-layer stacking mechanism. Anomaly detection is therefore necessary for the quality monitoring of the parts. Most relevant studies have applied machine learning to derive data-driven models that detect defects through feature and pattern learning. However, acquiring sufficient data is time- and/or resource-intensive, which introduces a challenge to applying machine learning-based anomaly detection. This study proposes a multisource transfer learning method that generates anomaly detection models for balling defect detection, thus ensuring quality monitoring in WAAM. The proposed method uses convolutional neural network models to extract sufficient image features from multisource materials, then transfers and fine-tunes the models for anomaly detection in the target material. Stepwise learning is applied to extract image features sequentially from individual source materials, and composite learning is employed to assign the optimal frozen ratio for converging transferred and present features. Experiments were performed using a gas tungsten arc welding-based WAAM process to validate the classification accuracy of the models using low-carbon steel, stainless steel, and Inconel. 
    more » « less
  3. ; ; (, Journal of Manufacturing Systems)
    Manufacturing process signatures reflect the process stability and anomalies that potentially lead to detrimental effects on the manufactured outcomes. Sensing technologies, especially in-situ image sensors, are widely used to capture process signatures for diagnostics and prognostics. This imaging data is crucial evidence for process signature characterization and monitoring. A critical aspect of process signature analysis is identifying the unique patterns in an image that differ from the generic behavior of the manufacturing process in order to detect anomalies. It is equivalent to separating the “unique features” and process-wise (or phase-wise) “shared features” from the same image and recognizing the transient anomaly, i.e., recognizing the outlier “unique features”. In state-of-the-art literature, image-based process signature analysis relies on conventional feature extraction procedures, which limit the “view” of information to each image and cannot decouple the shared and unique features. Consequently, the features extracted are less interpretable, and the anomaly detection method cannot distinguish the abnormality in the current process signature from the process-wise evolution. Targeting this limitation, this study proposes personalized feature extraction (PFE) to decouple process-wise shared features and transient unique features from a sensor image and further develops process signature characterization and anomaly detection strategies. The PFE algorithm is designed for heterogeneous data with shared features. Supervised and unsupervised anomaly detection strategies are developed upon PFE features to remove the shared features from a process signature and examine the unique features for abnormality. The proposed method is demonstrated on two datasets (i) selected data from the 2018 AM Benchmark Test Series from the National Institute of Standards and Technology (NIST), and (ii) thermal measurements in additive manufacturing of a thin-walled structure of Ti–6Al–4V. The results highlight the power of personalized modeling in extracting features from manufacturing imaging data. 
    more » « less
  4. ; ; ; ; (, Frontiers in Manufacturing Technology)
    This study presents an overview and a few case studies to explicate the transformative power of diverse imaging techniques for smart manufacturing, focusing largely on variousin-situandex-situimaging methods for monitoring fusion-based metal additive manufacturing (AM) processes such as directed energy deposition (DED), selective laser melting (SLM), electron beam melting (EBM).In-situimaging techniques, encompassing high-speed cameras, thermal cameras, and digital cameras, are becoming increasingly affordable, complementary, and are emerging as vital for real-time monitoring, enabling continuous assessment of build quality. For example, high-speed cameras capture dynamic laser-material interaction, swiftly detecting defects, while thermal cameras identify thermal distribution of the melt pool and potential anomalies. The data gathered fromin-situimaging are then utilized to extract pertinent features that facilitate effective control of process parameters, thereby optimizing the AM processes and minimizing defects. On the other hand,ex-situimaging techniques play a critical role in comprehensive component analysis. Scanning electron microscopy (SEM), optical microscopy, and 3D-profilometry enable detailed characterization of microstructural features, surface roughness, porosity, and dimensional accuracy. Employing a battery of Artificial Intelligence (AI) algorithms, information from diverse imaging and other multi-modal data sources can be fused, and thereby achieve a more comprehensive understanding of a manufacturing process. This integration enables informed decision-making for process optimization and quality assurance, as AI algorithms analyze the combined data to extract relevant insights and patterns. Ultimately, the power of imaging in additive manufacturing lies in its ability to deliver real-time monitoring, precise control, and comprehensive analysis, empowering manufacturers to achieve supreme levels of precision, reliability, and productivity in the production of components. 
    more » « less
  5. ; ; ; (, Rapid Prototyping Journal)
    PurposeThe purpose of this study is to develop a deep learning framework for additive manufacturing (AM), that can detect different defect types without being trained on specific defect data sets and can be applied for real-time process control. Design/methodology/approachThis study develops an explainable artificial intelligence (AI) framework, a zero-bias deep neural network (DNN) model for real-time defect detection during the AM process. In this method, the last dense layer of the DNN is replaced by two consecutive parts, a regular dense layer denoted (L1) for dimensional reduction, and a similarity matching layer (L2) for equal weight and non-biased cosine similarity matching. Grayscale images of 3D printed samples acquired during printing were used as the input to the zero-bias DNN. FindingsThis study demonstrates that the approach is capable of successfully detecting multiple types of defects such as cracks, stringing and warping with high accuracy without any prior training on defective data sets, with an accuracy of 99.5%. Practical implicationsOnce the model is set up, the computational time for anomaly detection is lower than the speed of image acquisition indicating the potential for real-time process control. It can also be used to minimize manual processing in AI-enabled AM. Originality/valueTo the best of the authors’ knowledge, this is the first study to use zero-bias DNN, an explainable AI approach for defect detection in AM. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email