skip to main content
Explore Scholarly Publications and Datasets in the NSF-PAR

  • NSF Public Access
  • Search Results
  • Accepted Manuscript: Deep Learning-Based Data Fusion Method for In Situ Porosity Detection in Laser-Based Additive Manufacturing
Title: Deep Learning-Based Data Fusion Method for In Situ Porosity Detection in Laser-Based Additive Manufacturing
Abstract Laser-based additive manufacturing (LBAM) provides unrivalled design freedom with the ability to manufacture complicated parts for a wide range of engineering applications. Melt pool is one of the most important signatures in LBAM and is indicative of process anomalies and part defects. High-speed thermal images of the melt pool captured during LBAM make it possible for in situ melt pool monitoring and porosity prediction. This paper aims to broaden current knowledge of the underlying relationship between process and porosity in LBAM and provide new possibilities for efficient and accurate porosity prediction. We present a deep learning-based data fusion method to predict porosity in LBAM parts by leveraging the measured melt pool thermal history and two newly created deep learning neural networks. A PyroNet, based on Convolutional Neural Networks, is developed to correlate in-process pyrometry images with layer-wise porosity; an IRNet, based on Long-term Recurrent Convolutional Networks, is developed to correlate sequential thermal images from an infrared camera with layer-wise porosity. Predictions from PyroNet and IRNet are fused at the decision-level to obtain a more accurate prediction of layer-wise porosity. The model fidelity is validated with LBAM Ti–6Al–4V thin-wall structure. This is the first work that manages to fuse pyrometer more » data and infrared camera data for metal additive manufacturing (AM). The case study results based on benchmark datasets show that our method can achieve high accuracy with relatively high efficiency, demonstrating the applicability of the method for in situ porosity detection in LBAM. « less
Authors:
; ; ; ;
Award ID(s):
1852215
Publication Date:
NSF-PAR ID:
10217479
Journal Name:
Journal of Manufacturing Science and Engineering
Volume:
143
Issue:
4
ISSN:
1087-1357
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ( , IISE Transactions)
    The goal of this work to mitigate flaws in metal parts produced from laser powder bed fusion (LPBF) additive manufacturing (AM) process. As a step towards this goal, the objective of this work is to predict the build quality of a part as it is being printed via deep learning of in-situ layer-wise images obtained from an optical camera instrumented in the LPBF machine. To realize this objective, we designed a set of thin-wall features (fins) from Titanium alloy (Ti-6Al-4V) material with varying length-to-thickness ratio. These thin-wall test parts were printed under three different build orientations and in-situ images of their top surface were acquired during the process. The parts were examined offline using X-ray computed tomography (XCT), and their build quality was quantified in terms of statistical features, such as the thickness and consistency of its edges. Subsequently, a deep learning convolutional neural network (CNN) was trained to predict the XCT-derived statistical quality features using the layer-wise optical images of the thin-wall part as inputs. The statistical correlation between CNN-based predictions and XCT-observed quality measurements exceeds 85%. This work has two outcomes consequential to the sustainability of additive manufacturing: (1) It provides practitioners with a guideline for building thin-wallmore »features with minimal defects, and (2) the high correlation between the offline XCT measurements and in-situ sensor-based quality metrics substantiates the potential for applying deep learning approaches for the real-time prediction of build flaws in LPBF.« less
  2. ; ; ; ( , Journal of Manufacturing Science and Engineering)
    Abstract The process uncertainty induced quality issue remains the major challenge that hinders the wider adoption of additive manufacturing (AM) technology. The defects occurred significantly compromise structural integrity and mechanical properties of fabricated parts. Therefore, there is an urgent need in fast, yet reliable AM component certification. Most finite element analysis related methods characterize defects based on the thermomechanical relationships, which are computationally inefficient and cannot capture process uncertainty. In addition, there is a growing trend in data-driven approaches on characterizing the empirical relationships between thermal history and anomaly occurrences, which focus on modeling an individual image basis to identify local defects. Despite their effectiveness in local anomaly detection, these methods are quite cumbersome when applied to layer-wise anomaly detection. This paper proposes a novel in situ layer-wise anomaly detection method by analyzing the layer-by-layer morphological dynamics of melt pools and heat affected zones (HAZs). Specifically, the thermal images are first preprocessed based on the g-code to assure unified orientation. Subsequently, the melt pool and HAZ are segmented, and the global and morphological transition metrics are developed to characterize the morphological dynamics. New layer-wise features are extracted, and supervised machine learning methods are applied for layer-wise anomaly detection. The proposedmore »method is validated using the directed energy deposition (DED) process, which demonstrates superior performance comparing with the benchmark methods. The average computational time is significantly shorter than the average build time, enabling in situ layer-wise certification and real-time process control.« less
  3. ; ; ; ; ; ; ; ( , Additive manufacturing)
    Despite its potential to overcome the design and processing barriers of traditional subtractive and formative manufacturing techniques, the use of laser powder bed fusion (LPBF) metal additive manufacturing is currently limited due to its tendency to create flaws. A multitude of LPBF-related flaws, such as part-level deformation, cracking, and porosity are linked to the spatiotemporal temperature distribution in the part during the process. The temperature distribution, also called the thermal history, is a function of several factors encompassing material properties, part geometry and orientation, processing parameters, placement of supports, among others. These broad range of factors are difficult and expensive to optimize through empirical testing alone. Consequently, fast and accurate models to predict the thermal history are valuable for mitigating flaw formation in LPBF-processed parts. In our prior works, we developed a graph theory-based approach for predicting the temperature distribution in LPBF parts. This mesh-free approach was compared with both non-proprietary and commercial finite element packages, and the thermal history predictions were experimentally validated with in- situ infrared thermal imaging data. It was found that the graph theory-derived thermal history predictions converged within 30–50% of the time of non-proprietary finite element analysis for a similar level of prediction error. However,more »these prior efforts were based on small prismatic and cylinder-shaped LPBF parts. In this paper, our objective was to scale the graph theory approach to predict the thermal history of large volume, complex geometry LPBF parts. To realize this objective, we developed and applied three computational strategies to predict the thermal history of a stainless steel (SAE 316L) impeller having outside diameter 155 mm and vertical height 35 mm (700 layers). The impeller was processed on a Renishaw AM250 LPBF system and required 16 h to complete. During the process, in-situ layer-by-layer steady state surface temperature measurements for the impeller were obtained using a calibrated longwave infrared thermal camera. As an example of the outcome, on implementing one of the three strategies reported in this work, which did not reduce or simplify the part geometry, the thermal history of the impeller was predicted with approximate mean absolute error of 6% (standard deviation 0.8%) and root mean square error 23 K (standard deviation 3.7 K). Moreover, the thermal history was simulated within 40 min using desktop computing, which is considerably less than the 16 h required to build the impeller part. Furthermore, the graph theory thermal history predictions were compared with a proprietary LPBF thermal modeling software and non-proprietary finite element simulation. For a similar level of root mean square error (28 K), the graph theory approach converged in 17 min, vs. 4.5 h for non-proprietary finite element analysis.« less
  4. ; ; ; ; ; ( , npj Computational Materials)
    Abstract In additive manufacturing of metal parts, the ability to accurately predict the extremely variable temperature field in detail, and relate it quantitatively to structure and properties, is a key step in predicting part performance and optimizing process design. In this work, a finite element simulation of the directed energy deposition (DED) process is used to predict the space- and time-dependent temperature field during the multi-layer build process for Inconel 718 walls. The thermal model results show good agreement with dynamic infrared images captured in situ during the DED builds. The relationship between predicted cooling rate, microstructural features, and mechanical properties is examined, and cooling rate alone is found to be insufficient in giving quantitative property predictions. Because machine learning offers an efficient way to identify important features from series data, we apply a 1D convolutional neural network data-driven framework to automatically extract the dominant predictive features from simulated temperature history. Very good predictions of material properties, especially ultimate tensile strength, are obtained using simulated thermal history data. To further interpret the convolutional neural network predictions, we visualize the extracted features produced on each convolutional layer and compare the convolutional neural network detected features of thermal histories for high andmore »low ultimate tensile strength cases. A key result is the determination that thermal histories in both high and moderate temperature regimes affect material properties.« less
  5. ; ; ; ; ( , ASME Manufacturing Science and Engineering Conference)
    Abstract

    The objective of this work is to provide experimental validation of the graph theory approach for predicting the thermal history in additively manufactured parts that was recently published in the ASME transactions. In the present paper the graph theory approach is validated with in-situ infrared thermography data in the context of the laser powder bed fusion (LPBF) additive manufacturing process. We realize this objective through the following three tasks. First, two types of test parts (stainless steel) are made in two corresponding build cycles on a Renishaw AM250 LPBF machine. The intent of both builds is to influence the thermal history of the part by changing the cooling time between melting of successive layers, called interlayer cooling time. Second, layer-wise thermal images of the top surface of the part are acquired using an in-situ a priori calibrated infrared camera. Third, the thermal imaging data obtained during the two builds were used to validate the graph theory-predicted surface temperature trends. Furthermore, the surface temperature trends predicted using graph theory are compared with results from finite element analysis. As an example, for one the builds, the graph theory approach accurately predicted the surface temperature trends to within 6% mean absolute percentagemore »error, and approximately 14 Kelvin root mean squared error of the experimental data. Moreover, using the graph theory approach the temperature trends were predicted in less than 26 minutes which is well within the actual build time of 171 minutes.

    « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email