skip to main content

Explore Research Products in the NSF-PAR

  • NSF Public Access
  • Search Results
  • A Physics-Informed Convolutional Neural Network with Custom Loss Functions for Porosity Prediction in Laser Metal Deposition
Title: A Physics-Informed Convolutional Neural Network with Custom Loss Functions for Porosity Prediction in Laser Metal Deposition
Physics-informed machine learning is emerging through vast methodologies and in various applications. This paper discovers physics-based custom loss functions as an implementable solution to additive manufacturing (AM). Specifically, laser metal deposition (LMD) is an AM process where a laser beam melts deposited powder, and the dissolved particles fuse to produce metal components. Porosity, or small cavities that form in this printed structure, is generally considered one of the most destructive defects in metal AM. Traditionally, computer tomography scans measure porosity. While this is useful for understanding the nature of pore formation and its characteristics, purely physics-driven models lack real-time prediction ability. Meanwhile, a purely deep learning approach to porosity prediction leaves valuable physics knowledge behind. In this paper, a hybrid model that uses both empirical and simulated LMD data is created to show how various physics-informed loss functions impact the accuracy, precision, and recall of a baseline deep learning model for porosity prediction. In particular, some versions of the physics-informed model can improve the precision of the baseline deep learning-only model (albeit at the expense of overall accuracy).  more » « less
Award ID(s):
1852215
NSF-PAR ID:
10319804
Author(s) / Creator(s):
; ;  
Date Published:
Journal Name:
Sensors
Volume:
22
Issue:
2
ISSN:
1424-8220
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ( , Journal of Manufacturing Science and Engineering)
    null (Ed.)
    Abstract Laser-based additive manufacturing (LBAM) provides unrivalled design freedom with the ability to manufacture complicated parts for a wide range of engineering applications. Melt pool is one of the most important signatures in LBAM and is indicative of process anomalies and part defects. High-speed thermal images of the melt pool captured during LBAM make it possible for in situ melt pool monitoring and porosity prediction. This paper aims to broaden current knowledge of the underlying relationship between process and porosity in LBAM and provide new possibilities for efficient and accurate porosity prediction. We present a deep learning-based data fusion method to predict porosity in LBAM parts by leveraging the measured melt pool thermal history and two newly created deep learning neural networks. A PyroNet, based on Convolutional Neural Networks, is developed to correlate in-process pyrometry images with layer-wise porosity; an IRNet, based on Long-term Recurrent Convolutional Networks, is developed to correlate sequential thermal images from an infrared camera with layer-wise porosity. Predictions from PyroNet and IRNet are fused at the decision-level to obtain a more accurate prediction of layer-wise porosity. The model fidelity is validated with LBAM Ti–6Al–4V thin-wall structure. This is the first work that manages to fuse pyrometer data and infrared camera data for metal additive manufacturing (AM). The case study results based on benchmark datasets show that our method can achieve high accuracy with relatively high efficiency, demonstrating the applicability of the method for in situ porosity detection in LBAM. 
    more » « less
  2. ; ; ; ; ( , Frontiers in Manufacturing Technology)

    This study presents an overview and a few case studies to explicate the transformative power of diverse imaging techniques for smart manufacturing, focusing largely on variousin-situandex-situimaging methods for monitoring fusion-based metal additive manufacturing (AM) processes such as directed energy deposition (DED), selective laser melting (SLM), electron beam melting (EBM).In-situimaging techniques, encompassing high-speed cameras, thermal cameras, and digital cameras, are becoming increasingly affordable, complementary, and are emerging as vital for real-time monitoring, enabling continuous assessment of build quality. For example, high-speed cameras capture dynamic laser-material interaction, swiftly detecting defects, while thermal cameras identify thermal distribution of the melt pool and potential anomalies. The data gathered fromin-situimaging are then utilized to extract pertinent features that facilitate effective control of process parameters, thereby optimizing the AM processes and minimizing defects. On the other hand,ex-situimaging techniques play a critical role in comprehensive component analysis. Scanning electron microscopy (SEM), optical microscopy, and 3D-profilometry enable detailed characterization of microstructural features, surface roughness, porosity, and dimensional accuracy. Employing a battery of Artificial Intelligence (AI) algorithms, information from diverse imaging and other multi-modal data sources can be fused, and thereby achieve a more comprehensive understanding of a manufacturing process. This integration enables informed decision-making for process optimization and quality assurance, as AI algorithms analyze the combined data to extract relevant insights and patterns. Ultimately, the power of imaging in additive manufacturing lies in its ability to deliver real-time monitoring, precise control, and comprehensive analysis, empowering manufacturers to achieve supreme levels of precision, reliability, and productivity in the production of components.

     
    more » « less
  3. ( , Proceedings of the IISE Annual Conference & Expo 2022)
    K. Ellis, W. Ferrell (Ed.)
    Fused deposition modeling (FDM) is one of the widely used additive manufacturing (AM) processes but shares major shortcomings typical due to its layer-by-layer fabrication. These challenges (poor surface finishes, presence of pores, inconsistent mechanical properties, etc.) have been attributed to FDM input process parameters, machine parameters, and material properties. Deep learning, a type of machine learning algorithm has proven to help reveal complex and nonlinear input-output relationships without the need for the underlying physics. This research explores the power of multilayer perceptron deep learning algorithm to create a prediction model for critical input process parameters (layer thickness, extrusion temperature, build temperature, build orientation, and print speed) to predict three functional output parameters (dimension accuracy, porosity, and tensile strength) of FDM printed part. A fractional factorial design of experiment was performed and replicated three times per run (n=3). The number of neurons for the hidden layers, learning rate, and epoch were varied. The computational run time, loss function, and root mean square error (RMSE) were used to select the best prediction model for each FDM output parameter. The findings of this work are being extended to online monitoring and real-time control of the AM process enabling an AM digital twin. 
    more » « less
  4. ( , Proceedings of the IISE Annual Conference & Expo 2022)
    K. Ellis, W. Ferrell (Ed.)
    Fused deposition modeling (FDM) is one of the widely used additive manufacturing (AM) processes but shares major shortcomings typical due to its layer-by-layer fabrication. These challenges (poor surface finishes, presence of pores, inconsistent mechanical properties, etc.) have been attributed to FDM input process parameters, machine parameters, and material properties. Deep learning, a type of machine learning algorithm has proven to help reveal complex and nonlinear input-output relationships without the need for the underlying physics. This research explores the power of multilayer perceptron deep learning algorithm to create a prediction model for critical input process parameters (layer thickness, extrusion temperature, build temperature, build orientation, and print speed) to predict three functional output parameters (dimension accuracy, porosity, and tensile strength) of FDM printed part. A fractional factorial design of experiment was performed and replicated three times per run (n=3). The number of neurons for the hidden layers, learning rate, and epoch were varied. The computational run time, loss function, and root mean square error (RMSE) were used to select the best prediction model for each FDM output parameter. The findings of this work are being extended to online monitoring and real-time control of the AM process enabling an AM digital twin. 
    more » « less
  5. ( , Advanced Photonics Research)
    Optical metasurfaces consist of densely arranged unit cells that manipulate light through various light confinement and scattering processes. Due to its unique advantages, such as high performance, small form factor and easy integration with semiconductor devices, metasurfaces have been gathering increasing attention in fields such as displays, imaging, sensing and optical computation. Despite advances in fabrication and characterization, a viable design prediction for suitable optical response remains challenging for complex optical metamaterial systems. The computation cost required to obtain the optimal design exponentially grows as the design complexity increases. Furthermore, the design prediction is challenging since the inverse problem is often ill-posed. In recent years, deep learning (DL) methods have shown great promise in the area of inverse design. Inspired by this and the capability of DL to produce fast inference, we introduce a physics-informed DL framework to expedite the computation for the inverse design of metasurfaces. Addition of the physics-based constraints improve generalizability of the DL model while reducing data burden. Our approach introduces a tandem DL architecture with physics-based learning to alleviate the nonuniqueness issue by selecting designs that are scientifically consistent, with low error in design prediction and accurate reconstruction of optical responses. To prove the concept, we focus on the inverse design of a representative plasmonic device that consists of metal gratings deposited on a dielectric film on top of a metal substrate. The optical response of the device is determined by the geometrical dimensions as well as the material properties. The training and testing data are obtained through Rigorous Coupled-Wave Analysis (RCWA), while the physics-based constraint is derived from solving the electromagnetic (EM) wave equations for a simplified homogenized model. We consider the prediction of design for the optical response of a single wavelength incident or a spectrum of wavelength in the visible light range. Our model converges with an accuracy up to 97% for inverse design prediction with the optical response for the visible light spectrum as input. The model is also able to predict design with accuracy up to 96% and optical response reconstruction accuracy of 99% for optical response of a single wavelength of light as input. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email