An official website of the United States government
Abstract Surface defect identification is a crucial task in many manufacturing systems, including automotive, aircraft, steel rolling, and precast concrete. Although image-based surface defect identification methods have been proposed, these methods usually have two limitations: images may lose partial information, such as depths of surface defects, and their precision is vulnerable to many factors, such as the inspection angle, light, color, noise, etc. Given that a three-dimensional (3D) point cloud can precisely represent the multidimensional structure of surface defects, we aim to detect and classify surface defects using a 3D point cloud. This has two major challenges: (i) the defects are often sparsely distributed over the surface, which makes their features prone to be hidden by the normal surface and (ii) different permutations and transformations of 3D point cloud may represent the same surface, so the proposed model needs to be permutation and transformation invariant. In this paper, a two-step surface defect identification approach is developed to investigate the defects’ patterns in 3D point cloud data. The proposed approach consists of an unsupervised method for defect detection and a multi-view deep learning model for defect classification, which can keep track of the features from both defective and non-defective regions. We prove that the proposed approach is invariant to different permutations and transformations. Two case studies are conducted for defect identification on the surfaces of synthetic aircraft fuselage and the real precast concrete specimen, respectively. The results show that our approach receives the best defect detection and classification accuracy compared with other benchmark methods.
more »
« less
Deep Image Segmentation for Defect Detection in Photo-lithography Fabrication
Abstract: Surface acoustic wave (SAW) sensors with increasingly unique and refined designed patterns are often developed using the lithographic fabrication processes. Emerging applications of SAW sensors often require novel materials, which may present uncharted fabrication outcomes. The fidelity of the SAW sensor performance is often correlated with the ability to restrict the presence of defects in post-fabrication. Therefore, it is critical to have effective means to detect the presence of defects within the SAW sensor. However, labor-intensive manual labeling is often required due to the need for precision identification and classification of surface features for increased confidence in model accuracy. One approach to automating defect detection is to leverage effective machine learning techniques to analyze and quantify defects within the SAW sensor. In this paper, we propose a machine learning approach using a deep convolutional autoencoder to segment surface features semantically. The proposed deep image autoencoder takes a grayscale input image and generates a color image segmenting the defect region in red, metallic interdigital transducing (IDT) fingers in green, and the substrate region in blue. Experimental results demonstrate promising segmentation scores in locating the defects and regions of interest for a novel SAW sensor variant. The proposed method can automate the process of localizing and measuring post-fabrication defects at the pixel level that may be missed by error-prone visual inspection.
more »
« less
- PAR ID:
- 10433152
- Date Published:
- Journal Name:
- 2023 24th International Symposium on Quality Electronic Design (ISQED)
- Page Range / eLocation ID:
- 1 to 7
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Deep learning leverages multi-layer neural networks architecture and demonstrates superb power in many machine learning applications. The deep denoising autoencoder technique extracts better coherent features from the seismic data. The technique allows us to automatically extract low-dimensional features from high dimensional feature space in a non-linear, data-driven, and unsupervised way. A properly trained denoising autoencoder takes a partially corrupted input and recovers the original undistorted input. In this paper, a novel autoencoder built upon the deep residual network is proposed to perform noise attenuation on the seismic data. We evaluate the proposed method with synthetic datasets and the result confirms the effective denoising performance of the proposed approach.more » « less
-
Abstract Laser powder bed fusion (L-PBF) additive manufacturing (AM) is an effective method of fabricating nickel–titanium (NiTi) shape memory alloys (SMAs) with complex geometries, unique functional properties, and tailored material compositions. However, with the increase of Ni content in NiTi powder feedstock, the ability to produce high-quality parts is notably reduced due to the emergence of macroscopic defects such as warpage, elevated edge/corner, delamination, and excessive surface roughness. This study explores the printability of a nickel-rich NiTi powder, where printability refers to the ability to fabricate macro-defect-free parts. Specifically, single track experiments were first conducted to select key processing parameter settings for cubic specimen fabrication. Machine learning classification techniques were implemented to predict the printable space. The reliability of the predicted printable space was verified by further cubic specimens fabrication, and the relationship between processing parameters and potential macro-defect modes was investigated. Results indicated that laser power was critical to the printability of high Ni content NiTi powder. In the low laser power setting (P < 100 W), the printable space was relatively wider with delamination as the main macro-defect mode. In the sub-high laser power condition (100 W ≤ P ≤ 200 W), the printable space was narrowed to a low hatch spacing region with macro-defects of warpage, elevated edge/corner, and delamination happened at different scanning speeds and hatch spacing combinations. The rough surface defect emerged when further increasing the laser power (P > 200 W), leading to a further narrowed printable space.more » « less
-
Three typical types of defects, i.e., keyholes, lack of fusion (LoF), and gas-entrapped pores (GEP), characterized by various features (e.g., volume, surface area, etc.), are generated under different process parameters of laser beam powder bed fusion (L-PBF) processes in additive manufacturing (AM). The different types of defects deteriorate the mechanical performance of L- PBF components, such as fatigue life, to a different extent. However, there is a lack of recognized approaches to classify the defects automatically and accurately in L-PBF components. This work presents a novel hierarchical graph convolutional network (H-GCN) to classify different types of defects by a cascading GCN structure with a low-level feature (e.g., defect features) layer and a high-level feature (e.g., process parameters) layer. Such an H-GCN not only leverages the multi- level information from process parameters and defect features to classify the defects but also explores the impact of process parameters on defect types and features. The H-GCN is evaluated through a case study with X-ray computed tomography (CT) L-PBF defect datasets and compared with several machine learning methods. H-GCN exhibits an outstanding classification performance with an F1-score of 1.000 and reveals the potential effect of process parameters on three types of defects.more » « less
-
Abstract Automated optical inspection (AOI) is increasingly advocated for in situ quality monitoring of additive manufacturing (AM) processes. The availability of layerwise imaging data improves the information visibility during fabrication processes and is thus conducive to performing online certification. However, few, if any, have investigated the high-speed contact image sensors (CIS) (i.e., originally developed for document scanners and multifunction printers) for AM quality monitoring. In addition, layerwise images show complex patterns and often contain hidden information that cannot be revealed in a single scale. A new and alternative approach will be to analyze these intrinsic patterns with multiscale lenses. Therefore, the objective of this article is to design and develop an AOI system with contact image sensors for multiresolution quality inspection of layerwise builds in additive manufacturing. First, we retrofit the AOI system with contact image sensors in industrially relevant 95 mm/s scanning speed to a laser-powder-bed-fusion (LPBF) machines. Then, we design the experiments to fabricate nine parts under a variety of factor levels (e.g., gas flow blockage, re-coater damage, laser power changes). In each layer, the AOI system collects imaging data of both recoating powder beds before the laser fusion and surface finishes after the laser fusion. Second, layerwise images are pre-preprocessed for alignment, registration, and identification of regions of interests (ROIs) of these nine parts. Then, we leverage the wavelet transformation to analyze ROI images in multiple scales and further extract salient features that are sensitive to process variations, instead of extraneous noises. Third, we perform the paired comparison analysis to investigate how different levels of factors influence the distribution of wavelet features. Finally, these features are shown to be effective in predicting the extent of defects in the computed tomography (CT) data of layerwise AM builds. The proposed framework of multiresolution quality inspection is evaluated and validated using real-world AM imaging data. Experimental results demonstrated the effectiveness of the proposed AOI system with contact image sensors for online quality inspection of layerwise builds in AM processes.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1109/ISQED57927.2023.10129372
