skip to main content


Title: Design Repository Effectiveness for 3D Convolutional Neural Networks: Application to Additive Manufacturing
Abstract Machine learning can be used to automate common or time-consuming engineering tasks for which sufficient data already exist. For instance, design repositories can be used to train deep learning algorithms to assess component manufacturability; however, methods to determine the suitability of a design repository for use with machine learning do not exist. We provide an initial investigation toward identifying such a method using “artificial” design repositories to experimentally test the extent to which altering properties of the dataset impacts the assessment precision and generalizability of neural networks trained on the data. For this experiment, we use a 3D convolutional neural network to estimate quantitative manufacturing metrics directly from voxel-based component geometries. Additive manufacturing (AM) is used as a case study because of the recent growth of AM-focused design repositories such as GrabCAD and Thingiverse that are readily accessible online. In this study, we focus only on material extrusion, the dominant consumer AM process, and investigate three AM build metrics: (1) part mass, (2) support material mass, and (3) build time. Additionally, we compare the convolutional neural network accuracy to that of a baseline multiple linear regression model. Our results suggest that training on design repositories with less standardized orientation and position resulted in more accurate trained neural networks and that orientation-dependent metrics were harder to estimate than orientation-independent metrics. Furthermore, the convolutional neural network was more accurate than the baseline linear regression model for all build metrics.  more » « less
Award ID(s):
1825535
NSF-PAR ID:
10120633
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Journal of Mechanical Design
Volume:
141
Issue:
11
ISSN:
1050-0472
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The widespread growth of additive manufacturing, a field with a complex informatic “digital thread”, has helped fuel the creation of design repositories, where multiple users can upload distribute, and download a variety of candidate designs for a variety of situations. Additionally, advancements in additive manufacturing process development, design frameworks, and simulation are increasing what is possible to fabricate with AM, further growing the richness of such repositories. Machine learning offers new opportunities to combine these design repository components’ rich geometric data with their associated process and performance data to train predictive models capable of automatically assessing build metrics related to AM part manufacturability. Although design repositories that can be used to train these machine learning constructs are expanding, our understanding of what makes a particular design repository useful as a machine learning training dataset is minimal. In this study we use a metamodel to predict the extent to which individual design repositories can train accurate convolutional neural networks. To facilitate the creation and refinement of this metamodel, we constructed a large artificial design repository, and subsequently split it into sub-repositories. We then analyzed metadata regarding the size, complexity, and diversity of the sub-repositories for use as independent variables predicting accuracy and the required training computational effort for training convolutional neural networks. The networks each predict one of three additive manufacturing build metrics: (1) part mass, (2) support material mass, and (3) build time. Our results suggest that metamodels predicting the convolutional neural network coefficient of determination, as opposed to computational effort, were most accurate. Moreover, the size of a design repository, the average complexity of its constituent designs, and the average and spread of design spatial diversity were the best predictors of convolutional neural network accuracy. 
    more » « less
  2. Abstract

    An intelligent sensing framework using Machine Learning (ML) and Deep Learning (DL) architectures to precisely quantify dielectrophoretic force invoked on microparticles in a textile electrode-based DEP sensing device is reported. The prediction accuracy and generalization ability of the framework was validated using experimental results. Images of pearl chain alignment at varying input voltages were used to build deep regression models using modified ML and CNN architectures that can correlate pearl chain alignment patterns of Saccharomyces cerevisiae(yeast) cells and polystyrene microbeads to DEP force. Various ML models such as K-Nearest Neighbor, Support Vector Machine, Random Forest, Neural Networks, and Linear Regression along with DL models such as Convolutional Neural Network (CNN) architectures of AlexNet, ResNet-50, MobileNetV2, and GoogLeNet have been analyzed in order to build an effective regression framework to estimate the force induced on yeast cells and microbeads. The efficiencies of the models were evaluated using Mean Absolute Error, Mean Absolute Relative, Mean Squared Error, R-squared, and Root Mean Square Error (RMSE) as evaluation metrics. ResNet-50 with RMSPROP gave the best performance, with a validation RMSE of 0.0918 on yeast cells while AlexNet with ADAM optimizer gave the best performance, with a validation RMSE of 0.1745 on microbeads. This provides a baseline for further studies in the application of deep learning in DEP aided Lab-on-Chip devices.

     
    more » « less
  3. The goal of this work is to quantify the link between the design features (geometry), in-situ process sensor signatures, and build quality of parts made using laser powder bed fusion (LPBF) additive manufacturing (AM) process. This knowledge is critical for establishing design rules for AM parts, and to detecting impending build failures using in-process sensor data. As a step towards this goal, the objectives of this work are two-fold: Quantify the effect of the geometry and orientation on the build quality of thin-wall features. To explain further, the geometry-related factor is the ratio of the length of a thin-wall (l) to its thickness (t) defined as the aspect ratio (length-to-thickness ratio, l/t), and the angular orientation (θ) of the part, which is defined as the angle of the part in the X-Y plane relative to the re-coater blade of the LPBF machine. Assess the thin-wall build quality by analyzing images of the part obtained at each layer from an in-situ optical camera using a convolutional neural network. To realize these objectives, we designed a test part with a set of thin-wall features (fins) with varying aspect ratio from Titanium alloy (Ti-6Al-4V) material — the aspect ratio l/t of the thin-walls ranges from 36 to 183 (11 mm long (constant), and 0.06 mm to 0.3 mm in thickness). These thin-wall test parts were built under three angular orientations of 0°, 60°, and 90°. Further, the parts were examined offline using X-ray computed tomography (XCT). Through the offline XCT data, the build quality of the thin-wall features in terms of their geometric integrity is quantified as a function of the aspect ratio and orientation angle, which suggests a set of design guidelines for building thin-wall structures with LPBF. To monitor the quality of the thin-wall, in-process images of the top surface of the powder bed were acquired at each layer during the build process. The optical images are correlated with the post build quantitative measurements of the thin-wall through a deep learning convolutional neural network (CNN). The statistical correlation (Pearson coefficient, ρ) between the offline XCT measured thin-wall quality, and CNN predicted measurement ranges from 80% to 98%. Consequently, the impending poor quality of a thin-wall is captured from in-situ process data. 
    more » « less
  4. The goal of this work to mitigate flaws in metal parts produced from laser powder bed fusion (LPBF) additive manufacturing (AM) process. As a step towards this goal, the objective of this work is to predict the build quality of a part as it is being printed via deep learning of in-situ layer-wise images obtained from an optical camera instrumented in the LPBF machine. To realize this objective, we designed a set of thin-wall features (fins) from Titanium alloy (Ti-6Al-4V) material with varying length-to-thickness ratio. These thin-wall test parts were printed under three different build orientations and in-situ images of their top surface were acquired during the process. The parts were examined offline using X-ray computed tomography (XCT), and their build quality was quantified in terms of statistical features, such as the thickness and consistency of its edges. Subsequently, a deep learning convolutional neural network (CNN) was trained to predict the XCT-derived statistical quality features using the layer-wise optical images of the thin-wall part as inputs. The statistical correlation between CNN-based predictions and XCT-observed quality measurements exceeds 85%. This work has two outcomes consequential to the sustainability of additive manufacturing: (1) It provides practitioners with a guideline for building thin-wall features with minimal defects, and (2) the high correlation between the offline XCT measurements and in-situ sensor-based quality metrics substantiates the potential for applying deep learning approaches for the real-time prediction of build flaws in LPBF. 
    more » « less
  5. Additive Manufacturing (AM) is a crucial component of the smart manufacturing industry. In this paper, we propose an automated quality grading system for the fused deposition modeling (FDM) process as one of the major AM processes using a developed real-time deep convolutional neural network (CNN) model. The CNN model is trained offline using the images of the internal and surface defects in the layer-by-layer deposition of materials and tested online by studying the performance of detecting and grading the failure in AM process at different extruder speeds and temperatures. The model demonstrates an accuracy of 94% and specificity of 96%, as well as above 75% in measures of the F-score, the sensitivity, and the precision for classifying the quality of the AM process in five grades in real-time. The high-performance of the model could not be achieved with the values usually used for printing temperature and printing speed, only in addition with much higher values. The proposed online model adds an automated, consistent, and non-contact quality control signal to the AM process. The quality monitoring signal can also be used by the AM machine to stop the AM process and eliminate the sophisticated inspection of the printed parts for internal defects. The proposed quality control model ensures reliable parts with fewer quality hiccups while improving performance in time and material consumption. 
    more » « less