An official website of the United States government
Abstract Machine learning can be used to automate common or time-consuming engineering tasks for which sufficient data already exist. For instance, design repositories can be used to train deep learning algorithms to assess component manufacturability; however, methods to determine the suitability of a design repository for use with machine learning do not exist. We provide an initial investigation toward identifying such a method using “artificial” design repositories to experimentally test the extent to which altering properties of the dataset impacts the assessment precision and generalizability of neural networks trained on the data. For this experiment, we use a 3D convolutional neural network to estimate quantitative manufacturing metrics directly from voxel-based component geometries. Additive manufacturing (AM) is used as a case study because of the recent growth of AM-focused design repositories such as GrabCAD and Thingiverse that are readily accessible online. In this study, we focus only on material extrusion, the dominant consumer AM process, and investigate three AM build metrics: (1) part mass, (2) support material mass, and (3) build time. Additionally, we compare the convolutional neural network accuracy to that of a baseline multiple linear regression model. Our results suggest that training on design repositories with less standardized orientation and position resulted in more accurate trained neural networks and that orientation-dependent metrics were harder to estimate than orientation-independent metrics. Furthermore, the convolutional neural network was more accurate than the baseline linear regression model for all build metrics.
more »
« less
Deriving Metamodels to Relate Machine Learning Quality to Repository Characteristics in the Context of Additive Manufacturing
The widespread growth of additive manufacturing, a field with a complex informatic “digital thread”, has helped fuel the creation of design repositories, where multiple users can upload distribute, and download a variety of candidate designs for a variety of situations. Additionally, advancements in additive manufacturing process development, design frameworks, and simulation are increasing what is possible to fabricate with AM, further growing the richness of such repositories. Machine learning offers new opportunities to combine these design repository components’ rich geometric data with their associated process and performance data to train predictive models capable of automatically assessing build metrics related to AM part manufacturability. Although design repositories that can be used to train these machine learning constructs are expanding, our understanding of what makes a particular design repository useful as a machine learning training dataset is minimal. In this study we use a metamodel to predict the extent to which individual design repositories can train accurate convolutional neural networks. To facilitate the creation and refinement of this metamodel, we constructed a large artificial design repository, and subsequently split it into sub-repositories. We then analyzed metadata regarding the size, complexity, and diversity of the sub-repositories for use as independent variables predicting accuracy and the required training computational effort for training convolutional neural networks. The networks each predict one of three additive manufacturing build metrics: (1) part mass, (2) support material mass, and (3) build time. Our results suggest that metamodels predicting the convolutional neural network coefficient of determination, as opposed to computational effort, were most accurate. Moreover, the size of a design repository, the average complexity of its constituent designs, and the average and spread of design spatial diversity were the best predictors of convolutional neural network accuracy.
more »
« less
- Award ID(s):
- 1825535
- PAR ID:
- 10171192
- Date Published:
- Journal Name:
- ASME 2020 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The data generated during additive manufacturing (AM) practice can be used to train machine learning (ML) tools to reduce defects, optimize mechanical properties, or increase efficiency. In addition to the size of the repository, emerging research shows that other characteristics of the data also impact suitability of the data for AM-ML application. What should be done in cases for which the data in too small, too homogeneous, or otherwise insufficient? Data augmentation techniques present a solution, offering automated methods for increasing the quality of data. However, many of these techniques were developed for machine vision tasks, and hence their suitability for AM data has not been verified. In this study, several data augmentation techniques are applied to synthetic design repositories to characterize if and to what degree they enhance their performance as ML training sets. We discuss the comparative advantage of these data augmentation techniques across several canonical AM-ML tasks.more » « less
-
null (Ed.)Modern digital manufacturing processes, such as additive manufacturing, are cyber-physical in nature and utilize complex, process-specific simulations for both design and manufacturing. Although computational simulations can be used to optimize these complex processes, they can take hours or days--an unreasonable cost for engineering teams leveraging iterative design processes. Hence, more rapid computational methods are necessary in areas where computation time presents a limiting factor. When existing data from historical examples is plentiful and reliable, supervised machine learning can be used to create surrogate models that can be evaluated orders of magnitude more rapidly than comparable finite element approaches. However, for applications that necessitate computationally- intensive simulations, even generating the training data necessary to train a supervised machine learning model can pose a significant barrier. Unsupervised methods, such as physics- informed neural networks, offer a shortcut in cases where training data is scarce or prohibitive. These novel neural networks are trained without the use of potentially expensive labels. Instead, physical principles are encoded directly into the loss function. This method substantially reduces the time required to develop a training dataset, while still achieving the evaluation speed that is typical of supervised machine learning surrogate models. We propose a new method for stochastically training and testing a convolutional physics-informed neural network using the transient 3D heat equation- to model temperature throughout a solid object over time. We demonstrate this approach by applying it to a transient thermal analysis model of the powder bed fusion manufacturing process.more » « less
-
Convolutional neural network (CNN), a type of deep learning algorithm, is a powerful tool for analyzing visual images. It has been actively investigated to monitor metal additive manufacturing (AM) processes for quality control and has been proven effective. However, typical CNN algorithms inherently have two issues when used in metal AM processes. First, in many cases, acquiring datasets with sufficient quantity and quality, as well as necessary information, is challenging because of technical difficulties and/or cost intensiveness. Second, determining a near-optimal CNN model takes considerable effort and is time-consuming. This is because the types and quality of datasets can be significantly different with respect to different AM processes and materials. The study proposes a novel concatenated ensemble learning method to obtain a flexible and robust algorithm for in-situ anomaly detection in wire + arc additive manufacturing (WAAM), a type of wire-based direct energy deposition (DED) process. For this, data, as well as machine learning models, were seamlessly integrated to overcome the limitations and difficulties in acquiring sufficient data and finding a near-optimal machine learning model. Using inexpensively obtainable and comprehensive datasets from the WAAM process, the proposed method was investigated and validated. In contrast to the one-dimensional and two-dimensional CNN models’ accuracies of 81.6 % and 88.6 %, respectively, the proposed concatenated ensemble model achieved an accuracy of 98 %.more » « less
-
Additive manufacturing (AM) methods have become mainstream in many industry sectors, especially aeronautics and space structures, where production volume for components is low and designs are highly customized. The frequency of launching space missions is increasing around the world. Some of these missions are sending landers and rovers to moon, mars, and other planets. Such space structures require numerous parts that are unique in design or are produced in just one or a very small production run. Such parts produced for high stake and very expensive missions require complete confidence in the quality of each part. Characterization of parts manufactured by AM is a significant challenge for many existing methods due to the geometric complexity, feature size in the structure, and size of the part. This paper discusses various challenges in applying current characterization methods to the AM sector. Machine learning (ML) methods are considered promising in materials and manufacturing fields. However, generating the training dataset by creating a large number of parts is expensive and impractical. New methods are required to train the ML algorithms on small datasets, especially for parts of unique geometry that are produced in limited production run such as space structures.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
