Search for: All records

Biomaterials and biomedical implants have revolutionized the way medicine is practiced. Technologies, such as 3D printing and electrospinning, are currently employed to create novel biomaterials. Most of the synthesis techniques are ad-hoc, time taking, and expensive. These shortcomings can be overcome greatly with the employment of computational techniques. In this paper we consider the problem of bone tissue engineering as an example and show the potentials of machine learning approaches in biomaterial construction, in which different models was built to predict the elastic modulus of the scaffold at given an arbitrary material composition. Likewise, the methodology was extended to cell-material interaction and prediction at an arbitrary process parameter.

 

Abstract—Materials Genomics initiative has the goal of rapidly synthesizing materials with a given set of desired properties using data science techniques. An important step in this direction is the ability to predict the outcomes of complex chemical reactions. Some graph-based feature learning algorithms have been proposed recently. However, the comprehensive relationship between atoms or structures is not learned properly and not explainable, and multiple graphs cannot be handled. In this paper, chemical reaction processes are formulated as translation processes. Both atoms and edges are mapped to vectors represent- ing the structural information. We employ the graph convolution layers to learn meaningful information of atom graphs, and further employ its variations, message passing networks (MPNN) and edge attention graph convolution network (EAGCN) to learn edge representations. Particularly, multi-view EAGCN groups and maps edges to a set of representations for the properties of the chemical bond between atoms from multiple views. Each bond is viewed from its atom type, bond type, distance and neighbor environment. The final node and edge representations are mapped to a sequence defined by the SMILES of the molecule and then fed to a decoder model with attention. To make full usage of multi-view information, we propose multi-view attention model to handle self correlation inside each atom or edge, and mutual correlation between edges and atoms, both of which are important in chemical reaction processes. We have evaluated our method on the standard benchmark datasets (that have been used by all the prior works), and the results show that edge embedding with multi-view attention achieves superior accuracy compared to existing techniques. 

Reducing the model redundancy is an important task to deploy complex deep learning models to resource-limited or time-sensitive devices. Directly regularizing or modifying weight values makes pruning procedure less robust and sensitive to the choice of hyperparameters, and it also requires prior knowledge to tune different hyperparameters for different models. To build a better generalized and easy-to-use pruning method, we propose AutoPrune, which prunes the network through optimizing a set of trainable auxiliary parameters instead of original weights. The instability and noise during training on auxiliary parameters will not directly affect weight values, which makes pruning process more robust to noise and less sensitive to hyperparameters. Moreover, we design gradient update rules for auxiliary parameters to keep them consistent with pruning tasks. Our method can automatically eliminate network redundancy with recoverability, relieving the complicated prior knowledge required to design thresholding functions, and reducing the time for trial and error. We evaluate our method with LeNet and VGGlike on MNIST and CIFAR-10 datasets, and with AlexNet, ResNet and MobileNet on ImageNet to establish the scalability of our work. Results show that our model achieves state-of-the-art sparsity, e.g. 7%, 23% FLOPs and 310x, 75x compression ratio for LeNet5 and VGG-like structure without accuracy drop, and 200M and 100M FLOPs for MobileNet V2 with accuracy 73.32% and 66.83% respectively. 

A Generative Adversarial Network (GAN) is an unsupervised generative framework to generate a sample distribution that is identical to the data distribution. Recently, mix strategy multi-generator/discriminator GANs have been shown to outperform single pair GANs. However, the mixed model suffers from the problem of linearly growing training time. Also, imbalanced training among generators makes it difficult to parallelize. In this paper, we propose a balanced mix-generator GAN that works in parallel by mixing multiple disjoint generators to approximate the real distribution. The weights of the discriminator and the classifier are controlled by a balance strategy. We also present an efficient loss function, to force each generator to embrace few modes with a high probability. Our model is naturally adaptive to large parallel computation frameworks. Each generator can be trained on multiple GPUs asynchronously. We have performed extensive experiments on synthetic datasets, MNIST1000, CIFAR-10, and ImageNet. The results establish that our model can achieve the state-of-the-art performance (in terms of the modes coverage and the inception score), with significantly reduced training time. We also show that the missing mode problem can be relieved with a growing number of generators. 

High‐performance and inexpensive platinum‐group‐metal (PGM)‐free catalysts for the oxygen reduction reaction (ORR) in challenging acidic media are crucial for proton‐exchange‐membrane fuel cells (PEMFCs). Catalysts based on Fe and N codoped carbon (Fe–N–C) have demonstrated promising activity and stability. However, a serious concern is the Fenton reactions between Fe²⁺and H₂O₂generating active free radicals, which likely cause degradation of the catalysts, organic ionomers within electrodes, and polymer membranes used in PEMFCs. Alternatively, Co–N–C catalysts with mitigated Fenton reactions have been explored as a promising replacement for Fe and PGM catalysts. Therefore, herein, the focus is on Co–N–C catalysts for the ORR relevant to PEMFC applications. Catalyst synthesis, structure/morphology, activity and stability improvement, and reaction mechanisms are discussed in detail. Combining experimental and theoretical understanding, the aim is to elucidate the structure–property correlations and provide guidance for rational design of advanced Co catalysts with a special emphasis on atomically dispersed single‐metal‐site catalysts. In the meantime, to reduce H₂O₂generation during the ORR on the Co catalysts, potential strategies are outlined to minimize the detrimental effect on fuel cell durability.