Search for: All records

Millions of new pieces of malicious software (i.e., malware) are introduced each year. This poses significant challenges for antivirus vendors, who use machine learning to detect and analyze malware, and must keep up with changes in the distribution while retaining knowledge of older variants. Continual learning (CL) holds the potential to address this challenge by relaxing the requirements of the incremental storage and computational costs of regularly retraining over all the collected data. Prior work, however, shows that CL techniques, which are designed primarily for computer vision tasks, fare poorly when applied to malware classification. To address these issues, we begin with an exploratory analysis of a typical malware dataset, which reveals that malware families are heterogeneous and difficult to characterize, requiring a wide variety of samples to learn a robust representation. Based on these findings, we propose Malware Analysis with Distribution-Aware Replay (MADAR), a CL framework that accounts for the unique properties and challenges of the malware data distribution. Through extensive evaluation on large-scale Windows and Android malware datasets, we show that MADAR significantly outperforms prior work. This highlights the importance of understanding domain characteristics when designing CL techniques and demonstrates a path forward for the malware analysis domain. 

It is significant to investigate the calcium carbonate (CaCO3) precipitation mechanism during the carbon capture process; nevertheless, CaCO3 precipitation is not clearly understood yet. Understanding the carbonation mechanism at the atomic level can contribute to the mineralization capture and utilization of carbon dioxide, as well as the development of new cementitious materials with high-performance. There are many factors, such as temperature and CO2 concentration, that can influence the carbonation reaction. In order to achieve better carbonation efficiency, the reaction conditions of carbonation should be fully verified. Therefore, based on molecular dynamics simulations, this paper investigates the atomic-scale mechanism of carbonation. We investigate the effect of carbonation factors, including temperature and concentration, on the kinetics of carbonation (polymerization rate and activation energy), the early nucleation of calcium carbonate, etc. Then, we analyze the local stresses of atoms to reveal the driving force of early stage carbonate nucleation and the reasons for the evolution of polymerization rate and activation energy. Results show that the higher the calcium concentration or temperature, the higher the polymerization rate of calcium carbonate. In addition, the activation energies of the carbonation reaction increase with the decrease in calcium concentrations. 

Abstract In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.