skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Generating Porous Metamaterial Designs Using Variational Graph Autoencoder and Large Language Model
Abstract In this paper, we propose and compare two novel deep generative model-based approaches for the design representation, reconstruction, and generation of porous metamaterials characterized by complex and fully connected solid and pore networks. A highly diverse porous metamaterial database is curated, with each sample represented by solid and pore phase graphs and a voxel image. All metamaterial samples adhere to the requirement of complete connectivity in both pore and solid phases. The first approach employs a Dual Decoder Variational Graph Autoencoder to generate both solid phase and pore phase graphs. The second approach employs a Variational Graph Autoencoder for reconstructing/generating the nodes in the solid phase and pore phase graphs and a Transformer-based Large Language Model (LLM) for reconstructing/generating the connections, i.e., the edges among the nodes. A comparative study was conducted, and we found that both approaches achieved high accuracy in reconstructing node features, while the LLM exhibited superior performance in reconstructing edge features. Reconstruction accuracy is also validated by voxel-to-voxel comparison between the reconstructions and the original images in the test set. Additionally, discussions on the advantages and limitations of using LLMs in metamaterial design generation, along with the rationale behind their utilization, are provided.  more » « less
Award ID(s):
2142290
PAR ID:
10639922
Author(s) / Creator(s):
; ;
Publisher / Repository:
American Society of Mechanical Engineers
Date Published:
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract In this paper, we propose and compare two novel deep generative model-based approaches for the design representation, reconstruction, and generation of porous metamaterials characterized by complex and fully connected solid and pore networks. A highly diverse porous metamaterial database is curated, with each sample represented by solid and pore phase graphs and a voxel image. All metamaterial samples adhere to the requirement of complete connectivity in both pore and solid phases. The first approach employs a Dual Decoder Variational Graph Autoencoder to generate both solid phase and pore phase graphs. The second approach employs a Variational Graph Autoencoder for reconstructing/generating the nodes in the solid phase and pore phase graphs and a Transformer-based Large Language Model (LLM) for reconstructing/generating the connections, i.e., the edges among the nodes. A comparative study is conducted, and we found that both approaches achieved high accuracy in reconstructing node features, while the LLM exhibited superior performance in reconstructing edge features. Reconstruction accuracy is also validated by voxel-to-voxel comparison between the reconstructions and the original images in the test set. Additionally, discussions on the advantages and limitations of using LLMs in metamaterial design generation, along with the rationale behind their utilization, are provided. 
    more » « less
  2. Abstract Designing 3D porous metamaterial units while ensuring complete connectivity of both solid and pore phases presents a significant challenge. This complete connectivity is crucial for manufacturability and structure-fluid interaction applications (e.g., fluid-filled lattices). In this study, we propose a generative graph neural network-based framework for designing the porous metamaterial units with the constraint of complete connectivity. First, we propose a graph-based metamaterial unit generation approach to generate porous metamaterial samples with complete connectivity in both solid and pore phases. Second, we establish and evaluate three distinct variational graph autoencoder (VGAE)-based generative models to assess their effectiveness in generating an accurate latent space representation of metamaterial structures. By choosing the model with the highest reconstruction accuracy, the property-driven design search is conducted to obtain novel metamaterial unit designs with the targeted properties. A case study on designing liquid-filled metamaterials for thermal conductivity properties is carried out. The effectiveness of the proposed graph neural network-based design framework is evaluated by comparing the performances of the obtained designs with those of known designs in the metamaterial database. Merits and shortcomings of the proposed framework are also discussed. 
    more » « less
  3. Abstract Porous metamaterial units filled with fluid have been used in engineering systems due to their ability to achieve desired properties (e.g., effective thermal conductvity). Designing 3D porous metamaterial units while ensuring complete connectivity of both solid and pore phases presents a significant challenge. In this study, we propose a generative graph neural network-based framework for designing the porous metamaterial units infilled with liquid. Firstly, we propose a graph-based metamaterial unit generation approach to generate porous metamaterial samples with complete connectivity in both solid and pore phases. Secondly, we establish and evaluate three distinct variational graph autoencoder (VGAE)-based generative models to assess their effectiveness in generating an accurate latent space representation of metamaterial structures. By choosing the model with the highest reconstruction accuracy, the property-driven design search is conducted to obtain novel metamaterial unit designs with the targeted properties. A case study on designing liquid-filled metamaterials for thermal conductivity properties is carried out. The effectiveness of the proposed graph neural network-based design approach is evaluated by comparing the performances of the obtained designs with those of existing designs in the training database. Merits and shortcomings of the proposed framework are also discussed. 
    more » « less
  4. The development of next-generation energy storage systems relies on discovering new materials that support multivalent-ion transport. Transition metal oxides (TMOs) are promising due to their structural versatility, high ionic conductivity, and ability to accommodate multiple charge carriers. However, their vast compositional and structural diversity makes traditional exploration inefficient. This work presents a generative AI framework combining a crystal diffusion variational autoencoder (CDVAE) and a fine-tuned large language model (LLM) to discover porous oxide materials. Thousands of candidate structures are generated and screened for structural validity, thermodynamic stability, and electronic properties using a graph-based machine learning model and density functional theory (DFT) calculations. CDVAE identifies a broader variety of structures, including five novel TMO-based candidates, while LLM excels in generating highly stable structures near equilibrium. This approach demonstrates the power of generative AI in accelerating the discovery of advanced battery materials for multivalent-ion storage. 
    more » « less
  5. Achieving expressive 3D motion reconstruction and automatic generation for isolated sign words can be challenging, due to the lack of real-world 3D sign-word data, the complex nuances of signing motions, and the cross-modal understanding of sign language semantics. To address these challenges, we introduce SignAvatar, a framework capable of both word-level sign language reconstruction and generation. SignAvatar employs a transformer-based conditional variational autoencoder architecture, effectively establishing relationships across different semantic modalities. Additionally, this approach incorporates a curriculum learning strategy to enhance the model's robustness and generalization, resulting in more realistic motions. Furthermore, we contribute the ASL3DWord dataset, composed of 3D joint rotation data for the body, hands, and face, for unique sign words. We demonstrate the effectiveness of SignAvatar through extensive experiments, showcasing its superior reconstruction and automatic generation capabilities. The code and dataset are available on the project page 
    more » « less