skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: An interpretable and transferrable vision transformer model for rapid materials spectra classification
Rapid analysis of materials characterization spectra is pivotal for preventing the accumulation of unwieldy datasets, thus accelerating subsequent decision-making. However, current methods heavily rely on experience and domain knowledge, which not only proves tedious but also makes it hard to keep up with the pace of data acquisition. In this context, we introduce a transferable Vision Transformer (ViT) model for the identification of materials from their spectra, including XRD and FTIR. First, an optimal ViT model was trained to predict metal organic frameworks (MOFs) from their XRD spectra. It attains prediction accuracies of 70%, 93%, and 94.9% for Top-1, Top-3, and Top-5, respectively, and a shorter training time of 269 seconds (∼30% faster) in comparison to a convolutional neural network model. The dimension reduction and attention weight map underline its adeptness at capturing relevant features in the XRD spectra for determining the prediction outcome. Moreover, the model can be transferred to a new one for prediction of organic molecules from their FTIR spectra, attaining remarkable Top-1, Top-3, and Top-5 prediction accuracies of 84%, 94.1%, and 96.7%, respectively. The introduced ViT-based model would set a new avenue for handling diverse types of spectroscopic data, thus expediting the materials characterization processes.  more » « less
Award ID(s):
2154428
PAR ID:
10504287
Author(s) / Creator(s):
; ; ; ; ;
Publisher / Repository:
RSC
Date Published:
Journal Name:
Digital Discovery
Volume:
3
Issue:
2
ISSN:
2635-098X
Page Range / eLocation ID:
369 to 380
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Journal of Composite Materials)
    null (Ed.)
    Semi-crystalline carbon biochar is derived from spent coffee grounds (SCG) by a controlled pyrolysis process at high temperature/pressure conditions. Obtained biochar is characterized using XRD, SEM, and TEM techniques. Biochar particles are in the micrometer range with nanostructured morphologies. The SCG biochar thus produced is used as reinforcement in epoxy resin to 3 D print samples using the direct-write (DW) method with 1 and 3 wt. % loadings. Rheology results show that the addition of biochar makes resin viscous, enabling it to be stable soon after print; however, it could also lead to clogging of resin in printer head. The printed samples are characterized for chemical, thermal and mechanical properties using FTIR, TGA, DMA and flexure tests. Storage modulus improved with 1 wt. % biochar addition up to 27.5% and flexural modulus and strength increased up to 55.55% and 43.30% respectively. However, with higher loading of 3 wt. % both viscoelastic and flexural properties of 3D printed samples drastically reduced thus undermining the feasibility of 3D printing biochar reinforced epoxies at higher loadings. 
    more » « less
  2. ; ; ; ; ; ; ; ; ; ; et al (, Frontiers in Chemistry)
    Covalent integration of polymers and porous organic frameworks (POFs), including metal-organic frameworks (MOFs), covalent organic frameworks (COFs) and hydrogen-bonded organic frameworks (HOFs), represent a promising strategy for overcoming the existing limitations of traditional porous materials. This integration allows for the combination of the advantages of polymers, i.e., flexibility, processability and chemical versatility etc., and the superiority of POFs, like the structural integrity, tunable porosity and the high surface area, creating a type of hybrid materials. These resulting polymer-POF hybrid materials exhibit enhanced mechanical strength, chemical stability and functional diversity, thus opening up new opportunities for applications across a large variety of fields, such as gas separation, catalysis, biomedical applications, environmental remediation and energy storage. In this review, an overview of synthetic routes and strategies on how to covalently integrate different polymers with various POFs is discussed, especially with a particular focus on methods like polymerization within, on and among POF structures. To investigate the unique properties and functions of these resultant hybrid materials, the characterization techniques, including nuclear magnetic resonance spectroscopy (NMR), Fourier transform infrared spectroscopy (FTIR), X-ray diffraction (XRD), thermogravimetric analysis (TGA), transmission electron microscopy (TEM) and scanning electron microscopy (SEM), gas adsorption analysis (BET) and computational modeling and machine learning, are also presented. The ability of polymer-POFs to manipulate the pore environments at the molecular level affords these materials a wide range of applications, providing a versatile platform for future advancements in material science. Looking forward, to fully realize the potential of these hybrid materials, the authors highlight the scalability, green synthesis methods, and potential for stimuli-responsive polymer-POF materials as critical areas for future research. 
    more » « less
  3. ; ; ; ; ; (, The Planetary Science Journal)
    Abstract The Chemistry and Mineralogy X-ray diffraction (XRD) instrument aboard the Curiosity rover consistently identifies amorphous material at Gale Crater, which is compositionally variable, but often includes elevated sulfur and iron, suggesting that amorphous ferric sulfate (AFS) may be present. Understanding how desiccating ferric sulfate brines affect the spectra of Martian material analogs is necessary for interpreting complex/realistic reaction assemblages. Visible and near-infrared reflectance (VNIR), mid-infrared attenuated total reflectance (MIR, FTIR-ATR), and Raman spectra, along with XRD data are presented for basaltic glass, hematite, gypsum, nontronite, and magnesite, each at three grain sizes (<25, 25–63, and 63–180μm), mixed with ferric sulfate (+/−NaCl), deliquesced, then rapidly desiccated in 11% relative humidity or via vacuum. All desiccated products are partially or completely XRD amorphous; crystalline phases include starting materials and trace precipitates, leaving the bulk of the ferric sulfate in the amorphous fraction. Due to considerable spectral masking, AFS detectability is highly dependent on spectroscopic technique and minerals present. This has strong implications for remote and in situ observations of Martian samples that include an amorphous component. AFS is only identifiable in VNIR spectra for magnesite, nontronite, and gypsum samples; hematite and basaltic glass samples appear similar to pure materials. Sulfate features dominate Raman spectra for nontronite and basaltic glass samples; the analog material dominates Raman spectra of hematite and gypsum samples. MIR data are least affected by masking, but basaltic glass is almost undetectable in MIR spectra of those mixtures. NaCl produces similar FTIR-ATR and Raman features, regardless of analog material. 
    more » « less
  4. ; ; ; ; ; ; ; (, ACM Transactions on Embedded Computing Systems)
    Vision Transformer (ViT) has demonstrated promising performance in various computer vision tasks, and recently attracted a lot of research attention. Many recent works have focused on proposing new architectures to improve ViT and deploying it into real-world applications. However, little effort has been made to analyze and understand ViT’s architecture design space and its implication of hardware-cost on different devices. In this work, by simply scaling ViT’s depth, width, input size, and other basic configurations, we show that a scaled vanilla ViT model without bells and whistles can achieve comparable or superior accuracy-efficiency trade-off than most of the latest ViT variants. Specifically, compared to DeiT-Tiny, our scaled model achieves a\(\uparrow 1.9\% \)higher ImageNet top-1 accuracy under the same FLOPs and a\(\uparrow 3.7\% \)better ImageNet top-1 accuracy under the same latency on an NVIDIA Edge GPU TX2. Motivated by this, we further investigate the extracted scaling strategies from the following two aspects: (1) “can these scaling strategies be transferred across different real hardware devices?”; and (2) “can these scaling strategies be transferred to different ViT variants and tasks?”. For (1), our exploration, based on various devices with different resource budgets, indicates that the transferability effectiveness depends on the underlying device together with its corresponding deployment tool; for (2), we validate the effective transferability of the aforementioned scaling strategies obtained from a vanilla ViT model on top of an image classification task to the PiT model, a strong ViT variant targeting efficiency, as well as object detection and video classification tasks. In particular, when transferred to PiT, our scaling strategies lead to a boosted ImageNet top-1 accuracy of from\(74.6\% \)to\(76.7\% \)(\(\uparrow 2.1\% \)) under the same 0.7G FLOPs; and when transferred to the COCO object detection task, the average precision is boosted by\(\uparrow 0.7\% \)under a similar throughput on a V100 GPU. 
    more » « less
  5. ; ; ; ; ; ; (, Journal of Composites Science)
    Titanium nitride and vanadium nitride–carbon-based composite systems, TiN/C and VN/C, were prepared using a new synthesis method based on the thermal decomposition of titanyl tetraphenyl porphyrin (TiOTPP) and vanadyl tetraphenyl porphyrin (VOTPP), respectively. The structure of the TiN/C and VN/C composite materials, as well as their precursors, were characterized using Fourier Transformed Infrared Spectroscopy, X-Ray diffraction (XRD), X-Ray energy dispersive (EDS) and X-Ray photoelectron spectroscopy (XPS). Morphologies of the TiN/C and VN/C composites were examined by means of scanning electron (SEM) and transmission electron (TEM) microscopy. The synthesis of the non-metalated tetraphenyl porphyrin, the titanium, and vanadium tetraphenyl porphyrin complexes were confirmed using FTIR. The thermal decomposition of the titanium and vanadium tetraphenyl porphyrin complexes produced the respective metal nitride encapsulated in a carbon matrix; this was confirmed by XRD, SEM, TEM, and XPS. From the XRD patterns, it was determined that the TiN and VN were presented in cubic form with expected space group FM-3M and 1:1 (metal:N) stoichiometry. The XPS results confirmed the presence of both TiN and VN in the carbon matrix without metal carbides. The SEM and TEM results showed that both TiN and VN nanoparticles formed small clusters throughout the carbon matrix; the EDS results revealed a uniform composition. The synthesis method presented in this work is novel and serves as an effective means to produce TiN and VN NPs with good structure and morphology embedded in a carbon matrix. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email