More Like this

1. Cryo-shift: reducing domain shift in cryo-electron subtomograms with unsupervised domain adaptation and randomization

   https://doi.org/10.1093/bioinformatics/btab794  

   Bandyopadhyay, Hmrishav ; Deng, Zihao ; Ding, Leiting ; Liu, Sinuo ; Uddin, Mostofa Rafid ; Zeng, Xiangrui ; Behpour, Sima ; Xu, Min ; Xu, ed., Jinbo ( November 2021 , Bioinformatics)

   Cryo-Electron Tomography (cryo-ET) is a 3D imaging technology that enables the visualization of subcellular structures in situ at near-atomic resolution. Cellular cryo-ET images help in resolving the structures of macromolecules and determining their spatial relationship in a single cell, which has broad significance in cell and structural biology. Subtomogram classification and recognition constitute a primary step in the systematic recovery of these macromolecular structures. Supervised deep learning methods have been proven to be highly accurate and efficient for subtomogram classification, but suffer from limited applicability due to scarcity of annotated data. While generating simulated data for training supervised models is a potential solution, a sizeable difference in the image intensity distribution in generated data as compared with real experimental data will cause the trained models to perform poorly in predicting classes on real subtomograms.

   In this work, we present Cryo-Shift, a fully unsupervised domain adaptation and randomization framework for deep learning-based cross-domain subtomogram classification. We use unsupervised multi-adversarial domain adaption to reduce the domain shift between features of simulated and experimental data. We develop a network-driven domain randomization procedure with ‘warp’ modules to alter the simulated data and help the classifier generalize better on experimental data. We do not use any labeled experimental data to train our model, whereas some of the existing alternative approaches require labeled experimental samples for cross-domain classification. Nevertheless, Cryo-Shift outperforms the existing alternative approaches in cross-domain subtomogram classification in extensive evaluation studies demonstrated herein using both simulated and experimental data.

   https://github.com/xulabs/aitom.

   Supplementary data are available at Bioinformatics online.

    

   more » « less
2. CryoETGAN: Cryo-Electron Tomography Image Synthesis via Unpaired Image Translation

   https://doi.org/10.3389/fphys.2022.760404  

   Wu, Xindi ; Li, Chengkun ; Zeng, Xiangrui ; Wei, Haocheng ; Deng, Hong-Wen ; Zhang, Jing ; Xu, Min ( March 2022 , Frontiers in Physiology)

   Cryo-electron tomography (Cryo-ET) has been regarded as a revolution in structural biology and can reveal molecular sociology. Its unprecedented quality enables it to visualize cellular organelles and macromolecular complexes at nanometer resolution with native conformations. Motivated by developments in nanotechnology and machine learning, establishing machine learning approaches such as classification, detection and averaging for Cryo-ET image analysis has inspired broad interest. Yet, deep learning-based methods for biomedical imaging typically require large labeled datasets for good results, which can be a great challenge due to the expense of obtaining and labeling training data. To deal with this problem, we propose a generative model to simulate Cryo-ET images efficiently and reliably: CryoETGAN. This cycle-consistent and Wasserstein generative adversarial network (GAN) is able to generate images with an appearance similar to the original experimental data. Quantitative and visual grading results on generated images are provided to show that the results of our proposed method achieve better performance compared to the previous state-of-the-art simulation methods. Moreover, CryoETGAN is stable to train and capable of generating plausibly diverse image samples. 

   more » « less
3. Few-shot learning for classification of novel macromolecular structures in cryo-electron tomograms

   https://doi.org/10.1371/journal.pcbi.1008227  

   Li, Ran ; Yu, Liangyong ; Zhou, Bo ; Zeng, Xiangrui ; Wang, Zhenyu ; Yang, Xiaoyan ; Zhang, Jing ; Gao, Xin ; Jiang, Rui ; Xu, Min ( November 2020 , PLOS Computational Biology)

   Haliloglu, Turkan (Ed.)

   Cryo-electron tomography (cryo-ET) provides 3D visualization of subcellular components in the near-native state and at sub-molecular resolutions in single cells, demonstrating an increasingly important role in structural biology in situ . However, systematic recognition and recovery of macromolecular structures in cryo-ET data remain challenging as a result of low signal-to-noise ratio (SNR), small sizes of macromolecules, and high complexity of the cellular environment. Subtomogram structural classification is an essential step for such task. Although acquisition of large amounts of subtomograms is no longer an obstacle due to advances in automation of data collection, obtaining the same number of structural labels is both computation and labor intensive. On the other hand, existing deep learning based supervised classification approaches are highly demanding on labeled data and have limited ability to learn about new structures rapidly from data containing very few labels of such new structures. In this work, we propose a novel approach for subtomogram classification based on few-shot learning. With our approach, classification of unseen structures in the training data can be conducted given few labeled samples in test data through instance embedding. Experiments were performed on both simulated and real datasets. Our experimental results show that we can make inference on new structures given only five labeled samples for each class with a competitive accuracy (> 0.86 on the simulated dataset with SNR = 0.1), or even one sample with an accuracy of 0.7644. The results on real datasets are also promising with accuracy > 0.9 on both conditions and even up to 1 on one of the real datasets. Our approach achieves significant improvement compared with the baseline method and has strong capabilities of generalizing to other cellular components. 

   more » « less
4. Artificial intelligence advances for de novo molecular structure modeling in cryo‐electron microscopy

   https://doi.org/10.1002/wcms.1542  

   Si, Dong ; Nakamura, Andrew ; Tang, Runbang ; Guan, Haowen ; Hou, Jie ; Firozi, Ammaar ; Cao, Renzhi ; Hippe, Kyle ; Zhao, Minglei ( May 2021 , WIREs Computational Molecular Science)

   Cryo‐electron microscopy (cryo‐EM) has become a major experimental technique to determine the structures of large protein complexes and molecular assemblies, as evidenced by the 2017 Nobel Prize. Although cryo‐EM has been drastically improved to generate high‐resolution three‐dimensional maps that contain detailed structural information about macromolecules, the computational methods for using the data to automatically build structure models are lagging far behind. The traditional cryo‐EM model building approach is template‐based homology modeling. Manual de novo modeling is very time‐consuming when no template model is found in the database. In recent years, de novo cryo‐EM modeling using machine learning (ML) and deep learning (DL) has ranked among the top‐performing methods in macromolecular structure modeling. DL‐based de novo cryo‐EM modeling is an important application of artificial intelligence, with impressive results and great potential for the next generation of molecular biomedicine. Accordingly, we systematically review the representative ML/DL‐based de novo cryo‐EM modeling methods. Their significances are discussed from both practical and methodological viewpoints. We also briefly describe the background of cryo‐EM data processing workflow. Overall, this review provides an introductory guide to modern research on artificial intelligence for de novo molecular structure modeling and future directions in this emerging field.

   This article is categorized under:

   Structure and Mechanism > Molecular Structures

   Structure and Mechanism > Computational Biochemistry and Biophysics

   Data Science > Artificial Intelligence/Machine Learning

    

   more » « less
5. One-Shot Learning With Attention-Guided Segmentation in Cryo-Electron Tomography

   https://doi.org/10.3389/fmolb.2020.613347  

   Zhou, Bo ; Yu, Haisu ; Zeng, Xiangrui ; Yang, Xiaoyan ; Zhang, Jing ; Xu, Min ( January 2021 , Frontiers in Molecular Biosciences)

   null (Ed.)

   Cryo-electron Tomography (cryo-ET) generates 3D visualization of cellular organization that allows biologists to analyze cellular structures in a near-native state with nano resolution. Recently, deep learning methods have demonstrated promising performance in classification and segmentation of macromolecule structures captured by cryo-ET, but training individual deep learning models requires large amounts of manually labeled and segmented data from previously observed classes. To perform classification and segmentation in the wild (i.e., with limited training data and with unseen classes), novel deep learning model needs to be developed to classify and segment unseen macromolecules captured by cryo-ET. In this paper, we develop a one-shot learning framework, called cryo-ET one-shot network (COS-Net), for simultaneous classification of macromolecular structure and generation of the voxel-level 3D segmentation, using only one training sample per class. Our experimental results on 22 macromolecule classes demonstrated that our COS-Net could efficiently classify macromolecular structures with small amounts of samples and produce accurate 3D segmentation at the same time. 

   more » « less