An official website of the United States government
Abstract This paper presents a method for time-lapse 3D cell analysis. Specifically, we consider the problem of accurately localizing and quantitatively analyzing sub-cellular features, and for tracking individual cells from time-lapse 3D confocal cell image stacks. The heterogeneity of cells and the volume of multi-dimensional images presents a major challenge for fully automated analysis of morphogenesis and development of cells. This paper is motivated by the pavement cell growth process, and building a quantitative morphogenesis model. We propose a deep feature based segmentation method to accurately detect and label each cell region. An adjacency graph based method is used to extract sub-cellular features of the segmented cells. Finally, the robust graph based tracking algorithm using multiple cell features is proposed for associating cells at different time instances. We also demonstrate the generality of our tracking method on C. elegans fluorescent nuclei imagery. Extensive experiment results are provided and demonstrate the robustness of the proposed method. The code is available on and the method is available as a service through the BisQue portal.
more »
« less
DEGAST3D: Learning Deformable 3D Graph Similarity to Track Plant Cells in Unregistered Time Lapse Images
Tracking plant cells in three-dimensional (3D) tissue captured through light microscopy presents significant challenge due to the large number of densely packed cells, non-uniform growth patterns, and variations in cell division planes across different cell layers. In addition, images of deeper tissue layers are often noisy, and systemic imaging errors further exacerbate the complexity of the task. In this paper, we propose a novel learning-based method DEGAST3D: Learning Deformable 3D GrAph Similarity to Track Plant Cells in Unregistered Time Lapse Images exploits the tightly packed 3D cell structure of plant cells to create a three-dimensional graph for accurate cell tracking. We also propose a novel algorithm for cell division detection and an effective three-dimensional registration, improving state-of-the-art algorithms. On a public dataset, our novel cell pair matching method outperforms the baseline by 6.83%, 5.96%, 6.40% in precision, recall, and F-1 score, respectively. On the same dataset, our proposed novel cell division technique improves the results of the baseline method by 15.38% and 14.78% in terms of recall and Fl-score, respectively.
more »
« less
- PAR ID:
- 10629867
- Publisher / Repository:
- IEEE
- Date Published:
- Journal Name:
- IEEE Transactions on Computational Biology and Bioinformatics
- Volume:
- 22
- Issue:
- 1
- ISSN:
- 2998-4165
- Page Range / eLocation ID:
- 343 to 354
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In vivo , microvasculature provides oxygen, nutrients, and soluble factors necessary for cell survival and function. The highly tortuous, densely-packed, and interconnected three-dimensional (3D) architecture of microvasculature ensures that cells receive these crucial components. The ability to duplicate microvascular architecture in tissue-engineered models could provide a means to generate large-volume constructs as well as advanced microphysiological systems. Similarly, the ability to induce realistic flow in engineered microvasculature is crucial to recapitulating in vivo -like flow and transport. Advanced biofabrication techniques are capable of generating 3D, biomimetic microfluidic networks in hydrogels, however, these models can exhibit systemic aberrations in flow due to incorrect boundary conditions. To overcome this problem, we developed an automated method for generating synthetic augmented channels that induce the desired flow properties within three-dimensional microfluidic networks. These augmented inlets and outlets enforce the appropriate boundary conditions for achieving specified flow properties and create a three-dimensional output useful for image-guided fabrication techniques to create biomimetic microvascular networks.more » « less
-
In plants, the robust maintenance of tissue structure is crucial to supporting its functionality. The multi-layered shoot apical meristem (SAM) ofArabidopsis,containing stem cells,is an approximately radially symmetric tissue whose shape and structure is maintained throughout the life of the plant. In this paper, a new biologically calibrated pseudo-three-dimensional (P3D) computational model of a longitudinal section of the SAM is developed. It includes anisotropic expansion and division of cells out of the cross-section plane, as well as representation of tension experienced by the SAM epidermis. Results from the experimentally calibrated P3D model provide new insights into maintenance of the structure of the SAM epidermal cell monolayer under tension and quantify dependence of epidermal and subepidermal cell anisotropy on the amount of tension. Moreover, the model simulations revealed that out-of-plane cell growth is important in offsetting cell crowding and regulating mechanical stresses experienced by tunica cells. Predictive model simulations show that tension-determined cell division plane orientation in the apical corpus may be regulating cell and tissue shape distributions needed for maintaining structure of the wild-type SAM. This suggests that cells' responses to local mechanical cues may serve as a mechanism to regulate cell- and tissue-scale patterning.more » « less
-
Image-based cell counting is a fundamental yet challenging task with wide applications in biological research. In this paper, we propose a novel unified deep network framework designed to solve this problem for various cell types in both 2D and 3D images. Specifically, we first propose SAU-Net for cell counting by extending the segmentation network U-Net with a Self-Attention module. Second, we design an extension of Batch Normalization (BN) to facilitate the training process for small datasets. In addition, a new 3D benchmark dataset based on the existing mouse blastocyst (MBC) dataset is developed and released to the community. Our SAU-Net achieves state-of-the-art results on four benchmark 2D datasets - synthetic fluorescence microscopy (VGG) dataset, Modified Bone Marrow (MBM) dataset, human subcutaneous adipose tissue (ADI) dataset, and Dublin Cell Counting (DCC) dataset, and the new 3D dataset, MBC. The BN extension is validated using extensive experiments on the 2D datasets, since GPU memory constraints preclude use of 3D datasets. The source code is available at https://github.com/mzlr/sau-net.more » « less
-
In this article, we propose a deep learning based semantic segmentation model that identifies and segments defects in electroluminescence (EL) images of silicon photovoltaic (PV) cells. The proposed model can differentiate between cracks, contact interruptions, cell interconnect failures, and contact corrosion for both multicrystalline and monocrystalline silicon cells. Our model utilizes a segmentation Deeplabv3 model with a ResNet-50 backbone. It was trained on 17,064 EL images including 256 physically realistic simulated images of PV cells generated to deal with class imbalance. While performing semantic segmentation for five defect classes, this model achieves a weighted F1-score of 0.95, an unweighted F1-score of 0.69, a pixel-level global accuracy of 95.4%, and a mean intersection over union score of 57.3%. In addition, we introduce the UCF EL Defect dataset, a large-scale dataset consisting of 17,064 EL images, which will be publicly available for use by the PV and computer vision research communities.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1109/TCBBIO.2024.3525404
