An official website of the United States government
In the medical sector, three-dimensional (3D) images are commonly used like computed tomography (CT) and magnetic resonance imaging (MRI). The 3D MRI is a non-invasive method of studying the soft-tissue structures in a knee joint for osteoarthritis studies. It can greatly improve the accuracy of segmenting structures such as cartilage, bone marrow lesion, and meniscus by identifying the bone structure first. U-net is a convolutional neural network that was originally designed to segment the biological images with limited training data. The input of the original U-net is a single 2D image and the output is a binary 2D image. In this study, we modified the U-net model to identify the knee bone structures using 3D MRI, which is a sequence of 2D slices. A fully automatic model has been proposed to detect and segment knee bones. The proposed model was trained, tested, and validated using 99 knee MRI cases where each case consists of 160 2D slices for a single knee scan. To evaluate the model’s performance, the similarity, dice coefficient (DICE), and area error metrics were calculated. Separate models were trained using different knee bone components including tibia, femur, patella, as well as a combined model for segmenting all the knee bones. Using the whole MRI sequence (160 slices), the method was able to detect the beginning and ending bone slices first, and then segment the bone structures for all the slices in between. On the testing set, the detection model accomplished 98.79% accuracy and the segmentation model achieved DICE 96.94% and similarity 93.98%. The proposed method outperforms several state-of-the-art methods, i.e., it outperforms U-net by 3.68%, SegNet by 14.45%, and FCN-8 by 2.34%, in terms of DICE score using the same dataset.
more »
« less
Volumetric Stimulated Raman Scattering Imaging of Cleared Tissues towards Three-dimensional Chemical Histopathology
Abstract: Thin tissue slice based histology has been used as a gold standard for disease diagnosis since over a hundred years ago. However, histopathological evaluation on two-dimensional slides suffers from large variations due to limited sampling. To improve the diagnostic accuracy, three-dimensional (3D) histology is performed through serial sectioning, staining, imaging and reconstruction of individual slices, which is highly time-consuming and labor intensive. We developed a volumetric stimulated Raman scattering (SRS) imaging method, which provides histology-like information in 3D context without the need for staining with dyes. Using a small molecule clearing agent, formamide, we performed tissue clearing within 30 min and achieved an imaging depth up to 500 µm in highly scattered tissues, including brain, kidney, liver and lung. Through a two-color SRS imaging scheme, we obtained histology-like images in cleared brain tissue slices. Our method has the potential for 3D tissue histopathology to improve the accuracy of histopathological examination. https://doi.org/10.1364/BOE.10.004329
more »
« less
- Award ID(s):
- 1807106
- PAR ID:
- 10147539
- Date Published:
- Journal Name:
- Biomedical optics express
- Volume:
- 10
- ISSN:
- 2156-7085
- Page Range / eLocation ID:
- 4329-4339
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Diffusible iodine-based contrast-enhanced computed tomography (diceCT) has emerged as a viable tool for discriminating soft tissues in serial CT slices, which can then be used for three-dimensional analysis. This technique has some potential to supplant histology as a tool for identification of body tissues. Here, we studied the head of an adult fruit bat ( Cynopterus sphinx ) and a late fetal vampire bat ( Desmodus rotundus ) using diceCT and µCT. Subsequently, we decalcified, serially sectioned and stained the same heads. The two CT volumes were rotated so that the sectional plane of the slice series closely matched that of histological sections, yielding the ideal opportunity to relate CT observations to corresponding histology. Olfactory epithelium is typically thicker, on average, than respiratory epithelium in both bats. Thus, one investigator (SK), blind to the histological sections, examined the diceCT slice series for both bats and annotated changes in thickness of epithelium on the first ethmoturbinal (ET I), the roof of the nasal fossa, and the nasal septum. A second trial was conducted with an added criterion: radioopacity of the lamina propria as an indicator of Bowman’s glands. Then, a second investigator (TS) annotated images of matching histological sections based on microscopic observation of epithelial type, and transferred these annotations to matching CT slices. Measurements of slices annotated according to changes in epithelial thickness alone closely track measurements of slices based on histologically-informed annotations; matching histological sections confirm blind annotations were effective based on epithelial thickness alone, except for a patch of unusually thick non-OE, mistaken for OE in one of the specimens. When characteristics of the lamina propria were added in the second trial, the blind annotations excluded the thick non-OE. Moreover, in the fetal bat the use of evidence for Bowman’s glands improved detection of olfactory mucosa, perhaps because the epithelium itself was thin enough at its margins to escape detection. We conclude that diceCT can by itself be highly effective in identifying distribution of OE, especially where observations are confirmed by histology from at least one specimen of the species. Our findings also establish that iodine staining, followed by stain removal, does not interfere with subsequent histological staining of the same specimen.more » « less
-
Abstract Prostate cancer treatment planning is largely dependent upon examination of core-needle biopsies. The microscopic architecture of the prostate glands forms the basis for prognostic grading by pathologists. Interpretation of these convoluted three-dimensional (3D) glandular structures via visual inspection of a limited number of two-dimensional (2D) histology sections is often unreliable, which contributes to the under- and overtreatment of patients. To improve risk assessment and treatment decisions, we have developed a workflow for nondestructive 3D pathology and computational analysis of whole prostate biopsies labeled with a rapid and inexpensive fluorescent analogue of standard hematoxylin and eosin (H&E) staining. This analysis is based on interpretable glandular features and is facilitated by the development of image translation–assisted segmentation in 3D (ITAS3D). ITAS3D is a generalizable deep learning–based strategy that enables tissue microstructures to be volumetrically segmented in an annotation-free and objective (biomarker-based) manner without requiring immunolabeling. As a preliminary demonstration of the translational value of a computational 3D versus a computational 2D pathology approach, we imaged 300 ex vivo biopsies extracted from 50 archived radical prostatectomy specimens, of which, 118 biopsies contained cancer. The 3D glandular features in cancer biopsies were superior to corresponding 2D features for risk stratification of patients with low- to intermediate-risk prostate cancer based on their clinical biochemical recurrence outcomes. The results of this study support the use of computational 3D pathology for guiding the clinical management of prostate cancer. Significance:An end-to-end pipeline for deep learning–assisted computational 3D histology analysis of whole prostate biopsies shows that nondestructive 3D pathology has the potential to enable superior prognostic stratification of patients with prostate cancer.more » « less
-
Research of cellular and molecular processes by way of histological methods allows for some insight but comes with a fundamental set of constraints that are challenging to overcome. Traditional histological methods are laborious, as well as severely limiting for in-depth study of developmental processes or disease processes in vivo. In traditional histology, fixing and sectioning tissue necessarily eliminates its dynamic function, while tissue section thickness limits the scope of investigation with conventional imaging tools. Noninvasive in vivo study of tissues and biomarkers is therefore paramount in gaining a fuller understanding of the pathophysiology surrounding conditions like congenital heart disorders. Light-sheet fluorescence microscopy (LSFM) is a powerful and noninvasive optical microscopy tool that can image in vivo tissue function in 4D (3D + time). LSFM boasts benefits such as short pixel dwell time (and therefore minimal photobleaching) while maintaining the ability to image a high dynamic range, as well as deep-tissue optical sectioning. Researchers have been seeking to overcome this problem by developing tissue-clearing techniques to attempt to homogenize the refractive index across the tissue via the removal of light-scattering pigments and lipids.more » « less
-
Abstract Traditional deep fluorescence imaging has primarily focused on red‐shifting imaging wavelengths into the near‐infrared (NIR) windows or implementation of multi‐photon excitation approaches. Here, the advantages of NIR and multiphoton imaging are combined by developing a dual‐infrared two‐photon microscope that enables high‐resolution deep imaging in biological tissues. This study first computationally identifies that photon absorption, as opposed to scattering, is the primary contributor to signal attenuation. A NIR two‐photon microscope is constructed next with a 1640 nm femtosecond pulsed laser and a NIR PMT detector to image biological tissues labeled with fluorescent single‐walled carbon nanotubes (SWNTs). Spatial imaging resolutions are achieved close to the Abbe resolution limit and eliminate blur and background autofluorescence of biomolecules, 300 µm deep into brain slices and through the full 120 µm thickness of aNicotiana benthamianaleaf. NIR‐II two‐photon microscopy can also measure tissue heterogeneity by quantifying how much the fluorescence power law function varies across tissues, a feature this study exploits to distinguish Huntington's Disease afflicted mouse brain tissues from wildtype. These results suggest dual‐infrared two‐photon microscopy can accomplish in‐tissue structural imaging and biochemical sensing with a minimal background, and with high spatial resolution, in optically opaque or highly autofluorescent biological tissues.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
