skip to main content


Title: Deep learning extended depth-of-field microscope for fast and slide-free histology
Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells—a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.  more » « less
Award ID(s):
1730574 1652633
NSF-PAR ID:
10215414
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Proceedings of the National Academy of Sciences
Volume:
117
Issue:
52
ISSN:
0027-8424
Page Range / eLocation ID:
33051 to 33060
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Optical coherence tomography (OCT) is a rapid non‐invasive imaging technique that has shown high sensitivity for intra‐operative surgical margin assessment in human breast cancer clinical trials. This promising technology has not been evaluated in veterinary medicine. The objective of this study was to correlate normal and abnormal histological features with OCT images for surgical margins from excised canine soft tissue sarcoma (STS) and to establish image evaluation criteria for identifying positive surgical margins. Fourteen client‐owned dogs underwent surgical resection of a STS and OCT imaging of 2 to 4 areas of interest on the resected specimen were performed. Following imaging these areas were marked with surgical ink and trimmed for histopathology evaluation. Results showed that different tissue types had distinct characteristic appearances on OCT imaging. Adipose tissue exhibited a relatively low scattering and a honey‐comb texture pattern. Skeletal muscle and sarcoma tissue were both dense and highly scattering. While sarcoma tissue was highly scattering, it did not have organized recognizable structure in contrast to muscle which showed clear fibre alignment patterns. In this investigation, we showed different tissue types had different and characteristic scattering and image texture appearances on OCT, which closely correlate with low‐power histology images. Given the differentiation between tissue types the results support that OCT could be used to identify positive surgical margins immediately following resection of STS. Further research is needed to assess the diagnostic accuracy of this method for surgical margin assessment.

     
    more » « less
  2. A miniature optical-sectioning fluorescence microscope with high sensitivity and resolution would enable non-invasive and real-time tissue inspection, with potential use cases including early disease detection and intraoperative guidance. Previously, we developed a miniature MEMS-based dual-axis confocal (DAC) microscope that enabled video-rate optically sectionedin vivomicroscopy of human tissues. However, the device’s clinical utility was limited due to a small field of view, a non-adjustable working distance, and a lack of a sterilization strategy. In our latest design, we have made improvements to achieve a 2x increase in the field of view (600 × 300 µm) and an adjustable working distance range of 150 µm over a wide range of excitation/emission wavelengths (488–750 nm), all while maintaining a high frame rate of 15 frames per second (fps). Furthermore, the device is designed to image through a disposable sterile plastic drape for convenient clinical use. We rigorously characterize the performance of the device and show example images ofex vivotissues to demonstrate the optical performance of our new design, including fixed mouse skin and human prostate, as well as fresh mouse kidney, mouse intestine, and human head and neck surgical specimens with corresponding H&E histology. These improvements will facilitate clinical testing and translation.

     
    more » « less
  3. null (Ed.)
    Advanced stage glioma is the most aggressive form of malignant brain tumors with a short survival time. Real-time pathology assisted, or image guided surgical procedures that eliminate tumors promise to improve the clinical outcome and prolong the lives of patients. Our work is focused on the development of a rapid and sensitive assay for intraoperative diagnostics of glioma and identification of optical markers essential for differentiation between tumors and healthy brain tissues. We utilized fluorescence lifetime imaging (FLIM) of endogenous fluorophores related to metabolism of the glioma from freshly excised brains tissues. Macroscopic time-resolved fluorescence images of three intracranial animal glioma models and surgical samples of patients’ glioblastoma together with the white matter have been collected. Several established and new algorithms were applied to identify the imaging markers of the tumors. We found that fluorescence lifetime parameters characteristic of the glioma provided background for differentiation between the tumors and intact brain tissues. All three rat tumor models demonstrated substantial differences between the malignant and normal tissue. Similarly, tumors from patients demonstrated statistically significant differences from the peritumoral white matter without infiltration. While the data and the analysis presented in this paper are preliminary and further investigation with a larger number of samples is required, the proposed approach based on the macroscopic FLIM has a high potential for diagnostics of glioma and evaluation of the surgical margins of gliomas. 
    more » « less
  4. Abstract The first line of treatment for most solid tumors is surgical resection of the primary tumor with adequate negative margins. Incomplete tumor resections with positive margins account for over 75% of local recurrences and the development of distant metastases. In cases of oral cavity squamous cell carcinoma (OSCC), the rate of successful tumor removal with adequate margins is just 50–75%. Advanced real‐time imaging methods that improve the detection of tumor margins can help improve success rates,overall safety, and reduce the cost. Fluorescence imaging in the second near‐infrared (NIR‐II) window has the potential to revolutionize the field due to its high spatial resolution, low background signal, and deep tissue penetration properties, but NIR‐II dyes with adequate in vivo performance and safety profiles are scarce. A novel NIR‐II fluorophore, XW‐03‐66, with a fluorescence quantum yield (QY) of 6.0% in aqueous media is reported. XW‐03‐66 self‐assembles into nanoparticles (≈80 nm) and has a systemic circulation half‐life ( t 1/2 ) of 11.3 h. In mouse models of human papillomavirus (HPV)+ and HPV‐ OSCC, XW‐03‐66 outperformed indocyanine green (ICG), a clinically available NIR dye, and enabled intraoperative NIR‐II image‐guided resection of the tumor and adjacent draining lymph node with negative margins. In vitro and in vivo toxicity assessments revealed minimal safety concerns for in vivo applications. 
    more » « less
  5. Kidney cancer is a kind of high mortality cancer because of the difficulty in early diagnosis and the high metastatic dissemination in treatments. The surgical resection of tumors is the most effective treatment for renal cancer patients. However, precise assessment of tumor margins is a challenge during surgical resection. The objective of this study is to demonstrate an optical imaging tool in precisely distinguishing kidney tumor borders and identifying tumor zones from normal tissues to assist surgeons in accurately resecting tumors from kidneys during the surgery. 30 samples from six human kidneys were imaged using polarization-sensitive optical coherence tomography (PS-OCT). Cross-sectional, enface, and spatial information of kidney samples were obtained for microenvironment reconstruction. Polarization parameters (phase retardation, optic axis direction, and degree of polarization uniformity (DOPU) and Stokes parameters (Q, U, and V) were utilized for multiparameter analysis. To verify the detection accuracy of PS-OCT, H&E histology staining and dice-coefficient were utilized to quantify the performance of PS-OCT in identifying tumor borders and regions. In this study, tumor borders were clearly identified by PS-OCT imaging, which outperformed the conventional intensity-based OCT. With H&E histological staining as golden standard, PS-OCT precisely identified the tumor regions and tissue distributions at different locations and different depths based on polarization and Stokes parameters. Compared to the traditional attenuation coefficient quantification method, PS-OCT demonstrated enhanced contrast of tissue characteristics between normal and cancerous tissues due to the birefringence effects. Our results demonstrated that PS-OCT was promising to provide imaging guidance for the surgical resection of kidney tumors and had the potential to be used for other human kidney surgeries in clinics such as renal biopsy. 
    more » « less