An official website of the United States government
Histopathology plays a critical role in the diagnosis and surgical management of cancer. However, access to histopathology services, especially frozen section pathology during surgery, is limited in resource-constrained settings because preparing slides from resected tissue is time-consuming, labor-intensive, and requires expensive infrastructure. Here, we report a deep-learning-enabled microscope, named DeepDOF-SE, to rapidly scan intact tissue at cellular resolution without the need for physical sectioning. Three key features jointly make DeepDOF-SE practical. First, tissue specimens are stained directly with inexpensive vital fluorescent dyes and optically sectioned with ultra-violet excitation that localizes fluorescent emission to a thin surface layer. Second, a deep-learning algorithm extends the depth-of-field, allowing rapid acquisition of in-focus images from large areas of tissue even when the tissue surface is highly irregular. Finally, a semi-supervised generative adversarial network virtually stains DeepDOF-SE fluorescence images with hematoxylin-and-eosin appearance, facilitating image interpretation by pathologists without significant additional training. We developed the DeepDOF-SE platform using a data-driven approach and validated its performance by imaging surgical resections of suspected oral tumors. Our results show that DeepDOF-SE provides histological information of diagnostic importance, offering a rapid and affordable slide-free histology platform for intraoperative tumor margin assessment and in low-resource settings.
more »
« less
Deep learning extended depth-of-field microscope for fast and slide-free histology
Microscopic evaluation of resected tissue plays a central role in the surgical management of cancer. Because optical microscopes have a limited depth-of-field (DOF), resected tissue is either frozen or preserved with chemical fixatives, sliced into thin sections placed on microscope slides, stained, and imaged to determine whether surgical margins are free of tumor cells—a costly and time- and labor-intensive procedure. Here, we introduce a deep-learning extended DOF (DeepDOF) microscope to quickly image large areas of freshly resected tissue to provide histologic-quality images of surgical margins without physical sectioning. The DeepDOF microscope consists of a conventional fluorescence microscope with the simple addition of an inexpensive (less than $10) phase mask inserted in the pupil plane to encode the light field and enhance the depth-invariance of the point-spread function. When used with a jointly optimized image-reconstruction algorithm, diffraction-limited optical performance to resolve subcellular features can be maintained while significantly extending the DOF (200 µm). Data from resected oral surgical specimens show that the DeepDOF microscope can consistently visualize nuclear morphology and other important diagnostic features across highly irregular resected tissue surfaces without serial refocusing. With the capability to quickly scan intact samples with subcellular detail, the DeepDOF microscope can improve tissue sampling during intraoperative tumor-margin assessment, while offering an affordable tool to provide histological information from resected tissue specimens in resource-limited settings.
more »
« less
- PAR ID:
- 10215414
- Date Published:
- Journal Name:
- Proceedings of the National Academy of Sciences
- Volume:
- 117
- Issue:
- 52
- ISSN:
- 0027-8424
- Page Range / eLocation ID:
- 33051 to 33060
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Intraoperative imaging of slide-free specimens is crucial for oncology surgeries, allowing surgeons to quickly identify tumor margins for precise surgical guidance. While high-resolution ultraviolet photoacoustic microscopy has been demonstrated for slide-free histology, the imaging speed is insufficient, due to the low laser repetition rate and the limited depth of field. To address these challenges, we present parallel ultraviolet photoacoustic microscopy (PUV-PAM) with simultaneous scanning of eight optical foci to acquire histology-like images of slide-free fresh specimens, improving the ultraviolet PAM imaging speed limited by low laser repetition rates. The PUV-PAM has achieved an imaging speed of 0.4 square millimeters per second (i.e., 4.2 minutes per square centimeter) at 1.3-micrometer resolution using a 50-kilohertz laser. In addition, we demonstrated the PUV-PAM with eight needle-shaped beams for an extended depth of field, allowing fast imaging of slide-free tissues with irregular surfaces. We believe that the PUV-PAM approach will enable rapid intraoperative photoacoustic histology and provide prospects for ultrafast optical-resolution PAM.more » « less
-
Single-shot 3D optical microscopy that can capture high-resolution information over a large volume has broad applications in biology. Existing 3D imaging methods using point-spread-function (PSF) engineering often have limited depth of field (DOF) or require custom and often complex design of phase masks. We propose a new, to the best of our knowledge, PSF approach that is easy to implement and offers a large DOF. The PSF appears to be axially V-shaped, engineered by replacing the conventional tube lens with a pair of axicon lenses behind the objective lens of a wide-field microscope. The 3D information can be reconstructed from a single-shot image using a deep neural network. Simulations in a 10× magnification wide-field microscope show the V-shaped PSF offers excellent 3D resolution (<2.5 µm lateral and ∼15 µm axial) over a ∼350 µm DOF at a 550 nm wavelength. Compared to other popular PSFs designed for 3D imaging, the V-shaped PSF is simple to deploy and provides high 3D reconstruction quality over an extended DOF.more » « less
-
Abstract The first line of treatment for most solid tumors is surgical resection of the primary tumor with adequate negative margins. Incomplete tumor resections with positive margins account for over 75% of local recurrences and the development of distant metastases. In cases of oral cavity squamous cell carcinoma (OSCC), the rate of successful tumor removal with adequate margins is just 50–75%. Advanced real‐time imaging methods that improve the detection of tumor margins can help improve success rates,overall safety, and reduce the cost. Fluorescence imaging in the second near‐infrared (NIR‐II) window has the potential to revolutionize the field due to its high spatial resolution, low background signal, and deep tissue penetration properties, but NIR‐II dyes with adequate in vivo performance and safety profiles are scarce. A novel NIR‐II fluorophore, XW‐03‐66, with a fluorescence quantum yield (QY) of 6.0% in aqueous media is reported. XW‐03‐66 self‐assembles into nanoparticles (≈80 nm) and has a systemic circulation half‐life ( t 1/2 ) of 11.3 h. In mouse models of human papillomavirus (HPV)+ and HPV‐ OSCC, XW‐03‐66 outperformed indocyanine green (ICG), a clinically available NIR dye, and enabled intraoperative NIR‐II image‐guided resection of the tumor and adjacent draining lymph node with negative margins. In vitro and in vivo toxicity assessments revealed minimal safety concerns for in vivo applications.more » « less
-
The ability to accurately define tumor margins may enhance tissue sparing and increase efficiency in the dermatologic surgery process, but no device exists that serves this role. Reflectance Confocal Microscopy (RCM) provides non-invasive cellular resolution of the skin. The only clinically-approved RCM device is bulky, non-portable, and requires a tissue cap which makes mapping of the underlying tissue impossible. We recently combined “virtual histology”, a machine learning algorithm with RCM images from this standard RCM device to generate biopsy-free histology to overcome these limitations. Whether virtual histology can be used with a portable, handheld RCM device to scan for residual tumor and tumor margins is currently unknown. We hypothesize that combining a handheld RCM device with virtual histology could provide accurate tumor margin assessment. We determined whether our established virtual histology algorithm could be applied to images from a portable RCM device and whether these pseudo-stained virtual histology images correlated with histology from skin specimens. The study was conducted as a prospective, consecutive non-randomized trial at a Veterans Affairs Medical Center dermatologic surgery clinic. All patients greater than 18 years of age with previously biopsied BCC, SCC, or SCCis were included. Successive confocal images from the epidermis to the dermis were obtained 1.5 microns apart from the handheld RCM device to detect residual skin cancer. The handheld, in-vivo RCM images were processed through a conditional generative adversarial network-based machine learning algorithm to digitally convert the images into H&E pseudo-stained virtual histology images. Virtual histology of in-vivo RCM images from unbiopsied skin captured with the portable RCM device were similar to those obtained with the standard RCM device and virtual histology applied to portable RCM images correctly correlated with frozen section histology. Residual tumors detected with virtual histology generated from the portable RCM images accurately corresponded with residual tumors shown in the frozen surgical tissue specimen. Residual tumor was also not detected when excised tissue was clear of tumor following surgical procedure. Thus, the combination of virtual histology with portable RCM may provide accurate histology-quality data for evaluation of residual skin cancer prior to surgery. Combining machine learning-based virtual histology with handheld RCM images demonstrates promise in providing insights into tumor characteristics and has the potential to assist the surgeon and better guide practice decisions to more efficiently serve patients, leading to decreased layers and appointment times. Future work is needed to provide real-time virtual histology, convert horizontal/confocal sections into vertical or 3D sections, and to perform clinical studies to map tumors in tissue.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1073/pnas.2013571117
