skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


  • NSF Public Access
  • Search Results
  • Monocular depth estimation based on deep learning for intraoperative guidance using surface-enhanced Raman scattering imaging

This content will become publicly available on January 1, 2026

Title: Monocular depth estimation based on deep learning for intraoperative guidance using surface-enhanced Raman scattering imaging
Imaging of surface-enhanced Raman scattering (SERS) nanoparticles (NPs) has been intensively studied for cancer detection due to its high sensitivity, unconstrained low signal-to-noise ratios, and multiplexing detection capability. Furthermore, conjugating SERS NPs with various biomarkers is straightforward, resulting in numerous successful studies on cancer detection and diagnosis. However, Raman spectroscopy only provides spectral data from an imaging area without co-registered anatomic context. This is not practical and suitable for clinical applications. Here, we propose a custom-made Raman spectrometer with computer-vision-based positional tracking and monocular depth estimation using deep learning (DL) for the visualization of 2D and 3D SERS NPs imaging, respectively. In addition, the SERS NPs used in this study (hyaluronic acid-conjugated SERS NPs) showed clear tumor targeting capabilities (target CD44 typically overexpressed in tumors) by anex vivoexperiment and immunohistochemistry. The combination of Raman spectroscopy, image processing, and SERS molecular imaging, therefore, offers a robust and feasible potential for clinical applications.  more » « less
Award ID(s):
2237142
PAR ID:
10586503
Author(s) / Creator(s):
; ; ; ; ; ; ; ; ; ; ; ; ; ;
Publisher / Repository:
Optica
Date Published:
Journal Name:
Photonics Research
Volume:
13
Issue:
2
ISSN:
2327-9125
Page Range / eLocation ID:
550
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; ; ; ; ; ; (, Small Science)
    Surface enhanced resonance Raman (SERS) is a powerful optical technique, which can help enhance the sensitivity of Raman spectroscopy aided by noble metal nanoparticles (NPs). However, current SERS‐NPs are often suboptimal, which can aggregate under physiological conditions with much reduced SERS enhancement. Herein, a robust one‐pot method has been developed to synthesize SERS‐NPs with more uniform core diameters of 50 nm, which is applicable to both non‐resonant and resonant Raman dyes. The resulting SERS‐NPs are colloidally stable and bright, enabling NP detection with low‐femtomolar sensitivity. An algorithm has been established, which can accurately unmix multiple types of SERS‐NPs enabling potential multiplex detection. Furthermore, a new liposome‐based approach has been developed to install a targeting carbohydrate ligand, i.e., hyaluronan, onto the SERS‐NPs bestowing significantly enhanced binding affinity to its biological receptor CD44 overexpressed on tumor cell surface. The liposomal hyaluronan (HA)‐SERS‐NPs enabled visualization of spontaneously developed breast cancer in mice in real time guiding complete surgical removal of the tumor, highlighting the translational potential of these new glyco‐SERS‐NPs. 
    more » « less
  2. ; ; ; ; ; ; ; ; ; ; et al (, Advanced Functional Materials)
    Abstract Nanoparticle‐based nucleic acid conjugates (NP‐NACs) hold great promise for theragnostic applications. However, several limitations have hindered the realization of their full potential in the clinical treatment of cancer and other diseases. In diagnoses, NP‐NACs suffer from low signal‐to‐noise ratios, while the efficiency of NP‐NACs‐mediated cancer therapies has been limited by the adaptation of alternative prosurvival pathways in cancer cells. The recent emergence of personalized and precision medicine has outlined the importance of having both accurate diagnosis and efficient therapeutics in a single platform. As such, the controlled assembly of hybrid graphene oxide/gold nanoparticle (Au@GO NP)‐based cancer‐specific NACs (Au@GO NP‐NACs) for multimodal imaging and combined therapeutics is reported. The developed Au@GO NP‐NACs show excellent surface‐enhanced Raman scattering (SERS)‐mediated live‐cell cancer detection and multimodal synergistic cancer therapy through the use of photothermal, genetic, and chemotherapeutic strategies. Synergistic and selective killing of cancer cells are then demonstrated using in vitro microfluidic models. Moreover, with the distinctive advantages of the Au@GO NP‐NACs for cancer theragnostics, precision cancer treatment through the detection of cancer cells in vivo using SERS followed by efficient ablation of tumors is shown. Therefore, the Au@GO NP‐NACs can pave a new road for advanced disease theragnostics. 
    more » « less
  3. ; ; ; ; ; ; ; ; (, Small)
    Abstract The enormous increase of Raman signal in the vicinity of metal nanoparticles allows surface‐enhanced Raman spectroscopy (SERS) to be employed for label‐free detection of substances at extremely low concentrations. However, the ultimate potential of label‐free SERS to identify pharmaceutical compounds at low concentrations, especially in relation to biofluid sensing, is far from being fully realized. Opioids are a particular challenge for rapid clinical identification because their molecular structural similarities prevent their differentiation with immunolabeling approaches. In this paper, a new method called quantitative label‐free SERS (QLF‐SERS) which involves the formation of halide‐conjugated gold nanoclusters trapping the analyte of interest near the SERS hot spots is reported, and it is demonstrated that it yields a 105fold improvement in the detection limit over previously reported results for the entire class of clinically relevant opioids and their metabolites. Measurements of opioid concentrations in multicomponent mixtures are also demonstrated. QLF‐SERS has comparable detection limits as currently existing laboratory urine drug testing techniques but is significantly faster and inexpensive and, therefore, can be easily adapted as part of a rapid clinical laboratory routine. 
    more » « less
  4. ; ; ; ; ; ; ; ; ; (, Advanced Healthcare Materials)
    Abstract Lipid metabolism and glycolysis play crucial roles in the progression and metastasis of cancer, and the use of 3‐bromopyruvate (3‐BP) as an antiglycolytic agent has shown promise in killing pancreatic cancer cells. However, developing an effective strategy to avoid chemoresistance requires the ability to probe the interaction of cancer drugs with complex tumor‐associated microenvironments (TAMs). Unfortunately, no robust and multiplexed molecular imaging technology is currently available to analyze TAMs. In this study, the simultaneous profiling of three protein biomarkers using SERS nanotags and antibody‐functionalized nanoparticles in a syngeneic mouse model of pancreatic cancer (PC) is demonstrated. This allows for comprehensive information about biomarkers and TAM alterations before and after treatment. These multimodal imaging techniques include surface‐enhanced Raman spectroscopy (SERS), immunohistochemistry (IHC), polarized light microscopy, second harmonic generation (SHG) microscopy, fluorescence lifetime imaging microscopy (FLIM), and untargeted liquid chromatography and mass spectrometry (LC‐MS) analysis. The study reveals the efficacy of 3‐BP in treating pancreatic cancer and identifies drug treatment‐induced lipid species remodeling and associated pathways through bioinformatics analysis. 
    more » « less
  5. ; ; (, Applied Spectroscopy)
    The ability to combine microscopy and spectroscopy is beneficial for directly monitoring physical and biological processes. Spectral imaging approaches, where a transmission diffraction grating is placed near an imaging sensor to collect both the spatial image and spectrum for each object in the field of view, provide a relatively simple method to simultaneously collect images and spectroscopic responses on the same sensor. Initially demonstrated with fluorescence spectroscopy, the use of spectral imaging in Raman spectroscopy and surface-enhanced Raman spectroscopy (SERS) can provide a vibrational spectrum containing molecularly specific information that can inform on chemical changes. However, a major complication to this approach is the spectral overlap that occurs when objects are spaced closely together horizontally. In this work, we add a dove prism to a spectral imaging instrument developed for SERS imaging, enabling rotation of the collected SERS image and dispersed spectrum onto the imaging complementary metal-oxide semiconductor (CMOS) sensor. We demonstrate that this effectively reduces spectral overlap for emitters with clear separation between them and emitters with slightly overlapping point spread functions thereby facilitating collection of unambiguous spectra from each emitter. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email