Search for: All records

The variability and biases in the real-world performance benchmarking of deep learning models for medical imaging compromise their trustworthiness for real-world deployment. The common approach of holding out a single fixed test set fails to quantify the variance in the estimation of test performance metrics. This study introduces NACHOS (Nested and Automated Cross-validation and Hyperparameter Optimization using Supercomputing) to reduce and quantify the variance of test performance metrics of deep learning models. NACHOS integrates Nested Cross-Validation (NCV) and Automated Hyperparameter Optimization (AHPO) within a parallelized high-performance computing (HPC) framework. NACHOS was demonstrated on a chest X-ray repository and an Optical Coherence Tomography (OCT) dataset under multiple data partitioning schemes. Beyond performance estimation, DACHOS (Deployment with Automated Cross-validation and Hyperparameter Optimization using Supercomputing) is introduced to leverage AHPO and cross-validation to build the final model on the full dataset, improving expected deployment performance. The findings underscore the importance of NCV in quantifying and reducing estimation variance, AHPO in optimizing hyperparameters consistently across test folds, and HPC in ensuring computational feasibility. By integrating these methodologies, NACHOS and DACHOS provide a scalable, reproducible, and trustworthy framework for DL model evaluation and deployment in medical imaging. 

Background: At the time of cancer diagnosis, it is crucial to accurately classify malignant gastric tumors and the possibility that patients will survive. Objective: This study aims to investigate the feasibility of identifying and applying a new feature extraction technique to predict the survival of gastric cancer patients. Methods: A retrospective dataset including the computed tomography (CT) images of 135 patients was assembled. Among them, 68 patients survived longer than three years. Several sets of radiomics features were extracted and were incorporated into a machine learning model, and their classification performance was characterized. To improve the classification performance, we further extracted another 27 texture and roughness parameters with 2484 superficial and spatial features to propose a new feature pool. This new feature set was added into the machine learning model and its performance was analyzed. To determine the best model for our experiment, Random Forest (RF) classifier, Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Naïve Bayes (NB) (four of the most popular machine learning models) were utilized. The models were trained and tested using the five-fold cross-validation method. Results: Using the area under ROC curve (AUC) as an evaluation index, the model that was generated using the new feature pool yields AUC = 0.98 ± 0.01, which was significantly higher than the models created using the traditional radiomics feature set (p < 0.04). RF classifier performed better than the other machine learning models. Conclusions: This study demonstrated that although radiomics features produced good classification performance, creating new feature sets significantly improved the model performance. 

Kidney cancer is a kind of high mortality cancer because of the difficulty in early diagnosis and the high metastatic dissemination in treatments. The surgical resection of tumors is the most effective treatment for renal cancer patients. However, precise assessment of tumor margins is a challenge during surgical resection. The objective of this study is to demonstrate an optical imaging tool in precisely distinguishing kidney tumor borders and identifying tumor zones from normal tissues to assist surgeons in accurately resecting tumors from kidneys during the surgery. 30 samples from six human kidneys were imaged using polarization-sensitive optical coherence tomography (PS-OCT). Cross-sectional, enface, and spatial information of kidney samples were obtained for microenvironment reconstruction. Polarization parameters (phase retardation, optic axis direction, and degree of polarization uniformity (DOPU) and Stokes parameters (Q, U, and V) were utilized for multiparameter analysis. To verify the detection accuracy of PS-OCT, H&E histology staining and dice-coefficient were utilized to quantify the performance of PS-OCT in identifying tumor borders and regions. In this study, tumor borders were clearly identified by PS-OCT imaging, which outperformed the conventional intensity-based OCT. With H&E histological staining as golden standard, PS-OCT precisely identified the tumor regions and tissue distributions at different locations and different depths based on polarization and Stokes parameters. Compared to the traditional attenuation coefficient quantification method, PS-OCT demonstrated enhanced contrast of tissue characteristics between normal and cancerous tissues due to the birefringence effects. Our results demonstrated that PS-OCT was promising to provide imaging guidance for the surgical resection of kidney tumors and had the potential to be used for other human kidney surgeries in clinics such as renal biopsy. 

Abstract Epidural anesthesia helps manage pain during different surgeries. Nonetheless, the precise placement of the epidural needle remains a challenge. In this study, we developed a probe based on polarization‐sensitive optical coherence tomography (PS‐OCT) to enhance the epidural anesthesia needle placement. The probe was tested on six porcine spinal samples. The multimodal imaging guidance used the OCT intensity mode and three distinct PS‐OCT modes: (1) phase retardation, (2) optic axis, and (3) degree of polarization uniformity (DOPU). Each mode enabled the classification of different epidural tissues through distinct imaging characteristics. To further streamline the tissue recognition procedure, convolutional neural network (CNN) were used to autonomously identify the tissue types within the probe's field of view. ResNet50 models were developed for all four imaging modes. DOPU imaging was found to provide the highest cross‐testing accuracy of 91.53%. These results showed the improved precision by PS‐OCT in guiding epidural anesthesia needle placement.