An official website of the United States government
Among the different types of skin cancer, melanoma is considered to be the deadliest and is difficult to treat at advanced stages. Detection of melanoma at earlier stages can lead to reduced mortality rates. Desktop-based computer-aided systems have been developed to assist dermatologists with early diagnosis. However, there is significant interest in developing portable, at-home melanoma diagnostic systems which can assess the risk of cancerous skin lesions. Here, we present a smartphone application that combines image capture capabilities with preprocessing and segmentation to extract the Asymmetry, Border irregularity, Color variegation, and Diameter (ABCD) features of a skin lesion. Using the feature sets, classification of malignancy is achieved through support vector machine classifiers. By using adaptive algorithms in the individual data-processing stages, our approach is made computationally light, user friendly, and reliable in discriminating melanoma cases from benign ones. Images of skin lesions are either captured with the smartphone camera or imported from public datasets. The entire process from image capture to classification runs on an Android smartphone equipped with a detachable 10x lens, and processes an image in less than a second. The overall performance metrics are evaluated on a public database of 200 images with Synthetic Minority Over-sampling Technique (SMOTE) (80% sensitivity, 90% specificity, 88% accuracy, and 0.85 area under curve (AUC)) and without SMOTE (55% sensitivity, 95% specificity, 90% accuracy, and 0.75 AUC). The evaluated performance metrics and computation times are comparable or better than previous methods. This all-inclusive smartphone application is designed to be easy-to-download and easy-to-navigate for the end user, which is imperative for the eventual democratization of such medical diagnostic systems.
more »
« less
LesionNet: an automated approach for skin lesion classification using SIFT features with customized convolutional neural network
Accurate detection of skin lesions through computer-aided diagnosis has emerged as a critical advancement in dermatology, addressing the inefficiencies and errors inherent in manual visual analysis. Despite the promise of automated diagnostic approaches, challenges such as image size variability, hair artifacts, color inconsistencies, ruler markers, low contrast, lesion dimension differences, and gel bubbles must be overcome. Researchers have made significant strides in binary classification problems, particularly in distinguishing melanocytic lesions from normal skin conditions. Leveraging the “MNIST HAM10000” dataset from the International Skin Image Collaboration, this study integrates Scale-Invariant Feature Transform (SIFT) features with a custom convolutional neural network model called LesionNet. The experimental results reveal the model's robustness, achieving an impressive accuracy of 99.28%. This high accuracy underscores the effectiveness of combining feature extraction techniques with advanced neural network models in enhancing the precision of skin lesion detection.
more »
« less
- Award ID(s):
- 2414513
- PAR ID:
- 10565477
- Publisher / Repository:
- Frontiers in Medicine
- Date Published:
- Journal Name:
- Frontiers in Medicine
- Volume:
- 11
- ISSN:
- 2296-858X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Techniques are developed for generating uncertainty estimates for convolutional neural network (CNN)-based methods for registering the locations of lesions between the craniocaudal (CC) and mediolateral oblique (MLO) mammographic X-ray image views. Multi-view lesion correspondence is an important task that clinicians perform for characterizing lesions during routine mammographic exams. Automated registration tools can aid in this task, yet if the tools also provide confidence estimates, they can be of greater value to clinicians, especially in cases involving dense tissue where lesions may be difficult to see. A set of deep ensemble-based techniques, which leverage a negative log-likelihood (NLL)-based cost function, are implemented for estimating uncertainties. The ensemble architectures involve significant modifications to an existing CNN dual-view lesion registration algorithm. Three architectural designs are evaluated, and different ensemble sizes are compared using various performance metrics. The techniques are tested on synthetic X-ray data, real 2D X-ray data, and slices from real 3D X-ray data. The ensembles generate covariance-based uncertainty ellipses that are correlated with registration accuracy, such that the ellipse sizes can give a clinician an indication of confidence in the mapping between the CC and MLO views. The results also show that the ellipse sizes can aid in improving computer-aided detection (CAD) results by matching CC/MLO lesion detects and reducing false alarms from both views, adding to clinical utility. The uncertainty estimation techniques show promise as a means for aiding clinicians in confidently establishing multi-view lesion correspondence, thereby improving diagnostic capability.more » « less
-
Anthropogenic global change is occurring at alarming rates, leading to increased urgency in the ability to monitor wildlife health in real time. Monitoring sentinel marine species, such as bottlenose dolphins, is particularly important due to extensive anthropogenic modifications to their habitats. The most common non-invasive method of monitoring cetacean health is documentation of skin lesions, often associated with poor health or disease, but the current methodology is inefficient and imprecise. Recent advancements in technology, such as machine learning, can provide researchers with more efficient ecological monitoring methods to address health questions at both the population and the individual levels. Our work develops a machine learning model to classify skin lesions on the understudied Tamanend's bottlenose dolphins (Tursiops erebennus) of the Chesapeake Bay, using manual estimates of lesion presence in photographs. We assess the model's performance and find that our best model performs with a high mean average precision (65.6 %–86.8 %), and generally increased accuracy with improved photo quality. We also demonstrate the model's ability to address ecological questions across scales by generating model-based estimates of lesion prevalence and testing the effect of gregariousness on health status. At the population level, our model accurately estimates a prevalence of 72.1 % spot and 27.3 % fringe ring lesions, with a slight underprediction compared to manual estimates (82.2 % and 32.1 %). On the other hand, we find that individual-level analyses from the model predictions may be more sensitive to data quality, and thus, some individual scale questions may not be feasible to address if data quality is inconsistent. Manually, we do find that lesion presence in individuals suggests a positive relationship between lesion presence and gregariousness. This work demonstrates that object detection models on photographic data are reasonably successful, highly efficient, and provide initial estimates on the health status of understudied populations of bottlenose dolphins.more » « less
-
null (Ed.)Knowing when a machine learning system is not confident about its prediction is crucial in medical domains where safety is critical. Ideally, a machine learning algorithm should make a prediction only when it is highly certain about its competency, and refer the case to physicians otherwise. In this paper, we investigate how Bayesian deep learning can improve the performance of the machine–physician team in the skin lesion classification task. We used the publicly available HAM10000 dataset, which includes samples from seven common skin lesion categories: Melanoma (MEL), Melanocytic Nevi (NV), Basal Cell Carcinoma (BCC), Actinic Keratoses and Intraepithelial Carcinoma (AKIEC), Benign Keratosis (BKL), Dermatofibroma (DF), and Vascular (VASC) lesions. Our experimental results show that Bayesian deep networks can boost the diagnostic performance of the standard DenseNet-169 model from 81.35% to 83.59% without incurring additional parameters or heavy computation. More importantly, a hybrid physician–machine workflow reaches a classification accuracy of 90 % while only referring 35 % of the cases to physicians. The findings are expected to generalize to other medical diagnosis applications. We believe that the availability of risk-aware machine learning methods will enable a wider adoption of machine learning technology in clinical settings.more » « less
-
Abstract Background Low specificity in current breast imaging modalities leads to increased unnecessary follow-ups and biopsies. The purpose of this study is to evaluate the efficacy of combining the quantitative parameters of high-definition microvasculature imaging (HDMI) and 2D shear wave elastography (SWE) with clinical factors (lesion depth and age) for improving breast lesion differentiation. Methods In this prospective study, from June 2016 through April 2021, patients with breast lesions identified on diagnostic ultrasound and recommended for core needle biopsy were recruited. HDMI and SWE were conducted prior to biopsies. Two new HDMI parameters, Murray’s deviation and bifurcation angle, and a new SWE parameter, mass characteristic frequency, were included for quantitative analysis. Lesion malignancy prediction models based on HDMI only, SWE only, the combination of HDMI and SWE, and the combination of HDMI, SWE and clinical factors were trained via elastic net logistic regression with 70% (360/514) randomly selected data and validated with the remaining 30% (154/514) data. Prediction performances in the validation test set were compared across models with respect to area under the ROC curve as well as sensitivity and specificity based on optimized threshold selection. Results A total of 508 participants (mean age, 54 years ± 15), including 507 female participants and 1 male participant, with 514 suspicious breast lesions (range, 4–72 mm, median size, 13 mm) were included. Of the lesions, 204 were malignant. The SWE-HDMI prediction model, combining quantitative parameters from SWE and HDMI, with AUC of 0.973 (95% CI 0.95–0.99), was significantly higher than the result predicted with the SWE model or HDMI model alone. With an optimal cutoff of 0.25 for the malignancy probability, the sensitivity and specificity were 95.5% and 89.7%, respectively. The specificity was further improved with the addition of clinical factors. The corresponding model defined as the SWE-HDMI-C prediction model had an AUC of 0.981 (95% CI 0.96–1.00). Conclusions The SWE-HDMI-C detection model, a combination of SWE estimates, HDMI quantitative biomarkers and clinical factors, greatly improved the accuracy in breast lesion characterization.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.3389/fmed.2024.1487270
