Computer-Aided Decision Support for Melanoma Detection Applied on Melanocytic and Nonmelanocytic Skin Lesions: A Comparison of Two Systems Based on Automatic Analysis of Dermoscopic Images

Møllersen, Kajsa; Kirchesch, Herbert; Zortea, Maciel; Schopf, Thomas R.; Hindberg, Kristian; Godtliebsen, Fred

doi:https://doi.org/10.1155/2015/579282

BioMed Research International

On this page

Abstract Introduction Materials and Methods Results and Discussion Conclusions References Copyright Related Articles

Special Issue

Cutaneous Oncology: From Research to Diagnosis and Management

View this Special Issue

Research Article | Open Access

Volume 2015 | Article ID 579282 | https://doi.org/10.1155/2015/579282

Computer-Aided Decision Support for Melanoma Detection Applied on Melanocytic and Nonmelanocytic Skin Lesions: A Comparison of Two Systems Based on Automatic Analysis of Dermoscopic Images

Kajsa Møllersen,¹Herbert Kirchesch,²Maciel Zortea,³Thomas R. Schopf,¹Kristian Hindberg,³and Fred Godtliebsen³

Academic Editor: Elisabeth Roider

Received11 Sept 2015

Accepted03 Nov 2015

Published26 Nov 2015

Abstract

Commercially available clinical decision support systems (CDSSs) for skin cancer have been designed for the detection of melanoma only. Correct use of the systems requires expert knowledge, hampering their utility for nonexperts. Furthermore, there are no systems to detect other common skin cancer types, that is, nonmelanoma skin cancer (NMSC). As early diagnosis of skin cancer is essential, there is a need for a CDSS that is applicable to all types of skin lesions and is suitable for nonexperts. Nevus Doctor (ND) is a CDSS being developed by the authors. We here investigate ND’s ability to detect both melanoma and NMSC and the opportunities for improvement. An independent test set of dermoscopic images of 870 skin lesions, including 44 melanomas and 101 NMSCs, were analysed by ND. Its sensitivity to melanoma and NMSC was compared to that of Mole Expert (ME), a commercially available CDSS, using the same set of lesions. ND and ME had similar sensitivity to melanoma. For ND at 95% melanoma sensitivity, the NMSC sensitivity was 100%, and the specificity was 12%. The melanomas misclassified by ND at 95% sensitivity were correctly classified by ME, and vice versa. ND is able to detect NMSC without sacrificing melanoma sensitivity.

1. Introduction

Melanoma is the deadliest of all skin cancers. When it is detected early, the treatment is excision of the tumour, and the survival rate is high. Recent developments in melanoma treatment are promising [1, 2], but the survival rate for patients with metastasised melanoma is still poor [3, 4]. Early diagnosis is crucial, but challenging, since early stage melanomas resemble benign skin lesions. Other types of skin cancer, like basal cell carcinoma (BCC) and squamous cell carcinoma (SCC), have high incidence rates but low mortality rates [4]. Early detection is beneficiary for the patient to get early treatment and avoid further damaging of the surrounding skin.

The dermoscope (dermatoscope, epiluminescence microscope) reveals structures not visible to the naked eye and has proven to raise diagnostic accuracy of melanoma when used by properly trained personnel [5]. Dermoscopy has not reached widespread use among general practitioners (GPs), except in Australia [6]. In view of increased melanoma incidence rates, national screening programmes, and growing awareness of skin cancer in the public, there seems to be a need for clinical decision support systems (CDSSs) for GPs not familiar with dermoscopy.

For the past few decades, many CDSSs (also referred to as computer-aided diagnostic (CAD) systems) have been developed for melanoma detection. For a description of the major steps and an overview of different technologies, see, for example, [7]. The review paper of Rosado et al. [8] from 2003 concluded that the diagnostic accuracy of the CDSSs was statistically not superior to that of human diagnosis. Vestergaard and Menzies [9] reported the same in 2008, and Korotkov and Garcia [10] made a similar conclusion in 2012. Simultaneously high sensitivity and specificity scores have been reported [11], but the scores dropped when the same systems were tested in clinical-like settings with an independent test set of consecutively collected images. Dreiseitl et al. [12] concluded that the performance of their system in a clinical-like setting was significantly lower than the result obtained during training. Elbaum et al. [13] reported 100% sensitivity and 85% specificity on the training set, with a dramatic drop in specificity to 9% on an independent test set [14]. Also, Bauer et al. reported better results for the training set [15] than those achieved with an independent test set [16]. The good results of Hoffmann et al. [17] were reproduced in a small study with only melanomas [18] but declined in another small study [19]. In two other small studies with independent test sets [20, 21], the performance reported by Blum et al. [22] declined. There are several possible explanations for the drop in performance. In studies where cross-validation has been used to validate the performance, the whole data set is used for feature selection or model selection, which gives overly optimistic results [23, 24]. Also, several studies exclude nonmelanocytic lesions post hoc based on the pathology reports, which introduces bias.

Differentiating between melanocytic and nonmelanocytic lesions can be challenging even for experienced dermoscopy users [25], and it is recommended that a CDSS for melanoma detection can handle nonmelanocytic lesions as well [8, 11, 26]. A lesion is classified as suspicious if it resembles a melanoma, but lesions that resemble NMSC should also be classified as suspicious, especially when used by GPs [27], and not be classified together with nonsuspicious lesions.

In this report we present the performance of a CDSS for melanoma detection, Nevus Doctor (ND), when applied to both melanocytic and nonmelanocytic lesions. To our knowledge, this has not been previously presented for image-based CDSSs. Shimizu et al. [28] included BCC but excluded other NMSCs. Several studies have included nonmelanocytic lesions, but without reporting sensitivity to NMSC [14–17, 29–31] or with less than three NMSCs [20, 32]. Recently, non-image-based technologies for melanoma detection have included NMSC sensitivity in their reported findings [33, 34].

There is no apparent ranking of the CDSSs for melanoma detection. In practice, CDSSs can only be compared if tested on the same set of lesions, as done by Perrinaud et al. [32]. We therefore compare the performance of ND to that of a commercially available system, Mole Expert (ME), on the same set of lesions. This methodology potentially identifies the diagnostic difficulty of the data set, supplementing the information on the proportion of melanomas in situ, Breslow depth, clinical diagnoses, and so forth. It also allows for indirect comparison of CDSSs if, in the future, some study chose to compare another system to ME.

2. Materials and Methods

2.1. Data

From March to December 2013, patients were recruited at a private dermatology practice in Pulheim, Germany. Adult patients scheduled for excision of a pigmented skin lesion were eligible for inclusion. Furthermore, patients who were having nonpigmented skin lesions excised were eligible for inclusion if melanoma, BCC, or SCC was a potential differential diagnosis. Patients attending the German skin cancer screening programme [35] were also eligible for inclusion if they had skin lesions selected for excision. Informed written consent was obtained from all patients prior to inclusion. Skin lesions were excised because of concern about malignancy or when requested by the patient for other reasons. All skin lesions were photographed prior to excision with a digital camera (Canon G10, Canon Inc., Tokyo, Japan) with an attached dermoscope (DermLite FOTO, 3Gen LLC, California, USA) and with a videodermoscope (DermoGenius ultra, DermoScan GmbH, Regensburg, Germany). All excised lesions were examined by a dermatopathologist. In the case of a malignant diagnosis, a second dermatopathologist examined the excised lesion and a consensus diagnosis was set.

2.2. Automatic Image Analysis

ND takes a dermoscopic image from the Canon/DermLite device as input and classifies the lesion. ND is still in an experimental phase. In a previous study, ND performed as well as three independent dermatologists in terms of melanoma sensitivity and specificity [36]. In another study, ND performed as well as an independent dermatologist on an independent test set consisting of melanomas and benign lesions [37]. The data set in this study partly overlaps with the test set in Møllersen et al. [37], but not with the training set. ND has not been retrained, so the present data set is independent. ND outputs a probability of malignancy for each lesion image, and the sensitivity can be tuned with a parameter (see [36–38] for details).

ME (MoleExpert micro Version 3.3.30.156) takes a dermoscopic image from the DermoGenius device as input. The output is a number between and , where high values indicate suspicion of melanoma, and the sensitivity can be tuned by adjusting a threshold . ME is intended for use on melanocytic lesions only. ME was chosen as the comparison system due to availability and the fact that it has been tested and compared to other commercial systems in clinical settings on a small scale [29, 32]. To our knowledge, the study of Perrinaud et al. [32] is the only study that compares several systems on the same set of lesions, and it is therefore not possible to pick the most adequate reference system.

2.3. Statistical Analysis

All excised lesions for which a pathology report was available were included in the analysis. Cases were excluded if either of the CDSSs could not give an output or if images were missing. Presence of hairs and bubbles, lesion size, inadequate segmentation, and so forth were not used as exclusion criteria. The data was divided into four classes according to the histopathological diagnosis: melanoma, NMSC, benign melanocytic lesions, and benign nonmelanocytic lesions. The melanoma class includes lesions where malignancy could not be ruled out by the dermatopathologists (ICD-10 D48.5), and the NMSC class includes precancerous lesions, as done in other studies [33, 34]. Precancerous lesions should be classified as suspicious, since the patient should receive treatment or follow-up. The sensitivity and specificity scores of ND and ME were calculated by adjusting parameters and and classifying the lesions accordingly. Sensitivity refers to the ratio of malignant lesions classified as suspicious to the total number of malignant lesions. Since there are two classes of malignant lesions, the terms melanoma sensitivity and NMSC sensitivity are used for clarification when needed.

The clinical diagnoses are taken from the dermatologist’s referrals to pathology. The clinical malignant class includes lesions where malignancy is a differential diagnosis. The clinical benign class consists of lesions that were given a benign diagnosis by the dermatologist but were referred to pathology, which indicates that malignancy could not be ruled out by the dermatologist, even if this was not explicitly stated.

3. Results and Discussion

3.1. Results

There were consultations (47% women) included in the study and a total of excised lesions. The minimum age was 18, the maximum age was 93, and median age was 53 years. Table 1 shows the histopathological diagnoses. The ratio of benign lesions per melanoma was 16 : 1, which is within the range for dermatologists [39, 40]. In total, of the lesions were melanomas. The median Breslow depth for the 23 invasive melanomas was 0.50 mm, and the maximum Breslow depth was mm. Table 2 shows the diagnoses and the Breslow depths according to the 2009 American Joint Committee on Cancer (AJCC) staging [41]. About of the melanomas and about of the NMSCs were clinically diagnosed as malignant. One lesion lacked clinical diagnosis. Of the lesions with histopathological diagnosis, four were excluded because ME did not give an output (one naevus, one seborrheic keratosis, one BCC, and one SCC) and one was excluded because the Canon/DermLite image was lost (melanoma in situ), which corresponds to less than of the images. In comparison, of the lesions were excluded due to lesions size or device malfunctions in the study by Malvehy et al. [33].

Figure 1(a) shows receiver operating characteristic (ROC) curves for ND and ME. The red and blue solid curves show sensitivity versus specificity for the whole data set where the malignant class includes both melanoma and NMSC, and a clear distinction between ND and ME can be seen. The pink and turquoise dotted curves show sensitivity versus specificity for melanocytic lesions only, and there is no significant difference between ND and ME. Figure 1(b) shows NMSC sensitivity as a function of melanoma sensitivity.

(a)

(b)

The boxplots in Figure 2 illustrate each CDSS’s ability to discriminate between the different classes of lesions. For both ND and ME, there is an overlap between melanomas in situ and benign melanocytic lesions, whereas invasive melanomas can be separated from benign melanocytic lesions. ND has high scores for NMSC, but also for benign nonmelanocytic lesions. ME has greater relative variety for all categories than ND has which lead to larger overlaps and thus more difficulty in distinguishing the different categories.

(a)

(b)

For ND at melanoma sensitivity, the overall sensitivity was , the specificity was , the positive predictive value (PPV) was , and the negative predictive value (NPV) was , where sensitivity, specificity, PPV, and NPV are defined in terms of malignant (melanoma and NMSC) and benign histopathological diagnosis. Figure 3 shows the two melanomas that were misclassified at 95% melanoma sensitivity for each CDSS. They were all in situ and were all clinically diagnosed as benign.

(a)

(b)

(c)

(d)

(e)

(f)

(g)

(h)

3.2. Discussion

The ROC curves for ND and ME in Figure 1(a) show that ND performed similar to ME when nonmelanocytic lesions were excluded, and by that we have shown that ND performed similarly to ME under the circumstances for which ME is intended. When nonmelanocytic lesions were included, ND performed better than ME. Figure 1(b) shows that ND’s NMSC sensitivity reached 100% at melanoma sensitivity of 86%, which means that, at reasonably high melanoma sensitivity, all NMSCs were classified as suspicious.

The majority of the benign lesions were excised due to suspicion of malignancy, and about of the melanomas had a benign clinical diagnosis, so the overlap between benign melanocytic lesions and melanomas in situ, as seen in Figure 2, was expected. ND misclassifies seborrheic keratoses as suspicious, similar to other CDSSs [20, 31–33]. GPs excise more seborrheic keratoses per melanoma than dermatologists do [39, 40, 42], so there is a potential for saving pathology resources if a CDSS can classify them correctly. Development of image analysis features to discriminate seborrheic keratosis from melanoma has just begun [28].

Only the segment of the ROC curve with high sensitivity to melanoma, as shown in Figure 4, is clinically relevant, and therefore the area under the curve (AUC) is not an adequate summary of a CDSS’s performance. The area under the clinically relevant segment of the ROC curve would be a more adequate summary statistic; however, then the clinically relevant segment must first be defined.

Inadequate segmentation was not used as exclusion criterion, although it seems unlikely that a user would trust the outcome if the segmentation fails. But since there is no ground truth for segmentation, it is less suited as exclusion criterion. The decision to carry out excision was based on only one dermatologist’s opinion, which is a drawback since interobserver agreement is only moderate for dermatologists [25]. Short-term follow-up of the patient or consensus diagnosis based on dermoscopic and clinical images can be used as the gold standard for nonexcised lesions, but it requires large resources. The data set used in this study is independent of all stages of ND’s development, but the lesions in this set are possibly more similar to the lesions ND has been trained on than to the lesions ME has been trained on, and this is potentially an advantage for ND.

The present data set consisted of 44% melanomas in situ and median Breslow depth of 0.50 mm, which indicate high diagnostic difficulty. A proportion of 31% melanomas in situ was reported on a similar population in Germany [43]. The data set consists of 44 melanomas, which is more than most reported studies of CDSSs with independent test sets, with some exceptions [14, 33]. With 44 melanomas, 95% melanoma sensitivity means that only two melanomas are misclassified, and the results are therefore very sensitive to small changes in the data set. Confidence intervals for highly data sensitive results can give a false impression of generalisability and are therefore not reported.

ND and ME misclassified different melanomas, as shown in Figure 3, which is not unexpected since the two CDSSs have been developed independently of each other. It has been reported that the sensitivity and specificity for dermatologists improve when majority vote or consensus is used to diagnose skin lesions [5, 25]. We have investigated whether a combination of ND and ME will increase the sensitivity without decreasing the specificity. Figure 5 shows the ROC curve for a classifier which classifies a lesion as suspicious if either ND or ME classifies it as suspicious. For melanocytic lesions only, this classifier outperformed ND and ME for sensitivities above 90%. For melanoma and NMSC, the performance was about the same as for ND (not shown). An explanation of the results can be that the lesions were photographed with different cameras and dermoscopes, but it can also be because of the different feature algorithms or different statistical classifiers.

A CDSS is not needed for skin lesions that obviously are melanomas, and it can therefore be argued that these lesions should be excluded [14]. To evaluate ND’s performance under these conditions, all melanomas that were clinically diagnosed as melanoma with no benign differential diagnosis were excluded. There were then melanomas left. Tuning the parameters to 95% melanoma sensitivity (21 of 22 melanomas detected) gave a specificity of 6% for ND and 13% for ME, similar to the 9% specificity reported by Monheit et al. [14]. One should, however, be very cautious when drawing conclusions. To demonstrate the dependence on the data set, one of the melanomas clinically diagnosed as benign was replaced by a melanoma clinically diagnosed as malignant, shown in Figure 6. The specificity then increased to 12% for ND and decreased to 7% for ME, which is outside the range of the respective confidence intervals.

(a)

(b)

Compared to other studies with independent test sets and a minimum of 10 melanomas [12, 14, 16, 33, 34], the sensitivity and specificity scores of ND and ME are not superior. Inclusion of nonexcised lesions [12, 34] can have a positive effect on the observed specificity, since these lesions do not resemble malignant lesions. A higher proportion of melanomas in situ decreases the observed performance of the system as shown in Figure 2 and also illustrated by Malvehy et al. [33]. Whether the superior performance of Piccolo et al. [16] is due to few melanomas in situ is unknown, as this was not reported. The two studies with more than 100 melanomas in an independent test set reported similar sensitivities (98% and 97%) but different specificities (9% and 34%), but it is not possible to conclude that one system is better than the other, since the exclusion criteria for the two studies are very different. A publicly available data set has been called for [8], but the wide variety of technologies is a challenge.

4. Conclusions

We have shown that ND was able to detect NMSC without sacrificing melanoma sensitivity but misclassified benign nonmelanocytic lesions. Although there are promising results for other technologies, dermoscopy is still the only widely used tool for skin lesion diagnosis. Nonmelanocytic lesions are an important aspect in melanoma detection, and more research is needed, especially on features for differentiating between melanomas and seborrheic keratoses.

Different inclusion and exclusion criteria, moderate-sized data sets, and variety in the diagnostic difficulty make the reported sensitivity and specificity scores inadequate for comparing different CDSSs. The demonstration of the results’ dependence on the data set emphasises the need for direct comparison on the same set of lesions. Which system is the most adequate for comparison will remain unknown until more studies are reported.

According to a study by Dreiseitl and Binder [44], physicians are willing to follow the recommendation of a CDSS, especially if they are not confident in their own diagnosis, and Frühauf et al. [20] reported that patients accept the use of a CDSS. Hence, there is a potential for CDSSs in melanoma detection if the systems can give reliable recommendations for all kinds of lesions.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

C. Garbe, T. K. Eigentler, U. Keilholz, A. Hauschild, and J. M. Kirkwood, “Systematic review of medical treatment in melanoma: current status and future prospects,” The Oncologist, vol. 16, no. 1, pp. 5–24, 2011.
View at: Publisher Site | Google Scholar
A. Niezgoda, P. Niezgoda, and R. Czajkowski, “Novel approaches to treatment of advanced melanoma: a review on targeted therapy and immunotherapy,” BioMed Research International, vol. 2015, Article ID 851387, 16 pages, 2015.
View at: Publisher Site | Google Scholar
American Cancer Society, “Cancer facts & figures 2014,” Tech. Rep., American Cancer Society, 2014.
View at: Google Scholar
Cancer Registry of Norway, “Cancer in Norway 2013—cancer incidence, mortality, survival and prevalence in Norway,” Tech. Rep., Cancer Registry of Norway, 2015.
View at: Google Scholar
H. Kittler, H. Pehamberger, K. Wolff, and M. Binder, “Diagnostic accuracy of dermoscopy,” The Lancet Oncology, vol. 3, no. 3, pp. 159–165, 2002.
View at: Publisher Site | Google Scholar
C. Rosendahl, G. Williams, D. Eley et al., “The impact of subspecialization and dermatoscopy use on accuracy of melanoma diagnosis among primary care doctors in Australia,” Journal of the American Academy of Dermatology, vol. 67, no. 5, pp. 846–852, 2012.
View at: Publisher Site | Google Scholar
A. Masood and A. A. Al-Jumaily, “Computer aided diagnostic support system for skin cancer: a review of techniques and algorithms,” International Journal of Biomedical Imaging, vol. 2013, Article ID 323268, 2013.
View at: Publisher Site | Google Scholar
B. Rosado, S. Menzies, A. Harbauer et al., “Accuracy of computer diagnosis of melanoma: a quantitative meta-analysis,” Archives of Dermatology, vol. 139, no. 3, pp. 361–367, 2003.
View at: Publisher Site | Google Scholar
M. E. Vestergaard and S. W. Menzies, “Automated diagnostic instruments for cutaneous melanoma,” Seminars in Cutaneous Medicine and Surgery, vol. 27, no. 1, pp. 32–36, 2008.
View at: Publisher Site | Google Scholar
K. Korotkov and R. Garcia, “Computerized analysis of pigmented skin lesions: a review,” Artificial Intelligence in Medicine, vol. 56, no. 2, pp. 69–90, 2012.
View at: Publisher Site | Google Scholar
A. Blum, I. Zalaudek, and G. Argenziano, “Digital image analysis for diagnosis of skin tumors,” Seminars in Cutaneous Medicine and Surgery, vol. 27, no. 1, pp. 11–15, 2008.
View at: Publisher Site | Google Scholar
S. Dreiseitl, M. Binder, K. Hable, and H. Kittler, “Computer versus human diagnosis of melanoma: evaluation of the feasibility of an automated diagnostic system in a prospective clinical trial,” Melanoma Research, vol. 19, no. 3, pp. 180–184, 2009.
View at: Publisher Site | Google Scholar
M. Elbaum, A. W. Kopf, H. S. Rabinovitz et al., “Automatic differentiation of melanoma from melanocytic nevi with multispectral digital dermoscopy: a feasibility study,” Journal of the American Academy of Dermatology, vol. 44, no. 2, pp. 207–218, 2001.
View at: Publisher Site | Google Scholar
G. Monheit, A. B. Cognetta, L. Ferris et al., “The performance of MelaFind: a prospective multicenter study,” Archives of Dermatology, vol. 147, no. 2, pp. 188–194, 2011.
View at: Publisher Site | Google Scholar
P. Bauer, P. Cristofolini, S. Boi et al., “Digital epiluminescence microscopy: usefulness in the differential diagnosis of cutaneous pigmentary lesions. A statistical comparison between visual and computer inspection,” Melanoma Research, vol. 10, no. 4, pp. 345–349, 2000.
View at: Publisher Site | Google Scholar
D. Piccolo, A. Ferrari, K. Peris, R. Daidone, B. Ruggeri, and S. Chimenti, “Dermoscopic diagnosis by a trained clinician vs. a clinician with minimal dermoscopy training vs. computer-aided diagnosis of 341 pigmented skin lesions: a comparative study,” British Journal of Dermatology, vol. 147, no. 3, pp. 481–486, 2002.
View at: Publisher Site | Google Scholar
K. Hoffmann, T. Gambichler, A. Rick et al., “Diagnostic and neural analysis of skin cancer (DANAOS). A multicentre study for collection and computer-aided analysis of data from pigmented skin lesions using digital dermoscopy,” British Journal of Dermatology, vol. 149, no. 4, pp. 801–809, 2003.
View at: Publisher Site | Google Scholar
M. Barzegari, H. Ghaninezhad, P. Mansoori, A. Taheri, Z. S. Naraghi, and M. Asgari, “Computer-aided dermoscopy for diagnosis of melanoma,” BMC Dermatology, vol. 5, no. 1, article 8, 2005.
View at: Publisher Site | Google Scholar
J. C. Boldrick, C. J. Layton, J. Nguyen, and S. M. Swetter, “Evaluation of digital dermoscopy in a pigmented lesion clinic: clinician versus computer assessment of malignancy risk,” Journal of the American Academy of Dermatology, vol. 56, no. 3, pp. 417–421, 2007.
View at: Publisher Site | Google Scholar
J. Frühauf, B. Leinweber, R. Fink-Puches et al., “Patient acceptance and diagnostic utility of automated digital image analysis of pigmented skin lesions,” Journal of the European Academy of Dermatology and Venereology, vol. 26, no. 3, pp. 368–372, 2012.
View at: Publisher Site | Google Scholar
A. Fueyo-Casado, F. Vázquez-López, J. Sanchez-Martin, B. Garcia-Garcia, and N. Pérez-Oliva, “Evaluation of a program for the automatic dermoscopic diagnosis of melanoma in a general dermatology setting,” Dermatologic Surgery, vol. 35, no. 2, pp. 257–259, 2009.
View at: Publisher Site | Google Scholar
A. Blum, R. Hofmann-Wellenhof, H. Luedtke et al., “Value of the clinical history for different users of dermoscopy compared with results of digital image analysis,” Journal of the European Academy of Dermatology and Venereology, vol. 18, no. 6, pp. 665–669, 2004.
View at: Publisher Site | Google Scholar
P. Smialowski, D. Frishman, and S. Kramer, “Pitfalls of supervised feature selection,” Bioinformatics, vol. 26, no. 3, pp. 440–443, 2009.
View at: Publisher Site | Google Scholar
T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning: Data mining, Inference, and Prediction, Springer Series in Statistics, Springer, New York, NY, USA, 2nd edition, 2009.
View at: Publisher Site | MathSciNet
G. Argenziano, H. P. Soyer, S. Chimenti et al., “Dermoscopy of pigmented skin lesions: results of a consensus meeting via the internet,” Journal of the American Academy of Dermatology, vol. 48, no. 5, pp. 679–693, 2003.
View at: Publisher Site | Google Scholar
S. M. Rajpara, A. P. Botello, J. Townend, and A. D. Ormerod, “Systematic review of dermoscopy and digital dermoscopy/artificial intelligence for the diagnosis of melanoma,” British Journal of Dermatology, vol. 161, no. 3, pp. 591–604, 2009.
View at: Publisher Site | Google Scholar
F. M. Walter, H. C. Morris, E. Humphrys et al., “Effect of adding a diagnostic aid to best practice to manage suspicious pigmented lesions in primary care: randomised controlled trial,” British Medical Journal, vol. 345, no. 7866, Article ID e4110, 2012.
View at: Publisher Site | Google Scholar
K. Shimizu, H. Iyatomi, M. E. Celebi, K.-A. Norton, and M. Tanaka, “Four-class classification of skin lesions with task decomposition strategy,” IEEE Transactions on Biomedical Engineering, vol. 62, no. 1, pp. 274–283, 2015.
View at: Publisher Site | Google Scholar
M. J. Jamora, B. D. Wainwright, S. A. Meehan, and J.-C. Bystryn, “Improved identification of potentially dangerous pigmented skin lesions by computerized image analysis,” Archives of Dermatology, vol. 139, no. 2, pp. 195–198, 2003.
View at: Publisher Site | Google Scholar
M. Carrara, A. Bono, C. Bartoli et al., “Multispectral imaging and artificial neural network: mimicking the management decision of the clinician facing pigmented skin lesions,” Physics in Medicine and Biology, vol. 52, no. 9, pp. 2599–2613, 2007.
View at: Publisher Site | Google Scholar
S. W. Menzies, L. Bischof, H. Talbot et al., “The performance of solarscan: an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma,” Archives of Dermatology, vol. 141, no. 11, pp. 1388–1396, 2005.
View at: Publisher Site | Google Scholar
A. Perrinaud, O. Gaide, L. E. French, J.-H. Saurat, A. A. Marghoob, and R. P. Braun, “Can automated dermoscopy image analysis instruments provide added benefit for the dermatologist? A study comparing the results of three systems,” British Journal of Dermatology, vol. 157, no. 5, pp. 926–933, 2007.
View at: Publisher Site | Google Scholar
J. Malvehy, A. Hauschild, C. Curiel-Lewandrowski et al., “Clinical performance of the Nevisense system in cutaneous melanoma detection: an international, multicentre, prospective and blinded clinical trial on efficacy and safety,” The British Journal of Dermatology, vol. 171, no. 5, pp. 1099–1107, 2014.
View at: Publisher Site | Google Scholar
H. Lui, J. Zhao, D. McLean, and H. Zeng, “Real-time Raman spectroscopy for in vivo skin cancer diagnosis,” Cancer Research, vol. 72, no. 10, pp. 2491–2500, 2012.
View at: Publisher Site | Google Scholar
A. Waldmann, S. Nolte, M. A. Weinstock et al., “Skin cancer screening participation and impact on melanoma incidence in Germany—an observational study on incidence trends in regions with and without population-based screening,” British Journal of Cancer, vol. 106, no. 5, pp. 970–974, 2012.
View at: Publisher Site | Google Scholar
M. Zortea, T. R. Schopf, K. Thon et al., “Performance of a dermoscopy-based computer vision system for the diagnosis of pigmented skin lesions compared with visual evaluation by experienced dermatologists,” Artificial Intelligence in Medicine, vol. 60, no. 1, pp. 13–26, 2014.
View at: Publisher Site | Google Scholar
K. Møllersen, M. Zortea, K. Hindberg, T. R. Schopf, S. O. Skrøvseth, and F. Godtliebsen, “Improved skin lesion diagnostics for general practice by computer aided diagnostics,” in Dermoscopy Image Analysis, Digital Imaging and Computer Vision, pp. 247–292, CRC Press, 2015.
View at: Google Scholar
M. Zortea, S. O. Skrøvseth, T. R. Schopf, H. M. Kirchesch, and F. Godtliebsen, “Automatic segmentation of dermoscopic images by iterative classification,” International Journal of Biomedical Imaging, vol. 2011, Article ID 972648, 19 pages, 2011.
View at: Publisher Site | Google Scholar
R. Marks, D. Jolley, C. McCormack, and A. P. Dorevitch, “Who removes pigmented skin lesions? A study of the ratio of melanoma to other benign pigmented tumors removed by different categories of physicians in Australia in 1989 and 1994,” Journal of the American Academy of Dermatology, vol. 36, no. 5, pp. 721–726, 1997.
View at: Publisher Site | Google Scholar
B. Lindelöf, M.-A. Hedblad, and U. Ringborg, “Nevus eller malignt melanom? Rätt kompetens vid diagnostik ger lägre kostnader,” Läkartidningen, vol. 105, no. 39, pp. 2666–2669, 2008.
View at: Google Scholar
C. M. Balch, J. E. Gershenwald, S.-J. J. Soong et al., “Final version of 2009 AJCC melanoma staging and classification,” Journal of Clinical Oncology, vol. 27, no. 36, pp. 6199–6206, 2009.
View at: Publisher Site | Google Scholar
M. I. Duque, J. R. Jordan, A. B. Fleischer Jr. et al., “Frequency of seborrheic keratosis biopsies in the United States: a benchmark of skin lesion care quality and cost effectiveness,” Dermatologic Surgery, vol. 29, no. 8, pp. 796–801, 2003.
View at: Publisher Site | Google Scholar
A. Katalinic, A. Waldmann, M. A. Weinstock et al., “Does skin cancer screening save lives?: an observational study comparing trends in melanoma mortality in regions with and without screening,” Cancer, vol. 118, no. 21, pp. 5395–5402, 2012.
View at: Publisher Site | Google Scholar
S. Dreiseitl and M. Binder, “Do physicians value decision support? A look at the effect of decision support systems on physician opinion,” Artificial Intelligence in Medicine, vol. 33, no. 1, pp. 25–30, 2005.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2015 Kajsa Møllersen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2091

Downloads

1172

Citations