Keratoconus Severity Classification Using Features Selection and Machine Learning Algorithms

Table 5

Precision, recall, -score, accuracy, and execution time of different models using different features selection algorithms.

Method	Model	Keratoconus classification using 2 classes					Keratoconus classification using 4 classes
		Precision	Recall	-score	Accuracy	Time in second	Precision	Recall	-score	Accuracy	Time in second
All features	LR	0.97	0.97	0.97	97.38%	1.384256	0.93	0.94	0.93	93.52%	2.281342
	LDA	0.96	0.96	0.96	96.17%	1.949949	0.9	0.9	0.9	89.88%	1.747491
	KNN	0.96	0.96	0.95	95.73%	6.792791	0.91	0.91	0.91	91.37%	5.829261
	CART	0.97	0.96	0.96	96.14%	5.563709	0.92	0.92	0.92	91.49%	6.864419
	NB	0.95	0.93	0.94	93.30%	0.273079	0.89	0.65	0.71	64.80%	0.242261
	SVM	0.93	0.92	0.88	91.88%	9.076491	0.76	0.82	0.75	82.36%	14.471874
	RF	0.98	0.98	0.98	98.00%	16.014512	0.95	0.95	0.95	95.32%	20.485403
Filter and mutual information	LR	0.93	0.93	0.93	93.46%	0.898035	0.81	0.87	0.84	87.35%	2.377594
	LDA	0.97	0.97	0.97	96.93%	0.230103	0.87	0.9	0.87	90.01%	0.092326
	KNN	0.95	0.96	0.95	95.61%	0.259209	0.83	0.87	0.84	87.32%	0.192763
	CART	0.96	0.96	0.96	95.67%	0.180062	0.88	0.88	0.88	87.83%	0.190027
	NB	0.95	0.94	0.94	94.06%	0.060432	0.87	0.8	0.82	79.79%	0.059485
	SVM	0.9	0.92	0.89	91.97%	0.796906	0.77	0.83	0.75	82.58%	1.20752
	RF	0.97	0.97	0.97	97.15%	3.884638	0.89	0.91	0.89	90.54%	4.793544
ANOVA	LR	0.95	0.95	0.95	95.29%	1.03231	0.82	0.88	0.85	88.49%	1.463929
	LDA	0.96	0.96	0.96	96.27%	0.144063	0.86	0.89	0.86	89.28%	0.092706
	KNN	0.95	0.96	0.95	95.57%	0.203406	0.86	0.88	0.87	87.92%	0.186572
	CART	0.96	0.96	0.96	95.61%	0.155927	0.87	0.87	0.87	87.13%	0.165356
	NB	0.95	0.93	0.94	92.85%	0.06592	0.88	0.69	0.74	68.66%	0.067247
	SVM	0.95	0.95	0.95	95.35%	0.628557	0.8	0.86	0.81	85.52%	1.203339
	RF	0.97	0.97	0.97	97.03	3.067386	0.9	0.91	0.9	90.83%	4.246253
Embedded	LR	0.97	0.97	0.97	96.97%	0.772439	0.83	0.89	0.85	88.87%	1.47536
	LDA	0.97	0.97	0.97	97.12%	0.183223	0.88	0.9	0.87	89.66%	0.191917
	KNN	0.96	0.96	0.96	96.33%	0.351021	0.89	0.89	0.88	88.74%	0.198216
	CART	0.97	0.97	0.97	96.55%	0.399475	0.88	0.88	0.88	88.39%	0.343518
	NB	0.96	0.95	0.96	95.16%	0.059198	0.9	0.82	0.85	82.16%	0.061666
	SVM	0.96	0.96	0.96	96.05%	0.745212	0.81	0.86	0.82	86.24%	1.343924
	RF	0.98	0.98	0.98	97.63%	4.735932	0.91	0.91	0.91	91.21%	5.290628
Embedded and filter	LR	0.96	0.96	0.96	96.08%	0.71674	0.8	0.87	0.83	86.62%	1.191328
	LDA	0.96	0.96	0.96	96.11%	0.216366	0.89	0.88	0.85	88.49%	0.059547
	KNN	0.96	0.96	0.96	96.21%	0.185542	0.86	0.88	0.86	88.43%	0.151569
	CART	0.96	0.96	0.96	95.45%	0.084678	0.86	0.86	0.86	85.42%	0.088294
	NB	0.94	0.94	0.94	94.28%	0.06354	0.88	0.89	0.88	88.90%	0.059538
	SVM	0.95	0.95	0.94	94.88%	0.510619	0.8	0.86	0.81	85.80%	0.873448
	RF	0.97	0.97	0.97	96.81%	2.4646	0.89	0.9	0.89	89.79%	2.605076
Filter and RFE	LR	0.98	0.98	0.98	97.63%	0.802103	0.8	0.86	0.82	86.15%	2.173507
	LDA	0.97	0.97	0.97	97.09%	0.180395	0.87	0.9	0.87	89.91%	0.091918
	KNN	0.95	0.96	0.95	95.57%	0.287014	0.83	0.87	0.84	87.29%	0.16819
	CART	0.96	0.96	0.96	96.21%	0.162709	0.9	0.89	0.89	89.28%	0.18652
	NB	0.95	0.94	0.94	94.31%	0.064485	0.87	0.86	0.87	86.31%	0.055916
	SVM	0.9	0.92	0.89	91.97%	0.838237	0.77	0.83	0.75	82.58%	1.209206
	RF	0.98	0.98	0.98	97.63%	3.765689	0.93	0.93	0.93	93.17%	4.597132
RFE	LR	0.94	0.94	0.94	94.37%	0.724412	0.83	0.89	0.85	88.87%	1.428089
	LDA	0.97	0.97	0.97	96.84%	0.173882	0.89	0.9	0.87	89.88%	0.09103
	KNN	0.97	0.97	0.97	97.06%	0.272294	0.9	0.9	0.9	89.98%	0.213538
	CART	0.97	0.97	0.97	96.52%	0.13398	0.91	0.9	0.91	90.26%	0.206897
	NB	0.96	0.96	0.96	95.61%	0.055933	0.91	0.86	0.87	85.52%	0.05992
	SVM	0.96	0.96	0.96	96.14%	0.502924	0.81	0.86	0.82	86.43%	1.160413
	RF	0.98	0.98	0.98	97.91%	3.210188	0.94	0.94	0.94	93.83%	4.381234
Filter and HRFA	LR	0.84	0.92	0.88	91.65%	0.234221	0.7	0.83	0.76	82.89%	1.201195
	LDA	0.84	0.92	0.88	91.65%	0.068874	0.7	0.83	0.76	82.96%	0.063042
	KNN	0.86	0.91	0.88	90.99%	0.173318	0.74	0.81	0.77	80.58%	0.157148
	CART	0.86	0.87	0.86	86.78%	0.078698	0.74	0.76	0.75	76.13%	0.075387
	NB	0.84	0.92	0.88	91.65%	0.060843	0.75	0.83	0.76	83.05%	0.057565
	SVM	0.84	0.92	0.88	91.65%	0.589599	0.7	0.83	0.76	82.99%	1.006607
	RF	0.86	0.89	0.87	88.90%	2.95956	0.74	0.78	0.76	77.90%	3.135792
Filter and SFS	LR	0.96	0.96	0.96	96.30%	0.661703	0.81	0.87	0.84	87.45%	1.456912
	LDA	0.97	0.97	0.97	96.96%	0.092182	0.87	0.89	0.86	89.06%	0.092238
	KNN	0.96	0.96	0.96	95.86%	0.20427	0.84	0.87	0.85	86.75%	0.198333
	CART	0.96	0.96	0.96	95.98%	0.136162	0.9	0.9	0.9	89.98%	0.226029
	NB	0.94	0.94	0.94	94.21%	0.057639	0.89	0.86	0.87	86.12%	0.059771
	SVM	0.9	0.92	0.89	91.97%	0.639869	0.81	0.87	0.83	86.62%	1.280597
	RF	0.98	0.98	0.98	97.76%	3.377056	0.93	0.94	0.93	93.64%	4.575722
SFS	LR	0.98	0.98	0.98	97.60%	0.627829	0.8	0.86	0.82	86.34%	1.447075
	LDA	0.97	0.97	0.97	97.31%	0.150447	0.89	0.9	0.88	89.95%	0.091448
	KNN	0.96	0.96	0.96	96.40%	0.264232	0.9	0.9	0.9	90.01%	0.179493
	CART	0.97	0.97	0.97	97.09%	0.148523	0.91	0.91	0.91	91.33%	0.158256
	NB	0.95	0.94	0.94	94.12%	0.059645	0.91	0.86	0.88	86.09%	0.056018
	SVM	0.96	0.96	0.95	95.89%	0.516274	0.76	0.85	0.8	85.04%	1.071349
	RF	0.98	0.98	0.98	98.10%	3.241881	0.95	0.95	0.95	95.32%	3.702065
Genetic	LR	0.97	0.98	0.97	97.53%	0.660959	0.82	0.88	0.84	87.98%	1.426594
	LDA	0.97	0.97	0.97	96.81%	0.090565	0.9	0.9	0.9	90.36%	0.091082
	KNN	0.97	0.97	0.97	96.81%	0.198013	0.84	0.87	0.85	87.13%	0.183919
	CART	0.97	0.97	0.97	97.12%	0.148974	0.91	0.91	0.91	90.20%	0.191642
	NB	0.96	0.95	0.95	94.75%	0.058466	0.91	0.88	0.89	87.51%	0.055448
	SVM	0.95	0.95	0.95	95.32%	0.636181	0.81	0.87	0.83	86.75%	1.192417
	RF	0.98	0.98	0.98	98.04%	3.51857	0.94	0.94	0.94	94.34%	4.337631
Filter and SBS	LR	0.97	0.97	0.97	96.93%	0.662359	0.81	0.87	0.83	86.88%	1.44051
	LDA	0.96	0.96	0.96	96.24%	0.090107	0.88	0.9	0.87	89.60%	0.091316
	KNN	0.95	0.96	0.95	95.67%	0.192713	0.84	0.87	0.85	86.88%	0.190318
	CART	0.96	0.96	0.96	95.70%	0.14732	0.9	0.9	0.9	90.26%	0.189021
	NB	0.94	0.94	0.94	94.44%	0.055937	0.89	0.83	0.85	82.86%	0.055396
	SVM	0.9	0.92	0.89	91.94%	0.649443	0.81	0.87	0.82	86.53%	1.272575
	RF	0.97	0.97	0.97	97.34%	3.432132	0.94	0.94	0.93	93.71%	4.532753
SBS	LR	0.98	0.98	0.98	97.85%	0.662359
	LDA	0.97	0.97	0.97	97.31%	0.090107
	KNN	0.96	0.96	0.96	96.08%	0.192713
	CART	0.97	0.97	0.97	96.90%	0.14732	N.A
	NB	0.95	0.94	0.94	93.87%	0.055937
	SVM	0.95	0.95	0.94	95.07%	0.649443
	RF	0.98	0.98	0.98	98.07%	3.432132