Detecting the Risk of Customer Churn in Telecom Sector: A Comparative Study

Table 3

Performance evaluation of applying HPO methods to the RF classifier based on low-ratio undersampling strategy (0.3 and 0.4).

Dataset	Optimization algorithm	Accuracy	Recall	Precision	AUC	F1-score	MAE
Dataset 1	Default HPs	0.92	0.58	0.84	0.78	0.82	0.078
	GS	0.99	1.00	0.91	0.99	0.97	0.014
	RS	0.94	0.74	0.83	0.85	0.88	0.059
	GA-DEAP	0.93	0.68	0.82	0.82	0.85	0.068
	GA-TPOT	0.96	0.87	0.84	0.91	0.91	0.043
Dataset 2	Default HPs	0.77	0.47	0.61	0.67	0.69	0.233
	GS	0.95	0.94	0.89	0.95	0.94	0.049
	RS	0.83	0.61	0.73	0.76	0.77	0.174
	GA-DEAP	0.83	0.63	0.72	0.76	0.78	0.173
	GA-TPOT	0.83	0.65	0.73	0.77	0.79	0.167