[Retracted] Impact of Activation, Optimization, and Regularization Methods on the Facial Expression Model Using CNN

Table 3

Hyperparameters testing accuracy on the JAFEE dataset.

Activation	Optimization	Dropout	Testing accuracy
Softmax	Adam	0.1	0.94%
Softmax	AdaGrad	0.1	0.91%
Softmax	Nadam	0.1	0.92%
Softplus	Adamax	0.1	0.91%
Sigmoid	Adam	0.1	0.90%
Relu	Adam	0.1	0.93%
Relu	AdaGrad	0.1	0.91%
Relu	Nadam	0.1	0.90%
Relu	Adamax	0.1	0.90%
Softmax	Adam	0.2	0.95%
………	………	……….	……..
hard_sigmoid	Adamax	0.4	0.88%