Mathematical Analysis and Performance Evaluation of the GELU Activation Function in Deep Learning

Figure 4

Experimental comparison of activation functions with respect to training epoch.