Mathematical Analysis and Performance Evaluation of the GELU Activation Function in Deep Learning

Figure 3

Comparison of various activation functions.