Mathematical Analysis and Performance Evaluation of the GELU Activation Function in Deep Learning

Figure 2

The GELU function and its derivative with respect to x.