Mathematical Analysis and Performance Evaluation of the GELU Activation Function in Deep Learning

Figure 1

The GELU function defined in equation (15).