Deep Neural Networks with Multistate Activation Functions

Figure 10

The cross entropy losses of the models using the 2-order MSAF on the cross-validation set. The curve of the logistic function is set to make the comparison clearer.