Research Article

Deep Neural Networks with Multistate Activation Functions

Table 5

Final WERs and the -test results of the DNNs without pretraining.

Activation function WER (%) -test significance

Logistic 14.44 /

Two-order MSAF 14.31
Three-order MSAF 14.14
SYM-MSAF 14.00

Two-order MSAF and MN 14.04
Three-order MSAF and MN 14.04
SYM-MSAF and MN 13.60