Deep Neural Networks with Multistate Activation Functions

Figure 1

The curve of the logistic function. Its definition domain is and its range is . This is a nonlinear function which has an exponential increase in the middle, separating state 0 and 1 apart from each other.