Linear Simultaneous Equations’ Neural Solution and Its Application to Convex Quadratic Programming with Equality-Constraint

Figure 1

Behavior of the four basic activation functions.

(a) Linear function 

(b) Sigmoid function

(c) Power function

(d) Power-sigmoid function