On Training Efficiency and Computational Costs of a Feed Forward Neural Network: A Review

Table 2

From sigmoid to tanh.

Hidden bias
Hidden weights
Output bias
Output weights