Research on Sparsity of Output Synapses in Echo State Networks

Figure 2

The experimental results verify that there are redundant synapses in the output connections of ESN. All the experimental results are averaged over 100 independent trials per sparsity. (a) Curves about the relationship between the predicted steps and the sparsity of ESN. The corresponding teacher sequences are generated by three different chaotic systems (Mackey-Glass system, Lorenz system, and Rössler system), respectively. (b) Curves about the effects of the sparsity on the energy consumption (blue solid line) and the energy efficiency (red dashed line), respectively. The left ordinate represents the energy consumption of output synapses, and the right ordinate shows the energy efficiency of output synapses.

(a)

(b)