A Reinforcement Learning Framework for Spiking Networks with Dynamic Synapses

Figure 6

Time course of dynamic synaptic strength. ⟨𝑆(𝑡)⟩ is the time average of the synaptic strength of a synapse over all the time steps in one episode. Values are normalized between zero and unity. (a) The average dynamic synaptic strength for untrained excitatory (Exc.) and inhibitory (Inh.) synapses (smoothed). (b) The average dynamic synaptic strength for trained excitatory (Exc.) and inhibitory (Inh.) synapses (for clear illustration of the lines, 𝑦-axis is on a logarithmic scale).

(a)

(b)