A Cognitive Model Based on Neuromodulated Plasticity

Figure 14

The structure of the core network in the operant conditioning experiment. In the phase of learning single action, there is only 1 layer of neurons in the action module, while there are 2 layers in the module representing the action sequence including 2 actions. The synaptic weights between the working memory and the action module are denoted as and , while the weights between the 2 layers of the action module are denoted as , , , and , respectively, as shown in the picture.

(a) In the phase of learning single action

(b) In the phase of learning action series