Abstract

Anterior forebrain pathway (AFP), a basal ganglia-dorsal forebrain circuit, significantly impacts birdsong, specifically in juvenile or deaf birds. Despite many physiological experiments supporting AFP’s role in song production, the mechanism underlying it remains poorly understood. Using a computational model of the anterior forebrain pathway and song premotor pathway, we examined the dynamic process and exact role of AFP during song learning and distorted auditory feedback (DAF). Our simulation suggests that AFP can adjust the premotor pathway structure and syllables based on its delayed input to the robust nucleus of the archistriatum (RA). It is also indicated that the adjustment to the synaptic conductance in the song premotor pathway has two phases: normal phases where the adjustment decreases with an increasing number of trials and abnormal phases where the adjustment remains stable or even increases. These two phases alternate and impel a specific effect on birdsong based on AFP’s specific structures, which may be associated with auditory feedback. Furthermore, our model captured some characteristics shown in birdsong experiments, such as similarities in pitch, intensity, and duration to real birds and the highly abnormal features of syllables during DAF.

1. Introduction

Birdsong is a complex learned behavior based on neural circuits and premotor functions. The neural structure is well-delineated [1] and similar to that for humans [2], leading to a great interest spreading among researchers. Through a series of electrophysiological experiments, researchers have demonstrated that song production mainly involves the song premotor pathway from the nucleus High Vocal Center (HVC) to the robust nucleus of the archistriatum (RA). They also found that song learning involves the anterior forebrain pathway (AFP), a basal ganglia-dorsal forebrain circuit composed of nucleus Area X, the dorsolateral thalamus (DLM), and the lateral part of the magnocellular nucleus of the anterior neostriatum (LMAN) [3]. In particular, AFP’s neurons in juvenile or deaf birds become more active than adults and adjust syllables for a specific purpose, such as learning.

The observations by Brainard [4] demonstrated that juvenile birds learn songs based on AFP, and the AFP lesions can damage their normal learning process. The lesions make the completion of song learning (called crystallization) occur prematurely and result in songs with highly abnormal features [5]. However, they do not affect adult birds since birdsong has crystallized. On the other hand, song degradation happens with adult birds deafened and breaks with lesions of LMAN [6]. These phenomena show that AFP has the ability to adjust birdsong and may affect the premotor pathway structure, which is closely related to syllables [7].

Due to these observed phenomena, the adjustment of AFP to birdsong during song learning and maintenance has attracted researchers’ attention. In 2004, Brainard [4] discussed the potential instructive and permissive functions of AFP in vocal plasticity. For song learning in juvenile birds, Kojima and Doupe [8] found that AFP neurons without tutor song exposure had highly tuned responses to bird’s own song based on recording physiological data. Furthermore, Hamaguchi et al. [5] showed that deafening-induced changes to HVC synapses require intact AFP output through in vivo multiphoton imaging. Despite important progress in identifying AFP’s role in vocal plasticity, there is no good understanding of these experiments’ neural mechanisms. Therefore, it is effective and necessary to use neural model theory to study AFP’s effect during these processes.

In this study, we extended the birdsong premotor pathway model introduced by Abarbanel et al. [9] to an AFP-mediated model, focusing on the role of AFP during song learning and DAF. The model’s modification includes three aspects: (1) HVCX neurons were introduced in HVC to control AFP and can be regulated according to environmental and physiologic factors. Imaging studies have shown that deafening causes the dendritic spines of HVCX neurons to contract within 12-48 hours, predicting the syllable degradation process [10]. (2) The fixed synaptic connection between HVC and RA was modified to be random and adjustable, resulting in synaptic plasticity of the premotor pathway, which provides the basis for AFP regulation. (3) An AFP model [11] was embedded in the song premotor pathway, with its network structure expanded based on some studies on nucleus DLM and Area X [12, 13]. Besides, we hypothesized that the structure of the nucleus in HVC and AFP had been well regulated by their superior nuclei.

For gaining insight into the control and maintenance functions of AFP on song syllables, we trained the extended model to simulate two different syllable adjustment processes: the learning process in young birds and the syllable distortion process in deaf birds. The simulation results successfully reproduced these two adjustment processes and quantitatively demonstrated AFP’s functions. They showed that AFP’s adjustment is phased, with normal phases and abnormal phases. During most of the adjustment process called normal phases, AFP’s adjustment amount and adjustment rate decreased with more trials. However, in other intervals called abnormal phases, they remained stable or even increased. Our simulation explained the neural mechanism underlying song production and adjustment, indicating the important role of neural plasticity during birdsong learning and maintenance.

2. Methods of Song Premotor Pathway

The neural circuit of the song premotor pathway is shown in Figure 1, accompanied by the anterior forebrain pathway (AFP) consisted of areas X, DLM, and LMAN. In the song premotor pathway, HVC excitatory neurons fire sparsely [6] during song production to control moments and sequences of syllables, minimum units of a song [14]. The output of HVC is directly and indirectly via AFP sent to RA, where excitatory neurons control the syrinx muscles and respiratory action [15]. RA projection neurons have different activity patterns [16], which are perceived as causes of different syllables. In fact, Henry has studied the relationship between song features and nerve structure, supporting that intrinsic the circuit within RA may greatly influence the features of birdsong [9]. Also, AFP participates in the song learning and maintenance as a processor between HVC and RA. Compared to that from HVC, AFP’s stimulation is sent to RA with a delay of .

Here, we make some improvements on the song premotor pathway model proposed by Abarbanel et al. [9]: introducing HVCX neurons to control AFP, regulating the network structure of HVC to adjust for the connecting with AFP, and improving the synaptic connection between HVC and RA to be random and plastic.

2.1. Nucleus HVC

Nucleus HVC contains several types of neurons, including projection neurons (HVCRA and HVCX neurons) that project to RA and Area X and interneurons (HVCI neurons) that project locally within the HVC [17]. These different neuron types have different morphologies, and few projection neurons project to both RA and area X [18].

We construct 20 HVC projection neurons and 2 inhibitory neurons to simulate HVC in the form of a feed-forward model. During each syllable, projection neurons fire sparsely while inhibition neurons receive input from them and inhibit them in turn. Based on the HH equation, the membrane potential of the th HVCRA neuron () is given by where HR, HX, and HI represent neurons HVCRA, HVCX, and HVCI, respectively; indicates the direct current stimulation to HVCRA; and , , and represent the input from other HVC neurons. When , , and are ignored, , including leakage, sodium, and potassium currents, is given by where , , and are the maximum conductance of Na, K, and leakage current. The activation and deactivation variables , , and satisfy the following first-order kinetic equations, where represents , , and . The corresponding parameters and are

Inputs from the neurons inside HVC are represented by where the function represents the proportion of postsynaptic GABA receptor channels opened, and it satisfies first-order kinetics,

The membrane potential of the th HVCX neuron can be similarly given by where is inhibited by HVC inhibitory neurons and other related inputs are similar to that of HVCRA neurons.

In addition, the membrane voltage () of the two inhibitory neurons satisfies the HH equations, where and represent inputs from projection neurons to inhibitory neurons, expressed as follows:

The parameters used for HVC neurons are , , , , , , , , , , , , and . When the neural circuit is at rest, .

2.2. Nucleus RA

As shown in Figure 2, there are inhibitory and excitatory neurons in RA. Inhibitory neurons simulate the local inhibition phenomenon in RA, while excitatory neurons receive input from HVC and LMAN and control syrinx to produce birdsong. Some RA neurons control the muscle of syrinx through the “spring constant” , and others control the respiratory system through the driving pressure . Here, we use 5 RA projection neurons to represent each part. The membrane voltage of the th projection neuron satisfies: where RP, RI stands for RA excitatory and inhibitory neurons separately; indicates direct current stimulation to projection neurons; and represent the input of other neurons in RA; and and represent the input from HVC and LMAN. These inputs are given by where and represent the maximum synaptic conductance from HVCRA and LMAN to RA projection neurons, respectively; represents the maximum synaptic conductance between RA projection neurons; , , and are matrices, and they determine the strength of synaptic connections. is an identity matrix, while and are random matrices where each element in matrices takes a random number between [0.01, 1].

Besides, RA inhibition neuron receives input from HVCRA and RA projection neurons, whose membrane voltage satisfies where inputs from RA projection neurons and HVCRA neurons are given by

The following are parameters used for RA neurons: , , , , , , , , , , , , , , , , and .

3. Methods of Anterior Forebrain Pathway

As shown in Figure 3, AFP consists of Area X, DLM, and LMAN. Based on its internal structure, AFP processes information from HVCX and sends input to RA with a delay of compared to HVCRA. For juvenile birds, AFP helps them learn birdsong. Any lesion of AFP, such as bilateral lesions in area X or LMAN, will disrupt their song development process [19]. Moreover, AFP injuries can prevent song degradation caused by deafening. To simulate these phenomena, we expanded the structure of the AFP model introduced by Abarbanel et al. [11] and embedded the model to the song premotor pathway.

3.1. Nucleus Area X

Stimulated by HVC and LMAN, Area X has excitatory projections to DLM. As shown in Figure 3, there are spiny neurons (SN) and aspiny fast-spiking neurons (AF) in Area X [20]. During periods of silence (nonsinging), SN neurons are in the polarization state, while AF neurons are in the oscillatory regime at 15-30 Hz.

In our model, the SN neuron receives input from HVC and LMAN. Its membrane voltage is given by: where is the direct current stimulation and is similar to . and indicating the input from HVCX and LMAN neurons are expressed as

Here, the function represents the proportion of open postsynaptic AMPA receptor channels. It satisfies first-order dynamics,

In addition, 10 AF neurons receive the input from HVCX to Area X. Their membrane voltage () of the th AF neuron is given by where represents the direct current stimulation to AF neurons, represents the inhibition from SN, represents the input from HVCX neurons, and represents the input from LMAN neurons. These currents are

where represents the maximum conductance of the synapse from HVCX to the AF and represents that from LMAN to the AF neuron. The matrices and are matrices, which determine the strength of the corresponding synaptic connection.

The following are the parameters used for neurons in AFP: , , , , , , , , and . In Area X, , , , , , , and .

3.2. Nucleus DLM

In DLM, inhibited by AF neurons and DLM inhibitory neurons, projection neurons activate LMAN. They include low threshold Ca2+ currents, , and , thus showing the characteristics of delayed activity.

We establish 10 DLM projection neurons, whose membrane potentials are given by where DP stands for DLM projection neurons and DI stands for DLM inhibitory neurons. The currents from AF neurons () and DLM inhibitory neuron () are given by where represents the maximum synaptic conductance from AF to DLM projection neurons, and represents that from DLM inhibitory neurons to DLM projection neurons. The matrix is a matrix, which determines the strength of the corresponding synaptic connection.

Besides, the low threshold Ca2+ currents, and , have the following forms: where the Goldman-Hodgkin-Katz expression is

The activation and inactivation variables satisfy the first-order kinetic equations and the expressions of and are

Besides, DLM inhibition neuron membrane voltage is given by

The following are the parameters used for DLM neurons: , , , , , , , and .

3.3. Nucleus LMAN

LMAN receives input from the DLM projection neuron and stimulates RA. We established 10 neuron models to simulate LMAN. The membrane voltage of the th neuron is where the current of the DLM projection neuron is given as

represents the maximum synaptic conductance from DLM projection neurons to LMAN neurons. The matrix is a matrix, which determines the strength of the corresponding synaptic connection.

It was suggested that the delayed stimulation from LMAN adjust the structure of the song premotor pathway to change the song [21]. Henry established a simple biophysical model of synaptic plasticity, including mixed receptors of NMDAR and AMPAR. In Henry’s model, the synaptic plasticity is controlled by (time difference between inputs to RA from LMAN and HVC), which is used in this paper. In order to simplify our calculation process, we assume that the adjustment function controlled by satisfies which can fit the results obtained by Henry well. We set the minimum value of conductance as and the maximum value as in the calculation. Besides, and .

4. Methods of Syrinx

To present AFP’s adjustment to song premotor pathway in the form of birdsong, we use a simplified vocal dynamic system [22] as the syrinx model to show syllables caused by RA. Based on the model proposed previously, the activity of RA is converted into two control parameters, and , whose specific expressions are where if and ; otherwise, . The movement of the labia midpoint in the syrinx model is given by where , , , , and .

5. Results

5.1. Birdsong Production

Before studying the AFP regulation function, we show how our model generates syllables, the smallest units of birdsong. Each syllable in real birds usually lasts 10 to 100 milliseconds with its fundamental frequency between 3 and 6 kHz. Its production only involves song premotor nuclei, HVC and RA, and syrinx. In order to produce a single syllable, we set each element in a synaptic conductance matrix between [0, ] at random, as shown in Figure 4(a). Under this condition, RA projection neurons were activated by HVC to show burst firing and produce a corresponding syllable without the impact from AFP, which can be seen in Figures 4(b) and 5.

HVCRA neurons were in the polarization state and RA projection neurons oscillated at about 50 Hz before the song. At 1.0 s, 1.2 s, and 1.4 s, we stimulated the first HVCRA neuron with a DC current of 12 mA and the first HVCX neuron with a DC of 18 mA. During the song, HVCRA neurons fired sparsely, and RA projection neurons showed burst firing. Besides, it took almost 65 ms for RA neurons to return to the oscillatory state. Compared with the th HVCRA neuron, the activity of the neuron began later and lasted shorter.

5.2. The Activity and Features of AFP

During both tutoring and singing, AFP adjusts through its delayed input to RA based on its intrinsic activities. The activities of HVCX neurons and Area X neurons are shown in Figure 6 with matrices , , , and set as identity matrices. Constructed in the form of feed-forward neural circuits, HVCX neurons showed similar patterns with HVCRA neurons. In Area X, the SN neuron was in the polarization state, and AF neurons oscillated at about 20 Hz disorderly until the occurrence of activation. Once HVC neurons were stimulated at 1.5 s, SN neurons began to fire at 30 Hz. At the same time, AF neurons “refreshed” waiting time and fired sequentially. As time goes on, they gradually returned to fire disorderly.

Including and currents, DLM projection neurons have more complex properties than general neurons based on the HH model. To understand the activity of DLM projection neurons, we use different DC currents to stimulate a single DLM projection neuron, as shown in Figure 7. The stimulation current contains 3 key values: normal current , positive current , and negative current . and both lasted 2 ms while was maintained at another time. In Figure 7(a), under the condition where , , and , the DLM projection neuron fired 157 ms later than the stimulation time. Nevertheless, when or are much less than 10 mA, the neuron fired immediately and stabilized gradually, as shown in Figures 7(b) and 7(c). When the normal current is 0, the DLM projection neuron fired at 40 Hz without global inhibition, and its equilibrium state was hardly disrupted by and (see Figure 7(d)). Figures 7(e) and 7(f) discuss the effect of reversing and . With order reversed and currents unchanged, the neuron fired immediately (see Figure 7(e)). However, with currents sufficiently large, the neuron has shown delayed activity again (see Figure 7(f)).

Figure 8 shows the activity of DLM and LMAN. Before the song, DLM projection neurons were in the polarization state while inhibitory neurons oscillated at about 30 Hz. Once activated, DLM projection neurons have shown complex firing patterns with their activities delayed by 50-100 ms. LMAN neurons processed the input from DLM projection neurons and stimulated RA 50-100 ms later than HVCRA neurons. The time difference between the inputs from AFP and HVC helps birds learn and maintain their song.

5.3. Song Learning

The specific role of AFP in song learning has been fully shown in studies on zebra finch disease. Although AFP lesions have no obvious destructive effect in healthy adults [23], they can prevent the normal progress of song learning in young birds, leading to songs with highly abnormal features [5]. This shows that AFP plays a key role in song learning by adjusting to neural connectivity in song premotor pathways.

To study AFP’s role during song learning, we embedded the AFP model to the song premotor pathway. The AFP structure was assumed to integrate already the auditory feedback information, which would be considered in the discussion. The first HVCRA and HVCX neurons were activated every 1.5 s for 1000 times to simulate song learning. The raster plots and syllables before and after training are shown in Figure 9. The activity pattern of RA neurons changed significantly due to the adjustment caused by AFP. Compared to the initial state, RA neurons controlling were less active while those controlling were more active, resulting in songs with a lower frequency and longer duration.

AFP’s adjustments to the structure of the song premotor pathway and the corresponding syllable are significant. For further understanding, we show two stages of the synaptic conductance matrix from HVC to RA and its change process on adjustment amount and adjustment rate in Figure 10. It can be clearly seen that the connectivity between HVC and RA in Figure 10(a) is randomly distributed. Simultaneously, in Figure 10(b), it has an obvious distribution characteristic, which corresponds to the syllable feature. Figure 10(c) shows each synaptic conductance adjustment rate from an increase of 500% to a decrease of 80%, and Figure 10(d) shows the adjustment amount from to (). The patterns in Figure 10(c) and Figure 10(d) were mainly controlled by AFP’s neural structure, which was assumed to integrate feedback information. Activated by HVC, AFP could adjust the activity of RA and the features of syllables, constructing a basic song learning process for birds.

Figure 11 shows the changes in the conductance between HVC and RA neurons every 5 trials, including adjustment rate and adjustment amount , whose formulas are where represents the conductance from HVCi to RAj during the th trial. Statistics show that the adjustment rate and amount decreased with an increasing number of trials. The highest adjustment rate for five trials is 7%, with an increase of 0.04 mS/cm2. These figures show the specific impact of AFP during song learning. We would then study what AFP does when an adult bird gets deafen and what the differences between the two processes are.

5.4. Auditory Feedback Distortion

Although AFP lesions have no obvious destructive effect on healthy adult birds, they can prevent song degradation caused by deafening. Experiments have found that auditory feedback distortion occurs when birds get deaf with synapses on HVCX neurons weakened [5] and song disrupted. Nevertheless, LMAN damage can prevent these results [24], and inactivating LMAN can reverse the syllable changes caused by DAF [13, 24]. Here, our model is used to study the distortion process of deaf birds and the impact of LMAN damage.

Due to the experimental observation that synapses of HVCX cells would get gradually weak once birds get deaf [5], we reduced maximum synaptic conductance between HVCX neurons into to simulate this process. The neural circuit structure after song learning in Figure 10(b) was assumed as healthy adults’ structure with syllables crystallized and initial condition during DAF. Compared with the initial condition (see Figures 12(a) and 12(c)), raster plots and syllables show evident change after 200 trials affected by deafening (see Figures 12(b) and 12(d)). The RA activity adjustment led to syllables with higher basic frequency (the highest is close to 8 kHz) and a longer duration (starting moment remained unchanged while ending moment extended).

Besides, we analyzed the synaptic conductance matrix and its adjustment caused by deafening during DAF in Figure 13. The connectivity pattern between HVC and RA in Figure 13(a) has been changed into another in Figure 13(b) by AFP under weak synapses between HVCX cells. Figure 13(c) shows each synaptic conductance adjustment rate from 500% to -80%, and Figure 13(d) shows the adjustment amount from to (). The patterns of adjustment rate and amount correspond to the regulation of AFP with HVCX synapses weakened.

Different from those during song learning, and during DAF had two states. Although they broadly went down, they got stable or even increased during some trials. As shown in Figure 14, R5 decreased during the first 20 trials and remained stable between 20th and 30th trials. went down generally, but it remained stable or even increased in some trials, such as those after the 100th trial. On the other hand, lesions of LMAN could prevent the adjustment through weakening HVCX synapses, proving that if the adult bird with LMAN damaged gets deaf suddenly, there would be no syllable distortion.

Figure 15 shows the curve of average adjustment amount and the average adjustment rate of HVC-RA conductance during song learning and DAF. The corresponding formulas are where represents the conductance from HVCi to RAj during the th trial.

The average adjustment rate curve under two conditions was monotonic and nonincreasing. In contrast, the adjustment amount curve fluctuated above and below, especially during DAF, indicating that AFP’s adjustment is phased. For example, the adjustment amount decreased in the first 46 trials, while it remained stable or even increases in some special trials during the DAF. Besides, compared to that during song learning, the adjustment process of AFP is stronger and shorter.

6. Discussion

Our study replicated and extended previous research by Henry et al. on birdsong neural circuits. They constructed a physiological model of song premotor pathway and the syrinx, showing the neural process of song production [11]. In the same year, they also found that the intrinsic circuit within RA may greatly influence the features of birdsong [9]. However, they did not consider AFP’s adjustment to song premotor pathway and syllables. Despite many physiological experiments on AFP, its modeling studies are limited to describe a single neuron [9] and unable to support its role during song learning and DAF. Due to urgent research needs for AFP’s modeling study, we constructed an AFP-mediated birdsong neural model to show that AFP could significantly affect syllables based on its adjustment to the structure of the song premotor pathway. Through qualitative and quantitative analysis of AFP’s adjustment, we found the adjustment amount increased with more trials in some special cases, countering our initial expectations that AFP’s adjustment gradually weakened in prolonged trains. Our findings need experimental verifications and hold the potential to advance the field of birdsong neural modeling research.

In our model, we set HVC as a sparse signal generator and AFP as a song-regulated setup, which are both thought to integrate auditory feedback already. However, we did not show the specific processes. In actual song learning, the auditory feedback is variable and sent to HVC and AFP from other nervous tissue, such as dopamine (DA) neurons in the ventral tegmental area [25]. These processes need to be addressed to achieve a deeper understanding of learning and memory in our model.

Our model for song production has not been complete. For example, the interface core (NIf) is thought to control the order of syllables through its input to HVC [26]. The model for NIF needs to be built to expand our syllables into a complete birdsong. Besides, a new connection from AFP to HVC is being recognized since a finding by Hamaguchi et al. that destroying LMAN can prevent the weakening of HVCX synapses due to deafness [5]. Therefore, birdsong modeling should consider a bidirectional connection between HVC and AFP, which may play an important role during song learning and DAF. Finally, all neurons in our model are represented by the HH model, which may be too complex for large-scale modeling. These neurons should be constructed on a simplified model, such as the FitzHugh-Nagumo model, for larger simulation.

7. Conclusions

In this study, we proposed an AFP-mediated premotor pathway model of birdsong. The model successfully simulated the learning process in young birds and the syllable distortion process in deaf birds. These processes were based on the following three aspects. Firstly, RA neurons acted under a certain HVC-RA conductance matrix and transmitted structure information of the song premotor pathway to the syrinx, which then integrated input and generated syllables corresponding to the structure. Secondly, AFP that had integrated feedback information was active during birdsong and sent delayed input to RA, resulting in an adjustment to the conductance structure from HVC to RA and eventually regulating syllables. These simple processes were repeated to form the learning process of young birds. Thirdly, even with the same AFP structure, the weakening of synapses in HVCX neurons due to deafening would indirectly lead to the rapid syllable distortion process through AFP. The key point of the distortion process was that the weakened HVCX input caused abnormal activities of DLM projection neurons and then affected the input from LMAN to RA. The altered input disturbed the conductance of the song premotor pathway, causing syllable distortion in deaf birds. The syllable regulation’s neural mechanisms explain many experimental phenomena about AFP, and the phased regulation of AFP we found promotes the study of vocal learning and maintenance.

Data Availability

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that there are no conflicts of interest.

Acknowledgments

This work was supported by the National Natural Science Foundation of China under Grant No.11572127 and 11872183.