Complexity, Nonlinear Evolution, Computational Experiments, Agent-Based Modeling and Big Data Modeling for Complex Social SystemsView this Special Issue
Research Article | Open Access
Gaofei Luo, Sayan Mukherjee, "In Search of Chaos and Complexity of a Cognitive Language-Learning System", Complexity, vol. 2020, Article ID 7169597, 10 pages, 2020. https://doi.org/10.1155/2020/7169597
In Search of Chaos and Complexity of a Cognitive Language-Learning System
In this article, we investigate the long-term dynamics of a known cognitive-based language-learning system under the variation of a system parameter. Stability of the equilibrium points is studied. Period root to chaos is investigated by bifurcation analysis. A Lyapunov analysis is performed to verify the complex dynamics in the system. Existence of chaos is confirmed by 0-1 test. A noise-induced cognitive phenomenon is proposed under the effect of power noise. Chaotic and nonchaotic dynamics are explored in the noise-induced system. Furthermore, disorder as well as complexity, are investigated for both the systems using the concept of weighted recurrence. The whole analysis can be effective to understand the dynamical features and nonlinear structure of the cognitive language-learning model.
Human language is an expressible complex communication system which consists of phonemes, words, phrases, sentences, poetry, and publications [1–4]. Grammar is itself an internal computational system that is used to represent a sentence in the language-learning process [5–7]. People store this internal grammar in the subconscious mind and spontaneously explore it to develop linguistic behaviour. So, language changes over time and hence dynamics is an obvious property of it. Small changes in linguistic data accumulation and interaction with different languages can produce unpredictably complex dynamics in the learning system [1, 8, 9]. As data accumulation and its utilization depend on the human mind, complex dynamics is an effective tool to study the behaviour of cognitive-based language-learning (CBLL) system [10–12]. In , it has been already established that chaotic dynamics exist for a CBLL system. However, it does not contain “forgetting” property in the cognitive growth . In this paper, the existence of deterministic and noise-induced chaos [13–19] in a known CBLL system was investigated for the first time. Moreover, the complexity of the respective dynamics has been studied which is not explored indeed.
Chaos can be verified by measuring the exponential divergence between the phase space trajectories . Lyapunov exponent (LE) is one of the powerful tools that can measure the exponential divergence properly [20, 21]. An alternative measure 0-1 test method [22, 23] was also proposed that can successfully characterize regular as well as chaotic behaviour of the system [22, 23]. Moreover, it is applicable for both deterministic and noise-induced system . The invariant characteristic of phase space can be characterized by measuring the complexity of the corresponding system . It can identify the disorder in the phase space trajectories by utilizing the concept of Shannon entropy . Several entropy measures have been proposed to quantify the complexity [26–37]. Recurrence-based entropy is one of the effective measures that can be applied in any dimensional system [38, 39]. However, it does not correlate with the proper dynamics of the system due to the selection of incorrect threshold . To overcome this situation, a new entropy measure has been proposed based on weighted recurrence plot .
This manuscript is organized as follows. In Section 2, a cognitive language-learning system is considered and illustrated by the schematic diagram. Complex dynamics is investigated for both the CBLL and its noise-induced system in Sections 3.1 and 3.2, respectively. In section 3.1, equilibrium points and the respective stability both are determined, and multiperiodicity and chaos are investigated by bifurcation analysis, Lyapunov study, and 0-1 test method. In Section 3.2, a noise-induced CBLL phenomenon is proposed and described by a schematic representation. Furthermore, chaos in the noise-induced CBLL is also investigated numerically by the 0-1 test method in the same section. The corresponding phase space behaviour is also investigated for the CBLL and its noise-induced systems in Sections 3.1 and 3.2, respectively. Section 4 discusses the complexity of both the systems using weighted recurrence entropy analysis. Section 5 is the conclusion.
2. Mathematical Model of a Cognition-Based Language Learning (CBLL) Phenomenon
We consider a cognitive language growth model proposed in . In this model, the growth in language is subject to the constraint of forgetting or loss of proficiency in the human brain. A schematic diagram is given in Figure 1 to describe the CBLL model.
As cognitive learning is always dependent on some resource , we mentioned a set of language resources in Figure 1. The human brain collects the information from language resource and then processes it for learning. So, resource growth factor is one of the major parameters in cognitive learning. In Figure 1, denotes the resource growth parameter. Furthermore, our brain is not capable to store all information with stabilized condition. Thus, forgetting or loss of information affects the learning process. In Figure 1, denotes the forgetting parameters which have been incorporated with the CBLL system in . Mathematically, the system can be expressed by , where and represent input and output, respectively. In , the explicit form of the is given by . According to the study in , depends on intrinsic growth rate , carrying capacity , and also the input by . Furthermore, it has been also established in  that the forgetting parameter depends on intrinsic forgetting growth , , and by . Thus, the CBLL system is given bywhere is known as braking parameter given by . For our purpose, we fix the respective values of , and by , respectively. By solving (1), we get an output which is called language growth oscillation or simply language growth of the system. In Figure 1, the language growth is shown at the extreme right panel.
3. Dynamics of the CBLL System
3.1. Nonnoisy Condition
We first investigated equilibrium points of (1) and the respective stabilities under the variation of . To calculate equilibrium points of (1), we consider an equation: , where represents equilibrium point in (1). The equation gives two solution of , say given by and . As we fixed , , and , can be considered as , where . Then, stability of and are investigated by perturbing system (1) with (perturbation). Then, by Taylor’s theorem, we can have with the small perturbation. Hence, . It indicates that if , i.e., the system is said to be stable and unstable if and , respectively. We thus investigate stability region of by verifying with the variation in . As at the equilibrium points , we get for . As for , no conclusion can be inferred. Since for all , it implies is unstable in nature. Same analysis is done for . The analysis shows for . The stability regions for and are given in Figure 2.
We divide the whole graph into three windows. From the first window, it can be observed that system (1) produces single and double periods for , whether the second window shows the existence of two as well as four periods in (1) for . On the other hand, multiple periods can be seen for the same system with (see the third window in Figure 3). So, the entire bifurcation analysis indicates that the dynamics of (1) may be complex with the increase of . To confirm this, we have investigated Lyapunov exponent (LE) for the system (1) with . The LE is calculated bywhere represents length of the .
Figure 4(a) shows fluctuation of over . It can be observed from Figure 4(a) that the oscillation of always fluctuates in [−4, 0] for . It assures nonchaotic dynamics in (1) over . Furthermore, and can be seen for . It indicates chaotic as well as nonchaotic dynamics exists in (1) for . However, it can be investigated that the values of positive for some in Figure 4(a). In this case, chaos cannot be confirmed for the system as two different trajectories show very small divergence with the perturbation in initial condition. We thus investigate chaos in (1) by test method. In this method, a solution component, say ( being the length of the component) of a system is considered [22, 23]. Then, decomposes into two components by the transformation:
The chaotic and nonchaotic dynamics of a system can be identified by the nature of -plots. In fact, regular and Brownian motion-like structure of the -plots corresponds with respective nonchaotic and chaotic dynamics of the system [22, 23]. We have investigated -plots for system (1) with . Figures 4(b) and 4(c) show two -plots for and 3, respectively.
From Figure 4(b), it can be seen that the -plot contains a regular geometrical structure. It indicates nonchaotic dynamics in (1). On the contrary, Brownian motion-like structure can be observed in Figure 4(c). It corresponds to chaotic dynamics in (1). To quantify chaotic and nonchaotic dynamics, we compute fluctuation of given bywhere is defined as
The values of and 1 correspond nonchaotic and chaotic dynamics of the system. Figure 4(d) shows fluctuation of over . From Figure 4(d), it can be observed that values of for all . It assures nonchaotic dynamics in (1). It can be also observed that, , 0 and may happens for the same system with . It implies chaotic as well as nonchaotic dynamics exists in (1) for .
We further investigated oscillation of and its corresponding phase space behaviour of system (1) over . Figures 5(a) and 5(c) show oscillation of for and 3, respectively. It can be observed from the figures that variation in for is lesser than that for . It indicates system (1) reveals more complex language growth for compared to the same for . Thus, nature of language growth can be investigated in (1) for the entire range of . However, long-term dynamics in (1) cannot be possible to predict by investigating only. So, a phase space analysis is carried out for (1) with . In order to investigate phase space of (1), we construct Poincare’ plot for each . Figures 5(b) and 5(d) represent two Poincare’ plots with respectively. In 5(b), the corresponding plot shows few cluster of clouds. As maximum number of points coverages to each another, it indicates stable dynamics in (1) for . On the contrary, the Poincare plot in Figure 5(d) indicates the well-known chaotic logistic curve for . It implies a strong correlation between the phase space and 0-1 test analysis. Moreover, existence of this correlation can also be verified for all . In this way, existence of chaotic as well as nonchaotic dynamics in (1) is identified.
3.2. Noisy Condition
To study the dynamics of the CBLL system under the effect of noise, we incorporate a multiplicative noise in (1) with the noise strength . The whole phenomenon is described in a schematic diagram given by Figure 6. In Figure 6, indicates multiplication. The green arrow denotes the incorporation of with the intrinsic parameter . The functional form of the resultant CBLL system is given by (see Figure 6).
The noise-induced system is thus given bywhere represent the same as mentioned for the nonnoisy case. For our purpose, is taken as -noise with .
In this case, we have investigated chaotic and nonchaotic dynamics in (6) under both the variation of and , respectively. To do so, we have applied the 0-1 test method in (6). Figures 7(a) and 7(b) show respective -plots for and with the fixed . From the respective plots, a regular geometric structure and Brownian motion-like movement can be observed for and , respectively. It indicates nonchaotic and chaotic dynamics in (6), respectively. These can be also identified for all and .
In the next, fluctuation of is also measured for the same with . The corresponding graph is given in Figure 7(c). It can be observed from Figure 7(c) that for all and for . It assures chaotic and nonchaotic dynamics in (6) for and , respectively. Hence, the method of 0-1 test can classify chaotic as well as nonchaotic phenomena in (6) over with fixed . Furthermore, fluctuation of is investigated over . Figure 7(d) shows the corresponding contour diagram. From the figure, it can be seen that yellow, green, blue, pink, and red regions are comparatively smaller than the dark red region. As dark red region corresponds and other regions correspond , respectively, it implies chaos in (6), which can be observed for almost all . It can be also observed that for and . It follows nonchaotic dynamics in (6) with the increasing for the noise strength . Furthermore, an increasing trend in with the increase of with can be observed for (6). As attains its maximum value (i.e., 1) in this case, chaotic dynamics in (6) can be first observed in the region . We call it first chaotic paradigm for system (6). For the remaining region, i.e., , dark red color confirms chaotic dynamics in (6). It establishes the existence of complex dynamics in the noise-induced CBLL system. Moreover, analysis of the 0-1 test method also differentiates the chaotic and nonchaotic paradigm for the same system.
We also investigated oscillation of and its corresponding phase space nature of system (6) over and . Figures 8(a) and 8(c) show oscillation of for and , respectively. It can be observed from Figures 8(a) and 8(b) that abrupt changes in for is higher than that for . It indicates, more complex oscillation in for compared to the same for . By comparing the s in (1) and (6), it can be observed that for some in the deterministic chaos whether in the noise-induced chaos, does not vanishes for any , , (see Figures 5(a) and 5(c) and Figures 8(a) and 8(c)). To investigate long-term behaviour of (6), Poincare plots are constructed for the same and , respectively. Figures 8(b) and 8(d) represent two Poincare plots with and , respectively. It can be seen that the corresponding Poincare cloud for is less distorted compare with the same for . The oscillation in and its corresponding phase space behaviour can also be investigated for . It gives a strong correlation with the fluctuation in , as shown in Figure 7(d).
So, complex dynamics in both systems (1) and (6) are identified successfully over the feasible parametric region under the variable noise strength. However, it does not reflect complexity in the corresponding long-term dynamics of the systems. A quantification is thus needed to measure the complexity of the respective asymptotic dynamics. In the following section, the complexity of (1) and (6) are investigated by weighted recurrence entropy .
4. Recurrence-Based Complexity Analysis
The weighted recurrence entropy (WRE) is proposed by utilizing Shannon entropy based on the weighted recurrence of phase space. An weighted recurrence for a given -dimensional phase space is denoted by and defined aswhere being the length of the trajectory of the phase space and is given by . As difference between indicates separation between two points, it implies can quantify dispersion between the trajectories. Hence, disorder in can be measured by matrix plot. Furthermore, can measure exponential decay of . So, values of always lies between 0 and 1. It indicates disorder in the phase space can be sampled within . Then, weight recurrence entropy is defined aswhere denotes probability of ( being number of events).
From both the figures, it can be observed that greater variation in Figure 9(c) exists compare to the same in Figure 9(a). It indicates disorder in the phase space of (1) for is greater than that for . In this way, disorder and hence complexity in the phase space of (1) for the entire range of can be recognized. To quantify complexity, we further calculate the probabilities using for . Figures 9(b) and 9(d) represent probability curves of the respective disorder given in Figures 9(a) and 9(c). In Figure 9(b), only two sharp peaks can be observed. It signifies that there exists only two variations in Figure 9(a). On the contrary, large number of probabilities in Figure 9(d) indicates that the corresponding phase space is more complex than for . To verify this, we have calculated respective using (8). It has been seen that . It confirms existence of higher complexity in (1) with than that in same for . We also investigated complexity in (1) for the entire range of . To do this, fluctuation in is measured over . The corresponding curves are shown in Figure 9(e). From the figure, it can be observed that a strong correlation exists between and the (given in Figure 4(d)).
From Figures 10(a) and 10(c), similar kind of patterns can be observed in the respective matrix, except the values of . From the color bar, it can be seen that range of for , whether for . It indicates greater dispersion between the trajectories for compared to the same for . It signifies more disordered structures in the corresponding phase space with can be observed compare to the other. In order to verify this, we further calculate respective probability distribution, which is given in Figures 10(b) and 10(d). The distribution for shows variation in for larger range compare to the same for . Finally, using (8), we have found that . It confirms that complexity in (6) for is greater than that for . Since difference , it corresponds difference between the disorder in the phase spaces are very small. Furthermore, complexity in (6) is studied over with . Figure 10(e) shows the corresponding vs. graphs. It is observed that there exists a strong correlation between the trend in and . It is noted that system (6) can possesses higher complexity compare to the same in (1) at the nonchaotic state.
Finally, we have investigated variation in over . The corresponding contour is shown in Figure 10(f). From the figure, it is observed that values of can be obtained for a very small range of . In fact, values of lies in for almost all region.
In this article, dynamics and complexity are explored for a CBLL and its noise-induced system. The dynamics of the CBLL system have been investigated by equilibrium and its stability, bifurcation, Lyapunov, and 0-1 test analysis. Bifurcation analysis shows periodic as well as multiperiodic solution can be obtained with the variation of intrinsic growth parameter . It has been also observed that multiperiodicity increases with an increase of . It initially indicates the existence of complex dynamics in the CBLL. To verify this, Lyapunov analysis has been performed under the same variation in . Our investigation confirms that the CBLL can have chaotic as well as multiperiodic features. As some of the positive have been obtained very close to zero, we have carried out 0-1 test analysis. It successfully quantified the chaotic paradigm for the same . Later on, oscillation in language growth and the phase space behaviour have been investigated. It assures that the CBLL system can possess unstable oscillations in and hence chaotic dynamics with the various . For the noise-induced CBLL, the 0-1 test method is applied. The effect of noise strength and the variation of both have been investigated in the noise-induced system. It assures that chaos can be enhanced in the CBLL under the effect of power noise. It has been remarked that deterministic SBLL may contain zero level language growth in some chaotic state. It is not feasible in any real-world cognitive learning phenomena. On the contrary, noise-induced chaotic language growth does not vanish at any condition. It indicates the effectiveness of noise-induced chaos in cognitive language learning. The complexity of both the systems has been quantified using WRE. The corresponding analysis shows that complexity in the CBLL increases with an increase of . On computing complexity, it has been notified that the noise-induced CBLL can produce highly complex phenomena even if its corresponding dynamics was nonchaotic. This phenomenon does not exist for the deterministic case.
All the data used in this study are included within the text.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
- W. G. Mitchener and M. A. Nowak, “Chaos and language,” Proceedings of the Royal Society of London. Series B: Biological Sciences, vol. 271, no. 1540, pp. 701–704, 2004.
- S. J. Greenhill, C.-H. Wu, X. Hua, M. Dunn, S. C. Levinson, and R. D. Gray, “Evolutionary dynamics of language systems,” Proceedings of the National Academy of Sciences, vol. 114, no. 42, pp. E8822–E8829, 2017.
- M. Arbib, “How the brain got language,” The Mirror-System Hypothesis, Oxford University Press, Oxford, UK, 2012.
- A. Bergs and G. Diewald, Constructions and Language Change, Mouton de Gruyter, Berlin, Germany, 2008.
- S. Pinker, The Language Instinct, William Morrow and Company, New York, NY, USA, 1990.
- R. Jackendoff, Foundations of Language, Oxford University Press, Oxford, UK, 2002.
- V. Barrès and J. Lee, “Template construction grammar: From visual scene description to language comprehension and agrammatism,” Neuroinformatics, vol. 12, no. 1, pp. 181–208, 2013.
- M. A. Nowak, N. L. Komarova, and P. Niyogi, “Evolution of universal grammar,” Science, vol. 291, no. 5501, pp. 114–118, 2001.
- P. V. Geert, “A dynamic systems model of cognitive and language growth,” Psychological Review, vol. 98, no. 1, pp. 3–53, 1991.
- L. Steels and E. Szathmáry, “The evolutionary dynamics of language,” BioSystems, vol. 164, pp. 128–137, 2018.
- D. L. Freeman, On the Complementarity of Chaos/Complexity Theory and Dynamic Systems Theory in Understanding the Second Language Acquisition Process, Cambridge University Press, Cambridge, UK, 2007.
- J. Dong, “A dynamic systems theory approach to development of listening strategy use and listening performance,” System, vol. 63, pp. 149–165, 2016.
- I. Bashkirtseva, E. Ekaterinchuk, and L. Ryashko, “Stochastic sensitivity analysis and noise-induced chaos in 2D logistic-type model,” International Journal of Bifurcation and Chaos, vol. 26, no. 4, Article ID 1650053, 2016.
- H. Kantz and T. Schreiber, Nonlinear Time Series Analysis, Cambridge University Press, Cambridge, UK, 2nd edition, 2004.
- J.-P. Eckmann and D. Ruelle, “Ergodic theory of chaos and strange attractors,” Reviews of Modern Physics, vol. 57, pp. 617–656, 1986.
- S. Banerjee and M. R. K. Ariffin, “Noise induced synchronization of time-delayed semiconductor lasers and authentication based asymmetric encryption,” Optics & Laser Technology, vol. 45, pp. 435–442, 2013.
- T. M. Hoang, S. K. Palit, S. Mukherjee, and S. Banerjee, “Synchronization and secure communication in time delayed semiconductor laser systems,” Optik, vol. 127, no. 22, pp. 10930–10947, 2016.
- S. K. Palit, N. A. A. Fataf, M. R. Md Said, S. Mukherjee, and S. Banerjee, “Complexity in synchronized and non-synchronized states: A comparative analysis and application,” The European Physical Journal Special Topics, vol. 226, no. 10, pp. 2219–2234, 2017.
- T. S. Dang, S. K. Palit, S. Mukherjee, T. M. Hoang, and S. Banerjee, “Complexity and synchronization in stochastic chaotic systems,” The European Physical Journal Special Topics, vol. 225, no. 1, pp. 159–170, 2016.
- T. Schreiber, “Interdisciplinary application of nonlinear time series methods,” Physics Reports, vol. 308, no. 1, pp. 1–64, 1999.
- T. S. Parker and L. O. Chua, Practical Numerical Algorithms for Chaotic Systems, Springer, Berlin, Germany, 1989.
- G. A. Gottwald and I. Melbourne, “A new test for chaos in deterministic systems,” Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, vol. 460, no. 2042, pp. 603–611, 2004.
- G. A. Gottwald and I. Melbourne, “Comment on “Reliability of the 0-1 test for chaos,” Physical Review E, vol. 77, no. 2, Article ID 028201, 2008.
- G. A. Gottwald and I. Melbourne, “Testing for chaos in deterministic systems with noise,” Physica D: Nonlinear Phenomena, vol. 212, no. 1-2, pp. 100–110, 2005.
- F. Franchini, A. R. Its, and V. E. Korepin, “Re’nyi entropy of the XY spin chain,” Journal of Physics A: Mathematical and Theoretical, vol. 41, no. 2, p. 025302, 2008.
- Y. G. Sinai, “On the notion of entropy of a dynamical system,” Dokl Akad Nauk SSSR, vol. 124, pp. 768–771, 1959.
- A. Kolmogorov, “Entropy per unit time as a metric invariant of automorphism,” Dokl Akad Nauk SSSR, vol. 124, pp. 754-755, 1959.
- S. M. Pincus, “Approximate entropy as a measure of system complexity,” Proceedings of the National Academy of Sciences, vol. 88, no. 6, pp. 2297–2301, 1991.
- J. S. Richman, D. E. Lake, and J. R. Moorman, “Sample entropy,” Methods in Enzymology, Academic Press, Cambridge, MA, USA, 2004.
- S. He and S. Banerjee, “Multicavity formations and complexity modulation in a hyperchaotic discrete system,” Physica A: Statistical Mechanics and its Applications, vol. 490, pp. 366–377, 2018.
- S. He, S. Banerjee, and B. Yan, “Chaos and symbol complexity in a conformable fractional-order memcapacitor system,” Complexity, vol. 2018, pp. 1–15, 2018.
- B. Yan, S. Mukherjee, and S. He, “A study on dynamical complexity of noise induced blood flow,” The European Physical Journal Special Topics, vol. 228, no. 12, pp. 2769–2777, 2019.
- B. Yan, S. K. Palit, S. Mukherjee, and S. Banerjee, “Signature of complexity in time-frequency domain,” Physica A: Statistical Mechanics and its Applications, vol. 535, p. 122433, 2019.
- S. Mukherjee, S. Banerjee, and L. Rondoni, “Dispersive graded entropy on computing dynamical complexity,” Physica A: Statistical Mechanics and its Applications, vol. 508, pp. 131–140, 2018.
- S. Banerjee, S. K. Palit, S. Mukherjee, M. R. K. Ariffin, and L. Rondoni, “Complexity in congestive heart failure: A time-frequency approach,” Chaos: An Interdisciplinary Journal of Nonlinear Science, vol. 26, no. 3, Article ID 033105, 2016.
- S. He, N. A. A. Fataf, S. Banerjee, and K. Sun, “Complexity in the muscular blood vessel model with variable fractional derivative and external disturbances,” Physica A: Statistical Mechanics and its Applications, vol. 526, Article ID 120904, 2019.
- S. He, S. Banerjee, and K. Sun, “Complex dynamics and multiple coexisting attractors in a fractional-order microscopic chemical system,” The European Physical Journal Special Topics, vol. 228, no. 1, pp. 195–207, 2019.
- J.-P. Eckmann, S. O. Kamphorst, and D. Ruelle, “Recurrence plots of dynamical systems,” Europhysics Letters (EPL), vol. 4, no. 9, pp. 973–977, 1987.
- N. Marwan, C. Romano, M. Thiel, and J. Kurths, “Recurrence plots for the analysis of complex systems,” Physics Reports, vol. 438, no. 5-6, pp. 237–329, 2007.
- D. Eroglu, T. K. D. M. Peron, N. Marwan et al., “Entropy of weighted recurrence plots,” Physical Review E, vol. 90, Article ID 042919, 2014.
Copyright © 2020 Gaofei Luo and Sayan Mukherjee. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.