Power, Control, and OptimizationView this Special Issue
Chaos Enhanced Differential Evolution in the Task of Evolutionary Control of Selected Set of Discrete Chaotic Systems
Evolutionary technique differential evolution (DE) is used for the evolutionary tuning of controller parameters for the stabilization of set of different chaotic systems. The novelty of the approach is that the selected controlled discrete dissipative chaotic system is used also as the chaotic pseudorandom number generator to drive the mutation and crossover process in the DE. The idea was to utilize the hidden chaotic dynamics in pseudorandom sequences given by chaotic map to help differential evolution algorithm search for the best controller settings for the very same chaotic system. The optimizations were performed for three different chaotic systems, two types of case studies and developed cost functions.
In many engineering applications, one of the most innate tasks is the controlling of highly nonlinear dynamical systems in order to either eliminate or synchronize the chaos. The first pioneering approach to control chaotic dynamics by means of a simple analytical linearization method was introduced in 1990s by Ott et al. (i.e., OGY method) . Subsequently, the rapid development of methods for stabilizing of nonlinear chaotic dynamics has arisen and many advanced techniques have been applied for chaos control and chaos synchronization including methods from the artificial intelligence field.
During recent years, usage of new intelligent systems in engineering, technology, modeling, computing, and simulations has attracted the attention of researchers worldwide. The most current methods are mostly based on soft computing, which is a discipline tightly bound to computers, representing a set of methods of special algorithms, belonging to the artificial intelligence paradigm. The most popular of these methods are neural networks, evolutionary algorithms (EAs), fuzzy logic, and tools for symbolic regression like genetic programming. Currently, EAs are known as a powerful set of tools for almost any difficult and complex optimization problem.
The interest about the interconnection between evolutionary techniques and control of chaotic systems is rapidly spreading. The initial research was conducted in , whereas [3, 4] was more concerned with the tuning of parameters inside the chaos control technique based on the Pyragas method: extended delay feedback control (ETDAS) . When compared to the aforementioned research, later works [6, 7] show a possibility as to how to generate the entire control law (not only how to optimize several parameters) for the purpose of stabilization of a chaotic system. Such approach also may overcome the possible sensitivity to initial conditions which may lead to stability issues. The synthesis of control is inspired by the Pyragas’ delayed feedback control technique [8, 9]. This method is very advantageous for the evolutionary computation, due to its amount of easy accessible control parameters, which can be easily tuned by means of EAs.
Other approaches utilizing the EAs for stabilizing chaotic dynamics have mostly applied the particle swarm optimization (PSO) algorithm  and multi-interval gradient method  or minimum entropy control technique . EAs have been also frequently used in the task of synchronization of chaos [13–15]. In , an EA for optimizing local control of chaos based on a Lyapunov approach is presented.
Evolutionary techniques were also used for the synthesis of new complex discrete type structures with chaotic behavior  as well as the synthesis (identification) of a mathematical model of chaotic system based on the measured data .
Another example of interconnection between deterministic chaos and EAs represents the research focused on the embedding of chaotic dynamics into the EAs. Recent research in chaos driven heuristics has been fueled with the predisposition that, unlike stochastic approaches, a chaotic approach is able to bypass local optima stagnation. This one clause is of deep importance to EAs. A chaotic approach generally uses the chaotic map in the place of a pseudorandom number generator . This causes the heuristic to map unique regions, since the chaotic map iterates to new regions. The task is then to select a very good chaotic map as the pseudorandom number generator.
The initial concept of embedding chaotic dynamics into EAs is given in . Later, the initial study  was focused on the simple embedding of chaotic systems in the form of chaos pseudorandom number generator (CPRNG) for differential evolution (DE)  and self-organizing migrating algorithm (SOMA)  in the task of optimal PID tuning. Also, the PSO algorithm with elements of chaos was introduced as the CPSO . This field of research was later extended with the successful experiments with chaos driven DE  in real domain as well as in combinatorial problems domain [26, 27].
At the same time, the chaos embedded PSO with inertia weigh strategy was closely investigated , followed by the introduction of a PSO strategy driven alternately by two chaotic systems  and novel chaotic multiple choice PSO (chaos MC-PSO) strategy . Recently, the chaotic firefly algorithm was also introduced .
Finally, the last example represents the research focusing on the EAs and the edge of chaos. An unconventional approach of the edge of chaos and its application to discrete systems and evolutionary algorithms in terms of stagnation avoidance is presented in .
The organization of this paper is as follows: firstly, used evolutionary technique, which is DE, is described and is followed by the description of the ChaosDE concept. Thereafter, the problem design and appropriate corresponding cost functions are investigated and proposed. Results and conclusion follow afterwards.
This paper extends the research of evolutionary chaos control optimization by means of ChaosDE algorithm [33–35]. Recent studies have shown that differential evolution  is one of the most potent heuristics and it has been used for a number of optimization tasks; [36–38] have explored DE for combinatorial problems; [39, 40] have hybridized DE whereas [41–43] have developed self-adaptive DE variants.
In this paper, the DE/rand/1/bin strategy driven by different chaotic maps (systems) was utilized to solve the issue of evolutionary optimization of chaos control for the very same chaotic system used as a CPRNG in the particular case study. Thus, the idea was to utilize the hidden chaotic dynamics in pseudorandom sequences given by chaotic map to help differential evolution algorithm search for the best controller settings for the very same chaotic system. Since the very positive contribution of the chaotic dynamics to the performance of DE in the task of evolutionary chaos control optimization was proven in comparison with original canonical DE within the initial study , this paper is not primarily focused on the performance comparisons with different heuristic. But this research extends the initial work with the aforementioned idea and with the several case studies combining different chaotic systems and different utilized cost functions.
3. Used Heuristic: Differential Evolution (DE)
DE is a simple and powerful population-based optimization method that works either on real-number-coded individuals or with small modifications on discrete type individuals [22, 45, 46]. DE is quite robust, fast, and effective, with global optimization ability. This global optimization ability has been proven in many interdisciplinary researches. It works well even with noisy and time-dependent objective functions. The canonical basic principle is as follows.
For each individual in the current generation G, DE generates a new trial individual by adding the weighted difference between two randomly selected individuals and to a randomly selected third individual . The resulting individual is crossed over with the original individual . The fitness of the resulting individual, referred to as a perturbed vector , is then compared with the fitness of . If the fitness of is greater than the fitness of , then is replaced with ; otherwise, remains in the population as .
4. Concept of ChaosDE
This section contains the description of discrete dissipative chaotic maps, which can be used as the chaotic pseudorandom generators for DE as well as the main principle of the ChaosDE concept. In this research, direct output iterations of the chaotic maps were used for the generation of real numbers in the process of crossover based on the user defined CR value and for the generation of the integer values used for selection of individuals.
4.1. Chaotic Pseudorandom Number Generator
The general idea of ChaosDE and CPRNG is to replace the default PRNG with the discrete chaotic map. As the discrete chaotic map is a set of equations with a static start position, we created a random start position of the map, in order to have different start position for different experiments (runs of EAs). This random position is initialized with the default PRNG, as a one-off randomizer. Once the start position of the chaotic map has been obtained, the map generates the next sequence using its current position.
The first possible way is to generate and store a long data sequence (approximately 50–500 thousands numbers) during the evolutionary process initialization and keep the pointer to the actual used value in the memory. In case of the using up of the whole sequence, the new one will be generated with the last known value as the new initial one.
The second approach is that the chaotic map is not reinitialized during the experiment and any long data series is not stored; thus it is imperative to keep the current state of the map in memory to obtain the new output values.
As two different types of numbers are required in ChaosDE, real and integers, the use of modulo operators is used to obtain values between the specified ranges, as given in the following equations (2): where abs refers to the absolute portion of the chaotic map generated number rndChaos, mod is the modulo operator, and Range specifies the value (inclusive) till where the number is to be scaled.
4.2. Selected Chaotic Systems
This subsection contains the mathematical and graphical description of the three selected discrete dissipative systems, which served both as for CPRNGs and also as the examples of systems to be evolutionary controlled.
4.2.1. Burgers Map
The Burgers mapping is a discretization of a pair of coupled differential equations which were used by Burgers to illustrate the relevance of the concept of bifurcation to the study of hydrodynamics flows. The map equations are given in (3) with control parameters and as suggested in :
4.2.2. Delayed Logistic
The delayed logistic is a simple two-dimensional discrete system similar to the one-dimensional logistic equation. The map equations are given in (4). The parameter used in this work is as also suggested in :
4.2.3. Lozi Map
The Lozi map is a simple discrete two-dimensional chaotic map. The map equations are given in (5). The parameters used in this work are as follows: and as suggested in . For these values, the system exhibits typical chaotic behavior and, with this parameter setting, it is used in most research papers and other literature sources :
4.3. Graphical Examples
Three chaotic maps were selected for the CPRNG concept. The , plots of the selected maps are depicted in Figure 1 (Burgers map), Figure 4 (delayed logistic map), and Figure 7 (Lozi map). The chaotic behavior of the chaotic maps, represented by the examples of direct output iterations, is depicted in Figures 2, 5, and 8. Finally, the illustrative histograms of the distribution of real numbers transferred into the range generated by means of chaotic maps are in Figures 3, 6, and 9.
5. Design of Cost Functions for Chaotic System Stabilization
The proposal of the basic cost function (CFSimple) is in general based on the simplest CF, which could be used problem-free only for the stabilization of p-1 orbit. The idea was to minimize the area created by the difference between the required state and the real system output on the whole simulation interval, (6). This CF design is very convenient for the evolutionary searching process due to the relatively favorable CF surface. Nevertheless, this simple approach has one big disadvantage, which is the including of initial chaotic transient behavior of not stabilized system into the cost function value. As a result of this, the very tiny change of control method setting for extremely sensitive chaotic system (given by the very small change of CF value) can be suppressed by the aforementioned inclusion of initial chaotic transient behavior. Consider where TS is target state and AS is actual state.
Different type of universal cost function without any selection rules is purely based on searching for the desired stabilized periodic orbit and thereafter calculation of the difference between desired and found actual periodic orbit on the short time interval, (20 iterations), from the point where the first minimal value of difference between desired and actual system output is found (i.e., floating window for minimization; see Figure 10).
Such a design of universal CF should secure the successful stabilization of either p-1 orbit (stable state) or any higher periodic orbit anywise phase shifted. Furthermore, due to CF values converging towards zero, this CF also allows the use of decision rules, avoiding very time demanding simulations. This rule stops EA immediately, when the first individual with good parameter structure is reached; thus the value of CF is lower than the acceptable (CFacc) one. Based on the numerous experiments, typically at time interval iterations; thus the difference between desired and actual output has the value of 0.0005 per iteration, that is, successful stabilization for the used control technique. The has the following form: where is the first min value of the difference between TS and AS and is the end of optimization interval if if (i.e., late stabilization).
The issue of pure searching for periodic orbits causes very chaotic, erratic, and discrete type CF surfaces.
6. Experimental Design
This research encompasses six case studies. Six different sets of discrete chaotic systems as CPRNGs/to be controlled and two different cost functions were combined in the following form:(i)case study 1: Burgers map as CPRNG/controlled system with CFSimple,(ii)case study 2: Burgers map as CPRNG/controlled system with ,(iii)case study 3: delayed logistic map as CPRNG/controlled system with CFSimple,(iv)case study 4: delayed logistic map as CPRNG/controlled system with ,(v)case study 5: Lozi map as CPRNG/controlled system with CFSimple,(vi)case study 6: Lozi map as CPRNG/controlled system with .
This work is focused on the utilization of the chaos driven DE for tuning of parameters for ETDAS control method to stabilize desired unstable periodic orbits (UPO). In the described research, desired UPO was p-1 (stable state). The original control method, ETDAS, in the discrete form suitable for discrete chaotic maps has the following form: where and are adjustable constants, is the perturbation, is given by a delay equation utilizing previous states of the system, and is the period of -periodic orbit to be stabilized. The perturbation in (8) may have arbitrarily large value, which can cause the divergence of the system. Therefore, should have a value between— and . The ranges of all evolutionary estimated parameters are given in Table 1.
Within the research, a total number of 50 simulations with ChaosDE were carried out for each case study. The parameter settings for ChaosDE were obtained analytically based on numerous experiments and simulations (see Table 2). Experiments were performed in an environment of Wolfram Mathematica; PRNG operations therefore used the built-in Mathematica software pseudorandom number generator. All experiments used different initialization; that is, different initial population was generated in each run of chaos driven DE.
All simulations were successful and have given new optimal settings for ETDAS control method securing the fast stabilization of the chaotic system at required behaviour (p-1 orbit). Tables 4, 5, 6, 7, 8, and 9 contain the simple statistical overview of optimization/simulation results as well as the best founded individual solutions of parameters setup for ETDAS control method, corresponding final CF value, also, the Istab. Value representing the number of iterations required for stabilization on desired UPO, and further the average error between desired output value and real system output from the last 20 iterations.
Graphical simulation outputs of the best individual solutions for particular case studies are depicted in Figures 11, 13, and 15, whereas Figures 12, 14, and 16 show the simulation output of all 50 runs of ChaosDE, thus confirming the robustness of this approach. For the illustrative purposes, all graphical simulations outputs are depicted only for the variable of the chaotic systems.
The values for desired p-1 UPOs (fixed points) of unperturbed chaotic systems based on the mathematical analysis of the systems are given in Table 3.
From the results presented in the Tables 4–9, it follows that the CF-simple is very convenient for evolutionary process, which means that repeated runs of EA are giving identical optimal results (i.e., very close to the possible global extreme). This is graphically confirmed in Figures 12, 14, and 16, which show all 50 simulations. All the runs are basically merged into one line.
On the other hand, the disadvantage of including of initial chaotic transient behavior of not stabilized system into the cost function value and subsequent resulting very tiny change of control method setting for extremely sensitive chaotic system is causing suppression of stabilization speed and numerical precision.
Results obtained in the cases utilizing the lend weight to the argument that the technique of pure searching for periodic orbits is advantageous for faster and more precise stabilization of chaotic system.
Based on obtained results, it may be claimed that the presented ChaosDE driven by selected discrete dissipative chaotic systems has given satisfactory results in the chaos control optimization issue.
The results show that the embedding of the chaotic dynamics in the form of chaotic pseudorandom number generator into the differential evolution algorithm may help to improve the performance and robustness of the DE. ChaosDE is able to obtain optimal solutions securing the very fast and precise stabilization for both convenient CF surface, in case of the CF-simple, as well as for the very chaotic and nonlinear CF surface in case of the CF-universal.
When comparing both the CF designs, the CF-simple is very convenient for evolutionary process (i.e., repeated runs are giving identical optimal results), but it has many limitations.
The second universal CF design brings the possibility of using it problem free for any desired behavior of arbitrary chaotic systems but at the cost of the highly chaotic CF surface. Nevertheless, the embedding of the chaotic dynamics into the evolutionary algorithms helped to deal with such an issue.
The primary aim of this work was not to develop any new pseudorandom number generator, which should normally pass many statistical tests but to show that through embedding the hidden chaotic dynamics into the evolutionary process in the form of chaotic pseudorandom number generators may help to obtain better results and avoid problems connected with evolutionary computation such as premature convergence and stagnation in local extremes.
Future plans include testing of different chaotic systems, either manually or evolutionary tuning of parameters of chaotic maps, further complex comparisons with different heuristics and obtaining a large number of results to perform statistical tests.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by Grant Agency of the Czech Republic, GACR P103/13/08195S, partially supported by Grant of SGS nos. SP2014/159 and SP2014/170, VŠB-Technical University of Ostrava, Czech Republic and by the Development of Human Resources in Research and Development of Latest Soft Computing Methods and Their Application in Practice Project, Registry no. CZ.1.07/2.3.00/20.0072, funded by Operational Programme Education for Competitiveness, and cofinanced by ESF and state budget of the Czech Republic; it was further supported by the European Regional Development Fund under the Project CEBIA-Tech no. CZ.1.05/2.1.00/03.0089 and by the Internal Grant Agency of Tomas Bata University under the Project no. IGA/FAI/2014/010.
W. Just, “Principles of time delayed feedback control,” in Handbook of Chaos Control, H. G. Schuster, Ed., Wiley- Vch, 1999.View at: Google Scholar
R. Senkerik, Z. Oplatkova, I. Zelinka, and D. Davendra, “Synthesis of feedback controller for three selected chaotic systems by means of evolutionary techniques: analytic programming,” Mathematical and Computer Modelling, vol. 57, no. 1-2, pp. 57–67, 2013.View at: Publisher Site | Google Scholar | MathSciNet
Z. Kominkova Oplatkova, R. Senkerik, I. Zelinka, and M. Pluhacek, “Analytic programming in the task of evolutionary synthesis of a controller for high order oscillations stabilization of discrete chaotic systems,” Computers and Mathematics with Applications, vol. 66, no. 2, pp. 177–189, 2013.View at: Publisher Site | Google Scholar
M. Abedini, R. Vatankhah, and N. Assadian, “Stabilizing chaotic system on periodic orbits using multi-interval and modern optimal control strategies,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 10, pp. 3832–3842, 2012.View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
M. J. Shirazi, R. Vatankhah, M. Boroushaki, H. Salarieh, and A. Alasty, “Application of particle swarm optimization in chaos synchronization in noisy environment in presence of unknown parameter uncertainty,” Communications in Nonlinear Science and Numerical Simulation, vol. 17, no. 2, pp. 742–753, 2012.View at: Publisher Site | Google Scholar | MathSciNet
I. Zelinka and A. Raidl, “Evolutionary synchronization of chaotic systems,” in Evolutionary Algorithms and Chaotic Systems, I. Zelinka, S. Celikovsky, H. Richter, and G. Chen, Eds., vol. 267, pp. 385–407, Springer, Berlin, Germany, 2010.View at: Google Scholar
K. V. Price, R. M. Storn, and J. A. Lampinen, Differential Evolution—a Practical Approach to Global Optimization, Natural Computing Series, Springer, Berlin, Germany, 2005.View at: MathSciNet
R. Senkerik, D. Davendra, I. Zelinka, M. Pluhacek, and Z. Oplatkova, “Aninvestigation on the chaos driven differential evolution: an initial study,” in Proceedings of the 5th International Conference on Bioinspired Optimization Methods and Their Applications (BIOMA '12), pp. 185–194, 2012.View at: Google Scholar
D. Davendra, I. Zelinka, R. Senkerik, and M. Bialic-Davendra, “Chaos driven evolutionary algorithm for the traveling salesman problem,” in Traveling Salesman Problem, Theory and Applications, D. Davendra, Ed., InTech, 2010.View at: Google Scholar
D. Davendra, M. Bialic-Davendra, and R. Senkerik, “Scheduling the lot-streaming flowshop scheduling problem with setup time with the chaos-induced enhanced differential evolution,” in Proceedings of the IEEE Symposium on Differential Evolution (SDE '13), pp. 119–126, Singapore, April 2013.View at: Publisher Site | Google Scholar
M. Pluhacek, R. Senkerik, and I. Zelinka, “Multiple choice strategy based PSO algorithm with chaotic decision making—a preliminary study,” in International Joint Conference SOCO’13-CISIS’13-ICEUTE’13, Á. Herrero, B. Baruque, F. Klett et al., Eds., vol. 239 of Advances in Intelligent Systems and Computing, pp. 21–30, 2014.View at: Google Scholar
D. Davendra, “Evolutionary algorithms and the edge of chaos,” in Evolutionary Algorithms and Chaotic Systems, I. Zelinka, S. Celikovsky, H. Richter, and G. Chen, Eds., vol. 267, pp. 145–161, Springer, Berlin, Germany, 2010.View at: Google Scholar
R. Senkerik, M. Pluhacek, I. Zelinka, D. Davendra, Z. Oplatkova, and R. Jasek, “Evolutionary control of chaotic Lozi map by means of chaos driven differential evolution,” in AETA 2013: Recent Advances in Electrical Engineering and Related Sciences, I. Zelinka, V. H. Duy, and J. Cha, Eds., vol. 282 of Lecture Notes in Electrical Engineering, pp. 371–380, Springer, Berlin, Germany, 2014.View at: Publisher Site | Google Scholar
R. Senkerik, I. Zelinka, M. Pluhacek, and Z. Kominkova Oplatkova, “Evolutionary control of chaotic burgers map by means of chaos enhanced differential evolution,” International Journal of Mathematics and Computers in Simulation, vol. 8, pp. 39–45, 2014.View at: Google Scholar
R. Senkerik, M. Pluhacek, I. Zelinka, D. Davendra, Z. Oplatkova, and R. Jasek, “Chaos driven differential evolution in the task of evolutionary control of delayed logistic chaotic system,” in Proceedings of the 7th Global Conference on Power Control and Optimization (PCO '13), 2013.View at: Google Scholar
L. Wang, H. Qu, T. Chen, and F. P. Yan, “An effective hybrid self-adapting differential evolution algorithm for the joint replenishment and location-inventory problem in a three-level supply chain,” The Scientific World Journal, vol. 2013, Article ID 270249, 11 pages, 2013.View at: Publisher Site | Google Scholar
J. Zhang and A. C. Sanderson, “Self-adaptive multi-objective differential evolution with direction information provided by archived inferior solutions,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '08), pp. 2801–2810, Hong Kong, China, June 2008.View at: Publisher Site | Google Scholar
K. V. Price, “An introduction to differential evolution,” in New Ideas in Optimization, D. Corne, M. Dorigo, and F. Glover, Eds., McGraw-Hill, 1999.View at: Google Scholar
J. C. Sprott, Chaos and Time-Series Analysis, Oxford University Press, New York, NY, USA, 2003.View at: MathSciNet