Controller Design Based on Echo State Network with Delay Output for Nonlinear System

Yao, Xianshuang; Fan, Siyuan; Zhao, Bo; Cao, Shengxian

doi:https://doi.org/10.1155/2020/8643029

Complexity

On this page

Abstract Introduction Discussion Data Availability Conflicts of Interest References Copyright Related Articles

Research Article Corrigendum

!

A Corrigendum for this article has been published. To view the article details, please click the ‘Corrigendum’ tab above.

Special Issue

Learning and Adaptation for Optimization and Control of Complex Renewable Energy Systems

View this Special Issue

Research Article | Open Access

Volume 2020 | Article ID 8643029 | https://doi.org/10.1155/2020/8643029

Controller Design Based on Echo State Network with Delay Output for Nonlinear System

Xianshuang Yao,¹Siyuan Fan,¹Bo Zhao,¹and Shengxian Cao¹

Guest Editor: Shubo Wang

Received15 Jun 2020

Revised27 Jul 2020

Accepted01 Aug 2020

Published27 Sept 2020

Abstract

For the nonlinear systems with delay output, the control performance of the system is affected by the previous output of the system, such as crawling robots of photovoltaic panels. In this paper, an improved controller design method based on echo state network with delay output (DO-ESN) is proposed for designing the controller of a class of nonlinear system. According to the internal characteristics of DO-ESN, the DO-ESN can match the system characteristics of nonlinear systems with delay output, such that the proposed controller can quickly meet the control performance of the nonlinear system. In order to ensure the stability of the controller, a sufficient condition is given for the echo state property of DO-ESN. Finally, a simulation example is used to illustrate the effectiveness of the proposed method.

1. Introduction

For the nonlinear system, the proportional-integral-derivative (PID) method is a very effective control method, which has been widely applied in many fields, for example, load frequency control [1], automatic voltage regulator [2], chemical engineering [3], vehicle dynamic [4], hydrogen energy [5], and others [6]. However, the setting problem of PID controller parameters is always the focus in the research of academic and industry community. In recent years, based on neural network, many different controller design methods have been presented, for example, BPNN [7], RBFNN [8, 9], single neuron adaptive neural networks (SNANN) [10], adaptive neural networks [11], and artificial intelligence algorithm [12]. For these design methods based on artificial neural networks, some appropriate PID parameters can be obtained to meet the control accuracy requirement in some industrial applications.

However, there are still some problems for these design methods, for example, through using BPNN, the obtained PID controller parameters are easily trapped in local minima. Because of the randomness of the center vector, it is difficult to obtain the appropriate PID controller parameters by using RBFNN in a short time. Through analyzing these design methods based on artificial neural networks, one can summarize these drawbacks including training weights, local minima, and slow convergence. Therefore, an improved neural network should be introduced into the controller design method to solve the above shortcomings.

Echo state network (ESN) [13, 14] uses a dynamical reservoir with many random connected neurons to replace the hidden layer of recurrent neural network (RNN) [15–20]. Compared with the traditional RNN, the advantages of ESN are reflected in the weight selection and weight learning of network, i.e., only the output weight needs to be learned. Therefore, ESN not only has the network structure of traditional RNN but also has the characteristics of deep learning, such that ESN can be applied in many fields, for example, time-series prediction [21–24], filtering or control [25–28], dynamic pattern recognition [29–31], optimization [32], system identification [31, 33, 34], and big data application [35, 36]. Thus, comparing with the existing controller design methods based on neural network, ESN can avoid lots of adjusting parameters and the limitation of calculation. Because the reservoir of ESN has the memory ability, the previous calculation results can be used for the next parameter calculation. In addition, ESN can also deepen the calculation of input information to improve the convergence speed.

Combining with the advantages of ESN, some improved methods have been applied in many control fields. For example, in [26], a PID adaptive controller based on RLSESN is proposed for realizing high-accurate tracking of the rehabilitation robotic hand. In [27], ESNBIMC is proposed for the pneumatic muscle system. The ESNBIMC is regarded as a replacement of the conventional PID controller which is used to adjust the input of the controlled plant. In [28], through using the approximation capability of ESN, the ESN is regarded as a controller which is applied for nonlinear dynamical systems. However, for a class of nonlinear systems with delay output, the current moment output of the system is affected by some previous moment output of the system, such that these existing control methods based on echo state network cannot well match the characteristics of the system. Thus, for the nonlinear systems with delay output, how to build a suitable echo state network to meet the characteristics of the system is an interesting problem.

Thus, in this paper, an improved echo state network with delay output (DO-ESN) is proposed. Based on the DO-ESN, an improved controller design method is given for a class of nonlinear systems with delay output, such that the output of the DO-ESN controller can quickly meet the control performance of the nonlinear system. In order to ensure the stability of the controller, the echo state property of DO-ESN should be first guaranteed, and thus, a sufficient condition is given for the echo state property of DO-ESN.

The main work of this paper is given as follows:(i)An improved controller design method based on DO-ESN is given for a class of nonlinear systems with delay output, such that the control performance of this nonlinear system can be quickly satisfied(ii)A sufficient condition is given for the echo state property of DO-ESN, and the proposed controller can be stably applied to nonlinear systems with delay output

2. Echo State Network with Delay Output

ESN is a class of recurrent neural networks, whose structure is shown in Figure 1. From Figure 1, the ESN comprises a -dimensional input layer, a -dimensional reservoir, and a -dimensional output layer. Let , , and denote the external input vector, the reservoir state, and the output vector, respectively. denotes the input weight matrix, denotes the reservoir weight matrix, denotes the output feedback weight matrix and denotes the output weight matrix. For the standard ESN, the reservoir state updated equation is given as follows [14]:

where and denote the activation function of reservoir state and network output, respectively.

Consider the characteristics of the nonlinear system with delay output, the previous moment output of ESN can be introduced into the reservoir state equation, and thus an improved echo state network with delay output (DO-ESN) is proposed. The reservoir state updated equation of DO-ESN is given as follows:where denote the index of delay output.

Remark 1. For the DO-ESN, the current reservoir state and the current output are affected by the previous output. The current reservoir state can use the previous system characteristic, and the current output can use the previous output characteristic. Therefore, the DO-ESN can better match the characteristics of the nonlinear system with delayed output.

3. Controller Design Method Based on DO-ESN

3.1. Controller Based on DO-ESN

Considering a class of nonlinear system with delay output,where and denote the delay of and , respectively. denotes the nonlinear polynomial.

According to the learning ability and approximation ability of DO-ESN in control and optimization, the DO-ESN can be embedded into the controller to control the nonlinear system. The design controller method based on the DO-ESN is illustrated in Figure 2.

From Figure 2, denotes the system output error, denotes the actual system output, and denotes the desired system output.

3.2. Stability Analysis of Controller Based on DO-ESN

In order to guarantee the stability and convergence of the controller model, the echo state property of DO-ESN should be ensured. Thus, in the following, a sufficient condition will be provided to guarantee the echo state property of DO-ESN.

Because the can be written as follows:

The output of DO-ESN is modified as follows:

Thus, the reservoir state is modified as follows:where , , and .

Theorem 1. For a DO-ESN model (equations (2) and (3)), if the following conditions are satisfied(1) is a Lipschitz continuous function, and the Lipschitz constant is less than 1(2) and (3)(4) (where and are the maximal singular value of and , respectively); then, the DO-ESN model has the echo state property in each iteration

Proof. For and , we haveFor the term of equation (8), we haveSimilarly, we also haveSubstituting equations (10) and (11) into equation (9), we haveSubstituting equation (12) into equation (8), we haveIfThen, the DO-ESN has the echo state property in each iteration.

Remark 2. For the proposed controller design method based on DO-ESN, the stability of the controller should be guaranteed, and then, a sufficient condition need be given for the echo state property of DO-ESN. Thus, in this section, the proposed controller design method can be stably applied to nonlinear systems with delay output.

3.3. Learning the Output Weights of DO-ESN

The purpose of designing the controller is to minimize the system output error. The expression of the system output error is given as follows:

For the output weight learning of DO-ESN, the partial derivative need be computed. is formulated as follows:

Then, the output weights is updated as follows:where denotes the learning rate.

Remark 3. In this paper, we usually give a definite value for the output weight learning rate. Since the learning rate is also affected by the reservoir parameters of DO-ESN, for different nonlinear systems, the learning rate can be given according to the changes of the reservoir state in the process of training network.

4. Simulation Examples

In this section, a simulation example is selected to show the performance of the proposed control method. For different output error accuracy (5%, 2%, 0.1%, or E-10), several neural networks methods (e.g., BPNN [7], RBFNN [9], and ESN [15]) are selected to illustrate the performance of the proposed design method.

Considering the following nonlinear system with time delay,

The desired output of system iswhere .

According to the characteristic of the nonlinear system, the reservoir size of DO-ESN is given as . Through equation (17) with , the final reservoir parameters of DO-ESN are obtained as follows:

The simulation results of these methods (BPNN [7], RBFNN [9], ESN [15], and DO-ESN) are shown in Table 1. The curves of system output and system output error are shown in Figures 3 and 4, respectively.

From Table 1, we can see that when the output value of the system reaches the expected fluctuation range (5%–2%), the DO-ESN needs less iteration step. For example, when the error precision is 0.025(5%), the iteration step of DO-ESN is 22, and the iteration step of those methods [7, 9, 15, 21] are 60, 145, 40, and 105, respectively. When the error precision is 0.01 (2%), the iteration of DO-ESN is 34, and the iteration of other methods [7, 9, 15, 21] is 74, 212, 62, and 123, respectively. When the error precision is 0.0005(0.1%), the iteration of DO-ESN is 56, and the iteration of other methods [7, 9, 15, 21] is 125, 462, 96, and 245, respectively. From Figures 3 and 4, we can see that, for the same error precision, the iteration step of DO-ESN is far less than that of those methods in [7, 9, 15].

5. Discussion

In this paper, an improved controller design method based on DO-ESN is proposed for a class of nonlinear system with delay output. According to the internal characteristics of DO-ESN, the DO-ESN can match the system characteristics of nonlinear systems with delay output, such that the DO-ESN controller can quickly meet the control performance of the nonlinear system. Meanwhile, a sufficient condition for the stability of the DO-ESN controller is given, such that the controller can be stably applied to the given controlled plant. Finally, the simulation result shows the effectiveness of the proposed method.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

References

D. G. Padhan and S. Majhi, “A new control scheme for PID load frequency controller of single-area and multi-area power systems,” ISA Transactions, vol. 52, no. 2, pp. 242–251, 2013.
View at: Publisher Site | Google Scholar
Z.-L. Gaing, “A particle swarm optimization approach for optimum design of PID controller in AVR system,” IEEE Transactions on Energy Conversion, vol. 19, no. 2, pp. 384–391, 2004.
View at: Publisher Site | Google Scholar
A. Leosirikul, D. Chilin, J. Liu, J. F. Davis, and P. D. Christofides, “Monitoring and retuning of low-level PID control loops,” Chemical Engineering Science, vol. 69, no. 1, pp. 287–295, 2012.
View at: Publisher Site | Google Scholar
H.-M. Li, X.-B. Wang, S.-B. Song, and H. Li, “Vehicle control strategies analysis based on PID and fuzzy logic control,” Procedia Engineering, vol. 137, pp. 234–243, 2016.
View at: Publisher Site | Google Scholar
F.-C. Wang and C.-C. Ko, “Multivariable robust PID control for a PEMFC system,” International Journal of Hydrogen Energy, vol. 35, no. 19, pp. 10437–10445, 2010.
View at: Publisher Site | Google Scholar
A.-A. Zamani, S. Tavakoli, and S. Etedali, “Fractional order PID control design for semi-active control of smart base-isolated structures: a multi-objective cuckoo search approach,” ISA Transactions, vol. 67, pp. 222–232, 2017.
View at: Publisher Site | Google Scholar
D. Z. Xia, L. Kong, Y. W. Hu, and P. Z. Ni, “Silicon microgyroscope temperature prediction and control system based on BP neural network and fuzzy-PID control method,” Measurement Science and Technology, vol. 26, no. 2, pp. 1–17, 2015.
View at: Publisher Site | Google Scholar
H. Yang and J. Liu, “An adaptive RBF neural network control method for a class of nonlinear systems,” IEEE/CAA Journal of Automatica Sinica, vol. 5, no. 2, pp. 457–462, 2018.
View at: Publisher Site | Google Scholar
S. M. Attaran, R. Yusof, and H. Selamat, “A novel optimization algorithm based on epsilon constraint-RBF neural network for tuning PID controller in decoupled HVAC system,” Applied Thermal Engineering, vol. 99, pp. 613–624, 2016.
View at: Publisher Site | Google Scholar
X. J. Chen and H. D. Qiu, “Research on single neuron adaptive PID controller,” Applied Mechanics and Materials, vol. 653, pp. 826–830, 2014.
View at: Publisher Site | Google Scholar
C. S. Tseng and B. S. Chen, “Multiobjective PID control design in uncertain robotic systems using neural network elimination scheme,” IEEE Transactions on Systems, Man, and Cybernetics–Part A: Systems and Humans, vol. 31, no. 6, pp. 632–944, 2001.
View at: Google Scholar
Y. Wu, X. Zhao, K. Li, M. Zheng, and S. Li, “Energy saving-another perspective for parameter optimization of P and PI controllers,” Neurocomputing, vol. 174, pp. 500–513, 2016.
View at: Publisher Site | Google Scholar
H. Jaeger and H. Haas, “Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication,” Science, vol. 304, no. 5667, pp. 78–80, 2004.
View at: Publisher Site | Google Scholar
H. Jaeger, “The “echo state” approach to analysing and training recurrent neural networks–with an erratum note,” German National Research Center for Information Technology, vol. 148, 2010.
View at: Google Scholar
H. Jaeger, “A tutorial on training recurrent neural networks, covering BPTT, RURL, EKF and the “echo state network” approach,” Tech. Rep., German National Research Center for Information Technology, Bonn, Germany, 2002, Technical Report GMD Report 159.
View at: Google Scholar
H. Zhang, Z. Wang, and D. Liu, “A comprehensive review of stability analysis of continuous-time recurrent neural networks,” IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 7, pp. 1229–1262, 2014.
View at: Publisher Site | Google Scholar
S. Ding, Z. Wang, Z. Huang, and H. Zhang, “Novel switching jumps dependent exponential synchronization criteria for memristor-based neural networks,” Neural Processing Letters, vol. 45, no. 1, pp. 15–28, 2017.
View at: Publisher Site | Google Scholar
S. Ding and Z. Wang, “Event-triggered synchronization of discrete-time neural networks: a switching approach,” Neural Networks, vol. 125, pp. 31–40, 2020.
View at: Publisher Site | Google Scholar
H. J. Liang, G. L. Liu, H. G. Zhang, and T. W. Huang, “Neural-network-based event-triggered adaptive control of nonaffine nonlinear multi-agent systems with dynamic uncertainties,” IEEE Transactions on Neural Networks and Learning Systems, pp. 1–12, 2020.
View at: Publisher Site | Google Scholar
L. Tang, D. Ma, and J. Zhao, “Adaptive neural control for switched non-linear systems with multiple tracking error constraints,” IET Signal Processing, vol. 13, no. 3, pp. 330–337, 2019.
View at: Publisher Site | Google Scholar
H. Jaeger, M. Lukoševičius, D. Popovici, and U. Siewert, “Optimization and applications of echo state networks with leaky- integrator neurons,” Neural Networks, vol. 20, no. 3, pp. 335–352, 2007.
View at: Publisher Site | Google Scholar
D. Li, M. Han, and J. Wang, “Chaotic time series prediction based on a novel robust echo state network,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 5, pp. 787–799, 2012.
View at: Publisher Site | Google Scholar
M. Xu and M. Han, “Adaptive elastic echo state network for multivariate time series prediction,” IEEE Transactions on Cybernetics, vol. 46, no. 10, pp. 2173–2183, 2016.
View at: Publisher Site | Google Scholar
X. Yao and Z. Wang, “Broad echo state network for multivariate time series prediction,” Journal of the Franklin Institute, vol. 356, no. 9, pp. 4888–4906, 2019.
View at: Publisher Site | Google Scholar
S. I. Han and J. M. Lee, “Fuzzy echo state neural networks and funnel dynamic surface control for prescribed performance of a nonlinear dynamic system,” IEEE Transactions on Industrial Electronics, vol. 61, no. 2, pp. 1099–1112, 2014.
View at: Publisher Site | Google Scholar
J. Wu, J. Huang, Y. Wang, and K. Xing, “RLSESN-based PID adaptive control for a novel wearable rehabilitation robotic hand driven by PM-TS actuators,” International Journal of Intelligent Computing and Cybernetics, vol. 5, no. 1, pp. 91–110, 2012.
View at: Publisher Site | Google Scholar
J. Wu, Y. Wang, J. Huang, H. Zhou, and H. Cai, “Echo state network-based internal model control for pneumatic muscle system,” Electrical, Information Engineering and Mechatronics 2011, vol. 2012, pp. 99–108, 2011.
View at: Publisher Site | Google Scholar
D. M. Xu, J. Lan, and J. C. Principe, “Direct adaptive control: an echo state network and genetic algorithm approach,” 2005 IEEE International Joint Conference on Neural Networks, vol. 3, pp. 1483–1486, 2005.
View at: Google Scholar
M. D. Skowronski and J. G. Harris, “Automatic speech recognition using a predictive echo state network classifier,” Neural Networks, vol. 20, no. 3, pp. 414–423, 2007.
View at: Publisher Site | Google Scholar
M. H. Tong, A. D. Bickett, E. M. Christiansen, and G. W. Cottrell, “Learning grammatical structure with echo state networks,” Neural Networks, vol. 20, no. 3, pp. 424–432, 2007.
View at: Publisher Site | Google Scholar
X. Yao, Z. Wang, and H. Zhang, “Identification method for a class of periodic discrete-time dynamic nonlinear systems based on Sinusoidal ESN,” Neurocomputing, vol. 275, pp. 1511–1521, 2018.
View at: Publisher Site | Google Scholar
H. Y. Ding, W. J. Pei, and Z. Y. He, “A multiple objective optimization based echo state network tree and application to intrusion detection,” in Proceedings of the 2005 IEEE International Workshop on VLSI Design and Video Technology, pp. 443–446, IEEE, Suzhou, China, May 2005.
View at: Google Scholar
S.-x. Lun, S. Wang, T.-t. Guo, and C.-j. Du, “An I-V model based on time warp invariant echo state network for photovoltaic array with shaded solar cells,” Solar Energy, vol. 105, pp. 529–541, 2014.
View at: Publisher Site | Google Scholar
X. Yao, Z. Wang, and H. Zhang, “Prediction and identification of discrete-time dynamic nonlinear systems based on adaptive echo state network,” Neural Networks, vol. 113, pp. 11–19, 2019.
View at: Publisher Site | Google Scholar
L. Bozhkov, P. Koprinkova-Hristova, and P. Georgieva, “Learning to decode human emotions with echo state networks,” Neural Networks, vol. 78, pp. 112–119, 2016.
View at: Publisher Site | Google Scholar
S. Scardapane, D. Wang, and M. Panella, “A decentralized training algorithm for echo state networks in distributed big data applications,” Neural Networks, vol. 78, pp. 65–74, 2016.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2020 Xianshuang Yao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

489

Downloads

879

Citations