Research Article  Open Access
Xiangli Li, Lincheng Zhou, Ruifeng Ding, Jie Sheng, "Recursive LeastSquares Estimation for Hammerstein Nonlinear Systems with Nonuniform Sampling", Mathematical Problems in Engineering, vol. 2013, Article ID 240929, 8 pages, 2013. https://doi.org/10.1155/2013/240929
Recursive LeastSquares Estimation for Hammerstein Nonlinear Systems with Nonuniform Sampling
Abstract
This paper focuses on the identification problem of Hammerstein nonlinear systems with nonuniform sampling. Using the keyterm separation principle, we present a discrete identification model with nonuniform sampling input and output data based on the frame period. To estimate parameters of the presented model, an auxiliary modelbased recursive leastsquares algorithm is derived by replacing the unmeasurable variables in the information vector with their corresponding recursive estimates. The simulation results show the effectiveness of the proposed algorithm.
1. Introduction
In actual industrial processes, there exist widely nonlinear systems which are described by blockoriented nonlinear systems [1–3]. Blockoriented nonlinear models are in general divided into Hammerstein systems and Wiener systems [4]. A Hammerstein system, which consists of a static nonlinear subsystem followed by a linear dynamic subsystem, can represent some nonlinear systems [5]. Many publications have been reported for the identification of the Hammerstein systems [6, 7]. For example, Chen et al. studied identification problems for the Hammerstein systems with saturation and deadzone nonlinearities by choosing an appropriate switching function [8]; Ding et al. presented the projection, the stochastic gradient, and the Newton recursive and the Newton iterative identification algorithms for the Hammerstein nonlinear systems, and then they analyzed and compared the performances of these approaches by numerical examples [9]. Li et al. derived a leastsquares based iterative algorithm for the Hammerstein output error systems with nonuniform sampling by using the overparameterization model [10].
The different inputoutput updating period (or called multirate sampling) is inevitable in discretetime systems [11–13]. The identification of multirate sampled systems have attracted much attention of many researchers. Recently, Liu et al. proposed a novel hierarchical leastsquares algorithm for a class of nonuniformly sampled systems based on the hierarchical identification principle [14]. Shi et al. presented a crosstalk identification algorithm for multirate xDSL FIR systems [15]. Han et al. gave statespace models for multirate multiinput sampleddata systems and derived an auxiliary modelbased recursive leastsquares algorithm for identifying the parameters of multirate systems [16].
The recursive leastsquares algorithm is a class of basic parameter estimation approaches which are suitable for online applications. In this literature, Wang adopted a filtering auxiliary modelbased recursive leastsquares identification algorithm for output error moving average systems [17]. Differing from the work in [14, 16], this paper discusses the parameter estimation problem for nonuniformly sampled Hammerstein nonlinear systems. The basic idea is, to combine the auxiliary model identification idea [18–24] and the keyterm separation principle to derive the auxiliary modelbased recursive leastsquares algorithm for the Hammerstein nonlinear systems with nonuniform sampling.
The rest of this paper is organized as follows. Section 2 establishes the identification model of the Hammerstein nonlinear systems with nonuniform sampling. Section 3 derives a recursive leastsquares parameter estimation algorithm based on the auxiliary model identification idea. Section 4 provides an example to illustrate the effectiveness of the proposed algorithm. The conclusions of the paper are summarized in Section 5.
2. The Identification Model
Let us introduce some notations. The superscript denotes the matrix transpose; stands for an identity matrix of appropriate sizes; represents an dimensional column vector whose elements are 1; “” stands for “ is defined as ”; and is a unit backward shift operator; that is, .
Consider a Hammerstein nonlinear system with nonuniform sampling shown in Figure 1, where is a nonuniform zeroorder hold with irregularly updating intervals , dealing with a discretetime signal and producing the input of the nonlinear subsystem ; is the output of the nonlinear subsystem; is a continuoustime process; is the true output of but is unmeasurable; is a sampler that produces a discretetime signal with period ; and is the system output but is corrupted by the additive noise .
Assuming that the input has the updating intervals , we have [11, 25] where is the frame period. The nonlinear subsystem in the Hammerstein nonlinear system is a polynomial of a known order: where is the polynomial order.
Suppose that has the following statespace representation: where is the state vector, and are the input and output of the continuoustime process, respectively, and , , , and are matrices of appropriate sizes. Referring to [25] and discretizing (3) with the frame period , we have where The output at the sampling instant can be expressed as Hence, the system output is written as Referring to [26] and from (4) and (6), we have where Equation (8) can be transformed into Substituting (10) into (7), the system output can be expressed as Equation (11) can be rewritten equivalently as Here, substituting (2) into (12) results in a complex expression containing the products of parameters. To solve this problem, we use the keyterm separation principle presented in [27], and let . Then, the identification model of the proposed system is as follows: The objective of this paper is to develop a recursive leastsquares algorithm for estimating the parameters of the nonuniformly sampled Hammerstein systems by using the auxiliary model identification idea in [11].
3. The Recursive LeastSquares Algorithm
In this section, we derive the recursive leastsquares estimation algorithm for the Hammerstein nonlinear systems with nonuniform sampling, referring to the method in [1].
Define the information vectors and the parameter vectors as Equation (13) can be written in a regressive form as Define a quadratic criterion function as Let be the estimate of at time . Minimizing gives the following recursive leastsquares algorithm: Note that the information vector in (17) contains unknown inner variables and ; the parameter vector cannot be estimated by the standard leastsquares method. The solution is based on the auxiliary model identification idea [11]: to replace the unmeasurable term in with its estimate Replacing in (2) with its estimate , we can obtain the estimate of as follows:
Define the estimate of as Using in place of in (17) and (18), we have Equations (19) to (22) form the AMRLS algorithm for the not uniformly sampled Hammerstein nonlinear systems, which can be summarized as To initialize the algorithm, we take to be a small real vector; for example, and with normally a large positive number (e.g., ).
4. Example
An example is given to demonstrate the feasibility of the proposed algorithm. Assume that the dynamical linear subsystem has the following statespace representation: and the static nonlinear subsystem is denoted by Let , s, and s; that is, s and s. Discretizing with the frame period , we obtain Thus, the corresponding inputoutput expression is given by
In simulation, the inputs and are taken as persistent excitation signal sequences with zero mean and unit variance; is a white noise with zero mean and variance . Applying the proposed algorithm to estimate the parameters of this system, the estimates of and their errors with different noise variances are shown in Tables 1 and 2, and the parameter estimation errors versus are shown in Figure 2. When and , the corresponding signaltonoise ratios (the square root of the ratio of output and noise variances) are and , respectively.


From Tables 1 and 2 and Figure 2, we can draw the following conclusions.(i)The parameter estimation errors of the AMRLS algorithm become (generally) smaller as increases; see the estimation errors of the last columns of Tables 1 and 2 and Figure 2. (ii)Under different noise levels, the parameter estimates can converge to the true value, and a lower noise level results in a faster convergence rate of the parameter estimates to the true parameters; see the error curves in Figure 2 and the estimation errors in Tables 1 and 2. (iii)The proposed recursive algorithm differs from the iterative identification approach in [10] and can be used as an online identification.
5. Conclusions
In this paper, we have established the identification model of the Hammerstein nonlinear systems with nonuniform sampling by using the keyterm separation principle. To estimate the parameters of the proposed model, the recursive leastsquares parameter estimation algorithm is derived based on the auxiliary model identification idea. The proposed algorithm can simultaneously estimate the parameters of the linear and nonlinear subsystems of the Hammerstein nonlinear systems with nonuniform sampling. The simulation results show that the parameters of the Hammerstein systems with nonuniform sampling can be estimated effectively by the proposed algorithm. Although the algorithm is presented for a class of nonuniformly sampled Hammerstein nonlinear systems, the basic idea can also be extended to identify other linear and nonlinear systems [28, 29] and can combine the hierarchical identification methods [30–34], the multiinnovation identification methods [35–44], and other identification methods [45–58] to present new identification algorithms for linear or nonlinear and scalar or multivariable systems [59].
Acknowledgments
This work was supported by the Fundamental Research Funds for the Central Universities (JUDCF11042 and JUDCF12031) and the PAPD of Jiangsu Higher Education Institutions and the 111 Project (B12018).
References
 F. Ding, System Identification—New Theory and Methods, Science Press, Beijing, China, 2013.
 L. C. Zhou, X. L. Li, and F. Pan, “Gradientbased iterative identification for MISO Wiener nonlinear systems: application to a glutamate fermentation process,” Applied Mathematics Letters, vol. 26, no. 8, pp. 886–892, 2013. View at: Google Scholar
 D. Wang and F. Ding, “Least squares based and gradient based iterative identification for Wiener nonlinear systems,” Signal Processing, vol. 91, no. 5, pp. 1182–1189, 2011. View at: Publisher Site  Google Scholar
 I. Cherif, S. Abid, and F. Fnaiech, “Nonlinear blind identification with threedimensional tensor analysis,” Mathematical Problems in Engineering, vol. 2012, Article ID 284815, 22 pages, 2012. View at: Google Scholar  Zentralblatt MATH  MathSciNet
 D. Wang, F. Ding, and Y. Chu, “Data filtering based recursive least squares algorithm for Hammerstein systems using the keyterm separation principle,” Information Sciences, vol. 222, pp. 203–212, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 D. Q. Wang and F. Ding, “Hierarchical least squares estimation algorithm for HammersteinWiener systems,” IEEE Signal Processing Letters, vol. 19, no. 12, pp. 825–828, 2012. View at: Google Scholar
 F. Ding, “Hierarchical multiinnovation stochastic gradient algorithm for Hammerstein nonlinear system modeling,” Applied Mathematical Modelling, vol. 37, no. 4, pp. 1694–1704, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 J. Chen, X. Wang, and R. Ding, “Gradient based estimation algorithm for Hammerstein systems with saturation and deadzone nonlinearities,” Applied Mathematical Modelling, vol. 36, no. 1, pp. 238–243, 2012. View at: Publisher Site  Google Scholar
 F. Ding, X. P. Liu, and G. Liu, “Identification methods for Hammerstein nonlinear systems,” Digital Signal Processing, vol. 21, no. 2, pp. 215–238, 2011. View at: Publisher Site  Google Scholar
 X. L. Li, R. F. Ding, and L. C. Zhou, “Leastsquaresbased iterative identification algorithm for Hammerstein nonlinear systems with nonuniform sampling,” International Journal of Computer Mathematics, vol. 90, no. 7, pp. 1524–1534, 2013. View at: Google Scholar
 Y. Liu, L. Xie, and F. Ding, “An auxiliary model based on a recursive leastsquares parameter estimation algorithm for nonuniformly sampled multirate systems,” Proceedings of the Institution of Mechanical Engineers. Part I: Journal of Systems and Control Engineering, vol. 223, no. 4, pp. 445–454, 2009. View at: Publisher Site  Google Scholar
 X. G. Liu and J. Lu, “Least squares based iterative identification for a class of multirate systems,” Automatica, vol. 46, no. 3, pp. 549–554, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Y. Wu, Y. Liu, and W. Zhang, “A discretetime chattering free sliding mode control with multirate sampling method for flight simulator,” Mathematical Problems in Engineering, vol. 2013, Article ID 865493, 8 pages, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 Y. Liu, F. Ding, and Y. Shi, “Least squares estimation for a class of nonuniformly sampled systems based on the hierarchical identification principle,” Circuits, Systems, and Signal Processing, vol. 31, no. 6, pp. 1985–2000, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Y. Shi, F. Ding, and T. Chen, “Multirate crosstalk identification in xDSL systems,” IEEE Transactions on Communications, vol. 54, no. 10, pp. 1878–1886, 2006. View at: Publisher Site  Google Scholar
 L. Han, J. Sheng, F. Ding, and Y. Shi, “Auxiliary model identification method for multirate multiinput systems based on least squares,” Mathematical and Computer Modelling, vol. 50, no. 78, pp. 1100–1106, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 D. Q. Wang, “Least squaresbased recursive and iterative estimation for output error moving average systems using data filtering,” IET Control Theory & Applications, vol. 5, no. 14, pp. 1648–1657, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding and T. Chen, “Combined parameter and output estimation of dualrate systems using an auxiliary model,” Automatica, vol. 40, no. 10, pp. 1739–1748, 2004. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and T. Chen, “Parameter estimation of dualrate stochastic systems by using an output error method,” IEEE Transactions on Automatic Control, vol. 50, no. 9, pp. 1436–1441, 2005. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding, Y. Shi, and T. Chen, “Auxiliary modelbased leastsquares identification methods for Hammerstein outputerror systems,” Systems & Control Letters, vol. 56, no. 5, pp. 373–380, 2007. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and J. Ding, “Leastsquares parameter estimation for systems with irregularly missing data,” International Journal of Adaptive Control and Signal Processing, vol. 24, no. 7, pp. 540–553, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and T. Chen, “Identification of dualrate systems based on finite impulse response models,” International Journal of Adaptive Control and Signal Processing, vol. 18, no. 7, pp. 589–598, 2004. View at: Publisher Site  Google Scholar
 F. Ding and Y. Gu, “Performance analysis of the auxiliary modelbased leastsquares identification algorithm for onestep statedelay systems,” International Journal of Computer Mathematics, vol. 89, no. 15, pp. 2019–2028, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and Y. Gu, “Performance analysis of the auxiliary modelbased stochastic gradient parameter estimation algorithm for statespace systems with onestep state delay,” Circuits, Systems, and Signal Processing, vol. 32, no. 2, pp. 585–599, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding, L. Qiu, and T. Chen, “Reconstruction of continuoustime systems from their nonuniformly sampled discretetime systems,” Automatica, vol. 45, no. 2, pp. 324–332, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 L. Xie, Y. J. Liu, H. Z. Yang, and F. Ding, “Modelling and identification for nonuniformly periodically sampleddata systems,” IET Control Theory & Applications, vol. 4, no. 5, pp. 784–794, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 J. Vörös, “Identification of Hammerstein systems with timevarying piecewiselinear characteristics,” IEEE Transactions on Circuits and Systems II, vol. 52, no. 12, pp. 865–869, 2005. View at: Publisher Site  Google Scholar
 L. C. Zhou, X. L. Li, and F. Pan, “Gradient based iterative parameter identification for Wiener nonlinear systems,” Applied Mathematical Modelling, vol. 37, no. 1617, pp. 8203–8209, 2013. View at: Google Scholar
 L. Zhou, X. Li, and F. Pan, “Leastsquaresbased iterative identification algorithm for Wiener nonlinear systems,” Journal of Applied Mathematics, vol. 2013, Article ID 565841, 6 pages, 2013. View at: Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and T. Chen, “Hierarchical gradientbased identification of multivariable discretetime systems,” Automatica, vol. 41, no. 2, pp. 315–325, 2005. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding and T. Chen, “Hierarchical least squares identification methods for multivariable systems,” IEEE Transactions on Automatic Control, vol. 50, no. 3, pp. 397–402, 2005. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding and T. Chen, “Hierarchical identification of lifted statespace models for general dualrate systems,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 52, no. 6, pp. 1179–1187, 2005. View at: Google Scholar
 J. Ding, F. Ding, X. P. Liu, and G. Liu, “Hierarchical least squares identification for linear SISO systems with dualrate sampleddata,” IEEE Transactions on Automatic Control, vol. 56, no. 11, pp. 2677–2683, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 D. Wang, R. Ding, and X. Dong, “Iterative parameter estimation for a class of multivariable systems based on the hierarchical identification principle and the gradient search,” Circuits, Systems, and Signal Processing, vol. 31, no. 6, pp. 2167–2177, 2012. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding and T. Chen, “Performance analysis of multiinnovation gradient type identification methods,” Automatica, vol. 43, no. 1, pp. 1–14, 2007. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, P. X. Liu, and G. Liu, “Multiinnovation leastsquares identification for system modeling,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 40, no. 3, pp. 767–778, 2010. View at: Publisher Site  Google Scholar
 F. Ding, P. X. Liu, and G. Liu, “Auxiliary model based multiinnovation extended stochastic gradient parameter estimation with colored measurement noises,” Signal Processing, vol. 89, no. 10, pp. 1883–1890, 2009. View at: Publisher Site  Google Scholar
 F. Ding, “Several multiinnovation identification methods,” Digital Signal Processing, vol. 20, no. 4, pp. 1027–1039, 2010. View at: Publisher Site  Google Scholar
 F. Ding, H. Chen, and M. Li, “Multiinnovation least squares identification methods based on the auxiliary model for MISO systems,” Applied Mathematics and Computation, vol. 187, no. 2, pp. 658–668, 2007. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 L. Han and F. Ding, “Multiinnovation stochastic gradient algorithms for multiinput multioutput systems,” Digital Signal Processing, vol. 19, no. 4, pp. 545–554, 2009. View at: Publisher Site  Google Scholar
 D. Wang and F. Ding, “Performance analysis of the auxiliary models based multiinnovation stochastic gradient estimation algorithm for output error systems,” Digital Signal Processing, vol. 20, no. 3, pp. 750–762, 2010. View at: Publisher Site  Google Scholar
 Y. Liu, L. Yu, and F. Ding, “Multiinnovation extended stochastic gradient algorithm and its performance analysis,” Circuits, Systems, and Signal Processing, vol. 29, no. 4, pp. 649–667, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 Y. Liu, Y. Xiao, and X. Zhao, “Multiinnovation stochastic gradient algorithm for multipleinput singleoutput systems using the auxiliary model,” Applied Mathematics and Computation, vol. 215, no. 4, pp. 1477–1483, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 L. Han and F. Ding, “Identification for multirate multiinput systems using the multiinnovation identification theory,” Computers & Mathematics with Applications, vol. 57, no. 9, pp. 1438–1449, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, G. Liu, and X. P. Liu, “Partially coupled stochastic gradient identification methods for nonuniformly sampled systems,” IEEE Transactions on Automatic Control, vol. 55, no. 8, pp. 1976–1981, 2010. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding, “Coupledleastsquares identification for multivariable systems,” IET Control Theory & Applications, vol. 7, no. 1, pp. 68–79, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding and T. Chen, “Performance bounds of forgetting factor leastsquares algorithms for timevarying systems with finite meaurement data,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 52, no. 3, pp. 555–566, 2005. View at: Google Scholar
 Y. Liu, J. Sheng, and R. Ding, “Convergence of stochastic gradient estimation algorithm for multivariable ARXlike systems,” Computers & Mathematics with Applications, vol. 59, no. 8, pp. 2615–2627, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, G. Liu, and X. P. Liu, “Parameter estimation with scarce measurements,” Automatica, vol. 47, no. 8, pp. 1646–1655, 2011. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, T. Chen, and L. Qiu, “Bias compensation based recursive leastsquares identification algorithm for MISO systems,” IEEE Transactions on Circuits and Systems II:Express Briefs, vol. 53, no. 5, pp. 349–353, 2006. View at: Google Scholar
 F. Ding, H. Yang, and F. Liu, “Performance analysis of stochastic gradient algorithms under weak conditions,” Science in China F, vol. 51, no. 9, pp. 1269–1280, 2008. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, P. X. Liu, and H. Yang, “Parameter identification and intersample output estimation for dualrate systems,” IEEE Transactions on Systems, Man, and Cybernetics A, vol. 38, no. 4, pp. 966–975, 2008. View at: Publisher Site  Google Scholar
 W. Wang, F. Ding, and J. Dai, “Maximum likelihood least squares identification for systems with autoregressive moving average noise,” Applied Mathematical Modelling, vol. 36, no. 5, pp. 1842–1853, 2012. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 F. Ding, X. G. Liu, and J. Chu, “Gradientbased and leastsquaresbased iterative algorithms for Hammerstein systems using the hierarchical identification principle,” IET Control Theory and Applications, vol. 7, pp. 176–184, 2013. View at: Google Scholar
 F. Ding, Y. Liu, and B. Bao, “Gradientbased and leastsquaresbased iterative estimation algorithms for multiinput multioutput systems,” Proceedings of the Institution of Mechanical Engineers. Part I: Journal of Systems and Control Engineering, vol. 226, no. 1, pp. 43–55, 2012. View at: Publisher Site  Google Scholar
 F. Ding, P. X. Liu, and G. Liu, “Gradient based and leastsquares based iterative identification methods for OE and OEMA systems,” Digital Signal Processing, vol. 20, no. 3, pp. 664–677, 2010. View at: Publisher Site  Google Scholar
 F. Ding, “Decomposition based fast least squares algorithm for output error systems,” Signal Processing, vol. 93, no. 5, pp. 1235–1242, 2013. View at: Google Scholar
 F. Ding, “Twostage least squares based iterative estimation algorithm for CARARMA system modeling,” Applied Mathematical Modelling, vol. 37, no. 7, pp. 4798–4808, 2013. View at: Publisher Site  Google Scholar  MathSciNet
 F. Ding and H. H. Duan, “Twostage parameter estimation algorithms for BoxJenkins systems,” IET Signal Processing, vol. 7, no. 8, pp. 646–654, 2013. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2013 Xiangli Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.