Mathematical Problems in Engineering

Volume 2013, Article ID 658194, 18 pages

http://dx.doi.org/10.1155/2013/658194

## Online Identification of Multivariable Discrete Time Delay Systems Using a Recursive Least Square Algorithm

National Engineering school of Gabes, Numerical Control of Industrial Processes Research Unit, Gabes University, Route de Medenine, BP 6029, Gabes, Tunisia

Received 6 February 2013; Revised 30 April 2013; Accepted 25 May 2013

Academic Editor: Yang Yi

Copyright © 2013 Saïda Bedoui et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper addresses the problem of simultaneous identification of linear discrete time delay multivariable systems. This problem involves both the estimation of the time delays and the dynamic parameters matrices. In fact, we suggest a new formulation of this problem allowing defining the time delay and the dynamic parameters in the same estimated vector and building the corresponding observation vector. Then, we use this formulation to propose a new method to identify the time delays and the parameters of these systems using the least square approach. Convergence conditions and statistics properties of the proposed method are also developed. Simulation results are presented to illustrate the performance of the proposed method. An application of the developed approach to compact disc player arm is also suggested in order to validate simulation results.

#### 1. Introduction

Time delay system identification has received great attention in the last years since time delay is a physical phenomenon which arises in most control loops industrial systems [1, 2]. Several reasons cause the presence of time delay in control loops. In fact, it may be an inherent feature of the system such as processes of transport (mass, energy, and information), higher order processes, and accumulation of time lags in several systems that are connected in series. It may also be introduced by the devices of control loops, such as response times of sensors and actuators, computation time of control laws, and information transmission time in networks. This delay can be neglected if its value is too small for the system time constants. Otherwise, it cannot be neglected, and the dynamic representation of the system must be described by a time delay model. This model is, generally, constructed using the identification approach which allows building a mathematical model from input-output data.

The identification of time delay systems is known to be a challenging identification problem because it involves both the estimation of dynamic parameters and time delay. Numerous methods have been proposed in the literature for the identification of time delay systems [3–15].

Among these methods, the graphical approach has been the most popular since it represents the first method proposed in the literature for the identification of continuous time delay systems [16]. Moreover, it is frequently used to compute the parameters of PID controllers for industrial processes. It consists in determining the time delay and the dynamic parameters of the system from its step response. The main advantage of this approach lies in the simplicity of its implementation. However, it produces inaccurate results because it is very sensitive to measurement noises. Another popular approach is proposed in [9]. It is based on the approximation of the time delay by a rational transfer function using classical approximations such as Pade or Laguerre. This method can insure very satisfactory results in the case of linear systems with constant time delays and lower order. However, its performance degrades rapidly in the case of higher order systems or important time delays. Moreover, it raises the computational complexity because it increases the number of parameters to be estimated. The parametrisation approach can be considered as one of the interesting methods because it is based on theoretical concepts of discrete time systems [17]. It consists, firstly, in inserting a known time delay in the numerator of the discrete time model, secondly, in estimating the dynamic parameters of the system using a recursive algorithm, and, finally, in deducing the time delay from zero coefficients of the numerator. In practice, it is difficult or rather impossible to have zero coefficients from experimental data. Indeed, we must set a threshold, which is a delicate task, mainly in the case of a noisy output. The method developed in [3] consists, It consists, firstly, in using the recursive least square approach to identify the parameters assuming that the time delay is known, and secondly, in estimating the time delay, taking into account the results of the first step. The time delay may be identified either by maximizing the correlation function or by minimizing the quadratic error. This method assumes that the domain range of the time delay is a priori known. We also mention the method presented in [18]. It allows the identification of the time delay and the system parameters using the Levenberg-Marquaydt optimization approach to minimize the prediction error. An online identification algorithm for continuous-time single-input single-output (SISO) linear time delay systems with uncertain time invariant parameters is developed in [10]. It consists in constructing a sliding mode-based observer of an underlying system with uncertain parameters. This observer is then used to design an adaptive identifier of system parameters. A linear filtering method is introduced in [19] for simultaneous parameter and time delay estimation of transfer function models. This method estimates the time delay along other model using an iterative way through simple linear regression. Another method that identifies the time delay and the system parameters is presented in [20] which is based on the correlation technique. The method developed in [21] allows the identification of time delay and the parameters of a system operating in the presence of colored noise. This method is based on correlation analysis. The method developed in [12, 22] allows the identification of time delay and the parameters. It minimizes the error between the process output and the process predictive model output, and then the variable time delay parameter is identified. In our previous work, we have proposed two methods for the simultaneous identification of the time delay and dynamic parameters of monovariable time delay discrete systems. The first method is based on the least square approach [23, 24]. The second method consists in minimizing a quadratic criterion using the gradient approach [25].

Most of these approaches deal with the problem of the identification of single-input single-output (SISO) time delay systems. However, the problem of multi-input multioutput (MIMO) time delay systems is one of the most difficult problems that represents an area of research where few efforts have been devoted in the past. The use of time delay approximation is extended to the MIMO case [26]. In fact, the authors deal with the problem of the identification of time delay processes using an overparameterization method. In [27], a method is developed for time delay estimation in the frequency domain of MIMO systems based on the combination of continuous wavelet transform (CWT) and cross-correlation. During the estimation, cross-correlation computations are carried out between the CWT coefficients of the input and the output data. The authors of [28] have proposed a simple method based on the combination of two well-known approaches: time delay estimation from impulse response and subspace identification.

In this paper, we propose an alternative approach for the problem of simultaneous identification of linear discrete time delay multivariable systems. Indeed, we develop a new formulation of the problem allowing to define the time delay and the dynamic parameters in the same estimated vector and to build the corresponding observation vector. Then, we use this formulation to propose a new method to identify the time delays and the parameters of these systems using the least square approach. Convergence conditions and statistics properties of the proposed method are also developed. Simulation and experimental examples are presented to illustrate the effectiveness of the proposed methods and to compare their performance in terms of convergence and speed. Our approach presents several interesting properties which can be summarized as follows.(i)The simultaneous identification of the time delays and parameters matrices is achieved by a new formulation of the parameters matrices. (ii)No a priori knowledge of the time delay is required. In fact, most of the publications assume the knowledge of the time delay variation range or the initial condition. (iii)The consistency of recursive least square methods has received much attention in the identification literature. In this paper, the proof of the consistency of the estimates is established. (iv)It can be used to deal with control adaptive purposes.

This paper is organized as follows. Section 2 presents the model and its assumptions. In Section 3, we propose an extended least square algorithm for simultaneous online identification of unknown time delays and parameters of multivariable discrete time delay systems. Moreover, we develop the convergence properties of the estimates in order to show that the obtained estimates are unbiased. Simulation results and experimental test are provided in the last section.

#### 2. Problem Statement

In this paper, we address the problem of identification of square linear multivariable delay system with inputs and ARX model: where and are the outputs and the delayed inputs of the system at time and is a vector of independent random variables sequences. Let be the time delay diagonal matrix, also called the interactive matrix, and and two polynomial matrices in the unit backward shift operator , defined by The delayed inputs can be expressed as where is a diagonal matrix defined as The following assumptions are made.(A1) The two polynomial matrices and have no common left factor. (A2) The orders and of the model are known. (A3) The input sequences are independent of , mutually independent and identically distributed with and , and are persistently exciting (PE). (A4) The disturbance is sequences of independent, identically distributed random variables with zero mean and finite variance . (A5) The inputs, the outputs, and the noises are causal; that is, , , and for .

*Problem Statement*. The goal is to develop a recursive algorithm to estimate, simultaneously, the time delay matrix and the matrices using the input/output measurement data .

In the following, we present three necessary definitions.

*Definition 1. *Operator is defined by
where denotes the integer part of .

*Definition 2. *Operator is defined by

*Definition 3. *Operator is defined by

#### 3. The Proposed Approach

In this section, an extended least square algorithm for simultaneous online identification of time delays and parameter matrices is developed.

Equation (1) can be rewritten as where is the parameter matrix and is the observation vector defined as

On the other hand, the estimated output is described by the following relation: where and represent, respectively, the estimated parameter matrix and the estimated time delay matrix.

Let us consider the prediction error given by

Since parameter matrix does not contain the unknown time delays , then consequently it is not directly applicable to achieve our objective which is the simultaneous identification of the time delays and the parameter matrices of the multivariable discrete time delay systems (1).

To overcome this problem, we suggest considering the time delay matrix in parameter matrices to be estimated. Indeed, the new matrix, called generalized matrix, is given by

Moreover, we propose the use of the negative gradient of the error to obtain an appropriate observation vector which is given by Then, The use of the approximation of (see the appendix) leads to where .

Replacing by its expression, we obtain the generalized observation vector:

An estimation of is denoted by the minimization of the following criterion: Then, the partial derivative of the criterion with respect to the generalized matrix is So Let us consider Adding and subtracting from (19) the term , given by (20), we have Canceling the partial derivative of the criterion, we obtain Let, Based on assumption which ensures that matrix is invertible [29], (22) can be rewritten as It follows that

Using (22), we have So It follows from (27) that Thus,

Using the matrix inversion lemma given by [29], Let , , and , and then we have The previous approach can be summarized by Algorithm 1.

#### 4. Convergence Properties

##### 4.1. Consistency

For the system in (1), assume that (A3) and (A4) hold. Then for any , the parameter estimation error, , associated with the LS algorithm in (29) and (30) satisfies where is the trace of the covariance matrix and represents the minimum eigenvalues of .

*Proof. *Define the parameter estimation error vector:

Using (27) and (11) we have
where
Equation (35) can be rewritten as (see the appendix)
where

Let us define now a nonnegative definite function:

Replacing by its expression, we obtain
So

Substituting by (30), we get

Then,
It follows from (43) that
We have
and the use of the relation
leads to

Since , , , and are uncorrelated with , taking the conditional expectation on both sides of (47) and using (A3) and (A4), we obtain
Define

Since is nondecreasing, we have

Using this property (the proof in the same way as the proof of Lemma 1 in [30]), we can see that the sum of the right-hand second term of equation (50) for from to is finite. Applying the martingale convergence theorem [30] to the previous inequality, we conclude that converges a.s. to a finite random variable, say ; that is,
is equivalent to
From the definition of , we obtain

Now, let us define the matrix trace
It follows that:

We obtain, finally,

##### 4.2. Lemma

*For the estimate (22) with the assumption (A4), the following proprieties hold. *(P1)* is an unbiased estimate of **. *(P2)*The covariance matrix of ** is given by**where*

*Proof. *If we replace (8) in (22), we have
Then,
So
Since is uncorrelated with the elements of (13), then
which proves (P1).

Consider the first-order Taylor series expansion around the real matrix of :

Since , it derives from (63) that

The second partial derivative of the criterion with respect to the generalized matrix is
So
The use of *the small residual algorithms* [31] leads to neglect the following term, then:
Hence, an approach of is obtained:
Applying the mean value of , we get:
So
Then, we have
Finally, we obtain
which proves (P2).

#### 5. Results

We now present a simulation example and an experimental validation to illustrate the performance of the proposed approach for the simultaneous identification of time delays and parameter matrices of square multivariable systems.

##### 5.1. Simulation Example

The objective of the simulation is to compare the efficiency of the proposed method (*DRLS*) with that of the classic recursive least square approach (*RLS*) [29] which assumes that the delays are a priori known. In fact, we consider the following cases.

*Case 1. *The output is noise-free and the RLS method uses the true time delays.

*Case 2. *The output is noise free and the RLS method uses the misestimated time delays.

*Case 3. *The output is contaminated by additive noise and the RLS method uses the true time delays.

We consider a square linear multivariable discrete time delay system with two inputs and two outputs described by the following equation [32]: where the delayed inputs and the outputs are defined, respectively, by and .

The two polynomials matrices and are given by

The time delay matrix is given by

###### 5.1.1. Case 1

The proposed approach (DLSR) and the RLS algorithm are applied to estimate time delays and parameter matrices. The estimation starts with zero initial conditions. The obtained results are illustrated in Table 1 and Figures 1, 2, and 3.

Figures 1–3 show the evolution of the estimated and the true parameter matrices.

A validation of the obtained model is presented in Figures 4 and 5 which show that the estimated outputs track fast and accurately the true outputs.

###### 5.1.2. Case 2

We apply the proposed approach (DLSR) and the RLS algorithm to estimate time delays and parameter matrices. The RLS algorithm uses misestimated time delays . The obtained results are illustrated in Table 2 and Figures 6 and 7.

Figures 6 and 7 show the evolution of the estimated and the true parameter matrices.

###### 5.1.3. Case 3

The system's output is corrupted by additive zero mean white noises with variances ,

The result of the simulation is given in Table 3.

Figures 8, 9, and 10 show the evolution of the estimated and the true parameter matrices.

A validation of the obtained model is presented in Figures 11 and 12 which show that the estimated outputs track fast and accurately the true outputs.

###### 5.1.4. Observations

Based on Tables 1–3 and Figures 1–12, we observe that (i)the RLS method gives the better performance when the true time delays are used. However, it poorly performs for misestimated delays; (ii)the proposed approach converges to the true delays with acceptable speed for the considered cases.

##### 5.2. Experiment Example

The experimental data from a mechanical construction of a CD player arm is considered. The system has two inputs that are forces of the mechanical actuators () and two outputs that are related to the tracking accuracy of the arm ().

The data set contains sample points out of which were used for the identification procedure and the rest to validate the identified models. The input/output identification signals [33] are given in Figures 13 and 14.

The system is described by the following equation: where and are the output and the delayed input of the system at time , and the orders of , are .

The estimation starts with zero initial values for the parameter and the time delay matrices. Applying the proposed algorithm, we obtain

The estimated time delay matrix is Another data set is used for the validation test which is illustrated by Figures 15 and 16.

We can see clearly that the estimated output tracks fast and accurately the true output.

#### 6. Conclusions

In this paper, we have addressed the problem of identification of linear discrete time delay multivariable systems. In fact, we have proposed a novel approach for the simultaneous identification of the unknown time delays and the parameter matrices of these systems. The proposed approach consists in constructing a linear-parameter formulation that is used to estimate the time delays and the polynomial matrices using recursive least square algorithm. The obtained estimates were shown to be unbiased, and an expression for their covariance matrix was given. Numerical simulation and experimental test are presented to demonstrate the performance of the proposed approach.

#### Appendices

#### A. Approximation of

Let us consider the shift operator and the backward difference given, respectively, by So We can infer the identity between the shift operator and the backward difference [34], and then It is equivalent to Applying the logarithm function of both sides of (A.1), we get Using the series expansion of , we have Finally, we use a first-order approximation of the shift operator given by

#### B. Expression of

The partial derivative of with respect to the estimated time delay matrix is given by It is equivalent to Equation (B.2) can be rewritten as We then obtain Using the approximation , we get the partial derivative of with respect to the estimated time delay matrix:

#### C. Expression of

We have In the same way as before (see the equations (22) and (21)), the estimated generalized vector parameters and the generalized vector parameters can appear after adding and subtracting the appropriate term of the equation (C.1): Adding and subtracting the term from (C.2), we obtain where So where

#### Acknowledgment

This work was supported by the Ministry of the Higher Education and Scientific Research in Tunisia.

#### References

- V. B. Kolmanovskii, S.-I. Niculescu, and K. Gu, “Delay effects on stability: a survey,” in
*Proceedings of the 38th IEEE Conference on Decision and Control (CDC '99)*, vol. 2, pp. 1993–1998, December 1999. View at Scopus - J.-P. Richard, “Time-delay systems: an overview of some recent advances and open problems,”
*Automatica*, vol. 39, no. 10, pp. 1667–1694, 2003. View at Publisher · View at Google Scholar · View at MathSciNet - A. Elnaggar, G. A. Dumont, and A.-L. Elshafei, “New method for delay estimation,” in
*Proceedings of the 29th IEEE Conference on Decision and Control*, vol. 3, pp. 1629–1630, December 1990. View at Scopus - E. Hidayat and A. Medvedev, “Laguerre domain identification of continuous linear time delay systems from impulse response data,” in
*Proceedings of the 18th International Federation of Automatic Control World Congress*, 2011. - M. de la Sen, “Robust adaptive control of linear time-delay systems with point time-varying delays via multiestimation,”
*Applied Mathematical Modelling*, vol. 33, no. 2, pp. 959–977, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - O. Gomez, Y. Orlov, and I. V. Kolmanovsky, “On-line identification of SISO linear time-invariant delay systems from output measurements,”
*Automatica*, vol. 43, no. 12, pp. 2060–2069, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Q.-G. Wang and Y. Zhang, “Robust identification of continuous systems with dead-time from step responses,”
*Automatica*, vol. 37, no. 3, pp. 377–390, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. Ahmed, B. Huang, and S. L. Shah, “Parameter and delay estimation of continuous-time models using a linear filter,”
*Journal of Process Control*, vol. 16, no. 4, pp. 323–331, 2006. View at Publisher · View at Google Scholar · View at Scopus - S. V. Drakunov, W. Perruquetti, J.-P. Richard, and L. Belkoura, “Delay identification in time-delay systems using variable structure observers,”
*Annual Reviews in Control*, vol. 30, no. 2, pp. 143–158, 2006. View at Publisher · View at Google Scholar · View at Scopus - X. M. Ren, A. B. Rad, P. T. Chan, and W. L. Lo, “Online identification of continuous-time systems with unknown time delay,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 9, pp. 1418–1422, 2005. View at Publisher · View at Google Scholar · View at MathSciNet - W. Gao, M.-L. Zhou, Y.-C. Li, and T. Zhang, “An adaptive generalized predictive control of time-varying delay system,” in
*Proceedings of the 2nd International Conference on Machine Learning and Cybernetics*, pp. 878–881, Shanghai, China, August 2004. View at Scopus - Y. Orlov, L. Belkoura, J. P. Richard, and M. Dambrine, “Adaptive identification of linear time-delay systems,”
*International Journal of Robust and Nonlinear Control*, vol. 13, no. 9, pp. 857–872, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - L. Ettaleb, G. A. Dumont, and M. S. Davies, “Extended off-line least-squares method for parameter identification and time delay estimation,” in
*Proceedings of the 37th IEEE Conference on Decision and Control (CDC '98)*, pp. 3423–3428, December 1998. View at Scopus - S. Bedoui, M. Ltaief, and K. Abderrahim, “New results on discrete time delay systems,”
*International Journal of Automation and Computing*, vol. 9, no. 6, pp. 570–577, 2012. View at Publisher · View at Google Scholar - S. Bedoui, M. Ltaief, and K. Abderrahim, “Nonlinear approach for the identification of discrete time delay systems,” in
*Proceedings of the 20th Mediterranean Conference on Control and Automation (MED '12)*, Barcelona, Spain, 2012. View at Publisher · View at Google Scholar - A. O. Dwyer, “A survey of techniques for the estimation and compensation of processes with time delay,” Tech. Rep., 2000. View at Google Scholar
- P. J. Gawthrop and M. T. Nihtilä, “Identification of time delays using a polynomial identification method,”
*Systems & Control Letters*, vol. 5, no. 4, pp. 267–271, 1985. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - S. W. S. Su Whan Sung and I.-B. Lee, “Prediction error identification method for continuous-time processes with time delay,”
*Industrial and Engineering Chemistry Research*, vol. 40, no. 24, pp. 5743–5751, 2001. View at Publisher · View at Google Scholar · View at Scopus - T. Zhang and Y.-C. Li, “A fuzzy smith control of time-varying delay systems based on time delay identification,” in
*Proceedings of the International Conference on Machine Learning and Cybernetics*, vol. 1, pp. 614–619, November 2003. View at Scopus - W. Gao, Y. C. Li, G. J. Liu, and T. Zhang, “An adaptive fuzzy smith control of time-varying processes with dominant and variable delay,” in
*Proceedings of the American Control Conference*, vol. 1, pp. 220–224, June 2003. View at Scopus - W. X. Zheng and C. B. Feng, “Identification of stochastic time lag systems in the presence of colored noise,”
*Automatica*, vol. 26, no. 4, pp. 769–779, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - Y. Orlov, L. Belkoura, M. Dambrine, and J. P. Richard, “On identifiability of linear time-delay systems,”
*IEEE Transactions on Automatic Control*, vol. 47, no. 8, pp. 1319–1324, 2002. View at Publisher · View at Google Scholar · View at MathSciNet - S. Bedoui, M. Ltaief, and K. Abderrahim, “A new recursive algorithm for simultaneous identification of discrete time delay systems,” in
*Proceedings of the 16th IFAC Symposium on System Identification (SYSID '12)*, Brussel, Belgium, 2012. - S. Bedoui, M. Ltaief, and K. Abderrahim, “Using a recursive least square algorithm for identification of interconnected linear discretetime delay multivariable systems,” in
*Proceedings of the 17th IEEE International Conference on Methods & Models in Automation & Robotics (MMAR '12)*, Miedzyzdroje, Poland, 2012. View at Publisher · View at Google Scholar - S. Bedoui, M. Ltaief, and K. Abderrahim, “New method for the systematic determination of the model's base of time varying delay system,”
*International Journal of Computer Applications*, vol. 46, no. 1, 2012. View at Google Scholar - J. Roe, R. Gao, and A. O'Dwyer, “Identification of a time-delayed process model using an overparameterisation method,” in
*Proceedings of the China-Ireland International Conference on Information and Communications Technologies (CIICT '07)*, August 2007. View at Publisher · View at Google Scholar - S. Selvanathan and A. K. Tangirala, “Time-delay estimation in multivariate systems using Hilbert transform relation and partial coherence functions,”
*Chemical Engineering Science*, vol. 65, no. 2, pp. 660–674, 2010. View at Publisher · View at Google Scholar · View at Scopus - B. Ni, D. Xiao, and S. L. Shah, “Time delay estimation for MIMO dynamical systems—with time-frequency domain analysis,”
*Journal of Process Control*, vol. 20, no. 1, pp. 83–94, 2010. View at Publisher · View at Google Scholar · View at Scopus - T. S. Söderström and P. Stoica,
*System Identification*, Prentice Hall International Series in Systems and Contol Engineering, 1989. - Y. Xiao, F. Ding, Y. Zhou, M. Li, and J. Dai, “On consistency of recursive least squares identification algorithms for controlled auto-regression models,”
*Applied Mathematical Modelling*, vol. 32, no. 11, pp. 2207–2215, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet - O. Nelles,
*Nonlinear System Identification: From Classical Approach to Neural Networks and Fuzzy Models*, Springer, Berlin, Germany, 2001. View at MathSciNet - L. Mišković, A. Karimi, D. Bonvin, and M. Gevers, “Correlation-based tuning of decoupling multivariable controllers,”
*Automatica*, vol. 43, no. 9, pp. 1481–1494, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus - B. de Moor, P. de Gersem, B. de Schutter, and W. Favoreel, “Daisy: a database for identification of systems,”
*Journal A*, vol. 38, no. 3, pp. 4–5, 1997. View at Google Scholar - L. Lapidus and G. F. Pinder,
*Numerical Solution of Partial Differential Equations in Science and Engineering*, John Wiley & Sons, New York, NY, USA, 1982. View at MathSciNet