Finite-time Control of Complex Systems and Their ApplicationsView this Special Issue
Research Article | Open Access
Ling Li, Lei Tan, Xinmin Song, Xuehua Yan, "Quadratic Filtering for Discrete-Time Systems with Measurement Delay and Packet Dropping", Complexity, vol. 2020, Article ID 1725121, 9 pages, 2020. https://doi.org/10.1155/2020/1725121
Quadratic Filtering for Discrete-Time Systems with Measurement Delay and Packet Dropping
We consider the problem of remote estimation with time delay and multiplicative noise for multichannel systems. First, we apply the reorganized innovation analysis approach to construct the original delay system into a new delay-free system. Secondly, the delay-free system will be reconstructed by the quadratic filtering method to obtain an augmented system. Then, Kalman filtering theory and projection formula are used to solve two Riccati equations and one Lyapunov equation for the augmented system, and the quadratic filter for the measurement delay system on the packet loss network can be obtained. Finally, we use a numerical example to illustrate the effectiveness of the method.
In recent years, the problem of missing measurements caused by unreliable channel transmission has been the focus of many scholars [1–3]. The research on the problem of packet loss can be roughly divided into two directions: one is to solve the linear estimator based on the minimum mean square error method and the other is to use the quadratic filtering method. Nahi  believes that the observation sequence may contain only noise when the packets are lost and derives a set of recursive formulas similar to Kalman filtering in the sense of the minimum mean square error. In , the Kalman filter is implemented by intermittent observation to solve the problem of information loss in large wireless sensor networks. Zhang et al.  propose an estimator that can be applied to an infinite horizon, and its iteration only includes solving a Riccati equation. This estimator avoids the convergence analysis problem caused by the calculation of the Lyapunov equation in traditional estimation methods. The authors in  apply the recombination innovation analysis method to obtain an optimal linear filter, which solves the remote estimation problem of the packet loss network with the measurement delay system obeying Bernoulli distribution.
However, with the development of engineering technology [8–10], the performance of the traditional linear estimator cannot meet the requirements of the real system. Therefore, people are paying more and more attention to the optimization design and implementation of the estimator. De Santis et al.  first propose a method called quadratic filtering, which uses a quadratic function of the measurement equation to improve the performance of the filter. Experiments show that this method is superior to the linear filtering method in estimating performance. This research has attracted great attention of many scholars. Caballero-Águila et al.  consider using innovative methods to solve the least square linear estimation problem and simplify the quadratic estimation problem into a linear estimation problem in a suitable augmented system. After that, Cacace et al.  add the packet loss factor to the measurement model and use the quadratic filtering method to obtain a filter iteration equation with a smaller estimation error. The Kronecker algebraic rules are used in  to discuss the stochastic properties of augmented noise in augmented systems. Then, the linear estimation of the discrete-time non-Gaussian system is obtained by the projection formula. Cacace et al.  propose a feedback quadratic filter that rewrites the system model by introducing an output injection term and prove that the performance of the feedback quadratic filter depends on the gain parameter of the output term.
Meanwhile, researchers found that time delay is common due to uncertain factors such as bandwidth and network failures [16–21]. Especially, the state estimation problem has received much attention for time-delay systems in [22–26]. The emergence of time delay often leads to the instability and even worsens the overall performance of the system. Therefore, solving the time-delay problem in life is bound to be an important subject of our research. The emergence of time delay often leads to the instability of the system and even makes the overall performance of the system worse, so solving the problem of time delay in life is bound to be the most important research content . By solving a partial differential equation, the solution of a continuous observation delay system is obtained. The authors in  transform the discrete system with observation delay into a nonobservation delay system estimation problem by expanding the dimensions and then obtain the filter based on the standard Kalman filtering theory. Zhang et al.  propose a new-information reorganization analysis theory, that is, keeping observation information unchanged and then rearranging and combining observation data from different channels and different time delays into a system without time delay. Finally, the new observation data are introduced into the innovation sequence, and the signal is designed by using the projection theory. Song et al.  extended the abovementioned innovation restructuring theory to the study of infinite time estimation and made a deeper demonstration of the estimation of multistable systems.
Inspired by the above studies, this paper considers the quadratic filter problem of time-delay systems with multichannel multiplicative noise in discrete time. First of all, we assume that the measurement has a delay phenomenon, and the measurement is transmitted through multiple communication channels. The packet loss of each channel is described by the Bernoulli process of independent and identical distribution. Secondly, we use the innovation recombination theory to rearrange and combine the above observation data and obtain a new time-delay free observation system structure. Finally, we construct a quadratic filtering equation for the new time-delay free observation system and obtain a new filter by solving two Riccati equations and one Lyapunov equation. The main contribution of this paper is to effectively combine the quadratic filtering method with the innovation recombination theory; therefore, so as to obtain the quadratic filtering scheme of the discrete-time system with packet loss and measurement delay.
The rest of this article is organized as follows. First, Section 2 provides the question statement and preliminary. Section 3 provides quadratic filter solutions of the problem with detailed derivation processes. This part is the key result of this paper. Then, Section 4 is a simulation example to prove the effectiveness of the estimator algorithm in Section 3. Finally, the summary of this paper is given in Section 5.
Throughout this technical paper, the superscripts ”” and ”-1” represent the transpose and inverse of a matrix, denotes the -dimensional Euclidean space, stands for the mathematical expectation operator, and are used to denote the Kronecker product and the Hadamard product, respectively, represents an identity matrix of the appropriate dimension, and for and . We use to represent a diagonal matrix, where are the diagonal elements of this diagonal matrix. If the dimensions are not explicitly stated, matrices are assumed to have compatible dimensions with algebraic operations.
2. Problem Statement and Preliminary
In this section, we consider a discrete time-delay system for which the state and measurement equations are as follows:where is the time instant, is the measurement delay time, , , and are, respectively, the system state and measurement, and , , and are the system noise and measurement noise with zero mean and covariances , , and , respectively. Here, and . The mutually uncorrelated and identically distributed (i.i.d.) Bernoulli random variables and are employed to describe, respectively. The packet loss phenomenon in the channels and channels is with , , , and . The initial state is a random vector with mean and covariance matrix . It should be noted that for simplicity, we assume that and are constant matrices with appropriate dimensions. The random processes are independent of the initial state .
For convenience, the measurement can be rewritten as the following:
2.1. Problem Statement
For the given systems (1) and (4), we try to construct the quadratic state and measurement vector and then get the quadratic filter iteration equation of the new system through the projection method and the basic theory of the Kalman filter.
3. Main Results
Since there is a time delay at instant , state has an additional measurement . In addition, when , the measurement contains the time delay. According to , the linear space contains the same information as , where the new observations and are provided as follows:
For convenience, and can be rewritten aswhere
Before introducing the quadratic filtering problem, we will construct the augmented state and measurement vectors by stacking the original vectors and obtaining their second-order Kronecker powers. Then, we can get the new state vector and the measurement vector as shown below:wherewith .
Similarly, it is not difficult to obtain the following measurement equation:wherewherein whichwith , , and .
Then, the new state vector and the measurement vector can be written as
Finally, we can derive the augmented system as follows:where
Note that the new measurements and are delay free. , , and for all and the initial are mutually independent. Moreover, , , and are zero mean such that , , and , and the detailed calculation processes are given below:where
It should be pointed out that the entries of , , and are known since they are the elements of , , and , respectively.
For convenience, let us define
Then, we can calculate thatwhere is the matrix which guarantees that .
Following the similar way for , one haswherewhere
It should be noted that and are the matrices which ensure and . Then, notice that the entries of , , , , , and are known because they are the elements of , , , , , and , respectively.
We define the quadratic state estimator as the projection of onto the linear space . In order to derive the projection, we give the following definitions of the innovation sequence:where is the projection of onto the linear space of and is the projection of onto the linear space of . Then, we define and . It should be noted that the definitions of and are similar to and . In addition, we reckon that is an independent white noise and spans the same linear space as . Next, we derive the covariance and of the innovation sequence. For convenience, the following definitions are given:
Finally, the covariance matrices and can be derived asand the Lyapunov equation can be calculated by
Proof. According to (15), we can directly prove (38) by the projection theorem:Then, we obtain the estimate error by subtracting (38) from (15):Therefore, the prediction error covariance can be calculated from (39):Similar to formula (39), we can deduce (41) as follows:By combining (15) and (41), one hasAs such, we get the Riccati equation:By the definition of and , we can conclude that . Therefore, formula (33) is proved.
The proof is finished.
4. Simulation Results
In this section, we demonstrate the effectiveness of the proposed algorithm by a simulation example. The linear discrete-time system can be written as follows:with initial values given as ,; , and are the white noises with zero mean and covariances , and , respectively.
We use MATLAB to simulate the performance of the estimator in Theorem 1, and the numerical results are shown in Figures 1–4. First, it can be seen that Figures 1 and 2 represent quadratic estimators with measurement delays, and Figures 3 and 4 reflect the quadratic estimation results without delays. Then, by comparing Figures 1 and 3 and Figures 2 and 4, it can be observed that the tracking effect of Figures 1 and 2 is better. Therefore, this experiment shows that the information from the measurement delay channel is really important in the design of the quadratic estimator.
We considered the problem of remote estimation with time delay and multiplicative noise for multichannel systems. At first, we applied the reorganized innovation analysis approach to construct the original delay system into a new delay-free system. Secondly, the delay-free system was reconstructed by the quadratic filtering method to obtain an augmented system. Then, the Kalman filtering theory and the projection formula were used to solve two Riccati equations and one Lyapunov equation for the augmented system, and the quadratic filter for the measurement delay system on the packet loss network was obtained. Finally, simulation experiments proved the effectiveness of the estimator algorithm.
The simulation program data used to support the proposed approach in numerical example section is available from the corresponding author upon request. No data (except for the simulation program) were used to support this study.
Conflicts of Interest
The authors express that there are no conflicts of interest concerning with the publication of this work.
The contribution of all the authors to the writing of this paper is identical. The final manuscript was read and approved by all of them.
This work was supported in part by the National Science Foundation of China (61873152) and the Chinese Postdoctoral Science Foundation (2019M652424 and 2017M612336).
- C. Pang and S. Sun, “Fusion predictors for multisensor stochastic uncertain systems with missing measurements and unknown measurement disturbances,” IEEE Sensors Journal, vol. 15, no. 8, pp. 4346–4354, 2015.
- X. Song and W. X. Zheng, “Linear estimation for discrete-time periodic systems with unknown measurement input and missing measurements,” ISA Transactions, vol. 95, pp. 164–172, 2019.
- L. Li, D. W. C. Ho, and J. Lu, “Event-based network consensus with communication delays,” Nonlinear Dynamics, vol. 87, no. 3, pp. 1847–1858, 2016.
- N. E. Nahi, “Optimal recursive estimation with uncertain observation,” IEEE Transactions on Information Theory, vol. 15, no. 4, pp. 128–136, 1969.
- B. Sinopoli, L. Schenato, M. Franceschetti, K. Poolla, M. I. Jordan, and S. S. Sastry, “Kalman filtering with intermittent observations,” IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1453–1464, 2004.
- H. Zhang, X. Song, and L. Shi, “Convergence and mean square stability of suboptimal estimator for systems with measurement packet dropping,” IEEE Transactions on Automatic Control, vol. 57, no. 5, pp. 1248–1253, 2012.
- X. Song, Z. Duan, and J. H. Park, “Linear optimal estimation for discrete-time systems with measurement-delay and packet dropping,” Applied Mathematics and Computation, vol. 284, pp. 115–124, 2016.
- H. Liu, B. Xu, D. Lu, and G. Zhang, “A path planning approach for crowd evacuation in buildings based on improved artificial bee colony algorithm,” Applied Soft Computing, vol. 68, pp. 360–376, 2018.
- H. Liu, B. Liu, H. Zhang, L. Li, X. Qin, and G. Zhang, “Crowd evacuation simulation approach based on navigation knowledge and two-layer control mechanism,” Information Sciences, vol. 436-437, pp. 247–267, 2018.
- D. Yang, X. Li, and J. Qiu, “Output tracking control of delayed switched systems via state-dependent switching and dynamic output feedback,” Nonlinear Analysis: Hybrid Systems, vol. 32, pp. 294–305, 2019.
- A. De Santis, A. Germani, and M. Raimondi, “Optimal quadratic filtering of linear discrete-time non-Gaussian systems,” IEEE Transactions on Automatic Control, vol. 40, no. 7, pp. 1274–1278, 1995.
- R. Caballero-Águila, A. Hermoso-Carazo, and J. Linares-Pérez, “Linear and quadratic estimation using uncertain observations from multiple sensors with correlated uncertainty,” Signal Processing, vol. 91, no. 2, pp. 330–337, 2011.
- F. Cacace, A. Fasano, and A. Germani, “Quadratic filtering of non-Gaussian systems with intermittent observations,” in Proceedings of the 52nd IEEE Conference on Decision and Control, Firenze, Italy, December 2013.
- H. Zhao and C. Zhang, “Non-Gaussian noise quadratic estimation for linear discrete-time time-varying systems,” Neurocomputing, vol. 174, pp. 921–927, 2016.
- F. Cacace, F. Conte, A. Germani, and G. Palombo, “Feedback quadratic filtering,” Automatica, vol. 82, pp. 158–164, 2017.
- T. H. Lee, H. M. Trinh, and J. H. Park, “Stability analysis of neural networks with time-varying delay by constructing novel Lyapunov functionals,” IEEE Transactions on Neural Networks and Learning Systems, vol. 29, no. 9, pp. 4238–4247, 2018.
- L. B. Wu and J. H. Park, “Adaptive fault-tolerant control of uncertain switched nonaffine nonlinear systems with actuator faults and time delays,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 99, 2019.
- X. Li, J. Shen, H. Akca, and R. Rakkiyappan, “LMI-based stability for singularly perturbed nonlinear impulsive differential systems with delays of small parameter,” Applied Mathematics and Computation, vol. 250, pp. 798–804, 2015.
- B. Niu, D. Wang, M. Liu, X. Song, H. Wang, and P. Duan, “Adaptive neural output-feedback controller design of switched nonlower triangular nonlinear systems with time delays,” in Procedings of the IEEE Transactions on Neural Networks and Learning Systems, Piscataway, NJ, USA, December 2020.
- Z. Wang, J. Xu, X. Song, and H. Zhang, “Consensus problem in multi-agent systems under delayed information,” Neurocomputing, vol. 316, pp. 277–283, 2018.
- Z. Wang, H. Zhang, M. Fu, and H. Zhang, “Consensus for high-order multi-agent systems with communication delay,” Science China-Information Science, vol. 9, pp. 241–252, 2017.
- X. Song and J. H. Park, “Linear optimal estimation for discrete-time measurement delay systems with multichannel multiplicative noise,” IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 64, no. 2, pp. 156–160, 2017.
- X. Yang, X. Li, X. Li, Q. Xi, and P. Duan, “Review of stability and stabilization for impulsive delayed systems,” Mathematical Biosciences & Engineering, vol. 15, no. 6, pp. 1495–1515, 2018.
- D. Yang, X. Li, J. Shen, and Z. Zhou, “State-dependent switching control of delayed switched systems with stable and unstable modes,” Mathematical Methods in the Applied Sciences, vol. 41, no. 16, pp. 6968–6983, 2018.
- T. H. Lee and J. H. Park, “New methods of fuzzy sampled-data control for stabilization of chaotic systems,” IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 48, no. 12, pp. 2026–2034, 2018.
- L. B. Wu, J. H. Park, and N. N. Zhao, “Robust adaptive fault-tolerant tracking control for nonaffine stochastic nonlinear systems with full state constraints,” IEEE Transactions on Cybernetics, vol. 99, 2019.
- H. Kwakernaak, “Optimal filtering in linear systems with time delays,” IEEE Transactions on Automatic Control, vol. 12, no. 2, pp. 169–173, 1967.
- L. Xiao, A. Hassibi, and J. P. How, “Control with random communication delays via a discrete-time jump system approach,” in Proceedings of the 2000 American Control Conference, pp. 2199–2204, Chicago, IL, USA, June 2000.
- H. Zhang, X. Lu, and D. Cheng, “Optimal estimation for continuous-time systems with delayed measurements,” IEEE Transactions on Automatic Control, vol. 51, no. 5, pp. 823–827, 2006.
Copyright © 2020 Ling Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.