Research Article | Open Access

Adrian-Mihail Stoica, "Mixed Performance Analysis and State-Feedback Control Design for Networked Systems with Fading Communication Channels", *Mathematical Problems in Engineering*, vol. 2012, Article ID 291714, 16 pages, 2012. https://doi.org/10.1155/2012/291714

# Mixed Performance Analysis and State-Feedback Control Design for Networked Systems with Fading Communication Channels

**Academic Editor:**Zidong Wang

#### Abstract

The purpose of the present paper is to provide a performance analysis approach of networked systems with fading communication channels. For a Ricean model of the fading communication channel, it is shown that the resulting system has a hybrid structure including the continuous-time dynamics of the networked systems and a discrete-time dynamics of the communication channels. Moreover, this resulting hybrid system has both multiplicative and additive noise terms. The performance analysis naturally leads to an -type norm evaluation for systems with finite jumps and multiplicative noise. It is proved that this norm depends on the stabilizing solution of a specific system of coupled Riccati's equations with jumps. A state-feedback design problem to accomplish a mixed performance is also considered. A numerical iterative procedure allowing to compute the stabilizing solution of the Riccati-type system with jumps is presented. The theoretical results are illustrated by numerical results concerning the tracking performances of a flight formation with fading communication channel. The paper ends with some concluding remarks.

#### 1. Introduction

The analysis and synthesis of networked control systems have received a major attention over the last decade due to their wide area of applications (see, e.g., [1–3] and their references). These applications include aerial and terrestrial surveillance [3], formation atmospheric flight [4], terrain mapping, and satellites formations for space science missions [5]. In all these applications, the formation members are autonomous vehicles from which the human pilots have been removed in order to avoid their participation at dangerous and repetitive tasks. The specific feature of such networked systems is that the control loop is closed through a communication channel shared by all autonomous vehicles. This communication network is required since the control law of each formation member usually depends on the measurements from all other vehicles. Even in the distributed control architectures when each vehicle uses only the information about its neighboring vehicles, a communication network is very useful. Indeed, in [6] it is proved that in a *predecessor following* approach, the relative positioning error between vehicles is amplified if the members of the formation have no information about the leader position. This conclusion motivates the use of a *predecessor and leader following* method in which both information about the predecessor and about the leader position are available for each formation member. In [6] it is also proved that in this case the relative spacing errors can be attenuated. These interesting results emphasize the importance of the communication in networked control systems. Most of the communication systems are based on wireless networks which, in contrast with the wired systems, are much more sensitive to information transmission errors.

The main goal of this paper is to analyze the interaction between the control and the communication system with fading. To this end, a model of the fading communication channel is required. There are many such models developed in the recent literature (see, e.g., [7, 8]). Deterministic models of communication networks with time-varying delays are considered in [9–11], in which the maximum admissible delays are determined using the Lyapunov stability theory. In other deterministic models of fading communication channels, the transmission errors are represented as uncertain parameters, and, the control system is designed via specific robust synthesis procedures including linear quadratic Gaussian (LQG) and -synthesis. Another class of representations of fading communication channels is based on stochastic models either with Markovian jumps or with white noise [7, 12]. Many useful results concerning the stability, control, and disturbance attenuation of such systems are available in the control literature (see, e.g., [13–15] and their references). In [8], an -type design is used to determine a controller for a system with fading communication channel represented as a Markovian system. A Markovian representation of the network status is also used to solve robust fault detection problems by techniques for communication systems which may be found in [16]. An extended version for the case of random measurement delays and stochastic data-missing phenomenon is treated in [17]. In the present paper, a discrete-time Ricean model of the communication channel is considered. The stochastic Rice models are often used for models of wireless links [7]. They include both additive and multiplicative white noise terms. The problem analyzed in this paper is the influence of the fading communication channel over the tracking performance of a flight formation. The control system of the flight formation is the one derived in [4]. Since the exogenous inputs in the networked system are both deterministic (the reference signals for the formation control) and stochastic (the white noise terms in the fading communication channel model), a mixed -type approach is appropriate for this analysis. Moreover, the networked system has a hybrid structure due to its continuous-time component represented by the vehicles dynamics and a discrete-time one corresponding to the communication channel. The above mentioned considerations lead to a mixed analysis problem for stochastic systems with finite jumps. The systems with finite jumps are used to represent dynamic systems with continuous-time and discrete-time components. Useful results and developments concerning these systems may be found, for instance, in [18, 19]. The paper provides an analysis and an optimization approach of the mixed performance for a hybrid model of networked systems with fading communication channels. This model is derived in Section 2 of the paper. In Section 3, the expression of the performance is determined in terms of the stabilizing solution of a specific system of coupled Riccati equations with finite jumps. A state-feedback design procedure to optimize the mixed performance is presented in Section 4. Numerical aspects concerning the computation of the stabilizing solution are given in Section 5. The theoretical results are illustrated by a numerical example concerning the tracking performance of an aircraft formation. The paper ends with some final remarks and future work.

#### 2. A Model of Networked Systems over Fading Communication Channel

In this section a control problem of a formation of unmanned air vehicles (UAVs) will be briefly presented. Such problems have been intensively analyzed over the last fifteen years (see, e.g., [3]) both for their wide area of applications and for the challenges addressed to the control engineer. In [4], a dynamic inversion-type approach is used to linearize the nonlinear dynamic and kinematic equations of the UAV motion. A simplified linearized model of a flight formation member has the form: where denotes the deviation of the aircraft with respect to its desired position and stands for the deviation of its state ( representing the airspeed, the heading angle, and the flight path angle) with respect to some specified value . The input vector includes the desired derivatives of and plays the role of a reference signal in the model (2.1). The constant matrix has the diagonal form , and the state-feedback control gains and are diagonal, too. In the present paper, the case when the reference signal is transmitted from the ground station or from the formation leader using a fading communication channel is considered. The aim is to analyze how the tracking performances of the flight formation are altered due to the communication system. To this end, a model of the fading communication channel is required. In this paper, the th-order Rice model was adopted. This model is frequently used in wireless mobile links, and it is given by the discrete-time equation: where denotes the moment of time, denotes the transmitted information, is the received information, is a Gaussian white noise with zero mean and unit variance, and , are independent random variables with known mean and variance . In the case of the application considered in this paper, is just the transmitted reference signal . A state-space representation of (2.2) is where, by definition, and stands for the state vector of the communication channel, denoting the dimension of the transmitted information vector . In (2.4), the identity and the zero matrices have the size , and the identity matrix in is on the th position. The configuration of the communication system (2.3) coupled with the system (2.1) is illustrated in Figure 1. The resulting system from Figure 1 is in fact a hybrid system since the dynamics of (2.1) is a continuous-time one, and (2.3) is a discrete-time system. A state-space realization of such hybrid system can be given using systems with finite jumps of the general form: in which denotes the sampling period, the state is left continuous and right discontinuous at the sampling moments , , and , , and , , are the continuous-time and the discrete-time inputs, respectively, of the system (see, e.g., [19, 20]). Since the received information is constant between the sampling moments, it can be represented as where the state of the communication system is given by A similar model can be adopted for the continuous-time control system (2.1) which can be represented as where In (2.8) the state is continuous-time, and therefore, and is the received perturbed reference signal described by (2.6). From (2.6)–(2.10), it follows that the hybrid networked system with fading communication channels can be represented using a model with finite jumps of the form (2.5) where . Moreover, since in (2.6) the coefficients , and , are random variables, one may consider the following stochastic version of (2.5) which includes both multiplicative noise components and additive white noise terms: where the random variables , and , , are such that the pair is an -dimensional standard Wiener process, and and , are sequences of independent random variables on a probability space . It is assumed that , , , , are independent stochastic processes with zero mean and unitary second moments. The outputs and denote the continuous-time and the discrete-time outputs, respectively. By virtue of standard results from the theory of stochastic differential equations (see, e.g., [21]), the system (2.11) has a unique -adapted solution for any initial condition , denoting the -algebra generated by the random vectors , and , . This solution is almost surely left continuous.

A mixed problem for this class of stochastic systems with jumps will be treated in the next section.

#### 3. Mixed -Type Norm for Systems with Jumps Corrupted with Multiplicative Noise

Before defining and computing the mixed norm for systems of the form (2.11), some useful definitions and preliminary results will be briefly presented.

##### 3.1. Notations, Definitions, and Some Useful Results

Consider the stochastic system with jumps (2.11) in which and denote continuous-time and discrete-time energy bounded inputs, respectively. It means that , where denotes the space of the functions for which , and where is the space of the discrete-time vectors with the property , where stands for the Euclidian norm.

*Definition 3.1. *The stochastic system with jumps and with multiplicative noise
is *exponentially stable in mean square* (ESMS) if there exist and such that for any initial condition and for all , denoting the mean of the random variable and representing the solution of (3.1) with the initial condition .

The following result gives necessary and sufficient conditions in which the system with finite jumps (3.1) is ESMS, and its proof may be found in [13].

Proposition 3.2. *The system (3.1) is ESMS if and only if the system of coupled Lyapunov equations
**
has a unique symmetric solution , right continuous and -periodic.*

Another useful result is the differentiation rule of functions of solutions to stochastic differential equations, well known in the literature as Itô’s formula [21].

Proposition 3.3. *Let be a continuous function with respect to . If is a solution of the stochastic differential equation
**
then
**
where denotes the trace of the matrix .*

The next result will be used in the following sections, and its proof may be found in [13, page 162].

Proposition 3.4. *Consider the stochastic system with multiplicative noise
**
and the cost function
**
then
**
where verifies the equation
**
and where .*

##### 3.2. The Mixed Norm of the System (2.11)

Assume that the system (2.11) which will be denoted below by is ESMS and that . As in the deterministic case, and norms can be defined as follows.

*impulse-to-energy gain* induced from to stands for the -type norm of the system (2.11). The -type norm of (2.11) denoted by can be determined as
where is the solution of the Lyapunov-type system
(see also [18]).

*energy-to-energy gain* induced from to stands for the -type norm of the system (2.11), denoted by . It represents the smallest for which the following system of coupled Riccati equations
has a *stabilizing solution *. Recall that a symmetric right continuous, -periodic function verifying (3.11) is called a stabilizing solution of (3.11) if
and the system with jumps
is ESMS, where, by definition,
Similarly with the deterministic case (see, e.g., [22, 23]), a mixed -type norm of (2.11) can be defined solving the optimization problem:
where , the white-noise-type random inputs and are as in previous subsection and with . Notice that, if and are null in (3.15), then gives the square of the -type norm induced by the random inputs and . The main result of this subsection is the following theorem.

Theorem 3.5. *The optimum defined in (3.15) is given by
**
where is the stabilizing solution of the system of coupled Riccati equations (3.11).*

*Proof. *The proof follows applying Itô’s formula (Proposition 3.3) for the function with being the solution of (2.11) and with the stabilizing solution to the system (3.11). Thus, by direct computations, one obtains
where, by definition,
On the other hand using the second equations of (2.11) and of (3.11), it follows that
where
Integrating (3.17) from to and equalizing it with (3.19) summed up from to , based on the fact that and and that is -periodic, one obtains (3.16).

#### 4. State-Feedback Mixed Control Design

Consider the following linear stochastic system with multiplicative noise and finite jumps: where is an exogenous input, denotes the control variable, stands for the regulated output, and is the measured output. For the simplicity of the computations, the following orthogonality assumption is made: As seen from the above system, the state vector is assumed measurable. It is not the purpose of the present paper to analyze the case when the state variables must be estimated. For some results concerning the discrete-time filtering methods associated to networked systems, see, for instance, [24–26].

The second equation of the system (4.1) does not include a discrete-time control input since, in the application presented in the previous section, the control law has only a continuous-time component.

The problem analyzed in this section consists in finding a state-feedback gain , such that the resulting system obtained with , satisfies the following conditions.(i)It is ESMS.(ii)The -type norm of the stochastic system with jumps obtained by ignoring the noises and is less than a given .(iii)The performance index (3.16) is minimized, where in (3.16) denotes the stabilizing solution of the norm-type Riccati system (3.11) corresponding to the resulting system obtained with , namely, replacing by .

The solution of this problem is given by the following result.

Theorem 4.1. *The solution of the state-feedback mixed control problem considered above is given by
**
where denotes the -periodic stabilizing solution of the game-theoretic Riccati type system with jumps
*

*Proof. *Consider the cost function
associated with the system
with the initial condition . Applying Proposition 3.4 for and , one obtains that
where the following notation has been introduced
, denoting the stabilizing solution of the Riccati-type system (4.4).

Equation (4.7) shows that the minimum of with respect to the control input is obtained for .

Further, consider a stabilizing state-feedback control , for which the norm of the resulting system without additive white noise (see the requirement (ii) above)
is less than .

Using again Proposition 3.4 for the system (4.9), direct computations give
where is defined by (4.8) and is the stabilizing solution of the Riccati system of form (3.11) corresponding to (4.9). Then, defining and
one obtains that ; namely,
Since and are stabilizing solutions of the Riccati systems, it follows that . Therefore, making in (4.12), one obtains that .

Further, using a similar reasoning for the cost function
with , one obtains that , and; thus, one concludes that the minimum of (3.16) is obtained for the stabilizing solution of the Riccati-type system (4.4).

#### 5. A Numerical Procedure to Compute the Stabilizing Solution of the Riccati System with Jumps

In order to determine with the expression given in the statement of Theorem 3.5, the stabilizing solution , of the Riccati-type system (3.11) must be determined. Since the two Riccati equations of this system are coupled, an iterative procedure will be used. The proposed iterative method is similar with the iterative numerical methods used to solve Riccati equations of norm in the deterministic continuous-time and discrete-time cases (see, for instance, [27, 28]). These Newton-type iterative procedures are adapted to the particularities of the Riccati systems with jumps derived in the previous sections, and a detailed proof of the convergence towards the stabilizing solution is not the purpose of the present paper. Roughly speaking, the proof based follows showing that the solutions obtained at each iteration determine a monotonic and bounded sequence. An important particular feature of the Riccati systems with jumps, already mentioned above, is that their solution is -periodic and right continuous. The proposed iterative procedure is the following: where For the initial step of the above iterative procedure, one takes , and and stabilizing (5.1). In order to solve (5.1) at each iteration, one solves the first equation (5.1) obtaining which is substituted then in the second equation (5.1) obtaining, thus, a Lyapunov-type equation with the unknown variable . Then, by backward integration on the interval with the initial condition , one obtains for .

In the final part of this section, some of the above theoretical results will be used to analyze the mixed performance of the UAVs formation networked with fading communication channel considered in Section 2. The values of the gains considered in this example are and , for m/s (see Section 2). One determined the performance index performance computing the value of the index defined by (3.15). The results are illustrated in Figure 2. One can see the the tracking performances of the flight formation are severely deteriorated when the sampling period of the transmission in the communication channel increases. In Figure 3, the variation of with respect to the sampling period and the variance of the multiplicative noise, in the absence of the additive white noise, are shown in Figure 3. It can be seen that is not very much influenced by the multiplicative noise at small sampling periods, but it becomes very sensitive with respect to this noise when the sampling period increases.

#### 6. Conclusions

The purpose of the paper was to provide an appropriate methodology to evaluate the performance of networked systems interconnected via fading communication channels. The main difficulty arises from the hybrid structure of the resulting system which includes a continuous-time component specific to the network individual members and a discrete-time component given by the communication system. It is shown that such a hybrid configuration can be analyzed from the point of view of stability and disturbance attenuation performances using dynamic models with finite jumps. In the actual stage of the research, a method to compute a mixed -type performance has been developed, and a state-feedback control law to optimize it has been designed. Further research will be focused on the state estimation problems arising in the implementation of such control laws.

#### Acknowledgments

The author thanks the anonymous reviewers for their useful comments and suggestions. This work was sponsored by the National University Research Council (CNCS) under Grant 1721.

#### References

- R. W. Beard, J. Lawton, and F. Y. Hadaegh, “A coordination architecture for spacecraft formation control,”
*IEEE Transactions on Control Systems Technology*, vol. 9, no. 6, pp. 777–790, 2001. View at: Publisher Site | Google Scholar - J. Carbaugh, D. N. Godbole, and R. Sengupta, “Safety and capacity analysis of automated and manual highway systems,”
*Transportation Research Part C*, vol. 6, no. 1-2, pp. 69–99, 1998. View at: Google Scholar - S. Banda, J. Doyle, R. Murray, J. Paduano, J. Speyer, and G. Stein, “Research needs in dynamics and control of uninhabited aerial vehicles,” Panel Report, 1997. View at: Google Scholar
- F. Giulietti and G. Mengali, “Dynamics and control of different aircraft formation structures,”
*Aeronautical Journal*, vol. 108, no. 1081, pp. 117–124, 2004. View at: Google Scholar - TechSat 21, “Space missions using satellite clusters,” 1998, http://www.vs.afrl.af.mil/. View at: Google Scholar
- P. J. Seiler,
*Coordinated control of unmanned aerial vehicles*, Ph.D. thesis, University of California, Berkeley, Calif, USA, 2001. - N. Elia, “Remote stabilization over fading channels,”
*Systems & Control Letters*, vol. 54, no. 3, pp. 237–249, 2005. View at: Publisher Site | Google Scholar | Zentralblatt MATH - P. Seiler and R. Sengupta, “An ${H}_{\infty}$ approach to networked control,”
*IEEE Transactions on Automatic Control*, vol. 50, no. 3, pp. 356–364, 2005. View at: Publisher Site | Google Scholar - A. Hassibi, S. P. Boyd, and J. P. How, “Control of asynchronous dynamical systems with rate constraints on events,” in
*Proceedings of the 38th IEEE Conference on Decision and Control (CDC '99)*, pp. 813–814, December 1999. View at: Google Scholar - G. C. Walsh, O. Beldiman, and L. G. Bushnell, “Asymptotic behavior of nonlinear networked control systems,”
*IEEE Transactions on Automatic Control*, vol. 46, no. 7, pp. 1093–1097, 2001. View at: Publisher Site | Google Scholar | Zentralblatt MATH - W. Zhang, M. S. Branicky, and S. M. Phillips, “Stability of networked control systems,”
*IEEE Control Systems Magazine*, vol. 21, no. 1, pp. 84–99, 2001. View at: Publisher Site | Google Scholar - H. Chan and U. Özgüner, “Optimal control of systems over a communication network with queues via a jump system approach,” in
*Proceedings of the 4th IEEE Conference on Control Applications*, pp. 1148–1153, September 1995. View at: Google Scholar - V. Dragan, T. Morozan, and A.-M. Stoica,
*Mathematical Methods in Robust Control of Linear Stochastic Systems*, vol. 50 of*Mathematical Concepts and Methods in Science and Engineering*, Springer, New York, NY, USA, 2006. - P. V. Pakshin, “State estimation and control synthesis for discrete linear systems with additive and multiplicative noise,”
*Automation and Remote Control*, vol. 39, no. 4, pp. 526–535, 1978. View at: Google Scholar | Zentralblatt MATH - J. Zabczyk, “Stochastic control of discrete-time systems,” in
*Control Theory and Topics in Functional Analysis*, vol. 1, pp. 187–224, International Atomic Energy Agency, Vienna, Austria, 1976. View at: Google Scholar | Zentralblatt MATH - X. He, Z. Wang, Y. D. Ji, and D. H. Zhou, “Robust fault detection for networked systems with distributed sensors,”
*IEEE Transactions on Aerospace and Electronic Systems*, vol. 47, no. 1, pp. 166–177, 2011. View at: Publisher Site | Google Scholar - X. He, Z. Wang, and D. H. Zhou, “Robust fault detection for networked systems with communication delay and data missing,”
*Automatica*, vol. 45, no. 11, pp. 2634–2639, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - A. Ichikawa and H. Katayama, “${H}_{\infty}$ control for a general jump system with application to sampled-data systems,” in
*Proceedings of the 35th IEEE Conference on Decision and Control (CDC '96)*, pp. 446–451, Kobe, Japan, December 1996. View at: Google Scholar - N. Sivashankar and P. P. Khargonekar, “Characterization and Computation of the ${H}_{2}$induced norm of sampled–data systems,”
*SIAM Journal on Control and Optimization*, vol. 32, no. 4, pp. 1128–1150, 1994. View at: Google Scholar - V. Dragan and A.-M. Stoica, “Riccati type equations for stochastic systems with jumps,” in
*Proceedings of the 17th International Symposium on Mathematical Theory of Networks and Systems (MTNS '06)*, Kyoto, Japan, July 2006. View at: Google Scholar - E. Biglieri, J. Proakis, and S. Shamai, “Fading channels: information-theoretic and communications aspects,”
*IEEE Transactions on Information Theory*, vol. 44, no. 6, pp. 2619–2692, 1998. View at: Publisher Site | Google Scholar | Zentralblatt MATH - J. Doyle, K. Zhou, K. Glover, and B. Bodenheimer, “Mixed ${H}_{2}$ and ${H}_{\infty}$ performance objectives. II. Optimal control,”
*IEEE Transactions on Automatic Control*, vol. 39, no. 8, pp. 1575–1587, 1994. View at: Publisher Site | Google Scholar | Zentralblatt MATH - K. Zhou, K. Glover, B. Bodenheimer, and J. Doyle, “Mixed ${H}_{2}$ and ${H}_{\infty}$ performance objectives. I. Robust performance analysis,”
*IEEE Transactions on Automatic Control*, vol. 39, no. 8, pp. 1564–1574, 1994. View at: Publisher Site | Google Scholar | Zentralblatt MATH - H. Dong, Z. Wang, and H. Gao, “Robust ${H}_{\infty}$ filtering for a class of nonlinear networked systems with multiple stochastic communication delays and packet dropouts,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 4, pp. 1957–1966, 2010. View at: Publisher Site | Google Scholar - H. Dong, Z. Wang, D. W. C. Ho, and H. Gao, “Variance-constrained ${H}_{\infty}$ filtering for a class of nonlinear time-varying systems with multiple missing measurements: the finite-horizon case,”
*IEEE Transactions on Signal Processing*, vol. 58, no. 5, pp. 2534–2543, 2010. View at: Publisher Site | Google Scholar - A. S. Matveev and A. V. Savkin, “Optimal state estimation in networked systems via sensor control,” in
*Proceedings of the 15th IFAC World Congress*, Barcelona, Spain, 2002. View at: Publisher Site | Google Scholar - R. R. Bitmead, M. R. Gevers, I. R. Petersen, and R. J. Kaye, “Monotonicity and stabilizability properties of solutions of the Riccati difference equation: propositions, lemmas, theorems, fallacious conjectures and counter-examples,”
*Systems & Control Letters*, vol. 5, no. 5, pp. 309–315, 1985. View at: Publisher Site | Google Scholar | Zentralblatt MATH - H. K. Wimmer, “Monotonicity of maximal solutions of algebraic Riccati equations,”
*Systems & Control Letters*, vol. 5, no. 5, pp. 317–319, 1985. View at: Publisher Site | Google Scholar | Zentralblatt MATH

#### Copyright

Copyright © 2012 Adrian-Mihail Stoica. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.