Spectral Perspective on the Stability of Discrete-Time Markov Jump Systems with Multiplicative Noise

Hou, Ting; Zhang, Weihai; Ma, Hongji

doi:https://doi.org/10.1155/2014/769302

Mathematical Problems in Engineering

On this page

Abstract Introduction Conclusions Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2014 | Article ID 769302 | https://doi.org/10.1155/2014/769302

Spectral Perspective on the Stability of Discrete-Time Markov Jump Systems with Multiplicative Noise

Ting Hou,¹Weihai Zhang,²and Hongji Ma¹

Academic Editor: Quanxin Zhu

Received30 Apr 2014

Accepted28 Jun 2014

Published10 Jul 2014

Abstract

We apply the spectrum analysis approach to address the stability of discrete-time Markov jump systems with state-multiplicative noise. In terms of the spectral distribution of a generalized Lyapunov operator, spectral criteria are presented to testify three different kinds of stochastic stabilities: asymptotic mean square stability, critical stability, and essential instability.

1. Introduction

Since the pioneering research of [1], Markov jump systems have received an increasing attention from the control community. The main impetus for studying this kind of systems arises from the widespread dynamics that are subject to abrupt structural changes, such as random component failures or repairs, sudden variation in operating points of nonlinear plants, the switching between the economic scenarios, and temporary loss of communication signal. By now, the study of Markov jump systems has become one of the most active areas in the control theory and great progress has been made in the relevant analysis and synthesis. Among many contributions, we would like to mention that structural properties and quadratic optimal control of continuous-time Markov jump linear systems have been considered in [2]. Stability and robust control design have been performed in [3] for discrete-time Markov jump linear systems. Moreover, robustly asymptotic stabilization for a class of stochastically nonlinear singular jump systems has been tackled in [4] based on the Lyapunov-Krasovskii functional. Besides, stability analyses for Markovian jumping neural networks with delays have also been elaborately addressed; see [5–10] and the references therein. Recently, many researchers are attracted to the study of stochastic linear systems subject to both multiplicative noise perturbations and Markov jump, which are commonly viewed as a powerful mathematical tool to investigate the financial phenomena and engineering problems. For instance, the indefinite stochastic linear quadratic (LQ) optimal control was tackled in [11] for discrete-time multiplicative noise systems with Markov jump parameters. Robust filtering has been reported in [12] for stochastic nonlinear Itô systems with Markov jumps. In addition, by means of four coupled matrix recursions, mixed control problem has been settled in [13] for a class of discrete-time Markov jump systems with multiplicative noise. For more details of recent developments, interested readers are referred to [14–16] and the references cited therein.

It is well known that stability is one of the most fundamental notions in the modern control theory. It is the primal factor to be taken into account in the controller design. For stochastic Itô systems and Markov jump systems, various stability concepts such as stochastic stability, exponential stability [17–19], asymptotic stability in probability [20], finite-time stability [21], global asymptotical stability [22, 23], and absolute stability [24] have been studied extensively. It can be remarked that almost all existing works about the stability analysis of stochastic systems are based on the Lyapunov functional method. However, our main purpose is to provide a spectral perspective about the stability of discrete-time Markov jump systems with state-multiplicative noise. Concretely speaking, we will employ the spectral analysis technique to classify three different kinds of stabilities: asymptotic mean square stability, critical stability, and essential instability. For them, spectral criteria are derived according to a generalized Lyapunov operator generated from the system coefficients and transition probability matrix of Markov jump parameter.

The rest of this paper is organized as follows. In Section 2, we introduce a generalized Lyapunov operator which serves as the fundamental tool in the stability analysis. In Section 3, necessary and sufficient conditions, including spectral criteria, are supplied for three kinds of stochastic stabilities, respectively. Section 4 ends this paper with a brief concluding remark.

Throughout this paper, the following notations are adopted: : -dimensional Euclidean space with the usual 2-norm ; : the space of all real matrices; : the set of all symmetric matrices; : that is positive definite (positive semidefinite) symmetric matrix; : the set of all sequences with ; : the set of all sequences where and ; : the transpose of a matrix (vector) ; : the Kronecker product of matrices and ; : the identity matrix; , , and ; : the indicator function of a set .

2. Lyapunov-Type Operator and Its Spectra

On a given probability space , we consider the following linear system with Markovian jumps and multiplicative noise: where represents the state of the system. is a Markov chain taking values in and the transition probability matrix is , . is a sequence of real random variables with and (Kronecker function). The random variables are independent of the Markov chain . The initial value is independent of the noise . Set the -field generated by . Fixing , we denote , , where and are matrix-valued functions of suitable dimensions. Let In the sequel, system (1) is also written as for short.

First of all, we show a useful representation which characterizes the state evolution of system (1).

Theorem 1. For , one sets that . Then, satisfies

Proof. Since and are -measurable and are independent of , we have The proof is completed.

Given , we introduce the following Lyapunov operator: According to the formulation of derived in Theorem 1, the spectra of are defined as follows.

Definition 2. For , let be the linear operator from to . Then, the spectral set of is
Let us see an illustrative example which shows how to compute all the spectra of .

Example 3. In , the jump parameter takes values in and the transition probability matrix is given by When , In the case of , By (5) and noting the symmetry of , we get where is the ellipsis of the symmetric terms. The eigenvalue equation in (6) can be equivalently expressed as Further, we can derive It is easy to obtain that the spectral set of is

Remark 4. The matrix that appeared in Example 3 is called the induced matrix of . Clearly, is unique and has the same eigenvalues as the operator .
Similar to [25, 26], we define two linear operators and as follows: , where is the element of . That is, is a column vector consisting of all elements of , while is the column vector generated by all upper diagonal elements of . The relation between them can be dominated by the unique matrix that is of full column rank: In fact, if we take that where then the expression of turns out to be
By Definition 2, the operator is a linear operator defined on the Hilbert space with the inner product , where . The adjoint operator of induced by the definition of inner production and the property of trace is given as follows: We can show that and have the same spectral radius. Particularly, when the coefficients of are all real matrices, we have .

3. Stability Analysis

Stability is one of the core concepts in the modern control theory. It is a common sense that stability is a necessary prerequisite for the system to behave well. Next, we will make use of the spectrum technique to discuss the stability of system (1).

3.1. Asymptotic Mean Square Stability

Above all, we recall the well-known asymptotic mean square stability of stochastic Markov jump systems.

Definition 5. The system described by the state equation (1) is asymptotically mean square stable (AMSS), if for any and , the corresponding state satisfies .
In terms of the spectra of the operator , several necessary and sufficient conditions can be obtained for the asymptotic mean square stability of .

Theorem 6. The following assertions are equivalent to AMSS of :(i);(ii)for any given with , there exists with such that ;(iii)for any given with , there exists with such that ;(iv)there exists with such that ;(v)there exists with such that .

Proof. We only show the validity of (i). The rigorous arguments of (ii)–(v) can be found in [3]. Set that and . Based on the state equation of , Theorem 1 and Definition 2 give that Recalling Remark 4 and using the operator , (21) can be equivalently expressed as From Definition 5, we have that is asymptotically mean square stable if and only if ; that is, , . By (22) and the stability theory of discrete-time linear systems, the desired result follows.

Example 7. In , the jump parameter takes values in and the transition probability matrix is given by Let There exists satisfying the following LMIs: It thus follows by Theorem 6 that the system denoted by this example is asymptotically mean square stable.

3.2. Critical Stability

In this subsection, we are concerned with the critical stability, which was first proposed in [27] and played a key role in defining the strong solution of a class of generalized Riccati equations arising from stochastic linear quadratic control problem. The following definition can be regarded as an extension of Definition 2.3 [27].

Definition 8. is called critically stable, if .
The following result presents useful criteria for verifying the critical stability of . Its proof can be accomplished by using Theorem 6 and Definition 8. So, only conclusions are listed below.

Theorem 9. is critically stable if and only if one of the following conditions is satisfied:(i)for any given , ;(ii)for any given and with , there exists with such that ;(iii)for any given and with , there exists with such that ;(iv)for any given , there exists with such that ;(v)for any given , there exists with such that .

3.3. Essential Instability

Essential instability for stochastic Itô systems was first proposed in [25]. In what follows, we generalize this concept to Markov jump systems.

Definition 10. is called essentially instable, if there exists such that .

Next, we give a spectral criterion for essential instability of system (1). The detailed proof can be given by following the similar procedure of Theorem 1 [25].

Theorem 11. is essentially instable if and only if for any given such that , there exists a constant and a unique satisfying that . Moreover, there must exist an such that admits at least one positive eigenvalue.

Example 12. Let . Take the same transition probability matrix and the same coefficient matrices as those in Example 3. According to Definition 10, we claim that is essentially instable because of .

4. Conclusions

In this paper, we have applied the technique of operator spectrum to demonstrate some new aspects on the stability of discrete-time Markov jump systems with multiplicative noise. With the help of the spectra of a generalized Lyapunov operator, we have distinguished three kinds of stochastic stabilities and obtained their spectral criteria which are easy to test. As one of our future works, we will focus on how to use the proposed stability theories to devise the stochastic LQ optimal control with convergence rate constraints, which still remains open to date.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (nos. 61304074 and 61174078), the Research Award Fund for Outstanding Young Scientists of Shandong Province (no. BS2013DX009), the Research Fund for the Taishan Scholar Project of Shandong Province of China, the SDUST Research Fund (no. 2011KYTD105), and the State Key Laboratory of Alternate Electrical Power System with Renewable Energy Sources (Grant no. LAPS13018).

References

N. N. Krasosvkii and E. A. Lidskii, “Analytical design of controllers in systems with random attributes I, II, III,” Automation and Remote Control, vol. 22, pp. 1021–1025, 1961.
View at: Google Scholar
M. Mariton, Jump Linear Systems in Automatic Control, Marcel Dekker, New York, NY, USA, 1990.
O. L. V. Costa, M. D. Fragoso, and R. P. Marques, Discrete-time Markovian Jump Linear Systems, Springer, London, UK, 2005.
View at: MathSciNet
Q. Zhu, “Stabilization of stochastically singular nonlinear jump systems with unknown parameters and continuously distributed delays,” International Journal of Control, Automation, and Systems, vol. 11, no. 4, pp. 683–691, 2013.
View at: Google Scholar
Q. Zhu and J. Cao, “Stability analysis of Markovian jump stochastic BAM neural networks with impulse control and mixed time delays,” IEEE Transactions on Neural Networks and Learning Systems, vol. 23, no. 3, pp. 467–469, 2012.
View at: Publisher Site | Google Scholar
Y. Liu, Z. Wang, J. Liang, and X. Liu, “Stability and synchronization of discrete time Markovian jumping neural networks with mixed mode-dependent time-delays,” IEEE Transactions on Neural Networks, vol. 20, no. 7, pp. 1102–1116, 2009.
View at: Google Scholar
Y. Liu, Z. Wang, and X. Liu, “On delay-dependent robust exponential stability of stochastic neural networks with mixed time delays and Markovian switching,” Nonlinear Dynamics, vol. 54, no. 3, pp. 199–212, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Zhang, “Stability of discrete-time Markovian jump delay systems with delayed impulses and partly unknown transition probabilities,” Nonlinear Dynamics, vol. 75, no. 1-2, pp. 101–111, 2014.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Zhang, “Stability of discrete-time delay Markovian jump systems with stochastic non-linearity and impulses,” IET Control Theory and Applications, vol. 7, no. 18, pp. 2178–2187, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Zhang, “Stochastic stability of discrete-time Markovian jump delay neural networks with impulses and incomplete information on transition probability,” Neural Networks, vol. 46, pp. 276–282, 2013.
View at: Publisher Site | Google Scholar
O. L. V. Costa and W. L. de Paulo, “Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems,” Automatica, vol. 43, no. 4, pp. 587–597, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Lin, Y. Lin, and W. Zhang, “ $H_{\infty}$ filtering for non-linear stochastic Markovian jump systems,” IET Control Theory & Applications, vol. 4, no. 12, pp. 2743–2756, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
T. Hou, W. Zhang, and H. Ma, “Finite horizon $H_{2}$ / $H_{\infty}$ control for discrete-time stochastic systems with Markovian jumps and multiplicative noise,” IEEE Transactions on Automatic Control, vol. 55, no. 5, pp. 1185–1191, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
J. Feng, J. Lam, and Z. Shu, “Stabilization of Markovian systems via probability rate synthesis and output feedback,” IEEE Transactions on Automatic Control, vol. 55, no. 3, pp. 773–777, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
J. Liang, Z. Wang, and X. Liu, “Distributed state estimation for uncertain Markov-type sensor networks with mode-dependent distributed delays,” International Journal of Robust and Nonlinear Control, vol. 22, no. 3, pp. 331–346, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
V. Dragan and T. Morozan, “Stochastic observability and applications,” IMA Journal of Mathematical Control and Information, vol. 21, no. 3, pp. 323–344, 2004.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Q. Zhu, F. Xi, and X. Li, “Robust exponential stability of stochastically nonlinear jump systems with mixed time delays,” Journal of Optimization Theory and Applications, vol. 154, no. 1, pp. 154–174, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
Q. Zhu and J. Cao, “Exponential stability of stochastic neural networks with both Markovian jump parametersand mixed time delays,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 41, no. 2, pp. 341–353, 2011.
View at: Publisher Site | Google Scholar
Q. Zhu and J. Cao, “Robust exponential stability of Markovian jump impulsive stochastic Cohen-Grossberg neural networks with mixed time delays,” IEEE Transactions on Neural Networks, vol. 21, no. 8, pp. 1314–1325, 2010.
View at: Publisher Site | Google Scholar
X. Mao and C. Yuan, Stochastic Differential Equations with Markovian Switching, Imperial College Press, London, UK, 2006.
View at: Publisher Site | MathSciNet
Y. Orlov, “Finite time stability and robust control synthesis of uncertain switched systems,” SIAM Journal on Control and Optimization, vol. 43, no. 4, pp. 1253–1271, 2004/05.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Liu, H. Zhang, and Q. Zhang, “Novel stability analysis for recurrent neural networks with multiple delays via line integral-type L-K functional,” IEEE Transactions on Neural Networks, vol. 21, no. 11, pp. 1710–1718, 2010.
View at: Publisher Site | Google Scholar
H. Zhang, Z. Liu, G. Huang, and Z. Wang, “Novel weighting-delay-based stability criteria for recurrent neural networks with time-varying delay,” IEEE Transactions on Neural Networks, vol. 21, no. 1, pp. 91–106, 2010.
View at: Publisher Site | Google Scholar
I. R. Petersen, V. A. Ugrinovskii, and A. V. Savkin, Robust Control Design Using H_∞-Methods, Communications and Control Engineering Series, Springer, Berlin, Germany, 2000.
View at: Publisher Site | MathSciNet
T. Hou, W. Zhang, and H. Ma, “Essential instability and essential destabilisation of linear stochastic systems,” IET Control Theory and Applications, vol. 5, no. 2, pp. 334–340, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
W. Zhang and B. Chen, “ $H$ -representation and applications to generalized Lyapunov equations and linear stochastic systems,” IEEE Transactions on Automatic Control, vol. 57, no. 12, pp. 3009–3022, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
W. Zhang, H. Zhang, and B. Chen, “Generalized Lyapunov equation approach to state-dependent stochastic stabilization/detectability criterion,” IEEE Transactions on Automatic Control, vol. 53, no. 7, pp. 1630–1642, 2008.
View at: Publisher Site | Google Scholar | MathSciNet

Copyright

Copyright © 2014 Ting Hou et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

636

Downloads

658

Citations