Table of Contents
International Journal of Stochastic Analysis
Volume 2013, Article ID 281473, 5 pages
Research Article

The LMI Approach for Stabilizing of Linear Stochastic Systems

Faculty of Economics and Business Administration, Sofia University “St. Kliment Ohridski,”, 125 Tsarigradsko Shosse Boulevard, bl.3, 1113 Sofia, Bulgaria

Received 28 April 2013; Accepted 26 July 2013

Academic Editor: Josefa Linares-Pérez

Copyright © 2013 Ivan Ivanov. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Stochastic linear systems subjected both to Markov jumps and to multiplicative white noise are considered. In order to stabilize such type of stochastic systems, the so-called set of generalized discrete-time algebraic Riccati equations has to be solved. The LMI approach for computing the stabilizing symmetric solution (which is in fact the equilibrium point) of this system is studied. We construct a new modification of the standard LMI approach, and we show how to apply the new modification. Computer realizations of all modifications are compared. Numerical experiments are given where the LMI modifications are numerically compared. Based on the experiments the main conclusion is that the new LMI modification is faster than the standard LMI approach.

1. Introduction

In this paper we investigate general stochastic algebraic Riccati equations which are related to LQ control models for stochastic linear systems with multiplicative white noise and markovian jumping. We consider a stochastic system described by whereis a -dimensional standard Brownian motion withand, defined by a filtered probability space. In addition, , is a right continuous homogeneous Markov chain with the state space the setand the probability transition matrix, , andwith, , and if . It is assumed that the andare independent stochastic processes andfor all. The state vector is areal vector, denotes the vector of control variables, and is the regulated output vector with components. The matrix coefficients , , , are constant matrices of appropriate dimensions with real elements.

The stochastic systems with multiplicative white noise naturally arise in control problems of linear uncertain systems with stochastic uncertainty. It is important for applications to find a stabilizing controller for the above stochastic system (for more details see [1, 2]). For this purpose it is enough to compute the stabilizing solution to the following stochastic generalized Riccati algebraic equations:

The concepts of stabilizing solution of the Riccati-type equation (2) and of stabilizability for the triple, where as usual, are defined in a standard way (see [1]).

Applying Theorem 4.9 of Dragan and Morozan [2] we deduce that system (2) has a unique stabilizing solutionwith . The control stabilizes system (1). An e1ective iterative convergent algorithm to compute these stabilizing solutions is presented in [3].

Let us consider the special case of (1) where. The stochastic linear quadratic model studied by Yao et al. in [4] is obtained. In this model the special functionalis minimized (see equation from [4]). The matricesandare so-called cost weighting matrices. It is allowed that the cost weighting matrices for the state and the control are singular, that is, andare singular matrices. Such type models belong to a wide class of indefinite SLQ models. Applications of the indefinite LQ problems can be found in [5] for pollution control, [4, 69] in which problem appears in field of the mathematical finance. In this case the stochastic LQ problem can be solved via the following stochastic algebraic Riccati equation (the symmetric matrixbeing the unknown one):

The coefficient matrices of (5), , , , , andforare given ones of sizes,,,,, and, respectively, anddenotes the state matrix, andis the control matrix. For a deterministic case () it is assumed that the matrix is positive semidefinite andis a positive definite one.

Here the computation of stabilizing solution of system (1) is explicitly expressed in terms of the solutions of some linear matrix inequalities (LMI). The paper is devoted to the LMI approach and its modifications. The LMI approach is very important for the practice and real-world problems. Very often the LMI approach is an only method for solving a given class of problems. The application of the LMI approach to the solution of the optimal control problems is studied in [1014]. We introduce a modification set of nonlinear equations equivalent to (1) which lead us to the new convex optimization problems. The LMI approach applied to the new optimization problem gives a fast way to find the stabilizing solution to (1). We will compare the numerical effectiveness of the introduced LMI solvers. Numerical simulations are used to demonstrate the performance of the considered solvers.

The notations used in this note are standard. Here, (or); it is denoted thatis positive semidefinite (or positive definite) anddenotes the spectral matrix norm.

2. The LMI Approach to the Generalized Stochastic Riccati Equations

Rami and Zhou [15] have investigated the stochastic algebraic Riccati equation (5) in case, where the numerical method to compute the maximal solution to (5) withis derived. The method is based on the solution of a convex optimization problem over linear matrix inequalities. The LMI approach is considered as powerful tool in optimization. Further on, the authors in [4] have developed a computational approach to such SLQ modelsusing an LMI formulation. The LMI optimization is a successful method for solving (5) in this case. Although we cannot solve the stochastic algebraic Riccati equation we can still find the optimal control law via the LMI approach. It is well known [16] that if the stochastic system is stabilizable, in the mean square sense, the LMI optimization method always yields the maximal positive semidefinite solution to (5). The problem of stability and optimality of SLQ model (5) with(the case of one-dimensional Brownian motion) is treated by [7]. Moreover, this study is continued in terms of the multidimensional model () by [4]. The optimization problem associated with (5) is with respect to the variablewhich is a symmetric matrix.

Under notations the optimization problem associated with the set of equations (2) is

In this paper we investigate the numerical solvability of the semidefinite programming problem (8) for different types of matrices, . However, the numerical experiments for finding the maximal solution of (2) show that the LMI method (8) is slowly working for different types of matricesin the case . Here we introduce a new modification to accelerate the LMI method for solving the optimization problem (8). In many applications of control system theory the following fact is exploited. If any matrixis singular or zero and the matrixhas the full rank, then there exists a symmetric matrix such thatis a positive definite one. In our investigation the matriceshave the full rank. Thus, we replacein. It is obtained whereis the new unknown matrix. We apply this conclusion to set of equations (2). We construct the matricessuch that all matrices are positive definite ones for. Then, the following set of Riccati equations is obtained regarding : where Thus, the new optimization problem over LMI conditions related to (11) is derived:

Our experience on computations with LMI approach shows that there are examples where are not positive semidefinite, but the matricesare still positive definite. In this reason we can consider a practical implementation of (13) where the constrainis omitted. This leads us to the following problem:

3. Numerical Experiments

We carry out numerical simulations to present the numerical behaviour of introduced methods. In our experiments we apply three semidefinite programming problems (8), (13), and (14) for solving the stochastic algebraic Riccati equations (2). Our experiments are executed in MATLAB on an 2,16 GHz Intel(R) Dual CPU computer. The solutions of above optimization problems are obtained under the MATLAB lmi solvers which are executed with relative accuracy .

For all examples we taketo be diagonal matrices with entries. We have executed a set of examples with different values ofand constant weighting matrices. We compare all iterations introducing the following parameters: “m It”—the biggest number of iterations, “av It”— the average number of iterations. To determine the numbers “m It” and “av It” we count those examples of each size for which the corresponding iteration converges.

We consider a family of examples in case, , and , where the coefficient real matrices are given as follows:, , , , , , , were constructed using the MATLAB notations

In our definitions the functions randn(p,k) and rand(p,k) return a -by- matrix of pseudorandom scalar values (for more information see the MATLAB description). The following transition probability matrix (see [3]) is applied for all examples.

For our purpose we have executed hundred examples of each value of for the test. The maximal number of iterations “m It” and average number of iterations “av It” of each size for all examples needed for achieving the relative accuracy are reported in the table. There are three columns where the maximal errors and for each for the test are presented. Hereis a computed solution to (2) via (8), andis a computed solution to (11) via (13) and (14). In addition, the time of execution for each method in casesandis reported. Results from experiments are given in Table 1.

Table 1: Results from 100 runs for each value of . .

4. Conclusion

We have made numerical experiments for computing this solution, and we have compared the numerical results. Our numerical experiments confirm the effectiveness of the proposed new transformations which lead us to the equivalent semidefinite programming problem. We have compared the results from the experiments in regard to number of iterations and CPU time for executing the above optimization problems for, . The solution of the optimization problems achieves the same accuracy for different number of iterations. The executed examples have demonstrated that the LMI problem performances (8) and (13) require the same average numbers of iterations (see the corresponding columns “av It” for all tests). In addition, the LMI performance (14) requires less number of iterations than the remaining approaches, and it is faster than the others—see the CPU time for execution from Table 1. This property of (14) follows from the structure of problem (14)—there is one inequality less than (13). However, this property is not valid in all cases.


This research was financially supported in part by the Sofia University “St. Kl. Ohridski” under a project of the 2013 year.


  1. V. Dragan and T. Morozan, “Stability and robust stabilization to linear stochastic systems described by differential equations with Markovian jumping and multiplicative white noise,” Stochastic Analysis and Applications, vol. 20, no. 1, pp. 33–92, 2002. View at Publisher · View at Google Scholar · View at Scopus
  2. V. Dragan and T. Morozan, “Systems of matrix rational differential equations arising in connection with linear stochastic systems with markovian jumping,” Journal of Differential Equations, vol. 194, no. 1, pp. 1–38, 2003. View at Publisher · View at Google Scholar · View at Scopus
  3. V. Dragan, T. Morozan, and A. M. Stoica, “H2 optimal control for linear stochastic systems,” Automatica, vol. 40, no. 7, pp. 1103–1113, 2004. View at Publisher · View at Google Scholar · View at Scopus
  4. D. D. Yao, S. Zhang, and X. Y. Zhou, “Tracking a financial benchmark using a few assets,” Operations Research, vol. 54, no. 2, pp. 232–246, 2006. View at Publisher · View at Google Scholar · View at Scopus
  5. S. Chen, X. Li, and X. Y. Zhou, “Stochastic linear quadratic regulators with indefinite control weight costs,” SIAM Journal on Control and Optimization, vol. 36, no. 5, pp. 1685–1702, 1998. View at Google Scholar · View at Scopus
  6. X. Y. Zhou and D. Li, “Continuous-time mean-variance portfolio selection: a stochastic LQ framework,” Applied Mathematics and Optimization, vol. 42, no. 1, pp. 19–33, 2000. View at Publisher · View at Google Scholar · View at Scopus
  7. D. D. Yao, S. Zhang, and X. Y. Zhou, “Stochastic linear-quadratic control via semidefinite programming,” SIAM Journal on Control and Optimization, vol. 40, no. 3, pp. 801–823, 2001. View at Publisher · View at Google Scholar · View at Scopus
  8. O. L. V. Costa and W. L. de Paulo, “Indefinite quadratic with linear costs optimal control of Markov jump with multiplicative noise systems,” Automatica, vol. 43, no. 4, pp. 587–597, 2007. View at Publisher · View at Google Scholar · View at Scopus
  9. O. L. V. Costa and A. D. Oliveira, “Optimal mean-variance control for discrete-time linear systems with Markovian jumps and multiplicative noises,” Automatica, vol. 48, no. 2, pp. 304–315, 2012. View at Publisher · View at Google Scholar · View at Scopus
  10. M. A. Rami, X. Y. Zhou, and J. B. Moore, “Well-posedness and attainability of indefinite stochastic linear quadratic control in infinite time horizon,” Systems and Control Letters, vol. 41, no. 2, pp. 123–133, 2000. View at Google Scholar · View at Scopus
  11. X. Li, X. Y. Zhou, and M. A. Rami, “Indefinite stochastic linear quadratic control with Markovian jumps in infinite time horizon,” Journal of Global Optimization, vol. 27, no. 2-3, pp. 149–175, 2003. View at Publisher · View at Google Scholar · View at Scopus
  12. W. Xie, “An equivalent LMI representation of bounded real lemma for continuous-time systems,” Journal of Inequalities and Applications, vol. 2008, Article ID 672905, 2008. View at Publisher · View at Google Scholar · View at Scopus
  13. I. Ivanov and J. Dobreva, “An optimal solution to discrete-time stochastic models with economic applications,” in Proceedings of the 9th International Scientific Conference Management and Engineering, vol. 2, pp. 957–965, Bulgaria, 2011.
  14. I. Ivanov, “Accelerated LMI solvers for the maximal solution to a set of discrete-time algebraic Riccati equations,” Applied Mathematics E-Notes, vol. 12, pp. 228–238, 2012. View at Google Scholar
  15. M. A. Rami and X. Y. Zhou, “Linear matrix inequalities, Riccati equations, and indefinite stochastic linear quadratic controls,” IEEE Transactions on Automatic Control, vol. 45, no. 6, pp. 1131–1143, 2000. View at Google Scholar · View at Scopus
  16. M. A. Rami and L. El Ghaoui, “LMI optimization for nonstandard Riccati equations arising in stochastic control,” IEEE Transactions on Automatic Control, vol. 41, no. 11, pp. 1666–1671, 1996. View at Publisher · View at Google Scholar · View at Scopus