Research Article | Open Access

Yong Lin, Qing-Wen Wang, "Iterative Solution to a System of Matrix Equations", *Abstract and Applied Analysis*, vol. 2013, Article ID 124979, 7 pages, 2013. https://doi.org/10.1155/2013/124979

# Iterative Solution to a System of Matrix Equations

**Academic Editor:**Masoud Hajarian

#### Abstract

An efficient iterative algorithm is presented to solve a system of linear matrix equations , with real matrices and . By this iterative algorithm, the solvability of the system can be determined automatically. When the system is consistent, for any initial matrices and , a solution can be obtained in the absence of roundoff errors, and the least norm solution can be obtained by choosing a special kind of initial matrix. In addition, the unique optimal approximation solutions and to the given matrices and in Frobenius norm can be obtained by finding the least norm solution of a new pair of matrix equations , where , . The given numerical example demonstrates that the iterative algorithm is efficient. Especially, when the numbers of the parameter matrices are large, our algorithm is efficient as well.

#### 1. Introduction

Throughout the paper, we denote the set of all real matrix by , the transpose matrix of by , the identity matrix of order by , the Kronecker product of and by , the vector formed by the vertical concatenation of the respective columns of a matrix by , the trace of a matrix by , and the Frobenius norm of a matrix by where .

In this paper, we consider the following two problems.

*Problem 1. *For the given matrices , , , , , , , , , and , find and such that

*Problem 2. *When Problem 1 is consistent, let denote the solution set of the pair of matrix equation (1). For the given matrices , , find such that

Problem 2 is to find the optimal approximation solutions to the given matrices in the solution set of Problem 1. It occurs frequently in experiment design (see, for instance, [1]). In the recent years, the matrix optimal approximation problem has been studied extensively (e.g., [2–13]).

The research on solving matrix equation pair has been actively ongoing for the last 30 years or more. For instance, Mitra [14] gave conditions for the existence of a solution and a representation of the general common solution to , . Shinozaki and Sibuya [15] and van der Woude [16] discussed conditions for the existence of a common solution to , . Navarra et al. [5] derived sufficient and necessary conditions for the existence of a common solution to , . Yuan [13] obtained an analytical expression of the least-squares solutions of , by using the generalized singular value decomposition (GSVD) of matrices. Dehghan and Hajarian [17] presented some examples to show a motivation for studying the general coupled matrix equations , , and [18] constructed an iterative algorithm to solve the general coupled matrix equations , . Wang [19, 20] gave the centrosymmetric solution to the system of quaternion matrix equations , . Wang [21] also solved a system of matrix equations over arbitrary regular rings with identity.

Recently, some finite iterative algorithms have also been developed to solve matrix equations. Ding et al. [22, 23] and Xie et al. [24, 25] studied the iterative solutions of matrix equations and and generalized Sylvester matrix equations and . They presented a gradient based and a least-squares based iterative algorithms for the solution. Li et al. [26, 27] and Zhou et al. [28, 29] considered iterative method for some coupled linear matrix equations. Deng et al. [30] studied the consistent conditions and the general expressions about the Hermitian solutions of the matrix equations and designed an iterative method for its Hermitian minimum norm solutions. Li and Wu [31] gave symmetric and skew-antisymmetric solutions to certain matrix equations , over the real quaternion algebra H. For more studies on iterative algorithms on coupled matrix equations, we refer to [3, 10–12, 17, 32–37]. Peng et al. [6] presented iterative methods to obtain the symmetric solutions of , . Sheng and Chen [8] presented a finite iterative method; when , is consistent. Liao and Lei [38] presented an analytical expression of the least-squares solution and an algorithm for , with the minimum norm. Peng et al. [7] presented an algorithm for the least-squares reflexive solution. Dehghan and Hajarian [2] presented an iterative algorithm for solving a pair of matrix equations , over generalized centrosymmetric matrices. Cai and Chen [39] presented an iterative algorithm for the least-squares bisymmetric solutions of the matrix equations , . Yin and Huang [40] presented an iterative algorithm to solve the least squares generalized reflexive solutions of the matrix equations , .

However, to our knowledge, there has been little information on finding the solutions to the system (1) by iterative algorithm. In this paper, an efficient iterative algorithm is presented to solve the system (1) for any real matrices . The suggested iterative algorithm, automatically determines the solvability of equations pair (1). When the pair of equations is consistent, then, for any initial matrices and , the solution can be obtained in the absence of round errors, and the least norm solution can be obtained by choosing a special kind of initial matrix. In addition, the unique optimal approximation solutions and to the given matrices and in Frobenius norm can be obtained by finding the least norm solution of a new pair of matrix equations , , where , . The given numerical examples demonstrate that our iterative algorithm is efficient. Especially, when the numbers of the parameter matrices are large, our algorithm is efficient as well while the algorithm of [32] is not convergent. That is, our algorithm has merits of good numerical stability and ease to program.

The rest of this paper is outlined as follows. In Section 2, we first propose an efficient iterative algorithm for solving Problem 1; then we give some properties of this iterative algorithm. We show that the algorithm can obtain a solution group (the least Frobenius norm solution group) for any (special) initial matrix group in the absence of roundoff errors. In Section 3, a numerical example is given to illustrate that our algorithm is quite efficient.

#### 2. Iterative Algorithm for Solving Problems 1 and 2

In this section, we present the iterative algorithm for the consistence of the system (1).

*Algorithm 3. *(1) Input matrices , , , , , , , , , , , and (where , are any initial matrices).

(2) Calculate

(3) If (), then stop. Otherwise,

(4) Calculate
Go to (3).

Lemma 4. *In Algorithm 3, the choice of makes reach a minimum and and orthogonal to each other.*

*Proof. *From Algorithm 3, we have
From the above, the condition of reaching a minimum is

On the other hand, if the choice of makes and orthogonal to each other, that is, , we can have the same as (7).

Theorem 5. *Algorithm 3 is bound to be convergent. *

*Proof. *From Algorithm 3 and Lemma 4 we have
such that
From (9), we know that Algorithm 3 is convergent.

Lemma 6 (see [41]). *Suppose that the consistent system of linear equations has a solution ; then is the least Frobenius norm solution of the system of linear equations.*

Theorem 7. *Assume that the system (1) is consistent. Let , be initial matrices where , are any initial matrices, or, especially, , ; then the solution generated by Algorithm 3 is the least Frobenius norm solution to (1). *

*Proof. *If (1) is consistent, from , , using Algorithm 3, we have the iterative solution pair of (1) as the following:

We know that (1) is equivalent to the system
From (10) and (11) we have
where is the column space of matrix *.

Considering Lemma 6, with the initial matrices , , where , are arbitrary, or, especially, and , then the solution pair generated by Algorithm 3 is the least Frobenius norm solution of the matrix equations (1).

Suppose that Problem 1 is consistent. Obviously the solution set of (1) is nonempty. For given matrices pair , , we can write Let , , , and . Then Problem 2 is equivalent to find the least Frobenius norm solution pair of the system which can be obtained using Algorithm 3 with the initial matrix pair , where and are arbitrary, or especially, , , and the solution of the matrix optimal approximation Problem 2 can be represented as , .

#### 3. An Example

In this section, we show a numerical example to illustrate the efficiency of Algorithm 3. All computations are performed by MATLAB 7. For the influence of the error of calculation, we consider the matrix as a zero matrix if .

*Example 1. *Consider the solution of the linear matrix equations
where

In this example, the numbers of the parameter matrices are larger than the numbers of the parameter matrices in the example of [32]. It can be verified that these matrix equations are consistent and have the solution as

Let

(1) Using Algorithm 3 and iterate 10309 steps, we obtain the least Frobenius norm solution pair of the matrix equation in Example 1 as follows: The obtained sequence are presented in Figure 1.

(2) Using the algorithm of [32], to this example, the iteration is not convergent. The obtained result is presented in Figure 2.

This numerical example demonstrates that our algorithm has merits of good numerical stability and ease to program.

#### Acknowledgments

This research was supported by the Grants from the Key Project of Scientific Research Innovation Foundation of Shanghai Municipal Education Commission (13ZZ080), the National Natural Science Foundation of China (11171205), the Natural Science Foundation of Shanghai (11ZR1412500), and the Nature Science Foundation of Anhui Provincial Education (ky2008b253, KJ2013A248).

#### References

- T. Meng, “Experimental design and decision support, in expert systems,” in
*The Technology of Knowledge Management and Decision Making for the 21st Century*, C. Leondes, Ed., vol. 1, Academic Press, New York, NY, USA, 2001. View at: Google Scholar - M. Dehghan and M. Hajarian, “An iterative algorithm for solving a pair of matrix equations $AYB=E$, $CYD=F$ over generalized centro-symmetric matrices,”
*Computers & Mathematics with Applications*, vol. 56, no. 12, pp. 3246–3260, 2008. View at: Publisher Site | Google Scholar | MathSciNet - M. Dehghan and M. Hajarian, “An iterative algorithm for the reflexive solutions of the generalized coupled Sylvester matrix equations and its optimal approximation,”
*Applied Mathematics and Computation*, vol. 202, no. 2, pp. 571–588, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A. L. Andrew, “Solution of equations involving centrosymmetric matrices,”
*Technometrics*, vol. 15, no. 2, pp. 405–407, 1973. View at: Google Scholar - A. Navarra, P. L. Odell, and D. M. Young, “A representation of the general common solution to the matrix equations ${A}_{1}X{B}_{1}={C}_{1}$ and ${A}_{2}X{B}_{2}={C}_{2}$ with applications,”
*Computers & Mathematics with Applications*, vol. 41, no. 7-8, pp. 929–935, 2001. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-X. Peng, X.-Y. Hu, and L. Zhang, “An iterative method for symmetric solutions and optimal approximation solution of the system of matrix equations ${A}_{1}X{B}_{1}={C}_{1}$, ${A}_{2}X{B}_{2}={C}_{2}$,”
*Applied Mathematics and Computation*, vol. 183, no. 2, pp. 1127–1137, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Z.-H. Peng, X.-Y. Hu, and L. Zhang, “An efficient algorithm for the least-squares reflexive solution of the matrix equation ${A}_{1}X{B}_{1}={C}_{1};{A}_{2}X{B}_{2}={C}_{2}$,”
*Applied Mathematics and Computation*, vol. 181, no. 2, pp. 988–999, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - X. Sheng and G. Chen, “A finite iterative method for solving a pair of linear matrix equations $(AXB,CXD)=(E,F)$,”
*Applied Mathematics and Computation*, vol. 189, no. 2, pp. 1350–1358, 2007. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - N. Li and Q. W. Wang, “Iterative algorithm for solving a class of quaternion matrix equation over the generalized $(P,Q)$-reflexive matrices,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 831656, 15 pages, 2013. View at: Publisher Site | Google Scholar - A.-G. Wu, G. Feng, G.-R. Duan, and W.-J. Wu, “Finite iterative solutions to a class of complex matrix equations with conjugate and transpose of the unknowns,”
*Mathematical and Computer Modelling*, vol. 52, no. 9-10, pp. 1463–1478, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A.-G. Wu, G. Feng, G.-R. Duan, and W.-J. Wu, “Iterative solutions to coupled Sylvester-conjugate matrix equations,”
*Computers & Mathematics with Applications*, vol. 60, no. 1, pp. 54–66, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - A.-G. Wu, B. Li, Y. Zhang, and G.-R. Duan, “Finite iterative solutions to coupled Sylvester-conjugate matrix equations,”
*Applied Mathematical Modelling*, vol. 35, no. 3, pp. 1065–1080, 2011. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-X. Yuan, “On the minimum norm solution of matrix equation $AXB=E;CXD=F$,”
*Journal of East China Shipbuilding Institute*, vol. 15, no. 3, pp. 34–37, 2001. View at: Google Scholar - S. K. Mitra, “Common solutions to a pair of linear matrix equations ${A}_{1}X{B}_{1}={C}_{1}$ and ${A}_{2}X{B}_{2}={C}_{2}$,” vol. 74, pp. 213–216, 1973. View at: Google Scholar | Zentralblatt MATH | MathSciNet
- N. Shinozaki and M. Sibuya, “Consistency of a pair of matrix equations with an application,”
*Keio Science and Technology Reports*, vol. 27, no. 10, pp. 141–146, 1975. View at: Google Scholar | MathSciNet - J. W. van der Woude,
*Freeback decoupling and stabilization for linear systems with multiple exogenous variables [Ph.D. thesis]*, Technical University of Eindhoven, Eindhoven, The Netherlands, 1987. - M. Dehghan and M. Hajarian, “The general coupled matrix equations over generalized bisymmetric matrices,”
*Linear Algebra and Its Applications*, vol. 432, no. 6, pp. 1531–1552, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - M. Dehghan and M. Hajarian, “The reflexive and anti-reflexive solutions of a linear matrix equation and systems of matrix equations,”
*The Rocky Mountain Journal of Mathematics*, vol. 40, no. 3, pp. 825–848, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q.-W. Wang, J.-H. Sun, and S.-Z. Li, “Consistency for bi(skew)symmetric solutions to systems of generalized Sylvester equations over a finite central algebra,”
*Linear Algebra and Its Applications*, vol. 353, pp. 169–182, 2002. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q.-W. Wang, “Bisymmetric and centrosymmetric solutions to systems of real quaternion matrix equations,”
*Computers & Mathematics with Applications*, vol. 49, no. 5-6, pp. 641–650, 2005. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Q.-W. Wang, “A system of matrix equations and a linear matrix equation over arbitrary regular rings with identity,”
*Linear Algebra and Its Applications*, vol. 384, pp. 43–54, 2004. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - F. Ding, P. X. Liu, and J. Ding, “Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle,”
*Applied Mathematics and Computation*, vol. 197, no. 1, pp. 41–50, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - J. Ding, Y. Liu, and F. Ding, “Iterative solutions to matrix equations of the form ${A}_{i}X{B}_{i}={F}_{i}$,”
*Computers & Mathematics with Applications*, vol. 59, no. 11, pp. 3500–3507, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Xie, J. Ding, and F. Ding, “Gradient based iterative solutions for general linear matrix equations,”
*Computers & Mathematics with Applications*, vol. 58, no. 7, pp. 1441–1448, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - L. Xie, Y. Liu, and H. Yang, “Gradient based and least squares based iterative algorithms for matrix equations $AXB+C{X}^{T}D=F$,”
*Applied Mathematics and Computation*, vol. 217, no. 5, pp. 2191–2199, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Z.-Y. Li, Y. Wang, B. Zhou, and G.-R. Duan, “Least squares solution with the minimum-norm to general matrix equations via iteration,”
*Applied Mathematics and Computation*, vol. 215, no. 10, pp. 3547–3562, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Z.-Y. Li, B. Zhou, Y. Wang, and G.-R. Duan, “Numerical solution to linear matrix equation by finite steps iteration,”
*IET Control Theory & Applications*, vol. 4, no. 7, pp. 1245–1253, 2010. View at: Publisher Site | Google Scholar | MathSciNet - B. Zhou, J. Lam, and G.-R. Duan, “On Smith-type iterative algorithms for the Stein matrix equation,”
*Applied Mathematics Letters*, vol. 22, no. 7, pp. 1038–1044, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - B. Zhou, J. Lam, and G.-R. Duan, “Gradient-based maximal convergence rate iterative method for solving linear matrix equations,”
*International Journal of Computer Mathematics*, vol. 87, no. 1–3, pp. 515–527, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-B. Deng, Z.-Z. Bai, and Y.-H. Gao, “Iterative orthogonal direction methods for Hermitian minimum norm solutions of two consistent matrix equations,”
*Numerical Linear Algebra with Applications*, vol. 13, no. 10, pp. 801–823, 2006. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-T. Li and W.-J. Wu, “Symmetric and skew-antisymmetric solutions to systems of real quaternion matrix equations,”
*Computers & Mathematics with Applications*, vol. 55, no. 6, pp. 1142–1147, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - M. Dehghan and M. Hajarian, “An efficient algorithm for solving general coupled matrix equations and its application,”
*Mathematical and Computer Modelling*, vol. 51, no. 9-10, pp. 1118–1134, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - M. Dehghan and M. Hajarian, “On the reflexive and anti-reflexive solutions of the generalised coupled Sylvester matrix equations,”
*International Journal of Systems Science*, vol. 41, no. 6, pp. 607–625, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - B. Zhou, Z.-Y. Li, G.-R. Duan, and Y. Wang, “Weighted least squares solutions to general coupled Sylvester matrix equations,”
*Journal of Computational and Applied Mathematics*, vol. 224, no. 2, pp. 759–776, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - I. Jonsson and B. Kågström, “Recursive blocked algorithm for solving triangular systems. I. One-sided and coupled Sylvester-type matrix equations,”
*ACM Transactions on Mathematical Software*, vol. 28, no. 4, pp. 392–415, 2002. View at: Publisher Site | Google Scholar | MathSciNet - B. Zhou, G.-R. Duan, and Z.-Y. Li, “Gradient based iterative algorithm for solving coupled matrix equations,”
*Systems & Control Letters*, vol. 58, no. 5, pp. 327–333, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - I. Jonsson and B. Kågström, “Recursive blocked algorithm for solving triangular systems. II. Two-sided and generalized Sylvester and Lyapunov matrix equations,”
*ACM Transactions on Mathematical Software*, vol. 28, no. 4, pp. 416–435, 2002. View at: Publisher Site | Google Scholar | MathSciNet - A.-P. Liao and Y. Lei, “Least-squares solution with the minimum-norm for the matrix equation $(AXB,GXH)=(C,D)$,”
*Computers & Mathematics with Applications*, vol. 50, no. 3-4, pp. 539–549, 2005. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - J. Cai and G. Chen, “An iterative algorithm for the least squares bisymmetric solutions of the matrix equations ${A}_{1}X{B}_{1}={C}_{1},{A}_{2}X{B}_{2}={C}_{2}$,”
*Mathematical and Computer Modelling*, vol. 50, no. 7-8, pp. 1237–1244, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - F. Yin and G.-X. Huang, “An iterative algorithm for the least squares generalized reflexive solutions of the matrix equations $AXB=E;CXD=F$,”
*Abstract and Applied Analysis*, vol. 2012, Article ID 857284, 18 pages, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - Y.-X. Peng, X.-Y. Hu, and L. Zhang, “An iteration method for the symmetric solutions and the optimal approximation solution of the matrix equation $AXB=C$,”
*Applied Mathematics and Computation*, vol. 160, no. 3, pp. 763–777, 2005. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet

#### Copyright

Copyright © 2013 Yong Lin and Qing-Wen Wang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.