`Mathematical Problems in EngineeringVolume 2011, Article ID 723509, 12 pageshttp://dx.doi.org/10.1155/2011/723509`
Research Article

## Common Lyapunov Function Based on Kullback–Leibler Divergence for a Switched Nonlinear System

1Graduate School of Health Sciences, The University of Tokushima, 3-18-15 Kuramoto, Tokushima 770-8509, Japan
2Institute of Health Biosciences, The University of Tokushima, 3-18-15 Kuramoto, Tokushima 770-8509, Japan

Received 21 December 2010; Revised 15 March 2011; Accepted 16 March 2011

Academic Editor: Jyh Horng Chou

Copyright © 2011 Omar M. Abou Al-Ola et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

Many problems with control theory have led to investigations into switched systems. One of the most urgent problems related to the analysis of the dynamics of switched systems is the stability problem. The stability of a switched system can be ensured by a common Lyapunov function for all switching modes under an arbitrary switching law. Finding a common Lyapunov function is still an interesting and challenging problem. The purpose of the present paper is to prove the stability of equilibrium in a certain class of nonlinear switched systems by introducing a common Lyapunov function; the Lyapunov function is based on generalized Kullback–Leibler divergence or Csiszár's I-divergence between the state and equilibrium. The switched system is useful for finding positive solutions to linear algebraic equations, which minimize the I-divergence measure under arbitrary switching. One application of the stability of a given switched system is in developing a new approach to reconstructing tomographic images, but nonetheless, the presented results can be used in numerous other areas.

#### 1. Introduction

A switched system is a dynamical system that consists of a finite number of subsystems and a logical rule that orchestrates switching between these subsystems. Mathematically, these subsystems are usually described by a collection of indexed differential or difference equations; one convenient way to classify switched systems is based on the dynamics of their subsystems, for example, continuous-time or discrete-time and linear or nonlinear. Switching events in switched systems can be classified into state-dependent versus time-dependent and autonomous versus controlled. For the moment, we will concern ourselves with controlled time-dependent switching. Given a family of functions from to , where is some index set. This gives rise to a family of systems: evolving on . The functions are assumed to be sufficiently regular. The easiest case to think about is when all these systems are linear and the index set is finite: . The switched system with time-dependent switching, generated by the above family, can be described by where the switching signal is a piecewise constant function that has a finite number of discontinuities, which we call the switching times, on every bounded time interval and takes a constant value on every interval between two consecutive switching times. The role of is to specify, at each time instant , the index of the active subsystem, that is, the system from the family in (1.1) that is currently being followed.

Stability analysis is a fundamental problem in the analysis and design of switched systems, and, during the past several years, several methods have been proposed to solve it. It is well known that a necessary condition for asymptotic stability under arbitrary (unconstrained) switching is that all of the individual subsystems are asymptotically stable. However, the above stability condition is not generally sufficient to guarantee asymptotic stability for the switched system under arbitrary switching. Standard Lyapunov theory for the stability of smooth systems, which requires the existence of a Lyapunov function satisfying, with its derivative, some inequalities [1, 2], has a direct extension for the stability of switched systems under arbitrary switching; this extension was obtained by requiring the existence of a common Lyapunov function for all individual subsystems corresponding to the system being considered, that is, the existence of a common Lyapunov function for all subsystems was shown to be a necessary and sufficient condition for a switched system to be asymptotically stable under arbitrary switching law (see [3, 4] and references therein). However, most results have been obtained for cases when switching occurs between linear subsystems, while the common Lyapunov function is set up in the quadratic form [3, 4]. For the nonlinear switched systems, some stability conditions were obtained in [3, 57]; however, it should be noted that so far there do not exist common methods of effectively developing the Lyapunov functions for nonlinear systems.

Most switched systems in practice, however, do not possess a common Lyapunov function, yet they may still be asymptotically stable under some properly chosen switching law. The multiple Lyapunov function technique is a powerful and effective tool for finding such a switching law or identifying a class of useful switching laws [3, 810]. The key point in these conditions of multiple Lyapunov function methods is the nonincreasing requirement on any Lyapunov function over the “switched on” time sequence of the corresponding subsystem; the Lyapunov functions in this case are called Lyapunov-like functions. However, this is usually difficult to check in its full generality. Thus, connecting adjacent Lyapunov functions at switching points is a commonly accepted strategy in applying the multiple Lyapunov function methods. To relax this nonincreasing requirement, the concept of generalized Lyapunov-like functions has been addressed , where a necessary and sufficient condition for the stability of switched systems in terms of generalized Lyapunov-like functions has been established; this condition tells us how much the corresponding general Lyapunov-like function is allowed to grow on the “switched on” time sequence without violating stability. We also do not need to worry about when and how each subsystem is activated for the first time with this condition. Given the importance of dissipativity concepts for smooth systems where the storage functions induced by dissipativity usually provide natural candidates for Lyapunov functions, a framework of dissipativity theory for switched systems using multiple storage functions and multiple supply rates was set up . Indeed, each subsystem in a switched system is associated with a storage function to describe the energy stored in the subsystem, and it is associated with a supply rate that represents the energy coming from outside the subsystem when the subsystem is active; the exchange of energy between the active subsystem and an inactive subsystem is characterized by cross-supply rates. The stability of the switched system was assured by dissipativity when all supply rates can be made negative, as long as the total exchanged energy between the active subsystem and any inactive subsystems is finite in some sense. Moreover, unlike multiple Lyapunov functions, where a nonincreasing condition on a “switched on” time sequence is a basic assumption even though the Lyapunov function is allowed to increase when the corresponding subsystem is inactive, storage functions are allowed to increase not only on time intervals when the corresponding subsystems are inactive but also on the “switched on” time sequence.

Tomography deals with the problem of determining the shape and dimensional information of an object from a set of projections and is concerned with the reconstruction of cross-sectional images, which permits the interiors of objects to be visualized. Computed tomography (CT)  is a method of medical imaging employing tomography created by computer processing; it is well known for delivering high-quality images from inside the human body and thus supports physicians in diagnosis. Problems with images reconstructed by a projection operator and from a projection data set generally become ill-posed . Many different reconstruction algorithms are used in medical practice to solve the inverse problem with image reconstruction.

We deal with analyzing the stability of a switched nonlinear system of the form in (1.2) in this study, where all individual subsystems, of the form in (1.1), will be stable, that is, a continuous system with switching signals under arbitrary switching. A common Lyapunov function, based on the generalized Kullback–Leibler divergence  or Csiszár’s -divergence [19, 20] measure between the state and the equilibrium, is set up. That Kullback–Leibler divergence can play the role of a common Lyapunov function for a class of switched nonlinear systems is demonstrated for the first time. A particular application of the stability of this switched system, which is to develop a novel approach to reconstructing tomographic images based on the idea of continuous dynamical methods, and an illustrative example are presented.

#### 2. Statement of the Problem

Systems of linear equations and matrix inversion play an important and motivating role in linear algebra. Such linear equations appear frequently in applied mathematics to model certain phenomena, for example, in computed tomography (CT) . Fundamentally, the problem is to obtain unknown variable , with denoting the set of nonnegative real numbers, satisfying where and . We say that the system is consistent if it has a locally unique solution . Equation (2.1) is an ill-posed problem for inconsistent cases, which means that its solution is not unique or does not exist . To find solution , we formulated a switched nonlinear system consisting of the family of subsystems [21, 22] or, equivalently, where indicates the diagonal matrix of order in which the diagonal entries starting in the upper left corner are the elements of , while and are, respectively, a submatrix consisting of partial rows of and a subvector of with the same corresponding rows of , for , with denoting the total number of divisions. Figures 1 and 2 present this formulation for case .

Figure 1: Illustration of the partitioning of and for .

Proposition 2.1. If one chooses positive initial value in the switched system in (2.2), then the solution is in for all , where represents the set of positive real numbers.

Proof. We proved in  that if we choose positive initial value in our continuous-time image reconstruction (CIR) system, then the corresponding solution will be in for all . Similarly, if we start from a positive initial value for each individual subsystem in (2.2), the corresponding trajectory will stay in . Consequently, if we choose a positive initial value for the first subsystem under arbitrary switching in the switched system described by (2.2), an end point of the corresponding trajectory, at a given time of switching, which is the initial point for the second subsystem, will be positive, and so on.

This behavior is illustrated in Figure 3, where we are switching between two subsystems on the line.

Proposition 2.2. Point satisfying (2.1) is a common equilibrium for all subsystems in (2.2).

Proof. Point satisfies (2.1) if and only if where and . Since the scalar multiplication defined for matrices having scalar elements also applies to partitioned matrices, then if and only if , , , which means that is a common equilibrium for all subsystems in (2.2) that satisfies for all . This similarly occurs for any submatrices consisting of partial rows of and the corresponding subvectors of .

According to Proposition 2.2, the common equilibria for all subsystems in the switched nonlinear system in (2.2) that satisfy for all are the solutions to the equation ; these equilibria are stable with respect to each subsystem by virtue of existing the Lyapunov functions:

Proposition 2.3. Consider the th subsystem in the switched system in (2.2) with initial value . If there exists locally unique equilibrium , then described by (2.5) decreases in .

Proof. We have with equality if . Its derivative along corresponding solution is given by where and . According to Proposition 2.1, the derivative of is negative semidefinite for and any . The can be a Lyapunov function on . Thus, exists such that as .

Proposition 2.4. The zero equilibrium of the switched system in (2.2) is locally unstable.

Proof. We rewrite the switched system in (2.2) as The derivative of with respect to is We can see that all eigenvalues of the derivative at the zero equilibrium are nonnegative for all .

#### 3. Stability via Common Lyapunov Function

This section addresses the main results where we construct a common Lyapunov function for all subsystems of the switched nonlinear system in (2.2), based on the generalized Kullback–Leibler divergence between the state and the equilibrium. This function will be positive definite and its derivatives, with respect to each subsystem, negative definite.

The generalized Kullback–Leibler divergence of two nonnegative vectors and is defined as The standard Kullback–Leibler divergence only consists of the first term and is only defined for probability distributions, that is, the sum of each vector is 1. The last two terms are necessary so that the generalized divergence has, for arbitrary nonnegative vectors and , the property of being nonnegative and zero exactly when and are equal. This divergence is called Csiszár's -divergence measure, which leads to effective methods of selection to solve optimization problems with nonnegativity constraints [19, 20]. The divergence for the and vectors of nonnegative real numbers is nonnegative with if and only if . Note that it suffices to prove this when and are scalars, because . Thus, we let and It is clear that is nonnegative and equal to zero if and only if .

Now, all the individual subsystems in (2.2) are asymptotically stable (Proposition 2.3). The existence of a common Lyapunov function for the family of subsystems in (2.2) guarantees stability in the corresponding switched system for arbitrary switching signals; for example, see .

Theorem 3.1. If the system is consistent, the switched nonlinear system corresponding to the family of systems in (2.2) is uniformly asymptotically stable.

Proof. Consider the following function, which is based on the generalized Kullback–Leibler divergence between the state and the equilibrium : which is positive definite. Using (2.3) to get its derivative, after some manipulations, in the form with equality if , for . Thus, all subsystem in the family in (2.2) share a common Lyapunov function given by (3.3), and, therefore, the corresponding switched system is uniformly asymptotically stable; the terminology uniform is employed here to indicate the uniformity with respect to the switching signals.

#### 4. Applications in Computed Tomography

This section presents a concise review from the field of computed tomography (CT), on the reason for which we have investigated the switched nonlinear system in (2.2) and its stability, as well as an illustrative example of a switched nonlinear system. Needless to say, the generality in (2.1) makes it possible to use the presented results on the switched nonlinear system in (2.2) in numerous other areas.

##### 4.1. Reason of Proposing Switching

The basic problem in CT is to calculate pixel values satisfying (2.1), where is the projection value, and is a normalized projection operator. To find solution , we proposed a novel approach to reconstructing tomographic images based on the idea of continuous dynamical methods; the method consists of a continuous-time image reconstruction (CIR) system described by the nonlinear continuous system: where the notations are as above. The main benefit of using the CIR system is that it easily allows theoretical analysis of the convergence and the stability of a solution .

We have extended our CIR method by introducing subsets of projections as in block iterative methods  to what is called a block CIR system [21, 22, 24]. The switched system with a piecewise smooth vector field, which describes our block CIR system, is given by (2.2). A convenient way of thinking about this formulation is facilitated from Figures 13, in the case of . According to the many simulations and numerical discussions we took part in, we noticed that our block CIR system could yield very good-quality image reconstructions; for example, see [21, 22, 24]. The goodness of our results from the block CIR approach tempts us to show that this approach works well theoretically, based on dynamical systems theory. We introduced an illustrative idea to search for a common Lyapunov function for all subsystems in our block CIR system (2.2) as a trial of showing its stability as a switched system; the idea was efficient in solving many practical problems . Because of this, the present paper introduces a common Lyapunov function, given by (3.3) that can be applied to all problems in our block CIR system that is described by (2.2).

##### 4.2. Example

Let us take a switched system having an explicit solution to illustrate the theoretical results. Consider matrix and vector as So, we study the switched nonlinear system in (2.2) with , which is defined by The solution to the first subsystem, consisting of (4.3) and (4.4), takes the form which is positive when we start from positive initial values and . The solution to the second subsystem, consisting of (4.5) and (4.6), takes the form which is positive when we start from positive initial values and . Thus in either subsystem if we start from a positive initial state, then the corresponding solution including a switching point to the other subsystem, will be positive. Hence, under arbitrary switching, if we choose a positive initial value for the first subsystem, an end point of the corresponding trajectory, at a given time of switching, which is the initial point for the second subsystem, will be positive and so the trajectory of the second subsystem will stay positive. We will switch to the first subsystem with a positive switching point at a given time. Repeating this procedure will generate a trajectory in of the corresponding switched system, which coincides with what we have already proved in the general case in Proposition 2.1.

The two subsystems have the point as a common equilibrium point (see Proposition 2.2). This point is stable for each of the two subsystems by virtue of existing two Lyapunov functions given by (2.5), with , which coincides with Proposition 2.3. The existence of the common Lyapunov function, for these two subsystems, given by (3.3), guarantees the stability of the corresponding switched system for arbitrary switching signals as mentioned in Theorem 3.1. Now, in case of in (4.2), we introduce two figures, the first one, Figure 4, shows the value of the common Lyapunov function given by (3.3), while the second one, Figure 5, shows a trajectory in the phase plane, with initial state , which approaches the common equilibrium point of the two subsystems .

Figure 4: Common Lyapunov function given by (3.3) for Section 4.2 (Example).
Figure 5: Trajectory in phase plane approaches the common equilibrium point for Section 4.2 (Example).

#### 5. Conclusion

In this work, to solve the linear system , we investigated a certain class of nonlinear switched systems, which we were interested in. Several basic properties of this nonlinear switched system were established. Since the construction of Lyapunov functions has always been a challenging task and an important problem in dynamical systems and control theory, we suggested a common Lyapunov function for the stability of an equilibrium in this switched nonlinear system, based on the generalized Kullback–Leibler divergence between the state and the equilibrium. To ensure practical relevance, the stability of the given switched system was used to develop a new approach to reconstructing tomographic images. However, the presented results can be used in numerous other areas, because of the frequent appearance of linear systems in applied mathematics used in modeling various phenomena.

#### Acknowledgment

This research is partially supported by Aihara Innovative Mathematical Modelling Project, the Japan Society for the Promotion of Science (JSPS) through its “Funding Program for World-Leading Innovative R&D on Science and Technology (FIRST Program).”

#### References

1. H. K. Khalil, Nonlinear Systems, Prentice Hall, Upper Saddle River, NJ, USA, 3rd edition, 2002.
2. A. M. Liapunov, Stability of Motion, Mathematics in Science and Engineering, Vol. 30, Academic Press, New York, NY, USA, 1966.
3. D. Liberzon, Switching in Systems and Control, Systems & Control: Foundations & Applications, Birkhäuser, Boston, Mass, USA, 2003.
4. H. Lin and P. J. Antsaklis, “Stability and stabilizability of switched linear systems: a survey of recent results,” IEEE Transactions on Automatic Control, vol. 54, no. 2, pp. 308–322, 2009.
5. A. Y. Aleksandrov and A. V. Platonov, “On absolute stability of one class of nonlinear switched systems,” Automation and Remote Control, vol. 69, no. 7, pp. 1101–1116, 2008.
6. J. L. Mancilla-Aguilar and R. A. García, “A converse Lyapunov theorem for nonlinear switched systems,” Systems & Control Letters, vol. 41, no. 1, pp. 67–71, 2000.
7. L. Vu and D. Liberzon, “Common Lyapunov functions for families of commuting nonlinear systems,” Systems & Control Letters, vol. 54, no. 5, pp. 405–416, 2005.
8. M. S. Branicky, “Multiple Lyapunov functions and other analysis tools for switched and hybrid systems,” IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 475–482, 1998.
9. N. H. El-Farra, P. Mhaskar, and P. D. Christofides, “Output feedback control of switched nonlinear systems using multiple Lyapunov functions,” Systems & Control Letters, vol. 54, no. 12, pp. 1163–1182, 2005.
10. H. Ye, A. N. Michel, and L. Hou, “Stability theory for hybrid dynamical systems,” IEEE Transactions on Automatic Control, vol. 43, no. 4, pp. 461–474, 1998.
11. J. Zhao and D. J. Hill, “On stability, L2-gain and H control for switched systems,” Automatica, vol. 44, no. 5, pp. 1220–1232, 2008.
12. J. Zhao and D. J. Hill, “Dissipativity theory for switched systems,” IEEE Transactions on Automatic Control, vol. 53, no. 4, pp. 941–953, 2008.
13. R. Gordon, R. Bender, and G. T. Herman, “Algebraic Reconstruction Techniques (ART) for three-dimensional electron microscopy and X-ray photography,” Journal of Theoretical Biology, vol. 29, no. 3, pp. 471–481, 1970.
14. A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging, IEEE Press, New York, NY, USA, 1988.
15. L. A. Shepp and Y. Vardi, “Maximum likelihood reconstruction for emission tomography,” IEEE Transactions on Medical Imaging, vol. 1, no. 2, pp. 113–122, 1982.
16. H. Stark, Ed., Image Recovery: Theory and Applications, Academic Press Inc., Orlando, FL, 1987.
17. J. Hadamard, Sur les problèmes aux dérivées partielles et leur signification physique, Princeton University Bulletin, Princeton University, 1902.
18. S. Kullback and R. A. Leibler, “On information and sufficiency,” Annals of Mathematical Statistics, vol. 22, pp. 79–86, 1951.
19. I. Csiszár, “Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems,” The Annals of Statistics, vol. 19, no. 4, pp. 2032–2066, 1991.
20. D. L. Snyder, T. J. Schulz, and J. A. O'Sullivan, “Deblurring subject to nonnegativity constraints,” IEEE Transactions on Signal Processing, vol. 40, no. 5, pp. 1143–1150, 1992.
21. O. M. Abou Al-Ola, K. Fujimoto, and T. Yoshinaga, “Block continuous-time image reconstruction for computed tomography,” Far East Journal of Dynamical Systems, vol. 14, no. 1, pp. 51–70, 2010.
22. K. Fujimoto, O. A. Al-Ola, and T. Yoshinaga, “Continuous-time image reconstruction using differential equations for computed tomography,” Communications in Nonlinear Science and Numerical Simulation, vol. 15, no. 6, pp. 1648–1654, 2010.
23. C. L. Byrne, “Block-iterative methods for image reconstruction from projections,” IEEE Transactions on Image Processing, vol. 5, no. 5, pp. 792–794, 1996.
24. C. Ueda, O. M. Abou Al-Ola, K. Fujimoto, and T. Yoshinaga, “Iterative method based on discretization of continuous-time image reconstruction for computed tomography,” Journal of Signal Processing, vol. 14, no. 4, pp. 293–296, 2010.