International Journal of Stochastic Analysis

Volume 2015 (2015), Article ID 231214, 9 pages

http://dx.doi.org/10.1155/2015/231214

## Asymptotic Stabilizability of a Class of Stochastic Nonlinear Hybrid Systems

Faculty of Mathematics and Natural Sciences, College of Sciences, Cardinal Stefan Wyszyński University in Warsaw, Dewajtis Street 5, 01-815 Warsaw, Poland

Received 23 August 2014; Accepted 7 January 2015

Academic Editor: Henri Schurz

Copyright © 2015 Ewelina Seroka. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

The problem of the asymptotic stabilizability in probability of a class of stochastic nonlinear control hybrid systems (with a linear dependence of the control) with state dependent, Markovian, and any switching rule is considered in the paper. To solve the issue, the Lyapunov technique, including a common, single, and multiple Lyapunov function, the hybrid control theory, and some results for stochastic nonhybrid systems are used. Sufficient conditions for the asymptotic stabilizability in probability for a considered class of hybrid systems are formulated. Also the stabilizing control in a feedback form is considered. Furthermore, in the case of hybrid systems with the state dependent switching rule, a method for a construction of stabilizing switching rules is proposed. Obtained results are illustrated by examples and numerical simulations.

#### 1. Introduction

In recent years there has been a growing interest in hybrid systems. At the same time one of the basic problems in the control theory is the problem of the stability and the stabilizability of dynamic systems. For this reason, in the paper we deal with the stabilizability problem of nonlinear stochastic hybrid systems.

It is known that, if a common Lyapunov function exists, then the hybrid system is stable for any switching [1, 2]. In the absence of the common Lyapunov function, stability properties of the hybrid system in general depend on the switching signal, and in this case the hybrid system is not stable for any switching rules, but only for the so-called stabilizing switching rules [1]. In this case more general single Lyapunov, multiple Lyapunov, and single Lyapunov-like functions have been introduced [1–5].

Stability problem for stochastic hybrid systems with any switching is considered in [2], for stochastic hybrid systems with state dependent switching in [6–8], and for stochastic hybrid systems with Markovian switching in [8–10]. Stabilization problem for hybrid systems is considered for Markovian switching rule in [11–14] and for state dependent switching rule in [4]. For more details concerning the stability and stabilization problem of hybrid systems, the author refers the reader to [15] and its references.

In the present paper ideas of a feedback control, proposed by Florchinger for nonhybrid stochastic nonlinear control systems [16], are used and combined with the concept of the hybrid control theory [1, 3, 6, 10] to derive results for the asymptotic stabilizability of stochastic nonlinear control hybrid systems (with a linear dependence of the control) described by Itô stochastic differential equations with any, state dependent, and Markovian switching rule. It is assumed that the trivial solution of unforced hybrid system is stable in probability (wherein some of subsystems of unforced hybrid systems can be unstable). By applying the obtained control the trivial solution of hybrid system becomes asymptotically stable in probability. To find sufficient conditions for the asymptotic stabilizability in probability of considered class of hybrid systems and to determine the control in the feedback form the Lyapunov function technique including common, single, and multiple Lyapunov function is applied. In the case of state dependent switching rules author proposes also a design method for stabilizing switching rules, which are based on the knowledge of regions of decreasing a Lyapunov function along solution.

This paper is divided into three sections and is organized as follows. In the first section we recall some basic definitions related to the issue of stability of stochastic systems and some stability results of hybrid systems. In the second section we present main results regarding the asymptotic stabilizability of stochastic nonlinear hybrid systems with any, state dependent, and Markovian switching rule. Also we give two examples to illustrate obtained stabilizability criteria. In the third section we summarize the obtained results.

#### 2. Mathematical Preliminaries

Throughout this paper we use the following notation. We mark . Let be a complete probability space with a filtration satisfying usual conditions. Let be the -dimensional standard Wiener process defined on the probability space . Let be the set of states and let be the switching rule. We assume that processes and are both adapted.

Let us consider a stochastic nonlinear hybrid system described by vector Itô differential equations as follows: where is the state vector, is an initial condition, and . Functions , , and , , , are continuous and locally Lipschitz and satisfy the following conditions:

We consider three types of the switching rules : Markovian, any, and state dependent switching rule.

Markovian switching is given by a right–continuous Markov chain defined on the probability space and taking values in a finite state space with a generator , that is, where , is the transition rate from to if , . We assume that the Markov chain is irreducible, that is, rank, and has a unique stationary distribution which can be determined by solving

In the case of Markovian switching rule we mean the switching rule with fixed and given matrix . To ensure the existence of the solution of the hybrid system (1) in the case of any switching rule we assume in addition that it is any Markovian switching rule that is with any matrix . In the further part of this paper we use the formulation “any switching rule,” when we mean that “any Markovian switching rule.” In the case of the state dependent switching rule we will assume that the switching times are stopping times.

We use the following definitions.

*Definition 1. *The null solution of the stochastic differential equation (1) is (1)stable in probability if
(2)asymptotically stable in probability if it is stable in probability and

*Definition 2. *We say that a continuous function is a Lyapunov function if (i);(ii) and ;(iii) is proper, that is, .

For any twice differentiable function (i.e., ) the th subsystem of the hybrid system (1) has a generator acting on (the Itô operator for the th subsystem of system (1)) defined for every subsystem by

The hybrid system for has a generator , , acting on any twice differentiable function in the following way:

Sufficient conditions for the asymptotic stability in probability of the null solution of the hybrid system (1) with Markovian switching rule in terms of the Lyapunov function are given by the following theorem.

Theorem 3 (see [10]). *Let be an open neighborhood of . Suppose that for each there exists a Lyapunov function such that
**
Then the null solution is (asymptotically) stable in probability.*

*Definition 4. *A Lyapunov function satisfying
is called a common Lyapunov function for the hybrid system (1).

Using Theorem 3 it is easy to conclude the following.

*Fact 1. *Note that it is a known fact that if there exists a common Lyapunov function for the hybrid system (1), then the null solution of (1) is asymptotically stable for any Markovian switching rule.

*Definition 5. *A Lyapunov function satisfying
for a switching rule is called a single Lyapunov function for the hybrid system (1).

*Fact 2 (see [6]). *Note that it is a known fact that if there exists a single Lyapunov function for the hybrid system (1) for a switching rule , then the null solution of (1) is asymptotically stable for the switching rule . Such switching rules are called stabilizing switching rules.

*Definition 6. *A family of Lyapunov functions , satisfying
is called a multiple Lyapunov function for the hybrid system (1).

Since we deal only with the stability problem of the null solution in the further part of this paper we use the formulation “system is stable,” when we mean that “the null solution of system is stable.”

#### 3. Stabilizability of Hybrid Systems

The aim of this paper is to establish sufficient conditions for the asymptotic stabilizability in probability for the stochastic nonlinear control hybrid system given by vector Itô differential equations as follows: where is the state vector, is the control vector, is an initial condition, and . Functions , , and , , , , are continuous and Lipschitz and satisfy the following conditions:

We use the following definition of the stabilizability.

*Definition 7. *The hybrid system (13) is said to be asymptotically stabilizable in probability, if there exists a switching signal and the associated feedback control law , such that the hybrid system (13) is asymptotically stable in probability.

Let us consider nonhybrid stochastic control nonlinear systems given by [16]:

We introduce the following notation. The second order differential operator (infinitesimal generator for the unforced stochastic differential system deduced from (15)) acting on any function and associated with this operator set The differential operator acting on any function and associated with this operator set

Then the following corollary can be formulated from theorem given by Florchinger in [16].

Corollary 8. *Assume that there exists a Lyapunov function such that *(i)*,*(ii)*. ** Then, the control law defined as follows:
**
stabilizes asymptotically in probability the stochastic control system (15).*

##### 3.1. Hybrid Systems with Markovian Switching Rule

Using Theorem of Khasminskii et al. [10] we can also formulate sufficient conditions for the asymptotic stabilizability in probability for a stochastic nonlinear control hybrid system with Markovian switching rule described by vector Itô differential equations as follows: where is the state vector, is the control vector, is an initial condition, and . Switching rule is given by Markovian switching rule described by (3). Functions , , and , , , , are continuous and Lipschitz and satisfy conditions (14).

Following the idea of Florchinger [16] we introduce the following notation. The second order differential operator (infinitesimal generator for the th subsystem of the unforced stochastic differential hybrid system with Markovian switching rule deduced from (21)) acting on any function and associated with this operator set The differential operator acting on any function and associated with this operator set where the superindex indicates the influence of the control coefficients .

The following theorem gives sufficient conditions for the asymptotic stabilizability in probability of the stochastic hybrid system (21).

Theorem 9. *Assume that there exist Lyapunov functions , , such that *(i)*,*(ii)*.** Then, the control law defined as follows:
**
stabilizes asymptotically in probability the stochastic control hybrid system (21).*

*Proof. *Using Assumption (i) we can conclude that the infinitesimal generator for the th subsystem of the hybrid system (21) can be estimated as follows:
Hence we can conclude that
and since condition (ii) is satisfied we obtain

Now the thesis follows from Theorem 3.

The family of Lyapunov functions satisfying (29) is called the multiple Lyapunov function for the hybrid system (21).

##### 3.2. Hybrid Systems with Any Switching Rule

Let us consider a stochastic nonlinear control hybrid system with any switching rule described by the following vector Itô differential equations: where is the state vector, is the control vector, is an initial condition, and . Switching rule is any Markovian switching rule. Functions , , and , , , , are continuous and Lipschitz and satisfy conditions (14).

Following the idea of Florchinger [16] we introduce the notation. The second order differential operator (infinitesimal generator for the th subsystem of the unforced stochastic differential hybrid system with any switching rule deduced from (30)) acting on any function and associated with this operator set The differential operator acting on any function and associated with this operator set

Using this notation we formulate the next theorem that gives sufficient conditions for the asymptotic stabilizability in probability of the stochastic hybrid system (30).

Theorem 10. *Assume that there exists a Lyapunov function such that *(i)(ii)*. ** Then, the control law defined as follows:
**
stabilizes asymptotically in probability the stochastic control hybrid system (30).*

*Proof. *Using Assumption (i) we can conclude that the infinitesimal generator for the th subsystem of the hybrid system (30) can be estimated as follows:
Hence we can conclude that
and since condition (ii) is satisfied we obtain

By means of equation (38) one can conclude that function is the common Lyapunov function for the hybrid system (30) and hence from Fact 1 it follows that the hybrid system (30) is asymptotically stable in probability under the control law given by (35).

*Remark 11. *Note that from condition (38) and assumption (iii) of Definition 2 it follows that every subsystem of hybrid system (30) with control is globally asymptotically stable in probability (see [17]) and hence the set of initial conditions from which stability of hybrid system (30) can be achieved (the so-called null controllable region) is the whole .

*Example 12 (stabilizability of hybrid systems with any switching rule). *Let us consider a particular case of hybrid system (30)
where , , , and function is given as follows:

We look for the feedback under which the hybrid system (39) is asymptotycally stable in probability for any switching. Let us choose the Lyapunov function as follows:
We obtain
We note that for and hence from Theorem 10 it follows that the hybrid system (39) is asymptotically stable in probability for any switching under the feedback control given as follows:
Note that function is a common Lyapunov function for the hybrid system (39).

An examplary simulation of a trajectory of the hybrid system (39) is shown in Figures 1 and 2.