Research Article | Open Access

Amogh Deshpande, "Asymptotic Stability of Semi-Markov Modulated Jump Diffusions", *International Journal of Stochastic Analysis*, vol. 2012, Article ID 185474, 17 pages, 2012. https://doi.org/10.1155/2012/185474

# Asymptotic Stability of Semi-Markov Modulated Jump Diffusions

**Academic Editor:**Lukasz Stettner

#### Abstract

We consider the class of semi-Markov modulated jump diffusions (sMMJDs) whose operator turns out to be an integro-partial differential operator. We find conditions under which the solutions of this class of switching jump-diffusion processes are almost surely exponentially stable and moment exponentially stable. We also provide conditions that imply almost sure convergence of the trivial solution when the moment exponential stability of the trivial solution is guaranteed. We further investigate and determine the conditions under which the trivial solution of the sMMJD-perturbed nonlinear system of differential equations is almost surely exponentially stable. It is observed that for a one-dimensional state space, a linear unstable system of differential equations when stabilized just by the addition of the jump part of an sMMJD process does not get destabilized by any addition of a Brownian motion. However, in a state space of dimension at least two, we show that a corresponding nonlinear system of differential equations stabilized by jumps gets destabilized by addition of Brownian motion.

#### 1. Introduction

The stability of stochastic differential equations (SDEs) has a long history with some key works being those of Arnold [1], Khasminskii [2], and Ladde and Lakshmikantham [3]. SDEs with switching have been applied in diverse areas such as finance (Deshpande and Ghosh [4]) and biology (Hanson [5]). On the same note, the stability of these processes has been much studied, in particular by Ji and Chizeck [6] and Mariton [7], who both studied the stability of a jump-linear system of the form , where is a Markov chain. Basak et al. [8] discussed the stability of a semilinear SDE with Markovian-regime switching of the form . Mao [9] studied the exponential stability of a general nonlinear diffusion with Markovian switching of the form . Yin and Xi [10] studied the stability of Markov-modulated jump-diffusion processes (MMJDs).

Consider the following jump-diffusion equation in which the coefficients are modulated by an underlying semi-Markov process: where takes values in and is a finite-state semi-Markov process taking values in . Let be a subset of ; it is the range space of impulsive jumps. For any set in , counts the number of jumps on with values in and is independent of the Brownian motion , . For future use we define the compensated Poisson measure , where is the jump distribution and is the jump rate. Equation (1.1) can be regarded as the result of the following equations: which switch from one state to another according to the underlying movement of the semi-Markov process.

Unlike the special Markov-modulated case in which the -dependent diffusion is a partial differential operator, the semi-Markov case is characterized by an integro-partial differential operator. In this paper we study the asymptotic stability of sMMJDs. We also investigate the perturbation of the nonlinear differential equation by an sMMJD. We determine the conditions under which the perturbed system is almost surely exponentially stable. We show that for a one-dimensional state space, the deterministic linear unstable system of differential equations that can be stabilized by the addition of a jump component of the process , surprisingly can never be destabilized by an addition of a Brownian motion. An interesting question we may ask here is, can the similar inference hold true for in higher dimension? The answer is surprisingly *no*. We show that for a state space with dimension greater than or equal to 2, a corresponding nonlinear system that is stabilized by the jump component of the process can in fact be destabilized by addition of the Brownian motion part. We organize the paper as follows.

In Section 2, we briefly establish a representation of a class of semi-Markov processes as a stochastic integral with respect to a Poisson random measure. We define the concepts of almost sure exponential stability and moment exponential stability. In Section 3, we present conditions that guarantee almost sure exponential stability and moment exponential stability of the trivial solution of (1.1). In general, there is no connection between these two stability criteria. However, under additional conditions one can say when does the moment exponential stability guarantees or implies almost sure exponential stability. We elaborate on this aspect while concluding this section. In Section 4, we provide some examples to illustrate these two stability criterion in our context. In Section 5, we investigate the conditions for which a nonlinear system of differential equation of the type is almost surely exponentially stable. We then investigate its behavior in higher-dimensional state space, as mentioned earlier. The paper ends with concluding remarks.

#### 2. Preliminaries

We assume that the probability space () is complete with filtration and is right-continuous and contains all null sets. If is some vector, then is its Euclidean norm and is its transpose, while if is a matrix then its trace norm is denoted as . stands for positive part of the real line while is a positive integer. Let denote the family of all functions on , which are twice continuously differentiable in and continuously differentiable in . Consider as a semi-Markov process taking values in with transition probability and conditional holding time distribution . Thus if are times when jumps occur, then Matrix is irreducible and for each , has continuously differentiable and bounded density . Embed in by identifying with . For , let Let the stationary distribution of the semi-Markov process be defined as where takes value 1 if and 0 otherwise for any .

For , , let be consecutive (with respect to lexicographic ordering on ) left-closed, right-open intervals of the real line, each having length . Define the functions and by

Let be the set of all nonnegative integer-valued -finite measures on a Borel -field of (). Define the process described by the following stochastic integral equations: where is an ()-valued Poisson random measure with intensity independent of the -valued random variable , where is a Lebesgue measure on . We define the corresponding compensated or centred Poisson measure as . It was shown in Theorem 2.1 of Ghosh and Goswami [11] that is a semi-Markov process with transition probability matrix with conditional holding time distributions . Therefore, one can write . We assume that , and defined on () are independent.

To ensure that zero is the only equilibrium point of (1.1), we need the following assumption.

*Assumption 2.1. *Assume is -measurable and that constants exist such that for each being -valued and for each we have
We also need the condition that the generator matrix is bounded and continuous. , and and for each , and each .

The process () defined on () in (1.1) and (2.4) is jointly Markov and has a generator given as follows. For , we have where is an matrix and is the element of the matrix while is the element of the vector .

We define the jump times, that is, time epochs when jumps occur by , where , to be the enumeration of all elements in the domain of the point process corresponding to the stationary -Poisson point process . It is easy to see that is an -stopping time for each . Moreover, we have since the characteristic measure is finite. Next, let us denote the successive switching instants of the second component, which is the semi-Markov process that switches from one point on the space to another and is denoted by . Since the Poisson random measure is independent of , one could adapt the proof of Xi ([12]) to show that with probability 1, and are mutually disjoint. Hence between two chain-switching epochs, the process behaves like an ordinary jump-diffusion process without switching, a fact that we will use below to show the existence and uniqueness of the sMMJD process . Accordingly, we describe next the existence-uniqueness theorem for (1.1).

Theorem 2.2. *Assume that Assumption 2.1 holds. Then there exists a unique solution with initial data to (1.1).*

*Proof. *We only provide a sketch of the proof here. Consider . Then as described above, on each of the intervals between the chain switching times, that is, , the sMMJD process behaves like a jump-diffusion process. We can then use the standard Picard iteration argument in Applebaum [13] to show the existence-uniqueness of solution .

Before we proceed with our main analysis concerning these two stability issues we introduce a key Lemma.

Lemma 2.3. * for any , and . Thus almost all sample paths of any solutions of (1.1) starting from a nonzero state will never reach the origin.*

*Proof. *We show this in a simple way. From the condition on the coefficients, , and . So (1.1) admits a trivial solution . From Theorem 2.2 above, due to the uniqueness of the solution of (1.1) the conclusion now follows.

We next have the following generalized Ito’s formula.

Lemma 2.4. *Utilizing the operator in (2.1), the generalized Ito’s formula is given by
**
where the local martingale terms are explicitly defined as
*

*Proof. *For details refer to Ikeda and Watanabe [14].

We now discuss the two criteria for stochastic stability that we intend to consider.

*Definition 2.5 (Almost sure exponential stability). *The trivial solution of (1.1) is almost surely exponentially stable if
The quantity on the left-hand side of the above equation is termed as the sample Lyapunov exponent.

*Definition 2.6 (Moment exponential stability). *Let . The trivial solution of (1.1) is said to be moment exponentially stable if there exists a pair of constants and , such that for any

In the next section, we detail the proofs for obtaining the conditions under which the trivial solution of (1.1) is almost surely exponentially stable and moment exponentially stable.

#### 3. Almost Sure Stability and Moment Exponential Stability

In the sequel we will always, as standing hypotheses, assume that Assumption 2.1 holds. From Theorem 2.2 we deduce that there exists a unique solution to (1.1). By Lemma 2.3, we know that will never reach zero whenever . So in what follows we will only need a function defined on the domain of the deleted neighborhood of zero. Our first main result provides conditions under which the trivial solution to (1.1) is almost surely exponentially stable.

Theorem 3.1. *Assume that there exist a function in any deleted neighborhood of zero. Moreover, assume that there exist positive constants ,, and for each and for each such that
**
then the solution to (1.1) is almost surely exponentially stable.*

*Proof. *Note that
Here the local martingale terms , and are, respectively,
We deal with (3.2) term by term to derive an upper bound on . Consider first the drift term of (3.2). It is easy to see from the assumptions made that will be bounded above by . Secondly, we now concentrate on the local martingale terms of (3.2). First consider the quadratic variation of the term. By Ito’s isometry, we have
Next consider the quadratic variation of the local martingale term . Based on the following result presented in Kunita [15, page 323], and noting that the jump distribution is a probability measure that is, we have
On very similar lines, one can easily show that the quadratic variation of the local martingale term is given by
Thus by SLLN for local martingales (refer to Lipster and Shiryayev [16, page 140–141]), we can say that
Thus from (3.2) and the above discussion, one can infer that
Thus, since by assumption , from the definition of almost sure exponential stability, the trivial solution to (1.1) is almost surely exponentially stable.

We now provide conditions under which the trivial solution to (1.1) is moment exponentially stable.

Theorem 3.2. *Let . Assume that there exists a function such that
**
Then,
**
As a result the trivial solution of (1.1) is -moment exponentially stable under the conditions discussed above and the -moment Lyapunov exponent should not be greater than .*

*Proof. *The proof is omitted as it is a simple extension of the Markov-modulated SDE case discussed in Mao [9].

In the next theorem, we provide criteria to connect these two seemingly disparate stabilty criteria. Specifically, we provide conditions under which the -moment exponential stability for always implies almost sure exponential stability for (1.1).

Theorem 3.3. *Assume that there exists a positive constant such that for each **
If for all ,
**
then
**
Then -moment exponential stability implies almost sure exponential stability.*

We need the Burkholder-Davis-Gundy inequality which is detailed in the following remark below.

*Remark 3.4. *Let us recall that [] denotes the quadratic variation of a process say , and is its maximum process. Then the Burkholder-Davis-Gundy theorem states that for any , there exist positive constants such that, for all local martingales with and stopping times , the following inequality holds:
Furthermore, for continuous local martingales, this statement holds for all . For its proof refers to Theorem 3.28 page 166 in Karatzas and Shreve [17].

*Proof of Theorem 3.3. *Let . Let be arbitrarily small positive number. By the definition of -moment exponential stability of (3.15), there exists a constant such that
Let be sufficiently small such that,
From (1.1) we have
Noting that for
we have
Noting that , we have
Similarly,
From (3.15), one can easily show that
Hence, substituting (3.20)–(3.23) in (3.19), we obtain
From (3.16) we obtain that
and utilizing the Borel-Cantelli Lemma as in Mao [9] we deduce the desired implication that -moment stability implies almost sure exponential stability.

#### 4. Examples

We now provide some simple examples to illustrate both the almost surely exponential stability and moment exponential stability. We start with an example on almost surely exponential stability.

Consider a two state semi-Markov modulated Jump-diffusion problem with and where the generator matrix is given by Let the holding time in each regime be assumed to follow . Note that with the choice of the holding time distribution, the sMMJD collapses to the MMJD case in which case the generator acting on is given by Now from Assumption 2.1 as and , we have If we choose and such that for any , there exists such that . Also . Similarly, if there exist a positive constant such that for any , , then . If there exist constants and such that for any , and , then it is easy to see that . Thus in brief for certain conditions on the growth of the drift, diffusion and the integrand of the jump component of the process given by (1.1), we satisfy the conditions of Theorem 3.1 for the solution to (1.1) to be almost surely exponentially stable.

We next provide a simple example to illustrate Theorem 3.2. Consider that and . Also assume that the conditional holding time distribution be for . Let , , , for . Then from (2.4) we have . If and , then condition (ii) of Theorem 3.2 for is satisfied. Moreso if we assume that there exist constants and such that is true, then condition (i) of Theorem 3.2 is satisfied. Thus both conditions (i) and (ii) now guarantee that the solution of (1.1) is moment exponentially stable.

Next we discuss the issue of stochastic stabilization and destabilization of nonlinear systems.

#### 5. Stochastic Stabilization and Destabilization of Nonlinear Systems

We now investigate the stability of the nonlinear deterministic system of differential equations given by the following dynamics: on with where is locally Lipschitz continuous and furthermore there exists some constant such that . When perturbed by noise, the nonlinear system (5.1) is either stable if it originally unstable, in the sense that by adding noise we can force the solution of the stochastic differential equation to converge to the trivial solution as time increases indefinitely. This is the aim of stochastic stabilization. Likewise if our original system in stable, then this system is said to destabilize when perturbed by noise if the sample paths of the process escapes to infinity almost surely instead of converging to the trivial solution as time tends to infinity. This is termed as stochastic destabilization. Consequently, the system then becomes what is known as unstable. Mao [9] and Applebaum and Siakalli [18] have established a general theory of stochastic stabilization/destabilization of (5.1) using a Brownian motion and the general Levy process, respectively. However, no specific work has been done so far for the case where is an sMMJD. In this paper we focus on the first-order nonlinear system of ODEs that is perturbed by an sMMJD. In the following section, we show that an unstable linear system counterpart of (5.1) wherein for can be stabilized just by the addition of a jump component to the dynamics of the one-dimensional process . We observe that such a jump-stabilized system of DEs cannot be destabilized by further addition of a Brownian motion. On the contrary, we show that such a jump-stabilized nonlinear system of differential equations can surprisingly be destabilized by addition of Brownian motion if the dimension of the state space is at least two. Before we go into the proofs of these statements, we begin by mentioning the key dynamics of the sMMJD process and some assumptions that follow. Suppose we have an -dimensional standard -adapted Brownian motion process for each . The system (5.1) is perturbed by the following sMMJD dynamics of given by where is for each . Likewise is an -valued matrix for each and . We refer to a system (5.1) perturbed by the dynamics of as in (5.2) as just a perturbed system. We make the following key assumption that remains valid until the end of this section.

*Assumption 5.1. *Assume that for each and we have and that does not have an eigenvalue equal to almost surely.

In the following, we will establish the conditions on the coefficients of (5.2) for the trivial solution of the perturbed system to be almost surely exponentially stable. In particular, this surprisingly demonstrates that the jump process can have a stabilizing effect, as for the Brownian motion part as has been shown by Mao [9]. We state this formally as one of our main theorems.

Theorem 5.2. *Assume that Assumption 5.1 holds. Suppose that the following conditions are satisfied for , :*(i)*,
*(ii)* for each and .**Then the sample Lyapunov exponent of the solution of (5.2) exists and satisfies for any . If , then the trivial solution to the system in (5.2) is almost surely exponentially stable.*

*Proof. * *Step 1.* Define for all . As is independent of states and , the following terms in (2.4) are zero:
Hence as an application of the generalized Ito’s formula, we have for
where and are the two local martingale terms.*Step 2.* Consider now the quadratic variation of the two martingale terms. From Ito’s isometry and noting that
where is the spectral radius of the symmetric matrix ,
Next, the quadratic variation of the process is given by
*Step 3.* We work with the rest of the terms in the following way:
also
Thus, if .

*Remark 5.3. *Consider a 1-D sMMJD with the dynamics
where and for each , and . is a 1D Brownian motion and is a compensated Poisson process with , where is the intensity of the Poisson process. Assume that the processes and are independent. Then one can show from the SLLN for a Brownian motion and for a Poisson process (refer to Applebaum [13]) that for each
Note that for all and has a negative sign attached to it. Hence when the one-dimensional perturbed system for is stabilized by the addition of a jump process infact can never be destabilized by the addition of a Brownian motion. An interesting question we may ask here is: can the same inference hold true in higher dimensions? The answer is surprisingly *no*. In the following theorem, we show that for a state space of dimension greater than or equal to two, an unstable nonlinear system of differential equation stabilized by a jump component can still be destabilized by the addition of the Brownian motion. This surprising phenomenon was also observed by Applebaum and Siakalli [19] for the Levy process case.

To prove this assertion, let us now consider system of nonlinear differential equation (5.1) stabilized by (5.2) but with for each and . We now show that it gets destabilized by further addition of the -dimensional Brownian motion to (5.1). This corresponds to for each and .

Theorem 5.4. *Assume that matrix is an symmetric positive definite matrix. Now let*(i)*,*(ii)*,**for for each , . Hence for any . In particular if , then the trivial solution of (5.2), tends to be infinity almost surely exponentially fast.*

*Proof. *Fix . From Lemma 2.2, for all . Applying Ito’s lemma to , for and for each ,
where and are the two local martingale terms. Now using methodology similar to Theorem 5.2 we find
for any . In particular, if , then the trivial solution of the -perturbed system given by (5.2) tends to be infinity almost surely exponentially fast.

#### 6. Concluding Remarks

We presented conditions under which the solution of a semi-Markov Modulated jump diffusion is almost surely exponentially stable and moment exponentially stable. We also provide conditions that connect these two notions of stability. We further determine the conditions under which the trivial solution of the sMMJD-perturbed nonlinear system of differential equation is almost surely exponentially stable. We show that an unstable deterministic system can be stabilized by adding jumps. Such jump stabilized system, however, can get de-stabilized by Brownian motion if the dimension of the state space is at least two.

#### Acknowledgments

The author is very grateful to the anonymous referees and the editor for their careful reading, valuable comments, and helpful suggestions, which have helped him to improve the presentation of this paper significantly.

#### References

- L. Arnold,
*Differential Equations: Theory and Applications*, John Wiley & Sons, New York, NY, USA, 1972. - R. Z. Khasminskii,
*Stochastic Stability of Differential Equations*, vol. 7, Sijthoff and Noordhoff, Alphen aan den Rijn, The Netherlands, 1980. - G. S. Ladde and V. Lakshmikantham,
*Random Differential Inequalities*, Academic Press, New York, NY, USA, 1980. - A. Deshpande and M. K. Ghosh, “Risk minimizing option pricing in a regime switching market,”
*Stochastic Analysis and Applications*, vol. 26, no. 2, pp. 313–324, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH - F. B. Hanson,
*Applied Stochastic Processes and Control for Jump-Diffusions*, vol. 13 of*Advances in Design and Control*, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, Pa, USA, 2007. View at: Publisher Site - Y. Ji and H. J. Chizeck, “Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control,”
*Institute of Electrical and Electronics Engineers*, vol. 35, no. 7, pp. 777–788, 1990. View at: Publisher Site | Google Scholar | Zentralblatt MATH - M. Mariton,
*Jump Linear Systems in Automatic Control*, Marcel Dekker, New York, NT, USA, 1990. - G. K. Basak, A. Bisi, and M. K. Ghosh, “Stability of a random diffusion with linear drift,”
*Journal of Mathematical Analysis and Applications*, vol. 202, no. 2, pp. 604–622, 1996. View at: Publisher Site | Google Scholar | Zentralblatt MATH - X. Mao, “Stability of stochastic differential equations with Markovian switching,”
*Stochastic Processes and their Applications*, vol. 79, no. 1, pp. 45–67, 1999. View at: Publisher Site | Google Scholar | Zentralblatt MATH - G. Yin and F. Xi, “Stability of regime-switching jump diffusions,”
*SIAM Journal on Control and Optimization*, vol. 48, no. 7, pp. 4525–4549, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH - M. K. Ghosh and A. Goswami, “Risk minimizing option pricing in a semi-Markov modulated market,”
*SIAM Journal on Control and Optimization*, vol. 48, no. 3, pp. 1519–1541, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - F. Xi, “Asymptotic properties of jump-diffusion processes with state-dependent switching,”
*Stochastic Processes and their Applications*, vol. 119, no. 7, pp. 2198–2221, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - D. Applebaum,
*Lévy Processes and Stochastic Calculus*, Cambridge University Press, Cambridge, UK, 2nd edition, 2009. View at: Publisher Site | Zentralblatt MATH - N. Ikeda and S. Watanabe,
*Stochastic Differential Equations and Diffusion Processes*, vol. 24 of*North-Holland Mathematical Library*, North-Holland, Amsterdam, The Netherlands, 2nd edition, 1989. - H. Kunita, “Stochastic differential equations based on Lévy processes and stochastic flows of diffeomorphisms,” in
*Real and Stochastic Analysis*, M. M. Rao, Ed., pp. 305–373, 2004. View at: Google Scholar - R. S. Lipster and A. N. Shiryayev,
*Theory of Martingales*, Horwood, Chichester, UK, 1989. - I. Karatzas and S. E. Shreve,
*Brownian Motion and Stochastic Calculus*, Springer, New York, NY, USA, 2nd edition, 1991. View at: Publisher Site - D. Applebaum and M. Siakalli, “Asymptotic stability of stochastic differential equations driven by Lévy noise,”
*Journal of Applied Probability*, vol. 46, no. 4, pp. 1116–1129, 2009. View at: Publisher Site | Google Scholar | Zentralblatt MATH - D. Applebaum and M. Siakalli, “Stochastic stabilization of dynamical systems using Lévy noise,”
*Stochastics and Dynamics*, vol. 10, no. 4, pp. 509–527, 2010. View at: Publisher Site | Google Scholar | Zentralblatt MATH

#### Copyright

Copyright © 2012 Amogh Deshpande. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.