About this Journal Submit a Manuscript Table of Contents
International Journal of Stochastic Analysis
Volume 2011 (2011), Article ID 501360, 11 pages
Research Article

First Passage Time Moments of Jump-Diffusions with Markovian Switching

Department of Mathematical Sciences, Central South University, Changsha, Hunan, China

Received 5 December 2010; Accepted 24 January 2011

Academic Editor: Enzo Orsingher

Copyright © 2011 Jun Peng and Zaiming Liu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


Using an integral equation associated with generalized backward Kolmogorov's equation for the transition probability density function, recurrence relations are derived for the moments of the time of first exit of jump-diffusions with Markovian switching. The results are used to find the expectation of first passage time of some financial models.

1. Introduction

Owing to the increasing demands on regime-switching diffusions in financial engineering and wireless communications, much attention has been drawn to switching jump diffusion processes. For example, one of the early efforts of using such hybrid models for financial applications can be traced back to [1, 2], in which both the appreciation rate and the volatility of a stock depend on a continuous Markov chain. The introduction of such models makes it possible to describe stochastic volatility in a relatively simpler manner. A stock market may be considered to have two “modes” or “regimes”, up and down, resulting from the state of the underlying economy, the general mood of investors in the market, and so on. The rationale is that in the different modes or regimes, the volatility and return rates are very different. For instance, in a stock market, the regimes can be roughly divided into two states, bull market and bear market. The market sentiment and reaction to the two states are in stark contrast. Normally, a bare market is more volatile than that of a bull market. Another need is to capture the features of insurance policies that are subject to the economic or political environment changes. It is thus sensible and necessary to take such regime changes into consideration. Also due to the needs from modeling points of view, formulation of dividend optimization problem often results in complex models in order to take into consideration various scenarios arising in finance and insurance practice. For example, in lieu of the diffusion models or jump-diffusion models, one may consider such models with regime switching modulated by a continuous time Markov chain, in which the Markov chain is used to delineate the random environment. Adopting a Markov regime-switching model is an easy way to capture all the cyclical features of the drift and volatility of asset return depending on market environment. For a long time, lots of empirical evidences have supported the existence of regime-switching property in financial markets. For example, Lewellen found that expected returns on equities change over time in [3]. Schwert concluded that the volatilities of stock returns also vary substantially over time in [2].

Taking the factors above into consideration, this paper is concerned with jump-diffusion involving Markovian switching regimes. In the models, there are finite set of regimes or configurations and a switching process that dictates which regime to take at any given instance. At each time , once the configuration is determined by the switching process, dynamics of the system follows a jump-diffusion process. It evolves until the next jump takes place. Then, the postjump location is determined and the process sojourns in the new location following the evolution of another jump-diffusion motions.

First passage time distribution for stochastic processes are key quantities in many fields of sciences, such as mathematical physics, neurology, and also in mathematical finance. For instance, in the latter case, it is required for the pricing of some path-dependent options and for estimating the risk of default in the structural approach. Tuckwell derived the recurrence relationship for the moments of the time of first exit of a temporally homogeneous Makov process from a set in the phase space (see [4]). Numerical algorithm for computing the probability of the first exit time from a bounded domain for multidimensional diffusions was given in [5]. Kou and Wang obtained explicit solutions of the Laplace transforms, of both the distribution of the first passage times and the joint distribution of a double exponential jump diffusion process (see [6]). However, to the best of our knowledge, there are few literatures concerning the first passage time of jump-diffusions with Markovian switching. Based on these, in this paper, following a similar method as in [4], we show that the moment of the first passage time can be represented as the unique weak solution of the backward Kolmogorov equation associated to the process subject to appropriate boundaries conditions. The results are used to find the expectation of first passage time of some financial models.

2. Derivation of the Recurrence Relations for the Moments

Consider the following jump-diffusions with Markovian switching:

We denote the transition probability family of the jump-diffusion with Markovian switching by . Assume that has density , then it satisfies the Kolmogorov backward equation.

Remark 2.1. When the switching process is missing, it reduces to the Ito's formula for jump-diffusion processes studied by Tuckwell in [4]; when the Poisson jump is missing, it reduces to diffusions with regime switching investigated in [7]; when both the switching process and the Poisson jumps are missing, it reduces to the Ito’s formula for the usual diffusion processes and this model has been studied by many authors, see [5, 6] and references therein.

In order to assure the existence of solutions of (2.1), we need to make the following assumption.

Assumption A. Assume that is measurable function and that and are continuously differentiable in and they satisfy the Lipschitz condition and the linear growth condition as follows: for some constant , for all and .
Under Assumption A, [8] has proved that (2.1) determines a unique right continuously strong Markov process with left-hand limits and shows that has the following generator: where
is the measure defined on such that and the jump intensity is assumed to be finite. is a temporally homogeneous Poisson random measure.
We now further assume that conditions are satisfied for the transition probability of to have a density, , with . Denote
Using a similar method as in [9], we can show that the density satisfies the backward equation, that is, for fixed and ,

Lemma 2.2 (see [8]). There exists a unique strong Markov process satisfying (2.1) with as its path space.

We now prove the following result.

Theorem 2.3. Let be the temporally homogeneous process whose transition density satisfy the Kolmogorov backward equation (2.8). Let be an open set in the phase space and define, for , which is the time of first exit from . One sets if these quantities exist. One, then, sets the following:(i)the probability that ever leaves the set satisfies the equation with boundary conditions ,(ii)if the solution of (2.11) is , for all , then the moments of satisfy the recurrence relations with boundary conditions for .

Proof. For fixed , satisfy the backward Kolmogorov equation Consider the functional where is defined on and takes nonnegative values. The Laplace transform for is where
According to [1], we have that satisfies the integral equation
Applying the operator to (2.17) and combining with (2.15), we obtain
The Laplace transform of satisfies
Let be an open set in , and define the function by so that the corresponding Laplace transform satisfies Given , the probability that is in in the time interval is where
Let , then we have
So, we obtain the equation with initial conditions and boundary conditions
On the one hand, since the Markov switching process is homogeneous, we set and put
On the other hand, where is the distribution function of and this is determined by with initial condition and the boundary conditions if . From (2.31), the Laplace-Stieltjes transform of defined by satisfies with boundary conditions for .
Since where .
Substituting (2.35) into (2.34), we have the recurrence relation
In particular, the probability that ever leaves , satisfying with boundary conditions for .

Remark 2.4. (1) When there is no Markov switching, it is the results of [4].
(2) When there is no Poisson jump, it gives the first passage time of regime-switching diffusion, which is the model studied in [7, 10].
(3) When both Poisson’s jump and Markov’s switching are disappeared, it is the result of [1].

3. Application to Finance

For the regime-switching diffusion without Poisson’s jumps, there are a number of works on financial models. For example, bounds to the first passage time density and distribution function of alternating Brownian motion are given in [10]. The problem of hedging an European call option for a modulated diffusion model is studied in [11], and a generalization of the Black-Scholes formula for the corresponding option price is shown there. The financial market models based on telegraph processes and alternative jump diffusions are treated in [12]. In this section, we add an extra Poisson jump term to the continuous diffusion models and consider the first passage time moment of the stock price composed of a geometric Brownian motion and Poisson jump.

Consider a stock whose price satisfies the following stochastic differential-integral equation and initial condition

In (3.1), and are constants, is a standard Brownian motion, is a jump Markov process with two states , and . The generator of is given by

The constant gives the rate of increase, the rate of decrease, is the expected time the drift stays in state , and is the expected time the drift stays in state . In (3.1), the stock price is composed of a geometric Brownian motion and Poisson jump. In the geometric Brownian motion, the drift rate is a two-state jump Markov process. One state of the drift rate is positive. In this state, the stock price should increase. The other state of the drift rate is negative. In this state, the stock price should decrease. Hence, the drift rate changes back and forth between positive and negative values. Discontinuous jump process is modeled by a Poisson distribution. These discontinuous price jumps are usually a result of outages, transmission constraints, and so forth.

The generator of (3.1) for is

When there is no Poisson jump, it reduces to the model in [13].

Proposition 3.1. The moments of first passage time for satisfy with boundary conditions for and for satisfy with boundary conditions for .

Example 3.2. Consider the following jump-diffusion processes with Markov’s switching: where constant , is a one-dimensional Brownian motion; is a stationary point process and independent of such that is the compensated Poisson random measure on . and are any given real numbers, and is a two-state random jump process on with generator given by When and , we have the following recursive relation for the moments of first passage time of (3.6): with boundary conditions , for with boundary conditions for .


The authors would like to thank the anonymous referee for the valuable suggestions and comments.


  1. D. A. Darling and A. J. F. Siegert, “A systematic approach to a class of problems in the theory of noise and other random phenomena—part I,” IRE Transactions on Information Theory, vol. 3, pp. 32–37, 1957. View at Publisher · View at Google Scholar
  2. W. Schwert, “Why does stock market volatility change over time ?” Journal of Finance, vol. 44, pp. 1115–1153, 1989. View at Publisher · View at Google Scholar
  3. J. Lewellen, “Predicting returns with financial ratios,” Journal of Financial Economics, vol. 74, no. 2, pp. 209–235, 2004. View at Publisher · View at Google Scholar
  4. H. C. Tuckwell, “On the first-exit time problem for temporally homogeneous Markov processes,” Journal of Applied Probability, vol. 13, no. 1, pp. 39–48, 1976. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  5. P. Patie and C. Winter, “First exit time probability for multidimensional diffusions: a PDE-based approach,” Journal of Computational and Applied Mathematics, vol. 222, no. 1, pp. 42–53, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  6. S. G. Kou and H. Wang, “First passage times of a jump diffusion process,” Advances in Applied Probability, vol. 35, no. 2, pp. 504–531, 2003. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  7. R. Z. Khasminskii, C. Zhu, and G. Yin, “Stability of regime-switching diffusions,” Stochastic Processes and Their Applications, vol. 117, no. 8, pp. 1037–1051, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  8. F. Xi, “On the stability of jump-diffusions with Markovian switching,” Journal of Mathematical Analysis and Applications, vol. 341, no. 1, pp. 588–600, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  9. I. I. Gihman and A. V. Skorohod, Stochastic Differential Equations, Springer, New York, NY, USA, 1972.
  10. A. Di Crescenzo, E. Di Nardo, and L. M. Ricciardi, “Simulation of first-passage times for alternating Brownian motions,” Methodology and Computing in Applied Probability, vol. 7, no. 2, pp. 161–181, 2005. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  11. G. B. Di Masi, Y. M. Kabanov, and V. I. Runggaldier, “Mean-square hedging of options on a stock with Markov volatilities,” Theory of Probability and Its Applications, vol. 39, pp. 172–182, 1995.
  12. N. Ratanov, “Option pricing model based on a Markov-modulated diffusion with jumps,” Brazilian Journal of Probability and Statistics, vol. 24, no. 2, pp. 413–431, 2010. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  13. R. Rishel, “Whether to sell or hold a stock,” Communications in Information and Systems, vol. 6, no. 3, pp. 193–202, 2006. View at Zentralblatt MATH