The Optimal Control Problem with State Constraints for Fully Coupled Forward-Backward Stochastic Systems with Jumps

Wei, Qingmeng

doi:https://doi.org/10.1155/2014/216053

Abstract and Applied Analysis

On this page

Abstract Introduction Preliminaries Acknowledgments References Copyright Related Articles

Special Issue

Long-Memory Processes and Applications

View this Special Issue

Research Article | Open Access

Volume 2014 | Article ID 216053 | https://doi.org/10.1155/2014/216053

The Optimal Control Problem with State Constraints for Fully Coupled Forward-Backward Stochastic Systems with Jumps

Qingmeng Wei¹

Academic Editor: Litan Yan

Received26 Nov 2013

Accepted22 Dec 2013

Published13 Feb 2014

Abstract

We focus on the fully coupled forward-backward stochastic differential equations with jumps and investigate the associated stochastic optimal control problem (with the nonconvex control and the convex state constraint) along with stochastic maximum principle. To derive the necessary condition (i.e., stochastic maximum principle) for the optimal control, first we transform the fully coupled forward-backward stochastic control system into a fully coupled backward one; then, by using the terminal perturbation method, we obtain the stochastic maximum principle. Finally, we study a linear quadratic model.

1. Introduction

In finance, various stochastic models are applied to simulate the price movements of financial instruments. For example, in the Black-Scholes model for pricing options, the price process of financial instrument is described by a geometrical Brownian movement which is a continuous-time stochastic process. However, the sudden world events would cause larger fluctuation in asset prices, which is intuitive in financial markets. In this situation, the price process usually follows a stochastic equation with jumps; that is, the uncertainty of the model comes from not only a Brownian motion but also a Possion random measure. Accordingly, for this case, there are also many applications in finance which produce the associated optimal control problem, such as risk management and option prices. In this paper, we focus on the optimal control problem for the discontinuous case.

There are two important approaches in control theory, namely, stochastic maximum principle and dynamic programming principle, where the stochastic maximum principle presents the necessary condition for the solution of the controlled system. In stochastic control theory, the maximum principle for the optimal control has been developed rapidly, especially, along with the appearance of nonlinear backward stochastic differential equations (BSDEs, for short) introduced by Pardoux and Peng [1], by Kushner [2], Bismut [3], Bensoussan [4], Haussmann [5], Hu [6], Peng [7, 8], and Øksendal and Sulem [9] (see [10] for the complete bibliography). In 1993, Peng [8] researched the decoupled forward-backward stochastic control system with the control domain being convex and deduced the maximum principle. Since then, under different assumptions, a lot of works about this topic have been springing up (refer to [9, 11–20]).

For the models with jumps, Situ [21] first got the maximum principle for forward stochastic controlled system with the jump diffusion coefficient independent of the control variable. Tang and Li [22] obtained the maximum principle in global form, when both diffusion and jump coefficients depend on the control variable and some state constraints are imposed. For the control problem of decoupled forward-backward stochastic differential equations (FBSDEs, for short) with jumps controlled system, the readers may refer to Øksendal and Sulem [9], Shi and Wu [23], and the references therein.

For the optimal control problem of the fully coupled FBSDEs with jumps, Shi and Wu [20] studied one kind of control problems with the control domain nonconvex, but the control variable does not appear in the diffusion and the jump coefficients of the forward equation. In [19], Shi discussed a general optimal control problem and derived Pontraygin’s maximum principle when the control domain is nonconvex, and the control variable appears in both diffusion and jump coefficients of the forward equation.

This paper is concerned with the optimal control problem of the fully coupled FBSDE with jumps (9), where we restrict the forward terminal state in a convex set , the control variables are non-convex, and the controlled model is not continuous. Moreover, we allow the diffusion and jump coefficients , in the forward equation to depend on the two different control variables, which is mainly because two diffusion terms are needed when applying martingale representation theorem to determine the solution of the BSDE with jumps. The control variables , associate with the diffusion term and the jump diffusion , respectively.

In order to deduce the stochastic maximum principle, we adopt the dual method (developed in [24]) and terminal perturbation method which are used to solve optimization problems with state constraints (refer to [12–14, 17, 25–28]). Recently, the dual approach is applied to utility optimization problem with volatility and ambiguity (see [29, 30]). First we transform the FBSDE with jumps (9) into a pure backward controlled one with jumps, in which the terminal state is regarded as the control variable which is much more easier to be dealt with than the initial state constraint. Meanwhile, the initial condition of the forward equation becomes an additional constraint. Fortunately, this constraint can be solved by applying Ekeland’s variational principle.

The paper is structured as follows. In Section 2, for fully coupled FBSDEs with jumps, we present some preliminaries. In Subsection 2.1, we first formulate the optimal control problem. By proving the variational inequality, we derive a stochastic maximum principle which presents the necessary condition for the optimal terminal state. Section 3 studies an application in stochastic linear quadratic control problem.

2. Preliminaries

Let be a complete probability space equipped with a natural filtration which is generated by the following two mutually independent processes and completed by all -null sets:(i)a -dimensional standard Brownian motion ;(ii)a Poisson random measure on , where is equipped with its Borel -field , with the compensator such that is a martingale for all satisfying . Here is assumed to be a -finite Lévy measure on with the property that .

For any , denotes the Euclidean norm of . is a fixed time horizon. Let us present the following spaces of processes which will be used later:(i)(ii)(iii)(iv)(v)where denotes the -field of -predictable subsets of .

First we recall some results about fully coupled FBSDEs with jumps. Consider the following fully coupled FBSDEs with jumps: where , ,:, : ,:, : ,:

are -progressively measurable processes.

Here we adopt the monotonic condition for fully coupled FBSDEs with jumps developed by Wu [31].

Given an full-rank matrix , we define where is the transposed matrix of .

We assume the following.(i) , (ii) , , , , , , where are nonnegative constants with , . Moreover, we have , , when (resp., ).For every , , are progressively measurable and

Lemma 1. Under assumptions , , for any , FBSDE with jumps (6) has a unique adapted solution .

For the proof, the readers may refer to Wu [31].

2.1. Problem Formulation

Denote , by the set of admissible controls , respectively.

For the given admissible control processes , , the dynamic of control system is described by the following fully coupled FBSDEs with jumps: with , , and:,:,:,:: .

(i) , and are continuous in their arguments and continuously differentiable in ; (ii) the derivatives of in are bounded; (iii) the derivatives of in are bounded by , and the derivatives of and in are bounded by .

Under and , for any , , from the existence and uniqueness theorem of fully coupled FBSDEs with jumps (refer to [31]), we know that (9) has a unique adapted solution so that the following cost functional is well defined: where , , .

Our optimal control problem with state constraints can be stated as follows.

Problem I. Minimize subject to , , and , where is convex.

Remark 2. In our optimal control problem, the control variables are not convex. However, the terminal state is constrained in a convex set . For the non-convex state constraint case, it is still an open problem.

2.2. Backward Formulation

In the above optimal control problem, the state constraint is new for fully coupled FBSDEs with jumps control system. To solve the state constraints, we adopt the dual method and terminal perturbation method. First we need to transform the discontinuous fully coupled forward-backward control system into a discontinuous backward form. In addition, the following assumption is necessary:there exists , such that and , for all , , , , and , .

We point out that under and , for any , and , and are one-to-one correspondences. By letting , , we get the existence of the inverse functions , satisfying , , respectively. So, (9) is rewritten as where

Then, combined with the existence and uniqueness theorem of fully coupled FBSDEs with jumps (refer to Lemma 1), we know it is equivalent to choose , and select the terminal state . Thus, we obtain the following backward control system: which associates with the following cost functional: where is the control variable, , and , , , .

Then, the optimal control problem is reformulated as follows.

Problem II. Minimize subject to and .

We propose to consider Problem II, though the terminal state becomes a control variable and the initial condition (which is the solution of (13) at time under ) is regarded as a constraint. Even so, it is more relaxing to study Problem II than Problem I. Moreover, , , also satisfy the similar conditions in .

Henceforth, we convert to Problem II to prove the maximum principle for the optimal control .

2.3. Variational Equation

In this subsection, we will present the estimates for the variational equations to serve for the variational inequality.

First we define a metric in , for . Obviously, is a complete metric space.

Suppose that is an optimal control to Problem II and is the associated state processes of (13) (with ). For each , , we know (note is convex). And denotes the state processes of (13) corresponding to .

Consider the following BSDEs with jumps: where , , , , , , respectively. Equation (15) is regarded as the variational equation along with the optimal control and the state .

We point that (15) is composed of two fully coupled linear BSDEs with jumps. In fact, under and , from the existence and uniqueness theorem for BSDE with jumps (Lemma 1 in [32]), we know that (15) has the unique adapted solution , .

For convenience, we denote

Then, we get the following results.

Lemma 3. Under , , and , one has

Proof. From (13), (15), and the notations (16), we have where Applying Itô’s formula to , from , , we obtain with . Furthermore, from Gronwall’s inequality, we have From Lebesgue’s dominated convergence theorem, we know . Also, it is clear that .
So, letting in (21), we complete the proof.

2.4. Variational Inequality

In this section we are going to explore the variational inequality for the variational equation (15). Let us start with the following Ekeland’s variational principle [33] used to deal with the initial constraint .

Lemma 4 (Ekeland’s variational principle). Suppose that is a complete metric space and is a proper lower semicontinuous function bounded from below. If, for some , there exists satisfying , then there exists such that(i),(ii),(iii), .

Given the optimal control , for any , we introduce the penalty function as where , , , , , , .

Remark 5. Note that under the mappings , , , defined on are continuous mainly due to the continuous dependence of solutions of BSDE with jumps.

Theorem 6. Suppose , hold. If is optimal to Problem II, then there exist and , with and , such that the following variational inequality holds: where , , respectively, and , is the solution of (15).

Proof. Clearly, the following properties hold for the penalty function : Combined with Ekeland’s variational principle (refer to Lemma 4), we obtain the existence of satisfying (i);(ii);(iii), .
For , , we have . The solution of (13) with (resp., is denoted by (resp., . And denotes the solution of (15) with . So, Similar to the proof of Lemma 3, we have It follows that Furthermore, we get the following expansions: where
Given , we discuss the following cases.
Case 1. There exists such that, for all , In this case, Setting and combining with (25), we get Case 2. There exists a positive sequence satisfying , such that In this case, from the definition of , . Due to being continuous, we have .
Thus, Similarly, from (25), where , , , .
We point out that, for the other six cases, the similar (33) also holds.
So, in any way, we always have that (i) (33) holds, (ii) , , , and (iii) .
Therefore, we obtain the existence of a convergent subsequence of whose limit is denoted by . Because of , we know in , as . According to the regularity of the solutions of BSDEs with jumps, as , we have

By letting in (33), we deduce the variational inequality (23).

2.5. Maximum Principle

In this subsection, we will prove the stochastic maximum principle. First, the adjoint equation is introduced as follows: We refer to the solution processes of (38) as the adjoint processes. In fact, there are two coupled SDEs with jumps in (38). The adjoint equation (38) can be easily solved when we regard as a whole.

The following is the main result of this paper.

Theorem 7. Assume −. Let be optimal to Problem II and let , be the corresponding state of (13). Then, there exist , , and such that, for any , where is the solution of (38).

Proof. Applying Itô’s formula to , we get Integrating from to , taking expectation, we obtain Combined with the variational inequality (23), we have Since is arbitrary, we know, for any , that

Denote by the boundary of . Define .

From Theorem 7, we have the following.

Corollary 8. Under the assumptions of Theorem 7, for each , one has

3. Application: Stochastic LQ Control with Terminal State Constraints

Now we consider a linear quadratic (LQ, for short) control problem of FBSDEs with jumps. For convenience, we assume .

Consider the following linear control system: The objective of our control problem is to minimize the following cost functional: subject to , , , .

Following the procedures in previous section, let , , and treat , as the controls; then, the backward control system can be rewritten as Accordingly, the equivalent control problem is Then, from Theorem 7, if is optimal, there exist , with and such that, for any , where is the solution of the following equation: Denote . From the arbitrariness of , we get the following necessary condition of the optimal control : where is the solution of (50).

Conflict of Interests

The author declares that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by National Natural Science Foundation of China (nos. 11171187, 11222110, and 11221061); supported by Shandong Province (no. JQ201202); supported by Program for New Century Excellent Talents in University of China; and supported by Postdoctoral Scientific Research Project of Jilin Province (no. RB201357).

References

É. Pardoux and S. G. Peng, “Adapted solution of a backward stochastic differential equation,” Systems & Control Letters, vol. 14, no. 1-2, pp. 55–61, 1990.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
H. Kushner, “Necessary conditions for continuous parameter stochastic optimization problems,” SIAM Journal on Control and Optimization, vol. 10, pp. 550–565, 1972.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
J.-M. Bismut, “An introductory approach to duality in optimal stochastic control,” SIAM Journal on Control and Optimization, vol. 20, no. 1, pp. 62–78, 1978.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
A. Bensoussan, “Lectures on stochastic control,” in Nonlinear Filtering and Stochastic Control, Lecture Notes in Mathematics, part I, pp. 1–39, Springer, New York, NY, USA, 1983.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
U. Haussmann, A Stochastic Maximum Principle for Optimal Control of Diffusions, vol. 151 of Pitman Research Notes in Mathematics, Wiley John & Sons, New York, NY, USA, 1986.
Y. Hu, “Maximum principle of optimal control for Markov processes,” Acta Mathematica Sinica, vol. 33, pp. 43–56, 1990.
View at: Google Scholar
S. G. Peng, “A general stochastic maximum principle for optimal control problems,” SIAM Journal on Control and Optimization, vol. 28, no. 4, pp. 966–979, 1990.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. G. Peng, “Backward stochastic differential equations and applications to optimal control,” Applied Mathematics and Optimization, vol. 27, no. 4, pp. 125–144, 1993.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
B. Øksendal and A. Sulem, “Maximum principles for optimal control of forward-backward stochastic differential equations with jumps,” SIAM Journal on Control and Optimization, vol. 48, no. 5, pp. 2945–2976, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
J. M. Yong and X. Y. Zhou, Stochastic Controls: Hamiltonian Systems and HJB Equations, vol. 43 of Applications of Mathematics, Springer, New York, NY, USA, 1999.
W. S. Xu, “Stochastic maximum principle for optimal control problem of forward and backward system,” Journal of the Australian Mathematical Society B, vol. 37, no. 2, pp. 172–185, 1995.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
N. El Karoui, S. Peng, and M. C. Quenez, “A dynamic maximum principle for the optimization of recursive utilities under constraints,” The Annals of Applied Probability, vol. 11, no. 3, pp. 664–693, 2001.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. L. Ji and S. G. Peng, “Terminal perturbation method for the backward approach to continuous time mean-variance portfolio selection,” Stochastic Processes and their Applications, vol. 118, no. 6, pp. 952–967, 2008.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. L. Ji and X. Y. Zhou, “A maximum principle for stochastic optimal control with terminal state constraints, and its applications,” Communications in Information and Systems, vol. 6, no. 4, pp. 321–337, 2006.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. L. Ji and Z. Wu, “The maximum principle for one kind of stochastic optimization problem and application in dynamic measure of risk,” Acta Mathematica Sinica, vol. 23, no. 12, pp. 2189–2204, 2007.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. L. Ji and X. Y. Zhou, “The Neyman-Pearson lemma under $g$ -probability,” Comptes Rendus de l'Académie des Sciences, vol. 346, no. 3-4, pp. 209–212, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
S. L. Ji and X. Y. Zhou, “A generalized Neyman-Pearson lemma under $g$ -probabilities,” Probability Theory and Related Fields, vol. 148, no. 3-4, pp. 645–669, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
S. L. Ji, “Dual method for continuous-time Markowitz's problems with nonlinear wealth equations,” Journal of Mathematical Analysis and Applications, vol. 366, no. 1, pp. 90–100, 2010.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. T. Shi, “Necessary conditions for optimal control of forward-backward stochastic systems with random jumps,” International Journal of Stochastic Analysis, vol. 2012, Article ID 258674, 50 pages, 2012.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
J. T. Shi and Z. Wu, “Necessary condition for optimal control of fully coupled forward-backward stochastic system with random jumps,” in Proceedings of the 31th Chinese Control Conference, pp. 1620–1627, Hefei, China, 2012.
View at: Google Scholar
R. Situ, “A maximum principle for optimal controls of stochastic with random jumps,” in Proceedings of the National Conference on Control Theory and Its Applications, Qingdao, China, October 1991.
View at: Google Scholar
S. J. Tang and X. J. Li, “Necessary conditions for optimal control of stochastic systems with random jumps,” SIAM Journal on Control and Optimization, vol. 32, no. 5, pp. 1447–1475, 1999.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
J. T. Shi and Z. Wu, “Maximum principle for forward-backward stochastic control system with random jumps and applications to finance,” Journal of Systems Science & Complexity, vol. 23, no. 2, pp. 219–231, 2010.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
T. Bielecki, H. Jin, S. Pliska, and X. Y. Zhou, “Continuous-time mean-variance portfolio selection with bankruptcy prohibition,” Mathematical Finance, vol. 15, no. 2, pp. 213–244, 2005.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
C. Bernard, S. L. Ji, and W. D. Tian, “An optimal insurance design problem under Knightian uncertainty,” Decisions in Economics and Finance, vol. 36, no. 2, pp. 99–124, 2013.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
S. L. Ji and Q. M. Wei, “An overview on the principal-agent problems in continuous time,” in Real Options, Ambiguity, Risk and Insurance, A. Bensoussan, S. Peng, and J. Sung, Eds., Studies in Probability, Optimization and Statistics 5, IOS Press, Amsterdam, The Netherlands, 2013.
View at: Google Scholar
S. L. Ji and Q. M. Wei, “A maximum principle for fully coupled forward-backward stochastic control systems with terminal state constraints,” Journal of Mathematical Analysis and Applications, vol. 407, no. 2, pp. 200–210, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
S. L. Ji, Q. M. Wei, and X. M. Zhang, “A maximum principle for controlled time-symmetric forward-backward doubly stochastic differential equation with initial-terminal sate constraints,” Abstract and Applied Analysis, vol. 2012, Article ID 537376, 29 pages, 2012.
View at: Publisher Site | Google Scholar
L. Epstein and S. L. Ji, “Ambiguous volatility and asset pricing in continuous time,” The Review of Financial Studies, vol. 26, no. 7, pp. 1740–1786, 2013.
View at: Publisher Site | Google Scholar
L. Epstein and S. L. Ji, “Ambiguous volatility, possibility and utility in continuous time,” Journal of Mathematical Economics, 2013.
View at: Publisher Site | Google Scholar
Z. Wu, “Fully coupled FBSDE with Brownian motion and Poisson process in stopping time duration,” Journal of the Australian Mathematical Society, vol. 74, no. 2, pp. 249–266, 2003.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet
G. Barles, R. Buckdahn, and E. Pardoux, “Backward stochastic differential equations and integral-partial differential equations,” Stochastics and Stochastics Reports, vol. 60, pp. 57–83, 1997.
View at: Google Scholar | Zentralblatt MATH | MathSciNet
I. Ekeland, “On the variational principle,” Journal of Mathematical Analysis and Applications, vol. 47, pp. 324–353, 1974.
View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet

Copyright

Copyright © 2014 Qingmeng Wei. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

1068

Downloads

1326

Citations