Abstract

The mixed control problem is studied for systems governed by infinite horizon backward stochastic differential equations (BSDEs) with exogenous disturbance signal. A necessary and sufficient condition for the existence of a unique solution to the control problem is derived. The equivalent feedback solution is also discussed. Contrary to deterministic or stochastic forward case, the feedback solution is no longer feedback of the current state; rather, it is feedback of the entire history of the state.

1. Introduction

control is one of the most important robust control approaches in which control law is sought to efficiently eliminate the effect of the exogenous disturbance in the practical system. We refer the reader to [13] and the references therein. If the purpose is to select control not only to restrain the exogenous disturbance, but also to minimize a cost function when the worst case disturbance is implemented, this is the so-called mixed control problem. Mixed control problem has attracted much attention and has been widely applied to various fields. Please refer to [4, 5] for more information.

It should be pointed out that the above-mentioned works are concerned only with the forward stochastic systems. The case of systems governed by backward stochastic differential equations with exogenous disturbance signal, to our best knowledge, seems to be open. The objective of this paper is to develop an control theory for infinite horizon backward stochastic systems.

A BSDE is an Itô stochastic differential equation (SDE) for which a random terminal condition on the state has been specified. Since BSDEs are well-defined dynamic systems, it is very natural and appealing to study the control problems involving BSDEs as well as their applications in lots of different fields, especially in finance, economics, insurance, and so forth. Please refer to [612] for more details. This paper is concerned with mixed control of backward systems governed by infinite horizon linear BSDEs, namely, an infinite horizon backward stochastic control problem. This means that our purpose is to study mixed backward stochastic control problem in infinite horizon which presents more robust and stable sense in practise. For that, as preliminaries, we first need to review some results on infinite horizon BSDEs in Section 2. Chen and Wang [13] gave an existence and uniqueness result under a kind of Lipschitz condition suitable for one-dimensional infinite horizon BSDEs. Wu [14] generalized the result of [13] into the poisson jump process case in unbounded stopping time duration and obtained the corresponding comparison theorem. In this section, under this frame, we get the existence and uniqueness result for the infinite horizon matrix-valued BSDEs.

In Section 3, similar to the deterministic or stochastic forward case, we formulate the infinite horizon backward stochastic control problem. In Section 4, a necessary and sufficient condition for the existence of a unique solution to the control problem is derived. It is shown that the existence of a unique solution to the control problem is equivalent to the corresponding uncontrolled perturbed system to have a -gain less than or equal to and the resulting solution is characterized by the solution of an uncontrolled forward backward stochastic differential equation (FBSDE). Under some monotone assumptions, Hu and Peng [15] and Peng and Wu [16] obtained the existence and uniqueness results in an arbitrarily prescribed time duration. Wu and Xu [17] gave some comparison theorems for FBSDEs. Riccati equation plays an important role to get the feedback form of the optimal control; please refer to Yong and Zhou [18] for the details. Section 5 gives the equivalent linear feedback solution by virtue of the solution of a Riccati-type equation. As it turns out, the infinite horizon backward stochastic control can no longer be expressed as a linear feedback of the current state like that in deterministic or stochastic forward case. Rather, it depends, in general, on the entire past history of the state pair .

2. Notations and Preliminary Results of Infinite Horizon BSDEs

To treat the infinite horizon backward stochastic control problem, we need the following preliminary results of infinite horizon BSDEs.

Let be a completed filtering probability space; let be a standard one-dimensional Wiener process (our assumption that is scalar-valued is for the sake of simplicity; no essential difficulties are encountered when extending our analysis to the case of vector-valued Wiener process). is the natural filtration generated by this Wiener process up to time , where contains all -null sets of and .

Throughout this paper, we adopt the following conventional notations. : the set of symmetric matrices with real elements; : the transpose of the matrix ; : is positive semidefinite (positive definite) real matrix; : identity matrix; for -dimensional vector ; for ; : for a.s. ; : ; : a given Hilbert space;

We consider the infinite horizon BSDE: take value in , , and is a map from onto which satisfies the following.(H2.1)For all , is progressively measurable and (H2.2)There exist two positive deterministic functions and such that, for all , , Then we have the following.

Theorem 1 (see Wu [14]). There exists a unique solution satisfying the BSDE (2).
Let us again consider a function , which will be in the sequel the generator of the BSDE, defined on , with values in , such that the process is a progressively measurable process for each .
Along the line of Chen and Wang [13] or Wu [14] combined with that in Peng [19] for matrixed-valued BSDEs result in finite horizon, we get the following existence and uniqueness theorem for infinite horizon matrix-valued BSDEs.

Theorem 2. Suppose that satisfies the following.(H2.1′)For all , is progressively measurable and (H2.2′)There exist two positive deterministic functions and such that, for all , , and , , is a given -valued random variable, and . Then, the following matrix-valued infinite horizon BSDE admits a unique solution .

3. Problem Statement

Now, we consider the following stochastic control system governed by an infinite horizon linear BSDE: is the penalty output, and the energy of the output signal is given by where is a nonnegative symmetric constant matrix and and are nonnegative symmetric bounded progressively measurable matrix-valued processes. and stand for the control input and exogenous disturbance signal, respectively. The energy of the disturbances is

Later, we will state assumptions on the coefficients , , , , , so as to guarantee the existence of a unique solution pair of BSDE (8) for any , , and . We refer to such a four-tuple as an admissible triple.

Now, we first define the infinite horizon backward stochastic control as follows.

Definition 3 (backward stochastic control). For given and , find, if possible, a control , such that (i)the trajectory of the closed-loop system (8) with satisfies (ii)when the worst case disturbance ([4]) , if existing, is implemented in (8), minimizes the quadratic performance simultaneously.
If we define then the mixed control problem is equivalent to find the Nash equilibria defined as Obviously, inequality (15) is associated with the performance. The first Nash inequality (13) is to keep that is the worst case disturbance, while the second one (14) is related with the performance. Clearly, if the Nash equilibria exist and satisfy inequality (15), then is our desired controller and is the worst case disturbance. In this case, we also say that the infinite horizon backward stochastic control admits a solution .
Throughout this paper, we assume the following.(A1) All matrices mentioned in this paper are bounded progressively measurable processes.(A2) (A3)
From Theorem 2, we obtain that assumption (A2) is sufficient to guarantee the existence of a unique solution pair of BSDE (8) for any and .

4. The Necessary and Sufficient Condition

In this section, we give a necessary and sufficient condition for the existence of a unique solution to the backward stochastic control problem. We begin our presentation with some preliminaries.

Consider the following uncontrolled stochastic perturbed system: Let be the to-be-controlled output. For any , define the perturbation operator as with its norm where Obviously, is a nonlinear operator.

Definition 4. Let ; system (18) is said to have -gain less than or equal to if for any nonzero , .

Proposition 5. For system (18) and given disturbance attenuation , if there exists a function , satisfying the following SDE (the variables and are suppressed): then .

Proof. It only needs to note the following identity:

The following theorem is a necessary and sufficient condition for the existence of a unique solution to the infinite horizon backward stochastic control problem.

Theorem 6. For system (8), the backward stochastic control problem admits a solution if and only if the corresponding uncontrolled system (18) has -gain less than or equal to . Moreover, if the backward stochastic control problem admits a solution, then the solution is unique with where is the solution of the following FBSDE:

Proof. (1) The Sufficient Condition. To show that the backward stochastic control problem admits a unique solution if the corresponding uncontrolled system (18) has -gain less than or equal to , we will show that is a solution firstly.
Look at the above FBSDE; from [16], the FBSDE (25) has a unique solution . Now, we try to prove that is the worst case disturbance. For any given , suppose that is the trajectory corresponding to . It is easy to see the trajectory corresponding to is with initial state and terminal state . Hence, is the solution corresponding to for system (18) with terminal state . Since system (18) has -gain less than or equal to , then Applying Itô’s formula to , Substituting into (28), we get From (27), then So is the worst case disturbance. Moreover, for , the FBSDE (25) admits a unique solution ; then
Hence, restrains the exogenous disturbance. In the following, we will show that also minimizes that cost function when the worst case disturbance is implemented into system (8).
For any , let be the trajectory of the system (8) corresponding to . Let us first consider where From , we use Itô’s formula to and get Then because of , , and being nonnegative, we have Therefore, minimizes the cost function when the worst case disturbance is implemented into system (8).
So, is a solution of the backward stochastic control problem.
We are now in a position to prove the uniqueness of the solution. Assume that the backward stochastic control has a solution , is the corresponding solution for (8), and is the solution of the following BSDE: Implementing , having is a standard LQ optimal control problem. By uniqueness, .
Let be the trajectory corresponding to ; then Applying Itô’s formula to , Substituting into (39), then Because of , , and being nonnegative, we get .
Therefore, .
(2) The Necessary Condition. Here we assume that a solution exists; then from the uniqueness of the solution, we get that is the unique solution and we will show that system (18) has -gain less than or equal to .
For , the FBSDE (25) has a unique solution ; then and Therefore, system (18) has -gain less than or equal to .

5. The Linear Feedback Solution

The main result of this section gives the equivalent linear feedback solution. For the purpose of this section the coefficients , , , , , , and are assumed deterministic functions; (18) has -gain less than or equal to .

Let be the solution of (25); we first give the relations between , , and using the undetermined coefficients method. Now, we introduce the following generalized matrix-valued Riccati equation (the variables are suppressed): Similar to the line developed by Lim and Zhou [6], we can prove that (43) admits a unique solution . Letting be the solution to (43), we define the following equations: Equation (44) is a linear BSDE and admits a unique solution .

Theorem 7. Suppose that , , and are the solutions of (25), (43), and (44), respectively; then the following relations are satisfied:

Proof. Let . We apply Itô’s formula to , , respectively, and it is easy to check that and satisfy (43) and (44), respectively.

From Theorem 7, we know that can be written to the functions of , , and . Now we would like to derive the feedback solution using the undetermined coefficients method. First, we introduce the generalized matrix-valued Riccati equation and a linear SDE: Similar to the line developed by Lim and Zhou [6], we can prove that (46) admits a unique solution . Equation (47) is a linear SDE and has a unique solution .

Theorem 8. The backward stochastic control problem has a feedback solution ,

Proof. Let . We apply Itô’s formula to and , respectively, and it is easy to check that and satisfy (46) and (47).

Remark 9. From Theorem 8, we see that the solution involves an additional random nonhomogeneous term . This addition disqualifies (48) from a feedback control of the current state, contrary to the deterministic or stochastic forward (see [4, 5]) cases. The reason is because depends on , which in turn depends on , the terminal condition of part of the state variable, . This is one of the major distinctive features of the backward stochastic problem.
Finally, it is important to recognize that the expressions for the backward stochastic control, as presented in Theorems 6 and 8, are equivalent expressions of the same process; that is, this does not contradict the uniqueness of the solution.
We present an example to illustrate the above theoretical results as follows.

Example 10. Consider the backward stochastic control problem of the following one-dimensional system: with controlled output energy If we take , then the Riccati equation (43) specializes to Solving it yields . Equation (44) specializes to Then, from Theorem 7, we get a unique solution of the backward control problem.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgments

This work was supported by the National Natural Science Foundation (11221061 and 61174092), 111 project (B12023), the National Science Fund for Distinguished Young Scholars of China (no. 11125102), the Science and Technology Project of Shandong Province (2013GRC32201), and the Doctoral Foundation of University of Jinan (XBS1213).