Mathematical Problems in Engineering

Volume 2010, Article ID 472867, 16 pages

http://dx.doi.org/10.1155/2010/472867

## An Application of Dynamic Programming Principle in Corporate International Optimal Investment and Consumption Choice Problem

School of Mathematics, Shandong University, Jinan 250100, China

Received 5 August 2010; Revised 16 December 2010; Accepted 27 December 2010

Academic Editor: Gradimir V. Milovanović

Copyright © 2010 Zongyuan Huang and Zhen Wu. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper is concerned with a kind of corporate international optimal portfolio and consumption choice problems, in which the investor can invest her or his wealth either in a domestic bond (bank account) or in an oversea real project with production. The bank pays a lower interest rate for deposit and takes a higher rate for any loan. First, we show that Bellman's dynamic programming principle still holds in our setting; second, in terms of the foregoing principle, we obtain the investor's optimal portfolio proportion for a general maximizing expected utility problem and give the corresponding economic analysis; third, for the special but nontrivial Constant Relative Risk Aversion (CRRA) case, we get the investors optimal investment and consumption solution; last but not least, we give some numerical simulation results to illustrate the influence of volatility parameters on the optimal investment strategy.

#### 1. Introduction

International portfolio diversification problem plays an important role in finance and generally depends on several factors such as barriers of international capital markets, uncertainty of operational cash flows, and the effect of exchange risk on corporate international investment. Some more theories and models can be found in Choi [1]. Since Duffie [2] and Merton [3] originally introduced stochastic models of security markets, optimal portfolio and consumption choice problems have been studied by many researchers. Zariphopoulou [4, 5] studied investment and consumption models with transactions fees and some trading constraints. Bellalah and Wu [6] gave a simple model of corporate international investment under incomplete information and taxes. Wang and Wu [7] obtained a general maximum principle for partially observed risk-sensitive optimal control problems and applied it to solve some problems arising from financial market. In 1997, El Karoui et al. [8] used backward stochastic differential equation (BSDE) theory to investigate some options pricing problem with the borrowing rate higher than the deposit rate.

For most investors, the profit is the most important while the risk cannot be ignorable. Since the investors who want to invest in an international corporate will face more liquidity risk, more risk in exchange rate, they usually choose a securer way in their domestic investment, which could offer enough liquidity and stable gains, such as bonds and other fixed-income derivatives. On the other hand, although bonds have lower yields, they have been widely selected as part of a portfolio from the viewpoint of risk management. In this paper, we are concerned with a kind of optimal international corporate portfolio and domestic consumption choice problem. Under our framework, an investor has two choices: one is a bond (bank account) in home country and the other is a real project with production in foreign country. The investor can borrow money from the bank to invest in the real project if he pays higher loan rate than deposit, meanwhile, the investor is also supposed to retain her/his domestic consumption habit. This reflects an implicit assumption according to which all the foreign projects are evaluated in foreign currency and converted by uncertain exchange rate. In order to maximize her/his expected utility of both consumption and her/his terminal wealth in domestic currency numeraire, the problem is then formulated as a kind of optimal control problems. To deal with this kind of problems, an efficient method is to apply Bellman's dynamic programming principle which was originally founded in 1952 (see Bellman [9]). This principle implies that an optimal policy has the property that whatever the initial state and initial decision are, the remaining decisions must constitute an optimal policy with regard to the state resulting from the first decision. Since it was founded, this principle has a broad applications in lots of different fields, such as in bank management and in insurance (see Mukuddem-Petersen and Petersen [10, 11]).

The paper is organized as follows. In Section 2, we formulate the maximizing expected utility problem and give some corresponding assumptions. Section 3 is devoted to establish the corresponding Bellmans dynamic programming principle and use it to solve the foregoing problem. In addition, some economic analysis on the optimal solutions is also given in this section. Section 4 concerns a special but nontrivial CRRA case. By a conjecture method arising from the classical linear quadratic (LQ) optimal control problems, the explicit optimal investment proportion and consumption choice are derived. Furthermore, some numerical simulations are used to explicitly illustrate the influence of the volatility parameters in foreign production and exchange rate market on the optimal investment strategy. Finally, we give some concluding remarks.

#### 2. Model and Formulation of the Problem

Let be a complete probability space endowed with a filtration . and are two one-dimensional Brownian motions defined on this space, which represents the external sources of uncertainty in the markets with the correlation coefficient .

Suppose the investor can put his money in the bank account to get nonrisk reward, and the price of the bank account satisfies the equation where is the interest rate and is the borrowing rate for any loan. Moreover, according to the real market situation, the borrowing rate should be a bit larger, that is, ..

On the other hand, the investor can choose a foreign real project with some production to get a higher return but with risk. The cash flow from this project in foreign currency numeraire is
with
Here and are input price and output price of the production, is the quantity of the output. *β* is a negative constant in general, and is the tax rate in the foreign country market.

Suppose that the input price and output price are described as where , are with the initial values , . is the exchange rate from foreign currency to domestic currency, and In the actual long time duration market, there is a mean reversion on the exchange rate. In our solving frame, we use a geometric Brownian motion to describe the exchange rate in a specified short time duration market to get an explicit optimal solution.

Due to the above expressions, it is easy to derive Then where Applying Itô's formula to , we can get where , . That is, the input price is not equal to the output price.

We translate the cash flow to domestic currency by exchange rate and let ; then where .

Let denote the total wealth at time and the amount investing in foreign market, then is the amount investing in non-risky bond. If stands for the consumption of the investor, then the change of the wealth would include three parts, the change of risky part and the risk-free part , and also the consumption , is the consumption rate. Finally it follows the equation Note that denotes the negative part of , whose value is when and 0 otherwise. It is not hard to see that only when the investor takes loan from bank, this part is taken into account.

Let us use the functions and to denote the investor's preference with respect to consumption and terminal wealth and the integral of the cumulated utility from the consumption. Suppose the investor wants to maximize the expected utility with the following assumption conditions(A1)are strictly increasing functions; (A2)are concave and differentiable w.r.t. and .

Note that these assumptions are common properties of utility function which can be seen in Karatzas [12]. The above formulates one kind of optimal control problems. Then the rest is devoted to solving it.

#### 3. Dynamic Programming Principle and the Optimal Solutions

In this section, we will show that the celebrated dynamic programming principle still holds for the optimization problem (2.12) and use it to give the optimal investment and consumption choice of the general case, then give the corresponding economic analysis.

The basic idea of the dynamic programming principle is to consider a family of optimal control problems and establish the relationships among them via the Hamilton-Jacobi-Bellman (HJB) equation. If the HJB equation is solvable, then we can obtain the desired optimal control. This is the so-called verification technique. As we know, dynamic programming method is now widely used to deal with some control problems, either deterministic or stochastic. (More results can be found for example, in Bellman [13], Peng [14], El Karoui and Quenez [15], etc.).

For any , define the value function and denote that .

We state the following dynamic programming principle for our optimal control problem which can be obtained by Lemma 3.2 of Chapter 4 in Yong and Zhou [16].

Proposition 3.1. *Let (A1) and (A2) hold. Then for any ,
*

Now we give the corresponding HJB equation.

Proposition 3.2. *Under the assumptions (A1) and (A2), if , then it is the solution of the following partial differential equation (HJB equation):
*

*Proof. *For fixed , applying Itô's formula to and then sending to , we can take the same steps as that of Proposition 3.5 of Chapter 4 in Yong and Zhou [16] to get the desired result.

The above proposition implies that if we could obtain the solution to the HJB equation, then we could construct an optimal control for the problem (2.11)-(2.12). This is called the verification technique, which is the chief method to solve this kind of optimization problems using dynamic programming principle.

According to the assumption of Proposition 3.2, it is natural to suppose that. This property is satisfied in many typical utility function cases such as CRRA case in the next section. This also means that the value function is nondecreasing and concave.

Suppose that the optimal consumption rate choice together with optimal proportion is the optimal solution to our problem, then , where denotes the inverse function of the consumption marginal utility.

Let us define then We have with maximal point with maximal point

Noting the assumption , , we then get that .

Now, let us discuss the optimal portfolio choice based on the relationship between and .

*Case 1 (). *From Figure 1, we can conclude that , then
The corresponding HJB equation is

It implies that the investor should borrow money from home bank and invest in foreign real project to get more profit in this case.

*Case 2 (). *From Figure 2, we can conclude that
The corresponding HJB equation is

It implies that the investor should put all his money into the foreign real project but without any loan in this situation.

*Case 3 (when ). *From Figure 3, we can conclude that
The corresponding HJB equation is

It means that the investor should invest some wealth in foreign real project while puting some of his money in home bank account to reduce the risk in this case.

Now we proceed to give the economic analysis for the optimal investment portfolio.

Denote that

Then is the optimal proportion of the total wealth invested in the real project. corresponds to the Pratt-Arrow measure of relative risk aversion which indicates the investor's attitude to the risk in the investment and refers to the total volatility of the portfolio in the foreign project, which is affected by not only the variability of the price but also the volatility of the exchange rate and their correlation coefficient.

We can rewrite the above result in the following form:

For the Cases 1 and 3, the optimal proportion can be referred as the speculative demand, which depends on the measure of relative risk aversion. Obviously, the optimal proportion is influenced by the variability of the portfolio. When increases, will decrease, that is, higher volatility in the foreign corporate market will simulate the investor to put more money in home riskless investment, that is, greater variability in oversea market can avoid home capital to flow out. On the other hand, the optimal proportion in the foreign corporate project is affected by whether the expectation rate of the cash flow in foreign project is higher than the interest (borrowing) rate in the bank.

#### 4. Special Case and Simulation

In this section, we will take a typical utility function (CRRA case) to get the explicit solution to the optimal portfolio choice and give the simulation to show the influence of the variability parameters in the market.

The CRRA utility function is where and are constants, , and is the discount factor. It is easily calculated that

Since the utility function has regular form, here we use a conjecture method arising form the classical LQ problems to solve this problem. We first conjecture that the value function is of a special form, then solve the HJB equation via ordinary differential equations.

In Case 1, let us conjecture that . The HJB equation can be rewritten as an Bernoulli type,

Solving this equation, we can get

Here

Then the explicit optimal solution to the first case is

Since , we have , that is, .

Similarly, solving (3.12) and (3.14) for Cases 2 and 3, respectively, we have with with

Finally we draw the following conclusion.

Proposition 4.1. * Under all the above assumptions, the optimal strategies to the optimal portfolio and consumption choice problem (2.11)-(2.12) for the specific CRRA case is given by
**Furthermore, the value function is given by
**
where , , and satisfy (4.4), (4.7), and (4.9), respectively.*

We can also give one conclusion which has explicit economics interpretation.

Proposition 4.2. * In CRRA case, we can get from simple calculus that the Pratt-Arrow measure of relative risk aversion , .*

*Remark 4.3. *The constant in CRRA utility function can indicate the investor's attitude to the risk in the market.

From the history of price data in the market, we can use statistical method to estimate the parameters in the model. The coefficients in the utility function can be determined by personal preference. Then we can use the above result to give an optimal investment choice for an investor in CRRA case. Now let us give a simulating example. In this example, let the coefficients be constants for simplicity, and we only consider the choice at initial time .

*Example 4.4. *Suppose an investor wants to make a corporate investment, but domestic investment may face much more competitions or cannot be executed due to certain policy barriers or monopoly restriction, such as crude oil exploitation in China. However, international corporate investment (e.g., to build a factory in some other countries) may be possible and profitable in some emerging markets due to the advantages in techniques, in human resources, and so on. The factory will produce and sell some products whose price is evaluated in foreign currency, for example, in US dollar. Meanwhile, he also needs to seek a domestic bond to catch a fundamental yield and avoid risk.

Here we just take the following parameters depending on the situation of the real market. Set , , , , , , , , , , , and .

From formula (4.11), we can draw the conclusion that the optimal proportion decreases when the volatility parameter or increases. And also the optimal proportion should be divided into three parts according to the different volatility. Let us first fix one of and and give the relationship between and another one.

In Figures 4 and 5, the curve goes just as we have expected.

Fixed (see Figure 4), when , , decreases down to 1. That means that high volatility in foreign corporate project market can stimulate to the riskless investment in home bond.

However, when the volatility is not too big and the expected reward of the foreign project is higher than the bond, the investor can borrow money from home bank and invest all his wealth into the project. Taking , for example, here . That is, she or he can borrow from home bank an amount about two thirds of his wealth to invest in the foreign project. When , . This implies that the investor should better put all his money to the foreign project but without any loan. When , continue decreasing. Taking , then . This shows the investor should better save about two fifths of his money in the home bank and invest the money left in the foreign project.

For fixed (see Figure 5), we can get a similar result. The high volatility in foreign exchange rate market can avoid home capital to flow out. In this case, when , . We also take several points for example. When , , that is, the investor's optimal choice is to borrow about twenty percents of his wealth and put all money into the foreign project.

The volatility in exchange rate between different currencies gives people a chance to get higher reward. We can take advantage of the difference created by the volatility just like that of a stock. But risk also comes along with the volatility. When one currency has a high volatility, it indicates that this kind of currency is not stable or even the economy of a country is not stable, so it is better not do any investment in that country.

We also give the variance tendency of with respect to both and . See Figure 6.

It tells us that the optimal proportion is a nonincreasing function of both and . When , , then , and at this time the investor can borrow money to invest in the foreign project. When ,, and the volatility of the foreign exchange rate is higher, we have . When , , . At this time, the investor has to put about half of his wealth in home bank. This coincides with the above economic analysis for the volatility of exchange rate.

#### 5. Conclusions

In this paper, we have considered one kind of investment and consumption choice problems for an investor who can invest her or his wealth either in a domestic bond or in an oversea real project. From Proposition 3.1, we knew that the classical Dynamical Programming Principle still holds for this optimal problem. The optimal investment and consumption choice have also been achieved by solving the corresponding H-J-B equation and the economic analysis was then given for that. For a typical CRRA utility function case, we got the explicit optimal investment and consumption strategy and then some simulation results illustrating the influence of market's volatility parameters to the optimal choice. We think similar idea may also be applied to consider the optimal auditing problem in bank management, since for the manager of a bank, he/she should decide the optimal capital allocation not only to make the maximal profit, but also to meet the auditing request according to Basel II. See Bosch et al. [17] and Petersen et al. [18] for more details.

One of the future tasks is to extend our model to a more general case, for instance, solving the problem under convex restriction which coincides better with the situation of the real market, generalizing the utility function to a more general case and so on. In addition, there are several interesting problems about the underlying topic, such as the corresponding convex restriction problem and the partial information problem. Since these problems are more consistent with the practical situation in real market, we will furthermore investigate them in further work and then desire to solve some practical optimization investment problems in financial market.

#### Acknowledgments

The authors would like to thank the editor and anonymous referee for many helpful comments and suggestions which have led to the improved version. This paper is supported by NSFC (10921101, 10926098), National Basic Research Program of China (973 Program) (2007CB814904), Shandong Provincial Natural Science Foundation (JQ200801 and 2008BS01024), the Postdoctoral Innovation Fund of Shandong Province (200903078), and IIFSDU (2009).

#### References

- J. J. Choi, “Diversification, exchange risk, and corporate international investment,”
*Journal of International Business Studies*, pp. 145–155, 1989. View at Google Scholar - D. Duffie,
*Dynamic Asset Picing Theory*, Princeton University Press, Princeton, NJ, USA, 1992. - R. Merton,
*Continuous-Time Finance*, Blackwell, Oxford, Uk, 1991. - T. Zariphopoulou, “Investment-consumption models with transaction fees and Markov-chain parameters,”
*SIAM Journal on Control and Optimization*, vol. 30, no. 3, pp. 613–636, 1992. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - T. Zariphopoulou, “Consumption-investment models with constraints,”
*SIAM Journal on Control and Optimization*, vol. 32, no. 1, pp. 59–85, 1994. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - M. Bellalah and Z. Wu, “A simple model of corporate international investment under incomplete information and taxes,”
*Annals of Operations Research*, vol. 165, no. 1, pp. 123–143, 2009. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - G. C. Wang and Z. Wu, “General maximum principles for partially observed risk-sensitive optimal control problems and applications to finance,”
*Journal of Optimization Theory and Applications*, vol. 141, no. 3, pp. 677–700, 2009. View at Publisher · View at Google Scholar · View at Scopus - N. El Karoui, S. Peng, and M. C. Quenez, “Backward stochastic differential equations in finance,”
*Mathematical Finance*, vol. 7, no. 1, pp. 1–71, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - R. Bellman, “On the theory of dynamic programming,”
*Proceedings of the National Academy of Sciences of the United States of America*, vol. 38, pp. 716–719, 1952. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Mukuddem-Petersen and M. A. Petersen, “Bank management via stochastic optimal control,”
*Automatica*, vol. 42, no. 8, pp. 1395–1406, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Mukuddem-Petersen and M. A. Petersen, “Optimizing asset and capital adequacy management in banking,”
*Journal of Optimization Theory and Applications*, vol. 137, no. 1, pp. 205–230, 2008. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - I. Karatzas, “Optimization problems in the theory of continuous trading,”
*SIAM Journal on Control and Optimization*, vol. 27, no. 6, pp. 1221–1259, 1987. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - R. Bellman,
*Dynamic Programming*, Princeton University Press, Princeton, NJ, USA, 1957. - S. G. Peng, “A generalized dynamic programming principle and Hamilton-Jacobi-Bellman equation,”
*Stochastics and Stochastics Reports*, vol. 38, no. 2, pp. 119–134, 1992. View at Google Scholar · View at Zentralblatt MATH - N. El Karoui and M.-C. Quenez, “Dynamic programming and pricing of contingent claims in an incomplete market,”
*SIAM Journal on Control and Optimization*, vol. 33, no. 1, pp. 29–66, 1995. View at Publisher · View at Google Scholar · View at Zentralblatt MATH - J. Yong and X. Y. Zhou,
*Stochastic Control: Hamiltonian Systems and HJB Equations*, vol. 43 of*Applications of Mathematics*, Springer, New York, NY, USA, 1999. - T. Bosch, J. Mukuddem-Petersen, M. A. Petersen, and I. Schoeman, “Optimal auditing in the banking industry,”
*Optimal Control Applications & Methods*, vol. 29, no. 2, pp. 127–158, 2008. View at Publisher · View at Google Scholar - M. A. Petersen, M. C. Senosi, and J. Mukuddem-Petersen,
*Subprime Mortgage Models*, Nova, New York, NY, USA, 2010.