Research Article | Open Access

M. J. Mardanov, Y. A. Sharifov, "Pontryagin’s Maximum Principle for the Optimal Control Problems with Multipoint Boundary Conditions", *Abstract and Applied Analysis*, vol. 2015, Article ID 428042, 6 pages, 2015. https://doi.org/10.1155/2015/428042

# Pontryagin’s Maximum Principle for the Optimal Control Problems with Multipoint Boundary Conditions

**Academic Editor:**Allaberen Ashyralyev

#### Abstract

Optimal control problem with multipoint boundary conditions is considered. Sufficient conditions for the existence and uniqueness of the solution of boundary value problem for every fixed admissible control are obtained. First order increment formula for the functional is derived. Pontryagin’s maximum principle is proved by using the variations of admissible control.

#### 1. Introduction

Boundary value problems appear in a large field of sciences to describe physical, biological, and chemical phenomena and several practically important problems lead to multipoint boundary value problems. Some examples are given in the area of elasticity and on the effects of soil settlement [1–5]. For boundary value problems with multipoint boundary conditions and comments on their importance, we refer the reader to the papers [6–11] and the references therein.

Pontryagin’s maximum principle is the first order necessary optimality condition and occupies a special place in theory of optimal processes. Originally the maximum principle was proved for the Cauchy system of ordinary differential equations [12]. Later on this result was carried over the most complex objects described by the equations with a delay, integral equations, partial equations, stochastic equations, and so forth (see, e.g., [13, 14] and the references therein).

At present, there exists a great amount of work devoted to derivation of necessary optimality conditions of first and second orders for the systems with local conditions (see [12, 14–19] and the references therein).

Recently, the optimal control problems with nonlocal conditions are intensively investigated. In the papers [13, 20–24] the necessary optimality conditions for optimal control problems described by the systems of ordinary differential equations with nonlocal conditions were obtained. In these papers the nonlocal conditions contain two-point and integral boundary conditions.

It is known that the solution of problems of mechanics and control processes is reduced to multipoint boundary value problems. The constructive sufficient existence and uniqueness conditions and also the methods of numerical solution of such boundary value problems were studied in [6–9].

In the present paper, Pontryagin’s maximum principle for optimal control problems for the ordinary differential equations with multipoint boundary conditions is proved. Since in optimal control problems with multipoint boundary conditions the solution of the associated system has discontinuities of the first kind of inner points, the direct applications of the solution methods of two-point boundary value problems to optimal control problems with multipoint boundary conditions are impossible.

The paper is organized as follows. First, we give the statement of the problem. Second, theorems on existence and uniqueness of the solution of problem (1)–(3) are established under some sufficient conditions on the nonlinear terms. Third, the first order increment formula for the functional is presented and Pontryagin’s maximum principle is provided.

#### 2. Problem Statement

Let the controlled process on a fixed time interval be described by a system of differential equations with multipoint boundary conditions where ; is the given dimensional vector-function; is the given constant vector; are fixed points; is the dimensional and bounded vector of control actions with the values from the nonempty, bounded set ; that is,

It is required to minimize the functional subject to (1)–(3).

Here we assumed that the functions , , and are continuous over the set of arguments and have bounded partial derivatives with respect to the arguments and . Under the solution of problem (1)–(3) that corresponds to the fixed admissible control we take the function absolutely continuous on the interval .

Denote by a space of continuous functions on the interval with the values from . Obviously, such a space is Banach with the norm where is the norm .

The admissible process , being the solution of problem (1)–(4), that is, delivering minimum to the functional (4) under restrictions (1)–(3), will be called an optimal process and an optimal control.

#### 3. Existence of Solutions of Boundary Value Problem (1)–(3)

Introduce the following conditions.(À1)Let , where .(À2)The function is continuous and there exists a constant such that (À3), where . is a piecewise matrix such that , ():

Theorem 1. *Let condition (À1) be fulfilled. The function is an absolute continuous solution of problem (1)–(3) if and only if
**
where the matrix function is determined by equality (7).*

*Proof. *Let the function be a solution of (1). Then for the formula is valid:
where is an arbitrary constant vector. In order to determine the required function defined by equality (9) satisfies condition (2):

Since, according to condition (À1), , then it follows from equality (10) that
which may be rewritten in the form

Now taking into account the value of determined by equality (12) in (9) we get
Obviously, for , we can write equality (13) in equivalent form:

So
holds; then by using (7) we can rewrite equality (14) in the following equivalent form:

Thus, it is shown that boundary value problem (1)–(3) may be rewritten in equivalent integral form (8). By direct calculation we can show that the solution of integral equation (8) is a solution of boundary value problem (1)–(3).

Theorem 2. *Let conditions (À1)–(À3) be fulfilled. Then for any and any fixed admissible control, boundary value problem (1)–(3) has the unique solution satisfying the integral equation (8).*

*Proof. *Let and be fixed. Let us consider the mapping determined according to the rule:

Obviously, the fixed points of the operator are a solution of boundary value problem (1)-(2). Using the Banach method of contractive operators we show that the operator determined by equality (17) has a fixed point. For any we have
or

Here taking into account condition (À3) we get that the operator has the unique fixed point in (17). This shows that integral equation (8) has the unique solution and therefore the equivalent boundary value problem (1)–(3) also has a unique solution. Theorem 2 is proved.

#### 4. Increment Formula for the Functional

The increment method is one of the simplest ones among the methods for proving the maximum principle. In order to obtain the necessary conditions for optimality, we will use the standard procedure (see, e.g., [16]).

Let and , , be two admissible controls and let , , , be appropriate trajectories. Then, obviously, is the solution of the following boundary value problem: Here are the denotations of total increment of the function . We can write the increment of functional (4) in the form

Let be an arbitrary nontrivial vector-function and let be a scalar vector. Then we can rewrite the increment of functional (4) in the form

After some standard operators usually used in deriving necessary optimality conditions of the first order, for the increments formula we get the following equality: where .

Now assume that the unknown vector-function and the scalar vector is a solution of the following boundary value problem:

The difference-differential (24)–(26) boundary value problem is called an adjoint problem in parametric form since it conditions the unknown parameter . From the adjoint system (24)-(25) it is seen that the solution of this system at the points , (), has the first order discontinuities. This is the essential peculiarity of multipoint boundary conditions.

From condition (À1) and from the system (24)-(25) we can exclude the unknown vector . Indeed, from equality (25) we have Hence

Now take into account the found value of expressed in (26) in equalities (25) and (26). Then equalities (25) and (26) take the form

Taking into account equalities (24) and (25) in (23), we get the final form for the increment of the functional

#### 5. Pontryagin’s Maximum Principle

At different proofs of the maximum principle, the needle-shaped variation plays one of the main parts. We choose the “perturbed” control in the special way: where the parameters of the needle-shaped variation satisfy the following conditions. is a regular point of the control , , , . For any satisfying the enumerated conditions, the control is admissible.

The traditional form of necessary optimality conditions will follow from increments formula (30) if we show that on the needle-shaped variation the increment of phase states is of order . This will follow from conditions (À1)–(À3) and boundary value problem (20):

From (32) we get

If in inequality we take , we have Estimation (33) shows that, for , where .

Use the increment formula (30) and the property of the needle-shaped variation. Then

Since the point is a regular point of the control , from the Taylor formula it follows that

Pontryagin’s maximum principle follows from formula (37).

Theorem 3 (maximum principle). *Let the admissible process , be optimal in problem (1)–(4) and let be a solution of conjugated problem (24)-(25) calculated on optimal process. Then for all the following equality is fulfilled:
*

Corollary 4. *If in the optimal control problem the function is linear with respect to and the functions , are convex with respect to , and , respectively, then the maximum principle is necessary and sufficient for optimality. This fact follows from increment formula (30). Indeed, in this case,
*

Since the functions and are convex, then , .

*Other Optimality Conditions.* In this item we suppose that the function is differentiable and the set is convex. Then from Theorem 3 we get the following theorem.

Theorem 5 (differential principle of maximum). *Let the process , , be optimal in problem (1)–(4) and let be an appropriate solution of adjoint problem (24)–(26). Then,
*

*Proof. *Suppose the contrary. Let there exist , , , such that

Let . Construct the vector

Since the set is convex, then . From maximum principle (38) and equality (41) it follows that the inequality
is valid for all rather small , which is impossible, since by supposition . Indeed, the right part of (43) for rather small is positive. The theorem is proved.

Note that condition (40) for verification is simpler than condition (38) by virtue of linearity of the right hand side of (43). However, assumptions on convexity of and differentiability of the function with respect to contract the application of condition (41).

Note that there exist optimal control problems for which condition (40) is valid, and the maximum principle gives no information. This determines the value of the differential principle of maximum.

The following theorem follows from the maximum principle.

Theorem 6 (stationary state principle). *Let be an open set. Then at each the optimal control delivers the stationary value to the function ; that is,
*

#### 6. Discussion of the Obtained Results

In this paper different necessary optimality conditions of first order were obtained for optimal control problems with multipoint boundary conditions. This problem is rather general and contains different special cases.(i)The first case is the Cauchy problem (in this case and is a unit matrix).(ii)The second case is the problem with two-point boundary conditions (in this case ).(iii)Each equation of (1) has its initial condition; that is, dimension of the vector equals and (; ) and Here is some permutation ().

#### Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

#### References

- J. Prescott,
*Applied Elasticity*, Dover Publications, New York, NY, USA, 1961. View at: MathSciNet - S. P. Timoshenko,
*Theory of Elastic Stability*, McGraw-Hill, New York, NY, USA, 1961. - E. H. Mansfield,
*The Bending and Stretching of Plates*, vol. 6 of*International Series of Monographs on Aeronautics and Astronautics*, Pergamon Press, New York, NY, USA, 1964. - E. Dulacska,
*Soil Settlement Effects Buildings, Development Getechn. Engrg.*, vol. 69, Elsevier, Amsterdam, The Netherlands, 1992. - A. Dhamacharen and K. Chompuvised, “An efficient method for solving multipoint equation boundary value problems,”
*World Academy of Science, Engineering and Technology*, vol. 75, pp. 61–65, 2013. View at: Google Scholar - M. Urabe, “An existence theorem for multi-point boundary value problems,”
*Funkcialaj Ekvacioj. Serio Internacia*, vol. 9, pp. 43–60, 1966. View at: Google Scholar | MathSciNet - A. Ashyralyev and O. Yildirim, “On multipoint nonlocal boundary value problems for hyperbolic differential and difference equations,”
*Taiwanese Journal of Mathematics*, vol. 14, no. 1, pp. 165–194, 2010. View at: Google Scholar | Zentralblatt MATH | MathSciNet - P. W. Eloe and J. Henderson, “Multipoint boundary value problems for ordinary differential systems,”
*Journal of Differential Equations*, vol. 114, no. 1, pp. 232–242, 1994. View at: Publisher Site | Google Scholar - J. R. Graef and L. Kong, “Solutions of second order multi-point boundary value problems,”
*Mathematical Proceedings of the Cambridge Philosophical Society*, vol. 145, no. 2, pp. 489–510, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - V. A. Il'in and E. I. Moiseev, “Nonlocal boundary value problem of the first kind for a strum-Lowville operator in its differential and difference aspects,”
*Differential Equations*, vol. 23, pp. 803–810, 1987. View at: Google Scholar - V. A. Il'in and E. I. Moiseev, “Nonlocal boundary value problem of the first kind for a Strum-Lowville operator,”
*Differential Equations*, vol. 23, pp. 979–987, 1987. View at: Google Scholar - L. Pontryagin, V. Boltyanski, R. Gamkrelidze, and E. Mishchenko,
*Mathematical Theory of Optimal Processes*, Wiley, Chichester, UK, 1962. - Y. A. Sharifov, “Optimality conditions in problems of control over systems of impulsive differential equations with nonlocal boundary conditions,”
*Ukrainian Mathematical Journal*, vol. 64, no. 6, pp. 958–970, 2012. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - R. Gabasov and F. M. Kirillova,
*Singular Optimal Controls*, Nauka, Moscow, Russia, 1973, (Russian). View at: MathSciNet - F. P. Vasil'ev,
*Optimization Methods*, Factorial Press, Moscow, Russia, 2002. - O. V. Vasiliev,
*Optimization Methods (Advanced Series in Mathematical Science and Engineering)*, vol. 5, World Federation Publishers Company, Atlanta, Ga, USA, 1996. View at: MathSciNet - A. J. Krener, “The high order maximal principle and its application to singular extremals,”
*SIAM Journal on Control and Optimization*, vol. 15, no. 2, pp. 256–293, 1977. View at: Publisher Site | Google Scholar | Zentralblatt MATH | MathSciNet - H. J. Kelley, R. E. Kopp, and H. G. Moyer, “Singular extremals,” in
*Topics in Optimization*, G. Leitmann, Ed., pp. 63–101, Academic Press, New York, NY, USA, 1967. View at: Google Scholar - M. J. Mardanov, K. B. Mansimov, and T. K. Melikov,
*Investigation of Singular Controls and Second Order Necessary Optimality Conditions in Systems with Delay*, Elm, Baku, Azerbaijan, 2013. - Y. A. Sharifov and N. B. Mamedova, “On second-order necessary optimality conditions in the classical sense for systems with nonlocal conditions,”
*Differential Equations*, vol. 48, no. 4, pp. 605–608, 2012. View at: Publisher Site | Google Scholar | MathSciNet - M. F. Mekhtiyev, S. I. Djabrailov, and Y. A. Sharifov, “Necessary optimality conditions of second order in classical sense in optimal control problems of three-point conditions,”
*Journal of Automation and Information Sciences*, vol. 42, no. 3, pp. 47–57, 2010. View at: Publisher Site | Google Scholar - O. Vasilieva and K. Mizukami, “Optimality criterion for singular controllers: linear boundary conditions,”
*Journal of Mathematical Analysis and Applications*, vol. 213, no. 2, pp. 620–641, 1997. View at: Publisher Site | Google Scholar | MathSciNet - A. Ashyralyev and Y. A. Sharifov, “Optimal control problems for impulsive systems with integral boundary conditions,”
*Electronic Journal of Differential Equations*, vol. 2013, no. 80, pp. 1–11, 2013. View at: Publisher Site | Google Scholar | MathSciNet - A. R. Safari, M. F. Mekhtiyev, and Y. A. Sharifov, “Maximum principle in the optimal control problems for systems with integral boundary conditions and its extension,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 946910, 9 pages, 2013. View at: Publisher Site | Google Scholar | MathSciNet

#### Copyright

Copyright © 2015 M. J. Mardanov and Y. A. Sharifov. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.