Abstract and Applied Analysis

Volume 2013, Article ID 357931, 7 pages

http://dx.doi.org/10.1155/2013/357931

## An Efficient Pseudospectral Method for Solving a Class of Nonlinear Optimal Control Problems

^{1}Department of Mathematics, Islamic Azad University, Zahedan Branch, Zahedan, Iran^{2}Department of Mathematics, Universiti Putra Malaysia (UPM), 43400 Serdang, Malaysia^{3}Department of Applied Mathematics, School of Mathematical Sciences, Ferdowsi University of Mashhad, Mashhad, Iran

Received 10 March 2013; Accepted 30 July 2013

Academic Editor: Mustafa Bayram

Copyright © 2013 Emran Tohidi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

#### Abstract

This paper gives a robust pseudospectral scheme for solving a class of nonlinear optimal control problems (OCPs) governed by differential inclusions. The basic idea includes two major stages. At the first stage, we linearize the nonlinear dynamical system by an interesting technique which is called linear combination property of intervals. After this stage, the linearized dynamical system is transformed into a multi domain dynamical system via computational interval partitioning. Moreover, the integral form of this multidomain dynamical system is considered. Collocating these constraints at the Legendre Gauss Lobatto (LGL) points together with using the Legendre Gauss Lobatto quadrature rule for approximating the involved integrals enables us to transform the basic OCPs into the associated nonlinear programming problems (NLPs). In all parts of this procedure, the associated control and state functions are approximated by piecewise constants and piecewise polynomials, respectively. An illustrative example is provided for confirming the accuracy and applicability of the proposed idea.

#### 1. Introduction

Optimal control problems (OCPs) have received considerable attention during the last four decades because of their applications. Such problems arise in many areas of science and engineering and play an important role in the modeling of real-life phenomena in other fields of science. The principal difficulty in studying OCPs via traditional and classical methods lies in their special nature. Obviously, most of OCPs cannot be solved by the well-known indirect methods [1, 2]. Therefore, it is highly desirable to design accurate direct numerical approaches to approximate the solutions of OCPs [3].

Among all of the numerical techniques for solving smooth OCPs, orthogonal functions and polynomials have been applied in a huge size of research works. High accuracy and ease of applying these polynomials and functions for OCPs are two important advantages which have encouraged many authors to use them for different types of problems. For solving smooth OCPs, there exist a broad class of methods based on orthogonal polynomials which were presented by famous applied mathematics scientists such as [4, 5]. The fundamental idea of these methods is based upon pseudospectral (or spectral collocation) operational matrices of differentiation. However, Legendre spectral operational matrix of differentiation was used in [6] (for other applications of spectral operational matrices of differentiation see [7]). The best property of the spectral operational matrices of differentiation is the sparsity, while the pseudospectral ones are relatively filled matrices. Another computational approach for solving OCPs which is based on high order Gauss quadrature rules was presented in [8]. However, high order of accuracy may be obtained by this method, but suitable preconditionings should be explored because of its ill-conditioning of the associated algebraic system.

In many real mathematical models, the controller should be restricted. In other words, the control functions of OCPs are bounded in many cases. According to the classical theory of optimal control [9], if the control functions are bounded and appear linearly in the cost functionals and dynamical systems, the resulting problem is a Bang-Bang OCP. In this case, the control functions are discontinuous. Therefore, we deal with a nonsmooth OCP. For dealing with such nonsmooth OCPs, some new numerical methods have been proposed in the literature such as [10, 11]. These approaches are based on finite difference methods (FDMs). Simplicity of the discretization by FDMs is usually easy to handle, but lower order of accuracy may make them unsuccessful. Therefore, we should look at high order numerical methods such as spectral or pseudospectral techniques. But, as it is mentioned in the literature, spectral schemes are the best tools just for the problems with smooth solutions and data. In other words, if we apply these methods for approximating nonsmooth functions we usually observe the Gibbs phenomena. The following example illustrates this fact.

*Example 1 (see [9]). *We consider the following OCP:

Since the computational interval is , we should change it into by a simple transformation as follows:

The optimal control of the above-mentioned problem is given in the following form:

For approximating the control function of this problem, we use the classical spectral method [6]. As it is depicted in Figures 1 and 2, the desired optimal control cannot be obtained in a good manner. From these Figures one can observe that not only the exact value of switching point (i.e., ) is not detected with a high accuracy, but also the obtained solutions have additional jumps in the boundary of domain. These are the disadvantages of the applying the classical spectral methods for solving nonsmooth problems.

To delete these mentioned disadvantages, a robust spectral method is presented in [12] for solving a class of nonsmooth OCPs that has some fundamental differences with the classical spectral techniques. First, the computational interval is partitioned into subintervals where the size of each subinterval is considered as an unknown parameter, and this enables us to compute the switching times more efficiently. Second, in contrast with the classical spectral schemes, the integral form of the dynamical system is considered. This equivalent form is found by integrating the differential dynamics and adding the initial conditions.

Our fundamental goal of this paper is to extend a new idea which was introduced in [12] to approximate the control and state functions of the following nonsmooth OCP: where is a set of continuous functions on and is a set which contains boundary points of state variable . Also, , , and . According to discussions in [11], we can assume that where is a compact set and is a continuous function on . Thus, OCP (4) can be rewritten in the form

It should be noted that the dynamical system of (6) is nonlinear in terms of control . For handling OCP (6) in a proper manner, we first linearize the nonlinear dynamical system by an interesting technique which is called linear combination property of intervals (LCPI). After this stage, the linearized dynamical system is transformed into a multidomain dynamical system via computational interval partitioning. Collocating these constraints at the Legendre Gauss Lobatto (LGL) points together with using the Legendre Gauss Lobatto quadrature rule for approximating the involved integrals enables us to transform the basic OCPs into the associated nonlinear programming problems (NLPs).

The paper is organized as follows. Section 2 is devoted to linearize the nonlinear dynamical system by using LCPI. In Section 3, we design our basic idea which is based on approximation of the associated control and state functions by piecewise constant and piecewise polynomials, respectively. It should be noted that Legendre Gauss Lobatto points are used for collocating the linearized dynamical system. In Section 4, we present a numerical example, demonstrating the efficiency of the suggested numerical algorithm. Concluding remarks are given in Section 5.

#### 2. Dynamical System Linearization

Since is continuous and is a compact and connected subset of , then is a closed set in . Thus, for is closed in . Now, suppose that the lower and upper bounds of the are and , respectively. Therefore,

In other words,

By using LCPI, which was first introduced in [10], can be approximated as a convex linear combination of its minimum and maximum in the following form: where and . It should be mentioned that all the are the new associated control variables. Now, the main problem (6) is approximated by the following OCP: where , , and = . Note that problem (10) is a Bang-Bang OCP, because in this problem the new control has lower 0 and upper 1 bounds and appears linearly in the dynamical equations. As soon as the controls are assumed to be bang-bang, the problem of finding the required controls becomes one of finding the switching times.

#### 3. Discretization of the New OCP Containing Linearized Dynamical System

In the sequel and for simplicity in the discretization procedure, we assume that (in other words, ) and suppose that problem (10) has an optimal solution with switching points denoted by . So if we set and , then the interval breaks into subintervals. That is, where on each subinterval, is constant. We denote in th subinterval with constant . Since , we have

Moreover, we take the restriction of to the th subinterval by . By considering (11), the dynamical system of (10) is conveyed as

It should be noted that (15) is assumed to guarantee the continuity of state functions. Integrating (13) gives rise to the following dynamic equations: where and

The final condition is imposed only on as

Therefore, problem (10) is transformed into the following optimization problem: For discretizing (19), we assume , , to be the shifted LGL nodes to subinterval ; that is, . By using Lagrange interpolation, we approximate by where and

It should be noted that is the th Lagrange basis function. Since is approximated, therefore can be approximated in the th subinterval as follows:

Now by substituting approximations (20) and (22) into (19), we get

From (17) and (20) for , we have . Now if we set , then we obtain

Collocating (23) at , , , yields

Now, by applying a simple linear transformation, we transform the interval into as follows:

Therefore, the Legendre Gauss Lobatto quadrature rule can be applied in the following form: where , , = for are the LGL weights and is the th degree Legendre Polynomial.

So by considering , problem (19) is discretized to the following NLP:

Here, , , , , and parameters are unknown variables in the NLP. Note that is known and .

In the above discretization procedure, the number of switching points, , is considered as a known parameter. So at first we should guess the number of switching points. This is the disadvantage of the proposed method. It should be noted that if the number of switching points, , is chosen correctly, then the resulting value of is equal to its lower or upper bounds; furthermore, changes in each switching point.

#### 4. Numerical Example

We now apply the proposed idea for solving a nonlinear OCP governed by differential inclusion. This example was first introduced in [11]. In the mentioned work, the authors used the simplest form of FDMs. One of the advantages of [11] is that we finally solve a Linear Programming (LP) problem. However, this method has other disadvantages such as needing higher values of approximations (i.e., ), and this leads to ill-conditioning of the associated discrete problem. Our presented ideas do not contains the difficulties of the classical spectral methods and FDMs for solving nonsmooth OCPs and also achieve superior results with respect to at least 3 other methods. These advantages confirm the efficiency of this modern spectral approximation. The following example is modeled using the mathematical software package MAPLE, and the corresponding nonlinear programming problem is solved using the command NLPSolve. It should be noted that if the NLP is univariate and unconstrained except for finite bounds, quadratic interpolation method may be used. If the problem is unconstrained and the gradient of the objective function is available, the preconditioned conjugate gradient (PCG) method may be used. Otherwise, the sequential quadratic programming (SQP) method can be used. According to the structure of our NLP, the SQP method is used.

*Example 2. *We consider the following nonlinear OCP governed by differential inclusion:

According to discussions in [11], the above OCP can be rewritten in the following form:

In this problem, the control function appears nonlinearly, and we should linearize the initial dynamical system. According to the idea of LCPI, the above OCP can be reduced to a linear OCP which is Bang-Bang. Here, . Thus, and hence, . Therefore, can be approximated as follows:

It should be noted that is the new control function, which is called associated control. By considering this approximation for , the basic OCP is approximated by the following Bang-Bang OCP:

According to our experiences in [11], we assume that the number of switching points is . Since by applying this assumption we reach to the exact results in which the new associated control is switched between its lower and upper bounds, the numerical results related to the values of switching points and objective function for different values of are provided in Table 1. Moreover, the associated control , control , and optimal state are depicted in Figures 3, 4, and 5, respectively. Moreover, in Table 2 comparisons of the numerical results of the proposed method with respect to the methods of [6, 10, 13] are given. From this table one can see the efficiency and applicability of the suggested method for solving nonlinear OCPs governed by differential inclusions.

#### 5. Concluding Remarks

In this study, a robust numerical technique has been used for solving a class of optimal control problems (OCPs) governed by differential inclusions. The proposed idea includes linearizing the dynamical system in which the resulting problem is a Bang-Bang OCP. After obtaining this nonsmooth OCP, we use the general idea of [12] for dealing with such problems in the best manner. As observed in the numerical example, the proposed scheme has superior results with regard to at least 3 methods which confirm the applicability of the method. One of the disadvantages of our method is more sensitivity to initial guess in comparison with the classical spectral schemes. However, our idea is terminated successfully by considering an initial guess from the solution of the traditional spectral techniques, even for small values of .

#### Conflict of Interests

The authors declare that they do not have any conflict of interests in their submitted paper.

#### Acknowledgment

The authors thank the referee for his or her valuable comments and helpful suggestions which led to the improved version of the paper.

#### References

- J. T. Betts, “Survey of numerical methods for trajectory optimization,”
*Journal of Guidance, Control, and Dynamics*, vol. 21, no. 2, pp. 193–207, 1998. View at Publisher · View at Google Scholar · View at Scopus - E. Tohidi, F. Soleymani, and A. Kilicman, “Robustness of operational matrices of differentiation for solving state-space analysis and optimal control problems,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 535979, 9 pages, 2013. View at Publisher · View at Google Scholar - J. T. Betts,
*Practical Methods for Optimal Control Using Nonlinear Programming*, vol. 3 of*Advances in Design and Control*, Society for Industrial and Applied Mathematics, Philadelphia, Pa, USA, 2001. View at MathSciNet - G. Elnagar, M. A. Kazemi, and M. Razzaghi, “The pseudospectral Legendre method for discretizing optimal control problems,”
*IEEE Transactions on Automatic Control*, vol. 40, no. 10, pp. 1793–1796, 1995. View at Publisher · View at Google Scholar · View at MathSciNet - F. Fahroo and I. M. Ross, “Direct trajectory optimization by a Chebyshev pseudospectral method,”
*Journal of Guidance, Control, and Dynamics*, vol. 25, no. 1, pp. 160–166, 2002. View at Publisher · View at Google Scholar · View at Scopus - E. Tohidi, O. R. N. Samadi, and M. H. Farahi, “Legendre approximation for solving a class of nonlinear optimal control problems,”
*Journal of Mathematical Finance*, vol. 1, pp. 8–13, 2011. View at Publisher · View at Google Scholar - F. Toutounian, E. Tohidi, and A. Kilicman, “Fourier operational matrices of differentiation and transmission: Introduction and Applications,”
*Abstract and Applied Analysis*, vol. 2013, Article ID 198926, 11 pages, 2013. View at Publisher · View at Google Scholar - E. Tohidi and O. R. N. Samadi, “Optimal control of nonlinear Volterra integral equations via Legendre Polynomials,”
*IMA Journal of Mathematical Control and Information*, vol. 30, no. 1, pp. 67–83. View at Publisher · View at Google Scholar - A. E. Bryson, Jr. and Y. C. Ho,
*Applied Optimal Control*, Hemisphere, New York, NY, USA, 1975. View at MathSciNet - M. H. Noori Skandari and E. Tohidi, “Numerical solution of a class of nonlinear optimal control problems using linearization and discretization,”
*Applied Mathematics*, vol. 2, no. 5, pp. 646–652, 2011. View at Publisher · View at Google Scholar · View at MathSciNet - E. Tohidi and M. H. Noori Skandari, “A new approach for a class of nonlinear optimal control problems using linear combination property of intervals,”
*Journal of Computations and Modelling*, vol. 1, pp. 145–156, 2011. View at Google Scholar - M. Shamsi, “A modified pseudospectral scheme for accurate solution of Bang-Bang optimal control problems,”
*Optimal Control Applications and Methods*, vol. 32, no. 6, pp. 668–680, 2011. View at Publisher · View at Google Scholar · View at Scopus - O. von Stryk, “Numerical solution of optimal control problems by direct collocation,” in
*Optional Control of Variations, Optimal Control Theory and Numerical Methods*, R. Bulrisch, A. Miele, and J. Stoer, Eds., International Series of Numerical Mathematics, pp. 129–143, Birkhäuser, Basel, Switzerland, 1993. View at Google Scholar · View at MathSciNet