Research Article  Open Access
Optimization of a PumpedStorage FixedHead Hydroplant: The BangSingularBang Solution
Abstract
We consider the problem of the optimization of the functioning of a pumpedstorage hydroplant. The problem can be mathematically formulated as an optimal control problem, and when the considered hydromodel is of the fixedhead type, an added complication arises: the solution is of the bangsingularbang type. In this paper, we propose a simple and efficient optimization algorithm to find the solution.
1. Introduction
This paper has a clear aim: optimizing the functioning of a pumpedstorage hydroplant, with the context of the decentralized Spanish electricity market [1].
In the literature (see [2, 3]), numerous simplifications are performed to model plants of this kind, in order to obtain an extremely simple mathematical formulation which permits the use of commercial packages of, for instance, linear programming. Readers are referred to [4], which constitutes an excellent list of over 100 of relevant research papers on the hydroplant modeling.
However, the optimization of pumpedstorage hydroplants is a complex Dynamic Programming problem [5], with given time and final state. The problem can be mathematically formulated as a standard Lagrangetype optimal control problem [6]. In a previous paper [7] the authors considered a variablehead model for the pumpedstorage hydroplant. The solution can be obtained using Pontryagin’s Maximum Principle [5]. In another previous paper [8] the authors considered a fixedhead model for a conventional hydroplant, without pumping capacity. The solution is of the bangbang type, and the absence of singular arcs was proven. However, when the considered model is fixed head and pumped storage simultaneously, an added complication arises: the solution is of the bangsingularbang type.
Different methods for determining optimal controls with a possibly singular part have already been developed. A popular approach introduced by Jacobson et al. [9] has been used by a number of researchers including Edgar and Lapidus [10, 11] and more recently by Chen and Huang [12]. This method involves solving the singular/bangbang optimal control problem as the limit of a series of nonsingular problems. It is important to establish the limitations of these perturbationbased methods for practical problems. In fact, the convergence criterion described in [9] requires that the perturbation parameter, , be sufficiently small; however, numerical difficulties result when approaches a zero limit. The reader is referred to [12–14] for further details. Maurer et al. [15] presented a numerical scheme for computing optimal bangbang controls. They assume that every component of the optimal control is bangbang and that there are only a known finite number of switching times. Assuming that the optimal control structure is known, [16] formulates a new finitedimensional optimization problem involving the initial states, the switching times, and the final time as optimization variables. Another idea is to guess a possible control structure and start with some additional bangbang and singular arcs. The optimization approach will then lead to a solution where the lengths of all redundant arcs will be optimized to zero. Alternatively, the direct monotone structural evolution method [17] additionally takes advantage of the minimum principle optimality conditions to obtain the correct control structure. For the study of sufficient conditions, the reader is referred, for example, to [18, 19].
Faced with the existence of diverse general methods for bangsingularbang problems, in this paper we have developed a specific algorithm for our problem. Our method needs no prior knowledge of the number and location of the bangsingularbang arcs neither does it handle any parameter (like, e.g., discretization or a penalization factor) that has an influence on convergence or the precision of the result.
In this paper we propose a simple and efficient optimization algorithm to find the bangsingularbang solution to our hydroproblem. Though we treat only a specific hydraulic problem, it should be noted that our method may be applied to other problems with the same characteristics. The paper is organized in the following way. In Section 2 we set out the corresponding mathematical problem. Section 3 summarizes the optimization algorithm based upon the previous mathematical fundaments. Finally, the results obtained in an example are presented in Section 4, and the conclusions reached in this study are discussed in Section 5.
2. Mathematical Optimization of a PumpedStorage Hydroplant
A basic physicallybased relationship between the active power generated by a hydroplant, (in MW), the rate of water discharge, (in m^{3}/s), and the effective head, (in m), is given by where is the efficiency (in m^{4}/h·MW) (see [20, 21]). For a large capacity reservoir, it is practical to assume that the effective head is constant over the optimization interval. Here the fixedhead hydroplant model is defined and is represented by the linear equation: where represents the efficiency and diverse parameters related to the geometry of the station (see [20] for further details). Pumpedstorage is a wellknown type of hydroplants used for load balancing. The method stores energy in the form of water, which is pumped from a lower to an upper reservoir. At times of low electrical demand, electric power is used to pump water into the upper reservoir. During periods of high electrical demand, water is released back into the lower reservoir through a turbine, thereby generating electricity.
Taking into account the conversion losses of the pumping process and evaporation losses from the exposed water surface, a maximum of or of the electrical energy used to pump the water into the elevated reservoir can be regained. Thus, we must introduce the efficiency, , in the model. Despite these losses, when scheduling is optimized, the system increases revenue by selling more electricity during periods of peak demand, when electricity prices get higher. Hence, when pumpedstorage plants are considered, the function is defined piecewise as If we assume that is the volume of water that must be discharged throughout the optimization interval , the following boundary conditions will have to be fulfilled: Besides the previous statement, we consider to be bounded by technical constraints No transmission losses will be considered in our study. From the perspective of a generation company and within the framework of the new electricity market, said losses are not relevant, as power generators currently receive payment for all the energy they generate in power plant bars.
In this section, we focus on the new shortterm problem faced by a generation company, in a deregulated electricity market, when preparing its offers for the dayahead market. Our model of the spot market explicitly represents the price of electricity as a known exogenous variable.
In our problem, the objective function is given by hydraulic profit over the optimization interval, . Profit is obtained by multiplying the hydraulic production of the pumpedstorage hydroplant by the clearing price, , at each hour, . Taking our objective functional in continuous time form, the problem is on A standard Lagrangetype optimal control problem can be mathematically formulated as follows: We define the Hamiltonian in normal form: The resulting Hamiltonian, , is linear in the control variable, , and results in an optimal singular/bangbang control policy. In general, the application of Pontryagin's Maximum Principle [5] is not well suited for computing singular control problems as it fails to yield a unique value for the control. It is well known [6] that when the Hamiltonian is linear in , the optimality condition (maximize ) leads to and is undetermined if . The function is called the switching function. If only at isolated time points, then the optimal control switches between its upper and lower bounds, which is said to be a bangbangtype control (i.e., the problem is not singular). The times when the OC switches from to or vice versa are called switching times. If for every in some subinterval of , then the original problem is called a singular control problem and the corresponding trajectory for , a singular arc. The case when vanishes over an interval is more troublesome, because the optimality condition is vacuous.
In our problem, however, an added complication arises: the Hamiltonian is defined piecewisely as and the derivative of with respect to presents discontinuity at , which is the point at which a sudden change in is produced, as it is the border between the power generation zone (positive values of ) and the pumping zone (negative values of ).
The classical gradient of at is defined only when is differentiable at . However, when nondifferentiable objective functions arise in optimization problems, the generalized (or Clarke's) gradient (see [22, 23]) must be considered. Remember that the Clarke’s gradient, , can be calculated as a convex hull of (almost) all converging sequences of the gradients With the aim of obtaining a numerical solution, we first attempt to determine the structure of the solution that is, the sequence of the bangbang and the singular parts.
Bearing in mind that the function is discontinuous in , and that if , then , we have that the partial Clarke’s gradient is with and . The switching function is , and the optimality condition leads to On the other hand, the costate equation of Pontryagin’s Maximum Principle allows us to obtain With the previous mathematical development, we can determine the optimal solution: the bangsingularbang segments and the boundary on which the solution is situated
3. Algorithm
Based on the above theoretical results, in this section we describe the optimization algorithm.
The algorithm presents a series of advantages. First of all, our method needs no prior knowledge of the number and location of the bangsingularbang arcs. Moreover (as we will see in the next section), it shows a rapid convergence to the optimal solution, and it can be run in a relatively short time due to the simplicity of the operations to be performed in this method.
Figure 1 illustrates the switching law, which is in fact the basis for the proposed method. The algorithm that leads to the optimal solution comprises the following steps.(i)First, must be interpolated to obtain a continuous function.(ii)Second, for a given , we have to determine the switching times: . These instants are calculated solving (iii) Third, the optimal value must be determined in order for with and being the duration of the th bangbang segment in the upper and lower bound, respectively, and the number of such segments, and the final volume obtained for each .(iv)To calculate an approximate value of , we propose a classic iterative method (like, e.g., bisection or the secant method).
In the next section the proposed method is applied to an example.
4. Example
A program was written using the Mathematica package to apply the results obtained in this paper to an example of a hydraulic system made up of one fixedhead hydroplant. The hydraulic model is with . We shall also consider the technical constraints: (m^{3}/h), (m^{3}/h). When the efficiency is , these constraints, respectively, correspond to (MW).
In this paper, we focus on the problem that a generation company faces when preparing its offers for the dayahead market. Thus, the classic optimization interval of h. was considered. The clearing price, (euros/h·MW), corresponding to one day was taken from the Spanish electricity market [1] (see Table 1). Note that in real electricity markets, the clearing price, , is only known at each hour (). In this paper the known values of were linearly interpolated with good results.

The solution may be constructed in a simple way by taking into account the above algorithm. We shall perform two tests.
4.1. Influence of the Efficiency
First, we consider the restriction on the volume: (m^{3}) as a fixed datum and then we proceed to analyze the influence of the efficiency, . In Table 2 we present the optimal profit when the efficiency falls within the 1.35 to 1.15 range. We show the amount of pumped water and the improvement in profit with respect to the case without pumping.


As can be appreciated, significant improvements in profit of between 12–14% are obtained for even very poor efficiencies (in the 65–75% range). For the normal efficiency of pumped plants of around , the improvement in profit is quite substantial, being around .
In Figure 2 we present the solution of the algorithm when the efficiency is . The optimal value obtained for is 0.01139601030789622, and the switching times are Figure 3 presents the optimal hydropower, , for three cases: (a) without pumping, (b) with , and (c) with .
(a)
(b)
(c)
It can clearly be seen that when (standard efficiency of , the plant pumps during the most offpeak period in the clearing price . However, when , and hence the efficiency increases to , the plant also pumps in the small offpeak period in the clearing price that usually occurs around 17.00 h.
The singular arcs correspond to what, in a previous paper [24], we called a smooth transition. This is a qualitative aspect of the solution of the problem. The discontinuity of the derivative of the Lagrangian does not translate as discontinuity in the derivative of the solution. In fact, it is verified that the derivative of the extremal where the minimum is reached presents an interval of constancy.
The algorithm runs very quickly (see Figure 4). In case (b), with , 7 iterations were needed, with the CPU time required by the program being 1.1 sec on a personal computer (Pentium IV/2 GHz). The secant method was used to calculate the approximate value of for which with (m^{3}). The secant method has provided satisfactory results using these initial values:
4.2. Influence of the Volume Available
Second, we consider the efficiency as a fixed datum, and then we proceed to analyze the influence of the restriction on the volume . We compare with the solution without pumping.
As can be seen (see Table 1), the more the water available in the reservoir, the lower the profit obtained from pumping it. In fact, if the average flow of the river was such that volumes of water of (m^{3}) were available, it would not be of interest to consider building a pump plant.
This type of study is very interesting when designing the most suitable type of plant for each hydrographic basin.
5. Conclusions
In this paper we have presented a simple and efficient optimization algorithm to optimize the functioning of a pumpedstorage hydroplant. When the hydroplant is of the fixedhead type, the optimal solution presents a very particular form: the bangsingularbang solution. Faced with the existence of diverse general methods for bangsingularbang problems, in this paper we have developed a specific algorithm for our problem. Our algorithm allows the optimal solution to be obtained easily. The obtained results provide realtime information to determine which configuration is preferable in each specific real situation of the electricity market. Our theoretical results have been illustrated with numerical examples.
As to future perspectives, in spite of having presented a hydraulic example in this paper, it should be noted that our method may be applied to other problems with the same characteristics, with a constant value of the adjoint. Another interesting future line of study could be that of adapting the technique present in [19] to our hydraulic problem. In this paper the authors present an application to a freeflying robot, where it has been shown that the singular arc of the control can be interpreted as a bangbang control of a socalled augmented smooth control problem.
Acknowledgment
This work was supported by the Spanish Government (MICINN, Project: MTM201015737).
References
 S. A. Omel, “Electricity market activity rules,” http://www.omel.es/files/EMRules_2.pdf. View at: Google Scholar
 J. Jia, Q. Zhai, X. Guan, H. Wu, and Q. Li, “Optimal short term scheduling of cascaded hydroelectric chain plants with pumpedstorage units,” in Proceedings of the 27th Chinese Control Conference (CCC '08), pp. 521–525, Kunming, China, July 2008. View at: Publisher Site  Google Scholar
 P. D. Brown, J. A. Peças Lopes, and M. A. Matos, “Optimization of pumped storage capacity in an isolated power system with large renewable penetration,” IEEE Transactions on Power Systems, vol. 23, no. 2, pp. 523–531, 2008. View at: Publisher Site  Google Scholar
 N. Kishor, R. P. Saini, and S. P. Singh, “A review on hydropower plant models and control,” Renewable and Sustainable Energy Reviews, vol. 11, no. 5, pp. 776–796, 2007. View at: Publisher Site  Google Scholar
 D. P. Bertsekas, Dynamic Programming and Optimal Control, Athena Scientific, 2007.
 R. Vinter, Optimal Control, Systems & Control: Foundations & Applications, Birkhäuser, Boston, Mass, USA, 2000.
 L. Bayón, J. M. Grau, M. M. Ruiz, and P. M. Suárez, “An optimization problem in deregulated electricity markets solved with the nonsmooth maximum principle,” International Journal of Computer Mathematics, vol. 86, no. 2, pp. 237–249, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 L. Bayón, J. M. Grau, M. M. Ruiz, and P. M. Suárez, “An algorithm for bangbang control of fixedhead hydroplants,” International Journal of Computer Mathematics, vol. 88, no. 9, pp. 1949–1959, 2011. View at: Publisher Site  Google Scholar
 D. H. Jacobson, S. B. Gershwin, and M. M. Lele, “Computation of optimal singular controls,” IEEE Transactions on Automatic Control, vol. 15, pp. 67–73, 1970. View at: Google Scholar
 T. F. Edgar and L. Lapidus, “The computation of optimal singular bangbang control I: linear systems,” AIChE Journal, vol. 18, no. 4, pp. 774–779, 1972. View at: Publisher Site  Google Scholar
 T. F. Edgar and L. Lapidus, “The computation of optimal singular bangbang control II: nonlinear systems,” AIChE Journal, vol. 18, no. 4, pp. 780–785, 1972. View at: Publisher Site  Google Scholar
 Y. Chen and J. Huang, “A continuation method for singular optimal control synthesis,” in Proceedings of the American Control Conference (ACC '93), pp. 1256–1260, San Francisco, Calif, USA, June 1993. View at: Google Scholar
 S. A. Dadebo and K. B. McAuley, “On the computation of optimal singular controls,” in Proceedings of the 4th IEEE Conference on Control Applications, pp. 150–155, Albany, NY, USA, September 1995. View at: Publisher Site  Google Scholar
 S. A. Dadebo, K. B. McAuley, and P. J. McLellan, “On the computation of optimal singular and bangbang controls,” Optimal Control Applications & Methods, vol. 19, no. 4, pp. 287–297, 1998. View at: Publisher Site  Google Scholar
 H. Maurer, C. Buskens, J. H. R. Kim, and C. Y. Kaya, “Optimization methods for the verification of second order sufficient conditions for bangbang controls,” Optimal Control Applications & Methods, vol. 26, no. 3, pp. 129–156, 2005. View at: Publisher Site  Google Scholar
 G. Vossen, “Switching time optimization for bangbang and singular controls,” Journal of Optimization: Theory and Applications, vol. 144, no. 2, pp. 409–429, 2010. View at: Publisher Site  Google Scholar  Zentralblatt MATH
 M. Szymkat and A. Korytowski, “Method of monotone structural evolution for control and state constrained optimal control problems,” in Proceedings of the 7th European Control Conference (ECC '03), University of Cambridge, Cambridge, UK, September 2003. View at: Google Scholar
 L. Poggiolini and G. Stefani, “Minimum time optimality for a bangsingular arc: second order sufficient conditions,” in Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference (CDCECC '05), pp. 1433–1438, Seville, Spain, December 2005. View at: Publisher Site  Google Scholar
 G. Vossen and H. Maurer, “On ${L}^{1}$minimization in optimal control and applications to robotics,” Optimal Control Applications & Methods, vol. 27, no. 6, pp. 301–321, 2006. View at: Publisher Site  Google Scholar
 M. E. ElHawary and G. S. Christensen, Optimal Economic Operation of Electric Power Systems, vol. 142 of Mathematics in Science and Engineering, Academic Press, New York, NY, USA, 1979.
 A. J. Wood and B. F. Wollenberg, Power Generation, Operation and Control, Wiley India Pvt, New Delhi, India, 2006.
 F. H. Clarke, Optimization and Nonsmooth Analysis, Canadian Mathematical Society Series of Monographs and Advanced Texts, John Wiley & Sons, New York, NY, USA, 1983.
 P. D. Loewen, Optimal Control via Nonsmooth Analysis, vol. 2 of CRM Proceedings & Lecture Notes, American Mathematical Society, Providence, RI, USA, 1993.
 L. Bayón, J. M. Grau, M. M. Ruiz, and P. M. Suárez, “A constrained and nonsmooth hydrothermal problem,” Applied Mathematics and Computation, vol. 209, no. 1, pp. 10–18, 2009. View at: Publisher Site  Google Scholar  Zentralblatt MATH
Copyright
Copyright © 2011 L. Bayón et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.