Contingency-Constrained Optimal Power Flow Using Simplex-Based Chaotic-PSO Algorithm
This paper proposes solving contingency-constrained optimal power flow (CC-OPF) by a simplex-based chaotic particle swarm optimization (SCPSO). The associated objective of CC-OPF with the considered valve-point loading effects of generators is to minimize the total generation cost, to reduce transmission loss, and to improve the bus-voltage profile under normal or postcontingent states. The proposed SCPSO method, which involves the chaotic map and the downhill simplex search, can avoid the premature convergence of PSO and escape local minima. The effectiveness of the proposed method is demonstrated in two power systems with contingency constraints and compared with other stochastic techniques in terms of solution quality and convergence rate. The experimental results show that the SCPSO-based CC-OPF method has suitable mutation schemes, thus showing robustness and effectiveness in solving contingency-constrained OPF problems.
The purpose of an optimal power flow (OPF) function is to schedule the power system controls so as to optimize the objective function while satisfying a set of nonlinear equality and inequality constraints. The equality constraints are the nodal power balance equations, while the inequality constraints are the limits of all control or dependent variables [1, 2]. The objective function is mainly to optimize both active-power and reactive-power dispatches. Currently, the security and optimality of system operation have been simultaneously treated for a power system economy-security control, thus adding more complexity to the system operation [3, 4].
In practical power system operation, the control variables in the contingency-constrained OPF (CC-OPF) problem can be divided into continuous variables, such as power output of PV-bus generator () and PV-bus voltage (), and discrete variables, such as transformer-tap setting () and shunt admittance of the switchable shunt capacitor/reactor (). Therefore, the OPF problem is a highly constrained, large-dimensional, and nonconvex optimization problem with valve-point loading effects (VPLEs) of the thermal generator being taken into consideration [5–7]. The VPLEs result in the ripples in the fuel cost function, thus the number of local optima is also increased. The CC-OPF problem is represented as a nonsmooth optimization problem with equality and inequality constraints that cannot be solved by the traditional mathematical methods.
According to the economy-security tendency, performing the OPF operation, the preprotection strategies of the system and the security constraints should be taken into account. The security constraints include the transmission capacity limit and the bus-voltage limit. It is expected to establish an economy-security operation model to defense the system that may suffer contingency impacts [3–5]. In , the CC-OPF scheduling can be undertaken to bring the system to a more acceptable level of security represented by level 1 or 2. Regardless of whether the system is in a normal operation or contingent state, the security constraints ensure that the system can secure the operation. Thus, the aspect of system economy-security control can be carried out. However, to construct a security-constrained optimal control for a power system generation-transmission network is an extremely difficult task. Moreover, this difficulty tends to increase with growth in system size, interconnection, and other operating problems.
Previous efforts in solving OPF problems have employed various optimization techniques, such as genetic algorithms (GA) [7–11], tabu search (TS) [12, 13], evolutionary programming (EP) [14, 15], differential evolution [14–16], and particle swarm optimization (PSO) [5, 17–21]. In particular, because of its simple concept, easy implementation, and quick convergence, PSO has by now gained much attention and has been widely employed in solving OPF problems [22–27]. However, the objective function that does not consider contingency constraints may result in improper implementation of system economy-security control. Moreover, premature convergence may result in the local optima solution obtained by PSO . Studies by Higashi and Iba  showed that although the standard PSO discovered solutions of reasonable quality much faster than other evolutionary algorithms, it did not possess the ability of the solutions as the number of generations was increased. Consequently, the particles become stagnated after a certain number of iterations, which reveals that some particles become inactive and the search performance cannot be further improved.
Chaos is a kind of characteristic of nonlinear systems. A chaotic motion can traverse every state in a certain region by its own regularity, and every state is visited only once. Due to the unique ergodicity and special ability to avoid being trapped in local optima, chaos search is much higher in some other stochastic algorithms, even though the chaos search often needs a large number of iterations to reach the global optimum and is not effective in large searching space. Recently, several attempts for PSO using chaos methods based on logistic map were made to overcome the drawbacks of PSO technique with premature convergence [27–31].
In this paper, a chaotic PSO technique with a simplex operator (SCPSO) for solving the CC-OPF problems is proposed. The proposed SCPSO method, which involves the chaotic map and the downhill simplex search, can avoid premature convergence of PSO and escape local minima. The objective of CC-OPF with the valve-point loading effects of generators taken into consideration is not only to minimize total generation cost, but also to reduce transmission loss and improve the bus-voltage profile under normal or postcontingent state. The effectiveness of the proposed method is demonstrated in two power systems with contingency constraints, the 26-bus and the IEEE 57-bus systems, and compared with other stochastic techniques in terms of solution quality and convergence rate.
The remainder of this paper is organized as follows. Section 2 provides the formulation of CC-OPF problem. Section 3 describes the fundamentals of SCPSO approach. Section 4 explains the development of the proposed method. Numerical examples and comparisons are provided in Section 5. Finally, Section 6 outlines the conclusion and future research.
2. Contingency-Constrained OPF Problem
In general, the CC-OPF is a static, nonlinear, and nonconvex optimization problem, which determines a set of optimal variables from the network state, load data, and system parameters. Optimal values are computed in order to achieve a certain goal such as minimum generation cost or transmission line power loss subject to number of equality and inequality constraints.
2.1. Contingency Constraints
Contingency constraints constitute a fundamental element of economy-security control. The contingency-constrained OPF formulation can be stated as where is the set of controllable quantities in the system and is the set of dependent variables. Objective function (1) is scalar. Equalities (2) are the conventional power equations. Inequalities (3) are the limits on the control variables and the operating limits on the power system. The superscript “” represents the precontingency (base-case) state being optimized, and superscript “” () represents the postcontingency states for the contingency cases. Moreover, the equality constraints change to to reflect the outage equipment and the control variables responded by changing to .
2.2. Valve-Point Loading Effect of Generator
Typically, the valve-point effects, due to wire drawing as each steam admission valve starting to open, produce ripple-like heat rate curve as in Figure 1 . To model this effect, a recurring rectified sinusoid contribution is added to the second-order polynomial function to represent the input-output equation. Thus, the fuel cost functions taking into account the valve-point effects were expressed as where , , , , and are the cost coefficients of unit .
2.3. Control and Dependent Variables
In this paper, the vector of control variables is defined as and the vector of dependent variables is defined as , where is the reactive power of PV-bus generator, is the PQ-bus voltage, and is the line flow in transmission line.
2.4. Objective Function
In this paper, two subproblems of CC-OPF, namely, active power dispatch and reactive power dispatch, are considered simultaneously. The former is to achieve the goal of minimum generation cost, and the latter is to achieve the goal of minimum transmission line loss and minimum bus voltage deviation. However, an advanced goal of CC-OPF should be defined not only to minimize the total generation cost but also to reduce the transmission line loss and to improve the bus-voltage profile under pre-contingency or post-contingency state. Minimizing the generation cost is the main objective, and reducing the transmission line loss and improving the bus voltage are also considered as objectives of CC-OPF with the valve-point loading effects of generators.
Considering the difference in homogeneity of above-mentioned three objectives, however, the three objectives are the relationship of positive correlation according to the characteristic of the CC-OPF problem, so that an optimal solution obtained by the optimization algorithm can minimize the total fuel cost while involving less transmission line loss and bus voltage deviation. Hence, to convert the multiobjective problem into a single optimization problem is feasible.
Therefore, the objective function of the CC-OPF is formulated as (5) for determining an optimal setting of control variables while minimizing the objective function. where is the number of generator buses, is the number of buses, is the number of transmission line, and is the loss of transmission line . Parameter is a weight factor for transferring the transmission line loss into a penalty cost, while is also a weight factor for transferring the voltage deviation of bus into a penalty cost. Two weight factors can be actively assigned according to the operation status, and are set to be 1.0 for transmission lines and buses energized, and 0.0 for de-energized. is a magnitude of reference voltage; in general, pu.
(i) Equality Constraints
System power flow equations:
(ii) Inequality Constraints
(1) Active and reactive power limits of generators:(2)Bus-voltage limit: (3)Transmission capacity limit:(4)Transformer-tap setting limit:(5)Operation limits of switchable capacitor/reactor devices: where is the number of network branches, is the number of transformer branches, and is the number of the reactive power source installation buses.
Therefore, the contingency-constrained OPF problem must be solved subject to both pre-contingency and post-contingency constraints of the selected contingency cases.
3. Chaotic Particle Swarm Optimization with Simplex Operator
3.1. Chaotic Particle Swarm Optimization
(i) Classical PSO
PSO as an optimization tool provides a population-based search procedure in which individuals (called particles) change their positions (coordinates) over time. In a PSO system, particles fly around in a -dimensional search space. During flight, each particle adjusts its position according to its own experience and the experience of neighboring particles, making use of the best position encountered by itself and its neighbors.
The particle swarm works by adjusting trajectories through manipulation of each coordinate of a particle. Let , and denote the positions and the corresponding flight speed (velocity) of the particle in a continuous search space, respectively. The particles are manipulated according to the following equations . where : pointer of iterations (generations), : inertia weight factor, , : acceleration constant, , : uniform random value in the range , : velocity of particle at iteration , and , where is the maximum velocity limits of , : current position of particle at iteration , : the previous best position of particle at iteration , : the best position among all individuals in the population at iteration , : new velocity of particle , and : new position of particle .
In (13), the proper selection of inertia weight will provide a balance between global explorations and local exploitation, thus requiring fewer iterations on average to find an optimal solution. In general, a decreasing linearly inertia weight is set (15). where is the maximum number of iterations (generations) and is the current number of iterations.
The advantages of the classical PSO are simple concept, easy implementation, robustness to control parameters, and computational efficiency. However, it depends greatly on its parameters and exists as the premature convergence phenomenon, especially in solving complex multihump problems with equality and inequality constraints. Conversely, owing to the properties of unique ergodicity, inherent stochastic property, and irregularity of chaos, a chaotic search can traverse every state in a certain space by its own regularity and visit every state once only, which helps avoid being trapped in local optima. Thus, a chaotic search has a much higher precision than some other stochastic algorithms [27–30].
(iii) Chaotic Map
To enrich the search behavior and avoid the premature phenomenon of PSO in solving OPF problems, incorporating a chaotic search into PSO to construct a chaotic PSO is proposed. The chaotic search algorithm is developed from the chaotic evolution of variables. Two well-known chaotic maps, logistic map and tent map, are the most common maps used in chaotic searches [27–29, 31].
The logistic map is defined by
The feature of the logistic map is that a small difference in the initial value of the chaotic variable would result in a considerable difference in its long-time behaviors; a chaotic variable can travel ergodically over the entire search space [18, 19].
The tent map is defined by
Similar to the uniform distribution function in the interval , the tent map has outstanding advantages and faster iterative speed than the logistic map, and therefore, it has excellent characteristic of ergodicity. In this paper, the tent map is employed to generate chaotic variables for enriching the search behavior.
3.2. Simplex Operator
(i) Downhill Simplex Method
A local search method called the Downhill simplex method is one of the most popular derivate-free nonlinear optimization algorithms [32, 33]. In the -dimensional space, a simplex is a polyhedron with vertices. The method iteratively updates the worst point by four operations process: reflection, expansion, contraction, and shrinkage that are shown in Figure 2. Reflection involves moving the worst point (vertex) of simplex to a point reflected through the remaining points. If this point is better than the best point, then the method attempts to expand the simplex along this line. This operation is called expansion. On the other hand, if the new point is not much better than the previous point, then the simplex is contracted along one dimension from the worst point. The procedure is called contraction. Moreover, if the new point is worse than the previous points, the simplex is contracted along all dimensions toward the best point and steps down the valley. The procedure is called shrinkage.
In each iteration, new points are computed, along with their function values, to form a new simplex. By repeating this series of operations, the method finds the optimal solution.
(ii) Simplex Search Algorithm
The calculation procedures of the simplex search algorithm (SSA) are described as follows [32–35]. The flowchart of SSA is shown in Figure 3.(1) Order and relabel the points as so that .(2)Generate a trial point by reflection, such that where is the centroid of the n best points in the vertices of the simplex. If , replace by .(3)If , generate a new point by expansion, such that If , replace by , otherwise replace by .(4)If , generate a new point by contraction, such that If , replace by .(5)If , shrink along all dimensions toward , such that Replace by . Evaluate at the new vertices.(6)Order and relabel the vertices of the new simplex as , such that . If the stopping criterion is satisfied, then stop. Otherwise go to step 2.
In general, four scalar parameters, coefficients of reflection , expansion , contraction , and shrinkage must be specified to define a complete downhill simplex method . Many articles have reported that coefficient values of , , , and are used . Figure 2 shows the reflection, expansion, contraction, and shrinkage points for a simplex in two dimensions using the values of above-mentioned coefficients.
3.3. Chaotic-PSO with Simplex Operator
To enhance the exploration-exploitation ability of the chaotic PSO method, the chaotic-PSO with simplex operator is included. The proposed method is made up of two parts. One is the chaotic-PSO that engages in global exploration, the other is the simplex search for increasing the local exploitation that can escape the local minimum and accelerate the converge process. The calculation procedures of the proposed SCPSO algorithm are described as follows.(1)Set the and generate the initial population. Compare the fitness of each particle to obtain its . The best is denoted .(2)Use the tent map () to generate the chaotic variables according to (22). Map the chaotic variables into the search range of decision variables . (3)Update the particle’s velocity and position according to (13) and (14), respectively. In addition, .Evaluate the fitness for each update particle. Update and if needed. (4)Order and relabel all new particles (new offsprint) according to their fitness. Apply a small number of iterations of simplex search to improve all new particles in the population. (5)Let and repeat Steps 2–5 until the stopping criterion () is met.(6)The latest is the optimal solution.
4. Development of the Proposed Method
4.1. Representation of Particle
In this paper, the particle comprises both continuous control variables and discrete control variables . A particle is a mixed-integer structure, that is, . The physical variables are encoded as follows.(1)Continuous variable taking the real value in the interval , .(2)Discrete variable taking the decimal integer value in the interval , . where is the adjustable step size of the discrete control variable . is the operator rounding the variable to the nearest integer. To transform a discrete variable into a practical control value is as in (25).
4.2. SCPSO-Based CC-OPF
As mentioned above, the objective of CC-OPF is not only to minimize total operation cost, but also to enhance transmission security, reduce transmission loss, and improve the bus-voltage profile under pre-contingency or post-contingency state. The search procedures of the SCPSO-based CC-OPF method are shown in Figure 4. The objective function in (5) is employed as a fitness function. If a particle is a feasible solution and satisfies all constraints, its fitness will be measured by (5). Otherwise, its fitness will be penalized with a very large positive constant (i.e., the dependent variable violates either the equality constraints (6) or the inequality constraints (8)-(10)).
5. Numerical Examples and Results
When the constraints of the valve-point loading effects of generators are considered, the OPF problem becomes non-convex and may thus degrade the quality of solution and convergence rate. To verify the feasibility and robustness of the proposed SCPSO-based OPF method, a 26-bus and an IEEE 57-bus systems were tested. The proposed method was compared with other stochastic methods, such as chaotic-based PSO (CPSO) , PSO with Gaussian mutation (MPSO) , improved PSO with linearly decreasing inertia weight (IPSO) , hybrid genetic algorithm (HGA)  and differential evolution (DE) , in terms of solution quality and computation efficiency using the same fitness function and particle definition. The maximum number of iterations for all the algorithms is set to 100.
5.1. Description of Study Systems
(i) 26-Bus System
The system that contains six thermal units, 26 buses, and 46 transmission lines is shown in Figure 5 . The load demand is 1263 MW. The detailed characteristics of the six thermal units with the valve-point loading effects are given in Table 1. Let Bus 1 denote the slack bus; the bus data, branch data, transformer-tap data, and shunt-capacitor bank data of the system are shown in .
The system has a total of 27 control variables as follows: 5 unit active power outputs, 6 generator-bus voltage magnitudes, 7 transformer-tap settings, and 9 var-injection values of shunt capacitor. The adjustable range of the transformer-tap is from 0.9 pu to 1.1 pu, and the shunt admittance of shunt capacitor is 0.0 to j0.05 pu. The adjustable step size is from 0.01 pu in the transformer-tap settings, and the changing step size is j0.005 pu in the shunt admittance. According to (24), the values of the two discrete variables above are 20 and 10, respectively. The upper and lower limits of the generator-bus and load-bus voltages are 0.95 pu and 1.05 pu, respectively.
(ii) IEEE 57-Bus System
The IEEE 57-bus system contains seven thermal units, 57 buses and 46 transmission lines. The load demand is 1250.8 MW. The detailed characteristics of the seven thermal generators with the valve-point loading effects are given in Table 2. Bus 1 is the swing bus.
The system has a total of 31 control variables as follows: 6 active power outputs, 7 generator-bus voltage magnitudes, 15 transformer-tap settings, and 3 var-injection values of shunt capacitor. Because the adjustable range of the transformer-tap is 0.9–1.1 pu, and the shunt admittance ranges from 0.0 to 0.1 pu, the adjustable step size in the transformer-tap settings is 0.01 pu, and the changing step size in the shunt admittance is 0.005 pu. The values of the two discrete variables above are 20 and 10, respectively. The upper and lower limits of the generator-bus and load-bus voltages are 0.9 pu and 1.1 pu, respectively.
5.2. Selected Contingency Event
Table 3 shows two states of the study systems. One is the normal operation (pre-contingency), and the other is the post-contingency with a selected contingency occurring. In 26-bus system, the power flow on transmission line is about 74.31 Mva in normal economic operation. From the results of contingency selecting, one of the most critical faults is proven line outage. When line faulted, three lines (, , and ) were overloaded, as shown in Figure 5. In the IEEE 57-bus system, the power flow on transmission line is about 100.82 Mva under normal operation. When faulted, two lines ( and ) were overloaded.
5.3. Parameters of Algorithms
Through repeated experiments, the suitable parameters of the proposed SCPSO method in Table 4 can be used. The population size is set to be 50 and the number of iterations is set to be 100. Those coefficients of reflection , expansion , contraction , and shrinkage in SSA method are 1.0, 2.0, 0.5, and 0.5, respectively. Maximum number of iterations for the SSA method is set to be 10.
5.4. Experimental Results
In each study system, a total of 30 trials were performed. The simulation results are summarized in Table 5. The optimal settings of control variables obtained by the four proposed methods are shown in Table 6.
In Table 5, three performance indexes, namely the distribution region (), the mean value (), and the standard deviation () are employed to verify the robustness of the proposed method. Best fitness obtained by each trial was recorded. The proposed indexes were employed to evaluate the effectiveness of the proposed method in solving the CC-OPF problem. where is the best fitness of each trial, and are the maximum and minimum fitness, respectively, among 30 trials. is the number of trials.
As seen in Table 6, in the 26-bus system, as compared with those obtained by other stochastic methods, the performance indexes obtained by the proposed SCPSO method, , , and , are obviously better. In the IEEE 57-bus system, as compared with those obtained by other PSO methods, the performance indexes obtained by the proposed SCPSO method, , , and , are also obviously better.
In addition, as shown by Table 5, the proposed SCPSO method is still the most outstanding method in terms of fitness, generation cost, transmission loss, and bus-voltage deviation. For example, in the 26-bus system, the SCPSO method has the best fitness of 15812, thus implying a total generation cost of $15,487, a transmission loss of 11.6166 MW, and a summation of bus-voltage deviation of 0.3432 pu. In the IEEE 57-bus system, the SCPSO method has the best fitness of 15426, thus implying a total generation cost of $15,407, a transmission loss of 17.1611 MW, and a summation of bus-voltage deviation of 2.3280 pu. These results have shown that the proposed SCPSO method can obtain better solution quality.
Figures 6(a)-6(b) present the convergence tendency using different stochastic methods for showing further the advantages of the proposed SCPSO method. The convergence tendency of average fitness of each proposed method can be found in the 30 trials. As seen in both figures, the proposed SCPSO method has the best convergence behavior that can escape the local optima. Specially, the SCPSO method is superior to the CPSO method because the former has the simplex operator that can avoid being trapped in local minima.
System operations must know which line or generation outages will cause power flows or voltages to fall outside limits. To verify the feasibility of the solution obtained by the SCPSO method, two profiles of bus voltage are employed and shown in Figure 7. One is a study system under normal operation, denoted by the circle symbol, and the other is a study system under post-contingency conditions, denoted by the cross symbol. Contingency analysis procedures single out failure events such as one-line outage in a power system. The proposed SCPSO-based OPF method is used to check the security constraints. For each outage tested, it checks all lines and voltages against their respective limits. For two study cases, tested systems can work under security constraints including the generation limit, transmission capacity limit, transformer-tap setting limit, and capacitor capacity limit, as shown in Tables 6(a) and 6(b). In the 26-bus system, as can be seen, the optimal settings of control variables obtained by the proposed SCPSO method can still maintain the least possible deviation of bus voltage even when line faulted. In the IEEE 57-bus system, the same phenomenon was obtained by the proposed SCPSO method when line faulted. The results show that the optimal settings of control variables allow systems to be operated defensively.
In this paper, an associated objective of CC-OPF is defined to be capable of minimizing the total generation cost as well as enhancing the security of the system even if the system suffers transmission line outages. For effectively solving the CC-OPF problem, a chaotic particle swarm optimization with simplex operator (SCPSO) is presented. The proposed SCPSO method, which involves the chaotic map and the downhill simplex search, can avoid the premature convergence of PSO and escape local minima. As shown in various comparisons, the solutions obtained by the proposed SCPSO method are superior to those obtained by other stochastic techniques in terms of solution quality and convergence characteristic.
Our main work in the future is to find out a more efficient parameter control method to verify further the advantages of the proposed SCPSO method in solving large-scale CC-OPF and security-constrained OPF problems.
The authors gratefully acknowledge the financial support from the National Science Council of Republic of China under contract NSC94-2218-E-244-003 and the technical support from Taiwan Power Company.
A. J. Wood and B. F. Wollenberg, Power Generation Operation and Control, John Wiley & Sons, New York, NY, USA, 1996.
L. L. Lai, J. T. Ma, R. Yokoyama, and M. Zhao, “Improved genetic algorithms for optimal power flow under both normal and contingent operation States,” International Journal of Electrical Power and Energy Systems, vol. 19, no. 5, pp. 287–292, 1997.View at: Google Scholar
B. Stott, O. Alsac, and A. J. Monticelli, “Security analysis and optimization,” Proceedings of the IEEE, vol. 75, no. 12, pp. 1623–1644, 1987.View at: Google Scholar
H. Harsan, N. Hadjsaid, and P. Pruvot, “Cyclic security analysis for security constrained optimal power flow,” IEEE Transactions on Power Systems, vol. 12, no. 2, pp. 948–953, 1997.View at: Google Scholar
H. Yoshida, K. Kawata, Y. Fukuyama, S. Takayama, and Y. Nakanishi, “A Particle swarm optimization for reactive power and voltage control considering voltage security assessment,” IEEE Transactions on Power Systems, vol. 15, no. 4, pp. 1232–1239, 2000.View at: Google Scholar
E. Liu, A. D. Papalexopoulos, and W. F. Tinney, “Discrete shunt controls in a Newton optimal power flow,” IEEE Transactions on Power Systems, vol. 7, pp. 1519–1528, 1999.View at: Google Scholar
M. Younes, M. Rahli, and L. Abdelhakem-Koridak, “Optimal Power Flow based on Hybrid Genetic Algorithm,” Journal of Information Science and Engineering, vol. 23, no. 6, pp. 1801–1816, 2007.View at: Google Scholar
J. Kennedy and R. Eberhart, “Particle swarm optimization,” in Proceedings of IEEE International Conference on Neural Netwroks, vol. 4, pp. 1942–1948, Perth, Australia, November 1995.View at: Google Scholar
Y. Shi and R. C. Eberhart, “Empirical study of particle swarm optimization,” in Proceedings of the Congress on Evolutionary Computation, vol. 3, pp. 1945–1950, Piscataway, NJ, USA, July 1999.View at: Google Scholar
A. Stacey, M. Jancic, and I. Grundy, “Particle swarm optimization with mutation,” in Proceedings of IEEE International Conference on Evolutionary Computation, vol. 2, pp. 1425–1430, December 2003.View at: Google Scholar
N. Higashi and H. Iba, “Particle swarm optimization with Gaussian mutation,” in Proceedings of the IEEE on Swarm Intelligence Symposium, pp. 72–79, April 2003.View at: Google Scholar
K. Tatsumi, H. Yamamoto, and T. Tanino, “A perturbation based chaotic particle swarm optimization using multi-type swarms,” in Proceedings of International Conference on Instrumentation, Control and Information Technology, SICE Annual Conference, pp. 1199–1203, Osaka, Japan, August 2008.View at: Publisher Site | Google Scholar
J. A. Nelder and R. Mead, “A simplex method for function minimization,” Computer Journal, vol. 7, pp. 308–313, 1965.View at: Google Scholar
V. Torczon, “On the convergence of pattern search algorithms,” SIAM Journal on Optimization, vol. 7, no. 1, pp. 123–145, 1997.View at: Google Scholar