The Artificial Neural Networks Based on Scalarization Method for a Class of Bilevel Biobjective Programming Problem

Zhang, Tao; Chen, Zhong; Liu, June; Li, Xiong

doi:https://doi.org/10.1155/2017/1853131

Computational Intelligence and Neuroscience

On this page

Abstract Introduction Results Conclusions Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2017 | Article ID 1853131 | https://doi.org/10.1155/2017/1853131

The Artificial Neural Networks Based on Scalarization Method for a Class of Bilevel Biobjective Programming Problem

Tao Zhang,¹Zhong Chen,¹June Liu,²and Xiong Li³

Academic Editor: Leonardo Franco

Received06 Jan 2017

Revised19 May 2017

Accepted07 Aug 2017

Published14 Sept 2017

Abstract

A two-stage artificial neural network (ANN) based on scalarization method is proposed for bilevel biobjective programming problem (BLBOP). The induced set of the BLBOP is firstly expressed as the set of minimal solutions of a biobjective optimization problem by using scalar approach, and then the whole efficient set of the BLBOP is derived by the proposed two-stage ANN for exploring the induced set. In order to illustrate the proposed method, seven numerical examples are tested and compared with results in the classical literature. Finally, a practical problem is solved by the proposed algorithm.

1. Introduction

The bilevel programming problem (BLP) is a nested optimizations problem with two levels in a hierarchy: the upper and lower level decision-makers. The upper level maker makes his decision firstly, followed by the lower level decision-maker. The objective function and constraint of the upper level problem not only rely on their own decision variables but also depend on the optimal solution of the lower level problem. The decision-maker at the lower level has to optimize his own objective function under the given parameters from the upper level decision-maker. Since many practical problems, such as engineering design, management, economic policy, and traffic problems, can be formulated as hierarchical problems, BLP has been studied and received increasing attention in the literatures. During the past decades, some surveys and bibliographic reviews were given by several authors [1–4]. Reference books on bilevel programming and related issues have emerged [5–8].

The bilevel programming problem is a nonconvex problem, which is extremely difficult to solve. As we know, BLP is a NP-Hard problem [9–11]. Vicente et al. [12] also showed that even the search for the local optima to the bilevel linear programming is NP-Hard. Even so, many researchers are devoted to develop the algorithms for solving BLP and propose many efficient algorithms. To date a few algorithms exist to solve BLP; it can be classified into four types: Karus-Kuhn-Tucker approach (KKT) [13–16], Branch-and-bound method [17], penalty function approach [18–21], and descent approach [22, 23].

Unfortunately, the bilevel programming problem is nonconvex and the properties such as differentiation and continuity are necessary when proposing the traditional algorithms. Thus, many researchers tend to propose the heuristic algorithms for solving BLP because of their key characteristics of minimal problem restrictions such as differentiation. Mathieu et al. [24] firstly developed a genetic algorithm (GA) for bilevel linear programming problem because of its good characteristics such as simplicity, minimal problem restrictions, global perspective, and implicit parallelism. Motivated by the same reason, other kinds of genetic algorithm for solving bilevel programming were also proposed in [25–28]. Because of the prominent advantage that neural computing can converge to the equilibrium point (optimal solution) rapidly, the neural network approach was used to solve bilevel programming problem in [29–31]. In additional, since McCulloch and Pitts [32] and Pyne [33] utilized logical calculus to emulate nervous activities, there have been various types of analogue neural networks proposed for computation. Sheng et al. [34] firstly proposed a neural network approach based on Frank-Wolfe method for a class of BLP problems. Shih et al. [35] and Lan et al. [29] presented neural network for solving linear BLP problem, respectively. Recently, Lv et al. [30, 36] investigated the nonlinear bilevel programming and the convex quadratic bilevel programming by neural network. However, there are few results on application of neural networks to the BLBMPP in the literature.

Particle swarm optimization (PSO) is a relatively novel heuristic algorithm inspired by the choreography of a bird flock. Due to its high speed of convergence and relative simplicity, the PSO algorithm has been employed for solving BLP problems. For example, Li et al. [37] proposed a hierarchical PSO for solving BLP problem. Kuo and Huang [38] applied the PSO algorithm for solving bilevel linear programming problem. Jiang et al. [39] presented the PSO based on CHKS smoothing function for solving nonlinear bilevel programming problem. Gao et al. [40] presented a method to solve bilevel pricing problems in supply chains using PSO. Zhang et al. [41] presented a new strategic bidding optimization technique which applies bilevel programming and swarm intelligence. The hybrid algorithms based on PSO are also proposed to solve the bilevel programming problems [42–44]. Besides, Tabu search [45–47], simulated annealing [48], ant colony optimization [49], and -cut and goal-programming-based algorithm [50] are also typical intelligent algorithms for solving bilevel programming problem.

However, the algorithms mentioned above are only for the simple single objective bilevel programming problems. In fact, the multiobjective characteristics widely existing in the BLPP and the bilevel multiobjective programming problem (BLMPP) have attracted many researchers’ interesting. For example, Shi and Xia [51, 52], Abo-Sinna and Baky [53], and Nishizaki and Sakawa [54] presented an interactive algorithm for BLMPP. Eichfelder [55] developed a numerical method for solving nonlinear nonconvex bilevel multiobjective optimization problems. In recent years, the metaheuristic has attracted considerable attention as an alternative method for BLMPP. For example, Deb and Sinha [56–58] as well as Sinha and Deb [59] discussed BLMPP based on evolutionary multiobjective optimization principles. Based on those studies, Deb and Sinha [60] proposed a viable and hybrid evolutionary-local-search based algorithm and presented challenging test problems. Sinha [61] presented a progressively interactive evolutionary multiobjective optimization method for BLMPP. Lately, Zhang et al. [62] proposed an improved PSO for BLMPP and a framework of PSO for solving BLMPP is established. Subsequently, Zhang et al. [63] proposed an elite quantum behaved PSO for relatively complex BLMPP. In 2013, Zhang et al. [64] proposed a hybrid particle swarm optimization algorithm with crossover operator to solve high-dimensional BLMPP. Almost all the research object of the BLMPPs is the BLBOP, so we mainly consider the BLBOPs in this paper.

As we known, the authenticity of the lower level Pareto optimal solution is very important for the BLBOP. If the obtained optimal Pareto solutions possess the fraudulence, it can lead to the failure to solve the whole problem. In this paper, the induced set of the BLBOP is firstly expressed as the set of minimal solutions of a biobjective optimization problem by a scalar approach which can greatly improve the accuracy of the lower level Pareto optimal solutions. Based on the efficient set of the BLBOP, a two-stage ANN is presented for solving whole problem which can reduce the computation burden.

The remaining of this paper is organized as follows. In Section 2, we give the formulation of the model and related definitions. In Section 3, we will introduce the scalar approach for the induced set of the BLBOP and the two-stage ANN algorithm for the whole problem. In Section 4, some numerical examples and practical problem are given to demonstrate the feasibility and efficiency of the proposed algorithm, while the conclusion is reached in Section 5.

2. Problem Formulation and Main Theory Results

Let be a nonempty subset of be a nonempty subset of , and , , , and be vector-valued mappings. We consider the following bilevel multiobjective programming problem (BLMPP): where and are the upper level and the lower level objective functions, respectively. and denote the upper level and the lower level constraints, respectively. Let and . For the fixed , let denote the Pareto optimal solutions to the lower level problem; the induced set of problem (1) is denoted as . Note that the constraint is uncoupled from the lower level variable . Particularly, if , we also call the BLMPP as bilevel biobjective programming problem (BLBOP). In the following, we shall focus on the BLBOP and assume that and .

Definition 1. Let be a closed pointed convex cone. A point is called a Pareto optimal solution of the lower level problem with respect to if .

Definition 2. For a fixed , if is a Pareto optimal solution to the lower level problem, then is a feasible solution to problem (1).

Definition 3. If is a feasible solution to problem (1) and there are no , such that , then is a Pareto optimal solution to problem (1), where “” denotes Pareto preference.

Definition 4. If is the optimistic solution for problem (1), then is given by .

Remark 5. The optimistic solution to the BLBOP is the one that optimizes the leader’s objective function over the set of efficient solutions to the follower, assuming that the follower has no preferences among the efficient solutions obtained for each leader’s decision or that the follower will choose the solution that most benefits the leader. In this paper, we only consider the optimistic BLBOP.

For problem (1), it is noted that a solution is feasible for the upper level problem if and only if is an optimal solution for the lower level problem with . In practice, we often make the approximate optimal solutions of the lower level problem as the optimal response feedback to the upper level problem, and this point of view is accepted usually. On the other hand, the authenticity of the lower level Pareto optimal solution is very important for the BLMP. If the obtained optimal Pareto solutions possess the fraudulence, it can lead to the failure to solve the whole problem. In this paper, we proposed the scalar approach for the lower level Pareto optimal solutions in order to improve the accuracy of the lower level Pareto optimal solutions.

3. Algorithm

3.1. The Scalar Approach for the Induced Set of BLBOP

In bilevel optimization, the constraint set of the upper level problem is given by the solution set of the lower level optimization problem. According to the Theorem 4.1 of the literature [55], the induced set of problem (1) is equivalent to the Pareto optimal set of the multiobjective optimization problem

Thus, to solve the induced set of BLBOP is transformed to solve the Pareto optimal solution set of problem (2). Inspired by the scalar approach adopted in [55], the approximation for the induced set of problem (1) can be solved by the following algorithm.

Algorithm 1.
Step 1. Discretize the upper level variable.
Step 1.1. For one-dimension upper level decision variable, choose and discretize by , .
Step 1.2. For -dimension upper level decision variable, choose and discretize by .
Step 2. Initialize the loop variables and predefine an accuracy measure .
Step 3. Execute the following steps for and let .
Step 3.1. Solve and . Then, determine and . Denote the approximate Pareto optimal solution set by . Let with a small and .
Step 3.2. If , solve problem (2) using the scalarization method in [56] with , for the minimal solution . Set .
Step 3.3. Calculate the according to Theorem 4.3 and determine according to (5.2) in [56]. Set and let ; go to Step 4.
Step 4. Output the approximation Pareto optimal solution set ; that is, .

3.2. The Two-Stage ANN

If in Step 2 is small, then set will consist of many points. Then, the determination of all nondominated points for the upper level problem can be very expensive. In this subsection, the two-stage ANN is presented for determining the Pareto optimal solution of the BLBOP on the induced set . The first stage is to map the vectors from to and the second stage is to determine the Pareto optimal solutions of problem (1). The detail of each stage is described as follows.

The first stage of the ANN is a feed-forward artificial neural network (FFANN) which is composed by two subnetworks and with the same structure and neuron output function. For each subnetwork, the nodes are organized into two layers and the weighted arcs only link nodes in lower layers to nodes in higher layers. The first stage is to compute the objective function value for the upper lever.

The second stage is a quasineural artificial network; namely, the network has no connectivity weight and the output value can be computed directly by software. The input layer of the quasineural artificial network is the output layer of the first stage network. For the hidden layer, the input of and the output are defined by (3) and (4), respectively.

For the output layer, the input of and the output are defined by (5) and (6), respectively.

Based on the set obtained by Algorithm 1, the first approximation Pareto optimal solutions of problem (1) can be achieved by the following algorithm.

Algorithm 2.
Step 1. Discrete induced set , denote the discrete set by , and let .
Step 2. Divide the set into two subsets and randomly; that is .
Step 3. Input and into subnetwork and subnetwork , respectively.
Step 4. Select Pareto optimal solutions.
Step 4.1. If , then . Let , go to Step 4.
Step 4.2. If , then . Let , go to Step 4.
Step 4.3. If , then . Go to Step 4.
Step 5. If , then .
Step 6. If , then .
Step 7. If the stopping criterion is met, then stop. Otherwise, go to Step 2.
In Step 2, the two subsets and have approximately equal number of feasible solutions. The output of Algorithm 2 is the first approximation Pareto optimal solution set of problem (1); we denote the set by .

3.3. The Algorithm for BLBOP

Based on Algorithms 1 and 2, as well as the refinement strategy used by the literature [9] which is employed in this paper, the algorithm for solving the BLBOP can be described as follows.

Algorithm 3.
Step 1. Based on the induced set obtained by Algorithm 1, we determine the approximation Pareto optimal solution set of problem (1) by Algorithm 2.
Step 2. Let and choose the distance .
Step 3. For any point , determine the refinement induced set around this point by the refinement strategy according to (5.4) in [55].
Step 4. Set ; update the approximation Pareto optimal solution set by Algorithm 2.
Step 5. If approximation of solution set of problem (1) is sufficient, then stop. Otherwise set , choose , and go to Step 3.

4. Results

In this section, we considered seven numerical examples and a practical problem to illustrate the feasibility of the proposed algorithm for problem (1). In order to evaluate the closeness between the obtained Pareto optimal front and the theoretical Pareto optimal front, as well as the diversity of the obtained Pareto optimal solutions along the theoretical Pareto optimal front, we adopted the following evaluation metrics.

4.1. Performance Evaluation Metrics

4.1.1. Generational Distance (GD)

This metric used by Deb [65] is employed in this paper as a way of evaluating the closeness between the obtained Pareto optimal front and the theoretical Pareto optimal front. The GD metric denotes the average distance between the obtained Pareto optimal front and the theoretical Pareto optimal front:where is the number of the obtained Pareto optimal solutions by the proposed algorithm and is the Euclidean distance between each obtained Pareto optimal solution and the nearest member of the theoretical Pareto optimal set.

4.1.2. Spacing (SP)

This metric is used to evaluate the diversity of the obtained Pareto optimal solutions by comparing the uniform distribution and the deviation of solutions as described by Deb [65]:where , , is the mean of all , is the Euclidean distance between the extreme solutions in obtained Pareto optimal solution set and the theoretical Pareto optimal solution set on the th objective, is the number of the upper level objective function, and is the number of the obtained solutions by the proposed algorithm.

All results presented in this paper have been obtained on a personal computer (CPU: AMD 2.80 GHz; RAM: 3.25 GB) using a c# implementation of the proposed algorithm.

4.2. Numerical Experiment

In this section, we will present seven BLBOPS to illustrate the proposed algorithm for the bilevel biobjective programming. Problem 1 and problem 2 are low-dimensional problems. Problems 3–6 are high-dimensional problems. For problem 7, the theoretical optimal front is unknown. In this paper, we refined every upper problem’s feasible solutions three times and the obtained results are compared with the classical literature.

Example 1. Example 1 is taken from [57]. Here . In this example, the parameters of Algorithm 3 are 0.23, 0.11, and 0.03.Figure 1(a) shows the obtained Pareto front by the proposed algorithm and the method in [57]. Table 1 shows the comparison results between the two algorithms considering the metrics previously described. It can be seen that the performance of the proposed algorithm is better with respect to the generational distance, although it places slightly below the method in [57] with respect to spacing. By looking at the obtained Pareto fronts, some nondominated vectors produced by the method in [57] are not part of the true Pareto front of the problem; however, the proposed algorithm is able to cover the full Pareto front. Figure 2(b) shows that all the obtained solutions by the proposed algorithm, which follow the relationship; that is, , , and . However, some solutions obtained by the method in [57] do not meet the relationship.

(a) The obtained Pareto front of Example 1

(b) The obtained solution by the proposed algorithm

(c) The obtained solution by [57]

(a) The obtained Pareto front of Example 2

(b) The obtained solutions by Algorithm 2

(c) The obtained solutions by the method in [25]

Example 2. Example 2 is taken from [57]. Here . In this example, the parameters of Algorithm 3 are 0.3, 0.21, and 0.12.Figure 2(a) shows the obtained Pareto front by the proposed algorithm and the method in [57]. Obviously, both the proposed algorithm and the method in [57] almost have the same spacing. However, there are some areas of the Pareto optimal solution obtained by the method in [57] which is sparse. In Figures 2(a) and 2(b), it can be seen that the obtained solutions by the proposed algorithm almost follow the relationship; that is, . However, some areas of the solutions obtained by the method in [57] are sparse and some solutions do not meet the relationship.

Example 3. Example 3 is taken from [60]. Here . In this example, the parameters of Algorithm 3 are 0.5, 0.36, and 0.12.This problem is more difficult compared to the previous problems (Examples 1 and 2) because the lower level problem of this example has multimodalities, thereby making the lower level problem difficult in finding the upper level Pareto optimal front. Figure 3 shows the graphical results produced by the method in [60] and the proposed algorithm in this paper. Tables 2 and 3 show the comparison of results between the two algorithms considering the metrics previously described. It can be seen that the performance of the proposed algorithm is the best with respect to the generational distance. By looking at the Pareto fronts of this test problem, some nondominated vectors produced by the method in [60] are not part of the true Pareto front and there are some areas are sparse. However, the proposed algorithm is able to cover the full Pareto optimal front. Furthermore, two obtained lower level Pareto optimal fronts are given when and .

Example 4. Example 4 is taken from [60]. Here . In this example, the parameters of Algorithm 3 are 0.6, 0.38, and 0.16.whereFor Example 4, the upper level problem has multimodalities, thereby causing an algorithm difficulty in finding the upper level Pareto optimal front. Figure 4 shows the obtained Pareto front by the method in [60] and the proposed algorithm. Tables 2 and 3 show the comparison of results among the three algorithms considering the metrics previously described. It can be seen that the performance of the proposed algorithm is better than the method in [60] with respect to the generational distance though they almost have the same performance with respect to the spacing.

Example 5. Example 5 is taken from [60]. Here . In this example, the parameters of Algorithm 3 are 0.7, 0.49, and 0.23.Figure 5 shows the obtained Pareto front of Example 5 by the method in [60] and the proposed algorithm. Tables 2 and 3 show the comparison of results between the two algorithms considering the metrics previously described. For this example, the graphical results again indicate that the method in [60] does not cover the full Pareto front. Since the nondominated vectors found by the method in [60] are clustered together, the spacing metric provides very good results. Graphically, it can be seen that the proposed algorithm is able to cover the entire Pareto front. It is also interesting to note that the Pareto optimal fronts for the upper level lie on constraint boundaries and every lower level Pareto optimal front has an unequal contribution to the upper level Pareto optimal front.

Example 6. Example 6 is taken from [60]. Here . In this example, the parameters of Algorithm 3 are 0.5, 0.23, and 0.17.Figure 6 shows the obtained Pareto front of Example 6 by the method in [60] and the proposed algorithm. Tables 2 and 3 show the comparison of results between the two algorithms considering the metrics previously described. It can be seen that our algorithm and the method in [60] almost have the same performance of the spacing, but some nondominated vectors produced by the method in [60] are slightly off the true Pareto front. Moreover, three obtained lower level Pareto optimal fronts are given when , and . It can be seen that only one Pareto optimal point from each participating lower level problem qualifies to be on the upper level Pareto optimal front.

Example 7. Example 7 is taken from [55]. Here . In this example, the parameters of Algorithm 3 are 0.3, 0.16, and 0.07, respectively. Figure 7 shows the final archive solutions by the proposed algorithm. For this problem, the exact Pareto optimal front is not known, but the obtained Pareto optimal front after four approximations by the proposed algorithm is similar to that reported in the previous study [55].

4.3. Application of the Algorithm for a Practical Problem

In a company, the CEO’s goal is usually to maximize net profits and quality of products, whereas a branch head’s goal is to maximize its own profit and worker satisfaction. The problem involves uncertainty and is bilevel in nature, as a CEO’s decision must take into account optimal decisions of branch heads. We present a deterministic version of the case study from [66] in (4). Figure 8 shows the obtained Pareto optimal front of this practical problem by the proposed algorithm. Note that Zhang et al. [66] only obtained a single optimal solution and which lies on the maximum of using weighted sum method. In contrast, a set of Pareto optimal solutions is obtained by the proposed algorithm. However, the fact that the single optimal solution in [66] is included in the obtained Pareto optimal solutions illustrates the feasibility of proposed algorithm. In this problem, the parameters of Algorithm 3 are 0.2, 0.11, and 0.02.

5. Conclusions

In this paper, a two-stage ANN based on scalarization method is presented for solving BLBOPs. Seven numerical examples and a practical problem are used to state the feasibility and efficiency of the proposed algorithm. The experimental results indicate that the obtained Pareto front by the proposed algorithm is very close to the theoretical Pareto optimal front, and the solutions are also distributed uniformly on entire range of the theoretical Pareto optimal front. The proposed algorithm is easy to implement, which provides another appealing method for further study on the general BLMPP.

Conflicts of Interest

The authors declared that they have no conflicts of interest related to this work.

Acknowledgments

This work is supported by the National Science Foundation of China (61673006), the Young Project of Hubei Provincial Department of Education (Q20141304), and the Dr. Start-Up Fund by the Yangtze University (2014).

References

L. s. Vicente and P. H. Calamai, “Bilevel and multilevel programming: a bibliography review,” Journal of Global Optimization, vol. 5, no. 3, pp. 291–306, 1994.
View at: Publisher Site | Google Scholar | MathSciNet
S. Dempe, “Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints,” Optimization. A Journal of Mathematical Programming and Operations Research, vol. 52, no. 3, pp. 333–359, 2003.
View at: Publisher Site | Google Scholar | MathSciNet
B. t. Colson, P. Marcotte, and G. Savard, “Bilevel programming: a survey,” 4OR. A Quarterly Journal of Operations Research, vol. 3, no. 2, pp. 87–107, 2005.
View at: Publisher Site | Google Scholar | MathSciNet
B. t. Colson, P. Marcotte, and G. Savard, “An overview of bilevel optimization,” Annals of Operations Research, vol. 153, pp. 235–256, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
K. Shimizu, Y. Ishizuka, and J. F. Bard, Nondifferentiable and two-level mathematical programming, Kluwer Academic Publishers, Boston, Mass, USA, 1997.
View at: Publisher Site | MathSciNet
J. F. Bard, Practical Bilevel Optimization: Algorithms and Applications, vol. 30, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1998.
View at: Publisher Site | MathSciNet
A. Migdalas, P. M. Pardalos, and P. Värbrand, Eds., Multilevel Optimization: Algorithms and Applications, Kluwer Academic, Dordrecht, The Netherlands, 1998.
View at: Publisher Site | MathSciNet
S. Dempe, Foundations of Bilevel Programming, vol. 61, Kluwer Academic Publishers, London, UK, 2002.
View at: MathSciNet
R. G. Jeroslow, “The polynomial hierarchy and a simple model for competitive analysis,” Mathematical Programming, vol. 32, no. 2, pp. 146–164, 1985.
View at: Publisher Site | Google Scholar | MathSciNet
O. Ben-Ayed and C. E. Blair, “Computational difficulties of bilevel linear programming,” Operations Research, vol. 38, no. 3, pp. 556–560, 1990.
View at: Publisher Site | Google Scholar | MathSciNet
J. F. Bard, “Some properties of the bilevel programming problem,” Journal of Optimization Theory and Applications, vol. 68, no. 2, pp. 371–378, 1991.
View at: Publisher Site | Google Scholar | MathSciNet
L. Vicente, G. Savard, and J. Júdice, “Descent approaches for quadratic bilevel programming,” Journal of Optimization Theory and Applications, vol. 81, no. 2, pp. 379–399, 1994.
View at: Publisher Site | Google Scholar | MathSciNet
J. F. Bard, “An algorithm for solving the general bilevel programming problem,” Mathematics of Operations Research, vol. 8, no. 2, pp. 260–272, 1983.
View at: Publisher Site | Google Scholar | MathSciNet
T. A. Edmunds and J. F. Bard, “Algorithms for nonlinear bilevel mathematical programs,” Institute of Electrical and Electronics Engineers. Transactions on Systems, Man, and Cybernetics, vol. 21, no. 1, pp. 83–89, 1991.
View at: Publisher Site | Google Scholar | MathSciNet
M. A. Amouzegar, “A global optimization method for nonlinear bilevel programming problems,” IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics, vol. 29, no. 6, pp. 771–777, 1999.
View at: Publisher Site | Google Scholar
J. B. Etoa Etoa, “Solving quadratic convex bilevel programming problems using a smoothing method,” Applied Mathematics and Computation, vol. 217, no. 15, pp. 6680–6690, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
J. F. Bard and J. E. Falk, “An explicit solution to the multi-level programming problem,” Computers and Operations Research, vol. 9, no. 1, pp. 77–100, 1982.
View at: Publisher Site | Google Scholar
K. Shimizu and E. Aiyoshi, “A new computational method for Stackelberg and min-max problems by use of a penalty method,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 26, no. 2, pp. 460–466, 1981.
View at: Publisher Site | Google Scholar | MathSciNet
E. Aiyoshi and K. Shimizu, “A solution method for the static constrained Stackelberg problem via penalty method,” Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 29, no. 12, pp. 1111–1114, 1984.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Ishizuka and E. Aiyoshi, “Double penalty method for bilevel optimization problems,” Annals of Operations Research, vol. 34, no. 1-4, pp. 73–88, 1992.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Lv, T. Hu, G. Wang, and Z. Wan, “A penalty function method based on Kuhn-Tucker condition for solving linear bilevel programming,” Applied Mathematics and Computation, vol. 188, no. 1, pp. 808–813, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
G. Savard and J. Gauvin, “The steepest descent direction for the nonlinear bilevel programming problem,” Operations Research Letters, vol. 15, no. 5, pp. 265–272, 1994.
View at: Publisher Site | Google Scholar | MathSciNet
J. E. Falk and J. Liu, “On bilevel programming, Part I: general nonlinear cases,” Mathematical Programming, vol. 70, no. 1, Ser. A, pp. 47–72, 1995.
View at: Publisher Site | Google Scholar | MathSciNet
R. Mathieu, L. Pittard, and G. Anandalingam, “Genetic algorithm based approach to bi-level linear programming,” Operations Research, vol. 28, no. 1, pp. 1–21, 1994.
View at: Publisher Site | Google Scholar | MathSciNet
S. R. Hejazi, A. Memariani, G. Jahanshahloo, and M. M. Sepehri, “Linear bilevel programming solution by genetic algorithm,” Computers and Operations Research, vol. 29, no. 13, pp. 1913–1925, 2002.
View at: Publisher Site | Google Scholar
Y.-P. Wang, Y.-C. Jiao, and H. Li, “An evolutionary algorithm for solving nonlinear bilevel programming based on a new constraint-handling scheme,” IEEE Transactions on Systems, Man and Cybernetics C: Applications and Reviews, vol. 35, no. 2, pp. 221–232, 2005.
View at: Publisher Site | Google Scholar
G.-m. Wang, X.-j. Wang, Z.-p. Wan, and S.-h. Jia, “An adaptive genetic algorithm for solving bilevel linear programming problem,” Applied Mathematics and Mechanics. English Edition, vol. 28, no. 12, pp. 1605–1612, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
H. I. Calvete, C. Galé, and P. M. Mateo, “A new approach for solving linear bilevel problems using genetic algorithms,” European Journal of Operational Research, vol. 188, no. 1, pp. 14–28, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
K. M. Lan, U. P. Wen, H.-S. Shih, and E. Lee, “A hybrid neural network approach to bilevel programming problems,” Applied Mathematics Letters. An International Journal of Rapid Publication, vol. 20, no. 8, pp. 880–884, 2007.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Lv, T. Hu, G. Wang, and Z. Wan, “A neural network approach for solving nonlinear bilevel programming problem,” Computers & Mathematics with Applications. An International Journal, vol. 55, no. 12, pp. 2823–2829, 2008.
View at: Publisher Site | Google Scholar | MathSciNet
S. B. Yaakob and J. Watada, “Double-Layered Hybrid Neural Network Approach for Solving Mixed Integer Quadratic Bilevel Problems,” in Integrated Uncertainty Management and Applications, vol. 68 of Advances in Intelligent and Soft Computing, pp. 221–230, Springer Berlin Heidelberg, Berlin, Heidelberg, 2010.
View at: Publisher Site | Google Scholar
W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” The Bulletin of Mathematical Biophysics, vol. 5, no. 4, pp. 115–133, 1943.
View at: Publisher Site | Google Scholar
I. B. Pyne, “Linear programming on an electronic analog computer,” Transactions of the American Institute Electrical Engineers, vol. 75, pp. 139–143, 1956.
View at: Google Scholar
Z. Sheng, Z. Lv, and R. Xu, “A new algorithm based on the Frank-Wolfe method and neural network for a class of bilevel decision making problems,” Acta Automatic Sinica, vol. 22, no. 6, pp. 657–665, 1996.
View at: Google Scholar
H.-S. Shih, U.-P. Wen, E. S. Lee, K.-M. Lan, and H.-C. Hsiao, “A neural network approach to multiobjective and multilevel programming problems,” Computers & Mathematics with Applications. An International Journal, vol. 48, no. 1-2, pp. 95–108, 2004.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Lv, Z. Chen, and Z. Wan, “A neural network for solving a convex quadratic bilevel programming problem,” Journal of Computational and Applied Mathematics, vol. 234, no. 2, pp. 505–511, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
X. Li, P. Tian, and X. Min, “A hierarchical particle swarm optimization for solving bilevel programming problems,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4029, pp. 1169–1178, 2006.
View at: Publisher Site | Google Scholar
R. J. Kuo and C. C. Huang, “Application of particle swarm optimization algorithm for solving bi-level linear programming problem,” Computers & Mathematics with Applications. An International Journal, vol. 58, no. 4, pp. 678–685, 2009.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Jiang, X. Li, C. Huang, and X. Wu, “Application of particle swarm optimization based on CHKS smoothing function for solving nonlinear bilevel programming problem,” Applied Mathematics and Computation, vol. 219, no. 9, pp. 4332–4339, 2013.
View at: Publisher Site | Google Scholar | MathSciNet
Y. Gao, G. Zhang, J. Lu, and H.-M. Wee, “Particle swarm optimization for bi-level pricing problems in supply chains,” Journal of Global Optimization, vol. 51, no. 2, pp. 245–254, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
G. Zhang, G. Zhang, Y. Gao, and J. Lu, “Competitive strategic bidding optimization in electricity markets using bilevel programming and swarm technique,” IEEE Transactions on Industrial Electronics, vol. 58, no. 6, pp. 2138–2146, 2011.
View at: Publisher Site | Google Scholar
S. B. Yaakob and J. Watada, “A hybrid intelligent algorithm for solving the bilevel programming models,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6277, no. 2, pp. 485–494, 2010.
View at: Publisher Site | Google Scholar
R. J. Kuo and Y. S. Han, “A hybrid of genetic algorithm and particle swarm optimization for solving bi-level linear programming problem—a case study on supply chain model,” Applied Mathematical Modelling, vol. 35, no. 8, pp. 3905–3917, 2011.
View at: Publisher Site | Google Scholar | MathSciNet
Z. Wan, G. Wang, and B. Sun, “A hybrid intelligent algorithm by combining particle swarm optimization with chaos searching technique for solving nonlinear bilevel programming problems,” Swarm and Evolutionary Computation, vol. 8, pp. 26–32, 2013.
View at: Publisher Site | Google Scholar
U. P. Wen and A. D. Huang, “A simple Tabu Search method to solve the mixed-integer linear bilevel programming problem,” European Journal of Operational Research, vol. 88, no. 3, pp. 563–571, 1996.
View at: Publisher Site | Google Scholar
M. Gendreau, P. Marcotte, and G. Savard, “A hybrid tabu-ascent algorithm for the linear bilevel programming problem,” Journal of Global Optimization, vol. 8, no. 3, pp. 217–233, 1996.
View at: Publisher Site | Google Scholar | MathSciNet
J. Rajesh, K. Gupta, H. S. Kusumakar, V. K. Jayaraman, and B. D. Kulkarni, “A Tabu Search Based Approach for Solving a Class of Bilevel Programming Problems in Chemical Engineering,” Journal of Heuristics, vol. 9, no. 4, pp. 307–319, 2003.
View at: Publisher Site | Google Scholar
K. H. Sahin and A. R. Ciric, “A dual temperature simulated annealing approach for solving bilevel programming problems,” Computers and Chemical Engineering, vol. 23, no. 1, pp. 11–25, 1998.
View at: Publisher Site | Google Scholar
H. I. Calvete, C. Galé, and M. Oliveros, “Bilevel model for production distribution planning solved by using ant colony optimization,” Computers & Operations Research, vol. 38, no. 1, pp. 320–327, 2011.
View at: Publisher Site | Google Scholar
Y. Gao, G. Zhang, J. Ma, and J. Lu, “A λ-cut and goal-programming-based algorithm for fuzzy-linear multiple-objective bilevel optimization,” IEEE Transactions on Fuzzy Systems, vol. 18, no. 1, pp. 1–13, 2010.
View at: Publisher Site | Google Scholar
X. Shi and H. Xia, “Interactive bilevel multi-objective decision making,” Journal of the Operational Research Society, vol. 48, no. 9, pp. 943–949, 1997.
View at: Publisher Site | Google Scholar
X. Shi and H. S. Xia, “Model and interactive algorithm of bi-level multi-objective decision-making with multiple interconnected decision makers,” Journal of Multi-Criteria Decision Analysis, vol. 10, no. 1, pp. 27–34, 2001.
View at: Publisher Site | Google Scholar
M. A. Abo-Sinna and I. A. Baky, “Interactive balance space approach for solving multi-level multi-objective programming problems,” Information Sciences, vol. 177, no. 16, pp. 3397–3410, 2007.
View at: Publisher Site | Google Scholar
I. Nishizaki and M. Sakawa, “Stackelberg solutions to multiobjective two-level linear programming problems,” Journal of Optimization Theory and Applications, vol. 103, no. 1, pp. 161–182, 1999.
View at: Publisher Site | Google Scholar | MathSciNet
G. Eichfelder, “Multiobjective bilevel optimization,” Mathematical Programming. A Publication of the Mathematical Programming Society, vol. 123, no. 2, Ser. A, pp. 419–449, 2010.
View at: Publisher Site | Google Scholar | MathSciNet
K. Deb and A. Sinha, “Constructing test problems for bilevel evolutionary multi-objective optimization,” in Proceedings of the 2009 IEEE Congress on Evolutionary Computation, CEC 2009, pp. 1153–1160, nor, May 2009.
View at: Publisher Site | Google Scholar
K. Deb and A. Sinha, “Solving bilevel multi-objective optimization problems using evolutionary algorithms,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5467, pp. 110–124, 2010.
View at: Publisher Site | Google Scholar
K. Deb and A. Sinha, “An evolutionary approach for bilevel multi-objective problems,” Communications in Computer and Information Science, vol. 35, pp. 17–24, 2009.
View at: Publisher Site | Google Scholar
A. Sinha and K. Deb, “Towards Understanding Evolutionary Bilevel Multi-Objective Optimization Algorithm,” IFAC Proceedings Volumes, vol. 42, no. 2, pp. 338–343, 2009.
View at: Publisher Site | Google Scholar
K. Deb and A. Sinha, “An efficient and accurate solution methodology for bilevel multi-objective programming problems using a hybrid evolutionary-local-search algorithm,” Evolutionary Computation, vol. 18, no. 3, pp. 403–449, 2010.
View at: Publisher Site | Google Scholar
A. Sinha, “Bilevel multi-objective optimization problem solving using progressively interactive EMO,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 6576, pp. 269–284, 2011.
View at: Publisher Site | Google Scholar
T. Zhang, T. Hu, Y. Zheng, and X. Guo, “An improved particle swarm optimization for solving bilevel multiobjective programming problem,” Journal of Applied Mathematics, Article ID 626717, Art. ID 626717, 13 pages, 2012.
View at: Publisher Site | Google Scholar | MathSciNet
T. Zhang, T. Hu, J.-W. Chen, Z. Wan, and X. Guo, “Solving bilevel multiobjective programming problem by elite quantum behaved particle swarm optimization,” Abstract and Applied Analysis, vol. 2012, Article ID 102482, 20 pages, 2012.
View at: Publisher Site | Google Scholar
T. Zhang, T. Hu, X. Guo, Z. Chen, and Y. Zheng, “Solving high dimensional bilevel multiobjective programming problem using a hybrid particle swarm optimization algorithm with crossover operator,” Knowledge-Based Systems, vol. 53, pp. 13–19, 2013.
View at: Publisher Site | Google Scholar
K. Deb, “Multi-Objective Optimization using Evolutionary Algorithms,” IEEE Transactions on Evolutionary Computation, vol. 6, pp. 182–197, 2002.
View at: Google Scholar
G. Zhang, J. Lu, and T. Dillon, “Decentralized multi-objective bilevel decision making with fuzzy demands,” Knowledge-Based Systems, vol. 20, no. 5, pp. 495–507, 2007.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2017 Tao Zhang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

954

Downloads

1137

Citations