Mathematical Problems in Engineering

Mathematical Problems in Engineering / 2017 / Article
Special Issue

Evolutionary Algorithms and Metaheuristics: Applications in Engineering Design and Optimization

View this Special Issue

Research Article | Open Access

Volume 2017 |Article ID 8306732 |

Igor Stojanović, Ivona Brajević, Predrag S. Stanimirović, Lev A. Kazakovtsev, Zoran Zdravev, "Application of Heuristic and Metaheuristic Algorithms in Solving Constrained Weber Problem with Feasible Region Bounded by Arcs", Mathematical Problems in Engineering, vol. 2017, Article ID 8306732, 13 pages, 2017.

Application of Heuristic and Metaheuristic Algorithms in Solving Constrained Weber Problem with Feasible Region Bounded by Arcs

Academic Editor: Domenico Quagliarella
Received26 Feb 2017
Accepted15 May 2017
Published14 Jun 2017


The continuous planar facility location problem with the connected region of feasible solutions bounded by arcs is a particular case of the constrained Weber problem. This problem is a continuous optimization problem which has a nonconvex feasible set of constraints. This paper suggests appropriate modifications of four metaheuristic algorithms which are defined with the aim of solving this type of nonconvex optimization problems. Also, a comparison of these algorithms to each other as well as to the heuristic algorithm is presented. The artificial bee colony algorithm, firefly algorithm, and their recently proposed improved versions for constrained optimization are appropriately modified and applied to the case study. The heuristic algorithm based on modified Weiszfeld procedure is also implemented for the purpose of comparison with the metaheuristic approaches. Obtained numerical results show that metaheuristic algorithms can be successfully applied to solve the instances of this problem of up to 500 constraints. Among these four algorithms, the improved version of artificial bee algorithm is the most efficient with respect to the quality of the solution, robustness, and the computational efficiency.

1. Introduction

The Weber problem is one of the most studied problems in location theory [13]. This optimization problem searches for an optimal facility location on a plane, which satisfiesIn (1), it is assumed that , are known demand points, and are weight coefficients, and is a matrix norm, used as the distance function.

The basic Weber problem is stated with the Euclidean norm underlying the definition of the distance function. Also, many other types of distances have been used in the facility location problems [35]. In general, a lot of extensions and modifications of the Weber location problem are known. Detailed reviews of these problems can be found in [3, 6].

The most popular method for solving the Weber problem with Euclidean distances is given by a one-point iterative procedure which was first proposed by Weiszfeld [7]. Later, Vardi and Zhang developed a different extension of Weiszfeld’s algorithm [8], while Szegedy partially extended Weiszfeld’s algorithm to a more general problem [9]. In particular, some variants of the continuous Weber problem represent nonconvex optimization problems which are hard to be solved exactly [10]. A nonconvex optimization problem may have multiple feasible regions and multiple locally optimal points within each region [11]. Consequently, finding the global solution of a nonconvex optimization problem is very difficult.

Heuristics and metaheuristics represent the main types of stochastic methods [12]. Both types of algorithms can be used to speed up the process of finding a high-quality solution in the cases where finding an optimal solution is very hard. The distinctions between heuristic and metaheuristic methods are inappreciable [12]. Heuristics are algorithms developed to solve a specific problem without the possibility of generalization or application to other similar problems [13]. On the other hand, a metaheuristic method represents a higher-level heuristic in the sense that they guide their design. In such a way we can use any of these methods to design a specific method for computing an approximate solution for an optimization problem.

In the last several decades, there is a trend in the scientific community to solve complex optimization problems by using metaheuristic optimization algorithms. Some applications of metaheuristic algorithms include neural networks, data mining, industrial, mechanical, electrical, and software engineering, as well as certain problems from location theory [1421]. The most interesting and most widely used metaheuristic algorithms are swarm-intelligence algorithms which are based on a collective intelligence of colonies of ants, termites, bees, flock of birds, and so forth [22]. The reason of their success lies in the fact that they use commonly shared information among multiple agents, so that self-organization, coevolution, and learning during cycles may help in creating the highest quality results. Although not all of the swarm-intelligence algorithms are successful, a few techniques have proved to be very efficient and thus have become prominent tools for solving real-world problems [23]. Some of the most efficient and the most widely studied examples are ant colony optimization (ACO) [2426], particle swarm optimization (PSO) [15, 2729], artificial bee colony (ABC) [19, 3035], and recently proposed firefly algorithm (FA) [18, 3638] and cuckoo search (CS) [17, 3941].

Different heuristic methods are proposed in order to provide encouraging results for challenging continuous Weber problem with regard to solution quality and computational effort [4246]. Also, some variants of the Weber problem have been successfully solved by different metaheuristic approaches [4752]. In [52], the authors studied a capacitated multisource Weber problem as an extended facility location problem that involves both facility locations and service allocations simultaneously. The method proposed in [52] is based on the integration of two genetic algorithms. The problem of locating one new facility with respect to a given set of existing facilities in the plane and in the presence of convex polyhedral barriers was considered in [47]. The general strategy in [47] arises from the iterative application of a genetic algorithm for the subproblems selection. A hybrid particle swarm optimization approach was applied in solving the incapacitated continuous location-allocation problem in [48]. In [49], the authors compared performances of four metaheuristic algorithms, modified to solve the single-facility location problem with barriers. The method for solving a kind of Weber problem from [50] was developed using an evolutionary algorithm enhanced with variable neighborhood search.

The aim of this paper is to investigate the performances of some prominent swarm-intelligence metaheuristic approaches to solve the constrained Weber problem with feasible region bounded by arcs. This variant of Weber problem has a nonconvex feasible set given by the constraints that make it much harder to find the global optimum using any deterministic algorithms. Hence, metaheuristic optimization algorithms can be employed in order to provide promising results.

In this paper, four swarm-intelligence techniques are applied to solve this version of the constrained Weber problem: the artificial bee colony for constrained optimization [53], the crossover-based artificial bee colony (CB-ABC) algorithm [54], the firefly algorithm for constrained optimization [37], and the enhanced firefly algorithm (E-FA) [55]. The CB-ABC and the E-FA are two of the most recently proposed improved variants of the ABC and FA for solving constrained problems, respectively. Also, a heuristic algorithm is proposed in [44] with the aim of solving this version of the constrained Weber problem. Hence, it is also implemented for the purpose of comparison with the metaheuristic approaches. These five techniques are tested to solve randomly generated test instances of constrained Weber problem with feasible region bounded by arcs of up to 500 constraints.

The rest of the paper is organized as follows. A formulation of the constrained Weber problem with feasible region bounded by arcs and the heuristic approach developed to solve this variant of the constrained Weber problem are presented in Section 2. Section 3 presents the four metaheuristic optimization techniques used to solve this variant of the Weber problem. Description of the generated benchmark functions and comparative results of the four implemented metaheuristic techniques are given in Section 4. Concluding remarks are provided in Section 5.

2. The Heuristic Method for Solving a Constrained Weber Problem

The constrained Weber problem with feasible region bounded by arcs in the continuous space was introduced in [44]. In order to complete our presentation, we briefly restate the method. It can be formulated by the goal function defined in (1) and by the feasible region which is defined on the basis of constraints of two opposite types:where is the total number of demand points and and are subsets of the set of demand point indices satisfying , , and . For the sake of simplicity, the optimization problem given by (1) with constraints (2) is denoted as the CWP problem.

Such a problem may occur if some demand points coincide with locations of some important facilities and the searched optimal location must be close to them. Other demand points may coincide with dangerous facilities and the facility must be located far from them.

The metric used in practically important location problems depends on various factors, including properties of the transportation means [44]. In the case of public transportation systems, the price usually depends on a distance. However, some minimum price is usually defined. For example, the initial fare of the taxi cab may include some distance, usually 1–5 km. Having rescaled the distances so that this distance included in the initial price is equal to 1, we can define the price function aswhere is a matrix norm.

In the case of distance function defined by (3), the problem can be decomposed into series of constrained location problems with the Euclidean metric where the area of the feasible solutions is bounded by arcs. Each of the problems has the feasible region equal to the same intersection of the discs with centers in the demand points. For more details, see [44, 56].

The Weiszfeld procedure for solving the Weber problem with a given tolerance , based on the results from [57], is presented as Algorithm  2.1 in [44].

An algorithm based on the Weiszfeld procedure for solving the CWP defined by objective (1) and constraints (2) was proposed [44]. The feasible set of our constrained optimization problems is generally nonconvex, while the objective function given by (1) is convex [58]. A solution of constrained optimization problems with convex objective functions coincides with the solution of the unconstrained problem or lies on the border of the forbidden region [59]. Thus, if is a solution of the constrained problem given by (1) with constraints (2) then it is the solution of the unconstrained problem (1) or .

Step  2.2 of Algorithm  2.1 from [44] can lead to generating a new point outside the feasible region determined by constraints (2). Let us denote this region . It is assumed that .

For an arbitrary point , let us denote the closest point in by . It can be computed using

Algorithm 1 was proposed as Algorithm  2.2 in [44], and it is based on the substitution of the point generated in Step  2.2 of Algorithm  2.1 from [44] with its closest point in the feasible region.

Require: Coordinates and weights of the demand points , pre-specified tolerance ,
constraints (2) specified by sets and .
Step  1. Calculate the initial point (here, is the feasible set bounded by constraints);
Step  2. While do:
Step  2.1. ;
Step  2.2. .
Step  2.3. If then .
Step  2.4. ; .
Step  2.5. Continue Step  .
Step  3. STOP, return .

3. Review of the Metaheuristic Optimization Techniques

The four metaheuristics used to solve constrained Weber problem with feasible region bounded by arcs are described in the following subsections.

3.1. Artificial Bee Colony Algorithm for Solving the CWP

A numerical variant of the ABC algorithm for constrained optimization problems (COPs) proposed in [60] is applied to solve the CWP. In the ABC the population is iteratively refined through employed, onlooker, and scout bee phases.

The update process used in the employed and onlooker bee phase is the same and it is determined bywhere is a uniform random number in the range , represents another solution selected randomly from the population, is the modification rate control parameter, is a randomly chosen real number in the range , and . The update process is completed when the selection between and is carried out.

The ABC uses Deb’s rules in order to decide which solution will be kept for the next iteration. This constraint handling method consists of a set of three feasibility rules introduced by Deb [61]. They are the following: (1) any feasible solution is preferred to any infeasible solution, (2) between two feasible solutions, the one having a better fitness value is preferred, and (3) if both solutions are infeasible, the one with the lowest sum of constraint violations is preferred.

In the employed bee phase, every solution involves the update process. On the other hand, in the onlooker bee phase only the solutions selected probabilistically proportional to their fitness values have the chance to be upgraded [60].

In the scout phase solutions that do not improve over a certain number of cases are replaced by new randomly generated solutions. The control parameters and the scout production period are used in this phase. The parameter is used to signify exhausted food source, while parameter is employed in order to denote a predetermined period of cycles for producing scout bees.

The pseudocode of the ABC is given as Algorithm 2.

Initial parameters of the ABC including maximum cycle number (), ;
Generate initial population () randomly in the search space and evaluate each ;
while () do
for   to SN do
Generate a solution with by Eq. (5), evaluate it and apply selection process based on Deb's method between with ;
end for
for   to SN do
Select food source based on fitness proportionate selection;
Generate a solution with by Eq. (5), evaluate it and perform selection process based on Deb's method
between with ;
end for
if ( mod ) then
Every solution which did not enhance at least number of times is replaced, each with a randomly produced solution.
end if
Memorize the best solution reached so far.
end while
3.2. Crossover-Based Artificial Bee Colony Algorithm for Solving the CWP

Recent improved variant of the ABC for COPs, called crossover-based artificial bee colony, is also used to solve the constrained Weber problem [54]. The main modifications introduced in the CB-ABC are related to the search operators used in each bee phase in order to improve the distribution of good information between solutions [54]. The differences between the CB-ABC and the ABC for COPs are given as follows.

In the employed bee phase, the CB-ABC algorithm uses modified search equation (5), in which is the same random number of each parameter which will be changed. Also, the CB-ABC does not use the fixed value of control parameter. Value of linearly increases from to the predefined value in the first iterations, while the value is used in the remaining iterations. The value of is defined in Table 1.



In the onlooker bee phase, the CB-ABC proposes a new search equation with the aim of enabling better exploration of the neighborhood of the high-quality solution. This equation is given bywhere is a uniform random number in range , and represent the other two solutions selected randomly from the population, is a randomly chosen real number in the range , and .

In the scout bee phase, the CB-ABC uses uniform crossover operator to generate new solutions in a promising region of the search space. Therefore, after each th iteration, each solution which did not improve number of times is replaced with a new solution which is created bywhere is the th element of the global best solution found so far, is a randomly chosen real number in range , and .

3.3. Firefly Algorithm for Solving the CWP

In order to solve the CWP we have employed a numerical optimization version of the FA for COPs, introduced in [37]. In the FA, a colony of artificial fireflies searches for good solutions in every iteration.

The search operator represents the movement of a firefly to another more attractive or brighter firefly and it is given bywhere the second term is due to the attraction and the third term is a randomization term.

In the second term of (8), the parameter is the attractiveness of fireflies which is calculated according to the following monotonically decreasing function [62]: where denotes the distance between firefly and firefly , while and are predetermined algorithm parameters: maximum attractiveness value and absorption coefficient, respectively. Distance between fireflies is calculated by the Euclidean distance.

In the third term of (8), is a randomization parameter, are the scaling parameters, and is a random number uniformly distributed between and . The scaling parameters () are calculated by , where and are the lower and upper bound of the parameter . Diversity of solutions is controlled by the randomization parameter which needs to be reduced gradually during iterations so that it can vary with the iteration counter [63].

In the FA for solving CWP, penalty functions approach is used in order to handle the constraints. In this way, a constrained problem is solved as an unconstrained one. A general formula of calculation penalty functions is given in [64] bywhere is the new (expanded) objective function to be optimized, and are positive constants normally called “penalty factors,” is the number of inequality constraints, and is the number of equality constraints for a given problem. We found it suitable to set each to the value . The penalty factors for equality constraints were not used, since these problems have only inequality constraints.

The pseudocode of the FA is given as Algorithm 3.

Initial parameters of the FA including .
Generate initial population of fireflies () randomly distributed in the solution space.
Assume that is the expanded objective function of () calculated by (10).
while    do
for   to   do
for   to   do
if    then
Generate a new according to Eq. (8) and evaluate it.
end if
end for
end for
Rank the fireflies and memorize the best solution achieved so far.
end while
3.4. An Enhanced Firefly Algorithm for Solving the CWP

An enhanced firefly algorithm for COPs is presented in [55] and it is also applied to solve the CWP. Two modifications are incorporated in the E-FA in order to improve the performance of the firefly algorithm for COPs.

The first modification is related to using Deb’s rules instead of the penalty approach. Three feasibility rules are employed instead of the greedy selection in order to decide which firefly is brighter. These rules are also used each time after (8) is applied in order to decide whether the solution will be updated. Evaluation of solution population is given as Algorithm 4.

for   to   do
for   to   do
if ( is better than based on Deb’s rules) then
for   to (dimension of the problem) do
end for
if ( is better than based on Deb’s rules) then
end if
end if
end for
end for

The second modification is employing the geometric progression reduction scheme to reduce the scaling factors at the end of each cycle, by the rulewhere is the maximum cycle number, is the current iteration number, and .

4. Experimental Study

The ABC, CB-ABC, FA, and E-FA are implemented in the Java programming language on a PC Intel Core i5-3300@3 GHz with 4 GB of RAM. The heuristic algorithm based on the modified Weiszfeld procedure is also implemented for the purpose of comparison with the metaheuristic approaches.

4.1. Benchmark Functions

The performance of the four metaheuristics techniques and behavior of the heuristic algorithm are evaluated through eighteen test instances of the single-facility constrained Weber problems with the connected feasible region bounded by arcs with equal radius.

The benchmark problems with the increasing number of input points are randomly generated according to the algorithm given in [44]. These problems have 5, 10, 50, 100, 250, and 500 input points. Three different random test problems are generated for each number of input points. Hence, these test instances have a nonconvex feasible set given from 5 up to 500 constraints.

Four example problems, named P1, P4, P7, and P10 with 5, 10, 50, and 100 input points, respectively, are shown in Figure 1. In each test image, the feasible region is represented by a gray surface area and the final solution obtained by the heuristic algorithm [44] is represented by a red cross.

4.2. Parameter Settings

The solution number (SN) in the four metaheuristic algorithms was set to 20. The maximum number of fitness function evaluations (FEs) was used as the stopping criterion. The allowed FEs were set to . In addition, the metaheuristic algorithms presented in Section 2 have several other control parameters that considerably influence their performance. The values of these control parameters are presented in Table 1.

In order to calculate FEs researchers usually use the rule , where is the maximum number of iterations [65, 66]. Hence, the FA and E-FA were terminated after iterations. The number of consumed fitness evaluations in each iteration of the ABC and CB-ABC algorithms is , since it calculates the solutions both in the employed bee and in onlooker bee phase [65]. Therefore, to ensure a fair comparison, the ABC and CB-ABC algorithms were terminated after iterations.

For the FA, it is widely reported in the literature that the light absorption coefficient , the initial attractiveness , and the initial randomness factor can be used for most applications [36, 62]. It can be seen from Table 1 that the value of the parameter was set to and the initial value of was set to for both FA and E-FA. A typical value of is used in the FA. It was empirically determined that slightly higher value of the parameter is more suitable for the E-FA. Hence was adapted. For the ABC and CB-ABC algorithms, the values of the specific control parameters were taken from [53, 54], where these algorithms were proposed to solve COPs. Especially for the CB-ABC, it was empirically determined that a lower value of the scout production period is more appropriate for solving the CWP. Therefore, it was set to . Each of the experiments was repeated for runs.

4.3. Analysis of Solution Quality and Robustness

The coordinates of the solution, corresponding objective function value, and the CPU time (in seconds) obtained by the heuristic algorithm are arranged in Table 2. To analyze the solution quality of the tested four metaheuristic algorithms, the best values, mean values, and standard deviations have been obtained by the ABC, CB-ABC, FA, and E-FA algorithms over runs. Significance tests are used to achieve reliable comparisons. According to [67], two-sample 95%-confidence t-test was conducted between each pair of compared metaheuristics on every benchmark function. The calculated best results are presented in Table 3, while the mean values and standard deviations are arranged in Table 4. Results of two-sample t-tests are reported in Table 5. The sign “+” indicates that the associated comparative algorithm is significantly better than the other one, while the sign “−” indicates it is significantly worse than the opposite one. If both algorithms show similar performance, they are both marked by “+.”

Prob Solution pointObjective function value Time (sec)