Abstract

In this paper, we present a new approach which is based on using numerical solutions and swarm algorithms (SAs) to solve the interval quadratic programming problem (IQPP). We use numerical solutions for SA to improve its performance. Our approach replaced all intervals in IQPP by additional variables. This new form is called the modified quadratic programming problem (MQPP). The Karush–Kuhn–Tucker (KKT) conditions for MQPP are obtained and solved by the numerical method to get solutions. These solutions are functions in the additional variables. Also, they provide the boundaries of the basic variables which are used as a start point for SAs. Chaotic particle swarm optimization (CPSO) and chaotic firefly algorithm (CFA) are presented. In addition, we use the solution of dual MQPP to improve the behavior and as a stopping criterion for SAs. Finally, the comparison and relations between numerical solutions and SAs are shown in some well-known examples.

1. Introduction

Nonlinear programming has been appeared in solving many real-world problems. Solving interval programming problems is a hot issue in the research area. Interval programming problems are divided into interval linear programming and interval nonlinear programming [112].

Interval nonlinear programming problems are used in modeling and solving many real applications such as planning of waste management activities [13]. The mathematical model and the proofs of interval analysis can be found easily in [14]. Many researchers and authors solve the interval nonlinear programming problems by different methods [1518], but all these methods try to get the optimal solution under some specific conditions. For example, in [8, 9], Hladík divided the problem into subclasses which can be reduced to easy problems. He put a condition for solving these problems that they must be convex quadratic programming. Jiang et al. [11] suggested a method to solve the nonlinear interval number programming problem with uncertain coefficients both in nonlinear objective function and nonlinear constraints. Liu and Wang [17] presented a numerical method to interval quadratic programming. Li and Tian [18] generalized Liu and Wang’s method [17] to solve interval quadratic programming. Their proposed method requires less computing compared with Liu and Wang’s method.

As mentioned above, there are many approaches for solving IQPP, but the most common one is dividing the interval problem into two problems. In the first problem, the optimal solution of the lower objective function on the largest feasible region is found, while in the second one, the optimal solution of the upper objective function on the lowest feasible region is obtained. So, the solution value of the interval problem is between values of the lower objective function and the upper objective function. As is known, this process is very difficult in many applications which lead to the difficultly in reaching the lowest value of the objective function of the problem.

KKT conditions are first-order necessary conditions for solving quadratic programming problems. KKT conditions are optimality conditions for the optimization problems with interval-valued objective functions and real-valued constraint functions investigated and discussed in [1922]. Wolfe’s duality theorems, strong duality theorems, and duality gap in interval-valued optimization problems are discussed in a good mathematical view in [12]. Chalco-Cano et al. [19] introduced a new concept of a stationary point for an interval-valued function based on the gH derivative.

SAs are an important concept in computer science [23, 24]. SAs can be described as a population of agents or individuals interacting with each other and with their environment and working under very few rules. The inspiration often comes from nature, especially biological systems. They are successfully applied in real-life applications. Examples of SAs are ant colony optimization [24, 25], particle swarm optimization (PSO) [26, 27], firefly algorithm (FA) [28], glowworm algorithm [29], krill herd algorithm [30], monkey algorithm [31], and grasshopper optimization algorithm [32].

On the other hand, most of the researchers proposed hybrid algorithms to improve the solution quality, to benefit from their advantages, and to overcome any deficiencies. For example, a gaining sharing knowledge-based algorithm for solving optimization problems over the continuous space was proposed in [33]. Yulian Cao et al. presented a comprehensive learning particle swarm optimizer (CLPSO) embedded with local search (LS) which has the strong global search capability of CLPSO and fast convergence ability of LS [34]. In [35], the authors presented an adaptive particle swarm optimization with supervised learning and control (APSO-SLC) for the parameter settings and diversity maintenance of particle swarm optimization (PSO) to adaptively choose parameters, while improving its exploration competence. A new hybrid PSO algorithm that introduces opposition-based learning (OBL) into PSO variants for improving the latter’s performance is proposed in [36]. In [37], a surrogate-assisted PSO with Pareto active learning was proposed to solve the multiobjective optimization problem with high computational cost. Finally, the historical memory-based PSO (HMPSO) is proposed in [38] which used an estimation of distribution algorithm to estimate and preserve the distribution information of particles’ historical promising p bests.

In this paper, a new approach is suggested to solve the interval quadratic programming problem (IQPP). IQPP is converted into the modified quadratic programming problem (MQPP) by replacing all intervals by additional variables. KKT conditions of MQPP are derived and solved by a numerical method. The numerical method provides the boundaries of the basic variables which are used as starting points in SAs. The solutions of KKT conditions are obtained by using the Mathematica program. CPSO and CFA are used to solve these problems to give the decision maker (DM) a fast view about the position of the optimal solution in the intervals. The dual of MQPP is discussed. The solutions of this problem are used to improve the behavior of the proposed approach and as a stopping criterion for this approach.

2. Interval Quadratic Programming Problem (IQPP)

The interval quadratic programming problem (IQPP) is an interval nonlinear programming problem [911]. The objective function is the quadratic function, and the constraints are linear functions. IQPP can be defined aswhere is an interval-valued function, , is a quadratic function, are the linear functions, , and . The feasible region is supposed to be nonempty and fixed.

The optimal solution of the interval programming problem cannot be defined exactly because at each value belonging to interval coefficients in the objective function and/or the constraints, there may be a new optimal solution. So, no one can define the exact optimal solution. Many researchers descried the optimal solution of IQPP by the objective function values. In [4, 15], the authors defined the optimal solution for the interval linear programming problem. For example, Garajová and Hladík [4] defined the optimal set of the interval linear programming problem and examined sufficient conditions for its closedness, boundedness, connectedness, and convexity. So, we defined the optimal solution as the union of all optimal solutions of IQPP. We explored the whole feasible region to get all possible optimal solutions of IQPP. In our approach, by numerical methods, we tried to get all optimal solutions in the feasible region, while by SAs, we found the best objective value in the whole interval.

3. The Solution of IQPP

The idea of our new vision to solve IQPP starts by replacing all intervals by additional variables and converting IQPP to the modified interval nonlinear problem (MQPP). KKT conditions of MQPP are obtained and solved by a numerical method. The solutions of the numerical method are functions in the additional variables. These solutions are providing the boundaries of the basic variables which are used as start points for SA. The dual of MQPP is presented and solved. CPSO and CFA are used to solve MQPP and its dual form. Furthermore, the solution of dual MQPP is used as a stopping criterion for our approach and to improve its performance. The proposed approach leads to explore the whole feasible region to get the optimal solution anywhere in the intervals.

3.1. Numerical Methodology

KKT conditions are a system of equations solved by two methods, with additional variables and with interval coefficients. Mathematica is used to solve this system program. In the first method, the equations are solved as algebraic equations where the solutions can be expressed as a function of the additional variables. These solutions are very helpful for DM if the optimal solution at certain values of interval coefficients is required. We use the Newton method in the second method if we want to know the boundary of the variables. The solution of this method is used as an initial stage of CPSO, and CFA improved their ability to find the solution in short time than using the whole space of the variables.

The following theorems are used for solving the system of nonlinear equations with interval coefficients. Let MQPP have a continuous function which has a zero in a given subset of , i.e., a vector exists such that , where is the set of real intervals’ vectors. Let be the set of real vectors, be the set of matrices, be an element of an interval vector , be a hull inverse of the interval matrix , be an interior of the interval matrix , be the set , be the interior of an interval , and be a volume-reducing property of the Newton iteration.

Theorem 1 (see [38]). Let be Lipschitz continuous on and let be a regular Lipschitz set on , then(i)For every , the equation has at most one solution (ii)The inverse function defined on the range by is Lipschitz continuous, and is a Lipschitz matrix for on (iii)If , then for every , (iv)If is compact and there is a point such that for all , then , i.e., the equation has a unique solution

Theorem 2 (see [38]). Under the assumption of Theorem 1 above, if , then every satisfying has the following three properties:(i)Every zero of satisfies (ii)If , then contains no zero in (iii)If and , then contains a unique zero in (and hence in )Since , implies , it is natural to consider the general Newton iteration [38]:

With the general Newton operator:

Theorem 3 (see [38]). Let be a strongly regular Lipschitz matrix on for . Let be such that is regular and let be an inverse of . If is regular, then the Newton iteration (6) is strongly convergent for every choice of . Moreover, for all , we have either

Corollary 1 (see [38]). If, for some , is an M-matrix or , then the optimal Newton iteration (6) is strongly convergent for every choice of and the relations (8) and hold.
is defined as

3.2. Swarm Algorithm (SA)

Chaos theory (CT) is used to improve the performance of many SAs [39], where the high randomness of the chaotic sequence improves the convergence and diversity of the solutions. CT is considered as irregular behavior in nonlinear systems due to using the chaotic maps. These maps are worked as particles which move in a small range of nonlinear dynamic systems without knowing the traveling path of these particles. Many researchers proposed combinations between CT and meta-heuristic algorithms to improve the solution quality such as hybrid chaos-PSO [40], chaotic genetic algorithm [41], combined evolutionary algorithm with chaos [42], chaotic whale optimization algorithm [43], and chaotic artificial neural networks [44].

3.2.1. Chaotic Firefly Algorithm (CFA)

FA is an evolutionary computation technique [28]. The main advantages of FA are exploitation and exploration. The improved FA with CT which is called the chaotic firefly algorithm (CFA) is applied to solve IQPP. The details of the main steps of CFA are described as follows:Step 1. Initialization. A population of random N fireflies (solutions) is initialized , where T is the total number of iterations. The position of the i-th firefly in an dimensional space is denoted as and represented as .Step 2. Evaluation. Evaluating the fitness value (the light intensity of each firefly in the population or simply .Step 3. Determination of Best Solution. For minimization problems, the firefly that has minimum light intensity is the best solution .Step 4. Updating Positions of Fireflies. For every firefly and for every firefly do the following: if , the i-th firefly is attracted to the firefly j, and its position is updated according to the following equation:where the attractiveness at is 0, is the light absorption coefficient, is the Cartesian distance between the two fireflies i and j, is a step size factor controlling the step size, and is a vector drawn from a Gaussian or other distribution. If , then otherwise .Step 4-1. Chaotic repairing of the new position .Step 4-2. Updating the best solution : if the new position of the i-th firefly is better than the best solution , i.e., , then .Step 5. Stopping Condition. If a prespecified stopping criterion is satisfied, stop the run; otherwise, go to Step 4.

3.2.2. Chaotic Particle Swarm Optimization Algorithm (CPSO)

PSO can solve many difficult optimization problems. It has a faster convergence on some problems in comparison [45]. The idea of PSO is that several random particles are placed in the search domain of the optimization problem. At its current location, each particle evaluates the objective function. After that, each particle determines the direction of movement in the search domain by combining some aspects of the history of its own current and best locations with particles located nearby in the swarm, but with some random disturbance. The next iteration takes place after all particles have been moved. Eventually the swarm, like a flock of birds collectively foraging for food, is likely to move close to an optimum of the fitness function. The i-th particle is described by an n-dimensional vector as , while its velocity is represented as . The best position of the particle in its memory that it visited is denoted as . The best position in the swarm is denoted as . The steps of the CPSO algorithm are described as follows:Step 1. Initialization.(a)Initializing randomly the positions of all particles(b)Initializing randomly the velocities of all particles(c)Setting t = 1, where t is the increment of time and T is the total number of iterationsStep 2. Optimization.(a)Evaluating the objective function value (b)If , then and (c)If , then and (d)If the stopping criterion is satisfied go to Step 3(e)All velocities are updated according to the following equation:where is an inertia term, are the positive constants, and are the random numbers belonging to (0, 1).(f)All positions are updated according to the following equation:(g)Chaotic repairing of the new position (h)t=t+ 1(i)Go to Step 2(a)Step 3. Termination. If a prespecified stopping criterion is satisfied, stop the run; otherwise, go to Step 2.

3.2.3. Chaotic Repairing of Infeasible Solution

If the new position is infeasible, it is repaired according to the following equation:

If is still infeasible, is repaired according to the following equation:where is any feasible solution in the search space and is a chaotic number generated by the following logistic map:where is the age of the infeasible solution, = 4, , and .

3.3. The Proposed Approach

In this section, we discuss the proposed approach. The following steps describe the proposed approach clearly:Step 1. Replacing all intervals in IQPP by additional variables which is called MQPP and obtaining the dual form of MQPP.Step 2. Constructing KKT for MQPP, and solving KKT equations by the numerical algorithm.Step 3. Using the solutions of the numerical algorithm as a start point of CPSO and CFA.Step 4. Solving MQPP and its dual form by CPSO and CFA.Step 5. The values of the objective function which are obtained from solving the problem by SA and its dual form are compared. If their values are the same, the global optimal solution of our problem is found. If there is a difference between the outputs from the problem and its dual, we solve the problem and its dual form again until the difference between them is ε, where ε can be computed aswhere is the difference between the optimal value of the problem and the optimal value of its dual problem. This solution is a local optimal solution. This comparison is used as a new stopping criterion.The suggested method is suitable for convex and nonconvex problems. The steps of the proposed approach are illustrated in Figure 1.

4. Results and Discussion

The proposed algorithm is tested by solving three problems taken from the literature. Each problem was independently run 30 times. The proposed algorithm was programmed in MATLAB (R2016b) and implemented on the PC with P4 CPU 3.00 GHz, 1 GB RAM with an i5 processor, Windows 7 operating system. The proposed algorithm, as any nontraditional optimization algorithms, involves a number of parameters that affect the performance of the algorithm. The parameters adopted in the implementation of CFA and CPSO are listed in Table 1.

4.1. Problem 1

This problem is formulated as follows [10]:

By replacing all intervals by additional parameters, the problem becomeswhere .

The dual form of problem (15) is

KKT conditions of problem (15) are

In [8, 9], problem (14) can be divided into two problems. The first problem is

Its solution is and . The second problem is

Its solution is and . The solutions of KKT conditions in (18) can be expressed as

In addition, the numerical solution provides the boundaries of the basic variables as and . The comparison between different types of SAs in solving problem (1) is shown in Table 2.

4.2. Problem 2

This problem is formulated as follows [1]:

By replacing all intervals by additional parameters, the problem becomeswhere , and .

The dual form of problem (22) is

The KKT conditions of problem (22) are

In [8, 9], problem (21) is divided into two problems. The first problem is

Its solution is and . The second problem is

Its solution is and . The solutions of KKT conditions in (24) can be expressed as

In addition, the numerical solution provides the boundaries of the basic variables as . The results of problem (2) by using SAs are shown in Table 3.

4.3. Problem 3

This problem is formulated as follows [46]:

By replacing all intervals by additional parameters, the problem becomeswhere

The dual form of problem (29) is

The KKT conditions of problem (28) are

In [8, 9], problem (28) is divided into two problems. The first problem is

Its solution is and . The second problem is

Its solution is and .

The solutions of KKT conditions in (31) can be expressed as

In addition, the numerical solution provides the boundaries of the basic variables and In Table 4, the results of problem (2) by using SAs are listed.

In addition, the statistical results obtained, by original PSO, original FA, CPSO, and CFA, over the 30 runs are summarized in terms of CPU time, mean value, standard deviation, and worst and best values in Table 5.

Furthermore, Figures 24 show the convergence curve of the best obtained so far by original PSO, original FA, CPSO, and CFA for the 3 problems.

Results show that the proposed SAs (CFA and CPSO) outperform the other original algorithms in terms of the optimality. In addition, these results prove that the proposed SAs can solve IQPP effectively with low computational cost where the CPU time is less than the other original algorithms as shown in Table 5. In other words, the solutions, of the test problems, of CPSO and CFA are the same as the solutions of previous methods, but they are very fast without any effort of computation. On the other hand, the numerical approach gives the solution as a general formula in the additional variables, where we can obtain, by this formula, the solution at any values inside the intervals. In addition, the numerical solution provides the boundaries of the basic variables which are used in the step of initialization in SAs. Finally, we can say that our approach, as any SAs, is more generalized and suitable for real applications than traditional methods.

5. Conclusion

This paper deals with a new approach to solve IQPP. We aim to explore the feasible region to get the optimal solution anywhere. All intervals were replaced by additional variables. The new form with additional variables is MQPP. KKT conditions for MQPP were solved numerically to get the solutions as a function in the additional variables and provide the boundaries of the basic variables. The solutions are used as start points for SAs. CPSO and CFA are used to solve MQPP and its dual form. The advantages of our procedure are (1) the solution of the numerical method is more general than previous methods, (2) giving the decision maker a very fast view of the optimal solution inside the intervals, (3) using the optimal solution of the dual problem as a stopping criterion for SAs is more suitable than other criteria, and (4) its effectiveness is verified as compared with other studies. Also, we compare PSO, FA, CPSO, and CFA with each other. Real applications of interval nonlinear programming problems should be conducted in the future. In addition, we are planning to use this vision to solve multiobjective linear programming with interval coefficients. Also, we aim to discuss the GSK algorithm to solve IQPP.

Data Availability

All data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare that this article content has no conflicts of interest.