Abstract

The standard particle swarm optimization (PSO) algorithm is the boundary constraints of simple variables, which can hardly be directly applied in the constrained optimization. Furthermore, the standard PSO algorithm often fails to obtain the global optimal solution when the dimensionality is high for unconstrained optimization. Thus, an improved PSO-based extended domain method (IPSO-EDM) is proposed to solve engineering optimization problems. The core idea of this method is that the original feasible region is expanded in the constrained optimization which is transformed into the unconstrained optimization by combining the ergodicity of chaos optimization and the evolutionary variation to realize global search. In addition, to verify the effectiveness of the IPSO-EDM, an unconstrained optimization case study, four constrained optimization case studies, and one engineering example are investigated. The results indicate that the computational accuracy of the IPSO-EDM is comparable to that provided by the existing literature, and the computational efficiency of the IPSO-EDM is significantly improved. Meanwhile, this method has conspicuous global search ability and stability in engineering optimization.

1. Introduction

Optimization began in the 17th century, which originated from differential and integral calculus invented by Newton and Leibnitz. Then, optimization algorithms [15] were rapidly developed, such as artificial neural network, simulated annealing, genetic algorithm, ant colony optimization, and particle swarm optimization (PSO). All these methods were widely used in different fields [612], such as chemical engineering, biomedicine, navigation, robot, automobile, architecture, and aerospace.

Actually, the mechanical engineering optimization can be expressed as continuity interval constraint optimization. To investigate this problem, some traditional gradient methodologies [1315] were investigated such as the penalty function and Lagrange multiplier. Although the theory of these methods is impeccable, the objective function and the constraint condition must be differentiable. However, the constraint function and objective function are nondifferentiable and discontinuous implicit functions in practical engineering. Consequently, a new optimization method was developed to study this problem, which plays an important role for the development of engineering optimization design.

Initially, the PSO was presented by Kennedy and Eberhart [16] to investigate the flight behaviour of birds, which was termed as the global PSO algorithm. This method has been extended to different kinds of fields. For instance, Xue et al. [17] used analytical method with modified PSO to establish the subdomain model and optimize cogging torque. Han et al. [18] adopted an adaptive gradient multiobjective PSO to improve the computational performance for a mechanism. Yi et al. [19] presented a parallel chaotic local search algorithm to solve constrained engineering design problems. Park et al. [20] used chaotic sequences with conventional linearly decreasing inertia weights to increase the exploitation capability. However, the essence of these methods is not improved, thus some scholars renewed the equation of the global PSO. For instance, Phung et al. [21] proposed a discrete PSO algorithm to solve the extended travelling salesman problem for robotic inspection. Wang and Zhang [22] presented an optimization method to describe a planar parallel 3-DOF nano positioner in modelling. Nickabadi et al. [23] successfully regarded the adaptive inertia weight factor as the feedback parameter to ascertain the situation of the particles in the search space. Mojarrad and Nayeripour [24] used a fuzzy adaptive PSO to solve the non-convex economic dispatch problems. Khan et al. [25] proposed a modified PSO algorithm to avoid the premature convergence and strengthen its robustness. This algorithm can adaptively update parameters to keep the diversity of the swarm. However, the convergence speed of inertia weight method is not very fast, so another method is developed. Liang et al. [26] proposed a fuzzy multilevel algorithm-based PSO to optimize support vector regression machine and realize a fuzzy multilevel drilling leak risk evaluation system. Tian et al. [27] utilized sigmoid-based acceleration coefficients to avoid premature convergence and entrapment into local optima when they handled complex multimodal problems. Hsieh et al. [28] developed a discrete cooperative coevolving PSO algorithm to study the influence of detour distance constraints on the carpooling performance. Zahara et al. [29, 30] put forward the hybrid Nelder-Mead-PSO algorithm for unconstrained optimization, and then they presented embedded constraint handling methods for dealing with constraints. Liu et al. [31] adopted a bottleneck objective learning strategy for many-objective optimization to improve convergence on all objectives. Xia et al. [32] proposed a triple archives PSO to deal with the selecting proper exemplars and designing an efficient learning model. Wang et al. [33] investigated the evolutionary computation community for large-scale optimization.

The above investigations on the PSO algorithm indicate that some constrained points are not located in the feasible region but outside the feasible region; however, these excluded constrained points are closer to the boundary than the points located in the feasible region. Obviously, this is unreasonable. Based on the above research studies, a new methodology named improved particle swarm optimization-based extended domain method (IPSO-EDM) is proposed to investigate engineering optimization.

In the following, Section 2 describes the basic theory of the IPSO-EDM, including standard PSO, improved PSO, and the algorithm principle. Section3 gives an unconstrained optimization case study, four numerical constrained optimization case studies, and one engineering case study to verify the effectiveness of the IPSO-EDM. Section 4 gives the conclusions.

2. Improved Particle Swarm Optimization

2.1. Standard PSO

Assuming that the particle swarm is composed of M particles in an N-dimensional space, the position of the ith particle of the kth iteration is expressed as , the flight speed is described as , the local optimal position is , and the global optimal location is . Each particle updates its speed and position according to the following equation, which are expressed aswhere is the jth component of the ith particle, are positive constants and they are called learning factor, c1 adjusts the step length for particles to their optimal location, and adjusts the step length for particles to the global optimal position, and and are, respectively, random numbers that obey a uniform distribution, and their values are within .

To prevent particles from flying out of the search space in the optimization, the velocity and position are limited as and . Meanwhile, the inertia weight is involved. This method is termed as the standard PSO algorithm. The update equations are expressed as

The standard PSO does not have too many requirements on the objective function and constraint function, which can conduct constraint optimization, and these constraints limit the range of each variable interval value such as . This is different from the gradient method, but it becomes more complicated if there are equality or inequality constraints in the optimization. One obvious reason is that the feasible region has changed from a hypercube to a less regular region, and the variables are not independent on each other. For this reason, the standard PSO must be improved to deal with the constraints.

2.2. Improved PSO
2.2.1. Constraint Methods of PSO

At present, there are four typical methods to deal with constraints:(1)Discriminant function method: inequality and equality constraints are used as discriminant functions to determine whether the search points are feasible points in the optimization process. It will be discarded or modified to be a feasible point during search if the search point is not a feasible point. Thus, this method has strict restrictions to the search point, and it is very difficult to generate the initial feasible point when the feasible region composed by equality and inequality constraints is small.(2)Penalty function method: the optimization and constraint functions are combined to form the penalty function. The original constrained optimization with equality and inequality constraints has become an unconstrained optimization with the penalty function. However, the disadvantage of this method is that the penalty factor must be chosen correctly; otherwise, it can hardly obtain the optimal solution.(3)Multiobjective optimization method: optimization and constraint functions are, respectively, used as the new optimization targets. However, solving the multiobjective optimization is more difficult than solving a single-objective optimization in many cases.(4)“Competitive selection” method: deals with the feasible particles (the design points represented by particles satisfy all constraint requirements) and infeasible particles (some or all design points represented by particles dissatisfy the optimization constraint requirements) in PSO. However, it is not appropriate to deem that feasible particles are superior to infeasible ones in competitive selection, and the infeasible region can be extended into a feasible region to find the optimal point.

2.2.2. Core Idea of the “Competitive Selection” Constraint

The “competitive selection” constraint can be summarized in three aspects:(1)All feasible particles are superior to infeasible particles(2)The particle with a better objective function is selected for two feasible particles(3)The advantages and disadvantages of the particle are judged according to the degree of constraint violation for two infeasible particles; the lesser the degree of the constraint, the larger the violation

In Figure 1(a), unconstrained optimal point is in the feasible region, and the constraint is useless to the whole optimization; essentially, the constrained optimal point is the unconstrained optimal point. However, the unconstrained optimal point is not located in the feasible region but at its boundary for some optimization. For example, point is the constrained optimal point, point C is in the feasible region, and point D is outside the feasible region in Figure 1(b). According to the competitive selection, point is superior to D. However, point is closer to B than C; thus, the optimal information provided by is superior to C. As a result, point is labelled as suboptimal, which is not appropriate. So, the algorithm must be improved. Figure 1(c) shows an improved method, which expands the original feasible region to include points such as D which is unfeasible but close to the feasible region and can provide better function information and is taken as the feasible point. This methodology is termed as extended domain method (EDM).

In addition, the new speed depends on the current speed in the updated formula for standard PSO. However, the algorithm is random, and it is impossible to predict and control the size of particle speed. To solve this problem, a control variable is introduced in the extended domain, and the result is shown in Figure 2,where is the optimal location, is the current particle position, is the optimal historical position of the particle swarm, is the optimal historical position of the current particle, is the optimal location of the current particle swarm, and and are, respectively, the largest and smallest speeds.

Figure 2 shows that the particle with higher speed may miss a better position, while the particle with smaller speed improves the position, but it is not the optimal position. Thus, the current particle speed is expected to be controlled. One method is to use current location information of the particle swarm to determine its speed. The difference value between the particle swarm and the particle in the current optimal position is used to determine current particle velocity. The results indicate that the position determined using this method is better than the positions and . In fact, the constrained optimization is transformed into an unconstrained optimization by the EDM, so a scientific and reasonable unconstrained optimization method needs to be developed.

2.2.3. Unconstrained PSO

Firstly, the initial particle swarm position and velocity are determined in a random way in standard PSO. Generally, the designers expect the particles in the particle swarm space can better reflect the information which is studied in the initial state. One of the direct ways is to generate many particles which fill in the whole search space. However, this will consume a lot of computational resources in subsequent iterations. The PSO algorithm will lose its characteristics of group cooperation if the number of particles in the particle swarm space is too small, which is meaningless. Usually, the particle swarm with dozens of particles can solve the complex optimization problem, but random arrangements of particles often result in a “cluster” in an area. To enable the particles to be relatively “evenly” distributed in the search space, the uniform design method based on statistical theory is used to initialize the particle swarm space. The random distribution and uniform distribution of the initial particle swarm space are shown in Figure 3.

Secondly, the standard PSO algorithm itself cannot obtain global information of the objective function, and it is easy to fall into the local optimal. Generally, the particle can jump out of the local optimal and give new global information by dynamically adjusting the inertia factor, but simply adjusting the inertia factor is not enough for the complex multipeak function. To handle this problem, the ergodicity of chaos optimization [22] is combined with evolutionary variation to realize global search. In this method, logistic chaotic system equation is applied in the PSO algorithm and obeys Chebyshev distribution, as shown in Figure 4.

Figure 4 indicates that the middle value of the logistic chaotic sequence is relatively uniform, while the probability of both sides is relatively large. It means that the chance of finding the global optimal point will be reduced using the logistic chaotic sequence if the global optimal point is not at ends of the design variable. Therefore, it is very necessary to find a chaotic sequence, which can not only maintain ergodicity but also keep uniform statistical distribution. According to this problem, evolutionary variation strategy is developed. Generally, this strategy introduces a mutation operator to change the design variable. This method can help the particle swarm escape local optimal and maintain its overall vitality and prevent the particle swarm from falling into the condition of “precocity” at the earlier iteration. Based on the above research, the idea of uniform design, chaos optimization, and evolutionary variation is introduced into unconstrained PSO, and this method is improved to realize global search and local search.

Firstly, the uniform design of the Halton sequence [34] is adopted to initialize the particle swarm. Assume that the particle position scope of the design variable is , whose component values of the ith particle are , and the position of the initialized particle swarm is expressed as

Similarly, the velocity for the component values of the particle is expressed as

In the process of particle swarm evolution, the points around the optimal position still need to be searched to get a better position when the optimal position of the particle swarm is found. This is called as the chaos optimization search method, which is expressed as

However, the chaotic sequence generated by equation (5) is not uniform in statistics; therefore, the chaotic sequence needs to be transformed as follows:

Equation (6) not only satisfies the ergodicity of the chaotic sequence but also complies with the uniform distribution in . The uniform logistic chaotic sequence and original logistic chaotic sequence of the frequency curve and ergodic graph are shown in Figures 5 and 6. The point set of the chaotic sequence is 1e4.

The optimal position of the particle swarm is denoted as after the kth evolution, and the ith component is denoted as ; then, the initial value of the chaotic sequence is expressed as

According to equations (5) and (6), the chaotic sequence is generated, and its coordinate value corresponding to the original space is obtained via reverse transformation, which is expressed aswhere l is the number of iterations of the chaotic sequence and k is the number of iterations.

However, the chaos optimization can hardly make particle swarm get rid of local optimal, and the evolutionary variation is used to help it jump out local optimal. The mutation operator plays a key role in evolutionary variation. The Gaussian operator and Cauchy operator are two commonly used mutation operators. The global searching ability of the Cauchy mutation is stronger than that of the Gaussian mutation, but Cauchy mutation may produce large stride length in search, which means its local search ability is not as good as that of the Gaussian mutation. Therefore, according to the characteristics of Cauchy variation and Gaussian variation, the “coarse tune” of the particle swarm is obtained through the Cauchy mutation at first, and then its “fine tune” is obtained through the Gaussian mutation. The mutation formula is described aswhere and represent the value of the kth design variable before and after mutation, respectively; is a random number; is the contraction coefficient and ; and is the number of mutations.

The design variable value can hardly exceed its interval after mutation because of its range limitation in optimization process. The design variable value will be mutated again when its value is not in the definition domain after mutation until its solution is convergence. The maximum number of mutations is stipulated as q when the mutation value still does not satisfy the value range in the procedure. Then, the mutation can be judged according to the absolute value of the difference between the mutation value and interval endpoint value, namely, the mutation value is the left endpoint value and vice versa if the variation value is close to the left endpoint.

2.2.4. Algorithm Principle

Generally, the optimization model is described aswhere is the objective function; is the inequality constraint function; and is the equality constraint function.

To divide the particle swarm space into the feasible domain and unfeasible domain, a constraint conflict function is constructed, which is defined as

According to equation (11), an arbitrary feasible point satisfies , and an arbitrary unfeasible point satisfies ; meanwhile, can also describe the degree of constraint violation of the unfeasible point.

To control the size of the extended domain and particle speed, the control variable is defined in the following four situations for any two given search points and :(1) is superior to when and are both in the extended domain, i.e., and (2) is superior to when and (3) is superior to when and are both outside the extended domain, i.e., , and (4) is superior to when is in the extended domain, , and is outside the extended domain,

The control variable of the extended domain is gradually changing with particle swarm evolution, and the strategy is expressed aswhere k is particle swarm evolution algebra and is the initial control variable of the extended domain, which is defined aswhere is the set composed by the initial particle swarm.

When evolves to the kth generation, stipulating , can be expressed as

The control variable can be expressed as

To make the particle swarm fast gather to the optimal point in the direction, its update strategy is written aswhere is the optimal position of particles in the current generation; controls step length; and determines the motion direction of the particle.

The following limit policy is adopted when the particle swarm crosses the border in the process of updating, which is denoted aswhere is the uniform-distributed random number and is the locational average of the particle swarm.

To include points such as D in Figure 1(b), the EDM expands the original feasible region and provides preferable information, which is more reasonable.

3. Example

3.1. Unconstrained Optimization

Four test functions are investigated to verify the effectiveness of chaotic methodology. The comparison of PSO, CPSO, and IPSO-EDM is shown in Tables 14. Firstly, the mathematic models are established as follows.(1)Sphere function:(2)Rastrigin function:(3)Rosenbrock function:(4)Ackley function:

It is seen from Tables 14 that four test functions are used to verify the effectiveness of the IPSO-EDM. As seen in Tables 14, the worst value, average value, optimal value, and standard variance in the same dimension are, respectively, calculated via PSO, CPSO, and IPSO-EDM, and the results calculated by the IPSO-EDM are the minimum values. Thus, the computational accuracy of the IPSO-EDM is the highest. In short, the IPSO-EDM has optimal computational accuracy compared with PSO and CPSO.

3.2. Constrained Optimization
3.2.1. Numerical Case Studies

To test the effectiveness of the IPSO-EDM, 3 test case studies are investigated, the scale of the particle swarm is 50, the number of iterations is 1000 times, and . The statistical results of the optimal function and constraint conflict function are listed in Tables 5 and 6. The comparison of different methods is shown in Tables 710, where “N/A” means not available. Firstly, the mathematic models are established as follows.G1:where .G2:where .G3:where .

Three numerical case studies are used to verify the effectiveness of the proposed IPSO-EDM. As seen in Tables 710, the worst value, average value, and the best value are, respectively, calculated via the IPSO-EDM and five famous methods, i.e., HM, ASCHEA, SR, EDPSO, and MPSO. The investigation indicates that the computational accuracy of the IPSO-EDM is comparable to HM, ASCHEA, SR, EDPSO, and MPSO. Furthermore, this research manifests that the computational efficiency of the IPSO-EDM is significantly improved compared with the other five methods (HM, ASCHEA, SR, EDPSO, and MPSO) by measuring the product of the group size and algorithm cycle times. It can be seen from Table 10 that the computational efficiency of the IPSO-EDM is the largest compared with the other five methods, i.e., the product of population size and algorithm cycle times of the IPSO-EDM is the least among all methods.

To verify the effectiveness of the presented algorithm, the new parameters such as and are investigated. The performance function is written aswhere .

The iteration process of and is calculated by HL, W-G, and IPSO-EDM, which are shown in Figure 7.

Figure 7 indicates that of the standard HL method is very large, and its convergence value is 674.2829, but convergence values of W-G and IPSO-EDM are, respectively, 2.42e − 2 and 5.14e − 4, which manifests feasible points of HL are very few, i.e., the accuracy is very low. Meanwhile, it can be seen that the curve of obtained is fairly close each other by W-G and IPSO-EDM, but the convergence value obtained via the IPSO-EDM is 5.14e − 4 which is smaller than 2.42e − 2 obtained by W-G, and this means the accuracy of IPSO-EDM is higher than that of W-G. Meanwhile, the convergence value of via HL is 1.1657, and they are 2.22572 and 2.22599 by W-G and IPSO-EDM. Thus, the computational accuracy and efficiency of the IPSO-EDM are optimal and of HL are the worst.

3.2.2. Engineering Case Study

Many researchers use the finite element method to study engineering [38], but they do not optimize it. This method can also be used in practical engineering, for instance, this is a welded beam structure, which is shown in Figure 8.

The optimization goal is to seek four design variables, i.e., , , , and , which satisfy the constraints of shear stress , bending stress , bending load of the welding rod, deviation , and the boundary condition, and the total manufacturing cost of the welding rod is the minimum. The mathematical model is described aswhere

Note that .

The comparison results obtained by the IPSO-EDM and the other methods are shown in Table 11.

The optimal results obtained by the IPSO-EDM are equivalent to those provided by the existing literature, which verifies the accuracy of this method. However, the computational efficiency of the proposed IPSO-EDM is higher than the methods in the literature in Table 10.

4. Conclusions

The standard PSO algorithm is improved from the perspective of engineering application to solve engineering optimization problems.(1)The original feasible region is expanded, and some points that are closer to the constrained optimal point in the feasible region are contained as feasible points, which provide preferable function information compared with the points in the original feasible region. This approach uses the current location information of the particles and particle swarm to determine the speed of the particles. In short, the difference value in the current optimal positions of the particle swarm and the particle is used to determine the current particle velocity. The optimal location of obtained points using the proposed method is better than that obtained using the standard PSO.(2)The constrained optimization is transformed into the unconstrained optimization by combining the ergodicity of chaos optimization and the evolutionary variation to realize global search. The logistic chaotic system equation is applied in the PSO algorithm, and the mutation operator is introduced in the evolutionary variation strategy to escape local optimal and maintain its vitality of the particle swarm, which prevents the particle swarm from falling into the condition of “precocity” at the earlier iteration.(3)An unconstrained optimization case study, four numerical case studies, and one engineering case study are used to verify the effectiveness of the IPSO-EDM. The worst value, average value, and optimal value are, respectively, calculated via the IPSO-EDM and compared with other methods. The investigation indicates that the computational accuracy of the IPSO-EDM is comparable to that provided by the existing literature; however, the computational efficiency of the IPSO-EDM is significantly improved.(4)Though the PSO method is improved and six case studies are investigated to prove the effectiveness of this method, yet the numerical case studies are relatively simple, and the design variables of the engineering case study are small. Moreover, only the deterministic optimization is studied. Thus, the nondeterministic optimization will be researched, and the random variable will be subject to normal distribution, exponential distribution, or Weibull distribution. Accordingly, the proposed method can be expanded to wide-spread engineering application fields. Further studies will focus on the IPSO-EDM considering random variables of different distributions including normal distribution, exponential distribution, and Weibull distribution to deal with actual operation of the machines.

Data Availability

The data used to support the findings of this study are currently under embargo, while the research findings are commercialized. Requests for data 6/12 months after publication of this article will be considered by the corresponding author.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

The authors gratefully acknowledge the financial support for this research from the National Key R&D Plan Project (Grant no. 2017YFB1301300), the National Natural Science Foundation of China (Grant nos. 11772011 and 11902220), and the National Natural Science Foundation of Hebei Province (Grant no. E2020202217).