Abstract

A fuzzy predictive controller using particle swarm optimization (PSO) approach is proposed. The aim is to develop an efficient algorithm that is able to handle the relatively complex optimization problem with minimal computational time. This can be achieved using reduced population size and small number of iterations. In this algorithm, instead of using the uniform distribution as in the conventional PSO algorithm, the initial particles positions are distributed according to the normal distribution law, within the area around the best position. The radius limiting this area is adaptively changed according to the tracking error values. Moreover, the choice of the initial best position is based on prior knowledge about the search space landscape and the fact that in most practical applications the dynamic optimization problem changes are gradual. The efficiency of the proposed control algorithm is evaluated by considering the control of the model of a 4 × 4 Multi-Input Multi-Output industrial boiler. This model is characterized by being nonlinear with high interactions between its inputs and outputs, having a nonminimum phase behaviour, and containing instabilities and time delays. The obtained results are compared to those of the control algorithms based on the conventional PSO and the linear approach.

1. Introduction

In the late seventies, a new class of advanced control algorithms, grouped under the denomination Model Predictive Control (MPC), has emerged. The MPC strategy is based on the use of an explicit model to predict the process future behaviour over a finite horizon and then to compute a sequence of future control actions by minimizing a given cost function. The MPC is known to be a very powerful control strategy for many industrial processes [13]. Its attraction is due to its ability to handle complex control problems which involve multivariable process interactions, constraints in the system variables, nonminimum phase behaviour, and variable or unknown time delays. Linear MPC (LMPC) techniques, which use a linear model for the process, have been successfully used in many industrial applications, such as refining, chemicals, petrochemicals, air and gas processing, and food processing industries [46].

Although LMPC algorithms provide satisfactory performance in many applications, against highly nonlinear process, severe degradation in the control performance can occur, unless of course the operating conditions are very close to the steady state around which the model is linearized [7]. Since most practical processes are nonlinear by nature, new efficient nonlinear MPC (NMPC) techniques have to be derived to incorporate nonlinearities and ensure higher control performance. The introduction of nonlinear models will enhance the overall controller performance. However, the relatively simple optimization problem in LMPC algorithms will be transformed to a nonlinear and a nonconvex optimization problem which requires complex and time consuming procedures [810]. Thus, the challenge is to derive an efficient optimization algorithm that allows the real-time implementation of the control law.

An important step in the design of NMPC algorithms based controllers is the construction of the explicit nonlinear model of the system. The model choice is a critical task; the controller efficiency and performance depend extremely on the accuracy of the used model. In many cases it is even impossible to obtain a suitable model for the underlying process due to its complexity or lack of knowledge of its critical parameters. Different approaches that can provide satisfactory models exist; one which is widely used is the fuzzy logic technique [11]. Fuzzy inference systems (FIS) are universal approximators capable of approximating any continuous function with a certain level of accuracy [12]. Takagi-Sugeno (TS) models, a subdivision of fuzzy models, are particularly suitable for NMPC algorithms [13]. These models are able to express the dynamic nature of systems with characteristics of randomness, large delay time, and strong nonlinearity [14, 15].

Another important factor in driving the NMPC based controllers is the resolution of the relatively difficult and time consuming nonlinear and nonconvex optimization problem. Seeing that the analytical approach is impractical, several other suboptimal solutions were proposed [7, 1618]. Some of them are based on numerical optimization algorithms, which are known to have a slow convergence rate and could easily be trapped in local minima. Other more interesting approaches are the metaheuristic based optimization algorithms, such as the powerful but computationally complex genetic algorithms (GA) and the particle swarm optimization strategy. PSO algorithms require much less computational effort than the GA and their implementation is relatively easy [19]. A lot of papers have considered the PSO to solve the optimization problem of NMPC [2023]. In these papers, a large number of particles and iterations were used which increases the computational burden of the control algorithm. Recently, several PSO algorithms have been proposed in the literature to solve different optimization problems [2426]. In most of these algorithms, improving the accuracy and the convergence proprieties of the algorithm is obtained at the cost of increasing its computing complexity. For example, in [26] more than one equation is used to update the particles positions at the same time. Obviously, using several update equations will increase the algorithm computing time and will limit its use in real time applications.

In this work, a PSO based constrained fuzzy predictive controller is proposed. The aim is to develop a simple and efficient controller capable of handling the relatively complex optimization problem with minimal computational time. This can be achieved using a reduced population size and a small number of iterations. The proposed control algorithm uses the normal distribution law to distribute the initial particles positions within the area around the best position. The radius limiting this area is adaptively changed according to the tracking error values. Moreover, the choice of the initial best position is based on prior knowledge about the search space landscape and the fact that in most practical applications the dynamic optimization problem changes are gradual. The algorithm efficiency is evaluated by considering the control of the model of a 4 × 4 Multi-Input Multi-Output (MIMO) industrial boiler [27, 28]. This model is characterized by being nonlinear with high interactions between its inputs and outputs, having a nonminimum phase behaviour, containing instabilities and time delays, and including constraints on its variables, disturbances, and uncertainties.

The paper is organized as follows. In Section 2 the design stages of Takagi-Sugeno fuzzy models are presented. Section 3 presents and describes the fuzzy predictive control problem. The PSO algorithm, used to solve the fuzzy MPC optimization problem, is introduced in Section 4. Section 5 deals with the proposed control algorithm and Section 6 gives the simulation results. Finally, conclusions are drawn in the last section.

2. Takagi-Sugeno Fuzzy Modelling

Fuzzy inference systems (FIS) are universal approximators capable of approximating any continuous function with certain level of accuracy [12]. The FIS are based on the so-called IF-THEN rules and are classified into two main categories: Mamdani models and Takagi-Sugeno models. The rules of TS fuzzy models, used in this work, have the following form:where is the set of premise values, is the set of inputs and outputs values used in the consequent regressors, is the set of membership functions associated with the antecedents of the rule, and is the parameter vector of the submodel while is its output (; is the number of fuzzy rules).

It is clear, from (1), that the Takagi-Sugeno fuzzy models have fuzzy propositions only in their antecedents while their consequences are linear functions of the antecedents or their variables.

Using input/output data extracted from a nonlinear process, a fuzzy model can be constructed to mimic the process behaviour, by defining the parameter matrix asand the normalized membership grade vector asThe inferred output of the TS fuzzy model is given byUsing the input/output representation, the TS model given by (4) can be rewritten as follows:where , , and .

The global output of the fuzzy model can be written aswhere is the output of the th submodel andAssuming that a set of input-output data pairs is available and defining , a regression matrix which has the following expression can be constructed:The vector can be calculated by solving the following least square problem:where .

The resolution of (9), which is the last step in TS fuzzy model construction, deals with the definition of the consequences part of the rules. However, the antecedent, which involves in part the number, the position, the shape, and the distribution of the membership functions, must be first selected. A lot of techniques for the construction of fuzzy models from input-output data are described in the literature; in Espinosa et al. [16] different approaches are well explained.

3. Fuzzy Predictive Control Principle

We can always distinguish two common features present in any given MPC based algorithm. The explicit model used to predict the future process behaviour and the optimization problem from which a control sequence is derived.

The main steps of the MPC strategy are given below:(1)The constructed model is used to predict the future behaviour of the process over a given prediction horizon.(2)The reference trajectory must be defined over the prediction horizon.(3)The control sequence is obtained by minimizing a given cost function.(4)Only the first element of the control sequence is applied on the system.

The previous steps are repeated, at every sampling time, according to the receding horizon idea. These steps are illustrated by the block diagram of Figure 1.

The optimization problem to be solved at every sampling time usually has the following form:where is the control increment, is the cost function, and are, respectively, the minimum and maximum prediction horizons, is the control horizon, is a positive definite matrix and is a positive semidefinite matrix which are called weight matrices, is the reference trajectory, represents the system inputs, and is a -step ahead prediction of the system outputs on data up to time . The predicted outputs can recursively be generated using the process fuzzy model or obtained using a multistep prediction model of the process.

Given that the predicted outputs are nonlinear with respect to the control inputs, the optimization problem given by (10) is then a constrained nonlinear and nonconvex optimization problem, the solution of which is difficult and generally expensive in computing time. Different approaches were investigated to solve this problem, such as the numerical optimization techniques [2931], the metaheuristic based optimization algorithms [7, 15, 22, 32], the linearization of the process fuzzy model [18], and the use of particular model structures to obtain a convex form for the cost function [33].

4. PSO Algorithm

The particle swarm optimization is a modern and versatile population based optimization technique, in many respects, similar to evolutionary algorithms [19]. It was first introduced by Kennedy and Eberhart in 1995, as a solution for the optimization problem of a single objective continuous problem. It is based on the observations made upon the collective behaviour of social living entities, such as ants, bees, and flocks of birds. Basically, each particle will be moving around the search space looking for an adequate solution to the optimization problem. By evaluating the fitness of each one of them, their suitability as a possible solution will be assessed. In the next iteration, each particle will change its position to provide more accurate solution, by considering the history of the particle or its best position, its neighborhood history, and mainly the best position found by the whole swarm.

The particles movements are bound by the following equations:where , , are, respectively, the particle, velocity, acceleration, and position and is the iteration index.

In the Clerc-Kennedy PSO [34], considered as the conventional PSO algorithm, the particle acceleration has the following expression:where , , and are random numbers from the uniform distribution , is the particle personal best position, and is the global best position of all particles. Parameter guarantees a decreasing velocity for each particle as the number of iterations increases. This property will improve the convergence quality as the particles approach the solution; their movement will be more and more limited, which help to fine-tune the found solution.

The PSO population size is extremely dependent on the optimization problem at hand; a compromise must be reached between the size of the population and the global performance. Empirically, it has been shown that a population of about 20 to 30 particles is generally sufficient in handling almost all the classical optimization problems [35]. Some other optimization problems could be efficiently solved by a smaller population or rather require a larger one. Several papers have dealt with this problem. The author in [35] describes an adaptive PSO algorithm where the swarm population size is obtained through different strategies that regulate the population by removing badly performing particles and creating new ones. In [36] the VarPSO has been proposed, where the PSO population size is varied during the run, based on the concepts of particle age and neighborhood.

One of the major drawbacks of the original PSO algorithm is its inability to consistently improve a solution as the number of iterations increases [37]. Several improvements were proposed to address this weakness, such as the tent-map PSO algorithm introduced by Song et al. [38] and the self-organizing hierarchical particle swarm optimization [39]. In [34], a constriction factor is used to progressively contract the particle movement, as the iterations increase. Different distribution laws like exponential and Gaussian have already been used for the fine-tuning of PSO parameters [40, 41]. But for initializing the particles most of the proposed algorithms use the uniform distribution. The authors in [42] have investigated the possibility of using different distribution law to initialize the particles. They have shown that using other distribution laws gives better performances for most of the cases. In the remaining ones, the performances were the same. This is due to the nature of the uniform distribution, which sometimes gives a wrong impression of the relative performance of algorithms as it is shown in [43].

One of the reasons for the poor performance of the basic version of PSO algorithm may be attributed to the dispersion of initial population points in the search space. If the population does not cover the search space efficiently, it may not be able to locate the appropriate solution points, thereby missing the global optimum [44]. This difficulty may be minimized to a great extent by selecting a well-organized distribution law.

The PSO algorithm used to solve the optimization problem of the fuzzy predictive control uses the Gaussian distribution to initialize the swarm and is based on the ideas that take advantage of both prior knowledge about the search space landscape and the fact that in most practical applications the dynamic optimization problems changes are gradual [19]. In most cases, it will be logical to assume that once a solution was found, it is better to track it rather than to look for it every time the optimization problem changes. In this algorithm a group of candidate solutions is generated and their fitness is evaluated. The fittest one is adopted by the PSO population as their initial global best position before even initializing the PSO algorithm; then the particles population is used to enhance this solution by favouring the search of an adaptive immediate neighbourhood around the initial solution. This allows increasing the efficiency of the algorithm in regard to the execution time and enhances the convergence quality of the solution. Contrary to the conventional PSO algorithms that involve the use of a large population size to effectively probe the whole search space, the downside, of course, is the huge computing requirement necessary to manage this population.

5. Fuzzy Predictive Controller Design Based on the PSO Algorithm

5.1. Notation and Principle

Without excluding the use of other nonlinear models, the TS fuzzy model described in [14] is used, as the explicit model to predict the future values of the system. In the case of other nonlinear models, the same steps can be used in solving the optimization problem.

Let us define the notation adopted in the formulation of the proposed control algorithm.

We consider a MIMO system with inputs and outputs.

The position of the particle, at the sampling time , is represented bywhere is the number of particles in the population (swarm), and The position of each particle is adaptively changed according to (11) and (12).

The cost function is used as the fitness function ().

The control sequence which is the optimal solution of the optimization problem is then given by the global best position (); that is,where , , is the system control input vector.

The block diagram of the developed control algorithm is illustrated in Figure 2.

The different steps of the algorithm are drawn based on the following points:(1)The solution obtained at the sampling time is taken as an initial solution for the next sampling time :This is a good choice when the system is operating in the steady state.(2)Another candidate initial solution for the sampling time is given bywhere is the control sequence obtained at the previous sampling time and .(3)Both initial solutions chosen in points 1 and 2 are evaluated using the fitness function. The fittest one is chosen as the initial global best position of the entire PSO population.(4)Using the Gaussian distribution, the particles (, ) are distributed around within the radius according to the following expression:where is random value from the normal distribution , is a random value from the normal distribution , and .The values of the radius , at the sampling time , are given by

To explore the whole search space, the particles positions are updated according to (11) and (12).

Using a Gaussian distribution will ensure that the density of the particles gets higher around the chosen initial global best position; thus the optimal solution can be reached in few iterations, using a small number of particles. This is very interesting, in the case of small changes of the system outputs, if the system is operating in the steady state, or if we want to fine-tune the solution. The use of a uniform distribution favors the diversity of the particles and increases the probability to find better solution relatively far from the previous one. Since the number of PSO particles and the allowed iterations number should not be large, their initial positions carry a lot of influence in the quality of the solution.

To keep the algorithm from converging toward a local optimum, a minimal value given by the following expression is imposed to :where is an matrix of scaling parameters and () is used to impose a minimum value to regardless of the tracking error (the value of can have a fixed value by setting to zero).

If the current solution is far from the global optimum, the corresponding tracking error will be large and consequently the values of will also be large. When    (), the particles are distributed around within instead of . This will allow the algorithm to escape the current local optimum by looking for a better solution far from the actual one.(5)The termination criterion is the maximal number of iterations.

5.2. Constraints Handling

One of the strong points of predictive control is its ability to handle the control constraints directly and efficiently in the design stage by solving a constrained optimization problem. Different types of constraints could be distinguished depending on their nature. Mainly, we have constraints on the inputs, presented by actuators with limited range of action and a limited slew rate, and constraints on the outputs due to environmental, safety, and economic goals.

Several approaches were proposed for handling constraints using evolutionary algorithms [45, 46]. They can be grouped into four categories [47]: methods based on preserving feasibility of solutions, methods based on penalty functions, methods that differentiate the feasible and infeasible solutions, and hybrid methods. The proposed control algorithm is based, in the constraints handling, on the hybrid approach. Indeed, the output constraints are handled using a penalty function while the input constraints are handled using the method based on preserving feasibility of solutions.

5.2.1. Outputs Constraints

One practical and popular approach is to soften the constraints [48]; this means that a violation of the constraints is allowed, but under severe and special conditions. The easy way to soften the outputs constraints is to add new variables, called slack variables, to the cost function that will heavily penalize any deviation or violation of the constraints in order to force the optimizer to violate these constraints only when it is absolutely necessary. The output-dependent weight function was chosen to soften the output constraints. It has the following expression [5]:where and

The function depicted in Figure 3 is the output-dependent weight function () used in the softening of the constraints.

is used to define the degree of softening: indicates hard constraint while indicates no constraint. and limit the range where the outputs are allowed to exist.

The function will be also used on unconstrained outputs () by setting and , respectively, to and .

By introducing the weight function , the optimization problem will be reformulated to have the following expression:

5.2.2. Inputs Constraints

The PSO algorithm, as any other population based algorithms, can systematically handle the input constraints by searching for solutions in the space for which these constraints are satisfied. The lower and upper bounds of this space are obtained as follows.

The constraints on the inputs and their increments are typically given bywhere and limit the range of the inputs, while and limit the range of the inputs increments.

For any given particle , we can write, from (24),For , is the already calculated control action , and .

On the other hand, from (23), the constraints on the inputs magnitude could also be written as follows:Hence, from (25) and (26), the lower and upper bounds of the search space will be given bywhere

5.3. The Control Algorithm

The basic steps of the proposed control algorithm are summarized as follows.

Step 1. Initialize the control algorithm by choosing suitable values for the design and the PSO algorithm parameters.

Step 2. According to points 1 and 2, determine the initial solutions and .

Step 3. Specify the desired reference trajectory over the prediction horizon and compute the future values of the system outputs: , .

Step 4. Use the cost function given by (22) to evaluate the fitness of the initial solutions and . The fittest one will be adopted by the PSO population as their initial global best position .
Set .

Step 5. Evaluate the value of using (19) and the value of using (20):

Step 6. For each particle ,randomly initialize its velocity ,using (18), distribute the particle around within the radius ,set , and evaluate ( is the personal best position of particle )

Step 7 (repeat). For each particle ,using (11) and (12), update ,evaluate ,until termination criterion is reached.

Step 8. The optimal solution is the global best position .

For the next sampling time go to Step 2.

6. Case Study

6.1. Process Description

To assess the performance of the proposed control algorithm, the control of the industrial boiler model developed by Pellegrinetti and Bentsman [28] is considered. This model represents a dual fuel (oil and gas) boiler in the Abbott Power Plant in Champaign, Illinois, which could be used for both heating and electric generation. It is a MIMO process, which has four manipulated inputs (fuel flow rate, air flow rate, feed water flow rate, and a valve to regulate the steam demand) and four measured outputs (pressure, oxygen level in the flue gas, drum water level, and steam flow). The control objectives are to maintain the pressure, the level of the water in the drum, and the oxygen level in the flue gas at their desired values, regardless of the steam flow rate provided by the boiler and any other disturbances, such as the fluctuations in the heating value of the fuel or the variations in the ambient temperature. This mathematical model includes perturbations and measurement noises and is described by the following equations:where is the drum pressure state , is the measured drum pressure (PSI), and are the measured excess oxygen level and its state, respectively (%), is the system fluid density , is the drum water level (in), is the steam flow rate , , , and are, respectively, the fuel, air, and feed water flow rates which take values in the interval , and is the exogenous variable related to the steam demanded. The variables are the outputs of the first-order colored noise models driven by zero mean and unit variance white noise and are considered to be unmeasured output disturbances. The remaining coefficients values are given in Table 1. Considerwhere , , are colored noise and , , is the unit variance white noise.

The process is supposed to be initially operating around the following states:

The linear representation of the boiler around the operating state given by (34) is described bywhere

There is a direct feedthrough between the output and the inputs and , expressed by a nonzero matrix in the state representation. This property will create some problems when considering the linear MPC controller [49]. In order to have = 0, a delay will be introduced to the inputs and with regard to the output .

This process is inherently unstable. Essentially, a stabilisation scheme of the water level must be introduced to make any identification approaches possible by incorporating a proportional feedforward action (C2) of 0.0403 and a PI controller (C1) with and , as it is illustrated in Figure 4.

6.2. Process Fuzzy Identification

The first step in the design of a fuzzy NMPC controller is the construction of a nonlinear model of the process. Four fuzzy multi-inputs single output models were constructed to predict the future behaviour of the process. Two triangular membership functions per input, a sampling period of 3 s, and the models given by the following equations were used: where , , represent the fuzzy relationships between the inputs and the outputs.

Figure 5 shows the validation results of these models.

6.3. Controller Implementation and Simulation Results

It has been shown in [28] that there is a nearly linear relationship between the fuel/air ratio () and the oxygen level. So, the oxygen level can be kept constant at a desired value by maintaining the corresponding FAR value constant. Given that affects all the systems outputs, varying to maintain the FAR value constant is the appropriate way. Thus, the value of can be directly deduced from that of . To keep the desired oxygen level in flue gas around 2.5% the FAR value must be equal to 1.2241 and equals 0.8169 .

The control objective is to force the steam flow rate to track a desired reference trajectory, while fulfilling the following constraints on the manipulated inputs,and the following constraints on the outputs,

The following parameters values were used in implementing the proposed control algorithm:And , number of particles = 5, number of iterations = 5, and . The values of the other parameters are gathered in Table 2.

In addition to the proposed algorithm, two other control strategies were considered:

Using the Conventional PSO. In this algorithm, the particles are randomly distributed in the whole search space and the solution of the previous sampling time is taken as a possible solution for the current sampling time. The PSO parameters values and , adopted by Clerc and Kennedy [34], are used in both PSO based controllers.

Using the Linear MPC Strategy. In this strategy, only the constraints on the inputs variables and their increments are considered and the optimization problem is converted into a quadratic programming (QP) problem.

To implement this strategy, a linear representation for the process given in Figure 4 must be used. To remove the direct feedthrough between the output and inputs and , the structure given in Figure 4 is slightly modified by introducing a unit delay in these inputs (Figure 6). The obtained system is linearized around the operating state given by (34) and then discretized using a sampling period of 3 s. The following discrete state space representation is obtained:where

The design parameters values are chosen as follows: And , , and .

Figure 7 presents the obtained results when a population size of 5 particles and 5 iterations is used. A zoom of the area lying between the 17 and 35 minutes of the steam flow rate is given by Figure 8. The corresponding control signals are depicted in Figure 9.

The obtained results show that the proposed controller outperforms the linear MPC and the conventional PSO based controller. The output is almost identical for the three controllers, due to the fact that the FAR is always kept constant regardless of the used controller.

To compare the performance of the considered algorithms when different values of the population size and the number of iterations are used, the Mean Cost Value (MCV) criterion given by (44) is adopted: For each value of the population size and the number of iterations both control algorithms are executed fifteen times and the corresponding value of the MCV criterion is computed. The averages values of the MCV criterion, over the fifteen executions, corresponding to each population size and iterations number are depicted in Figure 10. It is clear, from this figure, that the proposed PSO based controller always outperforms the conventional PSO based controller, regardless of the selected population size and the number of iterations.

The execution time of a control algorithm is a very important parameter to evaluate its computing efficiency and real-time implementation feasibility. Table 3 gives the execution time of the considered control algorithms for different population size and number of iterations; they were executed on an Intel Core i5 3.10 GHz based machine.

Table 3 indicates that the execution time of the proposed algorithm is slightly higher than that of the conventional algorithm. Although, when the population size or the iteration number increases, the execution times of both algorithms get closer. It was expected to get slightly higher computing time with the proposed controller as it requires more operations than the conventional PSO based controller. However, this small increase in the computation requirement has produced a decent performance increase.

7. Conclusion

A particle swarm optimization algorithm that uses the Gaussian distribution was proposed to solve the constrained fuzzy predictive control problem. A Takagi-Sugeno fuzzy model was used to predict the future values of the system outputs. Fuzzy systems are known for their simplicity and their ability to approximate complex nonlinear processes. However, when using a nonlinear model the optimization problem to be solved is then a nonlinear and a nonconvex one. The solution of this problem using numerical methods is expensive in computational time, especially when considering constraints. Particle swarm optimization algorithms are powerful metaheuristic based algorithms that require much less computational effort than the genetic algorithms, and their implementation is relatively easy. In this work, the PSO algorithm was adapted to find an efficient solution to the fuzzy predictive control optimization problem with a low computational burden. This was done essentially by reducing both the PSO population size and the number of iterations needed to obtain a suitable solution.

The efficiency and the control accuracy of the proposed algorithm were investigated and compared to other control strategies by considering the control of a highly nonlinear MIMO process, namely, an industrial boiler. The obtained simulation results have proved the efficiency and the control accuracy of the proposed algorithm, when considering highly nonlinear systems.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.