Abstract

The structure of the optimization procedure may affect the control quality of nonlinear model predictive control (MPC). In this paper, a data-driven optimization framework for nonlinear MPC is proposed, where the linguistic model is employed as the prediction model. The linguistic model consists of a series of fuzzy rules, whose antecedents are the membership functions of the input variables and the consequents are the predicted output represented by linear combinations of the input variables. The linear properties of the consequents lead to a quadratic optimization framework without online linearisation, which has analytical solution in the calculation of control sequence. Both the parameters in the antecedents and the consequents are calculated by a hybrid-learning algorithm based on plant data, and the data-driven determination of the parameters leads to an optimization framework with optimized controller parameters, which could provide higher control accuracy. Experiments are conducted in the process control of biochemical continuous sterilization, and the performance of the proposed method is compared with those of the methods of MPC based on linear model, the nonlinear MPC with neural network approximator, and MPC nonlinear with successive linearisations. The experimental results verify that the proposed framework could achieve higher control accuracy.

1. Introduction

Model predictive control (MPC) has been recognised as an efficient means and applied in many industrial applications successfully [15]. MPC refers to a class of computer algorithms that use a dynamic model to predict future behavior of the process [68]. In the family of MPC, the MPC based on linear model is more applicable as it brings about a quadratic programming optimization problem in online control [9], where analytical solutions exist. Since properties of many technological processes are nonlinear, the linear MPC algorithms are not likely to work properly all the time [10]. In the case of severe nonlinear process, linear MPC algorithms may result in poor control performance and even instability. Thus, nonlinear MPC is considered necessary.

Nonlinear MPC schemes based on the direct use of nonlinear models have been proposed, like the nonlinear quadratic dynamic matrix control [11] and the modified nonlinear internal model control [12] as well as their extensions. Both the two schemes require a fundamental model. The derivation of fundamental models can be very time consuming and even elusive if the process is not well understood, which limits its application in practice. With the plant data, a nonlinear empirical model can be identified with less computational intensity. Some MPC algorithms employ the data-driven method for more effective implementation of control schemes. A nonlinear MPC scheme based on the second-order Volterra series model was proposed, where a successive substitution algorithm is employed [13]. Neural networks provide an alternative nonlinear modeling approach for MPC [14, 15]. Nonlinear MPC algorithms based on neural network [16, 17] imply the minimization of a cost function using computational methods to obtain the optimal control actions [18]. In the control procedure of MPC based on neural network model, gradients of the cost function are approximated numerically and the nonlinear optimization problem is solved online [19, 20]. The gradient-based optimization techniques may terminate in local minima, while global minima substantially increase the computational burden, yet they still give no guarantee that the global optimal solution is found [21].

An efficient optimization framework is the key to successful implementation of nonlinear MPC. Some MPC algorithms with improved optimization structures have been proposed. Model predictive control with neural network approximator [2224] (MPC-NNA) and its extension [25] are proposed to approximate the solution of the optimization procedure in nonlinear MPC. With an approximator trained by offline calculations [26, 27], the whole MPC algorithm in online control is replaced by the neural network approximator [28]. Though this method provides computational convenience in online control, the training process of the neural network approximator still cannot get rid of the nonconvex nonlinear optimization problem. Linearisation technologies could provide quadratic optimization framework in nonlinear MPC, and analytical solution exists in such case. In most practical applications, the accuracy of the linearisation method is sufficient compared with full nonlinear optimization in model predictive control [29, 30]. Nonlinear MPC based on multiple piecewise linear models [31] is proposed to calculate the manipulated variable based on a series of local linear MPC controllers, where quadratic optimization problem exists and analytical solution could be obtained. In this approach, the recurrent neurofuzzy [32] model is employed to represent the process, which is partitioned into several fuzzy operating regions. Within each region, a local linear model is used to represent the process. Nevertheless, the coefficients of the membership function in the local linear models are determined subjectively, which may result in undesirable control accuracy. MPC nonlinear with successive linearisation (MPC-NSL) has been described [33, 34], where online linearisation is performed at each sampling instant. With the linearisation procedure, a linear approximation model is obtained and a quadratic programming optimization can be derived. Some extensions have been reported like the MPC with nonlinear prediction and linearisation [3537], which considers the free response of the nonlinear model. Though simple in implementation, the online linearisation approach may be susceptible to system disturbances and lower the control accuracy. A linguistic modeling method [38, 39] is reported where a series of linear models are used to represent the nonlinear model. A quadratic optimization problem without online linearisation could be obtained in the control procedure of MPC for the sake of the linear property of the consequents of the rules in the linguistic model [40]. The coefficients of the linguistic model are identified based on the plant data without subjective factors, resulting in more effective optimization procedure in MPC.

In this paper, a data-driven optimization framework for nonlinear MPC is proposed, which employs the linguistic model as the prediction model. The linguistic model consists of a series of fuzzy rules, whose antecedents and consequents are the membership functions of the input variables and the predicted output calculated based on linear combinations of the input variables, respectively. Because of the linear properties of the consequent, a quadratic optimization framework can be derived where analytical solution exists. With the resulting quadratic optimization, the nonconvex nonlinear optimization or the susceptible-to-disturbance online linearisation procedure is avoided in nonlinear MPC. Based on the plant data, the antecedent parameters are initialized by the Gaussian kernel fuzzy clustering algorithm, and a hybrid-learning algorithm is employed to tune the coefficients of both the antecedents and the consequents of the model. The data-driven determination of the antecedent and consequent in the linguistic model provides optimized parameters free of subjective factors, which could bring better control accuracy. The process control of continuous sterilization is employed in the experiments to evaluate the effectiveness of the proposed framework, and the performance of the proposed framework is compared with those of the MPC based on linear model, MPC-NNA, and the MPC-NSL.

The article is organized as follows: the MPC problem formulation is briefly shown in Section 2; the proposed optimization framework is explained in detail in Section 3; Section 4 shows the experiments results of the process control of biochemical continuous sterilization; conclusions are given in Section 5.

2. MPC Problem Formulation

MPC algorithms aim to achieve accurate and fast control. The most important task is to minimize the difference between the controlled output variable and its desired reference trajectory . Also, the changes of the value of the manipulated variable are expected not to be very big [24]. A set of control increments is calculated at each sampling instant by the MPC algorithms aswhere is the control horizon, and the increment in the equation is defined asTo minimize the difference between the predicted output and the reference trajectory over the prediction horizon and to penalize excessive control increments, the following quadratic cost function is usually used in MPC algorithms:where is the weighting coefficient. The control increments are calculated by minimizing the cost function online. Only the first value of the obtained control increments is applied to the control process, and the whole procedure is repeated at the next sampling instant.

An explicit model is used in MPC algorithms to predict the value of future outputs of the process, based on which the MPC algorithms are derived. The selection of a suitable model is a critical task in constructing an effective MPC algorithm, as different models lead to different MPC algorithms and different optimization framework in minimizing the cost function illustrated in the Introduction. In this paper, the linguistic model is employed to improve control performance in MPC.

3. The Proposed Framework

Figure 1 shows the block diagram of the proposed framework. The linguistic model is employed as the prediction model to make predictions on system output. The antecedent of the linear fuzzy rules in the model is the membership functions of the input variables, and the consequent is the predicted output represented by system input variables. and mean the forced response parameters and the free response parameters corresponding to the th rule, respectively. Both of and are calculated by the consequent. The final value of the forced response and the final value of the free response are calculated by the antecedent considering all the rules. Given the reference trajectory of the controlled variable, a quadratic optimization problem could be derived where the manipulated values within the control horizon can be calculated. Only the first value of the manipulated values is employed by the plant, and the whole optimization procedure is repeated in the following control process.

3.1. Linguistic Modeling Based on Plant Data

In the proposed framework, predictions on the system dynamic are made based on the linguistic model. The parameters of the linguistic model are identified based on the plant data. The linguistic model consists of a series of Tagaki-Sugeno- (TS-) type fuzzy rules, where both the antecedent parameters and the consequent parameters of the fuzzy rules are calculated in an optimized way.

3.1.1. Initialization of the Fuzzy Rules

Given that there exist as the input variables and as the output variable, the centers of the clusters of the process input-output dataset can be obtained by the Gaussian kernel fuzzy clustering algorithm. The centers of the clusters are used to generate the initial membership functions and a set of rules, which are used to calculate the weighted parameters of the linear models. Gaussian kernel fuzzy clustering algorithm is based on FCM clustering algorithm, and it replaces the Euclidean distance with a Gaussian kernel-induced distance [41, 42]. Assuming that there are clusters obtained, then the number of linguistic terms and the number of the total TS-type rules are both . The Gaussian function is employed as the membership function and the th rule’s firing strength is calculated bywhere is the th dimension value of the th cluster’s center and is the width of the membership function, which is usually set as . With the initial parameters of the antecedent in the fuzzy obtained rules, the initial parameters of the consequent in linear models are estimated aswhere is the th input variable’s coefficient corresponding to the th rule.

With both the initial antecedent and the consequent parameters of the fuzzy rules obtained, the predicted system output could be calculated by a set of -dimensional inputs:where is the predicted output variable under the th fuzzy rule and .

3.1.2. Optimization of the Parameters in the Fuzzy Rules

For better prediction of the system output, this paper employs an iterative hybrid-learning algorithm to adjust the initial parameters of the fuzzy rules.

Define the matrices and aswhere and represents a positive infinite value, which is often assigned as 1e6. For the th entry of the training data, , where and is the total number of the training data. Assuming that where ,   is the degree of membership of the th rule corresponding to the th entry of the training data, and could be approximated asThe initial value of is defined in (7). Let the initial be a zero matrix, and the new values of can be obtained in the iterative calculation. The iteration will not stop until the RMSE is no larger than , which is the user-defined threshold. The update of the antecedent parameters of the fuzzy rules, and , in the Gaussian membership functions is shown as follows. For the training data ,  , can be calculated aswhere is the predicted value of the linguistic model corresponding to the input and means the predicted output under the th fuzzy rule. Assuming that and are both matrices, the th column elements of the th row of and in the th iterative calculation arewhere the initial and are zero matrices. The values of and in the th iterative calculation can be obtained by where is the training step.

The iterative calculation goes on until the value of RMSE is less than the defined threshold or the number of iterations reaches the defined value. When the iteration stops, all the optimized parameters are obtained and the linguistic model is established. As a result, the system dynamic is presented by the nonlinear linguistic model consisting of a series of weighted linear models. The linguistic model will be employed in nonlinear MPC for a quadratic optimization framework, which will be shown in detail in the next section.

3.2. The Quadratic Programming Optimization Framework Based on Linguistic Model for Nonlinear Model Predictive Control

Assuming that is the system output and is the manipulated input variable at the sampling instant , the system dynamic can be represented by the linguistic model as follows:whereand the integrated Controller Autoregressive Moving-Average (CARIMA) model [43] is used to describe the consequent of the linguistic model as follows:where means the center of the cluster of under the th fuzzy rule, means the center of the cluster of under the th rule, means the membership function width of under the th rule, means the membership function width of under the th rule, and means the differencing operator, while means the backward shift operator. All the centers of the cluster, the membership functions width, and the linear model parameters ,   and ,   are determined in the linguistic modeling process. Equation (15) can be rewritten aswithConsider the Diophantine equation: The degree of the polynomials and is defined as and , respectively, and both the two polynomials could be recursively calculated [43]. Multiply (16) by ; it can be obtained that Given (18) and (19), it can be obtained that which could be rewritten as Because the degree of is , the noise terms are all in the future in (20). Thus, the best prediction of is calculated bywhere . For the degree of is , it can be gained that the degree of is . So it could be obtained thatFor the th rule of the linguistic model, the ahead optimal predictions of the system output can be calculated aswhich can be rewritten aswhereThe last two terms in (26) depend only on the variables of the past instants, assuming thatand (25) could be rewritten asConsidering all rules of the linguistic model, the final optimal predictions ahead could be calculated as follows:which could be represented bywhereBased on the predictions, the optimal control sequence could be calculated by minimizing a cost function. Considering the constraint on the control effort, the cost function could be presented aswhich could be rewritten aswhereand ,   means the reference trajectory of the controlled output variable at the instant , and   means the penalty coefficient on the control effort. Assuming that no more constraint is considered, the minimum of the cost function is calculated by making the gradient of equal 0, resulting inOnly the first value in is passed to the control process. In the following sampling instants, the procedure will be repeated.

Now the data-driven optimization framework for nonlinear MPC has been described. Experiments are conducted in the next section to verify the effectiveness of the proposed framework.

4. Experiment Implementation

The process control of continuous sterilization is employed in the experiments, and the performance of the proposed framework is compared with those of the MPC based on linear model (MPC-L), the MPC based on neural network approximator (MPC-NNA), and the MPC nonlinear with successive linearisation (MPC-NSL). The continuous sterilization system is described briefly, and the modeling and the controlling on the continuous sterilization system are conducted based on plant data.

4.1. The Continuous Sterilization Process

Continuous sterilization is conducted on the medium before fermentation in biochemical engineering, and the nonsterilized medium is heated to the desirable temperature by steam in the sterilization process, so the undesired microorganisms are removed in the medium. After the continuous sterilization, necessary pure culture could be provided for the objective microorganism. Figure 2 illustrates the diagrammatic sketch of the continuous sterilization system.

In the continuous sterilization system, the quantity of steam used to heat the unsterilized medium is changed by the opening degree of the valve on the steam tube (), while is the manipulated variable. The controlled output variable is the temperature of the heated medium at the outlet of the steam injector (). There exist measurable disturbances as the flow rate of medium (), the temperature of unsterilized medium (), and the temperature of steam (). The control procedure aims to provide suitable heating on the medium, so that the temperature of the heated medium can be kept around the set value.

4.2. Experiment Settings

To evaluate the effectiveness of the proposed framework in nonlinear MPC, the plant data in a real workshop of continuous sterilization are collected and experiments are conducted based on the obtained data. The plant data includes the input variable , which adjusts the quantity of steam for the sterilization, while ,  , and are the measurable system disturbances, and is the output variable. The value ranges of ,  ,  ,  , and are 0–100%, 0–70°C, 0–25 ton/h, 150–210°C, and 90–140°C, respectively.

Modeling and controlling are conducted based on the plant data, and MPC based on different models are employed, including the linear model, the neural network, the adaptive neurofuzzy inference system (ANFIS) [4448] with online linearisation (ANFIS-OL), and the linguistic model. With those models, four MPC algorithms are derived: MPC-L, MPC-NNA, MPC-NSL, and the proposed optimization framework for nonlinear MPC based on linguistic model, respectively. The proposed method is expressed as MPC-LOF for short.

4.3. Experiments on Modeling

In the modeling process, 788 samples are treated as training data, and 394 samples are treated as test data. The performances of the linear model, the neural network, the ANFIS with online linearisation, and the linguistic model are compared. For there are different parameters contained in different models, the parameters are selected by scanning for the best result based on the training data. All the involved parameters in the modeling are listed in Table 1.

In Table 1, the receding horizon is the sampling length of the variables employed in modeling of the prediction model. For the linguistic model in the proposed framework, the radius value affects the result of the Gaussian kernel clustering algorithm and the number of rules obtained. For the MPC-NNA, the three-layer back-propagation neural network is employed, and means the number of nodes in the hidden layers. For the MPC-NSL, the ANFIS model is adopted. For the ANFIS, the subtractive clustering algorithm constructs the initial fuzzy model, and the radius would affect the number of clusters obtained. In the following experiments, the parameters involved in the linguistic model are discussed, and the performances of different modeling methods are compared.

The first experiment shows the effect of and on the modeling of the linguistic model. With the training data, experiment is conducted and the modeling results under different couples of and are shown in Figure 3(a). From Figure 3(a), it can be seen that tends to bring about lower mean square error (MSE) compared with the other values, and the best result is obtained when and .

The second experiment is conducted with fixed to observe in detail the effect of on the modeling result of the linguistic model. The result is shown is in Figure 3(b), where in the middle of its range tends to bring about higher accuracy.

To make comparison between different model methods, the parameters of the linear model, the ANFIS with online linearisation, and the neural network are selected by scanning for the best results based on the training data. The selected parameters are shown in Table 2.

The performances of different methods with the selected parameters are shown in Figures 3(c) and 3(d). From Figure 3(c), it can be seen that the neural network achieves the best performance than the linear model, the ANFIS with online linearisation (ANFIS-OL), and the linguistic model in the training process. The ANFIS-OL shows the worst accuracy, possibly because of low noise rejection. In Figure 3(d), the linguistic model provides the best modeling accuracy in the test data, while the neural network shows slightly lower accuracy than the linguistic model and the linear model, which shows lower generalization than the latter two methods. Yet, the ANFIS-OL method still shows the worst performance. Table 3 shows the detailed comparison between different modeling methods.

4.4. Experiments on Controlling

To evaluate the effectiveness of the proposed control method, the control methods of MPC-L, MPC-NNA, MPC-NSL, and MPC-LOF are conducted to make comparison based on the plant data, which contain 1187 samples as training data and anther 1097 samples as test data. The process model used in those MPC methods is employed as the same neural network model generated by the plant data with . In the experiments, the performance indicator is the control accuracy, which represents the approximation of the controlled variable to the expected reference trajectory. The control accuracy is also the most important indicator in a practical continuous sterilization. The indicator of the control accuracy is calculated aswhere means the number of data samples, while means the reference trajectory at the time instant . is set to be 123°C in the control process. Different MPC methods are conducted, with the involved parameters discussed. All the involved parameters in the controlling experiments are listed in Table 4, where is the penalty coefficients on the control effort and is the control horizon.

In the following experiments, the parameters involved in the MPC-LOF are discussed, and the performances of MPC-L, MPC-NNA, MPC-NSL, and the MPC-LOF are compared.

The first experiment investigates the effects of parameters in MPC-LOF on the controlling performance, and the best combination of parameters in MPC-LOF is selected by scanning for the best result. With the training data, the optimal parameters combination is selected as ,  ,  , and  . The parameter selection in MPC-LOF is shown in Figures 47 for illustration. The effect of and on the performance of MPC-LOF is shown for illustration in Figure 4, where the indicator of is employed to show the control performance in detail. The th is calculated as . It can be seen from Figure 4 that, when and , desirable result could be found when , and the best result is obtained when and . The final corresponding to different combinations of and with fixed and is detailed in Table 5.

When there is and , the best performance is found when and , which performs better than the other couples of parameters as shown in Figures 5-6 for illustration. The details of the final with different couples of and with fixed and are shown in Table 6.

Figure 7 shows the effect of and on the MPC-LOF, and the final under different couples of and is shown for comparison. When and , the best result is found when and .

The second experiment is conducted to show the performances comparison between the MPC-L, MPC-NNA, MPC-NSL, and the proposed MPC-LOF. For there are different parameters contained in different MPC methods, the parameters are selected by scanning for the best result based on the training data, whose selection results are shown in Table 7.

The plot of the manipulated variable () and controlled variable () corresponding to the controller parameters in Table 7 are shown in Figure 8. Given the reference trajectory of 123°C, the controlled variable can be kept within the interval under the MPC-NNA method, and there exists deviation from the reference trajectory in the controlled variable; for example, is kept around 122°C from the 90th to the 140th iteration and rises to about 123.5°C in the following 200 iterations. There are no significant fluctuations in the trajectory of the controlled variable in MPC-NNA, but the controlled variable could not be held around the reference trajectory stably. As for the MPC-NSL method, the controlled variable shows better approximation to the reference compared with MPC-NNA, and is kept within generally. Yet there exists fluctuation during the control process; for example, the controlled variable fluctuation appears from the 700th to the 860th iteration, whose corresponding manipulated variable is also in severe fluctuation as shown in Figure 8. The fluctuations show low resistance of the online linearisation approach in MPC-NSL to the disturbances. Besides, there are deviations in the control process of MPC-NSL; for example, the controlled variable rises from 120.5°C to 127°C at the 20th iteration and rises from 123°C to 130°C at the 690th iteration. In MPC-L, the controlled output variable is generally kept within , and both severe deviation and fluctuation exist in the control process. For example, fluctuations appear from the 200th to the 320th iteration, and deviations exist at the 825th iteration with a decrease from 130°C to 117°C and the increase from 123°C to 128°C at the 690th iteration. Though the modeling accuracy of linear model is not the worst in the experiments on modeling, the bad control performance compared with the other methods shows the limit of the pure linear optimization framework in nonlinear system. As for the performance of the proposed MPC-LOF, is kept within . There exist fluctuations in the controlled variable, yet they are much less than those in MPC-NSL and MPC-L, and the value of the controlled variable is kept closely around the reference compared with MPC-NNA. The value of indicator of the MPC-LOF is 0.3829 and is less than that of the MPC-NNA (0.6452), MPC-NSL (1.1689), and MPC-L (2.2194), indicating that the proposed method could provide higher control accuracy than MPC-NNA, MPC-NSL, and MPC-L.

5. Conclusions

In this paper, the data-driven optimization framework for nonlinear MPC is proposed, which employs the linguistic model as the prediction model. The proposed framework has some advantages as follows. First, the proposed framework solves a quadratic optimization problem in online control without the calculation of piecewise linearisation or online linearisation procedure for local linear models. Second, the controller parameters are tuned based on the plant data, which is free of subjective factors, and the optimal parameters result in effective optimization framework that could bring about high control accuracy. Third, the data-driven determination of controller parameters makes the proposed method applicable in practice and easy to implement. The effectiveness is evaluated in comparison with MPC-L, MPC-NNA, and MPC-NSL in the control of continuous sterilization, and the experimental results show that the proposed framework has higher control accuracy. In the further research, we intend to apply the proposed method into other process control practices like the fermentation process in biochemical industry.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

Acknowledgments

This work is supported by National Natural Science Foundation of China (61375055), Program for New Century Excellent Talents in University (NCET-12-0447), Natural Science Foundation of Shanxi Province of China (2014JQ8365), State Key Laboratory of Electrical Insulation and Power Equipment (EIPE16313), and Fundamental Research Funds for the Central University.