Research Article | Open Access

# Offset-Free Strategy by Double-Layered Linear Model Predictive Control

**Academic Editor:**Xianxia Zhang

#### Abstract

In the real applications, the model predictive control (MPC) technology is separated into two layers, that is, a layer of conventional dynamic controller, based on which is an added layer of steady-state target calculation. In the literature, conditions for offset-free linear model predictive control are given for combined estimator (for both the artificial disturbance and system state), steady-state target calculation, and dynamic controller. Usually, the offset-free property of the double-layered MPC is obtained under the assumption that the system is asymptotically stable. This paper considers the dynamic stability property of the double-layered MPC.

#### 1. Introduction

The technique model predictive control (MPC) differs from other control methods mainly in its implementation of the control actions. Usually, MPC solves a finite-horizon optimal control problem at each control interval, so that the control moves for the current time and a period of future time (say, totally control intervals) are obtained. However, only the current control move is applied to the plant. At the next control interval, the same kind of optimization is repeated with the new measurements [1]. The MPC procedures applied in the industrial processes lack theoretical guarantee of stability. Usually, industrial MPC adopts a finite-horizon optimization, without a special weighting on the output prediction at the end of the prediction horizon.

Theoretically, the regulation problem for the nominal MPC can have guarantee of stability by imposing special weight and constraint on the terminal state prediction [2]. The authors in [2] give a comprehensive framework. However, [2] does not solve everything for the stability of MPC. In the past 10 years, the studies on the robust MPC for regulation problem go far beyond [2]. We could say that, for the case of regulation problem when the system state is measurable, the research on MPC is becoming mature (see e.g., [3–8]). For the case of regulation problem when the system state is unmeasurable, and there is no model parametric uncertainty, the research on MPC is becoming mature (see e.g. [9–11]). For other cases (output feedback MPC for the systems with parametric uncertainties, tracking MPC, etc.), there are many undergoing researches (see e.g., [12–16]).

A synthesis approach of MPC is that with guaranteed stability. However, the industrial MPC adopts a more complex framework than the existing synthesis approaches of MPC. Its hierarchy is shown in, for example [17]. In other words, the synthesis approaches of MPC have not been sufficiently developed to include the industrial MPC. Today, the separation of the MPC algorithm into steady-state target and dynamic control move calculations is a common part of industrial MPC technology [17]. The use of steady-state target calculation is necessary, since the disturbances entering the systems or new input information from the operator may change the location of the optimal steady-state at any control interval (see e.g., [18]). The goal of the steady-state target calculation is to recalculate the targets from the local optimizer every time the MPC controller executes.

In the linear MPC framework, offset-free control is usually achieved by adding step disturbance to the process model. The most widely used industrial MPC implementations assume a constant output disturbance that can lead to sluggish rejections of disturbances that enter the process elsewhere. In [19, 20], some general disturbance models that accommodate unmeasured disturbances entering through the process input, state, or output, have been proposed. In a more general sense, the disturbance model can incorporate any nonlinearity, uncertainty, and physical disturbance (measured or unmeasured). The disturbance can be estimated by the Kalman filter (or the usual observer). The estimated disturbance is assumed to be step-like, that is unchanging in the future, at each control interval (MPC refreshes its solution at each control interval). The estimated disturbance drives the steady-state target calculation, in order to refresh the new target value for the control move optimization.

This paper visits some preliminary results for the stability of double-layered MPC or output tracking MPC. These results could be useful for incorporating the industrial MPC into the synthesis approaches of MPC. The preliminary results for this paper can be found in [21, 22].

*Notations 1. *For any vector and positive-definite matrix , . is the value of vector at time , predicted at time . is the identity matrix with appropriate dimension. All vector inequalities are interpreted in an element-wise sense. The symbol *⋆* induces a symmetric structure in the matrix inequalities. An optimal solution to the MPC optimization problem is marked with superscript *⋆*. The time-dependence of the MPC decision variables is often omitted for brevity.

#### 2. System Description and Observer Design

Consider the following discrete-time model: where denotes the control input variables, the state variables, the output variables, and the unmeasured signals including all disturbances and plant-model mismatches.

*Assumption 2.1. *The augmented pair
is detectable, and the following condition holds:

The augmented observer is where is the prespecified observer gain. Define the estimation error and ; then one has the following observer error dynamic equation:

*Assumption 2.2. * is an asymptotically vanishing item, and the observer error dynamics is asymptotically stable, that is, .

#### 3. Double-Layered MPC with Off-Set Property

For the system (2.1), its steady-state state and input target vectors, and , can be determined from the solution of the following quadratic programming (QP) problems (steady-state target calculation, steady-state controller): where is the desired steady-state output (e.g., from the local optimizer), is the desired steady-state input, and are the input bounds. Problems (3.1) and (3.2) is solved; when (3.1) and (3.2) is feasible, and (3.3) and (3.4) is not solved; when (3.1) and (3.2) is infeasible, (3.3) and (3.4) is solved.

When this target generation problem is feasible, one has Subtracting (3.5) from (2.1) and utilizing (2.5) yield where the shifted variables , . The following nominal model of the transformed system (3.6) is used for prediction Its infinite horizon predictive control performance cost is defined as where .

Defining a quadratic function , if one can show that then it can be concluded that as . Furthermore, summing (3.9) from to yields the upper bound of as By substituting (3.10) into (3.8), one can get Here gives an upper bound of ; so we can formulate the MPC as an equivalent minimization problem on with respect to the optimal control sequence When lies in the terminal region, , . From the definition of , at time instant , one has with the shifted control sequence We can explicitly derive the multi-step-ahead state and output prediction: where

Lemma 3.1. *For a quadratic function , , there exist finite Lipschitz constants such that
**
for all , , where , are bounded regions. Similarly, for a quadratic function , , there exists a finite Lipschitz constant such that
**
for all . *

Clearly, , , depend on , . However, it is unnecessary to specify , in the following. Moreover, depends on , which is time varying; this paper assumes taking for all possible .

Lemma 3.2. *Consider the prediction model (3.7). Then, with the shifted control sequence ,
*

*Proof . *It is easy to show that
Then,
By induction, one can easily show the claimed result, and thus the proof is completed.

Theorem 3.3. *For the system (2.1) subject to the input constraints
**
under Assumptions 2.1-2.2, the closed-loop output feedback model predictive control system, with objective function , augmented observer (2.4), and target generation procedure (3.1)–(3.4), achieves the offset-free reference tracking performance if the following three conditions are satisfied. *(a)* There exist feasible solutions to the target generation problem (3.1)–(3.4), at each time .*(b)* There exist feasible solutions, including a control sequence , a positive-definite matrix , and any matrix , at each time , to the dynamic optimization problem (dynamic control move calculation problem)* *subject to the linear matrix inequalities
* *where is the th row of the -ordered identity matrix, , , , and . *(c)* By applying , where is obtained by solving (3.25)—(3.30), the closed-loop system is asymptotically stable. *

*Proof. *The matrix inequality (3.28) implies that
By referring to [23], it is easy to prove that (3.9) holds for all . Then, . Let , which is guaranteed by (3.27), where . Meanwhile, it is easy to show that, by applying (3.26), the optimal is exactly the optimal value of

Now we check if each element of the predictive control inputs satisfies the constraints , , . For any within the finite horizon , the input constraints are satisfied since , as shown in (3.30). Otherwise, beyond the finite horizon , belongs to the constraint set , which is guaranteed by (3.27). In this case, by referring to [23], it is easy to show that, (3.27)–(3.29) guarantee that the feedback control law , , satisfies the input constraints.

Since point (c) is assumed, the offset-free property can be referred to as in [19, 20, 22].

#### 4. Improved Procedure for Double-Layered MPC

At each time , we consider the following constraints: where , with being a given design parameter. Equation (4.1) is utilized for (3.1); (4.2) is utilized for (3.3).

Theorem 4.1. *For the system (2.1) subject to the input constraints under Assumptions 2.1-2.2, the closed-loop output feedback model predictive control system, with objective function , augmented observer (2.4), target generation procedure (at , (3.1)–(3.4); at any , (3.1), (3.3), (4.1)–(4.4)), and dynamic optimization problem (3.25)–(3.30), is input-to-state (ISS) stable if the following two conditions are satisfied. *(a)*There exist feasible solutions to the target generation problem, at each control interval. *(b)*There exist feasible solutions, including a control sequence , a positive-definite matrix , and any matrix , at time , to the dynamic optimization problem (3.25)–(3.30). *

*Proof. *By applying the shifted control sequence , at time , one has
By applying Lemmas 3.1-3.2, it is shown that
By further applying
it is shown that
where are appropriate scalars.

On the other hand, at time , since the target generation problem is feasible, it is feasible to choose .

Then,
Hence, can serve as an ISS (for the definition of this term, see [22]) Lyapunov function, and the closed-loop system is input-to-state stable.

If we use the terminal equality constraint, rather than the terminal inequality constraint, then (3.27) should be revised as and (3.28), (3.29) should be removed; moreover, (4.3) should be revised as with the shifted control sequence and (4.4) should be removed.

Theorem 4.2. *For the system (2.1) subject to the input constraints under Assumptions 2.1–2.2, the closed-loop output feedback model predictive control system, with objective function , augmented observer (2.4), target generation procedure (at , (3.1)–(3.4); at any , (3.1), (3.3), (4.1), (4.2), (4.11)), and dynamic optimization problem (3.25), (3.26), (4.10), (3.30), is input-to-state stable if the following two conditions are satisfied. *(a)*There exist feasible solutions to the target generation problem, at each time . *(b)*There exist feasible solutions , at time , to the dynamic optimization problem (3.25), (3.26), (4.10), (3.30). *

*Proof. * By applying the shifted control sequence , at time , one has
By analogy to Theorem 4.1, it is shown that can serve as an ISS Lyapunov function, and the closed-loop system is input-to-state stable.

Assume that is nonsingular. Then, applying (4.11) yields Further applying (4.3) yields and Hence, by applying (4.10)-(4.11), an analytical solution of the steady-state controller may be obtained.

#### 5. Numerical Example

Let us consider the heavy fractionator, which is a Shell standard problem, with the following model: where is the transfer function matrix between inputs and outputs, and between disturbances and outputs. The three inputs of the process are the product draw rates from the top and side of the column (, ), and the reflux heat duty for the bottom of the column (). The three outputs of the process represent the draw composition () from the top of the column, the draw composition (), and the reflux temperature at the bottom of the column (). The two disturbances are the reflux heat duties for the intermediate section and top of the column (, ).

The inputs are constrained between and , while the outputs between and . The weighting matrices are identity matrices. . The sampling interval is seconds. With the algorithm as in Theorem 3.3 applied, the simulation results are shown in Figure 1. The steady-state calculation begins running at instant , when the optimizer finds the optimum target . The objective value is , indicating that unit benefits are obtained. During time , the disturbances and are added. The simulation verifies our theoretical results.

#### 6. Conclusions

We have given some preliminary results for the stability of double-layered MPC. The results cannot be seen as the strict synthesis approaches; rather, they are endeavors towards this kind of approaches. Instead of asymptotic stability, we obtain the input-to-state stability, as in [22]. The results are inspired by [22]; but they are much different, as shown in Remarks 1–11 of [21].

We believe that several works need to be continued. Indeed, assuming feasibility of the target generation problem at each control interval is very restrictive, and overlooking the uncertainties in the prediction model brings difficulties for proving both the asymptotic stability and offset-free property. It may be necessary to develop a whole procedure, where the target generation problem is guaranteed (rather than assumed) to be feasible at each control interval and an augmented system is used for the stability analysis.

#### Acknowledgments

This work is supported by the Innovation Key Program (Grant KGCX2-EW-104) of the Chinese Academy of Sciences, by the Nature Science Foundation of China (NSFC Grant no. 61074059), by the Foundation from the State Key Laboratory of Industrial Control Technology (Grant no. ICT1116), by the Public Welfare Project from the Science Technology Department of Zhejiang Province (Grant no. 2011c31040) and by the Nature Science Foundation of Zhejiang Province (Grant no. Y12F030052).

#### References

- S. J. Qin and T. A. Badgwell, “A survey of industrial model predictive control technology,”
*Control Engineering Practice*, vol. 11, no. 7, pp. 733–764, 2003. View at: Publisher Site | Google Scholar - D. Q. Mayne, J. B. Rawlings, C. V. Rao, and P. O. M. Scokaert, “Constrained model predictive control: stability and optimality,”
*Automatica*, vol. 36, no. 6, pp. 789–814, 2000. View at: Publisher Site | Google Scholar | Zentralblatt MATH - A. Bemporad, F. Borrelli, and M. Morari, “Min-max control of constrained uncertain discrete-time linear systems,”
*Institute of Electrical and Electronics Engineers*, vol. 48, no. 9, pp. 1600–1606, 2003. View at: Publisher Site | Google Scholar - L. Chisci, J. A. Rossiter, and G. Zappa, “Systems with persistent disturbances: predictive control with restricted constraints,”
*Automatica*, vol. 37, no. 7, pp. 1019–1028, 2001. View at: Publisher Site | Google Scholar | Zentralblatt MATH - B. Ding, “Properties of parameter-dependent open-loop MPC for uncertain systems with polytopic description,”
*Asian Journal of Control*, vol. 12, no. 1, pp. 58–70, 2010. View at: Publisher Site | Google Scholar - B. Kouvaritakis, J. A. Rossiter, and J. Schuurmans, “Efficient robust predictive control,”
*Institute of Electrical and Electronics Engineers*, vol. 45, no. 8, pp. 1545–1549, 2000. View at: Publisher Site | Google Scholar | Zentralblatt MATH - D. Li and Y. Xi, “The feedback robust MPC for LPV systems with bounded rates of parameter changes,”
*Institute of Electrical and Electronics Engineers*, vol. 55, no. 2, pp. 503–507, 2010. View at: Publisher Site | Google Scholar - H. Huang, D. Li, Z. Lin, and Y. Xi, “An improved robust model predictive control design in the presence of actuator saturation,”
*Automatica*, vol. 47, no. 4, pp. 861–864, 2011. View at: Publisher Site | Google Scholar - Y. I. Lee and B. Kouvaritakis, “Receding horizon output feedback control for linear systems with input saturation,”
*IEE Proceedings of Control Theory and Application*, vol. 148, pp. 109–115, 2001. View at: Google Scholar - C. Løvaas, M. M. Seron, and G. C. Goodwin, “Robust output-feedback model predictive control for systems with unstructured uncertainty,”
*Automatica*, vol. 44, no. 8, pp. 1933–1943, 2008. View at: Publisher Site | Google Scholar - D. Q. Mayne, S. V. Raković, R. Findeisen, and F. Allgöwer, “Robust output feedback model predictive control of constrained linear systems: time varying case,”
*Automatica*, vol. 45, pp. 2082–2087, 2009. View at: Google Scholar - B. Ding, “Constrained robust model predictive control via parameter-dependent dynamic output feedback,”
*Automatica*, vol. 46, no. 9, pp. 1517–1523, 2010. View at: Publisher Site | Google Scholar - B. Ding, Y. Xi, M. T. Cychowski, and T. O'Mahony, “A synthesis approach for output feedback robust constrained model predictive control,”
*Automatica*, vol. 44, no. 1, pp. 258–264, 2008. View at: Publisher Site | Google Scholar | Zentralblatt MATH - B. Ding, B. Huang, and F. Xu, “Dynamic output feedback robust model predictive control,”
*International Journal of Systems Science*, vol. 42, no. 10, pp. 1669–1682, 2011. View at: Publisher Site | Google Scholar - B. Ding, “Dynamic output feedback predictive control for nonlinear systems represented by a Takagi-Sugeno model,”
*IEEE Transactions on Fuzzy Systems*, vol. 19, no. 5, pp. 831–843, 2011. View at: Publisher Site | Google Scholar - B. C. Ding, “Output feedback robust MPC based-on direct input-output model,” in
*Proceedings of the Chinese Control and Decision Conference*, Taiyuan, China, 2012. View at: Google Scholar - D. E. Kassmann, T. A. Badgwell, and R. B. Hawkins, “Robust steady-state target calculation for model predictive control,”
*AIChE Journal*, vol. 46, no. 5, pp. 1007–1024, 2000. View at: Google Scholar - T. Zou, H. Q. Li, X. X. Zhang, Y. Gu, and H. Y. Su, “Feasibility and soft constraint of steady state target calculation layer in LP-MPC and QP-MPC cascade control systems,” in
*Proceedings of the 4th International Symposium on Advanced Control of Industrial Processes (ADCONIP '11)*, pp. 524–529, Hangzhou, China, 2011. View at: Google Scholar - K. R. Muske and T. A. Badgwell, “Disturbance modeling for offset-free linear model predictive control,”
*Journal of Process Control*, vol. 12, no. 5, pp. 617–632, 2002. View at: Publisher Site | Google Scholar - G. Pannocchia and J. B. Rawlings, “Disturbance models for offset-free model-predictive control,”
*AIChE Journal*, vol. 49, no. 2, pp. 426–437, 2003. View at: Publisher Site | Google Scholar - B. C. Ding, T. Zou, and H. G. Pan, “A discussion on stability of offset-free linear model predictivecontrol,” in
*Proceedings of the Chinese Control and Decision Conference*, Taiyuan, China, 2012. View at: Google Scholar - T. Zhang, G. Feng, and X. J. Zeng, “Output tracking of constrained nonlinear processes with offset-free input-to-state stable fuzzy predictive control,”
*Automatica*, vol. 45, no. 4, pp. 900–909, 2009. View at: Publisher Site | Google Scholar - M. V. Kothare, V. Balakrishnan, and M. Morari, “Robust constrained model predictive control using linear matrix inequalities,”
*Automatica*, vol. 32, no. 10, pp. 1361–1379, 1996. View at: Publisher Site | Google Scholar | Zentralblatt MATH

#### Copyright

Copyright © 2012 Tao Zou. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.