- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Abstract and Applied Analysis
Volume 2014 (2014), Article ID 597805, 12 pages
Feedforward and Feedback Control Performance Assessment for Nonlinear Systems
Key Laboratory of Advanced Process Control for Light Industry (Ministry of Education), Institute of Automation, Jiangnan University, Wux 214122, China
Received 23 January 2014; Revised 29 March 2014; Accepted 30 March 2014; Published 24 April 2014
Academic Editor: Shuping He
Copyright © 2014 Zhiguo Wang and Jun Chen. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
A performance assessment method for nonlinear feedforward and feedback control systems is proposed in this paper. First, the existence of minimum variance performance bound for two nonlinear systems with different structures is analyzed, and the closed-loop model of nonlinear system is obtained with the help of iterative orthogonal least squares identification method. Then, the technology of variance analysis is introduced to establish the variance contributions due to both disturbances and controller. A nonlinear performance index for the feedforward and feedback control systems is estimated using an ANOVA-like variance decomposition method. Finally, a meaningful example is simulated to show the effectiveness of our method.
The technology of control performance assessment (CPA) has attracted much attention in recent years, due to the extensive application of automatic control systems in industrial area. CPA is a management tool to maintain efficient operation performance of automation systems. The main aim is to evaluate the performance of control loops in control systems, diagnose the reason of poor performance, and present effective proposals for improvement once the control performance of a running controller cannot meet the desired requirements.
The study of CPA began to blossom some 20 years ago with the pioneering work by Harris ; he proposed a linear performance index based on minimum variance benchmark. Desborough and Harris  proposed a normalized performance index for assessment of linear SISO controller performance, which can be estimated by linear regression methods. Stanfelj et al.  presented a method that utilized autocorrelation and cross correlation functions for monitoring and diagnosing the cause of poor performance of feedforward and feedback control systems. Desborough and Harris  developed a performance assessment algorithm based on variance table to investigate the variance contributions due to disturbances and controllers for a linear feedforward and feedback system. Harris et al.  developed a method for assessing the performance of linear MIMO control systems, and this method requires an estimate of the process interactor matrix that characterizes the dead-time structure. Almost at the same time, Huang et al.  developed a new approach based on filtering and correlation (FCOR) analysis of the process output and filtered data, which can be used to estimate the controller performance of a general class of linear MIMO processes. Subsequently, Huang et al.  developed a method for the performance assessment of linear multivariate feedback plus feedforward control systems using minimum variance control as the benchmark. CPA theoretical issues have been reported by several literatures, such as the references published by Qin , Huang and Shah , and Jelali .
Although the field of CPA has received much attention in theory and engineering in recent years [11–14], the most previous studies are focused on linear systems. In real applications, the industrial processes are naturally nonlinear systems. The estimation of the minimum variance performance lower bound (MVPLB) and the performance index using the linear control performance assessment techniques may be distorted by these nonlinearities. Due to the internal complexity and lack of effective mathematical tools, far less has been written on the CPA methods for nonlinear systems. For a special class of nonlinear SISO processes that can be described by the superposition of a nonlinear dynamic model and additive linear disturbance, Harris and Yu  presented a method to estimate the MVPLB using closed-loop data. Continuing this idea, estimates of the MVPLB for the moderate valve stiction cases are proposed by Yu et al. . Yu et al.  proposed a new CPA performance index for general nonlinear SISO models based on an ANOVA-like variance decomposition method. This new performance index is not based on the MVPLB, but it can be used to estimate the MVPLB for some nonlinear systems detailed are discussed in . Considering the process nonlinearity and valve stiction nonlinearity in control system, Zhang  proposed some CPA methods for nonlinear systems based on minimum variance benchmark. Yu et al.  extended CPA to nonlinear MIMO systems. However, in order to make the problem tractable, they restrict the system structure to be a model with additive linear disturbances and where the nonlinearity is in the form of valve stiction.
In spite of the fact that multivariate control schemes are justified from an economic and quality improvement standpoint, the univariate controllers are the mostly used controllers in practical applications. The performance of these SISO control schemes can be enhanced by including feedforward elements. In this paper, we study the performance assessment for nonlinear feedforward and feedback control systems. The objective of our work is to estimate the MVPLB for this nonlinear system and analyze the contribution of each controller for the overall performance bound. This study has an important guiding significance for the adjustment and design of the actual control system. Two common situations are often encountered in pragmatic feedforward and feedback control systems. The first case is, although a feedforward variable can be measured, it is not used in the control systems; in such situation, the result of CPA for nonlinear feedforward and feedback control systems can provide an estimation of the variance reductions if feedforward controller is considered. In the other case, a feedforward variable is both measured and used in a feedforward and feedback control scheme, and then, the performance of the individual controllers can be assessed by the result of this paper, such that we can determine which controller should be principally adjusted to improve the performance of feedforward and feedback control systems.
Based on some methods for the performance assessment of linear feedforward and feedback control systems, this paper is an extension to nonlinear systems. The outline of this paper is organized as follows. As a prerequisite, the performance assessment of linear feedforward and feedback systems is discussed in Section 2. In Section 3, the existence of MVPLB for nonlinear feedforward and feedback systems is analyzed. In Section 4, a description of the ANOVA-like variance decomposition method is given and a new performance index of nonlinear control systems is proposed. Finally, a simulation is made to illustrate the proposed methodology in Section 5, and this is followed by a conclusion in Section 6.
2. Analysis of Variance in Linear Feedforward and Feedback Control System
A structural schematic of general feedforward and feedback control system is given in Figure 1, where is output variable of the process, is manipulated variable which is adjusted by summing the outputs from the feedback controller and feedforward controller . is feedback controller transfer function, and is feedforward controller transfer function. represents the process model that may be linear or nonlinear. is the number of whole periods of process delay. represents the effect that the measured disturbance has on the process output, and is the number of periods of delay it takes for a change in to begin to affect the output. In linear systems, is often expressed by transfer function as . and represent the unmeasured and measured disturbances, respectively. In this paper, work is based on the assumption that there is no cross correlation among the unmeasured and measured disturbances, and this is reasonable for many industrial processes.
In linear systems, the delay-free process model can be represented by the following equation: where and are stable polynomials in the backshift operator . Disturbances and are represented by autoregressive integrated moving average (ARIMA) time series models: is a sequence of independently and identically distributed random variables with mean zero and constant variance . and are monic and stable polynomials. The difference operator is defined as , and is the degree of differencing. The linear feedforward and feedback control system can be modeled as the sum of two disturbances and a linear transfer function: Substituting the feedforward and feedback controller representation into above equation and multiplying both sides by and collecting terms In an analogous manner to the minimum variance feedback controller, the design of minimum variance feedforward and feedback controller can be derived. The research result of Desborough and Harris  reported that the linear closed-loop system can be described in terms of the unmeasured disturbance driving force and the measured feedforward variable. We do the similar work, which yields where is the closed-loop transfer function between and the driving force for the unmeasured disturbance. is the closed-loop transfer function between and measured feedforward variable . Alternatively, the process can be described in terms of the driving forces alone: Each of the closed-loop transfer functions in (6) can be expanded in a convergent power series in : This expansion is obtained by writing each transfer function as a ratio of polynomials and then dividing the numerator into the denominator using polynomial long division. Then the process output can be extended as The term is the contribution of unmeasured disturbance to the process output; it can be written as The first term in above function is recognized as the prediction error, which is independent of the second term. The second term is the contribution to the process output which arises from the nonoptimality of the control associated with the unmeasured disturbance, and it is also a function of the process dynamics, the unmeasured disturbance, and the feedback controller only.
In a similar manner, the contribution of the measured disturbance to the process output can be written as where In (10), the first term is the prediction error for the measured disturbance, and it is independent of the second and third terms. The second term is the contribution to the output which arises from the nonoptimality of the feedforward controller only, and the third term is the contribution which arises from the combined effect of the nonoptimality of the feedforward controller and the feedback controller.
Since it has been assumed that the measured and unmeasured disturbances are not cross correlated, the prediction error and are independent of all the controllers. Then, the process output under minimum variance control is given by the sum of the individual error in forecasting the effect of the disturbances: and the MVPLB can be written as
3. MVPLB of Nonlinear Feedforward and Feedback Control System
Due to the effect of various factors such as complexity of nonlinear behavior and challenges in model determination and parameter estimation, far less has been written to extend the methods for performance assessment to nonlinear systems. In order to simplify the analysis and without loss of generality, the problem of estimation for minimum variance performance bound for nonlinear feedforward and feedback systems is given in two aspects.
First, we only assume that the process model has a nonlinear representation in the structural schematic Figure 1, and this is not very restrictive in many applications. Then, the closed output -steps into the future of the nonlinear system can be expressed as where the notation denotes a nonlinear function of process model, and the superscript is used to represent the vector collecting the immediate historical values; that is, . Decomposing the unmeasured disturbance into a prediction error and a prediction the prediction is the -step ahead minimum mean square error prediction for the value of the unmeasured disturbance steps into the future. The effects of the measured feedforward variables are also decomposed into a prediction error and a prediction The prediction is the step ahead minimum mean square error prediction for the value of the measured disturbance steps into the future. Note that if is greater than or equal to , then . This implies that there is no prediction error since we exactly know the future value of the effect on the process of the measured disturbance.
The minimum variance control law is found by minimizing the mean square error of the output: It follows from this formula that the minimum variance controller (MVC) set the manipulated variables to exactly cancel the predictions; that is, Then the process output under this control scheme can be denoted by As we have assumed that there is no cross correlation among the unmeasured and measured disturbances, the prediction errors and are independent and unrelated with controller parameters. Then, the MVPLB of closed-loop output is From above derivation, we can conclude that the MVPLB of nonlinear feedforward and feedback system is identical to that of linear system. The difference is that it is possible to adopt different controllers for obtaining same minimum variance.
Second, a more general form of nonlinear feedforward and feedback control systems is considered: where the terms and are called output disturbances which represent the effect that the unmeasured and measured disturbances have on the process output, respectively. They are also nonlinear and can be represented by nonlinear ARMA model as Further, we assume that the output disturbance admits a representation of the form
where is a white noise sequence with mean and variance , and is monic and stable polynomial, and we also assume that the disturbance model is invertible. Multiply both sides by and substitute for all values of , , in (21): where is the impulse coefficient of , or 1. is a remainder term that is obtained by successive substitutions. The unmeasured output disturbance is represented as According to the definition of conditional expectation, the -step ahead prediction is Now in the aforementioned equation, we know where is the joint distribution of . Then the prediction error for the unmeasured output disturbance is In a same manner, the prediction error for the measured output disturbance is The process output can be written as If it is possible to find the control action at time such that then the resulting controller is the minimum variance controller. It may not be possible to implement a minimum variance controller due to the various reasons. For instance, it may lead to excessive manipulated variable action and may not be robust to modeling errors. However, the output variance set by minimum variance provides a theoretical lower bound on the system output and can be used as a useful guide for controller assessment.
The process output under minimum variance control is given by the sum of the individual error in predicting the effect of the disturbances: It should be pointed out that the terms and are very complicated functions, and they may not be expanded in convergent time series as that in linear systems. Therefore, it is difficult to estimate the MVPLB from the closed-loop operation data of feedforward and feedback control system by using traditional linear regression method. But we can get a conclusion that the MVPLB does not depend on the manipulated variable and only related with the most recent past unmeasured disturbance driving force and past measured disturbance driving force.
4. ANOVA-Based Performance Assessment of Nonlinear Feedforward and Feedback Control System
Analysis of variance (ANOVA) methods are a class of statistical methods that are useful in process systems engineering. Its primary task is to decompose the variance of a response variable into contributions arising from the inputs and assess the magnitude and significance of each of their contributions. Historically, the ANOVA variance decomposition techniques were used to provide variance analysis for nonlinear systems with the multidisturbance sources .
For the output of a static system such as , the relative importance of the independent inputs can be quantified by the fractional variance, and this can be calculated using an ANOVA-like decomposition formula : where , , and so on. denotes the expectation of conditional on when fixing the value , and stands for variance over all the possible values of . In the same way, if we partition the variable set into two groups: and , then the variance of can be decomposed into .
For the nonlinear feedforward and feedback control systems described by Figure 1, we separate the disturbance entering the system after time 0, say , into two groups: and . The first group includes all the disturbances entering the system after time and the second group includes all the disturbances entering the system up to and including time and including time starting from the initial time . Now, we are interested in determining the sensitivity of output variations of two vector series and . Since the future behavior of is possibly dependent on initial conditions due to the nonlinearity, the initial condition must be considered before using the ANOVA-like decomposition equation. Using the well-known variance decomposition theorem, the variance of can be decomposed into two terms: where denotes all of disturbances entering the system from time 1 to time and denotes initial conditions. The first term in above equation is the fractional contribution to the variance of from the disturbance signal and the interaction between disturbance and the initial condition. The second term is the fractional contribution to the output solely due to the uncertainties in the initial condition. Given the initial condition , conditional variance can be decomposed as where , , and . denotes the main effect of on the . denotes the interaction contributing to the that is not accounted for the main effects of and . Consequently, a suitable performance index can be constructed by referring to Harris index: If the nonlinear model is stationary, then the distribution of can reach an equilibrium. For linear time series, this limiting distribution is independent of initial condition. But for a stationary nonlinear model, the limiting distribution may depend on the initial condition. Therefore, the performance index will depend on the initial condition. If the distribution of does not depend on the initial conditions, the process is termed ergodic. In actual industry, the cases that processes are strongly nonergodic are more pathological than common cases. For an ergodic nonlinear system, in (34) will be zero for , and the variance decomposition can be expressed when as where , , and . The performance index will turn into
Generally, we will approximate the infinite limit in above equation by some suitably large value .
In Section 3, we conclude that the MVPLB of nonlinear feedforward and feedback control systems is existent and only related with the most recent past unmeasured disturbance driving force and past measured disturbance driving force. Moreover, we have , so just is the minimum variance performance index of the nonlinear feedforward and feedback control systems.
For the computation of the performance index, the principal task is to estimate the closed-loop model of nonlinear feedforward and feedback control system. Firstly, the measured feedforward variable transfer function, given in (2), must be estimated. Using the linear regression techniques and past values of . The model of measured disturbance can be estimated by is an estimate of the independent driving force for measured disturbance. If the process is controlled by a linear or nonlinear feedforward and feedback controller such as , then the output of closed-loop system can be written as According to the existing knowledge, any continuous can be arbitrarily well approximated by polynomial models. Therefore, expanding in above equation as a polynomial of degree gives the representation where and , , , and . Moreover, the output of closed-loop system can be written as a linear regression model: where is the data length, the are monomials of to up to degree , corresponding to a constant term, is some modeling error, and the , , are unknown parameters to be estimated. Then above equation can be written in the matrix form where In reality, as parameters , , and are unknown, we must consider the combined problem of structure selection and parameter estimation. To avoid losing significant terms which must be included in the final model, we are forced to consider the full model set at the beginning of the identification and then to select a subset from full model set and find the corresponding parameter. The orthogonal least squares (OLS) method  can be used to determine the order and estimate the parameters of the model. Denote After a series of Householder transformations , have been successively applied to ; it is transformed to where , , and , and is the upper triangular matrix. Further denote Assume that the maximum of , , is achieved at . Then interchange the column of with the column. The procedure is terminated at stage when where is a desired tolerance. Using backward substitution, the subset model parameter estimate is computed from In addition, since the terms of unmeasured disturbance driving force are generally unmeasured, the identification will require an iterative approach. The identification procedures can be clarified as follows.
Step 1. Set the initial sequence by fitting a linear model or setting the to zero, and set iteration number .
Step 2. Identify the nonlinear model and get the prediction errors or residuals , .
Step 4. Replace the initial sequence by the prediction errors or residuals.
Step 5. Set iteration number and return to Step 2.
Step 6. End of program.
Once the parameters of the closed-loop model are estimated, Monte Carlo (MC) method may be used to compute the variance decomposition. Firstly, two random vectors, and , are generated, which are two sets of simulation of multidimensional inputs that have the requisite distribution. denotes memory length of the model. Then, the mean and variance of given the initial condition can be calculated by
The partial variances can be estimated as To calculate the with the different initial conditions, the average of these values can be used as the estimates of , and the performance index of nonlinear feedforward and feedback control system can be obtained.
5. Simulation Study
This section presents a simulation experiment to show the effectiveness of the proposed strategy. The model of nonlinear feedforward and feedback control system that we have chosen is expressed as where is process model represented by a nonlinear polynomial: The measured and unmeasured disturbances are, respectively, given by where and are sequences of independent and identically distributed normal variables with mean zero, and the variances are, respectively, 0.05 and 0.1.
Assume that the process is presently being controlled about a fixed set point by a simple proportional feedforward controller in addition to an integral feedback controller. The manipulated variable is given by Two closed-loop signal curves of different time-delay conditions , and , are shown in Figure 2. Then, the traditional linear regression method is applied to estimate the MVPLB for nonlinear forward feedback control system. The estimated values of model parameters and MVPLB are shown in Table 1, where the model orders are , , and by applying AIC criterion and the values are calculated by 100 times’ statistics. It can be seen that the estimated value of model parameters and MVPLB by traditional linear regression method has larger deviation, which is always larger than the real value. This implies the excessive estimation.
It is necessary to identify the model of closed-loop system to estimate the minimum variance performance index of the nonlinear system. First, we collect the disturbance signals which can be measured and then apply the linear regression method to fit the curve to obtain the parameter of the white noise. Furthermore, we use iterative orthogonal least square method to identify the closed-loop model. The comparison for the output signal of identified model and actual model under two different time delays is shown in Figure 3. We can see the identified model can well approximate to the real nonlinear model.
It is noted that the output variance of nonlinear system is also related to the initial value. Thus, to see whether the resulting controller performance based on variance decomposition method includes the influence of the initial value or not, the output variation of closed-loop system during the period is shown in Figure 4. It can be seen that when , the distribution of the system output tends to be stable; thus we get the conclusion that the output has nothing to do with the initial value.
Selecting an appropriate memory length of 40 and applying 100 times’ Monte Carlo experiments, the box plots of MVPLB estimates with time delay , , and , by applying variance decomposition method proposed by this paper and traditional linear estimation method can be seen in Figure 5. In Figure 5(a), the first column gives theoretical performance index for nonlinear system with time delay , , and the second column and third one, respectively, show the estimates of performance index by traditional linear method and that by the method in this paper. In Figure 5(b), the first column gives theoretical performance index for nonlinear system with time delay , , and the fourth column and seventh column, respectively, show the estimates of performance index by traditional linear method and that by the method in this paper. The second and third column, respectively, show the contributions of performance index of the unmeasured and measured disturbance signal applying traditional linear method. The fifth and sixth column show the contributions of performance index of the unmeasured and measured disturbance signal applying the method proposed by this paper, respectively. From the plot, we can see that the estimates of performance index using our new method are more close to the theoretical value than that using traditional linear method and get the conclusion that it is effective to estimate the MVPLB of nonlinear forward and feedback system by applying the CPA method based on variance decomposition method.
Remarks. (i) The MVPLB of this nonlinear feedback and forward control system can be decomposed into the best possible bounds for each of the controllers. According to the variance contributions of the unmeasured and measured disturbance, we can confirm the degree of controller performance by the feedback controller and the feedforward controller.
(ii) When the feedforward delay exceeds the feedback delay, there is no error in predicting of the future disturbance by using given information at current time. In such case, the overall MVPLB is only the contribution of unmeasured disturbance. This is the reason why only three columns are included in Figure 5.
(iii) This new nonlinear CPA method requires only observable signals and crude estimates of the process delay and another delay that it takes for a change in measured feedforward variable to begin to affect the output.
(iv) The proposed method needs to estimate the closed-loop nonlinear model, and the identification of the closed-loop model will directly affect the estimates of the MVPLB.
The problem of control performance assessment for nonlinear feedforward and feedback system is investigated in this paper. We provide a method based on the variance decomposition to estimate the MVPLB for two classes of nonlinear feedforward and feedback control system. When the time delay of the process and measured disturbance are known, the performance index based on minimum variance benchmark can be estimated by the data from the closed-loop system; the simulation shows the effectiveness of the proposed approach. More specifically, the assumption of one measured disturbance is also suitable for the multimeasured disturbance cases; thus the method in this paper can be extended from SISO to MISO.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
This work was supported by the Priority Academic Program Development of Jiangsu Higher Education Institutions and the 111 Project (B12018) and the Basic Research Program of Jiangsu Province of China (Natural Science Foundation) (BK2012111).
- T. J. Harris, “Assessment of control loop performance,” The Canadian Journal of Chemical Engineering, vol. 67, no. 5, pp. 856–861, 1989.
- L. Desborough and T. Harris, “Performance assessment measures for univariate feedback control,” The Canadian Journal of Chemical Engineering, vol. 70, no. 6, pp. 1186–1197, 1992.
- N. Stanfelj, T. E. Marlin, and J. F. MacGregor, “Monitoring and diagnosing process control performance: the single-loop case,” Industrial and Engineering Chemistry Research, vol. 32, no. 2, pp. 301–314, 1993.
- L. Desborough and T. Harris, “Performance assessment measures for univariate feedforward/feedback control,” The Canadian Journal of Chemical Engineering, vol. 71, no. 4, pp. 605–616, 1993.
- T. J. Harris, F. Boudreau, and J. F. MacGregor, “Performance assessment of multivariable feedback controllers,” Automatica, vol. 32, no. 11, pp. 1505–1518, 1996.
- B. Huang, S. L. Shah, and E. K. Kwok, “Good, bad or optimal? Performance assessment of multivariable processes,” Automatica, vol. 33, no. 6, pp. 1175–1183, 1997.
- B. Huang, S. L. Shah, and R. Miller, “Feedforward plus feedback controller performance assessment of MIMO systems,” IEEE Transactions on Control Systems Technology, vol. 8, no. 3, pp. 580–587, 2000.
- S. J. Qin, “Control performance monitoring—a review and assessment,” Computers and Chemical Engineering, vol. 23, no. 2, pp. 173–186, 1998.
- B. Huang and S. L. Shah, Performance Assessment of Control Loops: Theory and Applications, Springer, London, UK, 1999.
- M. Jelali, “An overview of control performance assessment technology and industrial applications,” Control Engineering Practice, vol. 14, no. 5, pp. 441–466, 2006.
- B. Srinivasan, T. Spinner, and R. Rengaswamy, “Control loop performance assessment using detrended fluctuation analysis (DFA),” Automatica, vol. 48, no. 7, pp. 1359–1363, 2012.
- R. Gonzalez and B. Huang, “Control loop diagnosis with ambiguous historical operating modes: part 1. A proportional parametrization approach Original Research Article,” Journal of Process Control, vol. 23, no. 4, pp. 585–597, 2013.
- R. Gonzalez and B. Huang, “Control loop diagnosis with ambiguous historical operating modes: part 2, information synthesis based on proportional parametrization,” Journal of Process Control, vol. 23, no. 10, pp. 1441–1454, 2013.
- S. Liu, J. F. Fiu, Y. P. Feng, et al., “Performance assessment of decentralized control systems: an iterative approach,” Control Engineering Practice, vol. 22, pp. 252–263, 2014.
- T. J. Harris and W. Yu, “Controller assessment for a class of non-linear systems,” Journal of Process Control, vol. 17, no. 7, pp. 607–619, 2007.
- W. Yu, D. I. Wilson, and B. R. Young, “Nonlinear control performance assessment in the presence of valve stiction,” Journal of Process Control, vol. 20, no. 6, pp. 754–761, 2010.
- W. Yu, D. I. Wilson, and B. R. Young, “Control performance assessment for nonlinear systems,” Journal of Process Control, vol. 20, no. 10, pp. 1235–1242, 2010.
- Z. Zhang, On Performance assessment for nonlinear control systems based on mimimum variance benchmark [Ph.D. thesis], Shanghai Jiao Tong University, Shanghai, China, 2013.
- W. Yu, D. I. Wilson, and B. R. Young, “Control performance assessment for a class of nonlinear multivariable systems,” Computer Aided Chemical Engineering, vol. 30, pp. 962–966, 2012.
- W. Yu, D. Wilson, B. Young, and T. Harris, “Variance decomposition of nonlinear systems,” in Proceedings of the IEEE International Conference on Control and Automation (ICCA '09), pp. 738–744, Christchurch, New Zealand, December 2009.
- G. E. B. Archer, A. Saltelli, and I. M. Sobol, “Sensitivity measures, anova-like techniques and the use of bootstrap,” Journal of Statistical Computation and Simulation, vol. 58, no. 2, pp. 99–120, 1997.
- S. Chen, S. A. Billings, and W. Luo, “Orthogonal least squares methods and their application to nonlinear system identification,” International Journal of Control, vol. 50, no. 5, pp. 1873–1896, 1989.