Research Article  Open Access
Ali Erkoc, Esra Emiroglu, Kadri Ulas Akay, "Graphical Evaluation of the RidgeType Robust Regression Estimators in Mixture Experiments", The Scientific World Journal, vol. 2014, Article ID 806471, 9 pages, 2014. https://doi.org/10.1155/2014/806471
Graphical Evaluation of the RidgeType Robust Regression Estimators in Mixture Experiments
Abstract
In mixture experiments, estimation of the parameters is generally based on ordinary least squares (OLS). However, in the presence of multicollinearity and outliers, OLS can result in very poor estimates. In this case, effects due to the combined outliermulticollinearity problem can be reduced to certain extent by using alternative approaches. One of these approaches is to use biasedrobust regression techniques for the estimation of parameters. In this paper, we evaluate various ridgetype robust estimators in the cases where there are multicollinearity and outliers during the analysis of mixture experiments. Also, for selection of biasing parameter, we use fraction of design space plots for evaluating the effect of the ridgetype robust estimators with respect to the scaled mean squared error of prediction. The suggested graphical approach is illustrated on Hald cement data set.
1. Introduction
Mixture experiments, a special study area of response surface methodology (RSM), are performed in many areas of product development and improvement. The purpose of mixture experiments is to model the blending surface with some forms of the mathematical equation. In general, for modeling wellbehaved mixture system, the specific models such as Scheffé canonical polynomials are used in developing the appropriate response model. The parameter estimates of the Scheffé canonical polynomials are obtained by the ordinary least squares (OLS) method. However, in mixture experiments, multicollinearity is more frequent than the other experimental studies because of the constraints of components composing the mixture. Therefore, OLS estimates of the Scheffé canonical polynomials may be statistically insignificant with wrong sign and their variances are large so they may be far from the true values due to constraints on the mixture components [1–3]. To reduce the effect of multicollinearity in the analysis of mixture experiments, variable transformation or ordinary ridge regression (ORR), suggested by Hoerl and Kennard [4], is widely used as a classical method.
In mixture experiments, the detailed application of ORR estimator is given by St. John [1]. To evaluate the performance of ORR estimator, the graphical approaches apart from the analytical methods have been proposed in mixture experiments. These graphical approaches are based on plots of the scaled prediction variance (SPV) trace, which is suggested by Vining et al. [5]. The plot of SPV traces is used to compare the quality of prediction for designs in mixture experiments [5, 6]. Using the plot of SPV traces, Jang and Yoon [7] suggested a graphical method for evaluating and selecting an appropriate biasing parameter that balances the biasvariance tradeoff. With this approach, the SPV values are plotted along prediction rays that correspond to Cox directions. On the other hand, Jang and AndersonCook [8] used fraction of design space (FDS) plots, which is developed by Zahran et al. [9], and violin plots to illustrate and evaluate the effect of ORR estimator with respect to the SPV values and to guide the decision about the value of biasing parameter .
In mixture experiments, apart from the problems due to multicollinearity, another important problem which needs attention in parameter estimation is the presence of outliers in the data set [3, 10, 11]. In this case, outliers affect the efficiency of OLS estimates [12]. To overcome this problem, robust estimation methods like estimator, least median of squares (LMS) estimator, least trimmed sum of squares (LTS) estimator, estimator, and MMestimator are proposed (see [12–16]). However, although robust estimators are the resistant techniques used to obtain the parameter estimates which are not affected by outliers, they are frequently unstable when the design matrix is illconditioned [12]. Therefore, effects due to both outliers and multicollinearity in the analysis of mixture experiments can be reduced to a certain extent by using alternative approaches. One of these approaches is to use biasedrobust estimators for the estimation of the coefficients. In literature, it is recommended to use alternative ridgetype robust estimators for both outliers and multicollinearity problem in data set (see [17–22]).
The purpose of this study is to apply and evaluate various ridgetype robust estimators in the analysis of mixture experiments. Also, the performance of ridgetype robust estimators is dependent on the biasing parameter. In this case, to determine the biasing parameter apart from the analytical methods, alternative plots which are used in comparison and evaluation of the designs and which are based on the SPV values or the scaled mean squared error of prediction (SMSEP) values can be used. Considering the SPV values in evaluating and comparing designs is important, but bias properties of designs should also be considered [23]. Therefore, our study will focus on the use of FDS plots as a graphical tool for evaluating the effect of various ridgetype robust estimators with respect to the SMSEP values and for guiding the decision about the value of the biasing parameter.
This paper is organized as follows. In the next section, the concise information about the analysis of mixture experiments with robust methods is given. In Section 3, the ridgetype robust estimators based on the estimator, GMestimator, and MMestimator are introduced. In Section 4, the FDS plots are introduced for the selection of biasing parameter . The suggested approach is illustrated on Hald cement data in Section 5. Finally, the obtained results are given in Section 6.
2. Mixture Experiments
In mixture experiments, the measured response depends only on the proportions of the components present in the mixture and not on the amount of the mixture. For example, the measured response might be the strength of concrete which is a mixture of cement, sand, and water, or it might be octane rating of a blend of gasoline. The aim of these experiments is to find optimal component proportions that provide desired values of some product performance characteristics [24].
Let represent the proportion of the th component present in a component mixture; then The mixture constraints (1) produce a regular dimensional simplex experimental region. However, the experimental region (1) is sometimes subjected to additional constraints on individual mixture components of the form where and denote lower and upper bounds, respectively. In general, restriction (2) reduces the experimental region given by (1) to an irregular dimensional hyperpolyhedron. Mixture experimental designs are discussed by Cornell [24] for regular and irregular simplex regions.
In general, the presence of natural constraints or/and some additional linear constraints between the components requires the use of specific polynomial models such as Scheffé canonical polynomials for the modeling of the mixture system [25]. For modeling wellbehaved mixture system, generally the Scheffé canonical polynomials are sufficient [24]. The first and seconddegree Scheffé canonical polynomial are given as
As usual, we can represent the Scheffé canonical polynomial models in matrix form by where is vector of observations on the response variable, is matrix, where is number of the terms in the model, is vector of parameters to be estimated, and is vector of random errors satisfying and . The vector of unknown parameters can be generally estimated using OLS method. The OLS estimator for is When the observations in model (4) are normally distributed, the OLS is a good parameter estimation procedure in the sense that it produces an estimator of the parameter vector that has good statistical properties [12]. For example, is the best linear unbiased estimator of and also the maximumlikelihood estimator of . On the other hand, there are many situations where the distribution of the response variable is nonnormal. Under conditions of nonnormal distributions, particularly heavytailed distributions, OLS estimator no longer has these desirable properties. These heavytailed distributions tend to generate outliers, and these outliers may have improper effect on the OLS estimates. To deal with this, several robusttooutliers methods have been proposed in the literature [12, 16].
Robust regression methods are welldesigned statistical techniques to produce regression coefficients which are not sensitive to outliers and nonnormal error distributions [13]. The most popular of all robust estimation techniques is estimation, proposed by Huber [26]. The estimator is defined as where denote the residuals as , where denote the th row of , and is a robust estimate of scale. The scale is required to gain scale equivariance and either can be an external scale estimate or can be estimated simultaneously. The function is related to the likelihood function for an appropriate choice of the error distribution. Different choices for lead to different variants of estimators. As with most estimation procedures, both the Huber weight function and the Tukey biweight function are two common choices [16].
To minimize (6), equate the first partial derivatives of with respect to each parameter which leads to equations of the form where is the partial derivative of with respect to parameters. In general, the function in (7), a nonlinear function, must be solved by iterative methods. The most common solution is iteratively reweighted least squares (IRLS), resulting in an estimator where is an diagonal matrix of weights , . IRLS estimation procedure updates matrix until a convergence criterion has been met [12].
On the other hand, estimators are not robust to high leverage points. As a remedy to this problem, boundedinfluence generalized estimators (GMestimators) have been proposed. The most commonly used GMestimator is the Schweppetype estimator. Handschin et al. [27] proposed an objective function with associated normal equations of the form where, for appropriate values of , the GMestimator can downweight outliers with high leverage points. Several suggestions for have been made that involve typical OLS outlier diagnostics, including studentized residuals or DFFITS [28]. The resulting estimator is (8), except the weights which become . In the literature, several GM estimation approaches are suggested using various combinations of GM components (objective function, initial estimate, scale estimate, function, etc.) [29, 30].
The breakdown point and efficiency are two practical concerns that should be taken into account when selecting a robust estimation procedure [12, 16]. According to these properties, GMestimators possess the same efficiency and asymptotic distributional properties as estimators. But their breakdown points may not be much better than the worst case . In these cases, both estimation and GMestimation can be improved by starting with a good initial estimate. In general, an alternative desirable initial estimator with a high breakdown point can be estimator [29, 30].
estimator proposed by Rousseeuw and Yohai [14] is based on minimizing the dispersion of the residuals. The objective function for estimation is where the dispersion function is found implicitly as the solution to where is a tuning constant defined as and represent the standard normal distribution. The solution is called an estimator of scale. But it is impossible for estimator to achieve a high breakdown point as well as a high efficiency [16].
Other most commonly used robust estimators, proposed by Yohai [15], are MMestimators, which combine high breakdown with high asymptotic efficiency. Estimates are a modification of the typical estimates and are obtained through a threestep process [16]. Let be an estimator, and let be the corresponding estimator of scale, solving (11) for . The MMestimator is then defined as local solution of obtained with IRLS and initial value . The initial estimator guarantees a high breakdown point and the final MMestimate a high Gaussian efficiency. In both the initial estimator and the final MMestimator, a standard choice of is Tukey biweight function. The tuning constant can be set to 1.547 for the estimator to guarantee a 50% breakdown point, and it can be set to 4.685 for the second step MMestimator in (12) to guarantee a 95% efficiency of the final estimator [16].
3. RidgeType Robust Estimators
Multicollinearity and outliers are two main problems for researchers using regression estimation methods. In the presence of multicollinearity, several alternative estimation techniques are proposed. One of them is the ORR estimator which was proposed by Hoerl and Kennard [4]. The ORR estimator which is the most popular method for dealing with multicollinearity is defined by where is called biasing parameter. Since depends on , is sensitive to outliers. Therefore, outliers may have also improperly effect on the ridge estimates. The problem is further complicated when both outliers and multicollinearity are present in the data [31].
In recent years, major efforts have been made to obtain reliable estimates especially in the presence of outliers and also multicollinearity. When both outliers and multicollinearity occur in a data set, it would seem beneficial to combine methods designed to deal with these problems individually. It is hoped that the resulting ridgetype robust estimators will be resistant to outliers and less affected by multicollinearity [19, 21, 31].
A ridgetype estimator, suggested by Silvapulle [19], is defined by where is the estimators of . Silvapulle [19] shows that is obtained under some conditions and a positive exists which depends on the unknown parameters such that , for .
On the other hand, Maronna [22] stated that matrix and estimator in (14) are also sensitive to leverage points. Therefore, a ridgetype robust estimator which is not sensitive to both  and outliers is given by where is one of the robust estimators (such as GMestimator or MMestimator) of . In this case, the use of ridgetype robust estimators is a good method for obtaining more stable parameter estimates for the model.
The ridgetype robust estimator given in (15) depends on the biasing parameter . For selection of biasing parameter, Silvapulle [19] proposed the two different types of adaptive choices based on Hoerl et al. [32] (abbreviated to HKB) and Lawless and Wang [33] (abbreviated to LW). The same results can be extended to estimators. The resulting two choices of are where and is the th eigenvalue of . Also for ORR estimator, there are several methods for selecting the biasing parameter in literature. Most of these methods have been reviewed by Clark and Troskie [34]. Recommended methods can be similarly extended to the ridgetype robust estimators.
4. The Graphical Method for Evaluating Biasing Parameter
Due to the fact that there is not a definite rule for selection of biasing parameter, the graphical approaches developed for the ORR estimator can be used to select the biasing parameter of the ridgetype robust estimators. Different than analytical methods, determination of the biasing parameter with graphical approach is useful since it helps the researcher to examine the prediction properties of design based on the different biasing parameters visually. The prediction properties of a design, specifically the SMSEP values, also depend on the fitted model. Therefore multicollinearity due to the fitted model also influences the performance of the prediction properties of design completely. In this case, to examine the graphical approaches developed for comparison of the performance of designs based on the different biasing parameter for a single design is a useful method [7, 8].
For using the suggested methods on the analysis of mixture experiments, firstly we define the predicted response at . When we use estimator, the predicted response value at is given as The mean squared error of , also known as the mean squared error of prediction (MSEP), is given by where is the bias associated with estimating .
The variance of , also known as the prediction variance, is given by where is the variancecovariance matrix of . There are various approximations for determination of covariance matrix of the robust estimators in the literature [13]. Huber [13] has shown that a reasonable approximation for the covariance matrix of is , where is correction factor.
Using (17), the bias of at is approximately given by By combining the result in (19) and (20), an approximate expression for the MSE of is given by Note that is a function of the biasing parameter , the location of mixture in the design space, the model matrix, and the weights matrix. It should also be noted that depends on , which is unknown. To calculate the in (21), the unknown parameters can be replaced by suitable estimates of the parameters.
When design comparison focuses on prediction, the MSEP is generally scaled by to create a scalefree quantity that reflects the design size. The scaled mean squared error of prediction (SMSEP) at the th observation for a ridgetype robust estimator is written as where denotes the design size. The multiplication by serves to adjust the MSE for the total number of observations. This practice, which is quite common in RSM, makes it possible to use the SMSEP as a design criterion for comparing several designs [6].
In an experimental region, determination of the mixture points , values along with a constant value can be compared for different values. Instead of comparing values arbitrarily, a graphical approach which examines the distribution of the values of on the experimental region can be used. So, an appropriate value which achieves condition on the experimental region can be determined.
To evaluate the distribution of values on the constrained experimental design, the FDS plots which are used in comparison and evaluation of the designs can be used. The main advantage of the use of FDS plots is to display characteristics of values throughout a multidimensional design region on a twodimensional graph. Therefore, we can use the FDS plots as a graphical tool for evaluating the effect of ridgetype robust estimators with respect to the SMSEP values and for selecting an appropriate value of the biasing parameter . In this case, instead of just considering a single FDS curve for a design, we examine the impact of the biasing parameter on the MSEP performance throughout the experimental region.
To calculate the FDS, two sampling methods with nearly same results are generally explored to sample mixture points from the design space [35]. The first uses shrunken regions by Piepel et al. [36] and randomly selects a number of points on each shrinkage level proportional to that level. The second method selects points completely at random that fit within the constraints of the region [35]. In this study, we will use second method for generation of the sample points on the experimental region. Once the points are generated, the values are calculated for each point. The empirical cumulative distribution function is then calculated for the values and plotted on the FDS plot. The minimum value is shown at FDS of 0 and the maximum value is shown at the fraction 1. Along the FDS curve, the fraction of the design space at or below a particular value can be determined. A good design starts with small values and remains flat throughout. Therefore, with FDS plot, we see the relationship between the different biasing parameters and we see the pattern of changing as increases. By examining several different values of , we can determine the smallest possible value of , which stabilizes the distribution.
5. Example: The Hald Cement Data
To evaluate the performances of ridgetype robust estimators, we will draw on a mixture experiment given by Piepel and Redgate [37]. Piepel and Redgate [37] pointed out that the data from a cement example published by Hald [38] can be analyzed in the framework of the mixture experiments. The purpose of the experiment is to investigate the influence of the components on the heat of hardening (calories/gram), measured after the cements cured for 180 days. The data given in Table 1 contains the values (weight fractions, wf) computed from the 13 oxide weight percent clinker compositions. Additional information on the analyzing of the Hald cement experiment can be found in Piepel and Redgate [37] and Smith [3].

When we use firstdegree Scheffé canonical polynomial, the obtained model is as follows: where the quantities in parentheses are estimated as standard errors of the coefficient estimates. Statistics for detecting influential observations for the Hald cement data set are given in Table 2.

Based on the result of Table 2, ordinary residual seems suspiciously large. Also, observation 3 has a high leverage value. The parameter estimates of the robust estimators are given in Table 3. In Table 3, the quantities in parentheses are estimated as standard errors of the coefficient estimates and AICR is the robust version of Akaike Information Criterion which is used for model selection [16].

Table 4 displays the final weights for robust estimators. In estimation, there is considerably downweight only at point 3. In case of GMestimation, both point 3 and point 8 are significantly downweight. On the other hand, all observations are moderately downweight in MMestimation. But, we note that neither point 3 nor point 8 is significantly downweight in MMestimation, despite the fact that these points have the largest Cook’s distance and ordinary residual, respectively.

In addition, the condition number of matrix is 101.034. So, the design matrix is moderately illconditioned. Therefore, due to the multicollinearity and outliers, the ridgetype GMestimator or the ridgetype MMestimator can be used. For the ridgetype GMestimator, we can calculate the biasing parameter as . For the ridgetype MMestimator, the biasing parameter can be estimated as and based on the methods proposed by Silvapulle [19].
To evaluate the biasing parameter for the ridgetype GMestimator and the ridgetype MMestimator, randomly generated mixture points on the experimental region are considered. For different values, the FDS plots of values based on and estimators are given in Figures 1 and 2, respectively.
In Figures 1 and 2, as the biasing parameter increases, the distribution of values initially decreases gradually and then increases dramatically. In this case, we can select a reasonably positive small value of at which the distribution of is stable and condition is achieved. For the ridgetype GMestimator, the biasing parameter is approximately chosen as . Also, for the ridgetype MMestimator, we can select the biasing parameter as . The obtained models along with values are given in Table 5.

In Tables 3 and 5, we observe that is achieved for the ridgetype GMestimator. Also, when we select the biasing parameter as , the same result is obtained for the ridgetype MMestimator. A more comprehensive comparison of the ridgetype GMestimator and the ridgetype MMestimator under MSEP sense is given in Figure 3.
From Figure 3, it can be seen that is smaller than for . Also, is smaller than for . In addition, when we select the biasing parameter as , is smaller than . For the values of biasing parameter larger than , is smaller than . As a result, which ridgetype robustestimator is the best seems to be dependent on the robust estimator of and the choice of biasing parameter . We have to replace these unknown parameters by some suitable estimates in practice. Therefore, the results of the graphical findings may change.
6. Conclusions
In this study, we used various ridgetype robust estimators to reduce the effect of the multicollinearity and outliers on the model parameters to certain extent in the analysis of mixture experiments. We observed that the performance of the ridgetype robust estimator depends on the robust estimator of and the biasing parameter . In this study, as robust estimator of , the estimator, GMestimator, and MMestimator were discussed. By selecting the robust estimators which are less sensitive to points outlying in the and/or direction will improve the performance of the ridgetype robustestimator. On the other hand, depending on the biasing parameter, to evaluate the performance of the ridgetype robust estimators, we adapted extensive enlargement of the graphical approach suggested for ORR estimator. For evaluating the biasing parameter, the FDS plots which are based on the SMSEP values are considered. As known in literature, the MSEP is a more powerful criterion for comparison of the designs than the prediction variance. Because MSEP incorporates the prediction variance and the prediction bias associated with the fitted model, the results obtained by FDS plots which are based on the SMSEP values were observed to be consistent with the other analytic approaches used in literature. Therefore, for evaluation of biasing parameter, the FDS plots which are based on the SMSEP values can also be used for both the mixture models affected by multicollinearity and outliers and other biasedrobust estimators.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
The authors would like to acknowledge the editor and referees for their constructive and valuable suggestions and comments that have improved the presentation of the paper greatly. This work was supported by Scientific Research Projects Coordination Unit of Istanbul University, Project no. UDP24923.
References
 R. C. St. John, “Experiments with mixtures, illconditioning, and ridge regression,” Journal of Quality Technology, vol. 16, no. 2, pp. 81–96, 1984. View at: Google Scholar
 J. A. Cornell and J. W. Gorman, “Two new mixture models: living with collinearity but removing its influence,” Journal of Quality Technology, vol. 35, no. 1, pp. 78–88, 2003. View at: Google Scholar
 W. F. Smith, Experimental Design for Formulation, vol. 15 of ASASIAM Series on Statistics and Applied Probability, Society for Industrial and Applied Mathematics (SIAM), Philadelphia, Pa, USA, 2005. View at: Publisher Site  MathSciNet
 A. E. Hoerl and R. V. Kennard, “Ridge regression: biased estimation for nonorthogonal problems,” Technometrics, vol. 12, no. 1, pp. 55–67, 1970. View at: Google Scholar
 G. G. Vining, J. A. Cornell, and R. H. Myers, “A graphical approach for evaluating mixture designs,” Applied Statistics, vol. 42, no. 1, pp. 127–138, 1993. View at: Publisher Site  Google Scholar
 A. I. Khuri, J. M. Harrison, and J. A. Cornell, “Using quantile plots of the prediction variance for comparing designs for a constrained mixture region: an application involving a fertilizer experiment,” Journal of the Royal Statistical Society C: Applied Statistics, vol. 48, no. 4, pp. 521–532, 1999. View at: Publisher Site  Google Scholar
 D. Jang and M. Yoon, “Graphical methods for evaluating ridge regression estimator in mixture experiments,” Communications in Statistics B: Simulation and Computation, vol. 26, no. 3, pp. 1049–1061, 1997. View at: Google Scholar
 D. Jang and C. M. AndersonCook, “Fraction of design space plots for evaluating ridge estimators in mixture experiments,” Quality and Reliability Engineering International, vol. 27, no. 1, pp. 27–34, 2011. View at: Publisher Site  Google Scholar
 A. Zahran, C. M. AndersonCook, and R. H. Myers, “Fraction of design space to assess prediction capability of response surface designs,” Journal of Quality Technology, vol. 35, no. 4, pp. 377–386, 2003. View at: Google Scholar
 D. C. Montgomery and S. R. Voth, “Multicollinearity and leverage in mixture experiments,” Journal of Quality Technology, vol. 26, no. 2, pp. 96–108, 1994. View at: Google Scholar
 O. Coskuntuncel, Karma Denemelerde ve Modellerde Robust İstatistiksel Analizler [Ph.D. thesis], Cukurova Universitesi FBE, Adana, Turkey, 2005.
 D. C. Montgomery, E. A. Peck, and G. Vining, Introduction to Linear Regression Analysis, John Wiley & Sons, New York, NY, USA, 3rd edition, 2001. View at: MathSciNet
 P. J. Huber, Robust statistics, John Wiley & Sons, New York, NY. USA, 1981. View at: MathSciNet
 P. J. Rousseeuw and V. J. Yohai, “Robust regression by means of Sestimators,” in Robust and Nonlinear Time Series Analysis, J. Franke, W. Härdle, and R. D. Martin, Eds., Springer, New York, NY, USA, 1984. View at: Google Scholar
 V. J. Yohai, “High breakdownpoint and high efficiency robust estimates for regression,” The Annals of Statistics, vol. 15, no. 2, pp. 642–656, 1987. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 R. A. Maronna, R. D. Martin, and V. J. Yohai, Robust Statistics: Theory and Methods, Wiley Series in Probability and Statistics, John Wiley & Sons, London, UK, 2006. View at: Publisher Site  MathSciNet
 P. W. Holland, “Weighted ridge regression: combining ridge and robust regression methods,” NBER Working Paper Series, vol. 11, pp. 1–19, 1973. View at: Google Scholar
 R. G. Askin and D. C. Montgomery, “Augmented robust estimators,” Technometrics, vol. 22, no. 3, pp. 333–341, 1980. View at: Google Scholar
 M. J. Silvapulle, “Robust ridge regression based on an $M$estimator,” The Australian Journal of Statistics, vol. 33, no. 3, pp. 319–333, 1991. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 O. Arslan and N. Billor, “Robust ridge regression estimation based on the GMestimators,” Journal of Mathematical and Computational Science, vol. 9, no. 1, pp. 1–9, 1996. View at: Google Scholar  MathSciNet
 J. R. Simpson and D. C. Montgomery, “A biasedrobust regression technique for the combined outliermulticollinearity problem,” Journal of Statistical Computation and Simulation, vol. 56, no. 1, pp. 1–22, 1996. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 R. A. Maronna, “Robust ridge regression for highdimensional data,” Technometrics, vol. 53, no. 1, pp. 44–53, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 G. Piepel, “Discussion of “Response surface design evaluation and comparison” by C.M. AndersonCook, C.M. Borror , and D.C. Montgomery,” Journal of Statistical Planning and Inference, vol. 139, pp. 653–656, 2009. View at: Google Scholar
 J. A. Cornell, Experiments with Mixtures: Designs, Models, and the Analysis of Mixture Data, John Wiley & Sons, New York, NY, USA, 3rd edition, 2002. View at: Publisher Site  MathSciNet
 H. Scheffé, “Experiments with mixtures,” Journal of the Royal Statistical Society B, vol. 20, pp. 344–360, 1958. View at: Google Scholar  MathSciNet
 P. J. Huber, “Robust estimation of a location parameter,” Annals of Mathematical Statistics, vol. 35, pp. 73–101, 1964. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 E. Handschin, F. C. Schweppe, J. Kohlas, and A. R. Flechter, “Bad data analysis for power system state estimation,” IEEE Transactions on Power Apparatus and Systems, vol. 94, no. 2, pp. 329–337, 1975. View at: Publisher Site  Google Scholar
 W. S. Krasker and R. E. Welsch, “Efficient boundedinfluence regression estimation,” Journal of the American Statistical Association, vol. 77, no. 379, pp. 595–604, 1982. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 J. R. Simpson and D. C. Montgomery, “The development and evaluation of alternative generalized $M$estimation techniques,” Communications in Statistics—Simulation and Computation, vol. 27, no. 4, pp. 999–1018, 1998. View at: Publisher Site  Google Scholar  MathSciNet
 J. R. Simpson and D. C. Montgomery, “A performancebased assessment of robust regression methods,” Communications in Statistics, vol. 27, no. 4, pp. 1031–1049, 1998. View at: Google Scholar
 R. C. Pfaffenberger and T. E. Dielman, “A comparison of regression estimators when both multicollinearity and outliers are present,” in Robust Regression: Analysis and Applications, K. Lawrence and J. Arthur, Eds., pp. 243–270, Marcel Dekker, New York, NY, USA, 1990. View at: Google Scholar
 A. E. Hoerl, R. W. Kennard, and K. F. Baldwin, “Ridge regression: some simulations,” Communications in Statistics—Theory and Methods, vol. 4, no. 2, pp. 105–123, 1975. View at: Google Scholar
 J. F. Lawless and P. Wang, “A simulation study of ridge and other regression estimators,” Communications in Statistics: Theory and Methods, vol. 5, no. 4, pp. 307–323, 1976. View at: Google Scholar
 A. E. Clark and C. G. Troskie, “Ridge regression—a simulation study,” Communications in Statistics. Simulation and Computation, vol. 35, no. 3, pp. 605–619, 2006. View at: Publisher Site  Google Scholar  MathSciNet
 H. B. Goldfarb, C. M. AndersonCook, C. M. Borror, and D. C. Montgomery, “Fraction of design space plots for assessing mixture and mixtureprocess designs,” Journal of Quality Technology, vol. 36, no. 2, pp. 169–179, 2004. View at: Google Scholar
 G. Piepel, C. M. Anderson, and P. E. Redgate, “Variance dispersion graphs for evaluating and comparing experimental designs on polyhedral regions,” Tech. Rep. PNWDSA4218, Batelle, Pacific Northwest Laboratories, Richland, Wash, USA, 1995. View at: Google Scholar
 G. Piepel and T. Redgate, “A mixture experiment analysis of the hald cement data,” American Statistician, vol. 52, no. 1, pp. 23–30, 1998. View at: Google Scholar
 A. Hald, Statistical Theory with Engineering Applications, John Wiley & Sons, New York, NY, USA, 1952.
Copyright
Copyright © 2014 Ali Erkoc et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.