Research Article  Open Access
A Note on the Existence of the Location Parameter Estimate of the ThreeParameter Weibull Model Using the Weibull Plot
Abstract
The Weibull model is one of the widely used distributions in reliability engineering. For the parameter estimation of the Weibull model, there are several existing methods. The method of the maximum likelihood estimation among others is preferred because of its attractive statistical properties. However, for the case of the threeparameter Weibull model, the method of the maximum likelihood estimation has several drawbacks. To avoid the drawbacks, the method using the sample correlation from the Weibull plot is recently suggested. In this paper, we provide the justification for using this new method by showing that the location estimate of the threeparameter Weibull model exists in a bounded interval.
1. Introduction
There are several existing methods for the location parameter estimation of the threeparameter Weibull model. One can use the method of the maximum likelihood estimation (MLE) which is preferred by many statisticians due to its attractive statistical properties. However, it is well known that the MLE method has several drawbacks for the case of the threeparameter Weibull model. For example, the global maximum can reach infinity at the singularity and this singularity can result in local maxima of the likelihood function when it is numerically computed. For more details, see Barnard [1] and Smith and Naylor [2].
This MLE method has a convergence issue and it can also have an unfeasible value so that the location estimate of the threeparameter Weibull model can be greater than the minimum value of the observations [3, 4]. Cheng and Amin [5], Cheng and Iles [6], and Liu et al. [7] also pointed out that the likelihood function has the unbounded likelihood problem and the location parameter tends to approach the smallest observation. Huzurbazar [8] also showed that no stationary point can yield a consistent estimator, which results in no local maximum. Thus, whether a global or a local maximum is sought, the MLE is bound to fail.
To avoid the above problems, several authors, including Gumbel [3] and Vogel and Kroll [4], suggest the method of estimating the parameters using an estimate for the minimum drought. However, in order to estimate the location parameter of the threeparameter Weibull model using the methods in Gumbel [3] or Vogel and Kroll [4], one has to use the special tables provided by Gumbel [3] which are available only for limited cases. Sirvanci and Yang [9] also recommend to estimate the location parameter with . However, it is reported that the performance of these methods is not satisfactory. For more details, the reader is referred to Park [10]. It should be noted that this Gumbel method is improved by Park [10]. He proposes to estimate only the location parameter using the ordinary Gumbel method and estimate the other shape and scale parameters using the MLE of the twoparameter Weibull model and shows that the parameter estimates are noticeably improved by the proposed method.
Park [10] also proposed a method which maximizes the sample correlation function from the Weibull plot to estimate the location parameter of the threeparameter Weibull model. Comparing the sample correlations, the pvalues, and the AndersonDarling test statistics, he shows that his method outperforms the aforementioned existing methods. His method is conceptually easy to understand, simple to use and convenient for practitioners. However, the existence of the location estimate is not yet proved.
In this paper, we show that the location parameter estimate of the threeparameter Weibull model should exist in the bounded interval. Thus, unlike the MLE case, the method by Park [10] does not suffer from nonconvergence, singularity, or infeasibility issues when we calculate the location parameter numerically.
2. Weibull Plot and Correlation Coefficient from the Plot
In this section, we briefly review the Weibull plot [11] and present the sample correlation coefficient from the Weibull plot. The Weibull distribution has the respective probability density function and cumulative distribution function (CDF) We let for convenience. Then we haveIt is immediate from (2) that we have It is observed that the plot of versus is ideally a straight line with slope and intercept if the data are from the Weibull distribution. The widely used Weibull probability paper in engineering reliability is based on this idea.
With real data, we need to estimate to draw the Weibull plot. It should be noted that the estimation of is often called the plotting position in the statistics literature. Let be the order statistics from the smallest to the largest. There are several methods of estimating in the literature. Let be the empirical CDF value at for convenience. In practice, the plotting positions such as are widely used due to Blom [12] and Wilk and Gnanadesikan [13].
The Weibull plot is constructed by plotting on the vertical axis and on the horizontal axis. It should be noted that the straightness of the Weibull plot can also be used to assess the goodnessoffit of the Weibull model. See Park [10] along with the weibullness R package by Park [14]. The measure of the straightness in the Weibull plot can be evaluated by calculating the sample correlation coefficient of the paired points, We let and for convenience. Then the sample correlation coefficient from the Weibull plot is defined aswhere and .
3. Existence of the Location Parameter Estimate of the ThreeParameter Weibull Model
In many reliability applications, failures do not occur below a certain limit which is also known as a failurefree life (FFL) parameter in the engineering literature [15]. The threeparameter Weibull model with this FFL parameter has been widely used to describe the reliability of surfacemount assemblies due to wearout failures, etc. For more details, see Wong [16], Clech et al. [17], Drapella [18], Mitchell et al. [19], and Lam et al. [20].
It is thus reasonable to consider a lower limit to the Weibull model. This Weibull model is called the threeparameter Weibull with its CDF given by where . This lower limit is often called a location parameter.
Replacing by in (6), we can obtain the sample correlation as a function of where , and . For more details, see Section 5 of Park [10].
It is quite reasonable to impose a condition that for practical applications. Then the estimate of is given by
Lemma 1. The function has the limit as
Proof. In the following, we use the BachmannLandau’s big notation. See de Bruijin [21] for more details. That is, if and are defined on the domain , then means that for all where is a constant.
For convenience, let and then . It is easily seen that as (that is, ), we haveandIt is immediate upon substituting (11) and (12) into (8) that as , we haveWe have as . Thus, we let for convenience and we then have as . Rewriting (13) using , we haveBy dividing both the numerator and denominator of (14) by , we haveWhen taking the limit of (15) as (that is, as ), we havewhich completes the proof.
Lemma 2. As , we havewhere is the sample covariance between and and a series of observations of and is given by and for .
Proof. Differentiating (8) with respect to , we havewhere and alsoAgain, we let for convenience so that we have and . Then we can rewrite , , , and as a function of as follows: and alsowhere It should be noted that , , , and do not include .
After some tedious algebra, when , we haveSince as , we have . The sample covariance between and is given byIt is easily shown thatwhere is the BachmannLandau’s little notation in de Bruijin [21] for example. That is, implies that as .
Substituting , (26) and (27) into (25), we haveSimilarly, we can rewrite asSubstituting (28) and (29) into (18), we have which completes the proof.
Theorem 3. The global maximum of exists on with .
Proof. The function is continuous on . Considering the result of Lemma 1, we define Then is continuous on the closed bounded interval . Thus, the function has a global maximum and a global minimum on , due to Theorem 4.28 in Apostol [22]. Note that is a singularity point. Thus, it suffices to show that the global maximum of is not obtained at .
Since and , it is easily seen that the term in Lemma 2 is always positive. It is immediate from the L’Hôpital’s rule that we have Thus, using these with Lemma 2, we have as (that is, as ). Since is differentiable on , it is easily seen that cannot be a maximum from the intermediate value property of derivatives. For more details, see Lemma 6.2.11 of Bartle and Sherbert [23]. Thus, the global maximum exists on .
It is worthwhile to mention the lower bound of the sample correlation coefficient from the Weibull plot. It is well known that the sample correlation coefficient should be in in general. However, in the Weibull plot, the data and plotting positions are ordered and thus the sample correlation coefficient should be positive. Also, it should be noted that with the order statistics restriction, the sample correlation coefficient is bounded below by which is the best lower bound due to Hwang and Hu [24].
Finally, after the location parameter is obtained, we can estimate the other shape and scale parameters by several existing methods. We recommend the MLE method of the twoparameter Weibull for the estimation of shape and scale. For more details, see Section 5 of Park [10]. Unlike the MLE of the threeparameter Weibull, the MLE of the twoparameter Weibull guarantees the existence and uniqueness due to Farnum and Booth [25].
4. An Illustrative Example
The data in this example, published in Bilikam et al. [26], are the numbers of miles to failure of a type of vehicle. This data set has since then been often used for illustration of a threeparameter Weibull distribution [6, 20].
We can estimate the location parameter by maximizing the correlation function in (8) or solving in (18) as shown in Figure 1 which results in . As recommended earlier, we estimated the other shape and scale parameters using the MLE of the twoparameter Weibull.
In order to examine the performance of the proposed method, we compare it with other existing methods in Lam et al. [20]. They estimated the parameters using the constrained MLE (McLE) approach and the minimum SSE approach. The results are summarized in Table 1 with the corresponding , p value for Weibullness, and loglikelihood. Note that the p values for Weibullness testing were obtained using the weibullness R package by Park [14]. The results show that the proposed method outperforms the existing methods.

Data Availability
The article has no data used for study. So, it belongs to case 12 in the statement of the provided URL: that is, “12. No data were used to support this study”.
Conflicts of Interest
The author declares that they have no conflicts of interest.
Acknowledgments
This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (No. NRF2017R1A2B4004169). The author also wishes to dedicate this work to the memory and honor of Professor Byung Ho Lee in the Department of Nuclear Engineering at Seoul National University. The author’s interests in mathematics were formed under the strong influence of Professor Lee who passed away peacefully in Seoul on July 9, 2001.
References
 G. A. Barnard, “The use of the likelihood function in statistical practice,” in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 27–40, University of California Press, Berkeley, Calif, USA, 1965. View at: Google Scholar
 R. L. Smith and J. C. Naylor, “A comparison of maximum likelihood and Bayesian estimators for the threeparameter Weibull distribution,” Journal of the Royal Statistical Society: Series C (Applied Statistics), vol. 36, no. 3, pp. 358–369, 1987. View at: Publisher Site  Google Scholar  MathSciNet
 E. Gumbel, “Statistical forecast of droughts,” Hydrological Sciences Journal, vol. 8, no. 1, pp. 5–23, 1963. View at: Publisher Site  Google Scholar
 R. M. Vogel and C. N. Kroll, “Lowflow frequency analysis using probabilityplot correlation coefficients,” Journal of Water Resources Planning and Management, vol. 115, no. 3, pp. 338–357, 1989. View at: Publisher Site  Google Scholar
 R. C. Cheng and N. A. Amin, “Estimating parameters in continuous univariate distributions with a shifted origin,” Journal of the Royal Statistical Society Series B (Methodological), vol. 45, no. 3, pp. 394–403, 1983. View at: Google Scholar  MathSciNet
 R. C. Cheng and T. C. Iles, “Embedded models in threeparameter distributions and their estimation,” Journal of the Royal Statistical Society Series B (Methodological), vol. 52, no. 1, pp. 135–149, 1990. View at: Google Scholar  MathSciNet
 S. Liu, H. Wu, and W. Q. Meeker, “Understanding and addressing the unbounded "likelihood" problem,” The American Statistician, vol. 69, no. 3, pp. 191–200, 2015. View at: Publisher Site  Google Scholar  MathSciNet
 V. S. Huzurbazar, “The likelihood equation, consistency and the maxima of the likelihood function,” Annals of Eugenics, vol. 14, pp. 185–200, 1948. View at: Google Scholar  MathSciNet
 M. Sirvanci and G. Yang, “Estimation of the weibull parameters under type I censoring,” Journal of the American Statistical Association, vol. 79, no. 385, pp. 183–187, 1984. View at: Publisher Site  Google Scholar  MathSciNet
 C. Park, “Weibullness test and parameter estimation of the threeparameter weibull model using the sample correlation coefficient,” International Journal of Industrial Engineering : Theory, Applications and Practice, vol. 24, no. 4, pp. 376–391, 2017. View at: Google Scholar
 W. Nelson, Applied Life Data Analysis, John Wiley and Sons, New York, NY, USA, 1982. View at: MathSciNet
 G. Blom, Statistical Estimates and Transformed BetaVariables, John Wiley & Sons, New York, NY, USA, 1958. View at: MathSciNet
 M. B. Wilk and R. Gnanadesikan, “Probability plotting methods for the analysis of data,” Biometrika, vol. 55, no. 1, pp. 1–17, 1968. View at: Google Scholar
 C. Park, Weibullness: GoodnessOfFit Test for Weibull Distribution (R Package), 2018, https://cran.rproject.org/web/packages/weibullness. View at: Publisher Site
 Reliability HotWire, Reliability Basics – Location Parameter of The Weibull Distribution, vol. 15, May 2002, http://www.weibull.com/hotwire/issue15/relbasics15.htm.
 K. L. Wong, “When reliable means failure free,” Quality and Reliability Engineering International, vol. 3, no. 3, pp. 145–145, 1987. View at: Publisher Site  Google Scholar
 J.P. M. Clech, D. M. Noctor, J. C. Manock, G. W. Lynott, and F. E. Bader, “Surface mount assembly failure statistics and failure free time,” in Proceedings of the 1994 IEEE 44th Electronic Components & Technology Conference, pp. 487–497, May 1994. View at: Google Scholar
 A. Drapella, “An improved failurefree time estimation method,” Quality and Reliability Engineering International, vol. 15, no. 3, pp. 235–238, 1999. View at: Publisher Site  Google Scholar
 D. Mitchell, B. Zahn, and F. Carson, “Board level thermal cycle reliability and solder joint fatigue life predictions of multiple Stacked Die chip scale package configurations,” in Proceedings of the 54th Electronic Components and Technology Conference, pp. 699–703, USA, June 2004. View at: Google Scholar
 S.W. Lam, T. Halim, and K. Muthusamy, “Models with failurefree life—applied review and extensions,” IEEE Transactions on Device and Materials Reliability, vol. 10, no. 2, pp. 263–270, 2010. View at: Publisher Site  Google Scholar
 N. G. de Bruijn, Asymptotic Methods in Analysis, Dover Publications, New York, NY, USA, 3rd edition, 1981. View at: MathSciNet
 T. M. Apostol, Mathematical Analysis, AddisonWesley Publication, Reading, Mass, USA, 2nd edition, 1974. View at: MathSciNet
 R. G. Bartle and D. R. Sherbert, Introduction to Real Analysis, John Wiley and Sons, New York, NY, USA, 4th edition, 1982. View at: MathSciNet
 T. Y. Hwang and C. Y. Hu, “The best lower bound of sample correlation coefficient with ordered restriction,” Statistics and Probability Letters, vol. 19, no. 3, pp. 195–198, 1994. View at: Publisher Site  Google Scholar  MathSciNet
 N. R. Farnum and P. Booth, “Uniqueness of maximum likelihood estimators of the 2parameter weibull distribution,” IEEE Transactions on Reliability, vol. 46, no. 4, pp. 523–525, 1997. View at: Publisher Site  Google Scholar
 J. E. Bilikam, “ksample maximum likelihood ratio test for change of weibull shape parameter,” IEEE Transactions on Reliability, vol. R28, no. 1, pp. 47–50, 1979. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2018 Chanseok Park. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.