Abstract

The survival function of the Weibull distribution determines the probability that a unit or an individual will survive beyond a certain specified time while the failure rate is the rate at which a randomly selected individual known to be alive at time will die at time (). The classical approach for estimating the survival function and the failure rate is the maximum likelihood method. In this study, we strive to determine the best method, by comparing the classical maximum likelihood against the Bayesian estimators using an informative prior and a proposed data-dependent prior known as generalised noninformative prior. The Bayesian estimation is considered under three loss functions. Due to the complexity in dealing with the integrals using the Bayesian estimator, Lindley’s approximation procedure is employed to reduce the ratio of the integrals. For the purpose of comparison, the mean squared error (MSE) and the absolute bias are obtained. This study is conducted via simulation by utilising different sample sizes. We observed from the study that the generalised prior we assumed performed better than the others under linear exponential loss function with respect to MSE and under general entropy loss function with respect to absolute bias.

1. Introduction

As a result of the adaptability in fitting time-to-failure of a very widespread multiplicity to multifaceted mechanisms, the Weibull distribution has assumed the centre stage especially in the field of life-testing and reliability/survival analysis. It has shown to be very useful for modelling and analysing life time data in medical, biological and engineering sciences, Lawless [1]. Much of the attractiveness of the Weibull distribution is due to the wide variety of shapes it can assume by altering its parameters.

Censoring is a feature that is recurrent in lifetime and reliability data analysis, it occurs when exact lifetimes or run-outs can only be collected for a portion of the inspection units.

According to Rinne [2], “A data sample is said to be censored when, either by accident or design, the value of the variables under investigation is unobserved for some of the items in the sample.’’

Maximum likelihood estimator (MLE) is quiet efficient and very popular both in literature and practice. Bayesian approach has been employed for estimating parameters. Some research have been done to compare MLE and that of the Bayesian approach in estimating the survival function and the parameters of the Weibull distribution. Sinha [3] determined the Bayes estimates of the reliability function and the hazard rate of the Weibull failure time distribution by employing squared error loss function, Abdel-Wahid and Winterbottom [4] studied the approximate Bayesian estimates for the Weibull reliability function and hazard rate from censored data by employing a new method that has the potential of reducing the number of terms in Lindley procedure, and Al Omari and Ibrahim [5] conducted a study on Bayesian survival estimator for Weibull distribution with censored data using squared error loss function with Jeffreys prior amongst others.

Guure et al. [6] applied Bayesian estimation, for the two-parameter Weibull distribution using extension of Jeffreys’ prior information with three loss functions, Syuan-Rong and Shuo-Jye [7] considered Bayesian estimation and prediction for Weibull model with progressive censoring. Other recent papers employing different models can be seen in Cattani and Ciancio [8], Wang et al. [9], Cattani [10, 11]. Similar work can be seen in Gupta and Kundu [12] Zellner [13], Al-Aboud [14], Al-Athari [15], Cattani et al. [16] Pandey et al. [17], and a work on generalized exponential distribution: Bayesian estimations, Kundu and Gupta [18] which is somehow similar to the Weibull distribution.

The aim of this paper is twofold. First is to consider the maximum likelihood estimator of the survival function and the failure rate. In order to obtain the estimate of the survival function and the failure rate, we first need the MLE of the Weibull two parameters under consideration here. It is observed that the MLE cannot be obtained in analytical form, we therefore assumed the Newton-Raphson method to compute the MLE, and the method works quite well.

The second aim of this paper is to consider the Bayesian approach for the survival function and the failure rate. It is remarkable that most of the Bayesian inference procedures have been developed with the usual squared error loss function, which is symmetrical and associates equal importance to the losses due to overestimation and underestimation of equal magnitude according to Vasile et al. [19]. However, such applications may be restrictive in most situations of practical importance. For example, in the estimation of the failure rate, an overestimation is usually much more serious than an underestimation. In this case, the use of a symmetric loss function might be inappropriate as stated by Basu and Ebrahimi [20]. In this paper, we obtain the Bayes estimates under the LINEX loss function, general entropy loss function, and squared error loss function using Lindley’s approximation technique via simulation study with informative prior and a generalised noninformative prior.

The rest of the paper is arranged as follows: Section 2 contains the derivative of the parameters based on which the survival function and the failure rate are determined under maximum likelihood estimator, Section 3 is the Bayesian estimation approach. This is followed by simulation study in Section 4. Results and discussion are in Sections 5 and 6 is the conclusion.

2. Maximum Likelihood Estimation

Let be the set of random lifetimes with respect to the Weibull distribution with and as the parameters, where is the scale parameter and the shape parameter.

The probability density function , the cumulative distribution function , and the survival function ) of Weibull are given, respectively, as The likelihood function is where is the failure time and is for censored observations. is the survival function.

The log-likelihood function of (2.2) is We differentiate (2.3) with respect to the unknown parameters and equal the resulting equation to zero as follows:

The maximum likelihood estimator of is The shape parameter is obtained by the method of Newton-Raphson since it cannot be solved analytically.

The estimates of the survival function and the failure rate of the Weibull distribution under MLE are

3. Bayesian Inference

In the field of statistics, Bayesian inference is viewed as a method that employs the Bayes’ rule in other to update the probability estimate of a hypothesis taking into consideration new evidence as they become available. Bayesian updating is one of the essential techniques used in modern statistics, more importantly in mathematical statistics. Bayesian updating is particularly important in analysing sequence of data. Bayesian inference is applicable in many fields today, for example, engineering, medicine, accounting, and others. Bayes makes use of our prior beliefs of the parameters which is known as the prior distribution. It is the distribution of the parameters before any data is observed and is given as . It also takes into consideration the observed data which is viewed as the likelihood function and given as .

Bayesian inference is based on the posterior distribution which is simply the ratio of the joint density function to the marginal distribution.

The posterior distribution is where is the data and is the parameter of interest.

The Bayes estimator is considered under three loss functions which is also indisputable in Bayesian estimation. They are asymmetric (LINEX and general entropy) loss functions and symmetric (squared error) loss function.

Prior distribution of the parameters need to be assumed for the Bayesian inference. As discussed by Berger and Sun [21] and subsequently by Banerjee and Kundu [22], we let take on a prior with and . We assume that the prior of is independent of the prior of and is in the neighbourhood of . Let represent the prior of and for , where

Let the likelihood equation which is be the same as (2.2).

The joint posterior density function of is given by

The posterior probability density function of and given the data is obtained by dividing the joint posterior density function over the marginal distribution function as

3.1. Generalised Noninformative Prior

Our proposition of the generalised noninformative prior for the parameters and is given such that We are assuming there is no or little knowledge on the parameters being estimated, where and are the estimates from maximum likelihood with respect to the available data obtained by the researcher and is a constant that can assume any value in order to minimise the prior effect on the posterior distribution. We refer to this approach as the data-dependent prior and it is more or less an empirical or objective Bayes prior. This is an interesting new developing theory of objective priors and, while data dependent, it does not involve an inappropriate double use of the data, Berger [23], unless the sample size is fairly small. The generalised noninformative prior must not be misconstrued to imply a joint prior for the two parameters Weibull distribution. In other words, the scale and shape parameters are independent a priori.

The likelihood function from (2.2) is With Bayes theorem the joint posterior distribution of the parameters and is where is the normalizing constant that makes a proper pdf.

The posterior density function is obtained by using (3.4).

3.2. Linear Exponential Loss Function

This loss function according to Soliman et al. [24] rises approximately exponentially on one side of zero and approximately linearly on the other side.

The posterior expectation of the LINEX loss function according to Zellner [13] is with denoting the posterior expectation with respect to the posterior density of . Therefore, the Bayes estimator of , which is denoted by under LINEX loss function is the value of which minimizes (3.8) and is provided that exist and is finite.

The posterior density of the survival function and the failure rate under this loss function are given as

It can be observed that (3.10) contain ratio of integrals which cannot be obtained analytically and as a result we make use of Lindley approximation procedure to evaluate the integrals involved.

3.3. Lindley Approximation

A prior of need to be specified here so as to calculate the approximate Bayes estimates of and . Having specified a prior for as , it is similarly assumed that also takes on a Gamma prior.

Lindley [25] proposed a ratio of integral of the form where is the log-likelihood and are arbitrary functions of . Assuming that is the prior distribution for and with being some function of interest.

The posterior expectation according to Sinha [3] is where .

This can be approximated asymptotically by where , , , ; .

Taking the two parameters into consideration, (3.13) reduces to where is the log-likelihood equation in (2.3).

Taking the survival function, where In a similar approach and can be obtained.

For the failure rate, and follow in like manner.

Let

3.4. General Entropy Loss Function

This is used to determine the degree of overestimation and underestimation of the parameters. It is simply a generalization of the entropy loss function.

The Bayes estimator of , denoted by is given as provided exist and is finite.

The posterior density function of the survival function and the failure rate under general entropy loss are given, respectively, as By making use of Lindley procedure as in (3.14), where , , and , represent the first and second derivatives of the survival function and the failure rate, the following equations are obtained: Hence, and follows.

For the failure rate,

With the same approach as given above and are obtained.

3.5. Squared Error Loss Function

The most common loss function used for Bayesian estimation is the squared error (SE), also called quadratic loss. The square error loss denotes the punishment in using to estimate and is given as , where the expectation is taken over the joint distribution of and . The posterior density function of the survival function and the failure rate under the Symmetric loss function are given as

Applying the same Lindley approach here as in (3.14), we have for the Survival Function

In a similar approach and can be obtained.

For the Failure Rate, and follow in like manner.

With respect to the generalised noninformative prior, the same procedures as above are also employed but is substituted by .

4. Simulation Study

We have considered in this simulation study a sample size of , 50 and 100, which is representative of small, moderate, and large data sets. The following steps were employed to generate the data.

A lifetime is generated from the sample sizes indicated above from the Weibull distribution which represents failure of the product or unit. The values of the assumed actual parameters of the Weibull distribution were taken to be  and 1.5 and that of  and 1.2. The same sample size is generated from the uniform distribution for the censored time with , where the value of depends solely on the proportion of the observations that are censored. In our study, we consider the percentage of censoring to be 30. is taken as the minimum of the failure time and the censored time of the observed time , where

To compute the Bayes estimates, an assumption is made such that and take, respectively, and priors. We set the hyperparameters to zero, that is, in order to obtain noninformative priors. Note that at this point, the priors become nonproper but the results do not have any significant difference with the implementation of proper priors as stated by Banerjee and Kundu [22].

The values for the loss parameters of both the LINEX and general entropy were and ±2. For problems on how to choose the loss parameter values, see Calabria and Pulcini [26]. We have also considered the generalised noninformative prior to be = 3 and 5 without loss of generality. These were iterated () 1000 times. The mean squared error and the absolute bias values are determined and presented below for the purpose of comparison. Consider the following:

5. Results and Discussion

From Tables 1 and 3, the most dominant estimator that had the smallest mean squared error is the Bayesian under linear exponential loss function(LINEX). This happened with generalised noninformative prior except at  with    and    that we observed that the noninformative gamma prior gave the smallest MSE. This was followed closely by the general entropy loss function (GELF) with the noninformative gamma prior. What is remarkable is that the smallest absolute bias values occurred mostly with the generalised noninformative prior. GELF was slightly ahead of LINEX but both were better than SELF and that of the MLE.

The implication from above is that the generalised noninformative prior worked remarkable well under both LINEX and GELF with respect to the mean squared error and absolute bias. What need to be stated is that the generalised prior ensures that since there is very little knowledge on the function being estimated as a result of which a noninformative prior is assumed and obtained from the available data via MLE, then one should ensure that at the end it plays little role so that the Bayesian inference is based on the available data.

Considering Tables 2 and 4, we noticed again that the generalised prior performed astonishingly well against the noninformative prior under both the GELF and LINEX. Both priors performed equally well under general entropy and linear exponential loss functions. With the absolute bias values, the generalised noninformative prior incredibly performed better under LINEX loss function but was almost equal with the noninformative prior under the general entropy loss function.

To obtain the MSE values for each estimated value, the MSE is calculated for each of the one thousand estimated values of the survival function and the failure rate that is, from 1 to 1000. At the end, we obtain the average of the MSE, values. Our aim is to find out how close the estimated values of the estimators are to the true value. The absolute bias values are obtained in like manner and of course from the same simulated values as that of the MSE.

6. Conclusion

In this study, we consider the point estimation of the Weibull distribution based on right censoring through simulation. MLE and Bayes estimators are applied to estimate the survival function and the failure rate of this lifetime distribution. The Bayes estimators are obtained using linear exponential, general entropy, and squared error loss functions. We also employed the Bayesian noninformative prior approach in estimating survival function and the failure rate. In order to reduce the complicated integrals that are in the posterior distribution which cannot explicitly be obtained in close form, we employed the Lindley approximation procedure to calculate the Bayes estimators.

Another point worth noting is that we assumed an informative prior for the scale parameter and the shape parameter which led us into obtaining an improper prior. We also made a proposition for a generalised noninformative prior.

From the results and discussions above, it is evident that the proposed generalised noninformative prior performed quite well than the noninformative gamma prior. In all the cases, the Bayesian estimator using the generalised noninformative prior under the linear exponential loss function overall performed better than the other estimators and under the other different loss functions with respect to the mean squared error. It has also been observed that the smallest absolute bias values occurred predominantly with the generalised noninformative prior under general entropy loss function for both the survival function and the failure rate.

Acknowledgments

The authors would like to thank the anonymous referees for their suggestions and comments. The first author would like to personally thank the Editor, Professor Carlo Cattani, for his encouragement and suggestions.