Research Article  Open Access
Design of Testing Period for Reliability Assessment of Numerical Control Machine Tools Considering Working Conditions
Abstract
The existing methods of determining testing period do not consider the effect of working condition covariates on reliability testing period of Numerical Control (NC) machine tools, which may lead to highcost testing or lowprecision assessment. Aiming at the problem, a new method of determining the testing period considering working condition covariates is proposed. The change rate of interval estimation of Mean Time between Failures (MTBF) is used as the criterion for determining the length of testing period. The reliability model of NC machine tools is established by the Cox proportional hazards model, and the twostep estimation method is used to estimate parameters of the baseline failure rate function and the coefficients of working condition covariates. The Bootstrap resamples are obtained by the Bootstrap resampling method. And then the parameters of the baseline failure rate function and the coefficients of working condition covariates are estimated simultaneously by maximum likelihood method, and thus interval estimations of MTBF under each covariate are obtained. The change rate models of MTBF interval estimation under each covariate level are established by Power function, and the testing periods under each covariate are obtained. Case study indicates that the testing periods under each covariate obtained by the proposed method are more accurate than those obtained by the others, when the same criterion and confidence level  are set.
1. Introduction
Field reliability test is the basic method of reliability assessment for NC machine tools. Unreasonable test period may decrease the assessment accuracy or increase the testing cost. In the premise of meeting evaluation accuracy, the shorter test period is, the lower test cost is. Therefore, it is of great practical engineering significance to choose an accurate test period [1]. Mchane determined the number of test pieces and test period based on the width of interval estimation of pivot, when Time between Failures (TBF) of the product followed logarithmic positionscale model [2]. He determined the test sample size by using the shortest interval estimation length of the evaluation parameter as the judgment basis [3]. Guo determined reliability test period by calculating the logarithmic ratio of upper interval estimation to lower interval estimation [4]. It can be learned from the above that the interval estimation accuracy of model parameters is usually taken as a criterion to determine the product's test period. In order to determine the suitable testing period for reliability assessment of NC machine tools, Li established the method of determining the testing period for reliability assessment of NC machine tools by using change rate of interval estimation as the criterion to determine the testing period [1]. However, influences of working conditions on the testing period were not considered in [1]. Guo calculated the front axle's fatigue life and obtained the enhancement coefficients of roads by comparative norm of tarpaved roads [5]. Chen adopted the multiplestress accelerated test scheme to establish a reliability model of aerospace electrical connectors under different temperature and vibration stresses [6]. Qin studied the influence of the variation of environments and working conditions on the reliability of electronic system and proposed a system reliability evaluation method [7]. Li established the relationship between the reliability of harmonic driver and working conditions (including load and speed) by using the accelerated life test [8]. Ren presented a bathtub curve model, which included wear failure period and early failure period and analyzed the lasting time of early failure period of NC machine tools with minimal repair [9]. Zhou implemented the reliability assessment process of abrasion units and overloading units using Bayesian methods [10]. It can be deduced from the above studies that the worse the working conditions are, the shorter the testing period is. In other words, the better the working conditions are, the longer the test period is. Learning from [11], the scale parameter and MTBFs under the different covariate levels are different. And the more different the covariate level is, the more different the scale parameter and MTBFs are. Consequently, in determining the reliability test period of NC machine tools, not only the historical failure data but also the corresponding working conditions should be considered. The ignorance of working conditions may lead to inaccurate test period in [1].
Aiming at the above problem, according to the method in [1], the change rate of MTBF interval estimation of NC machine tools is also used as criterion to determine the testing period. Based on the historical failure data and the corresponding working condition of the NC machine tools, the reliability model of NC machine tools is obtained by the Cox proportional hazards model. The point estimations of the model’s parameters are obtained by the twostep estimation method. The Bootstrap resamples are obtained by the Bootstrap resampling method. The parameters of the baseline failure rate function and the coefficients of working condition covariates are estimated simultaneously by maximum likelihood method, and then interval estimations of MTBF under each covariate are obtained. The change rate models of MTBF interval estimation under each covariate level are established by Power function, and the testing periods under each covariate are obtained. Finally, the case study indicates the proposed method is feasible.
2. Reliability Model of NC Machine Tools Considering Working Conditions
For convenience, the failure rate function of NC machine tools under working condition Z in [11] is rewritten aswhere is a vector of working condition covariates (for example, cutting force, number of tool changes, and vibration) which affects the failure rate of NC machine tools and is the baseline working condition covariate which is selected from . is the vector of ’s coefficients, which reflects the covariates’ influences on the failure rate function. is the shape parameter under and ; is the scale parameter under and .
Then the reliability function of NC machine tools under working conditions can be written as follows:
Then, the probability distribution function (PDF) of NC machine tools under working conditions can be written as follows:
Then, the MTBF of NC machine tools under covariate is obtained bywhere is Gamma function.
, , , and , which are the estimations of parameters , , , and coefficients , are obtained by the twostep estimation method in [11]. And the covariates which have no effects on the reliability of NC machine tools are eliminated by the likelihood ratio test in [11]. , which is the scale parameter of NC machine tools under covariate , are obtained by (5) written in [11].
Then, of NC machine tools under working conditions covariate is expressed as
3. Design of Reliability Testing Period
Step 1. The historical failure data and the corresponding working conditions of the NC machine tools to be tested are collected and used to establish the reliability model of NC machine tools considering working conditions in (1). The point estimations , , , and of parameters , , , and coefficients of the reliability model are calculated by the twostep estimation method in [11]. And then the point estimations of of the NC machine tools under are obtained by (6).
Step 2. A testing period T is set. A Bootstrap resampling is obtained by the Bootstrap resampling method [12] based on the point estimations , , , and obtained in Step 1.
Step 3. The working condition covariates in (1) that have no effects on the reliability of NC machine tools are eliminated by the twostep estimation method and the likelihood ratio test in [11]. Thus, the parameters , , and the coefficient are not calculated by the twostep estimation method but calculated simultaneously by the maximum likelihood method.
The maximum likelihood function of NC machine tools for the Bootstrap resampling sample is given aswhere r is the number of failure data. n is the sum of failure data and timing censored data. is the ith working condition covariate.
Substituting (2) and (3) into (7), the likelihood function is obtained asTaking the logarithm of both sides in (8), then Taking the partial derivatives of the parameters , , and in (9), respectively, thenBecause (10), (11), and (12) have no analytical solutions, NewtonRaphson numerical algorithm is used to estimate parameters , , and .
of the NC machine tools under the baseline working condition covariate Z_{1} are obtained by (4).
of the NC machine tools under the working condition covariates are obtained by (5) and rewritten as of the NC machine tools under the working condition covariate are obtained by (6) and rewritten as
Step 4. B resampling samples are obtained by Bootstrap resampling method based on , , , which are obtained in Step 1. The point estimation of MTBF under for each Bootstrap resampling are calculated by Step 2 to Step 3 and expressed as , , .
Step 5. , , under covariate obtained by Step 4 are arranged in ascending order, and then new sequences are gotten as follows:
Step 6. Set confidence level 1. Solve and round and , respectively. Then two quantiles and of each of the q sequences in Step 5 are selected as the upper limit and lower limit of MTBF interval estimation under covariate . The MTBF interval estimations of NC machine under covariate are expressed as
Step 7. Set testing periods. . The MTBF interval estimations of NC machine tools under covariate for each testing period () are obtained by Step 2 to Step 6 and expressed as
Step 8. q curves, which are to be fitted, respectively, to l lower limits , (), are obtained by Matlab Cftool and expressed as where is the ith working condition covariate. Low is the lower limits of interval estimations. is the curve fitting function of lower limits under working condition covariate .
In the same way, the curves, which are to be fitted, respectively, to the upper limits of MTBF interval estimations, , (), are also obtained by Matlab Cftool and expressed aswhere is the ith working condition covariate. Up is the upper limits of interval estimations. is the curve fitting function of upper limits under working condition covariate .
And then, the fitting functions of MTBF interval estimations of NC machine tools under covariate can be obtained from (18) to (19) and expressed aswhere the variables are the same as those of (18) and (19).
Step 9. Change rates of MTBF interval estimation under covariate are obtained by taking the derivative of (20) and expressedwhere the variables are the same as those of (20).
Learning from [1], are also taken as the criterion that determines how long testing period of reliability assessment is. Suppose is the change rate of MTBF interval estimation required before the reliability assessment test; then the testing period under covariate must be determined by
Step 10. In order to test (18) and (19), tests of goodnessoffit are made [13].
Suppose referred to as the sample value is upper limit or lower limit of MTBF interval estimation obtained by the Bootstrap resampling. is the average of . Suppose referred to as theoretical value of fitting is the upper limit or lower limit of MTBF interval estimation obtained by the curves fitting. The error quadratic sum of is expressed asThe mean square error of is expressed as The R square is calculated bywhere represents the degree of nonlinear correlation between and . The range of is . When is closer to 1, the nonlinear correlation is better. when is closer to 0, the nonlinear correlation is worse.
4. Case Study
Suppose the NC machine tools in [11] have been improved by the manufacturer several years later, and the reliability of the improved NC machine tool will be evaluated. Thus, the testing data of NC machine in [11] can be regarded as the history fault information of the improved NC machine tools, which are used to determine the reliability testing period of the improved NC machine tools before the test by the proposed method.
The point estimations of reliability parameters (such as shape, scale, and MTBF) of the NC machine tools under each covariate are obtained by Step 1 and listed in Table 1. And for comparison, the point estimations of reliability parameters (such as shape, scale, and MTBF) of the NC machine tools obtained by the method without considering covariates in [1] are also listed in Table 1.

Based on the point estimate of the reliability parameter in Table 1, the reliability test periods of the improved NC machine tool are designed by the proposed method in this paper. Then the upper limits and lower limits of MTBF interval estimations under covariate of each Bootstrap resampling for testing period T are obtained by Step 2 to Step 7. The upper limits of interval estimations of MTBF under different covariate are shown in Figures 1(a) and 1(b), while the lower limits of interval estimations of MTBF under different covariate are shown in Figures 2(a) and 2(b). In order to facilitate comparison, the coordinates in Figures 1(a), 1(b), 2(a), and 2(b) are normalized. In other words, the lower limits or upper limits of MTBF interval estimations under each covariate are divided by the MTBF of NC machine tools under corresponding covariates in Figures 1(a), 1(b), 2(a), and 2(b). The upper limits and lower limits of MTBF interval estimations obtained by the method in [1] are also shown in Figures 1(a) and 2(a), respectively.
(a) Upper limit of interval estimations of MTBF under different covariate
(b) Upper limit of interval estimations of MTBF under different covariate
(a) Lower limit of interval estimations of MTBF under different covariate
(b) Lower limit of interval estimations of MTBF under different covariate
The curves fitted to the lower limits or upper limits of MTBF interval estimations under each covariate are calculated by Step 8 and shown in Table 2. The curves fitted to the lower limits or upper limits of MTBF interval estimations are obtained by the method in [1] and also shown in Table 2. are calculated by Step 10 and listed in Table 2.

The change rates of MTBF interval estimation of NC machine tools under covariate are obtained by Step 9 based on Table 2 and shown in Figures 3(a) and 3(b). The change rates of MTBF interval estimation of NC machine tools are also obtained by the method in [1] and shown in Figures 3(a) and 3(b). Figure 3(b) is the enlargement of H part in Figure 3(a).
(a) The change rate of MTBF interval estimation under different covariates
(b) Partial enlarged view of H part in Figure 3(a)
The testing periods of NC machine tools under different covariates are listed in Table 3 and Figure 4. The testing period of NC machine tools obtained by the method in [1] is also listed in Table 3 and Figure 4. The fourth column in Table 3 is equal to the third column times the MTBF of the NC machine tools under the corresponding covariate. For comparison, the testing period of 982 hours obtained by the method in [1] is used as the benchmark; the fifth column is equal to the fourth column minus 982 hours.

Set Q_{MTBF}=0.2; learning from the third column in Table 3, the testing periods obtained by the proposed method and by the method in [1] are all between 1.5 times of MTBF and 1.6 times of MTBF, and their difference is very little. However, when the unit of the test period of NC machine tools is converted from MTBF multiple to hour, the test period of NC machine tools will be significantly different, which is shown as the fourth column in Table 3. From the fourth column or fifth column in Table 3, when the testing period of 982 hours of NC machine tools obtained by the method in [1] is used as the benchmark, the testing periods of NC machine tools under some covariate level are very different from the benchmark. For example, when Fc = 1.03 and Nh = 14, the testing period of NC machine tools is 419 hours shorter than the benchmark. When Fc=0.35, Nh=2, the testing period of NC machine tools is 645 hours longer than the benchmark. When Fc=1.03, Nh=14, the testing period of NC machine tools is 1064 hours longer than that of NC machine tools under Fc=0.35, Nh=2. It can be deduced from the above analyses that the test periods obtained by the proposed method are quite different from the results obtained by the method in [1].
5. Conclusions
The same NC machine tools under different covariates may have different testing periods, when the same criterion for determining the testing period is set. However, the existing methods including that in [1] do not consider the impacts of working conditions covariates on the testing period. Considering this problem, the authors propose a new method to determine the testing period considering working conditions. The proportional hazards model is used to establish reliability model of NC machine tools. The twostep estimation method is used to estimate the parameters of baseline failure function and the coefficients of working conditions. The Bootstrap resamples are obtained by the Bootstrap resampling method. The parameters of baseline failure function and the coefficients of working conditions are estimated simultaneously by maximum likelihood estimation. The Power function is used to establish the change rate function of MTBF interval estimation. The result of the case study indicates that the testing periods under different covariates obtained by the proposed method are quite different from that obtained by the method without considering working conditions covariates. Therefore, the working conditions should not be ignored when the testing period is determined.
Data Availability
The data used to support the findings of this study are included within the article.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Acknowledgments
Research in this paper was supported by Jilin Provincial Education Department of Research on Reliability Modeling and Evaluation Technology of NC Equipment under Variable Environment or Conditions [Grant no. JJKH20180327KJ] and the Science and Technology Bureau of Jilin City [Grant no. 2013121010].
References
 H. Z. Li, Z. J. Yang, and B. B. Xu, “Design of testing period for reliability assessment of NC machine tools,” Journal of Jilin University (Engineering and Technology), vol. 9, pp. 1521–1527, 2016. View at: Google Scholar
 S. W. McKane, L. A. Escobar, and W. Q. Meeker, “Sample size and number of failure requirements for demonstration tests with loglocationscale distributions and failure censoring,” Technometrics. A Journal of Statistics for the Physical, Chemical and Engineering Sciences, vol. 47, no. 2, pp. 182–190, 2005. View at: Publisher Site  Google Scholar  MathSciNet
 J. He, H.Z. Zhao, and Q. Fu, “Interval estimation and sample size calculation for ATR algorithm classification accuracy,” Systems Engineering and Electronics, vol. 29, no. 7, pp. 1021–1026, 2007. View at: Google Scholar
 H. R. Guo and R. Pan, “On determining sample size and testing duration of repairable system test,” in Proceedings of the 2008 Annual Reliability and Maintainability Symposium, pp. 120–125, IEEE Computer Society, Washing DC, USA, 2008. View at: Google Scholar
 H. Guo, Study on the intensifying factor of reliability test on automotive proving ground, Zhenjiang University, Hangzhou, China, 2003.
 W. H. Chen and H. S. Li, “Accelerated life test and statistical analysis of aerospace electrical connectors under multiple environment stresses,” Journal of Zhenjiang University, vol. 40, no. 2, pp. 348–351, 2006. View at: Google Scholar
 Q. N. Tan, X. Y. Wei, Z. W. Huang, and Y. F. Meng, “Reliablity evaluation method of electronic system under variable environments and working conditions,” Journal of Central South University (Science and Technology), vol. 44, no. 8, pp. 3254–3260, 2013. View at: Google Scholar
 J.Y. Li, J.X. Wang, G.W. Zhou, W. Pu, and Z.H. Wang, “Accelerated life testing of harmonic driver in space lubrication,” Proceedings of the Institution of Mechanical Engineers, Part J: Journal of Engineering Tribology, vol. 229, no. 12, pp. 1491–1502, 2015. View at: Publisher Site  Google Scholar
 L. N. Ren, R. Z. Yuan, J. Liu, and C. L. Lei, “Whole lifecycle reliability assessment of multiple NC machine tools with minimal repair,” Journal of Shanghai Jiao Tong University, vol. 49, no. 1, pp. 19–23, 2015. View at: Google Scholar
 X. Z. Zhou, Research on Reliability Assessment Based on Bayesian Methods, Huazhong University of Science and Technology, Wuhan, China, 2007.
 H. Z. Li, Z. J. Yang, B. B. Xu, C. H. Chen, Y. N. Kan, and G. F. Liu, “Reliability evaluation of NC machine tools considering working condtions,” in Mathematical Problems in Engineering, pp. 1–11, 2016. View at: Google Scholar
 A. M. Zoubir and D. R. Iskandler, “Bootstrap methods and applications,” IEEE Signal Processing Magazine, vol. 24, no. 4, pp. 10–19, 2007. View at: Google Scholar
 Y. Han and L. C. Han, General Theory of Statistics, Beijing University Press, Beijing, China, 2012.
Copyright
Copyright © 2018 Li Hongzhou and Sun Lixia. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.