Research Article  Open Access
Risk Prediction of OneYear Mortality in Patients with Cardiac Arrhythmias Using Random Survival Forest
Abstract
Existing models for predicting mortality based on traditional Cox proportional hazard approach (CPH) often have low prediction accuracy. This paper aims to develop a clinical risk model with good accuracy for predicting 1year mortality in cardiac arrhythmias patients using random survival forest (RSF), a robust approach for survival analysis. 10,488 cardiac arrhythmias patients available in the public MIMIC II clinical database were investigated, with 3,452 deaths occurring within 1year followups. Forty risk factors including demographics and clinical and laboratory information and antiarrhythmic agents were analyzed as potential predictors of allcause mortality. RSF was adopted to build a comprehensive survival model and a simplified risk model composed of 14 top risk factors. The built comprehensive model achieved a prediction accuracy of 0.81 measured by cstatistic with 10fold cross validation. The simplified risk model also achieved a good accuracy of 0.799. Both results outperformed traditional CPH (which achieved a cstatistic of 0.733 for the comprehensive model and 0.718 for the simplified model). Moreover, various factors are observed to have nonlinear impact on cardiac arrhythmias prognosis. As a result, RSF based model which took nonlinearity into account significantly outperformed traditional Cox proportional hazard model and has great potential to be a more effective approach for survival analysis.
1. Introduction
Cardiac arrhythmias are defined as a group of conditions in which the electrical activity of the heart is irregular or faster or slower than normal [1]. Some arrhythmias are lifethreatening and would result in sudden cardiac death if not treated in time. It is one of the most common causes of death when travelling to a hospital. A major challenge in the management of arrhythmias in hospital is the availability of reliable prognostic models that enable patients and physicians to have a realistic expectation of prognosis and to guide treatment options including medical treatment, use of devices, more intense monitoring, or endoflife care. In addition, getting insights into which factors relate to poor outcome may help the physicians adopt appropriate medical treatments.
Until now, several models for predicting different kinds of cardiovascular diseases outcome such as heart failure (HF) and coronary heart diseases have been developed using data from clinical trials or observational studies [2–6]. In addition, several risk models for mortality in community were reviewed by Kwok et al. in [7]. However, researches on morality prediction for cardiac arrhythmias patients are still very rare as presented by Hinkle Jr. et al. [8]. In addition, most risk models presented above are based on multivariable Cox proportional hazard regression (CPH), which was proposed by Cox [9]. CPH is an intuitive and popular survival model by illustrating the importance of each variable and its relationship with a regression coefficient. However, proportional methods suffer from high variance and poor performance as demonstrated by Breiman [10, 11] as solving the model is very complex, especially for those involving multiple variables and further more nonlinear effects cannot be modeled. Fox example, considerable controversy is still unsettled regarding the precise association of body mass index (BMI) with prognosis. Even though BMI is often considered with poor survival in general population, some researchers such as Uretsky et al. have identified a possible obesity paradox among patients with heart disease in which increased body mass predicts better survival using univariate CPH [12]. The above results are biased due to a linear assumption between BMI and mortality and not considering the interaction between BMI and some other factors. Therefore, complex patterns about possible reverse causation in underweight individuals, including interactions with smoking and an unclear inflection point at which increasing body mass leads to increased risk, were noted by Adams, Flegal, and Fontaine et al. [13–15] through manually adding the interactions between BMI and other factors or subdivision of the population into different small groups. However, all of the methods mentioned above are from a subjective point of view. Random survival forests (RSF) modeling, a direct extension of random forest for survival analysis, is proposed by Ishwaran et al. [16] to handle the above difficulties by automatically assessing the complex effects and interactions among all variables from objective view, that is, following the inherent relationship between any factors and the predictive result. Ishwaran et al. also demonstrated that RSF has another advantage of insensitivity to noise brought by missing values or error data [16]. Thus, it has been used in several risk models for different kinds of diseases such as heart failure [17] by Hsich et al. and breast cancer [18] by Omurlu et al. The results show that the RSF model can identify complex interactions among multiple variables and performed better than traditional CPH model. Therefore, the aim of our study is to identify important risk factors and their complex effects on mortality and develop an available mortality risk model in cardiac arrhythmias patients using RSF.
2. Material and Methods
2.1. Study Population
Our study is based on the public MIMIC II (MultiParameter Intelligent Monitoring in Intensive Care) clinical database [19, 20], which contains comprehensive clinical data including results of laboratory tests, medications, ICD9 diagnoses, and more obtained from hospital medical information systems, for 32,536 ICU patients. The data were collected over a sevenyear period, beginning in 2001, from a variety of ICUs (medical, surgical, coronary care, and neonatal), in Boston’s Beth Israel Deaconess Medical Center (BIDMC). We defined the patients with cardiac arrhythmias according to ninth revision of the international classification of diseases (ICD9) adopted in the database with ICD9 of 427. We define the start point of each patient as the time of ICU admission and the end point as the death time in the hospital or 365 days after the start point. Using this approach, 10,488 patients with cardiac arrhythmias were extracted to establish the predictive model, during which 3,452 deaths occurred in hospital or after discharge over 1year followup period for each patient.
2.2. Study Variables
Potential clinical variables previously reported to be associated with mortality were evaluated in our study. The following 40 variables were assessed for prognostic value: demographics including age, sex, and BMI, clinical variables such as arrhythmias type (CA, VF, VT, AF, and other slow arrhythmias), valvular heart diseases, renal failure, and CHF, laboratory variables with missing value less than 20%, including glucose, NA, K, SCR, BUN, RBC, WBC, PT, PTT, INR, BR, AST, ALT, and CKPK, and antiarrhythmic agents including class I, class II, class III, class IV, and class V agents (as listed in Table 1). All of the clinical variables are binary and defined as 1 if the patient suffers from this disease at the admission time, otherwise defined as 0. The laboratory variables are realvalued numbers measured at the admission time to the ICU and the measurement scales for all variables are presented in Table 1. The medication was defined as 1 if the patient was prescribed with and took this kind of medications during the ICU stay.

2.3. Statistical Analysis with Random Survival Forest
In our study, continuous variables such as age, BMI, SCR, and BUN were logtransformed before analysis to eliminate the tail effect brought by larger or smaller value. Random survival forest [16], a new extension of random forest for survival analysis, was implemented in our study to establish prediction models in the following ways:(1)B bootstrap samples are randomly extracted from the original dataset, with each bootstrap sample precluding an average 37% of the data, that is, outofbag data (OOB data). B is defined as 1000 in our study.(2)A survival tree is grown for each bootstrap sample to develop a comprehensive model composed of all 40 variables. 6 candidate variables are randomly selected for each node based on the rule defined in [16]. The candidate variable with the ability of maximizing the survival difference between child nodes is selected to split the node.(3)Every tree was grown to full size until each leaf node is with less than unique deaths. In our study, is set to be 3.(4)Select predictive variables by filtering on the basis of minimal depth, that is, the minimum distance from the trunk to the branch level of the nearest maximum subtree, which is the largest subtree whose root node splits on the variable. The smaller the minimal depth is, the more impact the variable has on prediction.(5)Construct a simplified survival forest of 1000 survival trees based on the predictive variables selected above to get an optimized model with fewer variables.(6)The cumulative hazard function for each terminal node in a grown tree is estimated by NelsonAalen estimator [21]. Drop each case in the validation dataset down the grown tree; its cumulative hazard function is the NelsonAalen estimator [21] for the case’s falling terminal node. The individual hazards are then averaged to compute the cumulative hazard function for each tree. The ensemble cumulative hazard function is then obtained by averaging the cumulative hazard functions for all of the grown trees. NelsonAalen estimator was also used for comparison between estimated and real cumulative hazard functions for the validation dataset.(7)Prediction error is calculated based on Harrell cstatistics [22] for the ensemble cumulative hazard function, with the value being the error rate for the ensemble computed using the first trees. The method to calculate variable importance (VIMP) for a variable is presented in [16].To demonstrate the effectiveness of the RSF based models, Cox proportional hazards models were then used for comparing and evaluating the basic association between potential risk factors and mortality [23], with Wald tests for significance testing. Cross validation [24] was employed to validate the proposed models. In fold cross validation, the original dataset is randomly divided into equalsize subsets with a single subset as the validation dataset and the remaining subsets as the training datasets. The cross validation process is repeated times. The results from the processes are averaged to produce a single estimation. As 10fold cross validation is commonly used in most of situations, it was also used in our study to optimize the prediction performance.
All analyses were carried out with R version 3.0.1. RSF was implemented based on the “RandomSurvivalForest” package, which can be accessed from the public R software packages freely.
2.4. Baseline Characteristics of the Study Cohort
The baseline characteristics of alive and dead patients one year after presenting cardiac arrhythmias of the study cohort are shown in Table 1. During a followup of 1 year for each patient, 3452 individuals died, while 7036 were censored. The mean age for those who died within one year was 75.32 ± 12.84 and 71.94 ± 23.6 for patients that remained alive. From Table 1 we can see that demographics and clinical risk factors such as age, BMI, CA, slow arrhythmias, CHF, and stroke were significantly different between alive and dead patients. All laboratory results were also significantly different between alive and dead patients. With the exception of class V agents, all antiarrhythmic agents were significantly different between alive and dead patients.
3. Results
3.1. Model Validation
To validate the performance of proposed risk models, prediction ability in terms of cstatistic with 10fold cross validation was used in our study. The cstatistics for different models (comprehensive model versus simplified model) with different methods (RSF versus CPH) are presented in Table 2. From the table we can see that the RSF can improve the discrimination ability greatly for both comprehensive model and simplified model with high significance level (cstatistic of 0.81 versus 0.733 for comprehensive model and 0.799 versus 0.718 for simplified model with 10fold cross validation). In addition, the proposed simplified model can realize good predictive accuracy with limited variables based on a cstatistic of 0.799.

3.2. Comprehensive Risk Model Predicting 1Year Mortality with RSF
From the comprehensive RSF analysis with all 40 variables, 14 variables were selected to be predictive for 1year mortality, including cardiac arrest, BUN, BMI, AST, age, SCR, BR, K, WBC, ALT, NA, CKPK, class II agents, and glucose (the detailed minimal depths of all variables can be seen from Figure 1, in which 14 predictive variables were separated from the remaining nonpredictive variables by the horizontal line). The 6 variables on the extreme left including cardiac arrest, BUN, BMI, AST, age, and SCR are easily seen to be the most predictive variables.
3.3. Simplified Model Development for Clinical Application
In order to improve the availability of the proposed model, we reduced the comprehensive models to include the most important 14 risk factors selected from the comprehensive RSF analysis and developed a simplified model. The error rates for ensemble cumulative hazard function and VIMP for predictors are presented in Figure 2 with an estimated cstatistic of 0.799 (the detailed method for calculating prediction error and VIMP is presented in Section 2). Figure 3 gives the correlation between ensemble survival function and nonparametric NelsonAalen estimator, which is an alternative estimator for KaplanMeier. From the figure we can see that the ensemble survival function is very close to the curve with NelsonAalen estimator (, ). In other words, the estimated survival function using RSF basically conforms to the real survival curve.
(a)
(b)
3.4. Risk Model Predicting 1Year Mortality with CPH
As presented in Section 2.3, we also use traditional CPH for comparison to demonstrate the effectiveness of the proposed RSF model. After multivariable CPH analysis with all 40 predictors, the following 23 risk factors presented in Table 3 were found to be independent significant predictors for mortality, during which the first 6 important predictors with highest absolute BC coefficient were decreasing K, decreasing BMI, cardiac arrest, class III agents, increasing age, and BUN. The predictive accuracy of the model was reasonable, with a cstatistic of 0.733 using 10fold cross validation. These variables are a bit different from RSF based model as the RSF identified the nonlinear effect of the continuous variables on the mortality, which will be discussed in Section 4.
 
HR: hazard ratio; CI: confidence level; log indicates log of variables. 
4. Discussion
4.1. Complex Patterns and Interactions Identified Using RSF
Figure 4 shows the marginal effect of a given continuous variable on the 1year mortality from RSF analysis. From the figure we can see that the association between the continuous variables like BMI, BR, AST, SCR, and NA and 1year mortality is nonlinear. Figure 5 displays how the RSF model shows interaction among the 3 most important continuous variables including BUN, AST, and BMI and 1year predicted mortality. Patients with the highest BUN and AST have the largest mortality and most have low BMI. Oneyear predicted mortality increased sharply with the elevation of BUN, with about 15% for those with a BUN below 20 mg/dL and nearly 50% for those with a BUN above 58 mg/dL. The mortality rate depends more on AST than BMI for patients with lower BUN, while more on BMI for those with higher BUN. The above mentioned interactions and nonlinear relationships were not prespecified by the analyst but identified by the forest. That is why the RSF has a better discrimination ability than CPH with the error rate (1cstatistic) of 19% (the details about estimated error rate according to different grown trees can be seen from Figure 6).
From the above analysis we can see that RSF has the advantage of automatically identifying the nonlinear effect and complex interactions among multiple variables, using plots such as those shown in Figures 4 and 5. Therefore, RSF can improve the accuracy greatly compared to standard methodologies (cstatistic of 0.81 versus 0.733 for comprehensive model and 0.799 versus 0.718 for simplified model using 10fold cross validation), especially for a model with many continuous variables that have nonlinear effects on the predictive result. However, RSF is limited in identifying predictors with small number of population, that is, class III agents, due to its insensibility of noise. Therefore, a more comprehensive survival model will be developed in the future.
4.2. Comprehensive Risk Model versus Simplified Model
The comprehensive risk model, which is built with demographics and clinical and laboratory risk factors and antiarrhythmic agents, has advantage in discrimination ability with cstatistic of 0.81 using RSF and 0.733 using CPH. However, too many variables would influence the efficiency and result of the fitting process using mathematical models and thus lead to an unstable performance for the prediction model. Therefore, an optimized model that can balance the discrimination ability and cost is very important for its availability. The proposed simplified model can be used to derive a prognostic score and to estimate the risk of death with good accuracy (cstatistic of 0.799 with 10fold cross validation) using only 14 risk factors and thus has great potential to be an optimized risk model in a reallife cohort of ICU patients with cardiac arrhythmias.
4.3. Risk Factors for Mortality in Patients with Cardiac Arrhythmias
RSF identified cardiac arrest, BUN, BMI, AST, age, SCR, BR, K, WBC, ALT, NA, CKPK, class II agents, and glucose as the 14 predictive factors of survival in the cohort of 10,488 ICU patients with cardiac arrhythmias. These variables are a bit different from what was found in traditional Cox proportional hazard model analysis, by which SCR and NA are not significant predictors. In fact, both predictors exact nonlinear effects on mortality from the RSF analysis.
For predictors including BR, AST, SCR, and NA, both smaller and larger values for the variables would induce high mortality and the same with other continuous predictors such as ALT, K, and CKPK. It can be easily understood that there is a normal range for every laboratory test, too high and too low mean different kinds of abnormal status. For example, normal serum NA levels are between approximately 135 and 145 mEq/L. A serum level of less than 135 mEq/L is generally defined as hyponatremia while it is defined as hypernatremia for more than 145 mEq/L. It is demonstrated [25] that the lower the NA level, the higher the risk for the mortality. Values above 180 mEq/L are demonstrated to be associated with a high mortality rate, particularly in adults [26]. In addition, we found that the mortality would increase sharply with the elevation of BUN. It was also demonstrated that elevation BUN is independent predictive for longterm mortality [27] and subsequent mortality in patients with acute coronary syndromes [28].
Predictor BMI exacts complex impact on cardiac arrhythmias mortality. From its marginal effect on mortality presented in Figure 4, we can find that mortality decreases in a tiny amplitude with an elevation of BMI at lower BMI, and then with a sharp increase while close to an approximate point of 25 kg/m^{2}, after which mortality begins to sharply decrease. It was also demonstrated [29] that, compared to normal weight (BMI 18–24.9), underweight () was associated with increased risk of death while overweight (BMI 25–29.9) leads to significantly decreased risk. Interestingly, this pattern is highly dependent on BUN levels from their interaction analysis (as presented in Figure 5). For BUN values smaller than 20 mg/dL, significantly healthy renal function, the inflection point pattern is much straighter (subplots on the extreme top side) and becomes sharper and sharper with the elevation of BUN level (subplots from top to bottom). These results validate and add strength to the findings by Ishwaran et al. [16] using a more important renal function index BUN rather than creatinine clearance that the relationship of low BMI with high mortality depends on renal function, and this phenomenon disappeared while the renal function improved. In other words, high mortality rate in patients with low BMI may not due to underweight, but due to the weight loss accompanied with renal disease.
During five arrhythmias types, cardiac arrest is identified as the most important predictor leading to mortality with both methods. It is well known that unexpected cardiac arrest can lead to death within minutes: this is called sudden cardiac death (SCD). It was also demonstrated in [30] that sudden cardiac arrest exacts a significant mortality with a survival rate of only 2%. However, ventricular fibrillation, which is considered as one of the most emergency arrhythmias and responsible for nearly 50% of all causes of outofhospital cardiac arrests, is not identified as a predictive variable in our models, perhaps because moderate ventricular fibrillation is reversible if treated in time for ICU patients. It is also demonstrated [31] that if patients with in hospital VF were defibrillated early the survival could be very high.
During five classes of antiarrhythmic agents, class II agents are identified as the most prevalent medications in arrhythmias patients (nearly 75%) and most effective on prolonging survival times. Even though class I agents are not identified as predictive in RSF analysis, they would reduce survival rate in a certain degree from CPH based model. This finding validates the results reported by Echt et al. [32], in which class I agents were found to increase mortality instead of lowering it after myocardial infarction. That is why class I agents are least used medications (approximately 2% in the database).
5. Conclusion
In this paper, we developed a prognostic model that combines demographics and clinical and laboratory risk factors and antiarrhythmic agents for predicting the mortality of ICU patients with cardiac arrhythmias using random survival forest. The RSF model showed a much better separation of 1year survivors and nonsurvivors with a cstatistic of 0.81 using 10fold cross validation, compared with 0.733 using conventional CPH. In addition, a simplified model was built based on the most important 14 risk factors and thus presented to be more applicable in reallife cohort, showing good separation with cstatistic of 0.799 with RSF and 0.718 with CPH. Moreover, several variables that exact nonlinear effects on mortality and with interaction were automatically identified with RSF. Therefore, RSF has been demonstrated to be a potential effective approach for survival analysis.
The major limitation of our study is that we have not validated our models in external cohorts; nevertheless, the replicability of the result should be sufficient with 10fold cross validation method. In addition, due to incomplete data, some potential predictors, such as triglyceride (TG) and total cholesterol (TC), were not included in the proposed model. More comprehensive model can be developed by adding these potential predictors with potentially better discrimination performance.
List of Abbreviations
CA:  Cardiac arrest 
VF:  Ventricular fibrillation 
AF:  Atrial fibrillation 
VT:  Ventricular tachycardia 
K:  Potassium [mEq/L] in blood 
NA:  Sodium [mEq/L] in blood 
WBC:  Leukocytes [K/μL] in blood 
RBC:  Erythrocytes [m/μL] in blood 
SCR:  Creatinine [mg/dL] in serum or plasma 
BUN:  Urea nitrogen [mg/dL] in serum or plasma 
CKPK:  Creatine kinase [IU/L] in serum or plasma 
AST:  Aspartate aminotransferase [IU/L] in serum or plasma 
ALT:  Alanine aminotransferase [IU/L] in serum or plasma 
PT:  Prothrombin time (seconds) in blood by coagulation assay 
PTT:  Activated partial thromboplastin time (seconds) in blood by coagulation assay 
INR:  International normalized ratio in blood by coagulation assay 
Glucose:  Glucose [mg/dL] in blood 
BR:  Total bilirubin [mg/dL] in serum or plasma 
BMI:  Body mass index (kg/m^{2}) 
CHF:  Congestive heart failure 
RSF:  Random survival forest 
CPH:  Cox proportional hazard model. 
Conflict of Interests
The authors declare that they have no conflict of interests.
Acknowledgments
This work was supported in part by the National Natural Science Foundation of China (no. 61379136), 863 Program (SS2015AA02010), Shenzhen Innovation Funding for Advance Talents (KQCX20130628112914291), the Basic Research Program of Shenzhen (no. JCYJ20130401170306884), and the External Cooperation Program of the Chinese Academy of Sciences (GJHZ1212).
References
 W. J. Mandel, Ed., Cardiac Arrhythmias: Their Mechanisms, Diagnosis, and Management, Lippincott Williams & Wilkins, 3rd edition, 1995.
 W. C. Levy, D. Mozaffarian, D. T. Linker et al., “The Seattle Heart Failure Model prediction of survival in heart failure,” Circulation, vol. 113, no. 11, pp. 1424–1433, 2006. View at: Publisher Site  Google Scholar
 R. Vazquez, A. BayesGenis, I. Cygankiewicz et al., “The MUSIC Risk score: a simple method for predicting mortality in ambulatory patients with chronic heart failure,” European Heart Journal, vol. 30, no. 9, pp. 1088–1096, 2009. View at: Publisher Site  Google Scholar
 L. Manzano, D. Babalis, M. Roughton et al., “Predictors of clinical outcomes in elderly patients with heart failure,” European Journal of Heart Failure, vol. 13, no. 5, pp. 528–536, 2011. View at: Publisher Site  Google Scholar
 M. Senni, P. Parrella, R. De Maria et al., “Predicting heart failure outcome from cardiac and comorbid conditions: the 3CHF score,” International Journal of Cardiology, vol. 163, no. 2, pp. 206–211, 2013. View at: Publisher Site  Google Scholar
 S. J. Pocock, C. A. Ariti, J. J. V. McMurray et al., “Predicting survival in heart failure: a risk score based on 39 372 patients from 30 studies,” European Heart Journal, vol. 34, no. 19, pp. 1404–1413, 2013. View at: Publisher Site  Google Scholar
 C. S. Kwok, Y. K. Loke, K. Woo, and P. K. Myint, “Risk prediction models for mortality in communityacquired pneumonia: a systematic review,” BioMed Research International, vol. 2013, Article ID 504136, 12 pages, 2013. View at: Publisher Site  Google Scholar
 L. E. Hinkle , H. T. Thaler, D. P. Merke, D. RenierBerg, and N. E. Morton, “The risk factors for arrhythmic death in a sample of men followed for 20 years,” American Journal of Epidemiology, vol. 127, no. 3, pp. 500–515, 1988. View at: Google Scholar
 D. R. Cox, “Regression models and lifetables,” Journal of the Royal Statistical Society. Series B. Methodological, vol. 34, no. 2, pp. 187–220, 1972. View at: Google Scholar  MathSciNet
 L. Breiman, “Bagging predictors,” Machine Learning, vol. 24, no. 2, pp. 123–140, 1996. View at: Google Scholar  Zentralblatt MATH
 L. Breiman, “Heuristics of instability and stabilization in model selection,” The Annals of Statistics, vol. 24, no. 6, pp. 2350–2383, 1996. View at: Publisher Site  Google Scholar  Zentralblatt MATH  MathSciNet
 S. Uretsky, F. H. Messerli, S. Bangalore et al., “Obesity paradox in patients with hypertension and coronary artery disease,” American Journal of Medicine, vol. 120, no. 10, pp. 863–870, 2007. View at: Publisher Site  Google Scholar
 K. F. Adams, A. Schatzkin, T. B. Harris et al., “Overweight, obesity, and mortality in a large prospective cohort of persons 50 to 71 years old,” The New England Journal of Medicine, vol. 355, no. 8, pp. 763–778, 2006. View at: Publisher Site  Google Scholar
 K. M. Flegal, B. I. Graubard, D. F. Williamson, and M. H. Gail, “Causespecific excess deaths associated with underweight, overweight, and obesity,” The Journal of the American Medical Association, vol. 298, no. 17, pp. 2028–2037, 2007. View at: Publisher Site  Google Scholar
 K. R. Fontaine, D. T. Redden, C. Wang, A. O. Westfall, and D. B. Allison, “Years of life lost due to obesity,” Journal of the American Medical Association, vol. 289, no. 2, pp. 187–193, 2003. View at: Publisher Site  Google Scholar
 H. Ishwaran, U. B. Kogalur, E. H. Blackstone, and M. S. Lauer, “Random survival forests,” The Annals of Applied Statistics, vol. 2, no. 3, pp. 841–860, 2008. View at: Publisher Site  Google Scholar  MathSciNet
 E. Hsich, E. Z. Gorodeski, E. H. Blackstone, H. Ishwaran, and M. S. Lauer, “Identifying important risk factors for survival in patient with systolic heart failure using random survival forests,” Circulation: Cardiovascular Quality and Outcomes, vol. 4, no. 1, pp. 39–45, 2011. View at: Publisher Site  Google Scholar
 I. K. Omurlu, M. Ture, and F. Tokatli, “The comparisons of random survival forests and Cox regression analysis with simulation and an application related to breast cancer,” Expert Systems with Applications, vol. 36, no. 4, pp. 8582–8588, 2009. View at: Publisher Site  Google Scholar
 M. Saeed, M. Villarroel, A. T. Reisner et al., “Multiparameter intelligent monitoring in intensive care II: a publicaccess intensive care unit database,” Critical Care Medicine, vol. 39, no. 5, pp. 952–960, 2011. View at: Publisher Site  Google Scholar
 A. L. Goldberger, L. A. N. Amaral, L. Glass et al., “PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals,” Circulation, vol. 101, no. 23, pp. e215–e220, 2000. View at: Publisher Site  Google Scholar
 E. A. Colosimo, F. F. Ferreira, M. D. Oliveira, and C. B. Sousa, “Empirical comparisons between KaplanMeier and NelsonAalen survival function estimators,” Journal of Statistical Computation and Simulation, vol. 72, no. 4, pp. 299–308, 2002. View at: Publisher Site  Google Scholar  MathSciNet
 H. Uno, T. Cai, M. J. Pencina, R. B. D'Agostino, and L. J. Wei, “On the Cstatistics for evaluating overall adequacy of risk prediction procedures with censored survival data,” Statistics in Medicine, vol. 30, no. 10, pp. 1105–1117, 2011. View at: Publisher Site  Google Scholar  MathSciNet
 E. W. Steyerberg, F. E. Harrell Jr., G. J. J. M. Borsboom, M. J. C. Eijkemans, Y. Vergouwe, and J. D. F. Habbema, “Internal validation of predictive models: efficiency of some procedures for logistic regression analysis,” Journal of Clinical Epidemiology, vol. 54, no. 8, pp. 774–781, 2001. View at: Publisher Site  Google Scholar
 R. Kohavi, “A study of crossvalidation and bootstrap for accuracy estimation and model selection,” in Proceedings of the International Joint Conference on Artificial Intelligence, vol. 14, pp. 1137–1145, 1995. View at: Google Scholar
 B. Murray, J. Stofan, and E. R. Eichner, “Hyponatremia in athletes,” Sports Science, vol. 88, p. 88, 2003. View at: Google Scholar
 Y. Ofran, D. Lavi, D. Opher, T. A. Weiss, and E. Elinav, “Fatal voluntary salt intake resulting in the highest ever documented sodium plasma level in adults (255 mmol L1): a disorder linked to female gender and psychiatric disorders,” Journal of Internal Medicine, vol. 256, no. 6, pp. 525–528, 2004. View at: Publisher Site  Google Scholar
 K. Beier, S. Eppanapally, H. S. Bazick et al., “Elevation of BUN is predictive of longterm mortality in critically ill patients independent of ‘normal’ creatinine,” Critical Care Medicine, vol. 39, no. 2, article 305, 2011. View at: Google Scholar
 A. J. Kirtane, D. M. Leder, S. S. Waikar et al., “Serum blood urea nitrogen as an independent marker of subsequent mortality among patients with acute coronary syndromes and normal to mildly reduced glomerular filtration rates,” Journal of the American College of Cardiology, vol. 45, no. 11, pp. 1781–1786, 2005. View at: Publisher Site  Google Scholar
 H. M. Orpana, J.M. Berthelot, M. S. Kaplan, D. H. Feeny, B. McFarland, and N. A. Ross, “BMI and mortality: results from a national longitudinal study of canadian adults,” Obesity, vol. 18, no. 1, pp. 214–218, 2010. View at: Publisher Site  Google Scholar
 B. M. Squibb and A. Trust, “National Institute for Health and Clinical Excellence,” 2012. View at: Google Scholar
 J. Herlitz, S. Aune, A. Bång et al., “Very high survival among patients defibrillated at an early stage after inhospital ventricular fibrillation on wards with and without monitoring facilities,” Resuscitation, vol. 66, no. 2, pp. 159–166, 2005. View at: Publisher Site  Google Scholar
 D. S. Echt, P. R. Liebson, L. B. Mitchell et al., “Mortality and morbidity in patients receiving encainide, flecainide, or placebo: the Cardiac Arrhythmia Suppression Trial,” The New England Journal of Medicine, vol. 324, no. 12, pp. 781–788, 1991. View at: Publisher Site  Google Scholar
Copyright
Copyright © 2015 Fen Miao et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.