APACHE IV Is Superior to MELD Scoring System in Predicting Prognosis in Patients after Orthotopic Liver Transplantation

Hu, Yueyun; Zhang, Xianling; Liu, Yuan; Yan, Jun; Li, Tiehua; Hu, Ailing

doi:https://doi.org/10.1155/2013/809847

Journal of Immunology Research

On this page

Abstract Background Methods Results Discussion References Copyright Related Articles

Special Issue

Immunological Aspect on Late Allograft Dysfunction

View this Special Issue

Clinical Study | Open Access

Volume 2013 | Article ID 809847 | https://doi.org/10.1155/2013/809847

APACHE IV Is Superior to MELD Scoring System in Predicting Prognosis in Patients after Orthotopic Liver Transplantation

Yueyun Hu,¹Xianling Zhang,¹Yuan Liu,¹Jun Yan,²Tiehua Li,¹and Ailing Hu¹

Academic Editor: Qiquan Sun

Received22 Jun 2013

Revised21 Oct 2013

Accepted23 Oct 2013

Published18 Nov 2013

Abstract

This study aims to compare the efficiency of APACHE IV with that of MELD scoring system for prediction of the risk of mortality risk after orthotopic liver transplantation (OLT). A retrospective cohort study was performed based on a total of 195 patients admitted to the ICU after orthotopic liver transplantation (OLT) between February 2006 and July 2009 in Guangzhou, China. APACHE IV and MELD scoring systems were used to predict the postoperative mortality after OLT. The area under the receiver operating characteristic curve (AUC) and the Hosmer-Lemeshow C statistic were used to assess the discrimination and calibration of APACHE IV and MELD, respectively. Twenty-seven patients died during hospitalization with a mortality rate of 13.8%. The mean scores of APACHE IV and MELD were 42.32 ± 21.95 and 18.09 ± 10.55, respectively, and APACHE IV showed better discrimination than MELD; the areas under the receiver operating characteristic curve for APACHE IV and MELD were 0.937 and 0.694 ( for both models), which indicated that the prognostic value of APACHE IV was relatively high. Both models were well-calibrated (The Hosmer-Lemeshow C statistics were 1.568 and 6.818 for APACHE IV and MELD, resp.; for both). The respective Youden indexes of APACHE IV, MELD, and combination of APACHE IV with MELD were 0.763, 0.430, and 0.545. The prognostic value of APACHE IV is high but still underestimates the overall hospital mortality, while the prognostic value of MELD is poor. The function of the APACHE IV is, thus, better than that of the MELD.

1. Background

Liver transplantation has become exclusive and feasible treatment for various end-stage liver diseases, including liver cirrhosis, acute liver failure and tumor [1]. Although liver transplantation is widely conducted, the mortality remains significantly high as much as 5%8% [2].

As there was no an objective and accurate evaluation tool available for prediction of the outcome for liver transplantation till now [3]. Acute physiology and chronic health evaluation (APACHE) is one of the most widely used and authoritative scoring system for evaluation of the severity and prognosis of critically ill diseases, including liver transplantation, and APACHE IV showed better predicting value against APACHE II and APACHE III [4].

The Model for End-Stage Liver Disease (MELD) as another important scoring system for prediction of the mortality of critical ill patients is a survival model. This model has been adopted for donor liver allocation systems in the United States in 2002 [5]. Additionally, MELD has been reported to be used for prediction of the outcome for liver transplantation [6].

Therefore, this aims to explore and compare the effects of APACHE IV, MELD and combination APACHE IV with MELD for predicting the mortality risk after orthotopic liver transplantation.

2. Methods and Patients

2.1. Patients

A retrospective cohort study was performed. At a liver transplant center in Guangzhou, a total of 195 patients admitted to the ICU after orthotopic liver transplantation (OLT) between February 2006 and July 2009 were included when meeting the inclusion criteria. The inclusion criteria included age > 18 years, patients with OLT for the first time, cadaveric donor (cardiac death) and brain-dead donor liver transplant patients, and patients who had been more than four hours in the ICU after OLT operation. Living donor liver transplantation, multiple organ transplantation, and previous organ transplantation were excluded.

2.2. Data Collection

The data were collected by the researchers independently, and double check was conducted. We recorded the data of the previous day if the data used to calculate the APACHE IV scores was missing, and we recorded the data of the first two days when the data of the previous day was missing.

The APACHE IV scoring system takes age, chronic health conditions, and the acute physiology score (APS) into account. The APS is based upon the worst measurement during the first 24 hrs in the ICU. The Glasgow Coma Scale (GCS) score, whether sedation or paralysis resulted in an inability to assess GCS, and Pao₂/Fio₂ were recorded as part of the data collection for APS. All the following were also recorded: ICU admission diagnoses; admission source; length of stay before ICU admission; whether a patient received mechanical ventilation on day 1, had emergency surgery, or was an ICU readmission; and whether a patient with acute myocardial infarction received thrombolytic therapy in the 24 hrs before or after ICU admission. These data were collected over the first 24 hrs of admission to the ICU and were entered into a computer-based APACHE IV calculator. The calculator returns values that include the APACHE score, predicted mortality rate, and predicted ICU length of stay.

The MELD score was determined prior to OLT using the following equation: where INR is international normalized ratio and creatinine and bilirubin are expressed in mg/dL. The values lie between 6 and 40, depending on the severity of the clinical conditions.

2.3. Statistical Analysis

The outcomes of all patients were presented by frequencies, percentages, mean values, and standard deviations. The correlation between the predicted and the actual ICU LOS was tested using the Spearman test, and the differences were tested using the Wilcoxon test. The discrimination and accuracy of APACHE IV and MELD to predict the early mortality of OLT patients were described by receiver operating characteristic curves (ROC) and the Hosmer-Lemeshow test. The discrimination of a prognostic model is defined as the ability to distinguish between survivors and nonsurvivors. The discrimination of APACHE IV and MELD to predict hospital mortality was analyzed by calculating the area under the receiver operating characteristic curves (AUC). An AUC of >0.9 was considered to be outstanding; 0.7 to 0.9, acceptable; 0.5 to 0.7, poor. The calibration of the model is the degree of agreement between the predicted mortality and actual mortality. The Hosmer-Lemeshow C statistic was used to determine the calibration of the model. A model with good calibration should have a Hosmer-Lemeshow statistic with degrees of freedom, approximately, equal to the number of categories minus 2 as well as a . Standardized mortality ratios (SMRs) were calculated by dividing the actual rates by the rates predicted by APACHE IV. The significance level was set at . All statistical analyses were performed using SPSS 13.0.

3. Results

This retrospective study included 195 adult patients, comprising 171 males and 24 females with an overall mean age of years, who were admitted to the ICU during the immediate OLT postoperative period. Twenty-seven died during hospitalization with a mortality rate of 13.8%; the overall mean APACHE IV and MELD scores were , and . The mean APACHE IV and MELD scores of nonsurvivors and survivors were versus and versus . The mean predicted hospital mortality rates of nonsurvivors and survivors were ()% and ()%, respectively (). The data was shown in Tables 1, 2, and 3.

The AUC of the APACHE IV and MELD predictions of mortality during hospitalization was 0.937 (95%CI, 0.892 to 0.981) and 0.694 (95%CI, 0.51 to 0.817), respectively; for both models. The two models were well-calibrated (with Hosmer-Lemeshow C statistics of 1.568 and 6.818 for APACHE IV and MELD, resp.; for both models). The data was shown in Figure 1.

The highest Youden index was 0.763 when the APACHE IV score was 55.5 at the cutoff value, demonstrating a specificity of 0.911, a sensitivity of 0.852, a positive predictive value (PPV) of 0.605, and a negative predictive value (NPV) of 0.975. The highest Youden index was 0.430 when the MELD score was 20.7 at the cutoff value, demonstrating a specificity of 0.726, a sensitivity of 0.704, a positive predictive value (PPV) of 0.292, and a negative predictive value (NPV) of 0.938. In the combination test, the predicted mortality rate was classified as a positive result when APACHE IV score ≥ 55.5, and MELD score ≥ 20.07. The data was shown in Table 4.

The median predicted ICU LOS of survivors was 3.21 (2.39, 4.82) days, and the median actual ICU LOS was 3.71 (2.38, 5.47). There was a relationship between the predicted ICU LOS and the actual ICU LOS (, ). Comparing the predicted ICU LOS to the actual ICU LOS of survivors, we noticed that the former was shorter than the latter (, ).

4. Discussion

The study put APACHE IV and MELD to evaluate their validity on posttransplantation of liver. We found that the AUC of APACHE IV was higher than that of MELD. We also demonstrated that nonsurvivors were higher in the mean APACHE IV score than survivors. Thus, our results may provide some guidance in the outcome judgment of patients after liver transplant.

Here, the hospital mortality was underestimated by using APACHE IV scoring system (SMR was 3.68, 95%CI: 2.38 to 4.96). In contrast to the original study by Zimmerman et al. [4],the SMR of 0.997 showed little difference between the predicted hospital mortality and the actual hospital mortality. Several reasons might account for this difference. First, our data might not be nationally representative because the collection was limited to patients who were admitted to the ICU after OLT. In addition, the recovery process of OLT patients was affected by the characteristics of the donors and the experience of the surgeons. At last, the different levels of ICUs may account for this discrepancy.

The ROC curves scoring system is used for predicting the sensitivity and specificity of death. The area under the receiver operating characteristic curve of APACHE IV was 0.937, however, higher than the value of 0.88 reported in the original study by Zimmerman et al. [4], suggesting that the APACHE IV score system has a good ability to distinguish possible nonsurvivors from survivors. This difference may be because the original data of Zimmerman for APACHE IV were derived mostly from integrated ICUs selected for complex diseases, while the subjects of this study were specific for ICU patients with OLT. The APACHE IV score was well-calibrated (Hosmer-Lemeshow was 1.568; ). In contrast, other studies reported poorly calibrated APACHE IV scores that overestimated hospital mortality in integrated ICUs [7, 8]. According to our study, the APACHE IV score had a better calibration when it was applied to specialized ICUs, such as OLT patients; this scoring system is sensitive to distinguish possible nonsurvivors from survivors. Comparing with data from integrated ICUs, the APACHE IV score showed better predictive validity in a specialized ICU, which has been demonstrated by Knaus [9]. These results suggested that the APACHE IV scoring system is more appropriate for prediction of the prognosis of patients in specialized ICUs than in the integrated ICUs.

The MELD score is based on 3 biochemical variables that are objective and easy to obtain, which are the international normalized ratio of prothrombin, serum creatinine, and serum bilirubin. Renal function is often recognized as a major determinant of patient survival and is given a heavy weight in MELD scoring system. In our study, the MELD score values in nonsurvivors () were higher than in survivors (), . This result showed that the MELD score can predict early outcomes of transplantation and, as previously reported, hospital mortality. The pretransplantation MELD scores were 15~25, and the mortality rate was 6.12% at the lowest level; at <15, the mortality rate was 8.08%, and at >25, the mortality rate was 34.04%, which was the highest among the groups. The selection of proper patients and timing for OLT is complex and depends on multiple factors, such as survival, morbidity, resource utilization, and quality of life. Our results suggested that patients with lower death risks were not suitable for liver transplantation; in such cases, the survival times may be short. Therefore, the medium MELD scores (15~25) were the best fit for the operation; this confirms the results of Merion et al. that the low or high MELD score is not the most promising indicator [10].

The ROC curves scoring system was used to predict the sensitivity and specificity of death. The area under the receiver operating characteristic curve for MELD was 0.694, a relatively low prognostic value. The MELD scoring system was well-calibrated (Hosmer-Lemeshow was 6.818; ). Basile-Filho et al. reported that the area under the receiver operating characteristic curve of MELD is only 0.5 [11]. The prognostic value to predict hospital mortality postoperation was low, which was also demonstrated in other studies [12, 13].

As there was no an objective and accurate evaluation tool available for prediction of the outcome for liver transplantation till now The highest Youden index was 0.430 when the MELD score was at a 20.07 cutoff value, demonstrating a specificity of 0.726, a sensitivity of 0.704, a positive predictive value (PPV) of 0.292, and a negative predictive value (NPV) of 0.938. This result indicated that APACHE IV was higher than MELD regarding sensitivity and specificity, which was mainly due to that APACHE IV takes the diagnosis at admission and objective data into account. Barie et al. reported that it would be better to combine APACHE IV with another critical scoring system to provide more accurate prediction [14]. In this study, although the combination of APACHE IV and MELD had the highest specificity and PPV, its Youden index was only 0.545. Vincent considered that different critical scoring systems may assist each other in their assessment, rather than compete with each other. The combined APACHE IV and MELD improved the predictive accuracy for postoperative mortality against MELD, but declined the accuracy when compared with APACHE IV. Thus, the Youden index was highest when using APACHE IV scores alone. Therefore, the function of the APACHE IV is better than that of others.

Prediction of ICU LOS by APACHE IV is used to evaluate and compare the overall efficient use of the ICU in medical center. Care in the ICU accounted for approximately 13% of hospital costs and 4.2% of national health expenditures [16]. These costs were largely explained by the LOS in the ICU [17, 18]. We found that the difference between the predicted ICU LOS and the actual ICU LOS was significant , but the correlation between them was poor . The APACHE IV model provides clinically useful ICU LOS predictions for critically ill patient groups, but its accuracy and utility are still limited, as demonstrated in the study of Vasilevskis et al. [19].

In summary, the prognostic value of APACHE IV is higher than that of MELD scoring system; thus, it needs to be validated in multiple ICU centers.

Authors’ Contribution

Yueyun Hu and Xianling Zhang made equal contributions to this work.

References

A. Ahmed and E. B. Keeffe, “Current indications and contraindications for liver transplantation,” Clinics in Liver Disease, vol. 11, no. 2, pp. 227–247, 2007.
View at: Publisher Site | Google Scholar
Y. Arabi, A. Abbasi, R. Goraj et al., “External validation of a modified model of acute physiology and chronic health evaluation (APACHE) II for orthotopic liver transplant patients,” Critical Care, vol. 6, no. 3, pp. 245–250, 2002.
View at: Publisher Site | Google Scholar
M. L. Volk, J. C. Hernandez, A. S. Lok, and J. A. Marrero, “Modified Charlson Comorbidity Index for predicting survival after liver transplantation,” Liver Transplantation, vol. 13, no. 11, pp. 1515–1520, 2007.
View at: Publisher Site | Google Scholar
J. E. Zimmerman, A. A. Kramer, D. S. McNair, and F. M. Malila, “Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today's critically ill patients,” Critical Care Medicine, vol. 34, no. 5, pp. 1297–1310, 2006.
View at: Publisher Site | Google Scholar
J. F. Gallegos-Orozco and H. E. Vargas, “Liver transplantation: from child to MELD,” Medical Clinics of North America, vol. 93, no. 4, pp. 931–950, 2009.
View at: Publisher Site | Google Scholar
R. H. Wiesner, S. V. McDiarmid, P. S. Kamath et al., “Meld and peld: application of survival models to liver allocation,” Liver Transplantation, vol. 7, no. 7, pp. 567–580, 2001.
View at: Publisher Site | Google Scholar
S. Brinkman, F. Bakhshi-Raiez, A. Abu-Hanna et al., “External validation of acute physiology and chronic health evaluation IV in Dutch intensive care units and comparison with acute physiology and chronic health evaluation II and simplified acute physiology score II,” Journal of Critical Care, vol. 26, no. 1, pp. 105–e18, 2011.
View at: Publisher Site | Google Scholar
A. P. Nassar Jr., A. O. Mocelin, A. L. B. Nunes et al., “Caution when using prognostic models: a prospective comparison of 3 recent prognostic models,” Journal of Critical Care, vol. 24, no. 4, pp. 421–423, 2012.
View at: Publisher Site | Google Scholar
W. A. Knaus, “APACHE 1978–2001: the development of a quality assurance system based on prognosis: milestones and personal reflections,” Archives of Surgery, vol. 137, no. 1, pp. 37–41, 2002.
View at: Google Scholar
R. M. Merion, D. E. Schaubel, D. M. Dykstra, R. B. Freeman, F. K. Port, and R. A. Wolfe, “The survival benefit of liver transplantation,” American Journal of Transplantation, vol. 5, no. 2, pp. 307–313, 2005.
View at: Publisher Site | Google Scholar
A. Basile-Filho, E. A. Nicolini, M. Auxiliadora-Martins et al., “Comparison of acute physiology and chronic health evaluation II death risk, Child-Pugh, Charlson, and model for end-stage liver disease indexes to predict early mortality after liver transplantation,” Transplantation Proceedings, vol. 43, no. 5, pp. 1660–1664, 2011.
View at: Publisher Site | Google Scholar
P. H. Hayashi, L. Forman, T. Steinberg et al., “Model for end-stage liver diseases score does not predict patient or graft survival in living donor liver transplant recipients,” Liver Transplantation, vol. 9, no. 7, pp. 737–740, 2003.
View at: Publisher Site | Google Scholar
H. Y. Yoo and P. J. Thuluvath, “Short-term postliver transplant survival after the introduction of MELD scores for organ allocation in the United States,” Liver International, vol. 25, no. 3, pp. 536–541, 2005.
View at: Publisher Site | Google Scholar
P. S. Barie, L. J. Hydo, and E. Fischer, “Utility of illness severity scoring for prediction of prolonged surgical critical care,” Journal of Trauma, vol. 40, no. 4, pp. 513–518, 1996.
View at: Google Scholar
J.-L. Vincent and R. Moreno, “Clinical review: scoring systems in the critically ill,” Critical Care, vol. 14, no. 2, article 207, 2010.
View at: Publisher Site | Google Scholar
N. A. Halpern, S. M. Pastores, and R. J. Greenstein, “Critical care medicine in the United States 1985–2000: an analysis of bed numbers, use, and costs,” Critical Care Medicine, vol. 32, no. 6, pp. 1254–1259, 2004.
View at: Publisher Site | Google Scholar
A. A. Kramer and J. E. Zimmerman, “A predictive model for the early identification of patients at risk for a prolonged intensive care unit length of stay,” BMC Medical Informatics and Decision Making, vol. 10, no. 1, article 27, 2010.
View at: Publisher Site | Google Scholar
M. Kastrup, M. Seeling, S. Barthel et al., “Effects of intensivist coverage in a post-anaesthesia care unit on surgical patients' case mix and characteristics of the intensive care unit,” Critical Care, vol. 16, no. 4, article R126, 2012.
View at: Google Scholar
E. E. Vasilevskis, M. W. Kuzniewicz, B. A. Cason et al., “Mortality probability model III and simplified acute physiology score II: assessing their value in predicting length of stay and comparison to APACHE IV,” Chest, vol. 136, no. 1, pp. 89–101, 2009.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2013 Yueyun Hu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

3262

Downloads

1620

Citations