Abstract

Objectives. To determine in-hospital mortality and complications of cardiac surgery in pediatric patients and identify predictors of hospital mortality. Methods. Records of pediatric patients who had undergone cardiac surgery in 2005 were reviewed retrospectively. The risk adjustment for congenital heart surgery (RACHS-1) method, the Aristotle basic complexity score (ABC score), and the Society of Thoracic Surgeons and the European Association for Cardiothoracic Surgery Mortality score (STS-EACTS score) were used as measures. Potential predictors were analyzed by risk analysis. Results. 230 pediatric patients had undergone congenital cardiac surgery. Overall, the mortality discharge was 6.1%. From the ROC curve of the RACHS-1, the ABC level, and the STS-EACTS categories, the validities were determined to be 0.78, 0.74, and 0.67, respectively. Mortality risks were found at the high complexity levels of the three tools, bypass time >85 min, and cross clamp time >60 min. Common morbidities were postoperative pyrexia, bleeding, and pleural effusion. Conclusions. Overall mortality and morbidities were 6.1%. The RACHS-1 method, ABC score, and STS-EACTS score were helpful for risk stratification.

1. Introduction

During the past two decades, dramatic improvements have been seen in both diagnostic tools and treatments for heart diseases in pediatric patients. Advances in neonatal surgery, interventional cardiac catheterization, cardiac anesthesia and intensive care, cardiopulmonary bypass systems, and mechanical assisted device have been key achievements in outcomes, especially in the critical patients. The in-hospital mortality rates for pediatric cardiac surgery decreased significantly from 8.7–22% to 4.6–6% in the past two decades [15]. Recently, a report on indigenous Australian pediatric patients who had undergone congenital cardiac surgery showed overall complication rates of 20–32% and a mortality rate of 1.82%. The major postoperative complications were conduction disturbance (17%), valve dysfunction (6%), and tamponade (3%) [1]. In addition, a mortality outcome of up to 0.62% occurred within 365 days after hospital discharge. Chang et al. [6] indicated that the important risk factors of posthospital discharge death were young age and type of surgery. Silka et al. [7] reported that the majority of these patients had diagnoses of aortic stenosis, coarctation of aorta, transposition of great arteries, and tetralogy of Fallot. The major causes of death were cardiac arrhythmia, aneurysmal rupture, and heart failure.

To measure the performance of surgical outcome has been difficult because of the relative low number and heterogeneity of patients and the diversity of operations [810]. The risk adjustment for congenital heart surgery (RACHS-1) method can be used to stratify individual patients into six categories, based on type of surgery and age at operation, for predicting hospital mortality [1113]. Another well-known tool is the Aristotle basic complexity score (ABC score) which allocates the complexity scores on the basis of the primary procedure (ranging from 1.5–15) and complexity levels (1–4) [14, 15]. The newest model, developed from the empirical-based analysis from the European Association for Cardiothoracic Surgery (EACTS) congenital heart surgery database and the Society of Thoracic Surgeons (STS) congenital heart Surgery database, is the STS-EACTS mortality score and categories [16]. The large, recent study of 77,294 registered procedures showed a high degree of discrimination for predicting mortality, using these three tools and c statistic (0.74–0.78) [16, 17].

In Thailand, pediatric cardiac surgery and postoperative care have been developing gradually since 1970. Fundamentally, each institute assesses clinical outcomes based on their observational databases. As a result, an overall performance assessment has been lacking, especially for the whole country. Currently, administrative databases are being constructed using the ICD-9-CM code. Siriraj Hospital, which is a university hospital and a tertiary cardiac center, is one of the main referral hospitals in Thailand for congenital cardiac surgery and intervention. Congenital cardiac surgery at Siriraj Hospital involves 300–400 cases per year, with up to 70% being in the pediatric age group. Not only accurate data is needed for pediatric cardiac surgery outcomes, to measure institutional performance, but also preliminary survey results are needed for a national database. The final goal is to improve the quality of care and achieve world standards. This preliminary surveillance project has two main objectives: (1) to characterize the epidemiology of contemporary outcomes, including in-hospital mortality rates and complications among pediatric patients who have undergone cardiac surgery at Siriraj Hospital, using the RACHS-1, ABC level, and STS-EACTS Mortality Categories and (2) to perform a risk factor analysis of hospital mortality.

2. Materials and Methods

2.1. Data Sources

The present study was designed as a retrospective descriptive study and approved by the Siriraj Institutional Review Board and Ethics Committee. All pediatric patients (ages ranging from 0 to 15 years old, excluding preterm babies who underwent cardiac surgery between January 1 and December 31, 2005) were identified using the Siriraj Hospital Cardiothoracic Division database. Demographic data was reviewed for: age at the first presentation at the hospital, gender, age at the onset of symptom presentation, presence of genetic syndrome, and diagnosis of congenital heart disease. The preoperative and intraoperative data included type of operation, cardiopulmonary bypass time (CPB time), and aortic cross clamp time (AoX time). The postoperative data included outcomes like in-hospital morbidities and mortalities, which were categorized by the RACHS-1 method, ABC level, and STS-EACTS mortality categories [11, 12, 14, 16, 17]. Retrospective variables were identified, and a statistical analysis was performed on the effects of preoperative and intraoperative factors on surgical outcomes.

2.2. Study Variables

Postoperative death before hospital discharge was used as the main outcome variable. For secondary outcome variables, postoperative morbidities were considered. These included cardiac arrest, reoperation, postoperative reintubation, low cardiac output, acute renal failure requiring peritoneal dialysis, pyrexia (>38 degrees Celsius), pleural effusion, and serious cardiac arrhythmia such as complete AV block, junctional ectopic tachycardia, supraventricular tachycardia, atrial ectopic tachycardia, ventricular tachycardia, and ventricular fibrillation requiring medical or electrical cardioversion.

2.3. Data Analysis

Patients’ baseline characteristics and potential confounders were summarized using descriptive statistics (showing the percentage, median, and range). The ROC curve was examined for validation of the RACHS-1 level, ABC level, and STS-EACTS Mortality categories. Associations between potential risk factors and poor outcomes were assessed with univariate analysis. Continuous variables were assessed with a Mann-Whitney U test, and the categorical variables were evaluated by a Fisher’s exact test or a chi-square test. Multivariate analysis was performed with forward stepwise logistic regression, combined for each outcome. A 𝑃 value <  .05 was considered to be statistically significant. Statistical analysis was performed with SPSS 10.0 for Windows (SPSS Inc., Chicago, IL, USA).

3. Results

3.1. Demographic Data

During the 12-month study period, a total of 411 congenital cardiac surgical procedures were performed on patients at Siriraj Hospital. Of these, 230 cases met the eligibility criteria (Figure 1). Demographic data of the patients are shown in Table 1.

3.2. Surgical Procedures

The majority of procedures were open-heart surgery (82.6%; 𝑛 = 1 9 0 ). The most frequent procedure was ventricular septal defect patch closure (30.4%), followed by tetralogy of Fallot repair (16.1%) and systemic-to-pulmonary shunt (11.8%) (see Table 2). Average cardiopulmonary bypass time and average aortic cross clamp time were 84.9 ± 66.8, and 42.5 ± 34.7 minutes, respectively. Most of the procedures were stratified into the RACHS-1 levels of 1 and 2 (60.9%), ABC levels of 1 and 2 (56.1%), and STS-EACTS mortality categories of 1 and 2 (66.9%). Overall, the mean Aristotle basic score was 7.1 ± 1.9. The mean STS-EACTS mortality score was 0.65 ± 0.54 (see Table 3).

3.3. Mortality

Overall in-hospital postoperative mortality in the present study was 6.1% (14 of 230). Figure 1 illustrates the mortality using the RACHS-1 system, with the mortality increasing significantly between level 2 and levels 3 and 4 ( 𝑃 value <  .05). The area under the ROC curve was 0.78, with a 95% confidence interval between 0.669 and 0.897. Figure 2 shows the mortality, based on the ABC level, with the highest percentage of mortality at ABC level 4 (14.2%). The area under the ROC curve for this ABC level was 0.74 with a 95% confidence interval between 0.60 and 0.84. Mortality rate and the STS-EACTS Mortality categories are also shown in Figure 3. For this method, the highest proportion of mortality cases was in category 3. The area under the ROC curve was 0.66 with a 95% confidence interval between 0.53 and 0.81. Detailed descriptions of death and potential risk variables are summarized in Table 4.

3.4. Risk Analysis

Potential risk factors of mortality discharge were evaluated by univariate analysis (summarized in Table 5). No mortality discharge occurred with patients at the RACHS-1 level 1, in contrast to 100% mortality discharge of patients with patients at the RACHS-1 level 5. Consequently, estimation by the logistic regression model could not be assumed to be valid. Therefore, the separation between groups, defined by the RACHS-1 levels, was performed logically by grouping together RACHS-1 levels 1–3 and levels 4–6. In addition, bypass time and cross clamp time were analyzed by ROC, to determine cutoff values for the study. 84.5 minutes of bypass time (sensitivity = 91% and specificity = 64%) and 59 minutes of cross clamp time (sensitivity = 66% and specificity = 75%) were suitable for separate groups for in-hospital death prediction. Results from the univariate model and a forward stepwise logistic regression model showed a significant increased risk of death associated with the RACHS-1 level 4–6 (OR = 10.0), the ABC level 3-4 (OR = 8.5), the STS-EACTS Mortality Categories 3–5 (OR = 4.1), bypass time > 85 minutes (OR = 19.8), and cross clamp time > 60 minutes (OR = 6.3) (see Table 6).

3.5. Complications and Length of Stay

Table 7 shows the major postoperative complications and morbidities occurring in our cases. The common events were postoperative pyrexia (43.0%), redo due to bleeding or tamponade and unstable hemodynamic (9.6%), pleural effusion including chylothorax (8.6%), and cardiac arrhythmia events, which required medical intervention or electrical cardioversion (8.7%).

4. Discussion

In recent years, the attitude towards quality of health care and the cost of congenital heart surgery has received much attention from the public and is the subject of government coverage scrutiny. The RACHS-1 method was established to analyze the impact of case mix on pediatric cardiac surgical outcomes by Jenkins et al. [11, 12]. In 2006, the STS and EACTS also incorporated the RACHS-1 into their databases [17, 18]. Many institutes in Europe and North America reported use of the RACHS-1 with comparisons of inter-institutional performance [10, 13, 17, 1921]. Some authors also validated RACHS-1 stratification for use with a subset of pediatric cardiac surgeries, by considering the area under the ROC curve (0.75–0.86) [21, 22]. Meanwhile, Lacour-Gayet et al. [14, 15] introduced the Aristotle basic complexity score (ABC score) to predict surgical mortality. The complexity tool allocates a basic score (range from 1.5 to 5) and a level (range from 1 to 4) for each operation. Subsequently, the authors developed the Aristotle Comprehensive complexity score for a more complex stratification, based on procedure-dependent factors such as anatomical factors, age at procedure, and patient-adjusted factors such as extracardiac factors and general factors [14, 23]. The novel method has been accepted for use in several studies, with its validity (by c statistic) at 0.74 to 0.8 [16, 17, 23]. The most recent complexity stratification tool, published in 2009, is the STS-EACTS congenital heart surgery mortality score. It uses additional factors such as age, weight, and preoperative LOS and was shown to have a high validity (by c statistic) of 0.816 [16, 17]. These stratification tools are helpful methods for analyzing the case mix in pediatric cardiac surgeries.

To date, few reports have mentioned any evaluation of pediatric cardiac outcomes from developing countries [2, 3, 24, 25]. Vélez et al., from Colombia, indicated that patients with RACHS-1 levels 1 to 4 had mortality rates of 0.7%, 7.2%, 20.7%, and 33.8%, respectively [3]. Also, in Guatemala, a study demonstrated improvement in congenital heart surgery (from 1997 to 2004) using the RACHS-1 stratification [2]. Regarding a limitation of resource and prior data, the authors attempted to survey a surgical performance in a single center to provide fundamental information for longitudinal study and a multi-institutional report. The RACHS-1, ABC, and STS-EACTS mortality scoring systems appear to be sensible tools, with simple language and interpretation. Nevertheless, each system is recognized for limitations such as not having classifications for heart transplantation, fenestrated ASD closure, fenestrated VSD closure, truncal valve annuloplasty, and one and a half repair in the RACHS-1 method [8]. For our retrospective database, complete patients’ clinical factors were not available for applying the Aristotle comprehensive complexity score, or for applying the adjusted patient-level risk level in the STS-EACTS scoring system. As a result, we used all classifications to stratify the clinical database to determine cross-sectional mortality.

In the present study, postoperative in-hospital mortality was 6.1%, with increasing mortality rates at the higher levels of the RACHS-1 and the ABC. Nevertheless, only one patient was categorized at the RACHS-1 level 5, and no patients were at RACHS-1 level 6. Also, the Norwood procedure was not performed during the one-year study. The mean ABC score was 7.1 ± 1.9, which represents a complexity between ABC levels 2 and 3. Likewise, the mean STS-EACTS mortality score placed our complexity of procedures into categories 2-3. These scores imply a procedural-based level of complexity in the institute, which would be useful information for a longitudinal study.

Overall, the present study shows that three scoring systems can be applied to a medium volume hospital. The areas under the ROC curves for the RACHS-1 and ABC systems, for predicting in-hospital mortality, are impressive, 0.78 and 0.74, respectively. These values are close to the results from other studies [13, 16, 18, 2022]. Interestingly, the mortality rate distributed by the STS-EACTS mortality categories looks a bit different from those of the RACHS-1 or ABC score. In the STS-EACTS mortality categories, the highest mortality percentage was found at mortality level 3 (17.8%), followed by level 4 (8.3%), and then level 2 (6.2%). As a possible explanation, some of the procedures that are classified in the STS-EACTS mortality category 4, such as systemic to pulmonary artery shunt, have been performed commonly in the institute with a low mortality rate. The atrioventricular canal repair, in contrast, which is categorized in the STS-EACTS category 3, shows a high mortality rate. For a small sample size, the proportion of mortality is skewed considerably toward the STS-EACTS category 3. As a result, the area under the ROC curve for the STS-EACTS system was 0.66. By comparing our results to those of the largest database from the STS and EACTS congenital register [16, 17], the performance at our center has a much higher mortality, especially for complex procedures. Accordingly, the performance of congenital heart surgery at the institute needs to be improved to achieve a standard of quality as shown in Figure 4.

Using a stepwise logistic model and a predictive model, we found that high RACHS-1 levels (levels 4–6), high ABC levels (levels 3-4), high STS-EACTS mortality categories (categories 3–5), bypass time >85 minutes, and cross clamp time >60 minutes were significantly associated with high mortality (OR = 10.0, 8.5, 4.1, 19.8, and 6.3, resp.). The bypass times and aortic cross clamp time significantly affect the mortality since they generally reflect the difficulty of procedures and the complexity of diseases. After reviewing every death case, we also found that atrioventricular canal repair has the highest risk of surgery (mortality discharge of 35%). The causes of death included sepsis, pulmonary hypertensive crisis, low output, and cardiac arrhythmia.

In the present study, the most common complications were postoperative fever (43%), and bleeding tamponade, caused by unstable hemodynamic requiring reoperation (9.6%). Other morbidities appeared to be similar to those reported by other authors [1, 2, 6, 26]. For a meaningful clinical correlation, we explored cases where the patient developed fever within 10 days after the operation. Definite etiologies of pyrexia were identified in only 63.3% of the patients. The three most common causes of fever were pneumonia (29.6%), postpericardiotomy syndrome (23.5%), and bacteremia (6.1%). Postoperative fever itself does not directly predict a mortality (OR = 0.9, 95% CI = 0.3–2.9). By contrast, the risk mortality of the patients with postoperative major infections was 2.6 times that of the non-infectious group (95% CI = 1.8–9.5). In terms of other complications, significant associations were seen between mortality and bleeding tamponade caused by unstable hemodynamic requiring reoperation (OR = 11, 95% CI = 3.4–34.0), reintubation incidence (OR = 10.4, 95% CI = 2.4–40), and renal failure requiring dialysis (OR = 8.1, 95% CI = 1.8–35), and cardiac arrhythmia (OR = 3.4, 95% CI = 1–15.7). These complications need to be recognized early during postoperative care.

Interestingly, the high ABC levels (level 3-4) are associated with many complications: postoperative cardiac arrhythmia (OR = 3.3, 95% CI = 1.1–9.8), postoperative pleural effusion (OR = 3.3, 95% CI = 1.3–9.5), reintubation incidence (OR = 6.9, 95% CI = 1.4–32), renal failure requiring dialysis (P value <  .001), while the high RACHS-1 levels (levels 4–6) were highly associated with postoperative cardiac arrhythmia (OR = 7.6, 95% CI = 1.7–32.7). Nevertheless, in the present study, none of the three stratification tools were able to predict common complications, for instance, postoperative fever and bleeding tamponade caused by unstable hemodynamic requiring reoperation. With a larger sample size and a longer period of study, further implications and predictions of postoperative complications could be obtained from the risk stratification.

5. Limitations

(1)The patient population in the present study was rather small. The sample size was adequate for estimating only a two-sided 95% confidence interval (alpha level of 0.05) for a prevalence of mortality of 15 ± 5%. After categorizing patients into the risk models, the statistical power was reduced though some variables showed a strong association with the mortality discharge.(2)Since this was a retrospective study, selection bias is inevitable. Some variables, such as noncardiac anomalies, genetic syndromes diagnosed by characteristics, and socioeconomic status could not be traced.(3)This is the first time that the RACHS-1 classification and ABC scoring system has been applied to our population. The experts and pediatric cardiologists of our institutions have to scrutinize and explore the raw data before interpretation.(4)In the present study, the exclusion criteria was limited by age (between 0–15 years of age), which could skew the results. We excluded preterm, which represents a high-risk group in the ABC and STS-EACTS scoring systems, to reduce conflicts from mortality due to unrelated factors. In addition, adolescents (15–18 years old), who had been admitted to adult care units, were excluded by the unique infrastructure of the hospital. Since this is a preliminary report, to provide an initial measurement of the surgical performance at the institute, we intend to adjust the criteria in the next longitudinal study.(5)An aggregated database over a longer time may suggest trends that can be used to improve the subsets. Moreover, the interinstitutional case-mix will reveal overall outcomes for nation-wide improvements in quality of care for these patients.

6. Conclusions

The RACHS-1, ABC, and STS-EACTS mortality scoring systems are useful tools for assessing mortality discharge in a medium volume cardiac center in Thailand. The overall postoperative in-hospital mortality rate was found to be 6.1%. The important risk factors for postoperative mortality were the high RACHS-1 level, high ABC level, high STS-EACTS mortality categories, and prolonged bypass time. The most common complications were postoperative fever, and bleeding tamponade causing unstable hemodynamic requiring reoperation, which are not well predicted by the risk complexity tools.

Acknowledgments

The authors wish to thank Dr. Marion Tipple (Children’s Heart Centre, British Columbia Children’s Hospital) and Glen Wheeler for proofreading and editing this paper. They also thank to Dr. Pansak Laksanabunsong (Siriraj Hospital), Dr. Wanchai Wongkornrat (Siriraj Hospital), and all administrators of pediatric cardiology as well as cardiovascular thoracic surgery for their assistance on the database.