Abstract

Background. Acute kidney injury (AKI) is a common complication in critically ill patients. Some predictive models have been reported, but the conclusions are controversial. The aim of this study was the formation of nomograms to predict risk factors for AKI in critically ill patients within the first 7 days after admission to the intensive care unit (ICU). Methods. Data were extracted from the Medical Information Mart for Intensive Care- (MIMIC-) III database. The random forest method was used to fill in the missing values, and least absolute shrinkage and selection operator (Lasso) regression analysis was performed to screen for possible risk factors. Results. A total of 561 patients were enrolled. Complication with AKI is significantly associated with a longer length of stay (LOS). For all patients, the predictors contained in the prediction nomogram included hypertension, coronary artery disease (CAD), cardiopulmonary bypass (CPB), coronary artery bypass grafting (CABG), Simplified Acute Physiology Score II (SAPS II), central venous pressure (CVP) measured for the first time after admission, and maximum and minimum mean artery pressure (MAP). The model showed good discrimination (, 95% CI: 0.779-0.857). In the subgroup of patients with well-controlled blood glucose levels, the significant predictors included hypertension, CABG, CPB, SAPS II, and maximum and minimum MAP. Good discrimination was also present before (, 95% CI: 0.736–0.834) and after adjustment (adjusted ). Conclusion. Hypertension, CAD, CPB, CABG, SAPS II, CVP measured for the first time after admission, and maximum and minimum MAP were independent risk factors for AKI in critically ill patients.

1. Introduction

Acute kidney injury (AKI) is a serious clinical complication featuring both attributed morbidity and mortality in the short and long term [13]. Currently, there are a series of diagnostic criteria for AKI, including the risk, injury, failure, loss, and end-stage renal disease (RIFLE) [4], AKI Network (AKIN) [5], and Kidney Disease: Improving Global Outcomes (KDIGO) [6] classifications. Among different populations, the diverse diagnostic criteria correspond to the different incidences of AKI, which vary from 1% to 70% [79]. Given its significantly adverse effect on the prognosis of critically ill patients, early detection of potential AKI is vital [10].

As one of the classic and traditional predictors of renal insufficiency, serum creatinine has been labeled as limited now because of its unstable level in critically ill patients. Previous research reported that some prediction models incorporate age, the baseline estimated glomerular filtration rate (eGFR), N-terminal brain natriuretic peptide precursor (NT-proBNP), and some of the drugs affect kidney function, such as metformin and angiotensin converting enzyme inhibitor (ACEI). [11] Some results are still controversial. Also, a series of novel biomarkers, including urinary hemojuvelin (uHJV), kidney injury molecule-1 (uKIM-1), and neutrophil gelatinase-associated lipocalin (uNGAL), were also studied to better predict the occurrence of AKI [12, 13]. However, these markers are rarely used in the clinic and lack sensitivity or specificity. Thus, it is vital to build models of efficiency that contain common clinical indicators to predict AKI. Then, nomograms are facilitated to visually exhibit the role of each risk factor.

In our earlier study, we had explored the potential heterogeneity of AKI and evaluated the prognostic differences among AKI subphenotypes in critically ill patients with cardiovascular diseases [14]. In this study, we further built several nomograms of prediction models for different populations of AKI patients. The data were obtained from the Medical Information Mart for Intensive Care- (MIMIC-) III database, which is composed of a large amount of clinical and test data collected from the ICU [15].

2. Methods

2.1. Data Source

The data in this study were extracted from the MIMIC-III (Medical Information Mart for Intensive Care) database established by Beth Israel Deaconess Medical Center in Boston, Massachusetts, USA [15]. This is a large, single-center database that is comprised of information relating to the patients admitted to critical care units and includes patient demographics, vital signs, medications, laboratory measurements, fluid balance, procedure and diagnostic codes, imaging reports, hospital length of stay, and death events. The use of the MIMIC-III database in this study was approved by the review committee of Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center.

2.2. Study Population

Patients older than 18 years old with a length of ICU stay longer than one day were included. For the patients who were recorded with multiple admissions, only the first ICU admission was extracted. Ultimately, 561 patients in the critical care units were enrolled for the following analysis.

2.3. Covariates and Outcomes

The baseline characteristics were extracted within the initial 24 hours after critical care unit admission. The covariates in this study included age, sex, body mass index (BMI), heart rate (HR), respiratory rate, oxygen saturation (SpO2), temperature, glucose, systolic blood pressure (SBP), diastolic blood pressure (DBP), 24-hour urine output, use of ventilation, stage of acute kidney injury at 48 hours and 7 days after admission, administration of vasopressors, sedatives, and furosemide.

The comorbidities included coronary artery disease (CAD), atrial fibrillation (AF), congestive heart failure (CHF), hypertension, stroke, sepsis, diabetes mellitus (DM), and chronic obstructive pulmonary disease (COPD), which were all recorded as International Classification of Diseases, Ninth Revision (ICD-9) codes. The procedures included cardiopulmonary bypass, coronary artery bypass grafting (CABG), and left heart catheterization.

The laboratory test measurements included the white blood cell (WBC) count and levels of hemoglobin, platelets, sodium, potassium, blood urea nitrogen (BUN), and creatinine. The severity at admission was measured by the Sequential Organ Failure Assessment (SOFA) score, Simplified Acute Physiology Score (SAPS), Simplified Acute Physiology Score II (SAPS II), Elixhauser comorbidity score, and length of ICU stay. The outcome of the current study was AKI.

2.4. Statistical Analyses

Continuous variables are presented as the or median (interquartile range), and categorical variables are presented as numbers (percentages). The random forest method was used to fill in the missing values, and Student’s -test was used to compare significant differences in the data before and after filling. The chi-square test and the Kruskal–Wallis test were used for comparisons among the groups. After univariate binary logistic regression analysis, the least absolute shrinkage and selection operator (LASSO) method, which is suitable for the reduction in high-dimensional data [16, 17], was applied to select the optimal predictive features in the risk factors of critically ill patients. Eighty percent of the sample data were randomly selected as the training set and the remaining 20% as the fitting model of the test set. The odds ratio (OR) and 95% confidence interval (CI) values were determined by multivariate logistic regression to establish the final model. A two-tailed was considered statistically significant. Statistical analyses were carried out by using SPSS (version 25.0, IBM, New York, USA) and the R tool (version 4.0.2, R Foundation for Statistical Computing, Vienna, Austria).

3. Results

3.1. In All Statistics
3.1.1. Patient Characteristics

A total of 561 patients, consisting of 440 (78.43%) patients who were diagnosed with AKI in the first 7 days after admission to the ICU, were finally included in this study. There was no significant difference between the variables before and after filling. Their baseline information, including demographic, disease, and treatment features, in the two groups is shown in Table 1.

3.1.2. Feature Selection and Drawing of ROC Curve

After the univariate binary logistic regression analysis, 51 features with a were put into the LASSO regression model for further screening, as 80% of the data were randomly selected as the training set, and the remaining 20% were selected as the test set (Figures 1(a) and 1(b)). The ROC curves and AUC presented good predictive value of the model (Figure 2). The features included hypertension, CAD, cardiopulmonary bypass, CABG, SAPS II, CVP measured for the first time after admission, and maximum and minimum MAP during the ICU stay (Table 2).

3.1.3. Development of the Prediction Model

The results of multivariate logistic regression analysis are presented in Table 2. The model that incorporated the above independent predictors was developed and presented as the nomogram (Figure 3).

3.1.4. Apparent Performance of the Nonadherence Risk Nomogram in the Cohort

The C-index for the prediction nomogram was 0.818 (95% CI: 0.779-0.857) for the cohort and was confirmed to be 0.802 through bootstrapping validation, suggesting the model’s good discrimination.

3.2. In the Subgroup
3.2.1. Patient Characteristics

The subgroup contained 324 (73.63%) patients with AKI in the first 7 days after admission to the ICU. Their baseline information, including demographics, diseases, and treatment features, in the two groups is shown in Table 3.

3.2.2. Feature Selection and Drawing of the ROC Curve

Among the demographic, disease, and laboratory examination indexes, 34 features were put into the LASSO regression model for further screening, as 80% of the data were randomly selected as the training set and the remaining 20% as the test set (Figures 4(a) and 4(b)). The ROC curves and AUC presented good predictive value of the model (Figure 5). The features included hypertension, CABG, cardiopulmonary bypass, SAPS II, and maximum and minimum MAP during the ICU stay (Table 3).

3.2.3. Development of the Prediction Model

The results of the multivariate logistic regression analysis are presented in Table 4. The model that incorporated the above independent predictors was developed and presented as the nomogram (Figure 6).

3.2.4. Apparent Performance of the Nonadherence Risk Nomogram in the Cohort

The C-index for the prediction nomogram was 0.785 (95% CI: 0.736–0.834) for the cohort and was confirmed to be 0.770 through bootstrapping validation, suggesting the model’s good discrimination.

4. Discussion

In this retrospective observational study, we reported an overall AKI incidence of 78.43% among a population of critically ill patients and an incidence of 73.63% in the subgroup of . Additionally, we built two nomograms for the critically ill patients enrolled and the subgroup of patients with . The predictive value of the models performed well in both the training set and test set. Even after adjustment, good discrimination still exists. The combination of clinical markers could better anticipate the development of AKI, helping doctors to be vigilant and eventually achieve further prevention of AKI.

AKI is a major complication with quite a high incidence in the ICU and is associated with increased treatment expenses and longer hospital stays [18]. Our study confirmed the high incidence of AKI in critically ill patients, which has been reported in other studies [19, 20]. The patients complicated with AKI had a higher 28-day mortality and increased LOS, suggesting the necessity to take strategies to reduce the morbidity of AKI. Although a series of studies have identified risk factors for AKI, there is still room for the development of risk prediction tools for AKI in critically ill patients.

There have been a series of predictive models found in patients with contrast-induced AKI [21], underwent surgery [22], after liver transplantation [23], and with sepsis [24]. Recently, the standardized diagnostic and staging criteria for AKI have contributed to an improved understanding of the incidence and course of AKI in critically ill patients. However, there is still variation in its timely recognition, management, and outcomes [1, 20]. There are novel biomarkers showing predictive value for AKI, including cystatin C, neutrophil gelatinase-associated lipocalin, interleukin-18, protein C, insulin-like growth factor-binding protein 7, tissue inhibitor of metalloproteinases-2, and kidney injury molecule-1. However, the sensitivity and specificity of these indicators are still high, and they are not routinely measured in clinical diagnosis and treatment work. The relatively high costs of the assays are another disadvantage.

To predict the occurrence of AKI more effectively and reduce its harm to patients, a combination of epidemiological, clinical, biological, and hereditary factors along with a series of biomarkers is required to be included in the ideal predictive models [25]. Medical Information Mart for Intensive Care (MIMIC), as one of public database of high quality, is widely used in evaluating clinical risks and building disease-prediction models owing to advantages of being highly valuable for data mining [26, 27]. Moreover, nomograms are widely used as prognostic devices in medicine. Applying multivariate logistic regression to build nomograms is accurate enough to help to better achieve user-friendly digital interfaces and more easily understood prognoses to make better clinical decisions [28].

In this study, data of 561 patients from MIMIC were used to build the models. It was found that hypertension, CAD, cardiopulmonary bypass, CABG, SAPS II, CVP measured for the first time after admission, and the maximum and minimum MAP during the ICU stay were significantly associated with an increased risk of AKI for critically ill patients in the first 7 days after admission. We founded two models of AKI with satisfactory AUCs of 0.762 and 0.672 and adjusted C-indexes of 0.802 and 0.770. After incorporated into nomograms, these clinical risk factors facilitated the prediction of AKI and possessed satisfying predictive value. Gujadhur et al. [29] reported a model from data of more than 2000 patients from intensive care unit (ICU), to predict development of AKI. The multiregression model included serum bicarbonate on admission (; 95% CI: 0.796-0.846; ), APACHE III (; 95% CI: 1.007-1.015; ), age (; 95% CI 1.008-1.024; ), and presence of sepsis at ICU admission (; 95% CI: 2.122-23.744; ), with an AUC of 0.8 (95% CI: 0.78-0.83). In our model, we also showed the association between a classic score which commonly used to assess physiological status of critically ill patients, SAPS II, and AKI. Another model was developed, which contained heart failure, chronic kidney disease, emergency surgery, sepsis, and total bilirubin, to predict occurrence of critically ill patients, and the AUC (0.81), sensitivity (69.8%), and specificity (83.4%) were satisfactory [30]. Compared with Gujadhur A’s model, this model contained more disease variables, which is also a feature of our model.

Published in 1993, the Simplified Acute Physiology Score (SAPS) II was developed and validated in a European and North American cohort and includes 17 variables collected during the first 24 hours of ICU stay [31]. The sum of the score represents the in-hospital mortality risk, and its predictive performance has been evaluated in multiple studies [32, 33]. Xu et al. also used the data from postcardiac surgery patients from the MIMIC-III database and reported better discriminative performances of both the 90-day mortality and 1-year mortality of the SAPS II scoring system than the SOFA scoring system [34]. SAPS II has been widely reported as an independent risk factor for AKI in different populations and different stages of AKI [3537]. In our study, a similar positive result was concluded, suggesting the predictive value of SAPS II for the outcomes for critical patients.

AKI occurs in 2% to 30% of patients undergoing cardiac surgery [38]. It is largely assumed that the pathologic lesion of AKI after cardiac surgery is acute tubular necrosis [39]. The injured tubular epithelial cells slough, resulting in intratubular obstruction and hypertension. After the appearance of alterations in vasoreactivity, prerenal azotemia occurs, and cellular ATP depletion and oxidative injury eventually contribute to AKI. CPB is an intraoperative event associated with significant hemodynamic changes. Ischemic-reperfusion injury is common following cardiopulmonary bypass (CPB) and causes AKI [40]. In a meta-analysis that enrolled 46 studies comprising 242,388 participants [41], a significant association between CPB under different diagnostic criteria for AKI was reported. Minute oxygen consumption (VO2) and perfusion pressure during CPB are the two major determinants affecting the local hemodynamics of the kidney. The steady, nonpulsatile nature of CPB negates the elastance, inertial, and reflective components of the arterial resistance during normal pulsatile flow, making the regulation of local perfusion pressure more important. However, the optimum parameters of CPB flow and pressure goals are not known. Moderately high levels were reported to be associated with a reduced incidence of cardiac and neurologic complications, but the renal function was not assessed simultaneously [42].

It is worth noting that the relationship between CAD and AKI was anomalous. Yayan [43] compared occurrence of AKI after PCI of patients with and without CAD. Results showed that the occurrence of AKI was not significantly related to the presence of coronary heart disease (, chi-square test). In our study, the baseline presence of CAD and AKI is not associated (, chi-square test), neither. And after Lasso regression and multiple regression analysis, CAD was positively related to AKI. Combined with the results of this study, we speculated the difference of definitions and diagnostic criteria of AKI led to this abnormal result. However, there being no research elaborated the nonsignificant even positive relationship between CAD and AKI, future studies featured as more patients and prospective data collection with diagnostic criteria of AKI more applicable to Chinese are needed to solve this problem.

We believe our work provides clinicians with a new tool to identify patients with a high risk of AKI and the requirements of preventive strategies. The risk scores based on the parameters that are available to clinicians are higher, as they are faster and easier to obtain. Moreover, cheaper and more valid biomarkers, whose level is less affected by other factors, still need to be explored to evaluate changes in renal function. More sophisticated and effective models to predict AKI are needed for the prevention and intervention of adverse outcomes. There were several limitations that should be mentioned in our current study. First, the cohort could not represent all critically ill patients as those who without access to treatment were not included. Second, all comorbidities were recorded by ICD-9 codes, which might satisfy the latest diagnostic criteria for some diseases. Third, in all critically ill patients included in our study, CAD is a protective factor. As being analyzed, it is because of the inevitable deficiencies of the retrospective design, such as failure to assess patients’ status in a timely manner and limitations on the number of cases. Therefore, future studies featured as more patients and prospective data collection are needed to help enhance the credibility of our results.

5. Conclusion

This study applied a novel nomogram with relatively good accuracy to assess the risk of AKI in critically ill patients. Eventually, hypertension, CAD, cardiopulmonary bypass, CABG, SAPS II, CVP measured for the first time after admission, and maximum and minimum MAP during the ICU stay were independent risk factors for AKI for critically ill patients within the first 7 days of admission. Further study is needed to reveal the potential mechanisms.

Data Availability

The data used to support the findings of this study are included within the article.

Ethical Approval

The use of the MIMIC-III database was approved by the review committee of Massachusetts Institute of Technology and Beth Israel Deaconess Medical Center. Ethical approval was obtained from the Sun Yat-sen Memorial Hospital, Sun Yat-sen University ethics committee. All subjects/legal guardians gave written informed consent and assent as appropriate. The protocol was performed in accordance with the Declaration of Helsinki.

Conflicts of Interest

The authors declare that there is no conflict of interest regarding the publication of this article.

Authors’ Contributions

Kexin Wen and Yongqing Huang designed the study and wrote the main manuscript text. Qi Guo obtained the data from MIMIC-III. Tao Wu prepared Figures 16. Juanzhang Liu and Yuping Zheng prepared Tables 14. Shuxian Zhou and Dengfeng Geng proposed amendments to the manuscript. All authors made significant contributions to this study and reviewed the manuscript. Kexin Wen and Yongqing Huang contributed equally to this work.

Acknowledgments

We would like to thank the participants, developers, and investigators associated with the MIMIC-III database. This research is funded by the Sun Yat-Sen Clinical Research Cultivating Program (SYS-C-202101), the Guangzhou Science and Technology Plan Project (202102010312), the Hypertension Research and Innovation Fund of Chinese Cardiovascular Association (2021-CCA-HTN-40), the Chinese Cardiovascular Association-Access Fund (2021-CCA-ACCESS-166), and the Natural Science Foundation of Guangdong Province (2018A030313531).