Abstract
Purpose. Sepsis is a severe complication in patients following major hepatobiliary and pancreatic surgery. The purpose of this study was to develop and validate a nomogram based on inflammation biomarkers and clinical characteristics. Methods. Patients who underwent major hepatobiliary and pancreatic surgery between June 2015 and April 2017 were retrospectively collected. Multivariate logistic regression was used to identify the independent risk factors associated with postoperative sepsis. A training cohort of 522 patients in an earlier period was used to develop the prediction models, and a validation cohort of 136 patients thereafter was used to validate the nomograms. Results. Sepsis developed in 55 of 522 patients of the training cohort and 19 of 136 patients in the validation cohort, respectively. In the training cohort, one nomogram based on clinical characteristics was developed. The clinical independent risk factors for postoperative sepsis include perioperative blood transfusion, diabetes, operative time, direct bilirubin, and BMI. Another nomogram was based on both clinical characteristics and inflammation biomarkers. Multivariate regression analyses showed that previous clinical risk factors, PCT, and CRP were independent risk factors for postoperative sepsis. The last nomogram showed a good -index of 0.844 (95% CI, 0.787-0.900) compared with the previous one of 0.777 (95% CI, 0.713-0.840). Patients with a total score more than 109 in the second model are at high risk. The positive predictive value and negative predictive value of the second nomogram were 27% and 97%, respectively. Conclusion. The nomogram achieved good performances for predicting postoperative sepsis in patients by combining clinical and inflammation risk factors. This model can provide the early risk estimation of sepsis for patients following major hepatobiliary and pancreatic surgery.
1. Introduction
Severe sepsis and organ failure are major causes of morbidity and mortality after major hepatobiliary and pancreatic surgery [1]. Aggressive hepatobiliary pancreatic surgery has been associated with high complication rates of 40%–50% [1]. In a study of 583 patients who underwent surgical resection for intrahepatic cholangiocarcinoma, a postoperative complication occurred in 259 patients (44%) [2]. Moreover, sepsis is not uncommon. In one study of 1933 patients who underwent PD (pancreaticoduodenectomy), sepsis was found in 482 patients (24.9%) [3]. With advances in monitoring and prompt initiation of therapy, the mortality of severe sepsis remains higher than 25%~30%, even reaching 40-50% in the presence of shock [4]. These patients who survive to hospital discharge after sepsis are still at risk for death in the following time [5]. Those who survive often suffer from impaired physical or neurocognitive functions, emotional disorders, and a poor quality of life [6].
Sepsis was once defined as systemic inflammation caused by infection [7], and then, international consensus guidelines provide a series of warning signs of early sepsis [8]. Recently, it was defined as life-threatening organ dysfunction caused by dysregulated host response to infection [9]. Improper or delayed antibiotic treatment for sepsis patients can increase mortality [10]. Therefore, intravenous antibiotic therapy should be started as early as possible and should cover all likely pathogens [5]. This situation makes it meaningful to early predict the occurrence of sepsis.
In this study, we aim to develop and validate nomograms to predict sepsis of patients following major hepatobiliary and pancreatic surgery. Both serum biomarkers and clinical characteristics were analyzed by logistic regression analysis to identify risk factors. Then, one nomogram based on simple clinical characteristics and another one combining serum biomarkers and clinical characteristics were developed in a training cohort that comprises 522 patients. Finally, the nomograms were validated by a validation cohort containing 136 patients.
2. Materials and Methods
2.1. Patients
Patients who underwent major hepatobiliary and pancreatic surgery from June 2015 to April 2017 in the Department of Hepatobiliary Surgery of the First Medical Center of Chinese People’s Liberation Army General Hospital were retrospectively studied. This study was approved by the Institutional Ethics Committee of Chinese People’s Liberation Army General Hospital, and patients’ informed consent was obtained. Patients in training and validation groups come from a 4 : 1 split of all patients by time and then were divided into the training and validation groups, respectively. Blood samples were collected 1 day after surgery and tested for procalcitonin (PCT) and C-reactive protein (CRP), cytokines, and peripheral neutrophil to lymphocyte ratio (NLR).
The main outcome was whether postoperative sepsis occurred in the included patients. The secondary outcomes included the time when sepsis occurred, various infection events such as pneumonia and biliary tract infection, and microbiological tests like body fluids and blood culture.
Patients with signs of infection and a points were identified as sepsis [9]. In clinical use, patients with suspected and culture-proven infection are both in consideration. The SOFA comprises a score relevant to the major organ systems and graded from 0 to 4 according to the degree of dysfunction or failure [11].
Major surgery which was defined as organ removal or normal surgical anatomy which has changed after peritoneal access as previously reported, including operations creating any gastrointestinal anastomosis or involving parenchymal resection of the liver, bile duct, spleen, or pancreas, were included [12, 13]. In this study, we mainly included hepatectomy, pancreaticoduodenectomy, hilar cholangiocarcinoma radical surgery, and other hepatobiliary operations, and less extensive surgery such as cholecystectomy and liver tumor radiofrequency ablation was excluded. But surgery including both hepatectomy and cholecystectomy was included.
The exclusion criteria were patients with , with liver radiofrequency ablation only, with laparoscopic cholecystectomy only, and with incomplete clinical and inflammation biomarker data.
2.2. Methods
In this study, we collected patients’ clinical characteristic data on gender, age, body mass index (BMI), and diabetes. Perioperative data included durations of anesthesia, operative time, ASA physical status score, hemorrhage, and blood transfusion volumes. Perioperative blood transfusion in this study was based on data from 3 days after surgery and before.
Laboratory tests include direct bilirubin (DBil), aspartate aminotransferase (AST), alanine aminotransferase (ALT), lymphocyte counts, neutrophil counts, white blood cell count (WBC), C-reactive protein (CRP), procalcitonin (PCT), results of blood bacterial culture, and identified bacteria. Serum biomarkers (IL-1, IL-2, IL-6, IL-8, IL-10, and TNF-α) and peripheral neutrophil to lymphocyte ratio (NLR) were detected at 1 day after surgery.
Two surgeons separately collected clinical and inflammatory biomarker data of all patients who met the inclusion criteria. For inconsistencies in data, final results were confirmed by carefully reviewing the electronic medical records.
Serum IL-1, IL-2, IL-6, IL-8, IL-10, and TNF-α were measured by chemiluminescent immunoassay technology on the IMMULITE 1000 Immunoassay System as previously reported [14]. IL-6 was measured by the IMMULITE 2000 Immunoassay System.
2.3. Statistical Analysis
Normally distributed data of continuous variables were expressed as the and compared by an unpaired, 2-tailed -test. Otherwise, the data were represented as the median (P25 and P75) and compared by the Mann-Whitney test. Categorical variables were compared by the chi-squared test or Fisher exact test. Univariate logistic regression was performed in the training cohort to identify variables that were associated with postoperative sepsis, and then, multivariate logistic regression analysis was used to determine whether the variables included were independent.
Nomograms were built on multivariate logistic regression results using the “rms” package of R. One nomogram based on clinical characteristics and another one based on both clinical characteristics and inflammation biomarkers were developed. The predictive performance of the 2 nomograms in the training cohort was measured by -index and with 1000 bootstrap samples to decrease the overfit bias. Then, the predicted probabilities of the 2 models in the validation cohort were shown as ROC curves.
For clinical use, the total scores of each patient were calculated based on the nomograms. The cutoff value for total points of postoperative sepsis was calculated using the “OptimalCutpoints” package of R based on maximizing the Youden index. The net reclassification improvement (NRI) was calculated using the “PredictABEL” package of R. was considered to indicate statistical significance. All analyses were performed in SPSS and R, version 3.6.1.
3. Results
3.1. Clinical Characteristics and Inflammation Biomarkers
A total of 658 patients who underwent major hepatobiliary and pancreatic surgery and met the inclusion criteria were included. 522 patients and 136 patients were divided into the training and validation groups, respectively.
The inflammation biomarkers were detected at 1 day after surgery. Patients’ clinical characteristics in the training and validation cohorts were given in Table 1. There were no significant differences between the 2 cohorts in sepsis prevalence (). The finally diagnosed sepsis was found in 55 and 19 patients in the training and validation cohorts, respectively. Tables 2 and 3 show the characteristics of sepsis and nonseptic patients in the training and validation cohorts, respectively.
All patients in this study underwent postoperative (one day postsurgery) blood test for PCT, CRP, and cytokines (IL-1, IL-2, IL-6, IL-8, IL-10, and TNF-α). NLR was also collected. The median levels and interquartile ranges of inflammation biomarkers are listed in Table 4. There were no significant differences among the 2 cohorts.
3.2. Development and Validation of Nomograms
The results of univariate logistic regression analysis are presented in Table 5. The results were reported as odds ratio (95% CI). Two different multivariate logistic regression analyses were performed. The first one only included clinical characteristics as shown in Table 6, and the second one included both clinical characteristics and inflammation biomarkers as shown in Table 7. In the first regression results, perioperative blood transfusion (OR: 3.638 (1.921-6.891)), diabetes (OR: 2.378 (1.221-4.633)), operative time (OR: 1.003 (1.001-1.005)), direct bilirubin (OR: 1.004 (1.001-1.007)), and BMI (OR: 1.164 (1.057-1.281)) were independently associated with sepsis. In the second regression results, these clinical characteristics plus PCT (OR: 1.143 (1.071-1.221)) and CRP (OR: 1.175 (1.081-1.277)) were independently associated with sepsis.
Sepsis risk estimation nomograms based on the 2 multivariate regression analysis results were developed as shown in Figure 1. Both nomograms showed good accuracy in predicting sepsis. The 2 nomograms were validated using the bootstrap method in the training cohort. The first one has a -index of 0.777 (95% CI, 0.713-0.840) and a bootstrap-corrected -index of 0.761, and the second one has a -index of 0.844 (95% CI, 0.787-0.900) and a bootstrap-corrected -index of 0.831.
(a)
(b)
(c)
(d)
3.3. Compare the Performance of Nomograms for Predicting Sepsis in the Validation Cohort
The predicted sepsis probabilities of the 2 different nomograms for patients in the validation cohort were calculated. The diagnostic performances of the 2 different models for the validation cohort were evaluated by ROC curves and shown in Figure 2. In the validation cohort, the first nomogram showed an AUC of 0.756 (95% CI, 0.647-0.864); the second nomogram showed an AUC of 0.839 (95% CI, 0.745-0.932). There is a significant difference between these two ROC curves, with a value of 0.048. Besides, we could see that the AUC of model 2 was larger.
3.4. Cutoff Value of the Predicting Risk for Estimating Sepsis
To better use these nomograms for patients, the best cutoff total scores for risk estimation of the 2 nomograms were calculated based on maximizing the Youden index. We found that at cutoff total scores of 106 for the first model and 109 for the second model, respectively, these two prediction models have the largest Youden index as shown in Table 8. Using 106 for the first model and 109 for the second model as our cutoff values for high risk, the positive predictive value was 33% (validation cohort) and the negative predictive value was 91% (validation cohort) for model 1; the positive predictive value was 35% (validation cohort) and the negative predictive value was 95% (validation cohort) for model 2. The positive likelihood ratio and negative likelihood ratio in the training or validation cohort for both models are also shown in Table 8.
To demonstrate the superiority of PCT and CRP in model 2, we then compare the performance of the 2 models for the validation cohort, and the net reclassification improvement (NRI) was 0.1125 ().
4. Discussion
In this study, we developed and validated 2 different nomograms for early prediction of sepsis in patients following major hepatobiliary and pancreatic surgery. The last nomogram incorporates 2 inflammation biomarkers including the serum level of PCT and CRP. Incorporating the inflammation biomarkers and clinical risk factors into nomograms facilitates the early prediction of sepsis.
Similar to our results, a meta-analysis of over 30 million patients identified that the risk factors associated with postoperative sepsis also include perioperative blood transfusion (OR: 1.90) and diabetes (OR: 1.41) [15]. Other risk factors reported include male gender and emergency surgery [16]. Most of these studies were based on patient and surgery-related risk factors for postoperative sepsis. In our study, inflammation biomarkers like cytokines (IL-1, IL-2, IL-6, IL-8, IL-10, and TNF-α), PCT, CRP, and NLR were studied. IL-2, IL-6, IL-10, and NLR were significant after univariate regression analysis, but they were not independent risk factors for sepsis in our study.
PCT and CRP are both widely used in diagnosis of sepsis [17]. PCT is a peptide released in response to proinflammatory stimuli, particularly bacterial-related inflammatory mediators [18], although there is disagreement on the accuracy of PCT for differentiating sepsis from other noninfectious causes of SIRS (systemic inflammatory response syndrome) [19]. In this study, we found that PCT (, 1.143 (1.071-1.221)) was an independent risk factor for the occurrence of sepsis among patients who underwent major hepatobiliary and pancreatic surgery. No better markers are available that outperform PCT in diagnosis of sepsis [20, 21]. CRP showed significant differences in both training () and validation () cohorts. In multivariate analysis, CRP (, OR: 1.175 (1.081-1.277)) served as an independent risk factor. It was reported that an elevated serum CRP level is correlated with increased risk of organ failure and death [22].
Regarding clinical risk factors, preoperative direct bilirubin levels are independent risk factors for sepsis. It was reported that jaundice () was associated with 30-day mortality in patients with bacteraemic cholangitis [23]. Patients with biliary obstruction are common in hepatobiliary surgery, and much attention should be paid to these patients. BMI was also independent risk factors for sepsis in our study; BMI was reported to be associated with increased risk of infections [24]. Obese patients with kg/m2 should be noted. In our study, operative time was also an independent risk factor for sepsis. Duration of operation was reported to correlate with complications, and long duration procedures had greater risk of sepsis/sepsis shock [25]. Blood transfusion was also reported to be independently associated with higher odds of sepsis and septic shock and increased overall 30-day mortality [3]. In our study, blood transfusion was an independent risk factor for the occurrence of sepsis.
As shown in Figure 2, the last nomogram showed a bigger AUC for the validation group. And the 2 nomograms showed significant differences in predicting the sepsis risk of the validation cohort. The addition of inflammation biomarkers into the predictive model obtained satisfactory improvement for sepsis prediction (the -index of model 1 was 0.777 in the training cohort and 0.756 in the validation cohort; the -index of model 2 was 0.844 in the training cohort and 0.839 in the validation cohort). For clinical use of the 2 models, we evaluate the sensitivity, specificity, positive predictive value, and negative predictive value in risk estimation of sepsis using the method of Youden index. Patients with total scores more than 109 in model 2 are at a high-risk subgroup of sepsis. A high negative predictive value (97% in the training cohort) was yielded, but the positive predictive value (27% in the training cohort) was less impressive. Considering that the cost for early interventions such as the timely use of antibiotics and the improvement of bacterial culture tests is low and the patients will get the maximum benefit, we believe that the last model will allow surgeons to estimate the sepsis risk of patients who underwent major hepatobiliary and pancreatic surgery soon after surgery, and corrective treatment can be applied in time.
A limitation of our study mainly includes its retrospective design and a relatively smaller sample size. Patients in training and validation groups come from a split of all patients by time in our institution rather than an independent group of patients. Therefore, more strict external validation and prospective study are needed.
5. Conclusion
By combining clinical and inflammatory risk factors, we constructed a nomogram for postoperative sepsis for patients following major hepatobiliary and pancreatic surgery. This model can provide the early risk estimation of sepsis for patients after major hepatobiliary and pancreatic surgery.
Data Availability
The data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflict of interest.
Authors’ Contributions
Haoyun Zhang and Fanyu Meng contributed equally to this work and are co-first authors.
Acknowledgments
This research was supported by grants from the National Key R&D Program of China (2017YFA0103003).