Research Article | Open Access
Su-Han Chang, Chiao-Hsuan Hsieh, Yi-Ming Weng, Ming-Shun Hsieh, Zhong Ning Leonard Goh, Hsien-Yi Chen, Tung Chang, Chip-Jin Ng, Joanna Chen-Yeen Seak, Chen-Ken Seak, Chen-June Seak, "Performance Assessment of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score, and Rapid Acute Physiology Score in Predicting Survival Outcomes of Adult Renal Abscess Patients in the Emergency Department", BioMed Research International, vol. 2018, Article ID 6983568, 8 pages, 2018. https://doi.org/10.1155/2018/6983568
Performance Assessment of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score, and Rapid Acute Physiology Score in Predicting Survival Outcomes of Adult Renal Abscess Patients in the Emergency Department
Background. Renal abscess is a relatively uncommon yet debilitating and potentially fatal disease. There is no clearly defined, objective risk stratification tool available for emergency physicians’ and surgeons’ use in the emergency department (ED) to quickly determine the appropriate management strategy for these patients, despite early intervention having a beneficial impact on survival outcomes. Objective. This case control study evaluates the performance of Mortality in Emergency Department Sepsis Score (MEDS), Modified Early Warning Score (MEWS), Rapid Emergency Medicine Score (REMS), and Rapid Acute Physiology Score (RAPS) in predicting risk of mortality in ED adult patients with renal abscess. This will help emergency physicians, surgeons, and intensivists expedite the time-sensitive decision-making process. Methods. Data from 152 adult patients admitted to the EDs of two training and research hospitals who had undergone a contrast-enhanced computed tomography scan of the abdomen and was diagnosed with renal abscess from January 2011 to December 2015 were analyzed, with the corresponding MEDS, MEWS, REMS, RAPS, and mortality risks calculated. Ability to predict patient mortality was assessed via receiver operating curve analysis and calibration analysis. Results. MEDS was found to be the best performing physiologic scoring system, with sensitivity, specificity, and accuracy of 87.50%, 88.89%, and 88.82%, respectively. Area under receiver operating characteristic curve (AUROC) value was 0.9440, and negative predictive value was 99.22% with a cutoff of 9 points. Conclusion. Our study is the largest of its kind in examining ED patients with renal abscess. MEDS has been demonstrated to be superior to MEWS, REMS, and RAPS in predicting mortality for this patient population. We recommend its use for evaluation of disease severity and risk stratification in these patients, to expedite identification of critically ill patients requiring urgent intervention.
Renal abscess, while being relatively uncommon at an incidence of 1 to 10 in 10,000 hospital admissions [1–3], is a debilitating and potentially fatal disease with mortality rates historically ranging from 12% to 50% [2, 4]. With the advent of ultrasonography and computed tomography imaging techniques enabling the early identification of patients with renal abscess and subsequent prompt intervention, survival rates have improved; nevertheless, mortality still reaches up to 8.3% currently [3, 5, 6].
Management of renal abscess comprises antimicrobial therapy, percutaneous drainage, surgical drainage, and nephrectomy [2, 4, 7]. Though surgical drainage and nephrectomy are often avoided as first-line interventions, Meng et al. (2002) demonstrated that 35% of patients ultimately required exploratory laparotomy and nephrectomy while Coelho et al. (2007) found that 18.5% and 23.1% of renal abscess patients had received surgical drainage and nephrectomy, respectively [4, 5]. Apart from being the last-ditch intervention after failure of medical therapy, nephrectomy is also indicated for renal abscesses which develop in small, scarred, poorly functioning kidneys ; however, it is almost impossible to establish this history in the emergency department (ED) setting as patients with such a condition usually present in a critical state, complicating the time-sensitive decision-making process for emergency physicians and surgeons.
Early appropriate intervention improves the survival outcome of each renal abscess patient; therefore, it is imperative that they are initiated on the right therapy in the ED immediately after accurate assessment of disease severity and the corresponding mortality risk. There is however yet a clearly defined, objective risk stratification tool that lays down the criteria which justifies the decision of choosing medical therapy over surgical intervention and vice versa.
Various studies have suggested that the prognosis of renal abscess patients is related to certain variables such as the presence of lethargy, elevated blood urea nitrogen, thrombocytopenia, abscess size, and serum C-reactive protein levels [6, 9, 10]. These variables nevertheless do not constitute a complete risk stratification tool, and thus we employed four already-established ED scoring systems and studied their performance in predicting the mortality risk of renal abscess patients in the ED.
The four chosen physiologic scoring systems are the more commonly used ones: Rapid Acute Physiology Score (RAPS) , Rapid Emergency Medicine Score (REMS) [12, 13], Modified Early Warning Score (MEWS) , and Mortality in Emergency Department Sepsis Score (MEDS) [15, 16]. These systems are comprised of easily and rapidly obtainable parameters that can be calculated by the bedside, allowing emergency physicians, surgeons, and intensivists to quickly and accurately identify critically ill patients in whom urgent intervention is necessitated.
This study is a continuation in our series of investigations into the use of scoring systems for risk stratification of patients with abdominal infections to improve patient outcomes. Our first study evaluated the performance of Simplified Acute Physiology Score II (SAPS II), the Acute Physiology and Chronic Health Evaluation II (APACHE II) score, and the Sequential Organ Failure Assessment (SOFA) score in predicting mortality of adult hepatic portal venous gas (HPVG) patients presenting to the ED and found that SAPS II performed the best . We however realised that SAPS II, a score devised for intensive care units (ICUs), was not optimised for all ED environments. This was because some parameters of SAPS II required results of various investigations, readily available in the ICU, but cumbersome or not possible in some ED settings.
As such, we undertook a second study using ED scoring systems which incorporated parameters based on rapidly obtainable vital signs, while concurrently expanding our recruitment of adult ED HPVG patients to span 16.5 years. REMS was shown to outperform RAPS and MEWS .
Our third study was embarked upon to determine if there was any value in consideration of patient characteristics on top of clinical parameters, and if the results derived from the HPVG patient population could be similarly applied to splenic abscess ED patients. Statistical analysis results demonstrated that MEDS was superior to MEWS, REMS, and RAPS, thus giving merit to the hypothesis that patient characteristics should also be considered in patients with abdominal infections. We were however surprised to note that the performance of REMS in predicting mortality of splenic abscess patients was ranked last .
This current study was conceived with three aims: first, to evaluate the suitability of these four aforementioned ED scoring systems in patients with renal abscess, an abdominal infection with differing aetiology and pathogenesis from HPVG and splenic abscess; second, to ascertain the superiority of MEDS in the ED renal abscess patient population as a risk stratification tool which incorporates clinical parameters with patient characteristics; third, to assess the next-best score amongst RAPS, REMS, and MEWS to employ. MEDS’s strength of taking into account patient characteristics is a potential weakness if past history cannot be adequately established quickly. This could be due to neurological deficits of the patient, lack of accompanying family members, or language barriers, amongst other issues, Plan B is required in such cases.
2. Materials and Methods
2.1. Study Design
This retrospective analysis was conducted at the EDs of two training and research hospitals, Linkou Chang Gung Memorial Hospital (3406 beds with approximately 17000 monthly ED visits in 2017) and Taipei Chang Gung Memorial Hospital (252 beds with approximately 4200 monthly ED visits in 2017). The Chang Gung Memorial Hospital Institutional Review Board approved this study (IRB: 201701502B0C501), waiving the need for consent from study participants. Data was accessed anonymously.
2.2. Settings and Subjects
All adult patients above the age of 18 years admitted to the ED who had undergone a contrast-enhanced computed tomography scan of the abdomen and was diagnosed with renal abscess from January 2011 to December 2015 were recruited. Those with concomitant abdominal infections were excluded from the study.
2.3. Criteria of Renal Abscess
The diagnosis of renal abscess was confirmed upon meeting at least 1 of the following criteria: (1) intraoperative findings of renal abscess; (2) histopathological evidence of renal abscess; and in the absence of surgical intervention, (3) positive clinical, laboratory, and imaging findings consistent with the diagnosis.
2.4. Measurement of Variables
Pertinent data was retrieved from the ED records of the identified patients and used to calculate the respective physiological scoring systems (Tables 1–4). Septic shock was defined in accordance with the Second International Consensus Definitions for Sepsis and Septic Shock criteria (2001) . Patient mortality or survival upon discharge were taken as study endpoints.
PR, pulse rate; MAP, mean arterial pressure; RR, respiratory rate; GCS, Glasgow Coma Scale.
PR, pulse rate; MAP, mean arterial pressure; RR, respiratory rate; GCS, Glasgow Coma Scale; SpO2, peripheral oxygen saturation.
as disease condition with >50% likelihood of predicted fatality within 30 days or metastatic cancer. as respiratory rate > 20 breaths/min or requiring oxygen by mask or SpO2 < 90%. as any difference from the patient’s baseline in any of the three spheres of orientation or in their level of alertness.
2.5. Statistical Analysis
Median and interquartiles of numerical variables, as well as frequencies and corresponding percentages (%) of categorial variables, were recorded. Univariate analyses were conducted to establish the relationship between predictors and mortality rates; Mann–Whitney U tests and Fisher’s exact tests were selected for such analyses for numerical and categorical variables, respectively, in view of the small nonsurvivor group size. Univariate logistic regression analysis was done to develop predictive models between scoring systems and mortality, with Hosmer-Lemeshow statistical analysis used to determine model goodness of fit.
Receiver operating characteristic (ROC) curve analysis was performed to evaluate the performance of scoring systems in predicting mortality. Following that, optimal cutoff point for each scoring system was identified by maximizing Youden’s index. Last but not least, the corresponding accuracies, sensitivities, specificities, positive predictive values, and negative predictive values of the respective optimal cutoff points were calculated.
2.6. Patient Involvement
No patients were directly involved in this study. Hospitalization records were accessed anonymously, with only the relevant required information extracted for the study.
A total of 152 patients aged 19 to 91 were identified in Linkou Chang Gung Memorial Hospital and Taipei Chang Gung Memorial Hospital over the span of 5 years. Statistically significant results (p < 0.05) are as follows, expressed in terms of survivors versus nonsurvivors: 0% versus 37.5% with terminal illness, pulse rate of 114 versus 144 beats per minute, respiratory rate of 20 versus 28 breaths per minute, 19.44% versus 75% with tachypnea or hypoxia, SpO2 of 100% versus 83%, mean arterial pressure of 76.67 mmHg versus 65.67 mmHg, 4.86% versus 25% with Glasgow Coma Scale <12 at presentation to ED, 9.72% versus 62.5% with altered mental status, 19.44% versus 62.5% with bandemia, 18.75% versus 87.5% with estimated glomerular filtration rate < 50%, 9.72% versus 62.5% with septic shock, MEDS score of 3 versus 12, REMS of 5 versus 9, RAPS of 2 versus 6, and MEWS of 4 versus 8 (Table 5).
indicates a statistically significant difference between survivors and nonsurvivors.
Univariate logistic regression analysis of the scoring systems with respect to probability of death found the following odds ratios: 1.571 for MEDS (p = 0.0001), 1.529 for MEWS (p = 0.0035), 1.619 for RAPS (p = 0.0009), and 1.528 for REMS (p = 0.0009) (Table 6). Hosmer-Lemeshow statistical tests found all four models to be a good fit (MEDS 0.8249, MEWS 0.3598, RAPS 0.2430, and REMS 0.3111).
indicates a statistically significant difference between survivors and nonsurvivors.
Area under ROC (AUROC) analysis revealed the predictability of MEDS, REMS, RAPS, and MEWS as 0.9440 (p<0.001), 0.8355 (p=0.001), 0.8060 (p=0.004), and 0.7826 (p=0.007), respectively (Figure 1). With an optimal cutoff of 9, the negative predictive value of MEDS was found to be 99.22% (Table 7). Youden’s indexes for the respective scores were as follows: MEDS 0.7639, REMS 0.5278, RAPS 0.5972, and MEWS 0.5556.
This study is the largest yet examining renal abscess patients in the ED and also the first to the best of our knowledge to use ED physiologic scoring systems for risk stratification of these patients. We found MEDS to be the most ideal tool in predicting mortality rates of ED patients with renal abscess.
MEDS was designed and validated by Shapiro et al. in 2003 to risk stratify ED patients suspected to have infections according to risk of mortality. It comprises 9 parameters: age > 65 years, nursing home resident, rapid terminal comorbid illness, lower respiratory tract infection, bands >5% on a white blood cell count differential, tachypnea or hypoxemia, septic shock, platelet count < 150 x 109/L, and altered mental status. The calculated score is then directly proportional to the patient’s mortality risk . Its original intended target population of ED patients with infections sets it apart from the other 3 scoring systems, which were designed with different patient populations in mind. This might explain why MEDS is the most accurate tool in predicting mortality of renal abscess patients, as these patients usually succumb to sepsis and septic shock.
MEDS has also been demonstrated to be a good predictor of prognosis in patients with other intra-abdominal infections [19, 21, 22] and even performs better than other more established risk assessment tools including APACHE II and quick Sepsis-related Organ Failure Assessment in determining mortality risk of ED patients in infection and/or sepsis [23–30]. Its superiority in this study provides further evidence that both clinical presentation and patient characteristics are significant in assessing mortality risk of patients with abdominal infections as mentioned in our introduction, almost half of the 9 criteria in MEDS (age, nursing home resident, terminal illness, altered mental status) are dependent on the patient’s medical history that is easily and quickly ascertainable in the ED.
Univariate analysis in this study found that pulse rate, respiratory rate, tachypnea or hypoxia, SpO2, mean arterial pressure, Glasgow Coma Scale, altered mental status, estimated glomerular filtration rate, presence of septic shock, and positive history of terminal illness were significant in predicting the mortality of a renal abscess patient. These findings further reinforce the relationship between septic shock and mortality risk; other than presence of septic shock, most of the other significant parameters are classical findings in septic patients: tachycardia, tachypnea, hypotension, altered mental status, bandemia, and acute kidney injury. Patients with terminal illnesses are also more prone to developing sepsis. Interestingly, the number of abscesses did not have a significant impact on patient mortality, suggesting that preventing, limiting, and resolving sepsis are more important in mortality reduction than abscess characteristics.
The success of MEDS thus lies in its more suitable physiological parameters and incorporation of 5 significant variables (terminal illness, tachypnea or hypoxia, septic shock, bandemia, and altered mental status) into its scoring, enabling it to stratify patients with the highest accuracy rate of 88.82% and sensitivity of 87.50% amongst the 4 scoring systems studied. The high negative predictive value of 99.22% further enables emergency physicians and surgeons to decisively exclude renal abscess patients with a MEDS score of less than 9 from the high-risk group, and as such conservative management of antimicrobial therapy and/or percutaneous drainage can be justified, thus avoiding unnecessary emergency nephrectomies. The AUROC value of 0.9440 for MEDS also demonstrates that it is ideal for predicting mortality in patients with renal abscess. Though MEDS comprises more parameters than the other 3 physiologic scores, the extra information required is easily established through history taking and biochemical investigations routinely done during patient evaluation in the ED.
We nevertheless recognize that there will be certain situations in which patient history cannot be adequately established quickly in the ED, rendering emergency physicians unable to calculate MEDS. In these cases, our findings show that REMS is the next-best risk stratification tool to predict mortality in renal abscess patients, similar to study conclusions of our investigation into HPVG patients . Future efforts could be directed into further determining the superiority of REMS in relation to RAPS and MEWS for ED populations with other abdominal infections, so as to identify the optimal score to employ if only patient’s vital signs are available.
Despite being the largest study of renal abscess patients in the ED, this study is still limited by the small number of participants. There were only 2 patients who fulfilled each criteria of “nursing home resident” and “lower respiratory tract infection”, two important factors in the MEDS scoring system; the utility of MEDS in our study may therefore be an underestimate. Larger studies which include more patients who fulfil these criteria would aid in providing an even more accurate assessment of MEDS. Further studies to confirm these findings and prospectively validate the use of MEDS in this patient population is also required.
MEDS score is the best performing physiologic scoring system amongst the four studied systems in predicting the mortality of renal abscess patients. We recommend its employment in the ED for rapid risk stratification to promptly ascertain which patients require urgent intervention, thus ensuring timely and early intervention and subsequently improved patient outcomes.
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
The Chang Gung Memorial Hospital Institutional Review Board approved this study (IRB: 201701502B0C501), waiving the need for consent from study participants.
Obtaining a consent form was not applicable in this work as data was accessed anonymously.
Su-Han Chang and Chiao-Hsuan Hsieh are the first authors. Both funders had no role in study design, data collection and analysis, decision to publish, or preparation in the manuscript
Conflicts of Interest
The authors declare that they have no conflicts of interest.
Conceptualization was done by Zhong Ning Leonard Goh, Joanna Chen-Yeen Seak, Chen-Ken Seak, and Chen-June Seak. Data was curated by Su-Han Chang, Chiao-Hsuan Hsieh, Hsien-Yi Chen, and Tung Chang and formally analyzed by Ming-Shun Hsieh and Chen-June Seak. Funding was acquired by Chen-June Seak. Investigation was led by Yi-Ming Weng and Chip-Jin Ng, under supervision by Chen-June Seak. Visualization was performed by Joanna Chen-Yeen Seak, Chen-Ken Seak, and Chen-June Seak. The original draft of the manuscript was written by Su-Han Chang and Chiao-Hsuan Hsieh. Review and editing were subsequently done by Zhong Ning Leonard Goh and Chen-June Seak. All authors read and approved the final manuscript. Su-Han Chang and and Chiao-Hsuan Hsieh contributed equally to this article.
The study was supported by Chang Gung Memorial Hospital in Taiwan [CORPG3F0931] and the Maintenance Project for Center for Big Data Analytics and Statistics [Grant CLRPG3D0043] from Chang Gung Memorial Hospital for Statistical Analysis. The authors would like to thank Hsiao-Jung Tseng, Chia-Hsun Chang, and Nian-Ting Shie for their assistance in analyzing part of the data.
- F. N. Hutchinson and G. A. Kaysen, “Perinephric abscess: the missed diagnosis,” Medical Clinics of North America, vol. 72, no. 5, pp. 993–1014, 1988.
- L.-M. Dembry and V. T. Andriole, “Renal and perirenal abscesses,” Infectious Disease Clinics of North America, vol. 11, no. 3, pp. 663–680, 1997.
- R. A. Gardiner, R. A. Gwynne, and S. A. Roberts, “Perinephric abscess,” BJU International, vol. 107, no. 3, pp. 20–23, 2011.
- M. V. Meng, L. A. Mario, and J. W. McAninch, “Current treatment and outcomes of perinephric abscesses,” The Journal of Urology, vol. 168, no. 4, part 1, pp. 1337–1340, 2002.
- R. F. Coelho, E. D. Schneider-Monteiro, J. L. B. Mesquita, E. Mazzucchi, A. Marmo Lucon, and M. Srougi, “Renal and perinephric abscesses: Analysis of 65 consecutive cases,” World Journal of Surgery, vol. 31, no. 2, pp. 431–436, 2007.
- H.-S. Lin, J.-J. Ye, and T-Y. Huang, “Characteristics and factors influencing treatment outcome of renal and perinephric abscess a 5-year experience at a tertiary teaching hospital in Taiwan,” Journal of Microbiology, Immunology and Infection, vol. 41, pp. 342–350, 2008.
- T. Shu, J. M. Green, and E. Orihuela, “Renal and perirenal abscesses in patients with otherwise anatomically normal urinary tracts,” The Journal of Urology, vol. 172, no. 1, pp. 148–150, 2004.
- G. S. Hill, “Renal infection,” in Uropathology, G. S. Hill, Ed., p. 33, Churchill Livingstone, New York, NY, USA, 1st edition, 1989.
- D. H.-T. Yen, S.-C. Hu, J. Tsai et al., “Renal abscess: Early diagnosis and treatment,” The American Journal of Emergency Medicine, vol. 17, no. 2, pp. 192–197, 1999.
- C.-H. Hung, J.-D. Liou, M.-Y. Yan, and C.-C. Chang, “Immediate percutaneous drainage compared with surgical drainage of renal abscess,” International Urology and Nephrology, vol. 39, no. 1, pp. 51–55, 2007.
- S. Goodacre, J. Turner, and J. Nicholl, “Prediction of mortality among emergency medical admissions,” Emergency Medicine Journal, vol. 23, no. 5, pp. 372–375, 2006.
- T. Olsson, A. Terent, and L. Lind, “Rapid Emergency Medicine score: A new prognostic tool for in-hospital mortality in nonsurgical emergency department patients,” Journal of Internal Medicine, vol. 255, no. 5, pp. 579–587, 2004.
- T. Olsson and L. Lind, “Comparison of the rapid emergency medicine score and APACHE II in nonsurgical emergency department patients,” Academic Emergency Medicine, vol. 10, no. 10, pp. 1040–1048, 2003.
- M. Bulut, H. Cebicci, D. Sigirli et al., “The comparison of modified early warning score with rapid emergency medicine score: a prospective multicentre observational cohort study on medical and surgical patients presenting to emergency department,” Emergency Medicine Journal, vol. 31, no. 6, pp. 476–481, 2014.
- N. I. Shapiro, R. E. Wolfe, R. B. Moore, E. Smith, E. Burdick, and D. W. Bates, “Mortality in Emergency Department Sepsis (MEDS) score: a prospectively derived and validated clinical prediction rule,” Critical Care Medicine, vol. 31, no. 3, pp. 670–675, 2003.
- J. D. Sankoff, M. Goyal, D. F. Gaieski et al., “Validation of the Mortality in Emergency Department Sepsis (MEDS) score in patients with the systemic inflammatory response syndrome (SIRS),” Critical Care Medicine, vol. 36, no. 2, pp. 421–426, 2008.
- C.-J. Seak, C.-J. Ng, D. H.-T. Yen et al., “Performance assessment of the Simplified Acute Physiology Score II, the Acute Physiology and Chronic Health Evaluation II score, and the Sequential Organ Failure Assessment score in predicting the outcomes of adult patients with hepatic portal venous gas in the ED,” The American Journal of Emergency Medicine, vol. 32, no. 12, pp. 1481–1484, 2014.
- C.-J. Seak, D. H.-T. Yen, C.-J. Ng et al., “Rapid Emergency Medicine Score: A novel prognostic tool for predicting the outcomes of adult patients with hepatic portal venous gas in the emergency department,” PLoS ONE, vol. 12, no. 9, p. e0184813, 2017.
- S.-K. Hung, C.-J. Ng, C.-F. Kuo et al., “Comparison of the Mortality in Emergency Department Sepsis Score, Modified Early Warning Score, Rapid Emergency Medicine Score and Rapid Acute Physiology Score for predicting the outcomes of adult splenic abscess patients in the emergency department,” PLoS ONE, vol. 12, no. 11, p. e0187495, 2017.
- M. M. Levy, M. P. Fink, J. C. Marshall et al., “2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis definitions conference,” Intensive Care Medicine, vol. 29, no. 4, pp. 530–538, 2003.
- S.-H. Kuo, Y.-T. Lee, C.-R. Li et al., “Mortality in Emergency Department Sepsis score as a prognostic indicator in patients with pyogenic liver abscess,” The American Journal of Emergency Medicine, vol. 31, no. 6, pp. 916–921, 2013.
- C.-C. Lee, S.-Y. Chen, C.-L. Tsai et al., “Prognostic value of mortality in emergency department sepsis score, procalcitonin, and C-reactive protein in patients with sepsis at the emergency department,” Shock, vol. 29, no. 3, pp. 322–327, 2008.
- C.-C. Chen, C.-F. Chong, Y.-L. Liu, K.-C. Chen, and T.-L. Wang, “Risk stratification of severe sepsis patients in the emergency department,” Emergency Medicine Journal, vol. 23, no. 4, pp. 281–285, 2006.
- J. M. Williams, J. H. Greenslade, K. Chu, A. F. T. Brown, and J. Lipman, “Severity Scores in Emergency Department Patients with Presumed Infection: A Prospective Validation Study,” Critical Care Medicine, vol. 44, no. 3, pp. 539–547, 2016.
- J. Wang, Y. Chen, S. Guo, X. Mei, and P. Yang, “Predictive performance of quick Sepsis-related Organ Failure Assessment for mortality and ICU admission in patients with infection at the ED,” The American Journal of Emergency Medicine, vol. 34, no. 9, pp. 1788–1793, 2016.
- R. S. Nannan Panday, T. C. Minderhoud, N. Alam, and P. W. B. Nanayakkara, “Prognostic value of early warning scores in the emergency department (ED) and acute medical unit (AMU): A narrative review,” European Journal of Internal Medicine, vol. 45, pp. 20–31, 2017.
- C. Vorwerk, B. Loryman, T. J. Coats et al., “Prediction of mortality in adult emergency department patients with sepsis,” Emergency Medicine Journal, vol. 26, no. 4, pp. 254–258, 2009.
- E. Çildir, M. Bulut, H. Akalin, E. Kocabaş, G. Ocakoǧlu, and Ş. A. Aydin, “Evaluation of the modified MEDS, MEWS score and Charlson comorbidity index in patients with community acquired sepsis in the emergency department,” Internal and Emergency Medicine, vol. 8, no. 3, pp. 255–260, 2013.
- F. Geier, S. Popp, Y. Greve et al., “Severity illness scoring systems for early identification and prediction of in-hospital mortality in patients with suspected sepsis presenting to the emergency department,” Wiener Klinische Wochenschrift, vol. 125, no. 17-18, pp. 508–515, 2013.
- M. D. Howell, M. W. Donnino, D. Talmor, P. Clardy, L. Ngo, and N. I. Shapiro, “Performance of Severity of Illness Scoring Systems in Emergency Department Patients with Infection,” Academic Emergency Medicine, vol. 14, no. 8, pp. 709–714, 2007.
Copyright © 2018 Su-Han Chang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.