Abstract
Aim of the Study. To evaluate the ability of the prehospital National Early Warning Score 2 scale (NEWS2) to predict early mortality (within 48 hours) after the index event based on the triage priority assigned for any cause in the emergency department. Methods. This is a multicenter longitudinal observational cohort study on patients attending Advanced Life Support units and transferred to the emergency department of their reference hospital. We collected demographic, physiological, and clinical variables, main diagnosis, and hospital triage level as well as mortality. The main outcome variable was mortality from any cause within two days of the index event. Results. Between April 1 and November 30, 2018, a total of 1054 patients were included in our study. Early mortality within the first 48 hours after the index event affected 55 patients (5.2%), of which 23 cases (41.8%) had causes of cardiovascular origin. In the stratification by triage levels, the AUC of the NEWS2 obtained for short-term mortality varied between 0.77 (95% CI: 0.65-0.89) for level I and 0.94 (95% CI: 0.79-1) for level III. Conclusions. The Prehospital Emergency Medical Services should evaluate the implementation of the NEWS2 as a routine evaluation, which, together with the structured hospital triage system, effectively serves to predict early mortality and detect high-risk patients.
1. Introduction
Structured triage is a critical process that simplifies decision-making and favors efficient and effective management of a high patient flow [1, 2], making its use in the emergency department (ED) undebatable. However, in the prehospital context, the adaptation of structured triage systems seems to be not as efficient, equally because of the complex and time-consuming application and because of the lack of information in the initial moments, which hinders its applicability outside the hospital setting [3].
The Prehospital Emergency Medical Services (PhEMS) have a growing interest in implementing systems in their operational protocols that allow them to quickly and effectively classify critical patients beyond accidents with multiple victims or catastrophes in which they are already using different specific triage systems designed for this purpose [4, 5].
Today, PhEMS have a wide range of techniques, procedures, and materials for managing multiple pathologies, wherever the patient is. However, their diagnostic capacity is based on an objective and structured clinical evaluation and on a few complementary tests (vital signs, electrocardiogram, and basic analytical determinations) [6]. In this context, recent years have seen the development of different scales that assess the initial severity of patients with prognostic implications called the Early Warning Score (EWS) [4]. Of these, the National Early Warning Score 2 (NEWS2) is the most used internationally and validated in the prehospital context [7, 8]. The NEWS2 has a high predictive capacity [9] and is an excellent tool helping professionals in clinical decision-making [10, 11].
Although the NEWS2 has been evaluated as a predictor of mortality, few prospective studies in the prehospital setting have assessed its usefulness.
The aim of this study was to evaluate the capacity of the prehospital scale NEWS2 in relation to the classification of hospital triage to predict early mortality within 48 hours of the index event. In addition, we explored the performance of this scale in estimating mortality at 7 and 30 days.
2. Methods
The study protocol is available online (doi.org/10.1186/ISRCTN17676798). We follow the STROBE statement for reporting.
2.1. Ethical Approval
This study was approved by the Research Ethics Committees of all participating centers (reference REC: #PI 18-010, #PI 18-895, and #PI 2018-10/119). All patients (or guardians) signed informed consent.
2.2. Source of Data
A prospective multicenter longitudinal observational cohort study was carried out as part of the “Use of Early Warning Scales in the Prehospital Scope as a Diagnostic and Prognostic Tool” project of the regional health management of Castilla y León (GRS 1678/A/18), which includes admissions in the Rio Hortega University Hospital and University Clinic of Valladolid, the Hospital Complex of Segovia, and University Assistance Complex of Salamanca, belonging to the public health system of the Autonomous Community of Castilla y León (Spain). The clinical and administrative data included in the database are records of prehospital vital signs, demographic patient data, and level of triage assigned in the ED and mortality (in the hospital).
Prehospital vital signs were recorded in a written document in the place of patient care by the registered nurse (ERN); the remaining data were obtained by reviewing the patients’ electronic history 30 days after the index event.
2.3. Participants
The study was performed in three provinces of Spain (Valladolid, Salamanca, and Segovia), with a reference population of 886,098 inhabitants, and on all patients attending the five Advanced Life Support (ALS) and referred to its reference hospitals of the public health system between April 1 and November 30, 2018.
Patients were included in the study if they had been evaluated and transferred by an ALS to the ED of the reference hospital and did not meet any exclusion criteria, which were age below 18 years, cardiorespiratory arrest, death on arrival or during transfer, pregnant women, patients with psychiatric pathology or terminal pathology, time of arrival above 45 minutes, and/or patients evacuated by other means of transport or discharged in situ.
2.4. Outcomes
The main outcome variable was mortality from any cause within two days, stratified by the level of hospital triage assigned in the ED. Mortality was also studied at 7 and 30 days from the index event.
2.5. Predictors
At the time of prehospital care, the ERN of each ALS collected the necessary clinical variables for the NEWS2: respiratory rate, oxygen saturation, heart rate, systolic blood pressure, temperature, confusion state (confusion was defined as a score of less than 15 points on the Glasgow Coma Scale), and the use of oxygen [12].
The ERN together with the MD of each ALS, upon arriving at the place of the incident, through the anamnesis directed and the review of the clinical history, determines if the patient presents some type of obstructive pulmonary disease, selecting in this way which respiratory scale of the NEWS2 should be used in each specific case.
The neurological evaluation of each patient was performed conscientiously using the Glasgow Coma Scale, when the patient presented a situation of delirium, was considered not responding consistently to orders, and was categorized with a score in the Glasgow Coma Scale minor of 15 points; therefore it was classified as an alteration of the mental state, classification that coincidences with the AVPU [Alert, Verbal, Pain, Unresponsive] scale.
Temperature was measured using a ThermoScan® PRO 6000 tympanic thermometer (Welch Allyn, Inc., Skaneateles Falls, USA), and measurements of blood pressure, heart rate, and oxygen saturation were made with the LIFEPAK® 15 monitor (Physio-Control, Inc., Redmond, USA) and Corpuls3 (WEINMANN Emergency Medical Technology GmbH, Hamburg, Germany).
In a second time, we collected the demographic variables (sex and age), reason for call, times for arrival, assistance and transfer, prehospital Advanced Life Support maneuvers requiring special follow-up, which include use of intravenous medication or supplementary oxygen, and/or advanced management of the airway (including orotracheal intubation, noninvasive ventilation, and difficult airway). The prehospital primary diagnosis based on the International Classification of Diseases ICD 11 was also collected.
Subsequently, a researcher from each hospital collected the following variables from the electronic history of the patients 30 days after emergency care: mortality from any cause within two days, mortality at 7 and 30 days from the index event, and level of triage assigned in the ED by the Spanish triage system (STS) [13, 14]. This computer program is implemented throughout the public health system of the Autonomous Community of Castilla y León and consists of five levels of prioritization (level I: resuscitation, level II: emergency, level III: urgent, level IV: less urgent, and level V: not urgent).
2.6. Missing Data
Prior to applying statistical techniques, the database was cleaned using logical tests, range tests (for detecting extreme values), and data consistency tests. Subsequently, we checked for the presence and distribution of the unknown values of all variables.
2.7. Statistical Analysis Methods
All data were stored in an XLSTAT® Biomed database for Microsoft Excel® (version 14.4.0.) and Statistical Product and Service Solutions (SPSS, version 20.0), with which the subsequent statistical analysis was carried out.
Quantitative variables were described as median and interquartile range (IQR) and qualitative variables were described by absolute and relative frequencies.
To compare quantitative variables in two groups, we applied the U-Mann-Whitney test. The Chi-square test was used to study the association between qualitative binary variables. When the frequencies observed in the table discouraged the use of these tests, we used Fisher’s exact test.
For the global mortality at 2 days, 7 days, and 30 days, we calculated the area under the curve (AUC) of the receiver operating characteristic (ROC) of the NEWS2 scale and the best score that offered in each case greatest sensitivity and joint specificity. For these scores, we also obtained the positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (PLR), and negative likelihood ratio (NLR).
In all the hypothesis tests, we considered significant a p-value of less than 0.05 and chose the usual confidence intervals of 95%.
3. Results
3.1. Main Findings
Between April 1 and November 30, 2018, a total of 1054 patients were included in our study (Figure 1). The median age was 68 years (IQR, 53-81 years), and 418 (39.7%) of the patients were female. The reasons for the demand for care were mostly medical ones with 832 cases (78.9%).
To calculate the NEWS2 during prehospital care, we systematically evaluated all the participants. Nonsurvivors presented a higher respiratory rate, lower oxygen saturation, and an increased presence of confusion with respect to the survivors (p <0.001).
We observed that 90.9% of nonsurvivors needed supplemental oxygen compared to 30.9% in survivors, and 45.5% needed advanced airway management (4.8% in survivors). Regarding the prehospital main diagnosis, processes of cardiovascular origin stood out, 443 cases (42.1%) (Table 1).
3.2. Mortality and NEWS2
Early mortality after the index event within the first 48 hours occurred in 55 patients (5.2%), mostly deaths from causes of cardiovascular origin in 23 cases (41.8%). Mortality at 7 days from the index event increased to 81 cases (7.7%) and up to 119 cases (11.3%) at 30 days.
The predictive power of the NEWS2 scale to discriminate mortality at 2, 7, and 30 days is evidenced by an AUC of 0.88 (95% CI: 0.82-0.94), 0.86 (95% CI: 0.81-0.91), and 0.82 (95% CI: 0.77-0.87), verifying how its capacity to assess mortality fell by 6% between the AUC at 2 days and the AUC at 30 days.
3.3. Mortality and Spanish Triage System
With respect to early mortality according to the assigned triage priority in the ED, in level I (resuscitation) the mortality rate was 24.4%, in level II (emergency) 5.5%, and in level III (urgency) 0.9%. Table 1 shows the distribution of cases according to the level of triage.
3.4. Comparison between NEWS2 and Spanish Triage System
When stratified by triage levels, the AUCs of the NEWS2 obtained for short-term mortality varied between 0.77 (95% CI: 0.65-0.89) for level I and 0.94 (95% CI: 0.79 -1) for level III (Figure 2). However, in the analysis of mortality at 7 and 30 days, the best AUC of the NEWS2 has been found for level I with 0.85 (95% CI: 0.76-0.95) for the 7-day mortality and 0.83 (IC 95% CI: 0.74-0.92) for 30 days.
Table 2 shows the best cutoff points in terms of sensitivity and specificity for the NEWS2 according to priority levels and mortality at 2, 7, and 30 days. In the analysis of short-term mortality, we observed that a NEWS2 score greater than or equal to 7 among patients with priority III had a sensitivity of 100 (95% CI 56.6-100) and a specificity of 78.7 (95% CI 75.1-81.9) with a PPV of 4.1 (1.8-9.3) and a NPV of 100 (99.1-100). Meanwhile, in patients with priorities I and II, the cutoff point with better sensitivity and joint specificity rose to 9 points in both cases, with associated NPV of 92.5 (95% CI: 82.1-97.0) for level I and 98.4 (95% IC: 96.2-99.3) for level II (Table 2).
4. Discussion
4.1. Main Findings
This is the first study evaluating the performance of the joint use of NEWS2 at the prehospital level with the Spanish triage system at hospital level to detect patients at risk of early mortality within 2 days.
Our study shows that the combined use of the NEWS2 and hospital triage can help to identify patients with a high risk of early death, including those that a priori were not emergencies or resuscitation cases.
The capacity decreases progressively in predicting mortality at 7 and 30 days, diminishing its effectiveness globally.
Our results are consistent with those of previous studies [1, 15–20], where the combination of physiological and clinical data from the NEWS2 together with additional data at hospital level during triage in the ED improves the predictive capacity of the studied models.
PhEMS are keen to explore the relationship between diagnostic and prognostic systems, which can help in clinical decision-making in situ and in time-dependent diseases. Examples include the Early Warning Score [21, 22], point-of-care testing [23], imaging methods like point-of-care ultrasound [24], or end-tidal carbon dioxide [25]. Among those, the NEWS2 represents a validated and easy-to-use system [7, 26]. Similarly, ED are making an important effort to improve their capacity to adequately classify patients and rapidly detect the most severe cases, for which structured triage systems represent an optimal tool [27–29].
4.2. Strengths
This prospective study involved a group of patients already examined by a medical doctor in the place where the emergency occurred at the prehospital level and its subsequent follow-up at hospital level, excluding minor pathologies or those that can be resolved in situ. In contrast to other studies, vital signs for the NEWS2 were obtained at the scene or during ambulance transport.
We can find multiple studies on the Early Warning Score in the literature, but we opted for the NEWS2 because it is currently the most used in the PhEMS and has a high bibliographical consistency [8, 30].
4.3. Limitations
We used mortality at 2, 7, and 30 days from any cause as the main outcome variable, disregarding deaths outside this window and outside the hospital.
We excluded patients who did not require transport to the hospital or who were evacuated in Basic Life Support units for minor pathologies (after being seen by a medical doctor) to maximize the homogeneity of the patient cohort.
5. Conclusion
The combined use of the NEWS 2 and the Spanish triage system presents a very high AUROC, especially for the predictive power of priority III (urgent), increasing the capacity to discriminate those patients with potential to worsen their condition, despite a priori being classified otherwise.
In the light of these data, PhEMS should evaluate the routine implementation of the NEWS2 among their procedures, which together with the structured triage system at hospital level effectively serves to predict early mortality and to detect high-risk patients.
Data Availability
The data will be available upon request.
Disclosure
The corresponding author on behalf of the other authors guarantees that the data and information contained in the study are accurate, transparent, and honest, that no relevant information has been omitted, and that all discrepancies between authors have been adequately resolved and described.
Conflicts of Interest
All signing authors fulfill the requirements of authorship and have declared the nonexistence of potential conflicts of interest.
Authors’ Contributions
Francisco Martín-Rodríguez and Raúl López-Izquierdo equally contributed to this work.
Acknowledgments
This research has received support from the Gerencia Regional de Salud (SACYL) for research projects in Biomedicine, Healthcare Management, and Healthcare Care, with registration number GRS 1678/A/18, principal investigator: Francisco Martín-Rodríguez, as part of the “Use of Early Warning Scales in the Prehospital Scope as a Diagnostic and Prognostic Tool” and Scholarship for the intensification of the research activity for the year 2019, with registration number INT/E/02/19 from the Gerencia Regional de Salud (SACYL). Agustín Mayo Iscar has been partially supported by the Spanish Ministerio de Economía y Competitividad, grant MTM2017-86061-C2-1-P, and by Consejería de Educación de la Junta de Castilla y León and FEDER, grant VA005P17 and VA002G18. We would like to express our gratitude for the collaboration of professionals from the Valladolid, Segovia, and Salamanca Advanced Life Support Units of the Sanitary Emergency Management of Castilla y León (Spain), as without their help the field work for this study would not have been possible. We also thank Juliane Chaccour for language services.