Abstract

Background. To identify, upon emergency department (ED) admission, predictors of unexpected death or unplanned intensive care/high dependency units (ICU/HDU) admission during the first 15 days of hospitalization on regular wards. Methods. Prospective cohort study in a medical-surgical adult ED in a teaching hospital, including consecutive patients hospitalized on regular wards after ED visit, and identification of predictors by logistic regression and Cox proportional hazards model. Results. Among 4,619 included patients, 77 (1.67%) target events were observed: 32 unexpected deaths and 45 unplanned transfers to an ICU/HDU. We identified 9 predictors of the target event including the oxygen administration on the ED, unknown current medications, and use of psychoactive drug(s). All predictors put the patients at risk during the first 15 days of hospitalization. A logistic model for hospital mortality prediction (death of all causes) still comprised oxygen administration on the ED, unknown current medications, and the use of psychoactive drug(s) as risk factors. Conclusion. The “use of oxygen therapy on the ED,” the “current use of psychoactive drug(s)”, and the “lack of knowledge of current medications taken by the patients” were important predisposing factors to severe adverse events during the 15 days of hospitalization on regular wards following the ED visit.

1. Introduction

Clinical deterioration leading to unexpected death or intensive care unit (ICU) admission can occur during the course of patients hospitalized on regular wards. These unexpected events are often not only explained by the natural course of the patients’ diseases but can also result from several dysfunctions of the care system [13], source of enormous human and financial impact [4, 5]. As they may be avoided [1, 6], several health care systems have developed organizational measures to prevent them. The most topical measure is the implementation of the so-called “Patient At Risk Team,” “Critical Care Outreach Team”, or “Medical Emergency Team” [7]. However, this approach has not definitively proved its effectiveness in lives and cost saving [79]. Another way to prevent adverse events due to late recognition of clinical deterioration may be to admit fragile and at-risk patients to intermediate care settings (high dependency units (HDU)). Nevertheless, these units are staff and cost consuming and mostly comprise only few beds [10]. Usually, patients presenting with obvious or suspected organ failure at the emergency department (ED) are transferred to the ICU or HDU. For the remaining patients needing hospitalization, the choice of the setting depends on the type of the patient’s illness, the available number of HDU beds, and also the physician’s ability to recognize patients at the higher risk of deterioration. At the end of this decision process, some patients at high risk of clinical worsening may be transferred to the ward. Some of them will experience unexpected death or delayed ICU admission [11]. Numerous attempts were made in cohorts of ED patients to find relevant predictors of clinical deterioration and to include them into a predictive score. Nevertheless, only subpopulations of patients are reported [1216], often excluding surgical patients. Further, including both patients discharged home and patients presenting with frank distress (often needing immediate ICU admission) [1720] may have strengthened the global performance of death predicting scores but leaves the outcome of the numerous intermediate-acuity patients difficult to predict [20]. Additionally, most of the predictive scores have focused on vital signs without taking into account laboratory data or past medical history, despite the fact that these data impact the decision-making process.

We hypothesized that past medical history, physiological variables, and routine laboratory variables could be of interest to better predict clinical deterioration during hospitalization on regular wards. The primary objective of our work was to search, during the first 6 hours of ED admission, for demographic, clinical, and also laboratory variables linked to death that did not result from do-not-resuscitate orders or unplanned ICU/HDU admission during the first 15 days of hospitalization on regular medical or surgical wards.

2. Methods

2.1. Setting

This prospective cohort study was conducted in our regional 1000-bed hospital in Orléans (France), in the medical-surgical adult ED (the pediatric and the obstetric/gynecology EDs did not participate). The hospital comprises four intensive or intermediate care units for adult patients: neurosurgical ICU (4 beds), general surgical ICU (8 beds), coronary intensive care unit (10 beds), medical HDU (13 beds), and medical-surgical ICU (18 beds).

The Ethics’ Committee of Association des Réanimateurs du Centre-Ouest approved the study and allowed to waive patients’ consent. Patients admitted to the ED were informed, as routinely done, that (1) observational studies could be done using data related to their hospitalization and (2) they had the right to refuse to be enrolled in such studies.

2.2. Study Design and Selection of Participants

All consecutive patients aged 15 to 90 years and admitted to the adult ED before admittance to surgical or medical regular wards were include. We did not included patients who died within the ED, who were discharged home or directly transferred to ICU or HDU (without general ward admission), or for whom a do-not-resuscitate order was already known. Because of the rarity of unexpected deaths observed in gynecologic/obstetric, pediatric, geriatric, and orthopedic wards (in 2003 and 2004 analysis), patients transferred to these settings were not included.

2.3. Data Collection

For each included patient, the following clinical, laboratory, and demographic data were prospectively recorded, on a daily basis by review of patient’s ED charts routinely filled in by ED nurses and physicians: date and time of admission; gender; age; unknown underlying diseases and past medical history at the time of ED visit; palliative care either underway or decided during ED visit; obvious or probable chronic alcoholism; known chronic obstructive pulmonary disease (COPD); presence of other respiratory chronic diseases; solid cancer considered not definitively cured; ongoing hematological malignancy; chronic renal insufficiency (serum creatinine > 250 μMol/L); chronic haemodialysis or peritoneal dialysis; chronic arterial hypertension; coronaropathy; type I or type II diabetes mellitus; past hospitalization for psychiatric disorder or for suicide attempt; known cerebral illness (dementia, degenerative encephalopathy, and epilepsy); knowledge of current medications; known treatment by corticosteroids, nonsteroidal anti-inflammatory drugs (NSAID), antiplatelet drugs, angiotensin-converting enzyme inhibitors (ACEI) or angiotensin receptor blockers (ARB), diuretics, oral anticoagulant, psychoactive drugs (benzodiazepines, neuroleptics, antidepressors, anticonvulsants, morphinomimetics, tramadol, and lithium); admission for possible bacterial infection (recent fever and/or antibiotics prescribed before or during ED admission); admission for trauma; admission for acute, voluntary or not, intoxication (ethanol, illicit drugs, psychoactive drugs, smoke, plants, and agricultural products); acute confusion observed on the ED; witnessed seizures before or during ED stay; administration of oxygen therapy on the ED; minimal and maximal values (recorded during the first 6 hours in the ED) of blood pressure, heart rate, respiratory rate, capillary blood glucose level, and body temperature; maximal score on Glasgow coma scale; minimal oxygen saturation measured by pulse oximetry (SpO2). Laboratory variables recorded, when available on the ED, were ionogram (natremia, serum chloride, kaliemia, alkaline reserve, and blood protein level); serum creatinine; blood cell count; hemoglobin; prothrombin time (expressed as international normalized ratio (INR)); activated partial thromboplastin time (aPTT); liver aminotransferases (AST and ALT); total bilirubin.

We also collected additional variables: admission “at night” (between 19:00 and 07:00); admission on weekend (from 19:00 on Friday to 07:00 on Monday); presence of a systemic inflammatory response syndrome (SIRS) [25] during the ED stay; anion gap (calculated as [Na+ + K+] − [Cl + alkaline reserve]) when blood ionogram was available. Categorical variables were coded as 0 (absence) or 1 (presence) and were entered on a computerized spreadsheet.

Of note, for each patient admitted to the ED, the emergency physician systematically searched for previous hospitalization, known illnesses, and medications taken in the electronic hospital registry available at the ED. The item “lack of knowledge of the usual medications or the chronic illnesses” was ticked only after unsuccessful search on electronic hospital registry and after not informative interview of patient, familial practitioner or next of kin.

2.4. Missing Data

We planned to only analyze clinical and laboratory variables recorded in more than 85% of the patients. Among these parameters, missing values were recorded as “normal” for clinical items or replaced by the mean value in the whole population for laboratory items.

2.5. Definition and Recording of the Target Event

Once a week, two investigators (ND and AB) recorded the occurrence of death or unplanned admission in an intensive or intermediate care unit during the first 15 days of hospitalization on regular wards, as provided by our Hospital Medical Information Department. Deaths that occurred on the wards were classified as unexpected deaths or deaths with do-not-resuscitate order after review of patient’s chart and after interview of the attending nursing and medical staff. The chosen target event was a composite end-point: unplanned death or unplanned admission to ICU or HDU, during the first 15 days of admission on the ward.

2.6. Calculation of Sample Size

As the frequency of the target event is low (based on our hospital statistics for 2003 and 2004 and also based on a study by Bristow et al. [11]), around 1.7%, a 7-month period of study was deemed necessary to observe 50 to 80 target events.

2.7. Data Analysis

The association between each of the recorded variables and the occurrence of the target event (unplanned death or unplanned admission to ICU or HDU) was examined by Fisher’s exact test or by Student’s -test when appropriate. The variables linked to the target event with were checked for colinearity: when 2 variables belonging to the same category of data (i.e., either medications, demographic data, chronic illnesses, on clinical or biological symptoms at ED admission) were correlated with an absolute value of Pearson’s correlation coefficient , only the variable linked to the target event with the smallest value was kept for further analysis. We also examined the correlation coefficients between existing chronic illnesses and specific taken medications (e.g., chronic hypertension and treatment by diuretics or beta-blockers) and between the administration of oxygen during the ED stay and the respiratory rate and SpO2. When two variables were correlated with , the variable with the less number of missing values was kept for further analysis. All selected variables were then entered into a logistic regression model also to examine their relationship with time, in a Cox proportional hazards model, both with stepwise backward procedure.

Continuous variables were introduced after transformation in categorical variables when their distribution was not normal. Variables that remained linked to the target event with after multivariate analysis were considered as possible predictors of the target event.

The discriminative power of the logistic regression model was assessed by calculating the area under the receiver operating characteristics curve (AUROC) [26] and by testing calibration (i.e., the degree of correspondence between predicted and observed target event rate) by the Hosmer-Lemeshow test [27]. Our multivariate logistic regression analysis was made with and also without incorporating biological variables (in order to assess the improvement they allow in performance).

At last, we reran the logistic analysis to build a model for hospital mortality prediction (all causes of death) and compared its performance (AUROC) to the performance of several published predictive scores applied to our data set [28].

Values were expressed as the mean ± standard deviation (SD) (continuous variables), unless otherwise specified, or as a percentage of the group from which they were derived (categorical variables). Adjusted odds ratios (OR) and hazard ratios (HR) are provided with their 95% confidence interval (95% CI). All values were two-tailed, and indicates statistical significance. Descriptive statistics and multivariate analyses were performed with MedCalc 10.3.2.0 (Mariakerke, Belgium).

3. Results

From February 12, to September 12, 2005, 4,619 patients were included (Figure 1).

Demographic, clinical, and biological data are summarized in Table 1. Past medical history and current medications taken could not be retrieved during the ED stay for 4.3% and 10.7% of the cases, respectively.

A 2% sample (92 patients’ charts) was randomly extracted from the dataset to check for reliability. Overall, 97.5% (5,382/5,520) of the computerized items for these patients agreed with the original written records.

Among the 4,619 enrolled patients, 77 (1.67%) target events were observed: 32 (0.7%) unexpected deaths in the ward and 45 (0.97%) admissions in ICU or HDU (14 deaths). During the first 15 days, 70 (1.52%) deaths after do-not-resuscitate order occurred.

The 15-day mortality and the hospital mortality rates were 2.51% and 4.2%, respectively.

3.1. Prediction of the Target Event

Thirty-five variables were linked to the target event (occurrence of unplanned death or unplanned admission to ICU or HDU, during the first 15 days of admission on the ward) with in univariate analysis (Table 2). Capillary blood glucose level, minimal SpO2, and respiratory rate were recorded in only 78.2%, 70.4%, and 62.2% of the cases, respectively, and, as planned, were not used for further analysis because they were strongly correlated with other variables with no missing value. In the 3610 patients with recorded capillary blood glucose level, the variable “diabetes mellitus” was strongly correlated with capillary blood glucose level (; ). In the 2874 patients with recorded respiratory rate, the variable “oxygen administration in the ED” was strongly correlated with maximal respiratory rate (; ) and, in the 3252 patients with recorded minimal SpO2, the variable “oxygen administration in the ED” was strongly correlated with maximal respiratory rate (; ).

After planned elimination of some other variables due to colinearity and after recoding the variables “age”, “minimal systolic blood pressure”, “platelet count”, “serum chloride,” and “anion gap”, which had a skewed distribution, 19 variables were kept for further analysis. Among them, the following 9 remained significantly linked to the target event () either after adjustment by multivariate logistic regression or by Cox proportional hazards model (Table 3): systolic arterial pressure below 110 mmHg, platelet count below 150 G/L, serum chloride below 100 mmol/L, male gender, known chronic hypertension, oxygen administration on the ED, unknown current medications, use of psychoactive drug(s), and the presence of at least 3 SIRS items. The time independency of hazards ratios of the Cox model was verified graphically for all predictors, as illustrated in Figure 2 for the variables “unknown current medications” and “oxygen therapy on the ED.”

The target event probability derived from the logistic model had reasonable discriminative power (AUROC = 0.80 (95% CI: 0.79 to 0.81)) and was well calibrated (Hosmer-Lemeshow ; ). It performed better () than a similar model not incorporating laboratory data that retained 6 predictive factors (age, male gender, chronic hypertension, unknown current medications, use of psychoactive drugs, and oxygen therapy in the ED (odds ratios not shown)) and had an AUROC of 0.75 (0.74–0.77).

3.2. Prediction of Hospital Mortality

Our final logistic model for hospital mortality prediction that retained 13 variables (Table 4) was associated with good discriminatory power (AUROC = 0.87 (95% CI: 0.86 to 0.88)) and was well calibrated (Hosmer-Lemeshow ; ). Of note, the 13 retained factors still comprised the variables “use of oxygen therapy in the ED”, “unknown current medications,” and “use of psychoactive drugs”. Our model performed better than the 5 previously published predictive scores [12, 2124] ( for all 5 comparisons) (Table 5).

The logistic model for hospital mortality prediction not incorporating the biological variables comprised 7 variables (still comprising the variables “use of oxygen therapy in the ED”, “unknown current medications,” and “use of psychoactive drugs”) and had an AUROC of 0.82 (95% CI: 0.81 to 0.83), that is, less performing than the 13-variable model ().

4. Discussion

The main finding of our study is the identification of new factors predisposing patients with intermediate severity of illness to clinical deterioration and even to death while hospitalized on regular wards via the ED: the initiation of oxygen therapy in the ED, the use of psychoactive drug(s), and the lack of knowledge of medications regularly taken by the patient. Additionally, our work underlines the limits of validated predictive models [22, 23], underscoring the improvement allowed by the incorporation of patient’s past medical history and laboratory variables into a predictive model as ours.

In our study patients, the target event rate was 1.7%, that is, similar to that reported elsewhere [11] and the hospital mortality rate was 4.2%. The latter is difficult to compare to published data because of heterogeneity of ED cohorts in terms of inclusion criteria (e.g., inclusion or not of patients discharged home or rapidly transferred to ICU) and observation period.

4.1. Clinical and Laboratory Predictors

In our study patients, the respiratory rate and the SpO2 have been recorded on ED charts in only 62% and 70% of the cases, respectively, in our study, like it is often not recorded in many hospitals [29]. As planned, we examined the initiation of oxygen therapy on the ED as an important variable, reflecting poor respiratory condition, which could be seen as a surrogate for respiratory rate. Indeed, oxygen administration was strongly linked to the respiratory rate and to the SpO2 and appeared in our study as one of the most important variables to consider. Moreover, SpO2 could be considered as quite imprecise as concomitant fractional concentration of inspired oxygen was not recorded in our study, as also often observed in others [30]. The same limitations might apply to the respiratory rate.

The regular and current use of psychoactive drugs was a significant factor for clinical deterioration during hospitalization in our study cohort. This is in line with previous studies [31] and is probably explained by the increased risk of various pathologic events associated with psychoactive drugs use, such as delirium, withdrawal syndromes, aspiration pneumonia, muscles weakness, falls, and consciousness impairment. However, we cannot exclude that the role of psychoactive drugs might not be found in other countries, as the use of these drugs was very frequent in our study population (21.5%), as it is generally the case in the French population [32].

Interestingly, our analysis disclosed that the lack of knowledge of the medications regularly taken by the patients (10.7% of the cases) is a risk factor for further clinical deterioration. This may be not only due to patients’ inability to give the information but also due to the fact that it could not be found in the hospital electronic database, the absence of next-of-kin, or the impossibility to reach the familial practitioner. Our findings underline the paramount importance of meticulous search for this information at ED presentation, in order to avoid the ignorance of chronic organ failure, to prevent drug withdrawal syndromes in patients taking psychoactive drugs, or to avoid adverse drug interactions [33]. Interestingly, despite the fact that the list of the current medications is often retrieved during the first days of hospitalization, our Cox analysis tends to show that the lack of this information while on the ED put the patients at risk even during the following 15 days, suggesting that it may be of utmost importance to get this information earlier, that is, during the ED stay.

As in other studies [13, 22, 30, 34], important physiological variables such as heart rate or the level of consciousness were not retained in our analyses. Among other reasons, this could be due to the fact that we excluded patients with obvious distress and urgent need of intensive care referral.

4.2. Strengths and Limitations

To our knowledge, although our data are now 8 years old, our work is the first study that focused on the risk factors for hospital death or delayed ICU/HDU referral upon ED admission of unselected (i.e., medical and surgical) patients admitted to the ward via the ED. Indeed, numerous studies have been performed in selected populations of patients with trauma [35, 36], sepsis [15, 16, 20, 37], hypotension [14, 17, 18], nonsurgical patients [12, 13], geriatric patients [38], or only in patients who underwent blood sampling in the ED [39]. However, studies analyzing the whole population of patients admitted to regular wards via the ED are scarce [30, 34]. Of note, as we excluded patients who needed hospitalization on orthopedic or gynecologic/obstetric wards, our study population comprised a large proportion of medical patients. Thus, our cohort may be seen as a selected population. More importantly, unlike most of the above-cited studies, we focused our work on patients with intermediate severity of illness upon ED arrival, that is, excluding those who were discharged home or who had obvious or suspected organ failure that needed rapid ICU or HDU admission. Excluding these patients with very low or very high acuity scores at the ED, while focusing on intermediate-acuity patients, is known to weaken the performance of scores developed to predict death or clinical deterioration [40]. This is the reason why we did not attempt at building and validating another predictive score [30, 34]. Rather, our aim was to identify potential factors that could put the patients of intermediate severity of illness at risk of further deterioration and that could suggest possible avenues for improvement in the care of such patients.

Of note, we focused on the prediction of death that was not the result of palliative care and of unplanned ICU admissions (known to increase the risk of death [41]), in order to, in a pragmatic view, help avoid deaths that should be prevented. To our knowledge, our study is the first work focused on this outcome. This also could be seen as a limitation of our work since differentiating deaths that follow do-not-resuscitate orders or palliative care from actual unexpected deaths is not easy, even after cautious review of medical charts and interviews of the nursing-medical staffs, after which a part of subjectivity could persist. However, the second part of our work focusing on the prediction of hospital death (of any cause) tends to show that the most important variables retained in our primary analysis were not the result of bias as “oxygen therapy on the ED”, “use of psychoactive drug(s)”, and “unknown current medications” still remain linked to hospital death.

The high amount of missing data in our work, despite reflecting the real-life conditions in which it was performed, could have weakened the power of our multivariate analyses. However, we do not believe it could have biased our identification of risk factors as the incidence of the target event was consistently far less in patients with no respiratory rate measured at the ED (0.92%) or no SpO2 measured (0.73%), for example, than in patients with complete data.

Finally, our data are now old data, and despite the absence of obvious advances in the care of emergency department patients in our hospital since we conducted our study (same hospital electronic record, no automatic connection to the patient record that might be owned by the familial practitioner, and no increase in medical staff in the emergency department), our results might not be replicable today. For this reason, we plan to repeat the study in the near future and we are working to get closer to other hospitals in our region, with the aim to conduct a multicenter study that could give results with better external validity.

5. Conclusion

Our work identified the “use of oxygen therapy on the ED”, the “current use of psychoactive drug(s)”, and the “lack of knowledge of current medications” as important factors that predispose patients to severe clinical deterioration during the 15 days of hospitalization on regular wards that follow ED visit.

Abbreviations

ACEI:Angiotensin-converting enzyme inhibitors
ALT:Alanine aminotransferase
aPTT:Activated partial thromboplastin time
AR:Angiotensin receptor blockers
AST:Aspartate aminotransferase
AUROC:Area under the receiver operating characteristics curve
CI:Confidence interval
COPD:Chronic obstructive pulmonary disease
ED:Emergency department
HDU:High dependency unit
HIV:Human immunodeficiency department
HR:Hazard ratio
ICD-10:International classification of diseases, 10th revision
ICU:Intensive care unit
INR:International normalized ratio
MEWS:Modified early warning system
NSAID:Nonsteroidal anti-inflammatory drugs
OR:Odds ratio
RAPS:Rapid acute physiology score
REMS:Rapid emergency medicine score
SD:Standard deviation
SIRS:Systemic inflammatory response syndrome
SpO2:Oxygen saturation measured by pulse oxymetry
WPSS:Worthing physiological scoring system.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Authors’ Contribution

Conception and design are done by Thierry Boulain and Antoine Valéry. Acquisition of data is done by Thierry Boulain, Isabelle Runge, Nathalie Delorme, Angèle Bouju, and Antoine Valéry. Drafting and revision of the paper is performed by Thierry Boulain, Isabelle Runge, Nathalie Delorme, Angèle Bouju, and Antoine Valéry.

Acknowledgments

The authors thank the nursing staff and doctors from the Emergency Department, Hôpital de La Source, Centre Hospitalier Regional d’Orléans, Orléans, France, for their help with the data collection. They thank Drs. Karim Lakhal and Stephan Ehrmann for their advices in writing the paper. Institution where the work was performed is Hôpital de La Source, Centre Hospitalier Regional d’Orléans, Orléans, France.