Abstract
Predictive studies of acute respiratory distress syndrome (ARDS) in patients with coronavirus disease 2019 (COVID-19) are limited. In this study, the predictors of ARDS were investigated and a score that can predict progression to ARDS in patients with COVID-19 pneumonia was developed. All patients who were diagnosed with COVID-19 pneumonia between February 1, 2020, and May 15, 2020, at five university hospitals in Korea were enrolled. Their demographic, clinical, and epidemiological characteristics and the outcomes were collected using the World Health Organization COVID-19 Case Report Form. A logistic regression analysis was performed to determine the predictors for ARDS. The receiver operating characteristic (ROC) curves were constructed for the scoring model. Of the 166 patients with COVID-19 pneumonia, 37 (22.3%) patients developed ARDS. The areas under the curves for the infiltration on a chest X-ray, C-reactive protein, neutrophil/lymphocyte ratio, and age, for prediction of ARDS were 0.91, 0.90, 0.87, and 0.80, respectively (all ). The COVID-19 ARDS Prediction Score (CAPS) was constructed using age (≥60 years old), C-reactive protein (≥5 mg/dL), and the infiltration on a chest X-ray (≥22%), with each predictor allocated 1 point. The area under the curve of COVID-19 ARDS prediction score (CAPS) for prediction of ARDS was 0.90 (95% CI 0.86–0.95; ). It provided 100% sensitivity and 75% specificity when the CAPS score cutoff value was 2 points. CAPS, which consists of age, C-reactive protein, and the area of infiltration on a chest X-ray, was predictive of the development of ARDS in patients with COVID-19 pneumonia.
1. Introduction
The coronavirus disease 2019 (COVID-19) pandemic is currently ongoing. Since December 2019, more than 97,000,000 patients have been diagnosed with COVID-19, and the associated mortality rate is about 2% [1]. Several studies evaluating epidemiology, clinical manifestation, risk factors, treatment, and outcomes of patients with COVID-19 have been published, and these studies have shown that the presentation of COVID-19 varies from asymptomatic infection to severe viral pneumonia with acute respiratory distress syndrome (ARDS) in humans [2, 3].
Early detection of the likelihood of worsening to ARDS in patients with COVID-19 pneumonia will help to appropriately identify and classify those who need to be referred to tertiary centers among those requiring simple conservative treatment. However, few studies have evaluated models to predict which patients are likely to develop severe pneumonia such as ARDS. An effective and simple screening tool that can predict the occurrence of ARDS is urgently needed. For that reason, we developed the COVID-19 ARDS Prediction Score (CAPS) that can help to screen patients who are likely to develop into severe respiratory distress in clinical settings.
2. Patients and Methods
2.1. Ethics
The study was approved by the institutional review boards at Yeungnam University Hospital (IRB No. 2020-03-100), Chonnam National University Hospital (IRB No. CNUH-2020-039), and Chosun University Hospital (CHOSUN 2020-04-003-002).
2.2. Study Design and Patients
This retrospective cohort study included all adult patients (≥18 years old) with COVID-19 pneumonia between February 1, 2020, and May 15, 2020, from five hospitals: Yeungnam University Hospital (Daegu, Korea), Chonnam National University Hospital, Chonnam National University Hwasun Hospital, Chonnam National University Bitgoeul Hospital, and Chosun University Hospital (Gwangju, Korea). We evaluated a total of 238 patients with laboratory-confirmed COVID-19. The aim of this study was to identify risk factors that predict ARDS in COVID-19 patients with pneumonia. We excluded the patients with mild disease who had no pneumonic infiltration on chest radiogram or chest computed tomography. Finally, 166 of 238 patients had pneumonia and were enrolled in this study.
Infectious disease physicians in each hospital collected and reviewed the data. Demographic, clinical characteristics, and outcomes were extracted from patients’ electronic medical records. Symptoms, infiltration on a chest X-ray, and laboratory findings at the initial diagnosis of pneumonia were collected and used for further analyses. The clinical outcomes were followed up until June 15, 2020.
2.3. Definitions
The diagnosis of COVID-19 was made by detection of positive SARS-CoV-2 from respiratory specimens using real-time reverse transcription-polymerase chain reaction (RT-PCR), performed with a kit with a sensitivity and specificity of 95% and 97%, retrospectively (BioCore 2019-nCoV Real-Time PCR Kit, Kogene Biotech, Inc., Seoul, Republic of Korea).
Pulmonary infiltration was classified as patchy, confluent, or nodular, and unilateral or bilateral, by at least two physicians in each hospital. The area of pulmonary infiltration was analyzed by using DEEP:PHI (medical AI software; DEEPNOID, Seoul, Republic of Korea) which is an open platform that supports medical imaging artificial intelligence (AI) model research efficiently.
Oxygen was supplied to patients with oxygen saturation less than 93% in room air. The definition of ARDS is a partial pressure of arterial oxygen (PaO2)/percentage of inspired oxygen (FiO2) of <300 mmHg [4].
2.4. Statistical Analyses
The Kolmogorov-Smirnov test was used to test for normality in continuous variables. Continuous variables were expressed as , and the Student -test was used to compare statistical differences, if the variables follow a normal distribution. Continuous variables were expressed as median (interquartile range), and the Mann–Whitney U test was used, if the variables follow a nonnormal distribution. Categorical variables were expressed as numbers and percentages and Pearson’s chi-squared test or Fisher’s exact test was used for comparisons. The receiver operating characteristic (ROC) curve and Youden’s index () were used to select the optimal cutoff value indicating ARDS. We selected the variables that had an area under the and converted them into categorical variables using cutoff values for the COVID-19 ARDS Prediction Score (CAPS) calculation. Multiple logistic regression analysis was used to determine the predictive factors for the development of ARDS. A two-sided was considered statistically significant and no adjustment was made for multiplicity. The statistical analyses were performed with SPSS ver. 26.0 (IBM, Armonk, NY, USA).
3. Results
Clinical characteristics and outcomes of patients are shown in Table 1. A total of 166 patients were identified: 129 (77.7%) patients had pneumonia without ARDS and 37 (22.3%) patients developed ARDS. Older age; presence of comorbidity including hypertension, diabetes mellitus, chronic kidney disease, neurologic disorders, and dementia; presence of dyspnea or fever; and the absence of sore throat, myalgia, or headache were associated with the development of ARDS in the univariate analysis (, each; Table 1). Greater levels of lung infiltration on a chest X-ray; leukocytosis; neutrophilia; lymphopenia; thrombocytopenia; and elevated serum aspartate transaminase, bilirubin, glucose, blood urea nitrogen, C-reactive protein (CRP), lactate dehydrogenase, and procalcitonin were significantly associated with COVID-19 pneumonia combined with ARDS rather than those without ARDS (, each). COVID-19 pneumonia with ARDS was significantly associated with corticosteroid treatment (Table 1). The mortality rates of patients with COVID-19 pneumonia with ARDS and without ARDS were 43% and 2%, respectively ().
AUROC was obtained for the factors that showed significant differences between the patients with COVID-19 pneumonia with ARDS and those without ARDS. Age, area of pulmonary infiltration on a chest X-ray, C-reactive protein, and neutrophil/lymphocyte count showed (Table 2). Multiple logistic regression analysis showed that older age (; odds ratio: 4.6; ), area of pulmonary infiltration on a chest X-ray (; odds ratio: 3.5; 3), and elevated CRP (, odds ratio: 10.7; ) were independent risk factors for prediction of ARDS in patients with COVID-19. The N/L ratio () was excluded because it showed no statistical significance (Table 3) and no additional increase in AUROC when it was included.
Based on the values and regression coefficients of these risk factors, we created a clinical prediction model to predict which of the patients with COVID-19 are at risk of ARDS using scoring points (Table 4). The following variables were scored to develop CAPS: age (≥60 years old), CRP (≥5 mg/dL), and pulmonary infiltration (≥22%) on a chest X-ray (1 point each). The combination of these three parameters created scores ranging from 0 to 3. A COVID-19 ARDS Prediction Score model was constructed as . We used this simple scoring system because there was no significant difference in the results when we used a more detailed weighting system. On the ROC curve obtained for the model, the optimal cutoff score of ≥2 had 94% sensitivity and 75% specificity for the occurrence of ARDS, with a ROC area under the curve of 0.85 (Tables 5 and 6 and Figure 1).
4. Discussion
The emergence of COVID-19 caused a global pandemic, and most deaths are caused by pulmonary complications such as ARDS. Recently, several antiviral therapies including remdesivir [5] and dexamethasone [6] have shown beneficial effects on COVID-19 in randomized clinical trials. However, the benefits of these treatments were shown to be superior to placebo by shortening the time to recovery in some patients with mild to moderate symptoms, and not in severely and critically ill patients. For this reason, antiviral treatment should be initiated before the progression to severe disease. However, the number of therapeutic agents is limited, and it is unnecessary to treat all of the mild COVID-19 cases with antiviral agents. In this situation, the systematic and reliable prediction system will be beneficial for screening patients who are expected to develop severe disease, such as ARDS, requiring transfer to a specialized medical center for appropriate treatment.
Several studies have developed models that predict the diagnosis of COVID-19 and risk factors for disease severity [7–12]. Wu et al. reported that old age and fever are risk factors associated with ARDS and death in patients with COVID-19 pneumonia [13], and Zhang et al. reported that D-dimer could be a predictive factor for in-hospital mortality in patients with COVID-19 [14]. However, there are few studies of prediction models for the occurrence of ARDS or ICU admission. Liang et al. reported that chest radiography, age, hemoptysis, dyspnea, unconsciousness, number of comorbidities, cancer history, neutrophil-to-lymphocyte ratio, lactate dehydrogenase, and direct bilirubin were associated with an increased risk of ICU requirement or death, and a scoring system using above variables showed an AUC of 0.88 [15].
In this cohort study, we showed that older age, initial pulmonary infiltration on a chest X-ray, and CRP were independent predictors of ARDS occurrence for patients with COVID-19 pneumonia. In our study, dyspnea was not presented as an important predictor of ARDS, as this is a categorical variable (all or nothing). Instead, we introduced respiratory rate for predicting ARDS. However, respiratory rate showed inferiority for predicting ARDS compared to dyspnea (AUROC: 0.67; cutoff value: 22/min; sensitivity: 46%; specificity: 89%). This may be due to clinical evaluation at the time of diagnosing COVID-19 pneumonia, as subjective dyspnea may not have been present at that early stage of the disease.
Our prediction model has merit because we included detailed chest X-ray findings, which are used by most clinicians to estimate the severity and are more objective than the symptoms of patients. C-reactive protein, which is a widely used inflammatory marker for patients with infectious diseases, was more predictive of ARDS in this study than other laboratory values, which is consistent with a previous study [16]. The neutrophil-lymphocyte count ratio, neutrophilia, and lymphopenia were also associated with ARDS in this study, which is consistent with previous studies [17]. However, these parameters did not provide additional diagnostic value to the model consisting of age, C-reactive protein, and chest X-ray findings.
This study had several limitations. First of all, it may possess selection bias due to the retrospective design, even though it was a multicenter cohort study. Second, this study was conducted in a single country with a single genetic background. Third, this study had the absence of a validation cohort. Fourth, the symptoms and laboratory result used in this study were not standardized, so they could have confounding bias. For these reasons, further studies are needed to validate this score and allow generalization to various countries and races.
In conclusion, , which takes age (≥60), CRP (≥5 mg/dL), and area of pulmonary infiltration on a chest X-ray (≥22%) into consideration, could effectively predict the occurrence of ARDS in patients with COVID-19 pneumonia. Therefore, CAPS could be an early and helpful prediction model to improve the outcome of patients with COVID-19.
Data Availability
All the information supporting our conclusions and relevant references are included in the manuscript. Corresponding author HCJ can be contacted for more information.
Conflicts of Interest
The authors declare that they have no competing interests.
Authors’ Contributions
JH and HCJ designed the study. JWS, SEK, EYC, KSH, THO, UJK, SJK, KHP, SIJ, DYK, NRY, DMK, and JH performed data acquisition. SEK and HCJ analyzed the data. JWS, SEK, and HCJ wrote the manuscript. All authors read and approved the final manuscript. Jun-Won Seo and Seong Eun Kim equally contributed to the work.
Acknowledgments
We express our gratitude, for statistical consultation and cooperation, to the Statistical Office, Department of Research Collaboration at the Biomedical Research Institute of Chonnam National University Hospital. This study was supported by research funding from Chonnam National University (No. CNU 2020-1967).