Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning

Li, Xiaoshuo; Tan, Wenjun; Liu, Pan; Zhou, Qinghua; Yang, Jinzhu

doi:https://doi.org/10.1155/2021/5528441

Journal of Healthcare Engineering

On this page

Abstract Introduction Materials and Methods Results and Discussion Conclusions Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Special Issue

Supporting Healthcare During the COVID-19 Pandemic with Robotics and Artificial Intelligence

View this Special Issue

Research Article | Open Access

Volume 2021 | Article ID 5528441 | https://doi.org/10.1155/2021/5528441

Classification of COVID-19 Chest CT Images Based on Ensemble Deep Learning

Xiaoshuo Li,¹Wenjun Tan,^1,2Pan Liu,¹Qinghua Zhou,¹and Jinzhu Yang²

Academic Editor: Luigi Pavone

Received22 Jan 2021

Revised14 Mar 2021

Accepted07 Apr 2021

Published22 Apr 2021

Abstract

Novel coronavirus pneumonia (NCP) has become a global pandemic disease, and computed tomography-based (CT) image analysis and recognition are one of the important tools for clinical diagnosis. In order to assist medical personnel to achieve an efficient and fast diagnosis of patients with new coronavirus pneumonia, this paper proposes an assisted diagnosis algorithm based on ensemble deep learning. The method combines the Stacked Generalization ensemble learning with the VGG16 deep learning to form a cascade classifier, and the information constituting the cascade classifier comes from multiple subsets of the training set, each of which is used to collect deviant information about the generalization behavior of the data set, such that this deviant information fills the cascade classifier. The algorithm was experimentally validated for classifying patients with novel coronavirus pneumonia, patients with common pneumonia (CP), and normal controls, and the algorithm achieved a prediction accuracy of 93.57%, sensitivity of 94.21%, specificity of 93.93%, precision of 89.40%, and F1-score of 91.74% for the three categories. The results show that the method proposed in this paper has good classification performance and can significantly improve the performance of deep neural networks for multicategory prediction tasks.

1. Introduction

In March 2020, COVID-19 caused by SARS-CoV-2 has reached global pandemic levels. As of January 2021, the World Health Organization issued a bulletin showing that the cumulative number of confirmed cases worldwide exceeds 91 million, the cumulative number of deaths exceeds 1.9 million deaths, and up to 300,000 new confirmed cases per day, and artificial intelligence methods are one of the important tools for the diagnosis of clinical novel coronavirus pneumonia (COVID-19) [1, 2]. In clinical practice, etiological tests including sputum, pharyngeal swabs, and lower respiratory secretions, such as reverse transcription-polymerase chain reaction (RT-PCR) and gene sequences, are the gold standard for the diagnosis of COVID-19, and nucleic acid testing is widely considered to be the main criterion for discharge after treatment. However, the current epidemiological situation of COVID-19 is dramatically increasing, and a large number of COVID-19 infections are being confirmed every day. Diagnostic methods of nucleic acid testing are faced with long waiting times for test results, certain false negatives, and shortage of testing reagents, and CT image analysis of the chest is also considered an important adjunctive diagnostic tool. For example, almost all patients with COVID-19 have some typical radiological features of chest CT, including ground-glass opacities, multifocal patchy consolidation, and/or interstitial changes in a peripheral distribution [3–8]. Therefore, until definitive results are obtained, rapid differentiation of patient type, based on chest CT images, may be a useful tool to improve diagnosis and to better characterise disease effects.

Deep learning is a part of machine learning whose concept originated from the study of artificial neural networks. Deep learning discovers distributed feature representations of data by combining lower-level features to form more abstract higher-level representations of attribute categories or features. Researchers have made important research progress in previous work by implementing deep learning algorithms to predict and classify pneumonia such as COVID-19 based on chest medical images and other biological indicators. According to Table 1, the existing studies on COVID-19 face the following problems: Wang [10] used a three-dimensional deep neural network to classify COVID-19 and a weakly supervised approach to localize lesion regions by combining the activated regions and unsupervised connected components in the classification network, obtaining 90.1% accuracy and 95.5% ROC. However, this 3D classification model has problems such as long training time. Han [11] designed an attention mechanism-based pooling method applied to 3D data instance prediction that achieved 97.9% accuracy and 99% AUC in COVID-19, CP, and normal classification tasks, but there are problems of limited test set size, for instance, prediction based on 3D data. HORRY [12] proposed a COVID-19 detection method based on migration learning and multimodal image data, but the performance of the generated classification model is insufficient. Pathak [17] proposed a deep bidirectional long-short memory network with a hybrid density network model (DBM) for COVID-19 and non-COVID-19 classification tasks achieving 98.37% accuracy and 98.32% AUC; its dataset size is small with only 1790 sheets. Wang et al. [21] designed an X-ray migration learning and model integration deep learning method for COVID-19, which achieved good results of 96.1% in triclassification prediction tasks, but there are only 140 images of COVID-19 patients in the dataset, and more than 7000 images of common pneumonia patients and normal controls; but this dataset is small and unbalanced.

To address the problems of insufficient accuracy, long training time, and insufficient dataset size in multiclassification prediction tasks [27–29], a COVID-19-assisted diagnosis algorithm based on integrated deep learning is proposed in this paper. The algorithm aims to train deep learning models for small data sets to reduce the training time and the requirements for machine performance. Meanwhile, the integrated learning algorithm integrates multiple deep learning models to improve the performance of multiclassification prediction tasks. The CT image data on this experiment were obtained from a large CT dataset constructed by the China Consortium for Chest CT Image Survey (CC-CCI), including 61,775 CT images from 4,154 patients [1]. Zhang compared them with the assistance of senior radiologists in his study, and the experimental results showed that the AI algorithm showed 92.49% accuracy in many hospitals with practical applications and 98.13% AUROC and also showed good sensitivity in diagnosing COVID-19.

2. Materials and Methods

2.1. Ensemble Deep Learning Models

For the deep learning model, the prediction performance of the classifier changes when the size of the training set and the number of prediction types of the classifiers change. In Table 2, all classifier types with the corresponding accuracies are shown; the best accuracy is achieved by the classifier M24, which is a binary classifier for classifying COVID-19 and common pneumonia; the worst accuracy is achieved by the classifier M31, which is a triclassifier for classifying COVID-19, common pneumonia, and normal control under subtraining set U1. We can learn that all binary classifiers trained on the subtraining set using the VGG16 deep neural network have better performance, while the multiclassifiers generated on the subtraining set have poor prediction performance. Therefore, our method integrates a triple classifier and five binary classifiers to form a cascaded classifier. Finally, by analyzing the performance differences among the classifiers, we reduce the deviation before the predicted and true values by the stacked idea and thus output the prediction results to improve the classification performance. The overall flow chart is shown in Figure 1.

In order to improve the performance of the classification model trained by deep neural network for the recognition of three different types of patients such as new coronavirus pneumonia, our algorithm proposes to combine the stacked algorithm with the VGG16 deep learning pretraining model. Firstly, the training set is partitioned into several disjoint subtraining sets, and several binary classifiers and a triple classifier based on the VGG16 model are trained on different subtraining sets; secondly, all classifiers are integrated by stacked idea in ensemble learning to form a cascade classifier; and finally, the prediction results are output according to the cascade classifier. In this paper, the training set is divided into six subtraining sets and a triclassifier, and five binary classifiers are trained, where the discriminant type of each classifier is shown in Table 2.

2.2. VGG (Visual Geometry Group)

VGG is a classic deep convolution neural network jointly developed by Oxford University’s Visual Geometry Group and Google DeepMind researchers [30]. The network is a related research work on Large Scale Visual Recognition Challenge 2014. Its main work is to prove that increasing the depth of the network can affect the final performance of the network to a certain extent. VGG has two main structures: VGG16 and VGG19. An important improvement on VGG16 is that several continuous 3 × 3 convolution kernels replace the larger convolution kernels in AlexNet. For a given receptive field, it is better to use an accumulated small convolution kernel than a large convolution kernel because a multilayer nonlinear layer can increase the depth of the network to ensure learning more complex patterns, and the cost is relatively small.

2.3. Transfer Learning

Transfer learning means to transfer or extend the representations learned by the CNN in previous tasks to new tasks or new fields [31]. This paper is based on the VGG16 deep neural network, and the VGG16 model has been pretrained on large tagged natural image data sets such as ImageNet, so that the train time and the amount of calculation can be significantly reduced. At the same time, in order to better extract features, the size of the training and test images input to the VGG16 model in this experiment is not adjusted to the model preset 224 224, but the size of the original chest CT image is maintained, which is 512 512.

2.4. Stacked Generalization

Stacked generalization is an important ensemble learning idea proposed by David H. Wolpert in 1992 [32]. Stacking generalization refers to the scheme of providing information from one group of classifiers to another group of classifiers before forming the final prediction result. The prominent feature of stacking generalization is that the information constituting the classifier network comes from multiple subsets of the training set, and the original training set is divided into multiple subsets of training sets. Each subtraining set is used to collect bias information about the generalization behavior of the data set so that this bias information fills the classifier network. Stacking generalization is a method to estimate and correct the deviation from the constituent classifier to the training set provided.

2.5. Training Set Partition

Based on the idea of stacked generalization in ensemble learning, the total set U is divided into m subsets, are the subsets, and intersection of all subsets is null; the number of subsets is the number of total set U divided by m:

3. Results and Discussion

3.1. Dataset

As shown in Table 3, CT images of 1417 patients with NCP, common pneumonia, and normal controls were used to train and test the prediction model proposed in this paper. The prediction model was trained with 14,400 images of 328 patients [1], including 128 patients with common pneumonia, 115 patients with NCP, and 85 normal controls. Performance tests were conducted using 139,852 slices of 1,089 patients, including 76,000 slices from 675 NCP patients, 18,852 slices from 256 patients with common pneumonia, and 45,000 slices from 158 normal controls to test the improvement of the performance of the triclassifiers trained by the deep learning algorithm.

3.2. Evaluation Measures

This method used accuracy, precision, recall (or sensitivity), F1-score, and specificity to measure and analyze the performance of the ensemble learning model. Accuracy is the classifier’s ability to correctly predict all samples, and precision is the classifier’s ability not to predict negative samples as positive. Recall is the classifier’s ability to classify all those with the disease correctly (true positive rate). F1-score is the weighted average of precision and recall. Specificity is the ability of the classifier to correctly identify patients without the disease (true negative rate). TP is true positives, TN is true negatives, FP is false positives, and FN is false negatives. The formulas of the measures are given below:

3.3. Results and Discussion

This method trains and tests a triclassifier based on VGG16 deep neural network only and a triclassifier based on VGG16 deep neural network with integrated learning under the same training set conditions, respectively. The performance of each method is compared by accuracy, specificity, and sensitivity on the test dataset. According to Figure 2, it can be seen that even the triclassifier trained solely based on the VGG16 model showed good results in identifying neocoronary pneumonia, common pneumonia, and normal controls, while the performance of the cascade model combining the deep neural network and the integrated learning algorithm was significantly improved.

(a)

(b)

The experimental results in this paper show that the cascade classifier constructed by combining the deep learning algorithm with the integrated learning algorithm can significantly improve the multiclassification prediction accuracy of the model. According to Figure 3, it can be seen that among the prediction results using only the triclassifier M31, the normal control group is predicted as common pneumonia and new coronary pneumonia is predicted as common pneumonia, and these two false predictions occur more frequently, with the false prediction rates of 14.43% and 12.47%, respectively. For these two classification cases with high error rates, two classifiers M24 and M25 with prediction performance over 95% were trained in this paper by the subtraining sets U5 and U6 for improving the predictions with high error rates, and the number of these two errors was significantly reduced to 1.99% and 7.20%, respectively, thus greatly improving the prediction accuracy of the normal control group and new coronary pneumonia, especially new coronary pneumonia identified as normal pneumonia was greatly reduced in the error rate. In the cascade classifier, the number of discrimination errors increases when the original discrimination errors are less, such as judging normal control as new coronary pneumonia and judging new coronary pneumonia as the normal control group. As can be seen from Figure 2, the incorrect discrimination error rate of judging normal pneumonia as neocoronary pneumonia only increased from 0.27% to 0.78%, and there was no significant increase in the incorrect discrimination rate.

According to Figure 3, the accuracy, specificity, sensitivity, precision, and F1-score of the integrated model based on the combination of VGG16 deep neural network and integrated learning algorithm are 93.57%, 93.93%, 94.21%, 89.40%, and 91.74%, respectively, while the accuracy, specificity, sensitivity, precision, and F1-score of the single triclassifier trained based on VGG16 algorithm are 88.12%, 88.38%, 89.19%, 84.04%, and 86.54%, respectively. Compared with the single multiclassifier, the accuracy increased by 5.45%, the specificity increased by 5.55%, the sensitivity increased by 5.02%, the precision increased by 5.36%, and the F1-score increased by 5.2%; all the indicators were significantly improved.

4. Conclusions

In this paper, we propose an algorithm based on the combination of VGG16 deep neural network and ensemble learning with the aim of improving the performance of deep neural networks for multiclassification prediction tasks. The experimental results show that the VGG16 deep neural network combined with the integrated learning approach can significantly improve the classification performance compared with the VGG16 deep neural network-based integrated learning algorithm under the same conditions, which plays an important role in the rapid identification of patients with novel coronavirus pneumonia. The method proposed in this paper has the following drawbacks: (1) the training and testing of the classification model is only utilized on 2D images, while the rich spatial information preserved in the 3D structure is not utilized; (2) only the VGG model is used and some new network techniques are not tried; and (3) the publicly available dataset used in this method is not the original DICOM data format, and the image is lost in the process of data format conversion pixel information.

Data Availability

The data used to support the findings of this study are available at http://ncov-ai.big.ac.cn/download?lang=en.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

In the process of experiment and writing, the contributors get a lot of writing suggestions and work guidance from editors and readers, which helps the authors to make the content more rigorous and easier to understand. Here, the authors would like to express their most sincere thanks to them. This work was supported by the National Natural Science Foundation of China (61971118) and Fundamental Research Funds for the Central Universities (N182410001).

References

K. Zhang, X. Liu, J. Shen et al., “Clinically applicable AI system for accurate diagnosis, quantitative measurements, and prognosis of COVID-19 pneumonia using computed tomography,” Cell, vol. 181, no. 6, pp. 1423–1433, 2020.
View at: Publisher Site | Google Scholar
Worldometers COVID19 Coronavirus Pandemic[EB/OL]. https://www.worldometers.info/coronavirus/#countries.2021 January.
Li Geng, Y.-hua Fan, L. Yan-ni et al., “Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan. China: a descriptive study,” Lancet,”, vol. 92, no. 4, pp. 424–432, 2020.
View at: Google Scholar
C. Nan-shan, M. Zhou, X. Dong et al., “Epidemiological and clinical characteristics of 99 cases of 2019 novel coronavirus pneumonia in Wuhan, China: a descriptive study,” Lancet, vol. 395, no. 10223, pp. 507–513, 2020.
View at: Google Scholar
W. Zhu, K. Xie, H. Lu, L Xu, S Zhou, and S Fang, “Initial clinical features of suspected coronavirus disease 2019 in two emergency departments outside of Hubei, China,” Journal of Medical Virology, vol. 92, no. 9, pp. 1525–1532, 2020.
View at: Publisher Site | Google Scholar
Y. Zhu, Z.-H. Gao, Y.-L. Liu et al., “Clinical and CT imaging features of 2019 novel coronavirus disease (COVID-19),” Journal of Infection, vol. 81, no. 1, pp. 147–178, 2020.
View at: Publisher Site | Google Scholar
W.-guo Wang, H. Hou, S. Lu et al., “Imaging manifestations and diagnosis of pneumonia in atypical novel coronavirus (2019GnCoV) infection: with analysis of 14 cases,” Medical New Knowledge, vol. 30, no. 1, pp. 7–9, 2020.
View at: Publisher Site | Google Scholar
D. M. Hansell, A. A. Bankier, H. MacMahon, T. C. McLoud, N. L. Müller, and J. Remy, “Fleischner society: glossary of terms for thoracic imaging,” Radiology, vol. 246, no. 3, pp. 697–722, 2008.
View at: Publisher Site | Google Scholar
Z. Gao, W. Chen, P. Jiang et al., “Implementation of XGBoost-based intelligent detection system for new crown pneumonia,” China Digital Medicine, vol. 15, no. 11, pp. 123–127, 2020.
View at: Google Scholar
X. Wang, X. Deng, Q. Fu et al., “A weakly-supervised framework for COVID-19 classification and lesion localization from chest CT,” IEEE Transactions on Medical Imaging, vol. 39, no. 8, pp. 2615–2625, 2020.
View at: Publisher Site | Google Scholar
Z. Han, B. Wei, Y. Hong et al., “Accurate screening of COVID-19 using attention-based deep 3D multiple instance learning,” IEEE Transactions on Medical Imaging, vol. 39, no. 8, pp. 2584–2594, 2020.
View at: Publisher Site | Google Scholar
H. Mike, C. Subrata, M. Paul et al., “COVID-19 detection through transfer learning using multimodal imaging data,” IEEE Access, vol. 8, pp. 149808–149824, 2020.
View at: Google Scholar
A. Waheed, M. Goyal, D. Gupta, A. Khanna, F. Al-Turjman, and P. R. Pinheiro, “CovidGAN: data augmentation using auxiliary classifier gan for improved Covid-19 detection,” IEEE Access, vol. 8, pp. 91916–91923, 2020.
View at: Publisher Site | Google Scholar
“IEEE Covid Chest X-ray dataset.”[EB/OL]. Available:.
“Covid19 Radiography Database.”[EB/OL]. Available:.
“COVID-19 chest X-ray dataset initiative.” [Online]. Available:.
Y. Pathak, S. PPiyush-kumar, K.-v Arya et al., “Deep bidirectional classification model for COVID-19 disease infected patients,” IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 192, 2020.
View at: Google Scholar
D. Singh, V. Kumar, V. aishali, and M. Kaur, “Classification of COVID-19 patients from chest ct images using multi-objective differential evolution–based convolutional neural networks,” European Journal of Clinical Microbiology &Infectious Disease, vol. 39, no. 7, pp. 1–11, 2020.
View at: Publisher Site | Google Scholar
Y. Oh, S. Park, J. C Ye, and “, “Deep learning COVID-19 features on CXR using limited training data sets,” IEEE Transactions on Medical Imaging, vol. 39, no. 8, pp. 2688–2700, 2020.
View at: Publisher Site | Google Scholar
J. Shiraishi, S. Katsuragawa, J. Ikezoe et al., “Development of a digital image database for chest radiographs with and without a lung nodule,” American Journal of Roentgenology, vol. 174, no. 1, pp. 71–74, 2020.
View at: Google Scholar
N. Wang, H. Liu, and C. Xu, “Deep learning for the detection of COVID-19 using transfer learning and model integration,” in Proceedings of the 2020 IEEE 10th International Conference on Electronics Information and Emergency Communication (ICEIEC), pp. 281–284, Beijing, China, July 2020.
View at: Google Scholar
Cohen, J. P., Morrison, P., Dao, L., 2020. Covid-19 image data collection[EB/OL]. URL:.
X. Yang, X. He, J. Zhao, Y. Zhang, S. Zhang, and P. Xie. COVID-CT-dataset: A CT scan dataset about COVID-19 [EB/OL]. Available:.
X. Ouyang, J. Huo, L. Xia et al., “Dual-sampling attention network for diagnosis of COVID-19 from community acquired pneumonia,” IEEE Transactions on Medical Imaging, vol. 39, no. 8, pp. 2595–2605, 2020.
View at: Publisher Site | Google Scholar
T. Siswantining and R. Parlindungan, “Covid-19 classification using X-ray imaging with ensemble learning,” Journal of Physics: Conference Series, vol. 1722, pp. 012072–012080, 2021.
View at: Publisher Site | Google Scholar
Y. Zhang, S. Suresh, L. Shuai-qi et al., “A five-layer deep convolutional neural network with stochastic pooling for chest CT-based COVID-19 diagnosis,” Machine Vision and Applications, vol. 32, no. 1, pp. 14–34, 2021.
View at: Publisher Site | Google Scholar
Y. Chu, Li Tong, Q. Fang et al., “Clinical characteristics and imaging manifestations of the 2019 novel coronavirus disease (COVID-19): a multi-center study in Wenzhou city, Zhejiang, China,” Journal of Infection, vol. 81, no. 1, pp. 147–178, 2020.
View at: Google Scholar
B. Adam, M. Xue-yan, M Huang et al., “Dual-sampling attention network for diagnosis of COVID-19 from community acquired pneumonia,” IEEE Transactions on Medical Imaging, vol. 39, no. 8, pp. 2595–2605, 2020.
View at: Google Scholar
K. Simonyan and Zisserman, “Very deep convolutional networks for large-scale image recognition,” 2014, http://arxiv.org/abs/1409.1556.
View at: Google Scholar
M. Young, “The Technical Writer’s Handbook, University Science, ” Mill Valley, CA, 1989.
D. H. Wolpert, “Stacked generalization,” Neural Networks, vol. 5, no. 2, pp. 241–259, 1992.
View at: Publisher Site | Google Scholar
2019, North America, R. S. RSNA pneumonia detection challenge[EB/OL].

Copyright

Copyright © 2021 Xiaoshuo Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2696

Downloads

1153

Citations