International Journal of Microbiology

International Journal of Microbiology / 2016 / Article

Research Article | Open Access

Volume 2016 |Article ID 4197187 | 5 pages |

Identification of Common Bacterial Pathogens Causing Meningitis in Culture-Negative Cerebrospinal Fluid Samples Using Real-Time Polymerase Chain Reaction

Academic Editor: Giuseppe Comi
Received12 May 2016
Revised18 Jun 2016
Accepted04 Jul 2016
Published01 Aug 2016


Background. Meningitis is a serious communicable disease with high morbidity and mortality rates. It is an endemic disease in Egypt caused mainly by Streptococcus pneumoniae, Neisseria meningitidis, and Haemophilus influenzae. In some settings, bacterial meningitis is documented depending mainly on positive cerebrospinal fluid (CSF) culture results or CSF positive latex agglutination test, missing the important role of prior antimicrobial intake which can yield negative culture and latex agglutination test results. This study aimed to utilize molecular technology in order to diagnose bacterial meningitis in culture-negative CSF samples. Materials and Methods. Forty culture-negative CSF samples from suspected cases of bacterial meningitis were examined by real-time polymerase chain reaction (real-time PCR) for the presence of lytA, bexA, and ctrA genes specific for Streptococcus pneumoniae, Haemophilus influenzae, and Neisseria meningitidis, respectively. Results. Positive real-time PCR results for Streptococcus pneumoniae were detected in 36 (90%) of culture-negative CSF samples while no positive results for Haemophilus influenzae or Neisseria meningitidis were detected. Four (10%) samples were negative by real-time PCR for all tested organisms. Conclusion. The use of molecular techniques as real-time PCR can provide a valuable addition to the proportion of diagnosed cases of bacterial meningitis especially in settings with high rates of culture-negative results.

1. Introduction

Bacterial meningitis is one of the serious communicable diseases, associated with substantial morbidity and mortality rates [1]. About 10 to 20% of survivors develop disabling neurologic complications [2] mandating the prompt diagnosis, treatment, and prevention. The incidence of meningitis is usually high in developing countries, with poor-socioeconomic status [3], and it is in fact reported endemic in Egypt [4]. Streptococcus pneumoniae, Neisseria meningitidis, and Haemophilus influenzae type b account for most of the world’s documented cases of community-acquired bacterial meningitis [26]. However, over the past decade, changes in the epidemiology of the disease regarding the distribution of the causative agents and patients’ age group have been noticed in different geographical areas, owing to the implementation of different immunization strategies using conjugate polysaccharide vaccines [1, 3, 7, 8].

Different methods exist for the diagnosis of bacterial meningitis, of which cerebrospinal fluid (CSF) culture is still considered the “gold standard” [9, 10]. However, culture techniques in some settings lack sensitivity particularly when the patient is pretreated with antimicrobials; added to that, the disadvantage of the turnaround time till results becomes available [9, 1113]. Gram-stained smears of the CSF samples can provide a rapid preliminary tool for diagnosis in 60–90% of patients which correlates with the concentration of bacteria in the CSF samples [9]. However, sensitivities of CSF Gram staining vary considerably for different microorganisms [3]. Some studies have also reported a low sensitivity of direct antigen detection assays as latex agglutination test, especially in pretreated patients with antibiotics before lumbar puncture [1416].

Accordingly, molecular methods have been proposed to fill in these gaps, as rapid and accurate methods especially in culture-negative situations [6, 10, 1719].

This study aimed to diagnose bacterial meningitis caused by Neisseria meningitidis, Streptococcus pneumoniae, and Haemophilus influenzae type b (Hib) in culture-negative CSF samples by the aid of real-time PCR.

2. Materials and Methods

This study was performed during the period from December 2014 to March 2015 and was approved by the Ethics Committee of Faculty of Medicine, Ain Shams University, Cairo, Egypt, and in accordance with the ethical guidelines of the Declaration of Helsinki, 1975.

The study comprised a total of 40 CSF samples recovered from adult patients, admitted to Abbasseya Fever Hospital, presenting with clinical picture and abnormal CSF cellular and chemistry results suggestive of bacterial meningitis.

Clinical criteria for inclusion of patients were fever, headache, vomiting, photophobia, and irritability (symptoms of meningeal irritation) along with neck rigidity, Kernig sign, Brudzinski sign, altered conscious level, seizures, and focal neurological signs (signs of meningeal irritation) [4].

The diagnostic laboratory criteria for bacterial meningitis included the following: glucose concentration less than 40 mg/L, protein concentration more than 50 mg/dL, a white cell count more than 100 cells per mm3, and neutrophil percentage more than 50% [20].

The collected CSF samples were centrifuged at 10.000 rpm for 10 min and the supernatant was examined for abnormalities in WBCs, protein, and glucose. Ten microliters of the sediment was inoculated onto sheep blood agar and chocolate agar and the rest was aliquoted and stored at −70°C. Bacterial growth was observed after overnight incubation of the agar plates at 37°C in 5% CO2 atmosphere [21].

Data of patients with negative culture results were recorded and their stored CSF samples were further examined by real-time PCR.

2.1. Real-Time PCR
2.1.1. Bacterial DNA Extraction

Bacterial DNA was extracted from CSF samples with the aid of QIAGEN DNA Mini kit (QIAGEN Inc., California) as per the manufacturer’s protocol for DNA purification. The eluted DNA was stored at −20°C until further processed.

2.1.2. Real-Time PCR with SYBR Green I

Three runs were sequentially performed for the detection of each organism separately. The ctrA gene of Neisseria meningitidis, bexA gene of Haemophilus influenzae, and lytA gene of Streptococcus pneumoniae [9] were used as species-specific targets. The primers sequences are listed in Table 1. The mix for each run included 5 μL of sample DNA, 12.5 μL of 2x QuantiTect SYBR Green PCR master mix (QIAGEN Inc., Valencia, CA) containing a buffer, dNTP mix, MgCl2 and HotStarTaq DNA polymerase, 1 μL of the primer, and RNase-free water for a final volume of 25 μL. DNA was amplified with the Step One Real-Time PCR system (Applied Biosystems) by using the following temperature program: an initial Hotstart Taq activation step at 95°C for 15 min, initial denaturing at 95°C for 15 seconds and 40 PCR cycles of denaturing at 95°C for 30 seconds, annealing at 50°C for 30 seconds, and extension at 72°C for 30 seconds followed by melting curve stage of 95°C and 60°C [22]. Amplification data were analyzed by instrument software (Step One Software v2.3) in terms of melting curve graphs of each sample (Figure 1). Positive control strains and negative controls consisting of PCR grade water instead of the target DNA were used in each run.

OligonucleotideSequenceFinal conc. (nM)


2.2. Statistical Analysis

Quantitative variables are presented as mean and SD, and intergroup differences are compared using the unpaired -test. Categorical variables are presented as number and percentage. Discrete and skewed continuous data are presented as median and differences between groups are compared using the Mann-Whitney test. The statistical procedures were carried out using SPSS version 15 for Windows (SPSS Inc., Chicago, IL, USA).

3. Results

The present study was conducted on 40 culture-negative CSF samples, withdrawn from 27 (67.5%) males and 13 (32.5%) females. Age of patients ranged from 19 to 56 years (mean ± SD = ). Demographic data of the patients and biochemical and cytological findings of the CSF samples are listed in Table 2.


Age (years) 38.33 ± 10.44

 Male27 (67.5%)
 Female13 (32.5%)

Protein (mg/dL)402.7 ± 346.84
507 (17.5%)
5033 (82.5%)

Glucose (mg/dL)23 ± 15.92
4035 (87.5%)
405 (12.5%)

WBCs (total/mm3)7900.75 ± 12755.2
1000 (0%)
100–100017 (42.5%)
100023 (57.5%)

Neutrophil percentage74.25 ± 20.87
50%11 (27.5%)
50%19 (72.5%)

Data are presented as mean ± standard deviation for continuous variables and as number (percentage) for categorical variables.
WBCs, white blood cells.

CSF chemistry revealed elevated protein level (>50 mg/dL) in 82.5% of the samples and decreased glucose level (<40 mg/dL) in 87.5% of them. White blood cell (WBC) count >1.000 cells/mm3 was found in 57.5% of the samples whereas 42.5% of the samples showed WBC count between 100 and 1.000 cells/mm3. Predominant neutrophilic CSF (neutrophil > 50%) was found in 72.5% of the samples.

Thirty-six samples (90%) were positive for Streptococcus pneumoniae by real-time PCR, whereas Neisseria meningitidis and Haemophilus influenzae were not detected in any of the samples (0%). Four samples (10%) were negative for all three organisms (Table 3).


Positive 3690%
Streptococcus pneumoniae3690%
Haemophilus influenzae00
Neisseria meningitidis00

No statistical significant difference was observed regarding CSF chemistry and cells between samples of CSF positive and negative real-time PCR results (Table 4).

VariablesRT-PCR positiveRT-PCR negative/p value


Protein (mg/dL)300102.5−1.8730.061 (NS)
Glucose (mg/dL)1721.5−0.3390.735 (NS)
WBCs (total/mm3)2215400−1.5790.114 (NS)

Mean ± SD

Neutrophil percentage75 ± 21.867.5 ± 18.50.660.513 (NS)

Data are presented as median or mean ± standard deviation.
NS: nonsignificant result ( value > 0.05).
: Mann-Whitney test.
: unpaired -test.
WBCs, white blood cells.

4. Discussion

Rapid and accurate laboratory diagnostics remain a crucial step for the final diagnosis of bacterial meningitis, specifying the treatment and implementing preventive measures for close contacts when indicated. Conventional culture methods, though the gold standard diagnostic technique, cannot be relied upon per se, in certain situations owing to the delay in results availability and the relatively limited sensitivity that had been repeatedly reported worldwide [12, 13, 23] and in conditions when prior antimicrobial therapy has been received. In Egypt, a high percentage of culture-negative samples was reported previously [24, 25]. These results were explained by the fact that most patients received antimicrobial agents that are readily purchased as over-the-counter medications even prior to clinical evaluation alongside the occasional delay in csf sampling. For the above-mentioned reasons, we employed a molecular method (real-time PCR) in this study to improve the diagnosis of bacterial meningitis in culture-negative purulent CSF samples.

Demographic data analysis of patients revealed that they were mainly males (67.5% versus 12.5% for females). Most of the cases belonged to the middle age group (mean = 38.3). This finding agreed with Fouad et al. [4] who confirmed that males were more significantly affected with bacterial meningitis than females (61% versus 39%, resp.) though the disease was distributed in all age groups, with low rates of occurrence in the extremes of age (the neonates and above 60 years).

Real-time PCR in this study was positive for Streptococcus pneumoniae in 36 culture-negative CSF samples (90%) while no positive results for Haemophilus influenzae or Neisseria meningitidis were detected. The age group of the patients in this study might have contributed to these results as the main causative agents of bacterial meningitis in adults are generally believed to be Streptococcus pneumoniae and Neisseria meningitidis [1, 26, 27]. Streptococcus pneumoniae is found to be the commonest etiology of bacterial meningitis in the United States and Europe accounting for 61% of total cases in the United States [1, 3, 28] and in most African countries with high human immune deficiency virus prevalence [29, 30]. Yet meningococcal meningitis is common in Sub-Saharan Africa (the meningitis belt) but mostly apparent in the form of epidemics and outbreaks [31]. In a laboratory-based surveillance study undergone in Egypt by Afifi et al. [32], PCR was performed on purulent, culture-negative CSF specimens withdrawn from patients who met the criteria for case definition of bacterial meningitis. Streptococcus pneumoniae was also reported as the most common etiology of bacterial meningitis.

Fouad et al. [4] also documented Streptococcus pneumoniae as the most frequent isolate (52%) among bacteria causing meningitis. The agreement between our findings and those of the previously mentioned studies in Egypt consolidates the deduction of Shaban and Siam [33] in their review article that pneumococcal meningitis is currently the leading cause of meningitis in Egypt as its incidence is constantly rising at the expense of meningococcal meningitis, which may be a reflection of the increased use of polysaccharide meningococcal vaccines.

Wang et al. [7] also identified bacterial meningitis in five cases (9%) by CSF cultures and 25 (45%) by real-time PCR. They considered real-time PCR much more sensitive than culture for the diagnosis of bacterial meningitis particularly in their study where 68% of patients had received prior antimicrobial treatment and their CSF samples yielded negative culture results. A similar conclusion has been reached by Wu et al. [9] and Sacchi et al. [19] who stated that real-time PCR increases diagnostic yield for bacterial meningitis and is ideal for incorporation into routine surveillance in developing countries.

According to Brouwer et al. [34] CSF culture is documented to be positive only in 1/10th of the previously antibiotic treated patients in developing countries. Same result was found by Afifi et al. [32], who reported low rates of culture positive CSF samples (8%) of suspected cases with bacterial meningitis [32]. This low yield in culture results could be attributed to the fact that antimicrobials are being dispensed without prescriptions in Egypt.

This study faces the limitation of the relatively low number of CSF samples investigated and the lack of testing for other less commonly bacterial etiologies of adult meningitis (e.g., Group B Streptococcus, Listeria monocytogenes). This may provide an explanation for the negative results (10%) obtained.

According to our findings, we conclude that the use of molecular technique in the diagnosis of bacterial meningitis should be considered in suspected cases with negative culture results before reporting exclusion of the disease.

Competing Interests

The authors declare that they have no competing interests.


The authors gratefully acknowledge the support provided by the physicians of the Microbiology Laboratory in Abbasseya Fever Hospital for supplying them with the CSF samples included in this work.


  1. D. Van De Beek, J. De Gans, L. Spanjaard, M. Weisfelt, J. B. Reitsma, and M. Vermeulen, “Clinical features and prognostic factors in adults with bacterial meningitis,” New England Journal of Medicine, vol. 351, no. 18, pp. 1849–1923, 2004. View at: Publisher Site | Google Scholar
  2. S. A. Namani, R. A. Koci, E. Qehaja-Buçaj, L. Ajazaj-Berisha, and M. Mehmeti, “The epidemiology of bacterial meningitis in Kosovo,” Journal of Infection in Developing Countries, vol. 8, no. 7, pp. 823–830, 2014. View at: Publisher Site | Google Scholar
  3. M. C. Brouwer, A. R. Tunkel, and D. Van De Beek, “Epidemiology, diagnosis, and antimicrobial treatment of acute bacterial meningitis,” Clinical Microbiology Reviews, vol. 23, no. 3, pp. 467–492, 2010. View at: Publisher Site | Google Scholar
  4. R. Fouad, M. Khairy, W. Fathalah, T. Gad, B. El-Kholy, and A. Yosry, “Role of clinical presentations and routine CSF analysis in the rapid diagnosis of acute bacterial meningitis in cases of negative gram stained smears,” Journal of Tropical Medicine, vol. 2014, Article ID 213762, 7 pages, 2014. View at: Publisher Site | Google Scholar
  5. C. E. Corless, M. Guiver, R. Borrow, V. Edwards-Jones, A. J. Fox, and E. B. Kaczmarski, “Simultaneous detection of Neisseria meningitidis, Haemophilus influenzae, and Streptococcus pneumoniae in suspected cases of meningitis and septicemia using real-time PCR,” Journal of Clinical Microbiology, vol. 39, no. 4, pp. 1553–1558, 2001. View at: Publisher Site | Google Scholar
  6. G. M. K. Abdeldaim, K. Strålin, J. Korsgaard, J. Blomberg, C. Welinder-Olsson, and B. Herrmann, “Multiplex quantitative PCR for detection of lower respiratory tract infection and meningitis caused by Streptococcus pneumoniae, Haemophilus influenzae and Neisseria meningitidis,” BMC Microbiology, vol. 10, article 310, 2010. View at: Publisher Site | Google Scholar
  7. Y. Wang, G. Guo, H. Wang et al., “Comparative study of bacteriological culture and real-time fluorescence quantitative PCR (RT-PCR) and multiplex PCR-based reverse line blot (mPCR/RLB) hybridization assay in the diagnosis of bacterial neonatal meningitis,” BMC Pediatrics, vol. 14, no. 1, article 224, 2014. View at: Publisher Site | Google Scholar
  8. M. W. Bijlsma, M. C. Brouwer, E. S. Kasanmoentalib et al., “Community-acquired bacterial meningitis in adults in the Netherlands, 2006–2014: a prospective cohort study,” The Lancet Infectious Diseases, vol. 16, no. 3, pp. 339–447, 2016. View at: Publisher Site | Google Scholar
  9. H. M. Wu, S. M. Cordeiro, B. H. Harcourt et al., “Accuracy of real-time PCR, Gram stain and culture for Streptococcus pneumoniae, Neisseria meningitidis and Haemophilus influenzae meningitis diagnosis,” BMC Infectious Diseases, vol. 13, no. 1, article 26, 2013. View at: Publisher Site | Google Scholar
  10. L. D. Saravolatz, O. Manzor, N. VanderVelde, J. Pawlak, and B. Belian, “Broad-range bacterial polymerase chain reaction for early detection of bacterial meningitis,” Clinical Infectious Diseases, vol. 36, no. 1, pp. 40–45, 2003. View at: Publisher Site | Google Scholar
  11. K. Ahmadi, A. Akya, B. Numanpour, A. Salimi, and A. Veisi-Raigani, “Frequency of Streptococcus pneumoniae infection in patients with suspected meningitis in Imam Reza Hospital of Kermanshah in the west of Iran,” Iranian Journal of Microbiology, vol. 7, no. 1, pp. 12–17, 2015. View at: Google Scholar
  12. L. E. Nigrovic, R. Malley, C. G. Macias et al., “Effect of antibiotic pretreatment on cerebrospinal fluid profiles of children with bacterial meningitis,” Pediatrics, vol. 122, no. 4, pp. 726–730, 2008. View at: Publisher Site | Google Scholar
  13. J. P. Bryan, H. Rodriques de Silva, A. Tavares, H. Rocha, and W. M. Scheld, “Etiology and mortality of bacterial meningitis in northeastern Brazil,” Clinical Infectious Diseases, vol. 12, no. 1, pp. 128–135, 1990. View at: Publisher Site | Google Scholar
  14. A. R. Tunkel, B. J. Hartman, S. L. Kaplan et al., “Practice guidelines for the management of bacterial meningitis,” Clinical Infectious Diseases, vol. 39, no. 9, pp. 1267–1284, 2004. View at: Publisher Site | Google Scholar
  15. L. E. Nigrovic, N. Kuppermann, A. J. McAdam, and R. Malley, “Cerebrospinal latex agglutination fails to contribute to the microbiologic diagnosis of pretreated children with meningitis,” Pediatric Infectious Disease Journal, vol. 23, no. 8, pp. 786–788, 2004. View at: Publisher Site | Google Scholar
  16. K. Tarafdar, S. Rao, R. A. Recco, and M. M. Zaman, “Lack of sensitivity of the latex agglutination test to detect bacterial antigen in the cerebrospinal fluid of patients with culture-negative meningitis,” Clinical Infectious Diseases, vol. 33, no. 3, pp. 406–408, 2001. View at: Publisher Site | Google Scholar
  17. E. Van Gastel, P. Bruynseels, W. Verstrepen, and A. Mertens, “Evaluation of a real-time polymerase chain reaction assay for the diagnosis of pneumococcal and meningococcal meningitis in a tertiary care hospital,” European Journal of Clinical Microbiology and Infectious Diseases, vol. 26, no. 9, pp. 651–653, 2007. View at: Publisher Site | Google Scholar
  18. M. Tuyama, R. F. Boente, M. C. Rebelo, R. P. Igreja, and D. E. Barroso, “The utility of the polymerase chain reaction assay for aetiologic definition of unspecified bacterial meningitis cases,” Memorias do Instituto Oswaldo Cruz, vol. 103, no. 2, pp. 138–142, 2008. View at: Publisher Site | Google Scholar
  19. C. T. Sacchi, L. O. Fukasawa, M. G. Gonçalves et al., “Incorporation of real-time PCR into routine Public Health Surveillance of Culture Negative Bacterial meningitis in São Paulo, Brazil,” PLoS ONE, vol. 6, no. 6, Article ID e20675, 2011. View at: Publisher Site | Google Scholar
  20. B. Heydaria, H. Khalilib, I. Karimzadehc, and H. Emadi-Kochak, “Clinical, paraclinical, and antimicrobial resistance features of community-acquired acute bacterial meningitis at a large infectious diseases ward in Tehran, Iran,” Iranian Journal of Pharmaceutical Research, vol. 15, pp. 347–354, 2014. View at: Google Scholar
  21. M. Cheesebrough, “Biochemical tests to identify bacteria,” in District Laboratory Practice in Tropical Countries, M. Cheesbrough, Ed., pp. 116–124, Cambridge University Press, Cambridge, UK, 2nd edition, 2007. View at: Google Scholar
  22. K. Ohkusu, K. A. Nash, and C. B. Inderlied, “Molecular characterisation of Haemophilus influenzae type a and untypeable strains isolated simultaneously from cerebrospinal fluid and blood: novel use of quantitative real-time PCR based on the cap copy number to determine virulence,” Clinical Microbiology and Infection, vol. 11, no. 8, pp. 637–643, 2005. View at: Publisher Site | Google Scholar
  23. L. Ragunathan, M. Ramsay, R. Borrow, M. Guiver, S. Gray, and E. B. Kaczmarski, “Clinical features, laboratory findings and management of meningococcal meningitis in England and Wales: report of a 1997 survey,” Journal of Infection, vol. 40, no. 1, pp. 74–79, 2000. View at: Publisher Site | Google Scholar
  24. N. Guirguis, K. Hafez, M. A. El Kholy, J. B. Robbins, and E. C. Gotschlich, “Bacterial meningitis in Egypt: analysis of CSF isolates from hospital patients in Cairo, 1977-1978,” Bulletin of the World Health Organization, vol. 61, no. 3, pp. 517–524, 1983. View at: Google Scholar
  25. F. G. Youssef, H. El-Sakka, A. Azab et al., “Etiology, antimicrobial susceptibility profiles, and mortality associated with bacterial meningitis among children in Egypt,” Annals of Epidemiology, vol. 14, no. 1, pp. 44–48, 2004. View at: Publisher Site | Google Scholar
  26. M. L. Durand, S. B. Calderwood, D. J. Weber et al., “Acute bacterial meningitis in adults: a review of 493 episodes,” The New England Journal of Medicine, vol. 328, no. 1, pp. 21–28, 1993. View at: Publisher Site | Google Scholar
  27. B. Sigurdardóttir, Ó. M. Björnsson, K. E. Jónsdóttir, H. Erlendsdóttir, and S. Gudmundsson, “Acute bacterial meningitis in adults: a 20-year overview,” Archives of Internal Medicine, vol. 157, no. 4, pp. 425–430, 1997. View at: Publisher Site | Google Scholar
  28. B. Arda, O. R. Sipahi, S. Atalay, and S. Ulusoy, “Pooled analysis of 2,408 cases of acute adult purulent meningitis from Turkey,” Medical Principles and Practice, vol. 17, no. 1, pp. 76–79, 2008. View at: Publisher Site | Google Scholar
  29. M. Scarborough, S. B. Gordon, C. J. M. Whitty et al., “Corticosteroids for bacterial meningitis in adults in sub-Saharan Africa,” New England Journal of Medicine, vol. 357, no. 24, pp. 2441–2450, 2007. View at: Publisher Site | Google Scholar
  30. M. Scarborough and G. E. Thwaites, “The diagnosis and management of acute bacterial meningitis in resource-poor settings,” The Lancet Neurology, vol. 7, no. 7, pp. 637–648, 2008. View at: Publisher Site | Google Scholar
  31. G. Campagne, A. Schuchat, S. Djibo, A. Ousséini, L. Cissé, and J. P. Chippaux, “Epidemiology of bacterial meningitis in Niamey, Niger, 1981–96,” Bulletin of the World Health Organization, vol. 77, no. 6, pp. 499–508, 1999. View at: Google Scholar
  32. S. Afifi, M. O. Wasfy, M. A. Azab et al., “Laboratory-based surveillance of patients with bacterial meningitis in Egypt (1998–2004),” European Journal of Clinical Microbiology and Infectious Diseases, vol. 26, no. 5, pp. 331–340, 2007. View at: Publisher Site | Google Scholar
  33. L. Shaban and R. Siam, “Prevalence and antimicrobial resistance pattern of bacterial meningitis in Egypt,” Annals of Clinical Microbiology and Antimicrobials, vol. 8, article 26, 2009. View at: Publisher Site | Google Scholar
  34. M. C. Brouwer, A. R. Tunkel, and D. Van De Beek, “Epidemiology, diagnosis, and antimicrobial treatment of acute bacterial meningitis,” Clinical Microbiology Reviews, vol. 23, no. 3, pp. 467–492, 2010. View at: Publisher Site | Google Scholar

Copyright © 2016 Walaa Shawky Khater and Safia Hamed Elabd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

More related articles

3465 Views | 2677 Downloads | 3 Citations
 PDF  Download Citation  Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly and safely as possible. Any author submitting a COVID-19 paper should notify us at to ensure their research is fast-tracked and made available on a preprint server as soon as possible. We will be providing unlimited waivers of publication charges for accepted articles related to COVID-19. Sign up here as a reviewer to help fast-track new submissions.