Multiple Sclerosis International

Multiple Sclerosis International / 2016 / Article

Research Article | Open Access

Volume 2016 |Article ID 5794910 | 7 pages |

Lack of Association between Pulse Steroid Therapy and Bone Mineral Density in Patients with Multiple Sclerosis

Academic Editor: Bianca Weinstock-Guttman
Received30 Sep 2015
Revised07 Dec 2015
Accepted13 Dec 2015
Published04 Feb 2016


Multiple sclerosis (MS) has been associated with reduced bone mineral density (BMD). The purpose of this study was to determine the possible factors affecting BMD in patients with MS. We included consecutive 155 patients with MS and 90 age- and sex-matched control subjects. Patients with MS exhibited significantly lower T-scores and Z-scores in the femoral neck and trochanter compared to the controls. Ninety-four (61%) patients had reduced bone mass in either the lumbar spine or the femoral neck; of these, 64 (41.3%) had osteopenia and 30 (19.4%) had osteoporosis. The main factors affecting BMD were disability, duration of MS, and smoking. There was a negative relationship between femoral BMD and EDSS and disease duration. No association with lumbar BMD was determined. There were no correlations between BMD at any anatomic region and cumulative corticosteroid dose. BMD is significantly lower in patients with MS than in healthy controls. Reduced BMD in MS is mainly associated with disability and duration of the disease. Short courses of high dose steroid therapy did not result in an obvious negative impact on BMD in the lumbar spine and femoral neck in patients with MS.

1. Introduction

Multiple sclerosis (MS), a chronic progressive demyelinating disease of the central nervous system, is the most common cause of acquired disability in young adults [1]. Several previous studies, but not all, have shown reduced bone mineral density (BMD) in patients with MS, indicating that patients with MS have a higher risk for osteoporosis [210]. The exact mechanism and causes of the reduced BMD in MS patients are as yet unclear.

MS itself causes problems with vision, balance, coordination, and motor performance, all of which increase the risk of osteopenia, osteoporosis, and fractures. Genetic factors, corticosteroid use, the presence of various cytokines involved in the pathogenesis of MS, and calcium and vitamin D deficiency have also been implicated as plausible etiopathogenic mechanisms leading to secondary osteoporosis in patients with MS [4, 5, 10, 11].

Chronic use of glucocorticosteroids has been shown to increase bone resorption and to reduce bone formation and is a risk factor for osteoporosis [12, 13].

High-dose methylprednisolone is the gold standard in pharmacological management of MS relapses. The effect of high-dose methylprednisolone pulses on BMD in MS is still controversial, however. There are some concerns over possible harmful effects of steroid pulse on bone composition in patients with MS.

Understanding the role of pulse steroid in bone status will help with planning optimal relapse management in MS. The purpose of this study was to determine the possible factors affecting bone mineral density in patients with MS.

2. Subjects and Methods

One hundred fifty-five (51 males and 104 females) consecutive patients with MS diagnosed according to McDonald 2005 criteria [14] regularly followed up in our outpatient MS clinic and 90 age- and sex-matched control subjects were included in the study. The protocol was approved by the university local ethical committee, and all individuals gave informed consent. Subjects with a medical condition or medication use that might influence bone mineral metabolism such as menopause, hyperthyroidism, rheumatoid arthritis, hormone replacement therapy, or use of long-term oral contraceptive exceeding 1 year were excluded from the study. Subjects with body mass index higher than 35 kg/m2 were also excluded. None of the case or control individuals were receiving calcitonin, vitamin D, bisphosphonates, or selective estrogen receptor modulators. All patients were in remission and had not received pulse intravenous methylprednisolone for at least 1 month during the BMD measurements.

Neurological examination and Expanded Disability Status Scale (EDSS) calculation were performed by a neurostatus EDSS-certified neurologist. EDSS steps 0 to 4.5 refer to patients who are fully ambulatory, while EDSS steps 5.0 to 9.5 are defined by impairment in ambulation [15]. For this study we defined MS subgroups as a fully ambulatory group (EDSS < 5) and an impaired ambulation group (EDSS ≥ 5).

Treatment of MS relapse at our center consists of 3–7 days of 1000 mg intravenous methylprednisolone without oral steroid taper.

The control group consisted of randomly selected healthy individuals representing friends of patients in the neurology clinic or hospital staff who consented to participate for research purposes.

Dual energy X-ray absorptiometry (DEXA) was used to measure BMD values at the lumbar spine (L1–L4) and femoral neck and trochanter. The scans and data analysis were performed by the same technician.

BMD results were expressed as g/cm2, in addition to -score and -score. -score is used to make a diagnosis of normal bone density, osteoporosis, or osteopenia according to the classification system of World Health Organization (WHO) [16]. Normal BMD was defined as -score of −1.0 or above, osteopenia was defined as -score less than −1.0 and greater than −2.5, and osteoporosis was defined as -score of −2.5 or less.

Biochemical parameters which may have an impact on BMD, serum 25-hydroxyvitamin D3, intact parathyroid hormone, calcium, phosphorus, and total alkaline phosphatase were measured.

2.1. Statistical Analyses

Continuous data were presented as means (± standard deviation) and categorical data were presented as numbers. Comparison of groups was performed using χ2 test for dichotomous variables and independent-samples 2-tailed -tests for continuous variables. Stepwise multiple regression analysis was performed to examine factors independently associated with -scores in the three regions. Gender, age, MS duration, BMI, EDSS, MS type, cumulative steroid administration, and smoking habits were included in the model and assumed to be independent variables. Relations between BMD and numerical data (age, disease duration, cumulative steroid dose, and vitamin D level) were evaluated using Pearson’s correlation analysis. Spearman’s rank correlation coefficients () were calculated to determine the relationship between -scores for BMD and EDSS. All tests were performed using SPSS (version 13, SPSS, Chicago, IL), and was considered statistically significant.

3. Results

Descriptive characteristics of patients with MS and controls are shown in Table 1. No statistically significant differences were found in terms of age, sex ratio, smoking duration, or BMI between the MS patients and controls. The mean ages of male and female patient subgroups were also similar to those of the male and female controls.

MS patientsControls

Sex (female/male)155 (104/51)90 (58/32)0.66
Age, all 35.6 ± 9.336.6 ± 8.50.36
 Female35.1 ± 9.137.7 ± 8.20.07
 Male36.7 ± 9.834.6 ± 8.70.32
Smoking years10.7 ± 9.810.2 ± 9.40.44
Body mass index (kg/m2)23.6 ± 3.224.1 ± 3.10.37
Mean age at onset27.7 ± 8.1
MS duration (years)7.7 ± 5.8
Relapse number3.8 ± 2.9
EDSS2.6 ± 2.0
Total steroid dose (gram)13.9 ± 13.4
25(OH)D (ng/mL)12.4 ± 7.1

SD: standard deviation; RRMS: relapsing-remitting multiple sclerosis; SPMS: secondary progressive multiple sclerosis; PPMS: primary progressive multiple sclerosis.

Mean age of the entire MS patient group was 35.6 (18–55), and mean EDSS was 2.6 (0–7.5). One hundred twelve patients with MS were fully ambulatory (EDSS score < 5) and 43 had limited ambulation (EDSS ≥ 5).

Of these MS patients, 110 (71%) had relapsing-remitting multiple sclerosis, 34 (22%) had secondary progressive multiple sclerosis, and 11 (7%) had primary progressive multiple sclerosis. The majority of patients (135 of the 155) had received pulse methylprednisolone therapy prior to enrolment, with an average cumulative dose of 13.9 g.

One hundred five of the patients with MS used disease-modifying drugs (75 used interferon beta, 24 used glatiramer acetate, and 6 used natalizumab).

Table 2 shows BMD assessment at the three regions of interest in the patients and controls. Mean BMD measurements did not exhibit any significant difference at the lumbar site in the female and male patient groups compared to the controls. Male and female patients exhibited significantly lower -score and -score compared to the controls in the femoral neck and trochanter. BMD score expressed as g/cm2 was significantly lower at the femoral neck and trochanter in female MS patients than in the female controls.

Female Male
MS patients
MS patients

Lumbar spine
 BMD0.98 ± 0.151 ± ± 0.171.00 ± 0.130.81
score−0.56 ± 1.37−0.40 ± 1.110.47−0.81 ± 1.51−0.77 ± 0.870.89
score−0.33 ± 1.370.06 ± 1.170.07−0.68 ± 1.50−0.57 ± 0.850.69
Femoral neck
 BMD0.81 ± 0.170.87 ± 0.140.0210.89 ± 0.230.92 ± 0.140.48
score−0.82 ± 1.59−0.24 ± 1.35<0.001−0.67 ± 1.690.69 ± 1.53<0.001
score−0.48 ± 1.630.45 ± 1.43<0.001−0.05 ± 1.590.79 ± 1.46 0.018
Femoral trochanter
 BMD0.64 ± 0.130.68 ± 0.10<0.0010.74 ± 0.160.71 ± 0.150.46
score−1.02 ± 1.20−0.47 ± 1.150.005−0.76 ± 1.290.32 ± 1.53<0.001
score−0.87 ± 1.190.15 ± 1.15<0.001−0.49 ± 1.230.50 ± 1.41<0.001

SD: standard deviation. values are from Student’s -test and values <0.05 are statistically significant.

The numbers and proportions of patients and controls with WHO classified osteoporosis and osteopenia at the three regions are shown in Figure 1. Ninety-four (60%) of the patients with MS had either osteoporosis or osteopenia in at least one measured site. In fully ambulatory patients (EDSS < 5), the proportions of osteopenia and osteoporosis did not differ significantly at the lumbar spine () or femoral neck (), but the proportion of osteopenia was significantly higher at the femur trochanter ().

In limited ambulatory MS patients (EDSS ≥ 5), the proportions of osteopenia and osteoporosis were significantly higher at all three regions of interest. Only 13 of the 43 (30%) of the limited ambulation patients had normal BMD measurements at all regions.

Multiple linear regression analyses showed an independent negative association between -scores and smoking, EDSS at the femoral neck ( and 0.005, resp.), and trochanter ( and 0.03, resp.) and age at the femoral neck (). Disease duration was associated with reduced BMD at the lumbar site (). Cumulative steroid dose and relapse rate were not associated with BMD scores at any region (Table 3).

Lumbar spineFemoral neckFemoral trochanter

Age 0.1180.2520.2400.0160.1410.161
Disease duration0.0370.7370.0200.852−0.0870.418
Smoking years−0.1920.051−0.2230.019−0.1910.049
Cumulative steroid dose−0.0630.638−0.1270.327−0.0730.581
Relapse number0.0650.6450.0920.4970.0970.484

values <0.05 are statistically significant.

Correlation analyses revealed a negative association of -scores with EDSS at the femoral neck ( and ) and the trochanter (, ), but there was no significant association at the lumbar region. There was no correlation between cumulative steroid dose and BMD values at any region (Figure 2). Distributions of -scores in relation to disability and cumulative steroid dose are shown in Figure 2.

Levels of vitamin D intact parathyroid hormone, calcium, phosphorus, and total alkaline phosphatase were not significantly correlated with BMD measurements.

MS duration was significantly negatively correlated with -scores at the femoral neck ( and ) and femoral trochanter ( and ). Length of smoking status was significantly correlated with -scores in the lumbar region ( and ), femoral neck ( and ), and femoral trochanter ( and ).

4. Discussion

This study demonstrated that male and female patients with MS have significantly higher prevalence of osteoporosis and osteopenia at femoral regions, but not at the lumbar site, compared with healthy age-matched control subjects. The same results have been reported in previous studies [9, 10, 1618] for the femoral site; however, other studies have also reported decreased BMD at the lumbar site [6, 10, 19].

Our major findings in this study are that reduced BMD in patients with MS is mainly associated with higher EDSS scores and that short courses of high-dose methylprednisolone therapy in MS relapses did not result in any obvious negative impact on BMD.

The deleterious effect of low-dose, long-term oral steroid treatment on bone homeostasis is well known [20]. Epidemiological studies have shown that fracture risk increases rapidly after commencement of oral steroid treatment and is related to the dose and duration of steroid exposure [21]. However, it has been reported that the fracture risk tends to return toward baseline levels after discontinuation of steroids [22].

In agreement with our study, previous studies have shown that intermittent intravenous high-dose methylprednisolone commonly used as a therapy for acute MS relapses does not affect BMD [9, 2326], but others have reported a negative association between steroid therapy and bone status [18, 19, 27, 28]. Cosman et al. determined suppression of bone formation in patients with MS who received 1 g IV MP for 10 days followed by 28-day oral glucocorticoid [19]. Sioka et al. also failed to demonstrate a statistically significant correlation between BMD in all investigated sites and total steroid dose (only 20 g on average) and number of relapses. However, that study did demonstrate a significantly increased frequency of osteopenia or osteoporosis when WHO diagnosis was the dependent variant instead of BMD at both femoral sites investigated [6]. Ozgocmen et al. determined that estimated cumulative steroid dose was negatively correlated with femoral trochanteric BMD, although there was no correlation with BMD at the femoral neck or lumbar region [27]. More recently, Tyblova et al. reported a negative effect of steroid and disability on BMD [28].

In addition to several studies that failed to show an association with reduced bone mass and intravenous pulse high-dose methylprednisolone therapy in patients with MS [9, 2326], Schwid et al. reported a significant increase in lumbar BMD but no change in femoral BMD in patients with MS treated with high-dose methylprednisolone pulse (1 g/day for 3 days) [24].

We determined a significant association between disability levels and BMD. In order to better explore this hypothesis we evaluated the presence of osteopenia and osteoporosis in the two patient subgroups: EDSS scores not affected by ambulation (EDSS < 5) and EDSS scores based on limited ambulation (EDSS ≥ 5). We observed decreased BMD in fully ambulatory patients with MS. However, patients with impaired ambulation exhibited more prominent and a high proportion of decreased BMD.

Sioka et al. determined no association between axial BMD and neurological disability quantified by EDSS [6]. Similarly, Mojtahedi et al. determined such a correlation in a study of 29 female patients with EDSS less than 5.5 [29]. On the other hand, in parallel to our findings, the vast majority of previous studies have reported negative correlations between BMD and EDSS [7, 10, 24, 26, 27, 29]. The discrepancy between the results may be due to the different characteristics of the populations investigated.

A negative association was observed between duration of MS and BMD. Similar results have been reported in other studies [6, 9, 30].

There was a negative association between smoking and BMD, again in agreement with previous studies [31].

These effects may be mediated directly by toxic effects on osteoblasts in addition to the negative effects on bone vessels and nerves [31].

We determined no association between vitamin D and bone status in MS. However, one of the limitations of our study is that it was not designed to assess vitamin D and additional humoral or endocrine factors which may contribute to bone loss in patients with MS. Previous studies have reported an association between vitamin D status and low BMD [7, 19, 32, 33]. However, other investigators have reported no relationship between vitamin D levels and BMD in patients with MS [8, 10, 25, 27]. Another limitation of our study is that we included heterogeneous groups of different types of MS. Low frequency pulses and sporadic glucocorticoid pulses 1-2 times in a year may not have been a problem on bone metabolism in young patients. However, steroids can have adverse effects in patients with PPMS and SPMS in older MS patients.

5. Conclusion

Our findings reinforce the idea that motor disability and limited mobilization appear to be a major contributor to secondary osteoporosis in patients with MS. Pulse methylprednisolone treatment for relapse does not further exacerbate bone loss. We therefore suggest that it is not necessary to exclude relapse treatment with pulse dose methylprednisolone due to concerns over bone loss. The main clinical implication of our results suggests that physical rehabilitation and exercise programs for patients with MS are essential for better bone health.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.


  1. A. Compston and A. Coles, “Multiple sclerosis,” The Lancet, vol. 372, no. 9648, pp. 1502–1517, 2008. View at: Publisher Site | Google Scholar
  2. Y. Dionyssiotis, “Bone loss and fractures in multiple sclerosis: focus on epidemiologic and physiopathological features,” International Journal of General Medicine, vol. 4, pp. 505–509, 2011. View at: Publisher Site | Google Scholar
  3. R. Dobson, S. Ramagopalan, and G. Giovannoni, “Bone health and multiple sclerosis,” Multiple Sclerosis, vol. 18, no. 11, pp. 1522–1528, 2012. View at: Publisher Site | Google Scholar
  4. J. C. Gibson and G. D. Summers, “Bone health in multiple sclerosis,” Osteoporosis International, vol. 22, no. 12, pp. 2935–2949, 2011. View at: Publisher Site | Google Scholar
  5. A. P. Hearn and E. Silber, “Osteoporosis in multiple sclerosis,” Multiple Sclerosis, vol. 16, no. 9, pp. 1031–1043, 2010. View at: Publisher Site | Google Scholar
  6. C. Sioka, S. Papakonstantinou, A. Fotopoulos et al., “Bone mineral density in ambulatory patients with multiple sclerosis,” Neurological Sciences, vol. 32, no. 5, pp. 819–824, 2011. View at: Publisher Site | Google Scholar
  7. T. Terzi, M. Terzi, B. Tander, F. Cantürk, and M. Onar, “Changes in bone mineral density and bone metabolism markers in premenopausal women with multiple sclerosis and the relationship to clinical variables,” Journal of Clinical Neuroscience, vol. 17, no. 10, pp. 1260–1264, 2010. View at: Publisher Site | Google Scholar
  8. N. Triantafyllou, I. Lambrinoudaki, P. Thoda et al., “Lack of association between vitamin D levels and bone mineral density in patients with multiple sclerosis,” Journal of the Neurological Sciences, vol. 313, no. 1-2, pp. 137–141, 2012. View at: Publisher Site | Google Scholar
  9. Ş. Tüzün, A. Altintaş, I. Karacan, S. Tangürek, S. Saip, and A. Siva, “Bone status in multiple sclerosis: beyond corticosteroid,” Multiple Sclerosis, vol. 9, no. 6, pp. 600–604, 2003. View at: Publisher Site | Google Scholar
  10. B. Weinstock-Guttman, E. Gallagher, M. Baier et al., “Risk of bone loss in men with multiple sclerosis,” Multiple Sclerosis, vol. 10, no. 2, pp. 170–175, 2004. View at: Publisher Site | Google Scholar
  11. M. T. Kampman, E. F. Eriksen, and T. Holmøy, “Multiple sclerosis, a cause of secondary osteoporosis? What is the evidence and what are the clinical implications?” Acta Neurologica Scandinavica, vol. 124, no. 191, pp. 44–49, 2011. View at: Publisher Site | Google Scholar
  12. S. L. Silverman and N. E. Lane, “Glucocorticoid-induced osteoporosis,” Current Osteoporosis Reports, vol. 7, no. 1, pp. 23–26, 2009. View at: Publisher Site | Google Scholar
  13. R. S. Weinstein, “Glucocorticoid-induced osteoporosis and osteonecrosis,” Endocrinology and Metabolism Clinics of North America, vol. 41, no. 3, pp. 595–611, 2012. View at: Publisher Site | Google Scholar
  14. C. H. Polman, S. C. Reingold, B. Banwell et al., “Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria,” Annals of Neurology, vol. 69, no. 2, pp. 292–302, 2011. View at: Publisher Site | Google Scholar
  15. J. F. Kurtzke, “Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS),” Neurology, vol. 33, no. 11, pp. 1444–1452, 1983. View at: Publisher Site | Google Scholar
  16. J. A. Kanis, L. J. Melton III, C. Christiansen, C. C. Johnston, and N. Khaltaev, “The diagnosis of osteoporosis,” Journal of Bone and Mineral Research, vol. 9, no. 8, pp. 1137–1141, 1994. View at: Google Scholar
  17. A. Ayatollahi, M. R. Mohajeri-Tehrani, and S. Nafissi, “Factors affecting bone mineral density in multiple sclerosis patients,” Iranian Journal of Neurology, vol. 12, pp. 19–22, 2013. View at: Google Scholar
  18. V. Zikán, M. Tyblova, I. Raška, M. Luchavova, D. Michalska, and E. Havrdova, “Bone mineral density and body composition in men with multiple sclerosis,” Bone, vol. 50, supplement 1, p. S145, 2012. View at: Publisher Site | Google Scholar
  19. F. Cosman, J. Nieves, L. Komar et al., “Fracture history and bone loss in patients with MS,” Neurology, vol. 51, no. 4, pp. 1161–1165, 1998. View at: Publisher Site | Google Scholar
  20. T. P. van Staa, H. G. M. Leufkens, and C. Cooper, “The epidemiology of corticosteroid-induced osteoporosis: a meta-analysis,” Osteoporosis International, vol. 13, no. 10, pp. 777–787, 2002. View at: Publisher Site | Google Scholar
  21. T. P. Van Staa, H. G. M. Leufkens, L. Abenhaim, B. Zhang, and C. Cooper, “Oral corticosteroids and fracture risk: relationship to daily and cumulative doses,” Rheumatology, vol. 39, no. 12, pp. 1383–1389, 2000. View at: Publisher Site | Google Scholar
  22. P. Vestergaard, L. Rejnmark, and L. Mosekilde, “Fracture risk associated with different types of oral corticosteroids and effect of termination of corticosteroids on the risk of fractures,” Calcified Tissue International, vol. 82, no. 4, pp. 249–257, 2008. View at: Publisher Site | Google Scholar
  23. S. M. Moen, E. G. Celius, L. Sandvik, L. Nordsletten, E. F. Eriksen, and T. Holmoøy, “Low bone mass in newly diagnosed multiple sclerosis and clinically isolated syndrome,” Neurology, vol. 77, no. 2, pp. 151–157, 2011. View at: Publisher Site | Google Scholar
  24. S. R. Schwid, A. D. Goodman, J. E. Puzas, M. P. McDermott, and D. H. Mattson, “Sporadic corticosteroid pulses and osteoporosis in multiple sclerosis,” Archives of Neurology, vol. 53, no. 8, pp. 753–757, 1996. View at: Publisher Site | Google Scholar
  25. L. H. Steffensen, S. I. Mellgren, and M. T. Kampman, “Predictors and prevalence of low bone mineral density in fully ambulatory persons with multiple sclerosis,” Journal of Neurology, vol. 257, no. 3, pp. 410–418, 2010. View at: Publisher Site | Google Scholar
  26. M. Zorzon, R. Zivadinov, L. Locatelli et al., “Long-term effects of intravenous high dose methylprednisolone pulses on bone mineral density in patients with multiple sclerosis,” European Journal of Neurology, vol. 12, no. 7, pp. 550–556, 2005. View at: Publisher Site | Google Scholar
  27. S. Ozgocmen, S. Bulut, N. Ilhan, A. Gulkesen, O. Ardicoglu, and Y. Özkan, “Vitamin D deficiency and reduced bone mineral density in multiple sclerosis: effect of ambulatory status and functional capacity,” Journal of Bone and Mineral Metabolism, vol. 23, no. 4, pp. 309–313, 2005. View at: Publisher Site | Google Scholar
  28. M. Tyblova, T. Kalincik, V. Zikan, and E. Havrdova, “Impaired ambulation and steroid therapy impact negatively on bone health in multiple sclerosis,” European Journal of Neurology, vol. 22, no. 4, pp. 624–632, 2015. View at: Publisher Site | Google Scholar
  29. M. C. Mojtahedi, E. M. Snook, R. W. Motl, and E. M. Evans, “Bone health in ambulatory individuals with multiple sclerosis: impact of physical activity, glucocorticoid use, and body composition,” Journal of Rehabilitation Research and Development, vol. 45, no. 6, pp. 851–862, 2008. View at: Publisher Site | Google Scholar
  30. E. Stenager and K. Jensen, “Fractures in multiple sclerosis,” Acta Neurologica Belgica, vol. 91, no. 5, pp. 296–302, 1991. View at: Google Scholar
  31. M. R. Law and A. K. Hackshaw, “A meta-analysis of cigarette smoking, bone mineral density and risk of hip fracture: recognition of a major effect,” British Medical Journal, vol. 315, no. 7112, pp. 841–846, 1997. View at: Publisher Site | Google Scholar
  32. A. Kirbas, S. Kirbas, O. Anlar, A. K. Turkyilmaz, M. C. Cure, and H. Efe, “Investigation of the relationship between vitamin D and bone mineral density in newly diagnosed multiple sclerosis,” Acta Neurologica Belgica, vol. 113, no. 1, pp. 43–47, 2013. View at: Publisher Site | Google Scholar
  33. J. Nieves, F. Cosman, J. Herbert, V. Shen, and R. Lindsay, “High prevalence of vitamin D deficiency and reduced bone mass in multiple sclerosis,” Neurology, vol. 44, no. 9, pp. 1687–1692, 1994. View at: Publisher Site | Google Scholar

Copyright © 2016 Serap Zengin Karahan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

More related articles

1100 Views | 428 Downloads | 1 Citation
 PDF  Download Citation  Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly and safely as possible. Any author submitting a COVID-19 paper should notify us at to ensure their research is fast-tracked and made available on a preprint server as soon as possible. We will be providing unlimited waivers of publication charges for accepted articles related to COVID-19. Sign up here as a reviewer to help fast-track new submissions.