Comparing the Mini-BESTest with the Berg Balance Scale to Evaluate Balance Disorders in Parkinson's Disease

King, Laurie A.; Priest, Kelsey C.; Salarian, Arash; Pierce, Don; Horak, Fay B.

doi:https://doi.org/10.1155/2012/375419

Parkinson’s Disease

On this page

Abstract Introduction Methods Results Discussion Acknowledgments References Copyright Related Articles

Special Issue

Rehabilitation and Parkinson’s Disease

View this Special Issue

Research Article | Open Access

Volume 2012 | Article ID 375419 | https://doi.org/10.1155/2012/375419

Comparing the Mini-BESTest with the Berg Balance Scale to Evaluate Balance Disorders in Parkinson's Disease

Laurie A. King,¹Kelsey C. Priest,¹Arash Salarian,¹Don Pierce,²and Fay B. Horak¹

Academic Editor: Terry Ellis

Received09 Jun 2011

Revised23 Jul 2011

Accepted18 Aug 2011

Published24 Oct 2011

Abstract

Objective. The purpose of this study was to explore the usefulness of the Mini-BESTest compared to the Berg Balance Scale in evaluating balance in people with PD of varying severity. We evaluated (1) the distribution of patients scores to look for ceiling effects, (2) concurrent validity with severity of disease, and (3) the sensitivity/specificity of separating people with or without postural response deficits. Subjects. Ninety-seven people with PD were tested for balance deficits using the Berg, Mini-BESTest, Unified Parkinson’s Disease Rating Scale (UPDRS) III and the Hoehn & Yahr (H&Y) disease severity classification. Setting. Clinical research facility at Oregon Health & Science University. Results. The Mini-BESTest is highly correlated with the Berg (, ), but avoids the ceiling compression effect of the Berg for mild PD (skewness −2.30 Berg, −0.93 Mini-BESTest). Consequently, the Mini-BESTest is more effective than the Berg for predicting UPDRS Motor score ( Mini-BESTest versus Berg), and for discriminating between those with and without postural response deficits as measured by the H&Y (ROC differential ). Conclusion. The Mini-BESTest is a promising tool for discerning balance deficits in patients with PD, most importantly those with more subtle deficits.

1. Introduction

Postural instability and balance deficits are one of the most debilitating impairments associated with chronic neurological disease, such as Parkinson’s disease (PD) [1]. The most commonly used clinical test of balance severity in people with PD is the Berg Balance Scale (Berg) [2]. The Berg, originally designed for use in the frail elderly, is a 14-item test that focuses on a variety of self-initiated tasks related to everyday function such as sit-to-stand and functional reach forward. The Berg has excellent reliability and is somewhat correlated with severity of PD, as measured with the Unified Parkinson Rating Scale (UPDRS) [3, 4]. However, the Berg has limitations such as documented ceiling effects [5–7] and problems with underutilization and redundancy of categories due to the rating scale [8, 9]. These particular limitations are important considerations when evaluating patients with mild neurological deficits, who are easy to underidentify and therefore less likely to receive rehabilitation.

Such documented limitations of the Berg have led many clinicians to do more than one validated balance assessment in order to identify deficits that may respond to treatment. Recently, a new and more comprehensive clinical balance test, the Balance Evaluation Systems Test (BESTest), has been developed that is essentially a battery of balance and mobility tests, borrowed from other validated tests such as the Berg and Dynamic Gait Index. The BESTest was uniquely designed as a comprehensive clinical tool for evaluating six different balance control systems: biomechanical, stability limits/verticality, anticipatory, reactive, sensory orientation, and stability in gait. Such system-specific assessment is helpful in directing treatment and to ensure that a meaningful deficit is not overlooked. The BESTest has good interrater reliability [10] and good validity in discerning fallers from nonfallers in patients with PD [11].

The BESTest, though comprehensive, valid, and reliable, is lengthy to administer and may not always be practical in a busy clinical setting. Thus, a shorter version of the BESTest, the Mini-BESTest, was developed using psychometric techniques to reduce item redundancy and simplify scoring [12]. This shorter version has excellent interrater (ICC ≥ 0.91), and test-retest (ICC ≥ 0.88) reliability and similar in length to the Berg [13]. However it is currently unknown how the Mini-BESTest compares with the Berg in detecting balance deficits in the PD population.

The purpose of this study was to explore the usefulness of the Mini-BESTest compared to the Berg in evaluating balance in people with PD of varying severity. Specifically, we evaluated (1) the distribution of patients scores to look for ceiling effects, (2) concurrent validity with severity of disease, and (3) the sensitivity/specificity of separating people who do or do not have postural response deficits.

2. Methods

Ninety-seven participants with idiopathic PD participated in the study. These participants were part of either a larger clinical study examining prospective fall risk or an exercise efficacy study. Therefore, the group here represents a convenience sample of participants with PD, and the data for this paper was taken from their baseline visits. Inclusion criteria: all people in the study were diagnosed with idiopathic PD by a movement disorders neurologist. People were excluded from the study if they presented with cognitive impairment, prior orthopedic injuries, or impairments that could interfere with mobility such as artificial joints or peripheral neuropathy or prior brain surgery such as a pallidotomy or deep brain stimulation. All participants signed informed consent forms approved by the Oregon Health & Science University Institutional Review Board. All work was conducted in accordance with the declaration of Helsinki (1964).

All participants came in for an assessment of their balance and mobility which included both clinical and instrumented testing. The data presented in this paper is taken from the clinical scales: the Unified Parkinson’s Disease Rating Scale (UPDRS) III Motor section, Hoehn & Yahr (H&Y) disease severity classification, and the Berg and the Mini-BESTest. The testing was performed in the same order for each participant, and rest breaks were given as needed to avoid fatigue. Other balance and gait assessments conducted during testing that were not included in this analysis included gait and sway analysis using wearable inertial sensors. Testing was conducted at the Oregon Clinical Translational Research Institute at Oregon Health & Science University. All participants took their PD medication as normally indicated and were tested in the ON state. All of the participants except for two were currently taking some form of PD medication. The testing was administered by a trained examiner, overseen by a physical therapist. Participant characteristics are outlined in Table 1.

2.1. Clinical Tests

2.1.1. Mini-BESTest

The Mini-BESTest test is a 14-item test that focuses on dynamic balance, specifically anticipatory transitions, postural responses, sensory orientation, and dynamic gait [12]. Each item is scored from (0–2); a score of 0 indicates that a person is unable to perform the task while a score of 2 is normal. The best score is the maximum amount of points, being 28.

2.1.2. Berg Balance Scale (Berg) [2]

The Berg is a 14-item test designed to measure the balance of older adults by assessing their performance of specific functional tasks [14]. Each task is scored from (0–4), for a maximum of 56 points. The test indicates that a score of 41–56 is associated with a low fall risk, 21–40 with a medium fall risk, and 0–20 with a high fall risk [14].

2.1.3. Unified Parkinson’s Disease Rating Scale (UPDRS)

Disease severity was evaluated using the UPDRS III motor component [15]. This test has a maximum score of 108; each item is scored from 0-not affected through 4-most severely affected.

2.1.4. Hoehn and Yahr (H&Y)

Postural response deficits were identified as patients scoring 3 to 4 in the H&Y scale. [16]. A score of 3 and above indicates postural instability as defined by an abnormal stepping response to a backwards pull on the shoulders. The H&Y scale is the most commonly used method for evaluating the severity of PD [17], and the scale ranges from 0 (no symptoms of PD) to 5 (wheelchair bound).

2.2. Statistics

The STATA statistical package was used for both calculations and graphics [18]. We describe the Berg and Mini-BESTest data for the 97 participants, using histograms and a scatter plot displaying the association between the two variables. We used the bootstrap method to assess a P value for the skewness [19]. We also carried out a regression of UPDRS jointly on the two scores for the Berg and Mini-BESTest. This regression provided information on the relative contributions of the Berg and Mini-BESTest for predicting the UPDRS, each adjusted for the other measure using added variable or partial correlation plots that show the extent of information in each test that is not conveyed by the other test [20]. Finally, we considered the relative performance of the Berg and Mini-BESTest in terms of receiver operating characteristic (ROC) curves for classifying people into two groups based on a threshold for the H&Y score, to discriminate between mild PD (H&Y 1-2) versus more severe PD (H&Y 3-4) [21].

3. Results

3.1. Distribution of Scores and Relation between Berg and Mini-BESTest

The distribution of scores among the 97 participants with PD on the Mini-BESTest differed significantly from the Berg (Figure 1). The Mini-BESTest scores were significantly less skewed than the Berg (Berg skewness versus Mini-BESTest skewness . Using the bootstrap method, we found that, sampling from a population with the shape of the Mini-BESTest histogram, the chance would be less than 0.001 of obtaining a skewness as extreme as that seen for Berg. The scatter plot in Figure 1(c) shows the relationship between the two measures.

(a)

(b)

(c)

The Mini-BESTest and Berg correlate significantly (r = 0.79; P < 0.001). However, people scoring the highest values in the Berg (i.e., 52–56; those with scores in the clinically accepted range as “normal”) had scores representing approximately half of its maximum range in the Mini-BESTest. This suggests that the Mini-BESTest “spreads out” the compression (ceiling effect) at the top end of the Berg.

3.2. Relationship to PD Severity

Both the Mini-BESTest and Berg were moderately correlated with disease severity as measured by the UPDRS. Figures 2(a) and 2(b) display the individual regression lines, indicating that the Berg and the Mini-BESTest each have a significant correlation to the UPDRS (−0.39 and −0.51, P > 0.001, respectively).

(a)

(b)

(c)

(d)

Using a multiple regression of the UPDRS on both the Mini-BESTest and the Berg, we determined how much either test compliments the other in the prediction of disease severity. For linear regression prediction of the UPRDS, the Berg did not provide statistically significant information in addition to the Mini-BESTest (t = 0.18; P = 0.86). In contrast, the Mini-BESTest provided significant information in addition to the Berg (t = −3.7; P = 0.001) to predict severity of disease. The added variable plot in Figure 2(c) shows the extent of information in the Mini-BESTest for predicting UPDRS, beyond that provided by the Berg. This was significant (P < 0.001). The added variable plot in Figure 2(d) shows the extent of information in the Berg for predicting UPDRS, beyond that provided by Mini-BESTest. This was not statistically significant (P = 0.86).

3.3. Identifying Mild Deficits

We compared the ability of the Berg and Mini-BESTest to differentiate PD patients with and without clinical balance deficits. Participants with and without clinical balance deficits were classified using H&Y: H&Y 1-2 and H&Y 3-4. A score of H&Y 3 and 4 identifies people with abnormal postural stepping response to the backwards pull test or observable postural instability. Though the mean H&Y score was 2.3, the range was 1–4. Roughly one third (31 of 97) of the participants had a H&Y of 3 or above, indicating postural instability as defined by H&Y. Figures 3(a) and 3(b) compare the distributions of Berg and Mini-BESTest scores for people with H&Y 1-2 versus H&Y 3-4. ROC analysis was done to test the discriminative ability of these different balance tests to differentiate those people with and without abnormal postural responses.

(a)

(b)

(c)

The area under the ROC curves (AUC) differed for the tests; the AUC for the Berg = 0.84 ± 0.04 and the AUC for the Mini-BESTest = 0.91 ± 0.03. The 2-sided P-value for testing equality of the two AUC values was 0.05. A suggested cut-off point for the Mini-BESTest to differentiate those with and without postural response deficits is > 21, yielding (sensitivity, specificity) = (89%, 81%). The nearest point to this for the Berg is ≥52, yielding (Sensitivity, Specificity) = (77%, 74%). The points corresponding to these cut-off points are indicated by circles in Figure 3(c).

3.4. Most Difficult Items for People with PD

Individual items from both the Berg and the Mini-BESTest were ranked in order of difficulty for the whole population of people with PD within this study and classified as “difficult” if a person had a score less than perfect on that item (2 = perfect; 1 = some difficulty, or 0 = cannot perform) (Table 2). We found that 72% (10 out of 14) items on the Mini-BESTest presented some difficulty to at least one-third of the group versus only 36% (5 out of 14 items) in the Berg.

4. Discussion

The results from this study suggest that the Mini-BESTest may be more useful than the Berg in evaluating balance disorders in patients with PD, especially in those with mild PD or more subtle balance deficits. Specifically, results showed that (1) although the Mini-BESTest had a high correlation with the Berg, it did not have the same ceiling effects; (2) both the Berg and Mini-BESTest correlated with PD severity but the Mini-BESTest added value to the Berg score; (3) the Mini-BESTest test had better sensitivity/specificity then the Berg to identify people with abnormal postural responses.

The high correlation of the Mini-BESTest with the Berg supports concurrent validity since the Berg remains one of the most commonly used clinical scales for balance assessment in people with PD. But importantly, we found very different test score distributions across patients with varied levels of severity. Though neither test had a normal distribution, the Mini-BESTest was significantly less skewed, indicating that there are less ceiling effects as has been shown previously with the Berg [22]. These results are not surprising since the Berg was originally intended for frail elderly and remains an excellent measure of balance deficits for those with more severe PD.

The high sensitivity of the Mini-BEST is important for clinicians who see patients with mild balance deficits who are seeking to identify and treat potentially preventable mobility problems early in the disease progression.

The Berg has been shown to have excellent test-retest reliability [3] and to correlate significantly with disease severity in PD [23], and our results support the relationship with the UPDRS. Both exercise and physical therapy have been shown to improve UPDRS scores. Therapists need measures that reflect improvements with intervention so comparing the Mini-BESTest with the UPDRS establishes concurrent validity of the new test with an established one. The novel information obtained from our study is that while both the Berg and Mini-BESTest correlate with disease severity, the Mini-BESTest adds value not included in the Berg, but the Berg does not add value to the Mini-BESTest. These findings suggest that the Mini-BESTest distinguishes among PD subjects who all get similar, high scores in the Berg, and this information can add to the prediction of disease severity. A previous study demonstrated the Berg to be useful in identifying balance impairments in people with very severe PD (i.e., H&Y 4), but it could not discriminate subgroups of H&Y scores successfully [24]. Here, we found similar results in that the Mini-BESTest was more successful than the Berg at discriminating subgroups of PD severity as measured by the H&Y scale. Franchignoni et al. examined the clinimetric properties of the Berg with 57 participants with PD [9]. They found excellent internal consistency, good correlations to other scales of disease severity, and quality of life, all agreeing with previously published work [4]. However, they did find, using a Rasch analysis, that some rating categories were not used and others were underutilized. The authors suggested that improving the rating scale structure would improve the test. The same type of Rasch analysis was performed on the full BESTest to obtain the shortened Mini-BESTest that excludes redundant or underused items [12].

The cut-off point of the Mini-BESTest for identifying patients with PD who had problems with the “Pull test” (i.e., H&Y score of at least 3) was a score of 21. It is interesting that a similar cut-off point for the Mini-BESTest for identifying patients with PD who fall was a score of 20 [13]. Both the Mini-BESTest and the Berg were sensitive (89% and 77%, respectively) and specific (81% and 74%, respectively) in differentiating those with and without postural response deficits. Similarly, the Mini-BESTest was also shown to be sensitive (88%) and specific (78%) in identifying PD patients with a history of falls [13].

It has been suggested that postural instability in PD is multifactorial, therefore, a multitude of tests should be administered by physical therapists [25, 26]. For example, the Berg does not include tests of postural reactions or dynamic gait, and, therefore, some deficits may be missed. Since the Mini-BESTest is essentially a combination of tests, this may be a reason it successfully identified people with mild balance deficits. As outlined in Table 2, each test item primarily tests one of 4 categories of balance: anticipatory, dynamic gait, reactive control, and sensory orientation. The Berg was not designed with such systems in mind but if a system categorization is assigned to each item, the Berg items primarily evaluate anticipatory and sensory contributions to balance. There are two additional systems that the Mini-BESTest evaluates, dynamic gait, and reactive postural control, this may explain the added variable plot being significant for the Mini-BESTest adding value to the Berg in relating to disease severity. In other words, the Mini-BESTest usefully distinguishes among those persons that are overly range compressed in the Berg. If a clinician is using the Berg for their PD patients, it may be beneficial to augment testing with the Dynamic Gait Index and the Pull test from the UPDRS. Dynamic gait (cognitive task with gait) and reactive postural control (response to perturbation) items were the most difficult items for people with PD, balance systems that are not assessed using the Berg.

Clinicians commonly use single-limb stance for balance assessment. An example of a difference between testing items in the Berg and Mini-BESTest is the assessment of the single-limb stance (item #14 Berg, item #3 Mini-BESTest). In the Berg, the participant chooses either leg, and it is only this side that is assessed. Comparatively, the Mini-BESTest assesses both the left and right leg and records the worst side. In this study, when the Berg was used, assessing only one leg, 39% of the participants had some observable difficulty. When the Mini-BESTest was used, assessing both left and right leg, 81% of the participants had some difficulty. Therefore, clinicians should test standing balance on both sides.

This study was limited to people with PD so it needs to be repeated in patients with other pathologies affecting balance control. One potential limitation is that the order of testing was not randomized so fatigue may have factored into test performance. However, participants were given frequent rest breaks to avoid fatigue.

In conclusion, the Mini-BESTest is a novel, useful, and easy to administer tool for balance assessment. Although the Mini-BESTest had a high correlation with the Berg, it did not have the same ceiling effects. Furthermore, both the Berg and Mini-BESTest correlated with PD severity but the Mini-BESTest added value to the Berg score in predicting disease severity. Finally, the Mini-BESTest test had better sensitivity/specificity than the Berg to identify people with abnormal postural responses. Taken together, these findings suggest that the Mini-BESTest is a promising tool for discerning balance deficits in patients with mild to severe PD.

Acknowledgments

This research is supported by National Institute of Aging (R37AG006457), National Institute of Neurologic Disorders and Stroke (RC1NS068678), the Kinetics Foundation, and Oregon Clinical & Translational Institute (OCTRI) (ULI RR024140).

References

B. R. Bloem, Y. A. M. Grimbergen, M. Cramer, M. Willemsen, and A. H. Zwinderman, “Prospective assessment of falls in Parkinson's disease,” Journal of Neurology, vol. 248, no. 11, pp. 950–958, 2001.
View at: Publisher Site | Google Scholar
K. O. Berg, S. L. Wood-Dauphinee, J. I. Williams, and B. Maki, “Measuring balance in the elderly: validation of an instrument,” Canadian Journal of Public Health, vol. 83, supplement 2, pp. S7–S11, 1992.
View at: Google Scholar
T. Steffen and M. Seney, “Test-retest reliability and minimal detectable change on balance and ambulation tests, the 36-Item Short-Form Health Survey, and the Unified Parkinson Disease Rating Scale in people with parkinsonism,” Physical Therapy, vol. 88, no. 6, pp. 733–746, 2008.
View at: Publisher Site | Google Scholar
A. A. Qutubuddin, P. O. Pegg, D. X. Cifu, R. Brown, S. McNamee, and W. Carne, “Validating the Berg Balance Scale for patients with Parkinson's disease: a key to rehabilitation evaluation,” Archives of Physical Medicine and Rehabilitation, vol. 86, no. 4, pp. 789–792, 2005.
View at: Publisher Site | Google Scholar
A. H. Newstead, M. R. Hinman, and J. A. Tomberlin, “Reliability of the Berg Balance Scale and balance master limits of stability tests for individuals with brain injury,” Journal of Neurologic Physical Therapy, vol. 29, no. 1, pp. 18–23, 2005.
View at: Google Scholar
R. A. Geiger, J. B. Allen, J. O'Keefe, and R. R. Hicks, “Balance and mobility following stroke: effects of physical therapy interventions with and without biofeedback/forceplate training,” Physical Therapy, vol. 81, no. 4, pp. 995–1005, 2001.
View at: Google Scholar
L. D. B. Thorbahn, R. A. Newton, and J. Chandler, “Use of the Berg balance test to predict falls in elderly persons,” Physical Therapy, vol. 76, no. 6, pp. 576–585, 1996.
View at: Google Scholar
D. L. Kornetti, S. L. Fritz, Y. P. Chiu, K. E. Light, and C. A. Velozo, “Rating scale analysis of the Berg balance scale,” Archives of Physical Medicine and Rehabilitation, vol. 85, no. 7, pp. 1128–1135, 2004.
View at: Publisher Site | Google Scholar
F. Franchignoni, C. A. Velozo, A. A. Qutubuddin, D. X. Cifu, and W. Carne, “Use of the Berg Balance Scale in rehabilitation evaluation of patients with Parkinson's disease,” Archives of Physical Medicine and Rehabilitation, vol. 86, no. 11, pp. 2225–2226, 2005.
View at: Publisher Site | Google Scholar
F. B. Horak, D. M. Wrisley, and J. Frank, “The balance evaluation systems test (BESTest) to differentiate balance deficits,” Physical Therapy, vol. 89, no. 5, pp. 484–498, 2009.
View at: Publisher Site | Google Scholar
A. L. Leddy, B. E. Crowner, and G. M. Earhart, “Functional gait assessment and balance evaluation system test: reliability, validity, sensitivity, and specificity for identifying individuals with parkinson disease who fall,” Physical Therapy, vol. 91, no. 1, pp. 102–113, 2011.
View at: Publisher Site | Google Scholar
F. Franchignoni, F. Horak, M. Godi, A. Nardone, and A. Giordano, “Using psychometric techniques to improve the balance evaluation systems test: the mini-bestest,” Journal of Rehabilitation Medicine, vol. 42, no. 4, pp. 323–331, 2010.
View at: Publisher Site | Google Scholar
A. L. Leddy, B. E. Crowner, and G. M. Earhart, “Utility of the mini-BESTest, BESTest, and BESTest sections for balance assessments in individuals with Parkinson disease,” Journal of Neurologic Physical Therapy, vol. 35, no. 2, pp. 90–97, 2011.
View at: Publisher Site | Google Scholar
K. Berg, S. Wood-Dauphinee, and J. I. Williams, “The balance scale: reliability assessment with elderly residents and patients with an acute stroke,” Scandinavian Journal of Rehabilitation Medicine, vol. 27, no. 1, pp. 27–36, 1995.
View at: Google Scholar
S. Fahn and R. Elton, Unified Parkinson's Disease Rating Scale, Macmillan Healthcare Information, Florham Park, NJ, USA, 1987.
M. M. Hoehn and M. D. Yahr, “Parkinsonism: onset, progression and mortality,” Neurology, vol. 17, no. 5, pp. 427–442, 1967.
View at: Google Scholar
C. Ramaker, J. Marinus, A. M. Stiggelbout, and B. J. van Hilten, “Systematic evaluation of rating scales for impairment and disability in Parkinson's disease,” Movement Disorders, vol. 17, no. 5, pp. 867–876, 2002.
View at: Publisher Site | Google Scholar
Stata Statistical Software, Release 11, StataCorp LP, College Station, Tex, USA, 2009.
A.C. Davison and D. Hinkley, Bootstrap Methods and Their Application, Cambridge Series in Statistical and Probabilistic Mathematics, Cambridge University Press, Cambridge, UK, 8th edition, 2006.
J. Neter, W. Wasserman, and M. Kunter, Applied Linear Statistical Models, Irwin, 1990.
E. R. DeLong, D. M. DeLong, and D. L. Clarke-Pearson, “Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach,” Biometrics, vol. 44, no. 3, pp. 837–845, 1988.
View at: Google Scholar
L. Blum and N. Korner-Bitensky, “Usefulness of the Berg Balance Scale in stroke rehabilitation: a systematic review,” Physical Therapy, vol. 88, no. 5, pp. 559–566, 2008.
View at: Publisher Site | Google Scholar
K. J. Brusse, S. Zimdars, K. R. Zalewski, and T. M. Steffen, “Testing functional performance in people with Parkinson disease,” Physical Therapy, vol. 85, no. 2, pp. 134–141, 2005.
View at: Google Scholar
H. Tanji, A. L. Gruber-Baldini, K. E. Anderson et al., “A comparative study of physical performance measures in Parkinson's disease,” Movement Disorders, vol. 23, no. 13, pp. 1897–1905, 2008.
View at: Publisher Site | Google Scholar
J. V. Jacobs, F. B. Horak, V. K. Tran, and J. G. Nutt, “Multiple balance tests improve the assessment of postural stability in subjects with Parkinson's disease,” Journal of Neurology, Neurosurgery and Psychiatry, vol. 77, no. 3, pp. 322–326, 2006.
View at: Publisher Site | Google Scholar
L. E. Dibble and M. Lange, “Predicting falls in individuals with Parkinson disease: a reconsideration of clinical balance measures,” Journal of Neurologic Physical Therapy, vol. 30, no. 2, pp. 60–67, 2006.
View at: Google Scholar

Copyright

Copyright © 2012 Laurie A. King et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

24053

Downloads

7342

Citations