Table of Contents Author Guidelines Submit a Manuscript
Parkinson’s Disease
Volume 2018, Article ID 7347859, 6 pages
https://doi.org/10.1155/2018/7347859
Research Article

Reliability and Validity of the Geriatric Depression Scale in Italian Subjects with Parkinson’s Disease

1Sapienza University of Rome, Rome, Italy
2Department of Public Health and Infection Disease, Sapienza University of Rome, Rome, Italy
3Department Human Neurosciences, Sapienza University of Rome, Rome, Italy
4IRCSS Neuromed Institute, Pozzilli, IS, Italy

Correspondence should be addressed to Giovanni Galeoto; ti.1amorinu@otoelag.innavoig

Received 9 May 2018; Revised 27 June 2018; Accepted 11 July 2018; Published 1 August 2018

Academic Editor: Aristide Merola

Copyright © 2018 Perla Massai et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Introduction. The Geriatric Depression Scale (GDS) is commonly used to assess depressive symptoms, but its psychometric properties have never been examined in Italian people with Parkinson’s disease (PD). The aim of this study was to study the reliability and validity of the Italian version of the GDS in a sample of PD patients. Methods. The GDS was administered to 74 patients with PD in order to study its internal consistency, test-retest reliability, construct, and discriminant validity. Results. The internal consistency of GDS was excellent (α = 0.903), as well as the test-retest reliability (ICC = 0.941 [95% CI: 0.886–0.970]). GDS showed a strong correlation with instruments related to the depression (ρ = 0.880) in PD (ρ = 0.712) and a weak correlation with generic measurement instruments (−0.320 < ρ <−0.217). An area under the curve of 0.892 (95% CI 0.809–0.975) indicated a moderate capability to discriminate depressed patients to nondepressed patient, with a cutoff value between 15 and 16 points that predicts depression (sensitivity = 87%; specificity = 82%). Conclusion. The GDS is a reliable and valid tool in a sample of Italian PD subjects; this scale can be used in clinical and research contexts.

1. Introduction

Parkinson disease (PD) is characterized by motor and nonmotor symptoms. Bradykinesia, tremor at rest, and rigidity are the cardinal motor manifestations of PD [1]. Nonmotor symptoms include gastrointestinal dysfunctions, sleep disorders, cognitive disorders, and neuropsychiatric disturbances. Depression has been found to be more frequent in PD patients than in age-matched healthy controls or in patients with other chronic medical conditions [2, 3]. For example, major depression may be found in up to 20% of PD patients [4]. To measure the level of depression, it is crucial that clinicians and researchers have access to reliable and valid instruments. A recent systematic review about depression tools in PD patients recommended the use of the Hamilton Depression Inventory as a rating scale, which takes into consideration the judgment of the clinician or the caregiver, and the Geriatric Depression Scale (GDS), that considers the patient’s point of view, for the screening and measurement of the degree of perceived depression in patients with PD [5].

The GDS [6], composed by 30 items, was developed to evaluate the level of depressive symptoms over the past week. It was transculturally adapted in several languages [79], and it has proven to be reliable and valid in subjects with dementia [1013], stroke [1417], rheumatoid arthritis [18], and psychiatric disorders [19, 20]. In PD, several studies showed that GDS has good psychometric properties, a high internal consistency (Cronbach’s alpha = 0.92) [21], an excellent test-retest reliability (intraclass correlation coefficient = 0.89 [95% CI 0.83–0.93]), and a minimal detectable change of 5.4 points [22]. Taking into account the validity, the GDS showed good correlations with the Beck Depression Inventory () and with mood related items of the Unified Parkinson’s Disease Rating Scale () [23], and moderate correlations with the 17-item Hamilton Depression Rating Scale () [24]. Recently, the GDS was used in an Italian sample of geriatric patients, and this study confirmed the good psychometric properties of GDS [25]. As the measurement properties of an instrument are affected by the disease investigated and by the contextual factors, for a reliable and valid use of the instrument in Italian subjects, the GDS should be validated also in the target population to which the questionnaire will be administered. No study has assessed the psychometric properties of GDS in Italian patients with PD. Therefore, the aim of this study is to assess the reliability and the validity of the GDS in a sample of Italian PD patients, using the Classical Theory Test.

2. Methods

2.1. Subjects

Seventy-four (older than 18 years) patients with clinically diagnosed PD were consecutively recruited through a convenience sample in the Rehabilitation Unit of San Giovanni Battista Hospital, Polyclinic Italia, and in the Department of Neurosciences, Sapienza University of Rome. Patients with cognitive impairment (Mini-Mental State Examination score <23 points) and problems with reading and understanding the Italian language were excluded. All subjects gave their informed consent [26, 27] to participate in the study, and the research was conducted according to the principles of Declaration of Helsinki.

2.2. Outcome Measures
2.2.1. Geriatric Depression Scale

This scale assesses the depressive symptoms [6]. The version used in this study was composed by 30 items that investigated different aspects of the depression over the last week. Each item is rated by a dichotomous score (yes = 1; no = 0), and some items (Item numbers 1, 5, 7, 9, 15, 19, 21, 27, 29, and 30) presented a reverse score (yes = 0; no = 1). The total score is given adding the item scores, and it ranged from 0 (no depression) to 30 (maximum depression) points. The Italian version used in this study demonstrated to be reliable and valid [25].

2.2.2. Hospital Anxiety and Depression Scale

This scale measures the level of depression and anxiety [28]. It is composed by 14 items divided in two subscales: 7 items investigate depressive symptoms, and the other 7 measure anxious symptoms. Subjects respond to each item on four-level ordinal score (0 = no symptoms; 3 = maximum symptoms); therefore, the total scores may vary between 0 and 21 points for each subscale. The Italian version of the scale was used in this study [29].

2.2.3. Parkinson Disease Questionnaire

This questionnaire assesses the impact of parkinsonian symptoms in the life of these patients in the past month [30]. It contains 39 items that examine 8 domains through separately scored subscales: mobility (10 items), activities of daily living (6 items), emotional well-being (6 items), stigma (4 items), social support (3 items), cognition (4 items), communication (4 items), and bodily discomfort (3 items). A 5-point level score is attributed to each item (0 = never; 1 = occasionally/rarely; 2 = sometimes; 3 = often; 4 = always). A total score ranging from 0 (indicating best health status) to 100 (indicating worst health status) was calculated by summing the score of each item, both for the 8 subscores and for the total score. The Italian version used in this study was recently evaluated [31] and revealed good psychometric properties.

2.2.4. Short Form 36-Health Survey Questionnaire (SF-36)

This is a 36-item questionnaire measuring the patient’s health status in the past four weeks [32]. The total score ranges from 0 to 100 with higher scores indicating a better condition. The Italian version is considered to be a valid and reliable tool [33].

2.2.5. Barthel Index

This well-known test measures the disability on the ADLs [34]. It is composed of 10 items including feeding, bathing, grooming, dressing, bowel and bladder control, toilet use, transfers (bed to chair and back), mobility, and stairs climbing. Three ordinal level scores are attributed to each item (0, 5, or 10; 15 points for items regarding transfers and mobility) to assess whether the patient can perform the various activities independently, with assistance or whether they are totally dependent from others. The total score is generated summing each score, and it varies from 0 (total dependence) to 100 (total independence). The Italian version was administered in this study [35, 36].

2.3. Procedures

Four clinicians (three occupational therapists and one physical therapist) screened all patients for their recruitment. Once enrolled, these clinicians collected demographic and clinical variables and administered the outcome measure to all patients. In order to study the test-retest reliability, the GDS was readministered after seven days. To assess the discriminant validity, a physician diagnosed the depression in this sample. According to DSM-5, patients were diagnosed with depression if they had at least five depressive symptoms including “depressed mood” and “loss of interest or pleasure” for at least two weeks [37].

2.4. Statistical Analysis

Descriptive statistics was used to analyze the sample characteristics; in particular, mean ± standard deviation (SD), median with 25th and 75th percentiles, and frequency with percentage were calculated for intervallic, ordinal, and categorical data, respectively.

The reliability of GDS was assessed in terms of internal consistency and test-retest reliability. Internal consistency was determined calculating Cronbach’s alpha [38]: for values closer to 1, the internal consistency is higher. Alpha was considered excellent if >0.9, good if >0.8, and acceptable if >0.7 [39]. Test-retest reliability was calculated by the intraclass correlation coefficient (ICC) with a 95% confident interval (CI). ICC values greater than 0.75 are a minimum requirement to use the instrument in group measurements [40]; ICC values greater than 0.90 are considered essential for the use of the instrument in individual measurements [41].

The construct validity of the GDS was studied calculating the Pearson correlation coefficient (ρ) when comparing the GDS with the other administered instruments. The following ranges were considered in order to interpret the results: ρ > 0.70 = strong correlation, 0.50 < ρ < 0.70 = moderate correlation, and e ρ < 0.50 = weak correlation [42].

In order to study the discriminant validity, the receiving operating characteristic (ROC) curve was created, and the area under the curve (AUC) was calculated. The closer the AUC value is to 1.0, the greater the instrument’s ability to distinguish depressed and nondepressed patients. An AUC higher than 0.75 confers to the tool a moderate discriminative validity; while an excellent one is demonstrated by a value ≥0.90.

For all statistical analyses, the α value was set at 0.05, and SPSS statistical software program, version 18.0 for Windows (SPSS Inc., Chicago, IL, USA), was used.

3. Results

3.1. Sample Characteristics

Seventy-four patients (44 males; 30 females) with PD were included in this study. The demographic and clinical characteristics of the patients studied are reported in Table 1.

Table 1: Main demographic and clinical characteristics of the sample ().
3.2. Internal Consistency

The internal consistency for the total GDS score was excellent (α = 0.903).

3.3. Test-Retest Reliability

Test-retest reliability was assessed in a subsample of 35 patients. Excellent reliability was observed for the GDS total score (ICC = 0.941 [95% CI: 0.886–0.970]).

3.4. Validity

Pearson’s correlation coefficient values are reported in Table 2. Taking into account the comparisons between GDS and the other instrument related to depression (HADS) and PD (PDQ-39), Pearson coefficient ranged between 0.712 and 0.880, indicating a strong correlation. On the other hand, regarding the comparisons between GDS and generic measurement instrument (Barthel Index and SF-36), the correlation coefficient varied from −0.320 to −0.217, showing a weak correlation.

Table 2: Pearson’s correlation coefficient for each comparison.

Regarding the discriminant validity, the AUC showed a value of 0.892 (95% CI 0.809–0.975), indicating a moderate capability to discriminate depressed patients to nondepressed patient. The score with the best sensibility and specificity that predicts depression is between 15 and 16 (sensitivity = 87%; specificity = 82%) (Figure 1).

Figure 1: Receiving operating characteristic curve.

4. Discussion

The use of a reliable and valid instrument is essential in clinical practice and when measuring specific outcomes [43]. Several questionnaires are available to measure depression in patients with PD [5]. The psychometric properties of GDS have been extensively studied in different pathologies and in different settings. To our knowledge, however, no study assessed the psychometric properties of GDS in Italian patients with PD. Studying the measurement properties in the context in which the instrument will be administered is crucial because these properties can be influenced by various contextual, social, and environmental factors [44]. The results of our study show that GDS is a reliable and valid instrument in Italian patients with PD.

The internal consistency assessed by calculating Cronbach’s alpha (equal to 0.903) was excellent. The results obtained in the PD patients we studied are similar to those obtained in patients with different clinical conditions. For example, Cronbach’s alpha was found to be 0.876 in a study on 294 geriatric patients [45] and 0.90 in 888 depressed and nondepressed elderly subjects [46].

We demonstrated an excellent test-retest reliability of the questionnaire (ICC = 0.941). The results obtained in our sample of PD patients are similar to those found in a cohort of 75 Chinese subjects with PD (ICC = 0.89 [95% CI 0.83–0.93]) [22].

The construct validity was investigated through the correlations between the GDS and other validated questionnaires. In particular, a strong construct validity was obtained through correlations with HADS (both with anxiety and depression) and PDQ-39. On the other hand, a weak correlation was found when the GDS was compared with the Barthel Index and the SF-36. The strong correlations between GDS and HADS can be explained because these two scales intend to measure the same variable, that is, the depression; these results are in line with previous studies that obtained similar correlations with questionnaires related to depression—Beck Depression Inventory () [23] and Hamilton Depression Rating Scale at 17 items () [24]. Conversely, the low correlation found with SF-36 and Barthel Index may be explained because both the Barthel Index and the SF-36 are generic instruments.

Finally, the discriminating validity was studied through the ROC curve in order to identify the best sensitivity and specificity of the cutoff value that can distinguish depressed and nondepressed patients. The cutoff value of 15–16 points showed a sensitivity of 87% and a specificity of 82%. Comparing our results with those obtained in other studies is not easy considering the different patient populations and the different settings; for example, the study by McDonald et al. showed a cutoff value of 9–10 points [24] and the study by Ertan et al. [7] a cutoff value of 13–14.

This study presents limitations that need to be taken into account. The design of the study did not allow the assessment of some fundamental psychometric properties such as content validity and responsiveness.

In conclusion, this study shows that GDS can be used in clinical practice as a valid measurement instrument in order to quantify depression in patients with PD.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Consent

Informed consent was obtained from all individual participants included in the study.

Disclosure

All authors have no commercial associations or disclosures that may pose or create a conflict of interest with the information presented within this manuscript.

Conflicts of Interest

The authors declare that they have no conflicts of interest.

References

  1. R. B. Postuma, D. Berg, M. Stern et al., “MDS clinical diagnostic criteria for Parkinson’s disease,” Movement Disorders, vol. 30, no. 12, pp. 1591–1601, 2015. View at Publisher · View at Google Scholar · View at Scopus
  2. D. Aarsland and M. G. Kramberger, “Neuropsychiatric symptoms in Parkinson’s disease,” Journal of Parkinson’s Disease, vol. 5, no. 3, pp. 659–667, 2015. View at Publisher · View at Google Scholar · View at Scopus
  3. A. H. V. Schapira, K. R. Chaudhuri, and P. Jenner, “Non-motor features of Parkinson disease,” Nature Reviews Neuroscience, vol. 18, no. 7, pp. 435–450, 2017. View at Publisher · View at Google Scholar · View at Scopus
  4. J. S. Reijnders, U. Ehrt, W. E. Weber, D. Aarsland, and A. F. Leentjens, “A systematic review of prevalence studies of depression in Parkinson’s disease,” Movement Disorders, vol. 23, no. 2, pp. 183–189, 2008. View at Publisher · View at Google Scholar · View at Scopus
  5. E. Torbey, N. A. Pachana, and N. N. Dissanayaka, “Depression rating scales in Parkinson’s disease: a critical review updating recent literature,” Journal of Affective Disorders, vol. 184, pp. 216–224, 2015. View at Publisher · View at Google Scholar · View at Scopus
  6. J. A. Yesavage, T. L. Brink, T. L. Rose et al., “Development and validation of a geriatric depression screening scale: a preliminary report,” Journal of Psychiatric Research, vol. 17, no. 1, pp. 37–49, 1982. View at Publisher · View at Google Scholar · View at Scopus
  7. T. Ertan and E. Eker, “Reliability, validity, and factor structure of the geriatric depression scale in Turkish elderly: are there different factor structures for different cultures?” International Psychogeriatrics, vol. 12, no. 2, pp. 163–172, 2000. View at Publisher · View at Google Scholar · View at Scopus
  8. J. Martínez de la Iglesia, M. C. Onís Vilches, R. Dueñas Herrero, C. Aguado Taberné, C. Albert Colomer, and M. C. Arias Blanco, “Abbreviating the brief. Approach to ultra-short versions of the Yesavage questionnaire for the diagnosis of depression,” Atención Primaria, vol. 35, no. 1, pp. 14–21, 2005. View at Publisher · View at Google Scholar · View at Scopus
  9. G. G. Gottfries, S. Noltorp, and N. Nørgaard, “Experience with a Swedish version of the Geriatric Depression Scale in primary care centres,” International Journal of Geriatric Psychiatry, vol. 12, no. 10, pp. 1029–1034, 1997. View at Publisher · View at Google Scholar
  10. W. N. Havins, P. J. Massman, and R. Doody, “Factor structure of the Geriatric Depression Scale and relationships with cognition and function in Alzheimer’s disease,” Dementia and Geriatric Cognitive Disorders, vol. 34, no. 5-6, pp. 360–372, 2012. View at Publisher · View at Google Scholar · View at Scopus
  11. R. Lucas-Carrasco, “Spanish version of the Geriatric Depression Scale: reliability and validity in persons with mild-moderate dementia,” International Psychogeriatrics, vol. 24, no. 8, pp. 1284–1290, 2012. View at Publisher · View at Google Scholar · View at Scopus
  12. H. W. Lach, Y. P. Chang, and D. Edwards, “Can older adults with dementia accurately report depression using brief forms? reliability and validity of the Geriatric Depression Scale,” Journal of Gerontological Nursing, vol. 36, no. 5, pp. 30–37, 2010. View at Publisher · View at Google Scholar · View at Scopus
  13. H. Debruyne, M. Van Buggenhout, N. Le Bastard et al., “Is the geriatric depression scale a reliable screening tool for depressive symptoms in elderly patients with cognitive impairment?” International Journal of Geriatric Psychiatry, vol. 24, no. 6, pp. 556–562, 2009. View at Publisher · View at Google Scholar · View at Scopus
  14. E. Y. Sivrioglu, K. Sivrioglu, T. Ertan et al., “Reliability and validity of the Geriatric Depression Scale in detection of poststroke minor depression,” Journal of Clinical and Experimental Neuropsychology, vol. 31, no. 8, pp. 999–1006, 2009. View at Publisher · View at Google Scholar · View at Scopus
  15. J. S. Cinamon, L. Finch, S. Miller, J. Higgins, and N. Mayo, “Preliminary evidence for the development of a stroke specific geriatric depression scale,” International Journal of Geriatric Psychiatry, vol. 26, no. 2, pp. 188–198, 2011. View at Publisher · View at Google Scholar · View at Scopus
  16. W. K. Tang, S. S. Chan, H. F. Chiu et al., “Can the Geriatric Depression Scale detect poststroke depression in Chinese elderly?” Journal of Affective Disorders, vol. 81, no. 2, pp. 153–156, 2004. View at Publisher · View at Google Scholar · View at Scopus
  17. J. Chau, C. R. Martin, D. R. Thompson, A. M. Chang, and J. Woo, “Factor structure of the Chinese version of the Geriatric Depression Scale,” Psychology, Health and Medicine, vol. 11, no. 1, pp. 48–59, 2006. View at Publisher · View at Google Scholar · View at Scopus
  18. K. L. Smarr and A. L. Keefer, “Measures of depression and depressive symptoms: Beck Depression Inventory-II (BDI-II), Center for Epidemiologic Studies Depression Scale (CES-D), Geriatric Depression Scale (GDS), Hospital Anxiety and Depression Scale (HADS), and Patient Health Questionnaire-9 (PHQ-9),” Arthritis Care and Research, vol. 63, no. 11, pp. S454–S466, 2011. View at Publisher · View at Google Scholar · View at Scopus
  19. A. C. Chan, “Clinical validation of the Geriatric Depression Scale (GDS): Chinese version,” Journal of Aging and Health, vol. 8, no. 2, pp. 238–253, 1996. View at Publisher · View at Google Scholar · View at Scopus
  20. J. N. Bae and M. J. Cho, “Development of the Korean version of the Geriatric Depression Scale and its short form among elderly psychiatric patients,” Journal of Psychosomatic Research, vol. 57, no. 3, pp. 297–305, 2004. View at Publisher · View at Google Scholar · View at Scopus
  21. F. S. Ertan, T. Ertan, G. Kiziltan, and H. Uyguçgil, “Reliability and validity of the Geriatric Depression Scale in depression in Parkinson’s disease,” Journal of Neurology, Neurosurgery and Psychiatry, vol. 76, no. 10, pp. 1445–1447, 2005. View at Publisher · View at Google Scholar · View at Scopus
  22. S. L. Huang, C. L. Hsieh, R. M. Wu, and W. S. Lu, “Test-retest reliability and minimal detectable change of the Beck Depression Inventory and the Taiwan Geriatric Depression Scale in patients with Parkinson’s disease,” PLoS One, vol. 12, no. 9, Article ID e0184823, 2017. View at Publisher · View at Google Scholar · View at Scopus
  23. V. Tumas, G. G. Rodrigues, T. L. Farias, and J. A. Crippa, “The accuracy of diagnosis of major depression in patients with Parkinson’s disease: a comparative study among the UPDRS, the geriatric depression scale and the Beck depression inventory,” Arquivos de Neuro-Psiquiatria, vol. 66, no. 2A, pp. 152–156, 2008. View at Publisher · View at Google Scholar · View at Scopus
  24. W. M. McDonald, P. E. Holtzheimer, M. Haber, J. L. Vitek, K. McWhorter, and M. Delong, “Validity of the 30-item geriatric depression scale in patients with Parkinson’s disease,” Movement Disorders, vol. 21, no. 10, pp. 1618–1622, 2006. View at Publisher · View at Google Scholar · View at Scopus
  25. G. Galeoto, J. Sansoni, M. Scuccimarri et al., “A psychometric properties evaluation of the Italian version of the Geriatric Depression Scale,” Depression Research and Treatment, vol. 2018, Article ID 1797536, p. 7, 2018. View at Publisher · View at Google Scholar · View at Scopus
  26. G. Galeoto, R. De Santis, A. Marcolini, A. Cinelli, and R. Cecchi, “The informed consent in occupational therapy: proposal of forms,” Giornale Italiano di Medicina del Lavoro ed Ergonomia, vol. 38, no. 2, pp. 107–115, 2016. View at Google Scholar
  27. G. Galeoto, R. Mollica, O. Astorino, and R. Cecchi, “Informed consent in physiotherapy: proposal of a form,” Giornale Italiano di Medicina del Lavoro Ergonomia, vol. 37, no. 4, pp. 245–254, 2014. View at Google Scholar
  28. A. S. Zigmond and R. P. Snaith, “The hospital anxiety and depression scale,” Acta Psychiatrica Scandinavica, vol. 67, no. 6, pp. 361–370, 1983. View at Publisher · View at Google Scholar · View at Scopus
  29. F. Mondolo, M. Jahanshahi, A. Granà, E. Biasutti, E. Cacciatori, and P. Di Benedetto, “The validity of the hospital anxiety and depression scale and the geriatric depression scale in Parkinson’s disease,” Behavioural Neurology, vol. 17, no. 2, pp. 109–115, 2006. View at Publisher · View at Google Scholar · View at Scopus
  30. C. Jenkinson, R. Fitzpatrick, V. Peto, R Greenhall, and N. Hyman, “The Parkinson’s disease questionnaire (PDQ-39): development and validation of a Parkinson’s disease summary index score,” Age and Ageing, vol. 26, no. 5, pp. 353–357, 1997. View at Publisher · View at Google Scholar · View at Scopus
  31. G. Galeoto, F. Colalelli, P. Massai et al., “Quality of life in Parkinson’s disease: Italian validation of the Parkisnon’s disease questionnaire (PDQ-39-IT),” Neurological Sciences, In press.
  32. J. E. Ware Jr. and C. D. Sherbourne, “The MOS 36-item short-form health survey (SF-36). I. Conceptual framework and item selection,” Medical Care, vol. 30, no. 6, pp. 473–483, 1992. View at Google Scholar
  33. G. Apolone and P. Mosconi, “The Italian SF-36 Health Survey: translation, validation and norming,” Journal of Clinical Epidemiology, vol. 51, no. 11, pp. 1025–1036, 1998. View at Publisher · View at Google Scholar · View at Scopus
  34. F. I. Mahoney and D. W. Barthel, “Functional evaluation: the Barthel index,” Maryland State Medical Journal, vol. 14, pp. 61–65, 1965. View at Google Scholar
  35. G. Galeoto, A. Lauta, A. Palumbo et al., “The Barthel index: Italian translation, adaptation and validation,” International Journal of Neurology and Neurotherapy, vol. 2, no. 2, pp. 1–7, 2015. View at Publisher · View at Google Scholar
  36. S. F. Castiglia, G. Galeoto, A. Lauta et al., “The culturally adapted Italian version of the Barthel Index (IcaBI): assessment of structural validity, inter-rater reliability and responsiveness to clinically relevant improvements in patients admitted to inpatient rehabilitation centers,” Functional Neurology, vol. 32, no. 4, p. 221, 2017. View at Publisher · View at Google Scholar · View at Scopus
  37. F. Edition, Diagnostic and Statistical Manual of Mental Disorders, American Psychiatric Publishing, Arlington, VA, USA, 2013.
  38. J. M. Bland and D. G. Altman, “Cronbach’s alpha,” BMJ, vol. 314, no. 7080, p. 572, 1997. View at Publisher · View at Google Scholar · View at Scopus
  39. D. George and P. Mallery, SPSS for Windows Step by Step: A Simple Guide and Reference, 11.0 Update, Allyn & Bacon, Boston, MA, USA, 2003.
  40. M. W. Post, “What to do with “moderate” reliability and validity coefficients?” Archives of Physical Medicine and Rehabilitation, vol. 97, no. 7, pp. 1051-1052, 2016. View at Publisher · View at Google Scholar · View at Scopus
  41. L. G. Portney and M. P. Watkins, Foundations of Clinical Research: Applications to Practice, vol. 2, Prentice-Hall, Upper Saddle River, NJ, USA, 2000.
  42. B. Munro, Statistical Methods for Health Care Research, J. B. Lippincott, Philadelphia, PA, USA, 2000.
  43. A. A. Küçükdeveci, A. Tennant, G. Grimby, and F. Franchignoni, “Strategies for assessment and outcome measurement in physical and rehabilitation medicine: an educational review,” Journal of Rehabilitation Medicine, vol. 43, no. 8, pp. 661–672, 2011. View at Publisher · View at Google Scholar · View at Scopus
  44. D. L. Streiner and G. R. Norman, Health Measurement Scales: A Practical Guide to Their Development and Use, Oxford University Press, Oxford, UK, 4th edition, 2008.
  45. K. B. Adams, H. C. Matto, and S. Sanders, “Confirmatory factor analysis of the geriatric depression scale,” Gerontologist, vol. 44, no. 6, pp. 818–826, 2004. View at Publisher · View at Google Scholar · View at Scopus
  46. J. Y. Kim, J. H. Park, J. J. Lee et al., “Standardization of the Korean version of the geriatric depression scale: reliability, validity, and factor structure,” Psychiatry Investigation, vol. 5, no. 4, p. 23, 2008. View at Publisher · View at Google Scholar