Accuracy of the Hospital Anxiety and Depression Scale for Identifying Depression in Chronic Obstructive Pulmonary Disease Patients

Nowak, Christoph; Sievi, Noriane A.; Clarenbach, Christian F.; Schwarz, Esther Irene; Schlatzer, Christian; Brack, Thomas; Brutsche, Martin; Frey, Martin; Irani, Sarosh; Leuppi, Jörg D.; Rüdiger, Jochen; Thurnheer, Robert; Kohler, Malcolm

doi:https://doi.org/10.1155/2014/973858

Pulmonary Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusions Ethical Approval Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2014 | Article ID 973858 | https://doi.org/10.1155/2014/973858

Accuracy of the Hospital Anxiety and Depression Scale for Identifying Depression in Chronic Obstructive Pulmonary Disease Patients

Christoph Nowak,^1,2Noriane A. Sievi,¹Christian F. Clarenbach,¹Esther Irene Schwarz,¹Christian Schlatzer,¹Thomas Brack,³Martin Brutsche,⁴Martin Frey,⁵Sarosh Irani,⁶Jörg D. Leuppi,⁷Jochen Rüdiger,⁴and Robert Thurnheer⁸ et al.

Academic Editor: Denis Caillaud

Received21 Jun 2014

Revised12 Nov 2014

Accepted20 Nov 2014

Published04 Dec 2014

Abstract

Psychological morbidity is common in chronic respiratory diseases. The diagnostic accuracy of the Hospital Anxiety and Depression Scale (HADS) and risk factors for comorbid depression in chronic obstructive pulmonary disease (COPD) are addressed. Consecutive COPD patients (GOLD stage I–IV, 40–75 years old) were enrolled in a multicentre, cross-sectional cohort study. Diagnosis of depression was ascertained through clinical records. Lung function, HADS score, 6-minute walking test (6-MWT), MRC dyspnoea score, and COPD Assessment Test (CAT) were evaluated. Two hundred fifty-nine COPD patients (mean age 62.5 years; 32% female; mean FEV1 48% predicted) were included. Patients diagnosed with depression (29/259; 11.2%) had significantly higher HADS-D and HADS-Total scores than nondepressed patients (median (quartiles) HADS-D 6 [4; 9] versus 4 [2; 7], median HADS-Total 14 [10; 20] versus 8 [5; 14]). Receiver-operating characteristic plots showed moderate accuracy for HADS-D, AUC 0.662 (95%CI 0.601–0.719), and HADS-Total, AUC 0.681 (95%CI 0.620–0.737), with optimal cut-off scores of >5 and >9, respectively. Sensitivity and specificity were 62.1% and 62.6% for HADS-D compared to 75.9% and 55.2% for HADS-Total. Age, comorbidities, sex, and lower airflow limitation predicted depression. The HADS exhibits low diagnostic accuracy for depression in COPD patients. Younger men with comorbidities are at increased risk for depression.

1. Introduction

Depression is a common comorbidity in chronic obstructive pulmonary disease (COPD) patients [1]. Impaired lung function is a risk factor for depression with up to 4 in 10 respiratory patients affected [2]. Mood and anxiety disorders in patients with COPD are likely underdiagnosed [3], emphasising the need for a reliable and accurate instrument in the recognition of depression. The Hospital Anxiety and Depression Scale (HADS [4]) was originally designed by Zigmond and Snaith in 1983 as a short, easy-to-use, 14-item screening tool for depression and anxiety symptoms in the hospital outpatient setting [5]. It is composed of two 7-item subscales (HADS-D and HADS-A for depression and anxiety, resp.) both ranging from 0 to 21 with higher scores indicating more severe distress. Items enquire about symptoms over the preceding week and are self- or clinician-rated on a 4-point Likert scale. The developers suggested categorising subjects according to subscale score into noncases (0 to 7), possible cases (8 to 10), and probable cases (>10) of clinical depression [4].

A 1997 review found both subscales to be reliable and valid measures for assessing anxiety and depression symptoms in medical patients in European, American, and Asian cohorts [6]. An updated analysis in 2002 found similar results in general medical, psychosomatic, and psychiatric patients with an optimal cut-off score of ≥8 for both subscales to define patients with probable diagnosis of depression or anxiety [7]. However, classifying patients as either depressed/anxious or not according to HADS threshold scores is controversial, especially so in chronic disease. A range of cut-offs has been used, for example, HADS-D >4 in coronary heart disease [8], HADS-D >7 in cancer [9], and HADS-D >11 in end-stage renal disease [10]. Its original purpose as a screening tool notwithstanding, in these studies, categorisation according to HADS scores is often implicitly used to diagnose depression.

The HADS has frequently been used in patients with COPD, among other reasons to assess psychological health status [11], quality of life [12], and effectiveness of pulmonary rehabilitation [13]. In spite of its widespread use, the HADS’ diagnostic accuracy in COPD patients has only been examined in a small sample for anxiety [14]: in 55 COPD patients, of whom 14 were clinically diagnosed with an anxiety disorder, the optimal HADS-A cut-off score of ≥4 achieved moderate diagnostic power. However, no validation of the HADS for diagnosing depression in COPD patients has yet been attempted although the aforementioned results indicate that optimal cut-off scores for chronic disease patients are likely to differ from those originally suggested for the general patient population.

The aim of the current cross-sectional study was to validate the use of the HADS in screening patients with COPD for the presence of clinically diagnosed depression. We furthermore explored the role of patient and disease-specific predictors for depression. Data were extracted from the baseline assessment of an ongoing longitudinal COPD cohort study in Switzerland.

2. Patients and Methods

2.1. Study Subjects

Inclusion criteria were an objective diagnosis of COPD according to GOLD guidelines [15] and age between 40 and 75 years. Exclusion criteria were mental or physical disability precluding informed consent or protocol compliance, as well as acute or recent (within the preceding six weeks) exacerbation of COPD.

2.2. Study Design

The Obstructive Pulmonary Disease Outcomes Cohort of Switzerland (TOP DOCS) is an ongoing prospective observational cohort study coordinated by the University Hospital of Zurich, Switzerland, involving patients with mild to very severe (GOLD stage I to IV) COPD examined annually for at least three years each. Recruitment involves seven hospitals in Switzerland. A range of demographic, COPD-specific, physiologic, and quality of life-related variables are recorded. At baseline patients attending participating clinics consented and were enrolled in a nonselective, consecutive manner. The study was approved by the Ethics Committee of the Canton of Zurich, Switzerland (Kantonale Ethikkommission Zürich), registration reference KEK-ZH-Nr. 2011-0106.

2.3. Measurements

Patients’ characteristics and clinical information were ascertained through self-report questionnaires, investigator-led interviews, and clinical records. Apart from details extracted from detailed clinical records, all assessments were conducted by either trained pulmonologists or dedicated study investigators.

Information about the presence or absence of an active diagnosis of unipolar depression according to ICD-10 [16] was extracted from patients’ clinical records and double-checked by personal communication with patients’ physicians. Most diagnoses had been made by primary care physicians (who are required to apply ICD-10 coding criteria to receive reimbursement from patients’ health insurance providers). Whilst this precluded the uniform use of rigorous psychiatric interviews, the approach is an adequate reflection of clinical reality.

The German language version of the HADS [4] was administered as a self-rated questionnaire for patients to fill in either during the recruitment visit or as soon as possible thereafter. Both the HADS-A and HADS-D 7-item components were administered (each ranging from 0 to 21 with higher scores indicating increased symptoms) to evaluate patients’ perceived psychological distress.

Forced expiratory volume in one second (FEV1) and maximum forced vital capacity (FVC) were assessed according to the criteria for reproducibility of the American Thoracic Society [17]. COPD-specific assessments included the 6-minute walking test (6-MWT; maximum distance in meters walked in six minutes) [18], Medical Research Council (MRC) Dyspnoea score (ranging in ascending severity from 0 to 4) [19], COPD assessment test (CAT; an 8-item health-related quality of life questionnaire ranging from 0 to 40 with higher scores indicating more severe impairment) [20], and BODE index (the composite of body mass index (BMI, body weight in kilograms divided by body height in meters squared), FEV1% predicted, 6-MWT, and MRC Dyspnoea scale; ranging from 0/low risk to 10/high risk) [21].

2.4. Analysis

Receiver operating characteristic (ROC) curves [22] and area under the curve (AUC) statistics were compared for HADS-D and HADS-total [23]. DeLong et al.’s [24] approach for estimating ROC parameters, Hilgers’ [25] nonparametric 95% confidence interval (CI) estimation method for criterion values, and Youden’s [26] index (the maximum vertical distance between the diagonal guessing line and the ROC curve) were estimated alongside likelihood ratios (LR). A clinical diagnosis of depression at the time of assessment was the reference standard. Multivariable logistic regression models for depression with stepwise predictor selection were constructed including HADS, age, gender, BMI, FEV1%, number of comorbidities, 6-MWT, and MRC-dyspnoea (chosen as established risk factors for depression in COPD [3, 27, 28]). CAT score was added to control for nonspecific COPD-related quality of life impairment and antidepressant use was included to adjust for treatment-related confounding. Model assumptions were tested via Kolmogorov-Smirnov tests and residual plots. Independent sample -tests, Mann-Whitney tests, and Chi-Square statistics were Bonferroni-corrected for multiple testing (nominal ). Analyses were performed using MedCalc for Windows, version 12.6.1 (MedCalc Software, Ostend, Belgium).

3. Results

Figure 1 depicts the flow of all 263 participants enrolled between October 2009 and June 2013 from screening to analysis. Four patients were excluded due to missing data, leaving 259 COPD patients who provided complete information for HADS score and depression status. The prevalence of active depression according to ICD-10 was 11.2% (29/259). Among depressed patients, 35% (10/29) had been prescribed an antidepressant. Patient characteristics are displayed in Table 1. There were no significant differences between depressed and nondepressed patients with respect to demographic and disease-related characteristics although there was a trend for worse airflow limitation and more severe GOLD stage in nondepressed patients.

Patients with a preexisting diagnosis of depression had significantly higher HADS-D scores than nondepressed patients: median ± quartiles 6 (4; 9) for depressed versus 4 (2; 7) for nondepressed subjects (). The same held true for the HADS-total score: median ± quartiles 14 (10; 20) for depressed versus 8 (5; 14) for nondepressed patients ().

Figure 2 depicts the ROC curve for the HADS-D subscale. The overall discriminant performance was low but significantly different from random chance, AUC 0.66 (95% CI 0.60–0.72). Youden’s index identified a threshold of HADS-D >5 as the optimal cut-off score to diagnose depression (). A cut-off >5 yielded a sensitivity of 62.1% (95% CI 42.3%–79.3%), a specificity of 62.6% (95% CI 56.0%–68.9%), a positive LR of 1.66 (95% CI 1.2–2.3), and a negative LR of 0.61 (95% CI 0.4–1.0). Using a cut-off value of 5 on the HADS-D applied on the background of an observed prevalence for depression of 11.2% yielded a positive predictive value of 17.3% and a negative predictive value of 92.9%. Thus, in 100 hypothetical patients with a HADS-D >5, 17 will qualify for a diagnosis of depression, whilst among 100 patients with a score ≤5, on average 93 will be correctly identified as nondepressed. The comparison between HADS-D and HADS-total ROC plots is shown in Figure 3. There was no significant difference in overall performance between both scores, 0.662 versus 0.681 (95% CI for the difference 0–0.070). The optimal cut-off score for diagnosing depression on the HADS-total was >9, Youden’s , sensitivity 75.9% (95% CI 56.5%–89.7%), and specificity 55.2% (95% CI 48.5%–61.8%).

The stepwise logistic regression model identified four significant predictors (model fit ). An increasing likelihood of suffering from depression was predicted by lower age (), higher number of comorbidities (), male gender (), and higher percentage of predicted FEV1 (). This model correctly classified 89.6% of cases. Controlling for antidepressant medication use did not alter the results. Thus, younger men with additional comorbidities had the highest risk of depression.

4. Discussion

In this cross-sectional multicentre cohort study involving patients with mild to very severe COPD, we found low accuracy of both the HADS-D and HADS-total in identifying patients with a preexisting diagnosis of depression. As the optimal cut-off HADS-D >5 yielded a positive predictive value of only 17.3% and a negative predictive value of 92.9%, the test seems to more accurately identify the absence rather than presence of depression. Its usefulness as a general measure of psychological distress notwithstanding, the validity of the HADS-D as a tool for classifying COPD patients into depressed and nondepressed categories—as commonly applied in previous studies—is questionable. This lack of discriminant power may be explained in part by the original validation of the questionnaire, which was aimed at a general medical case mix in an outpatient setting, rather than at secondary/tertiary care patients with chronic debilitating ailments. Yet, despite caveats mentioned by the HADS’ developers [5], over the last three decades it has been applied to the evaluation of depression and anxiety symptoms in a large variety of clinical contexts outwith its original target group. Relying on a one-week retrospective questionnaire-based approach to classify patients as depressed or not for ensuing subgroup analyses (e.g., to predict physical activity [29]) is not appropriate. Moreover, the original purpose of the HADS as a screening rather than diagnostic tool should forbid reliance on its results as the sole indicator of clinically significant depression—a labelling approach applied in previous research. This study reemphasizes that the HADS should not be used to diagnose depression or reliably subgroup patient samples.

Our results on depression in COPD patients are in line with findings from a recent meta-analysis in cancer and palliative care patients [30], which reported a weighted combined sensitivity of 71.6% with a specificity of 82.6% of the HADS for identifying depression. Restricting analyses to trials using HADS-D >7 as cut-off yielded a sensitivity of 68.3% with a specificity of 85.7%. The authors of the meta-analysis promote the use of the HADS as a screening rather than diagnostic tool. High subscale correlations may favour using the HADS as a general measure of psychological distress rather than specifically detecting depression and anxiety [31–33]. Furthermore, studies vary substantially in cut-offs used to identify mental morbidity, casting doubt on the HADS’ usefulness as a screening tool [34]. Using recommended cut-off scores may underestimate psychiatric morbidity in cancer patients [35].

A review incorporating all studies (2000 to 2010) investigating the HADS’ factor structure found heterogeneous results: only half of the included trials confirmed the two-factor model (depression and anxiety), whilst others identified between one and four underlying constructs [31]. For example, an established alternative model suggests three factors labelled, respectively, “negative affectivity,” “anhedonic depression,” and “autonomic anxiety” [32]. Yet, a 2013 metaconfirmatory factor analysis favoured the depression/anxiety two-dimensional structure [33]. Given the confusing theory underpinning the HADS, its use as a measure of any specific psychiatric disorder should best be avoided.

Consequently, the inconsistency of the HADS’ factor structure across samples [31], the discrepancy between its wordings based on colloquial British expressions, and its international application [36], compounded by the exclusion of somatic items, have led to calls for abandoning the 30-year-old HADS in favour of more accurate instruments [37]. Others continue to promote the HADS as a valid, cross-culturally appropriate tool for assessing psychological distress [38]. Future studies should make an effort to validate psychiatric diagnoses in line with the best clinical practice.

The prevalence of depression according to ICD-10 in our cohort (11.2%) was lower than in other studies with reported rates of up to 42% [27]. However, considering only studies based on a definition of depression according to established classification systems yields a lower estimate of about 20% [39]. Another explanation for the low prevalence of depression may be the homogeneous composition of our cohort composed of well looked-after patients recruited from established high-quality care centres in Switzerland. The observed higher rate of diagnosed depression in younger patients with better airway function could be due to a lower threshold for seeking professional help for psychological issues in more recent generations. Less physically limited patients may be more inclined to recognising and addressing ailments other than pulmonary disease. Alternatively, clinicians’ thresholds for diagnosing depression could be different in these patients. Many factors may contribute to emotional morbidity in COPD patients, including social isolation and dependence on others for activities of daily living [28]. Crucially, however, feelings of low mood and the general psychological impact of chronic disease must not be equated with a psychiatric diagnosis of a depressive disorder. The HADS gauges psychological impairment but is not suited as a diagnostic tool. Investigators need to be cautious about labelling subjects inappropriately. As confirmed by our results, overreliance on a self-report questionnaire is prone to erroneous categorisation of patients.

There are some limitations to our study. The recruitment context of specialist pulmonary care necessitated the evaluation of preexisting rather than newly diagnosed depression. Whilst recorded diagnoses of depression were double-checked with patients’ registered clinicians, short-term variations in mood may have hampered the HADS’ ability to detect long-term impairment. Yet, as many clinical trials have used the HADS to label patients as depressed or not irrespective of any reference standard, our findings carry significant implications for the planning of future trials. The comparatively low prevalence of depression, potentially contributed to by underdiagnosis, may have limited the statistical power. Nonetheless, our large nonselective sample is representative of the COPD patient population in Switzerland and is consequently characterised by a high socioeconomic status and low proportion of ethnic minorities—both factors that have been linked to low rates of depression [40].

5. Conclusions

In this large cross-sectional study of stable COPD patients, the HADS questionnaire had a low accuracy in identifying a diagnosis of depression. This is the first study to address HADS-D test accuracy in COPD patients. Depression rates were highest among young male patients with additional comorbidities. The clinical implications of our findings are twofold. Firstly, the HADS should not be used as a stand-alone diagnostic tool for depression in COPD patients. It provides an appropriate scale to evaluate psychological distress but does not allow for diagnostic classification. Secondly, clinicians’ awareness of the significant prevalence of psychological comorbidities in chronic pulmonary disease patients needs to be improved.

Ethical Approval

The study was approved by the Ethics Committee of the Canton of Zurich, Switzerland (Kantonale Ethikkommission Zürich), registration reference KEK-ZH-Nr. 2011-0106.

Disclaimer

Professor Malcolm Kohler is the guarantor of this work and, as such, had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Conflict of Interests

All of the authors report no conflict of interests—financial or otherwise—in relation to this paper.

Authors’ Contribution

Christoph Nowak drafted the paper, implemented the data analysis, and edited the paper. Malcolm Kohler and Christian F. Clarenbach made substantial contributions to conception and design, acquisition of data, interpretation of results, and critical paper review for important intellectual content and provided final approval of the version to be published. Noriane A. Sievi, Esther Irene Schwarz, Christian Schlatzer, Thomas Brack, Martin Brutsche, Martin Frey, Sarosh Irani, Jörg D. Leuppi, Jochen Rüdiger, and Robert Thurnheer made substantial contributions to conception and design, acquisition of data, and paper revision.

Acknowledgments

The study was supported by Lunge Zürich, Lungenliga St. Gallen, Lungenliga Thurgau, Lungenliga Glarus, Lungenliga Aagau, the Gottfried und Julia Bangerter-Rhyner-Stiftung, and the Freiwillige Akademische Gesellschaft Basel.

References

P. J. Barnes and B. R. Celli, “Systemic manifestations and comorbidities of COPD,” European Respiratory Journal, vol. 33, no. 5, pp. 1165–1185, 2009.
View at: Publisher Site | Google Scholar
P. A. Cafarella, T. W. Effing, Z.-A. Usmani, and P. A. Frith, “Treatments for anxiety and depression in patients with chronic obstructive pulmonary disease: a literature review,” Respirology, vol. 17, no. 4, pp. 627–638, 2012.
View at: Publisher Site | Google Scholar
J. Maurer, V. Rebbapragada, S. Borson et al., “Anxiety and depression in COPD: current understanding, unanswered questions, and research needs,” Chest, vol. 134, no. 4, pp. 43S–56S, 2008.
View at: Publisher Site | Google Scholar
A. S. Zigmond and R. P. Snaith, “The hospital anxiety and depression scale,” Acta Psychiatrica Scandinavica, vol. 67, no. 6, pp. 361–370, 1983.
View at: Publisher Site | Google Scholar
R. P. Snaith and A. S. Zigmond, “The hospital anxiety and depression scale,” British Medical Journal, vol. 292, no. 6516, article 344, 1986.
View at: Google Scholar
C. Herrmann, “International experiences with the hospital anxiety and depression scale—a review of validation data and clinical results,” Journal of Psychosomatic Research, vol. 42, no. 1, pp. 17–41, 1997.
View at: Publisher Site | Google Scholar
I. Bjelland, A. A. Dahl, T. T. Haug, and D. Neckelmann, “The validity of the hospital anxiety and depression scale: an updated literature review,” Journal of Psychosomatic Research, vol. 52, no. 2, pp. 69–77, 2002.
View at: Publisher Site | Google Scholar
M. Haddad, P. Walters, R. Phillips et al., “Detecting depression in patients with coronary heart disease: a diagnostic evaluation of the PHQ-9 and HADS-D in primary care, findings from the UPBEAT-UK study,” PLoS ONE, vol. 8, no. 10, Article ID e78493, 2013.
View at: Publisher Site | Google Scholar
L. Castelli, L. Binaschi, P. Caldera, A. Mussa, and R. Torta, “Fast screening of depression in cancer patients: the effectiveness of the HADS,” European Journal of Cancer Care, vol. 20, no. 4, pp. 528–533, 2011.
View at: Publisher Site | Google Scholar
W. L. Loosman, C. E. H. Siegert, A. Korzec, and A. Honig, “Validity of the hospital anxiety and depression scale and the beck depression inventory for use in end-stage renal disease patients,” British Journal of Clinical Psychology, vol. 49, no. 4, pp. 507–516, 2010.
View at: Publisher Site | Google Scholar
M. D. Eisner, P. D. Blanc, E. H. Yelin et al., “Influence of anxiety on health outcomes in COPD,” Thorax, vol. 65, no. 3, pp. 229–234, 2010.
View at: Publisher Site | Google Scholar
T. Hajiro, K. Nishimura, M. Tsukino, A. Ikeda, H. Koyama, and T. Izumi, “Comparison of discriminative properties among disease-specific questionnaires for measuring health related quality of life in patients with chronic obstructive pulmonary disease,” The American Journal of Respiratory and Critical Care Medicine, vol. 157, no. 3 I, pp. 785–790, 1998.
View at: Publisher Site | Google Scholar
P. Ergün, D. Kaymaz, E. Günay et al., “Comprehensive out-patient pulmonary rehabilitation: treatment outcomes in early and late stages of chronic obstructive pulmonary disease,” Annals of Thoracic Medicine, vol. 6, no. 2, pp. 70–76, 2011.
View at: Publisher Site | Google Scholar
G. Cheung, C. Patrick, G. Sullivan, M. Cooray, and C. L. Chang, “Sensitivity and specificity of the Geriatric Anxiety Inventory and the Hospital Anxiety and Depression Scale in the detection of anxiety disorders in older people with chronic obstructive pulmonary disease,” International Psychogeriatrics, vol. 24, no. 1, pp. 128–136, 2012.
View at: Publisher Site | Google Scholar
K. F. Rabe, S. Hurd, A. Anzueto et al., “Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease: GOLD executive summary,” American Journal of Respiratory and Critical Care Medicine, vol. 176, no. 6, pp. 532–555, 2007.
View at: Publisher Site | Google Scholar
World Health Organization, ICD-10. International Statistical Classification of Diseases and Related Health Problems, 10th Revision, WHO, Geneva, Switzerland, 2010.
J. Wanger, J. L. Clausen, A. Coates et al., “Standardisation of the measurement of lung volumes,” European Respiratory Journal, vol. 26, no. 3, pp. 511–522, 2005.
View at: Publisher Site | Google Scholar
ATS Committee on Proficiency Standards for Clinical Pulmonary Function Laboratories, “ATS statement: guidelines for the six-minute walk test,” American Journal of Respiratory and Critical Care Medicine, vol. 166, no. 1, pp. 111–117, 2002.
View at: Google Scholar
C. M. Fletcher, P. C. Elmes, A. S. Fairbairn, and C. H. Wood, “The significance of respiratory symptoms and the diagnosis of chronic bronchitis in a working population,” British Medical Journal, vol. 2, no. 5147, pp. 257–266, 1959.
View at: Publisher Site | Google Scholar
P. W. Jones, G. Harding, P. Berry, I. Wiklund, W.-H. Chen, and N. K. Leidy, “Development and first validation of the COPD Assessment Test,” European Respiratory Journal, vol. 34, no. 3, pp. 648–654, 2009.
View at: Publisher Site | Google Scholar
B. R. Celli, C. G. Cote, J. M. Marin et al., “The body-mass index, airflow obstruction, dyspnoea, and exercise capacity index in chronic obstructive pulmonary disease,” The New England Journal of Medicine, vol. 350, no. 10, pp. 1005–1012, 2004.
View at: Publisher Site | Google Scholar
K. H. Zou, A. J. O'Malley, and L. Mauri, “Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models,” Circulation, vol. 115, no. 5, pp. 654–657, 2007.
View at: Publisher Site | Google Scholar
K. Hajian-Tilaki, “Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation,” Caspian Journal of Internal Medicine, vol. 4, no. 2, pp. 627–635, 2013.
View at: Google Scholar
E. R. DeLong, D. M. DeLong, and D. L. Clarke-Pearson, “Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach,” Biometrics, vol. 44, no. 3, pp. 837–845, 1988.
View at: Publisher Site | Google Scholar | Zentralblatt MATH
R. A. Hilgers, “Distribution-free confidence bounds for ROC curves,” Methods of Information in Medicine, vol. 30, no. 2, pp. 96–101, 1991.
View at: Google Scholar
W. J. Youden, “Index for rating diagnostic tests,” Cancer, vol. 3, no. 1, pp. 32–35, 1950.
View at: Google Scholar
L. van Ede, C. J. Yzermans, and H. J. Brouwer, “Prevalence of depression in patients with chronic obstructive pulmonary disease: a systematic review,” Thorax, vol. 54, no. 8, pp. 688–692, 1999.
View at: Publisher Site | Google Scholar
K. Hill, R. Geist, R. S. Goldstein, and Y. Lacasse, “Anxiety and depression in end-stage COPD,” European Respiratory Journal, vol. 31, no. 3, pp. 667–677, 2008.
View at: Publisher Site | Google Scholar
H. Q. Nguyen, V. S. Fan, J. Herting et al., “Patients with COPD with higher levels of anxiety are more physically active,” Chest, vol. 144, no. 1, pp. 145–151, 2013.
View at: Publisher Site | Google Scholar
A. J. Mitchell, N. Meader, and P. Symonds, “Diagnostic validity of the Hospital Anxiety and Depression Scale (HADS) in cancer and palliative settings: a meta-analysis,” Journal of Affective Disorders, vol. 126, no. 3, pp. 335–348, 2010.
View at: Publisher Site | Google Scholar
T. D. Cosco, F. Doyle, M. Ward, and H. McGee, “Latent structure of the hospital anxiety and depression scale: a 10-year systematic review,” Journal of Psychosomatic Research, vol. 72, no. 3, pp. 180–184, 2012.
View at: Publisher Site | Google Scholar
M. Dunbar, G. Ford, K. Hunt, and G. Der, “A confirmatory factor analysis of the Hospital Anxiety and Depression scale: comparing empirically and theoretically derived structures,” British Journal of Clinical Psychology, vol. 39, no. 1, pp. 79–94, 2000.
View at: Publisher Site | Google Scholar
S. Norton, T. Cosco, F. Doyle, J. Done, and A. Sacker, “The hospital anxiety and depression scale: a meta confirmatory factor analysis,” Journal of Psychosomatic Research, vol. 74, no. 1, pp. 74–81, 2013.
View at: Publisher Site | Google Scholar
A. Vodermaier and R. D. Millman, “Accuracy of the hospital anxiety and depression scale as a screening tool in cancer patients: a systematic review and meta-analysis,” Supportive Care in Cancer, vol. 19, no. 12, pp. 1899–1908, 2011.
View at: Publisher Site | Google Scholar
R. Morse, K. Kendell, and S. Barton, “Screening for depression in people with cancer: the accuracy of the hospital anxiety and depression scale,” Clinical Effectiveness in Nursing, vol. 9, no. 3-4, pp. 188–196, 2005.
View at: Publisher Site | Google Scholar
G. A. Maters, R. Sanderman, A. Y. Kim, and J. C. Coyne, “Problems in cross-cultural use of the hospital anxiety and depression scale: “no butterflies in the desert”,” PLoS ONE, vol. 8, no. 8, Article ID e70975, 2013.
View at: Publisher Site | Google Scholar
J. C. Coyne and E. van Sonderen, “No further research needed: abandoning the Hospital and Anxiety Depression Scale (HADS),” Journal of Psychosomatic Research, vol. 72, no. 3, pp. 173–174, 2012.
View at: Publisher Site | Google Scholar
S. Norton, A. Sacker, and J. Done, “Further research needed: a comment on Coyne and van Sonderen's call to abandon the Hospital Anxiety and Depression Scale,” Journal of Psychosomatic Research, vol. 73, no. 1, pp. 75–76, 2012.
View at: Publisher Site | Google Scholar
A. M. Yohannes, T. G. Willgoss, R. C. Baldwin, and M. J. Connolly, “Depression and anxiety in chronic heart failure and chronic obstructive pulmonary disease: prevalence, relevance, clinical implications and management principles,” International Journal of Geriatric Psychiatry, vol. 25, no. 12, pp. 1209–1221, 2010.
View at: Publisher Site | Google Scholar
I. Tarricone, E. Stivanello, F. Poggi et al., “Ethnic variation in the prevalence of depression and anxiety in primary care: a systematic review and meta-analysis,” Psychiatry Research, vol. 195, no. 3, pp. 91–106, 2012.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Christoph Nowak et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

6350

Downloads

2872

Citations