The Validity and Reliability of the Sinhala Translation of the Patient Health Questionnaire (PHQ-9) and PHQ-2 Screener

Hanwella, Raveen; Ekanayake, Shakya; de Silva, Varuni A.

doi:https://doi.org/10.1155/2014/768978

Depression Research and Treatment

On this page

Abstract Introduction Materials and Methods Results Discussion Conclusions References Copyright Related Articles

Research Article | Open Access

Volume 2014 | Article ID 768978 | https://doi.org/10.1155/2014/768978

The Validity and Reliability of the Sinhala Translation of the Patient Health Questionnaire (PHQ-9) and PHQ-2 Screener

Raveen Hanwella,¹Shakya Ekanayake,¹and Varuni A. de Silva¹

Academic Editor: Frans G. Zitman

Received05 Dec 2013

Accepted06 Mar 2014

Published27 Mar 2014

Abstract

The Patient Health Questionnaire (PHQ-9) was adapted and translated into Sinhala. Sample consisted of 75 participants diagnosed with MDD according to DSM-IV criteria and 75 gender matched controls. Concurrent validity was assessed by correlating total score of PHQ-9 with that of Centre for Epidemiological Studies Depression Scale (CESD). The Structured Clinical Interview for DSM-IV (SCID-II) conducted by a psychiatrist was the gold standard. Mean age of the sample was 33.0 years. There were 91 females (60.7%). There was significant difference in the mean PHQ-9 scores between cases (14.71) and controls (2.55) (). The specificity of the categorical algorithm was 0.97; the sensitivity was 0.58. Receiver operating characteristic (ROC) analysis found that cut-off score of ≥10 had sensitivity of 0.75 and specificity of 0.97. The area under the curve (AOC) was 0.93. The sensitivity of the two-item screener (PHQ-2) was 0.80 and the specificity was 0.97. Cronbach’s alpha was 0.90. The PHQ-9 is a valid and reliable instrument for diagnosing MDD in a non-Western population. The threshold algorithm is recommended for screening rather than the categorical algorithm. The PHQ-2 screener has good sensitivity and specificity and is recommended as a quick screening instrument.

1. Introduction

The Global Burden of Disease Study 2010 states that mental and behavioural disorders are a main contributor to Years Living with Disability (YLD) [1]. Patients with depressive symptoms present to primary care settings, specialized care units, and psychiatry treatment services [2, 3]. A WHO multicountry study reported that the prevalence of depression in primary care was 14% [4]. Depression is underdiagnosed in primary care and specialized treatment settings and only about half the patients with depression are accurately diagnosed by general practitioners [5, 6].

The Patient Health Questionnaire (PHQ-9) was developed as a screener for depression during the development of PRIME-MD [7, 8]. It is a self-administered tool based on DSM-IV criteria for diagnosing depressive disorder. It can be used to monitor severity of depression by scoring the frequency of each symptom on a scale of 0–3. It can also be used to diagnose major depressive disorder (MDD).

The PHQ-9 has been used in a variety of settings. It has been translated and culturally adapted for diagnosing depressive disorder in many countries [9–11]. A meta-analysis reported that the summary sensitivity of the PHQ-9 was 0.77 (0.71–0.84) and specificity was 0.94 (0.90–0.97) [12]. The PHQ-2 is used as a screening tool for depression in primary care, and patients who screen positive are subject to further evaluation [8, 13].

This study had two main aims. The first was to establish the validity and reliability of the PHQ-9 in a Sri Lankan population. Sri Lanka has a shortage of psychiatrists and many patients with depression are treated in nonpsychiatric settings [14]. Therefore a valid and reliable depression screening instrument is invaluable in these settings. The second aim was to compare the sensitivity and specificity of the different diagnostic algorithms of the PHQ-9 which would help identify the best algorithm for diagnosis of MDD.

2. Materials and Methods

2.1. Sample

Sample size was calculated assuming a sensitivity and specificity of 0.85. Sample consisted of 75 cases diagnosed with major depressive disorder and 75 gender matched controls. Cases were selected from an outpatient psychiatry clinic in a tertiary care hospital in Colombo, Sri Lanka. Patients are referred to this clinic from other units in the hospital. Patients also directly seek treatment from this clinic. Therefore the patient population is comparable with a primary care population. Controls were selected from the community following a screening assessment to exclude depressive disorder. Patients with bipolar depression were excluded from the study.

2.2. Study Procedure

The study methodology has been described in a previous publication [15]. A combined qualitative and quantitative approach was used for the translation of the PHQ-9 [16]. A panel of six experts who were bilingual individually translated the scale into Sinhala. Sinhala is a language spoken by about 75% of Sri Lankans. The translations were then discussed in a group consisting of all six experts. The best translation for each item of the scale was decided by consensus of the group. The final translated scale was back translated to English by a bilingual expert who was unaware of the original scale. The back translated scale was compared with the original scale. The translated scale was pretested on a group of 20 people in the community.

Major depressive disorder was diagnosed based on the Structured Clinical Interview for DSM-IV Disorders (SCID-1) [17]. Cases and controls completed the Sinhala version of the PHQ-9 questionnaire and the Centre for Epidemiological Studies Depression Scale (CESD) [15]. The CESD was used to assess the concurrent validity.

Written informed consent was obtained from all participants and ethical approval was obtained from the Ethics Review Committee of the Faculty of Medicine, University of Colombo.

2.3. Measures

The Patient Health Questionnaire is a nine-item instrument that assesses symptoms of depression as listed in the DSM-IV. Each of the nine items is scored from 0 (not at all) to 3 (nearly every day). The total scores can range from 0 (no depressive symptoms) to 27 (all symptoms occurring daily). The PHQ-9 uses two diagnostic algorithms to diagnose MDD. The categorical algorithm requires “more than half the days” or “nearly every day” response to at least five questions which should include question or 1b or both. Question is counted as positive if the thought is present on several days [18]. The second algorithm uses a threshold score for diagnosis. The total score also indicates the severity of depression; scores of 0 to 4 represent a minimal level of depression; 5 to 9, mild; 10 to 14, moderate; 15 to 19, moderately severe; and 20 to 27, severe. In addition the first two questions of the PHQ-9 can be used as a screener for depressive disorder (PHQ-2) [13].

2.4. Statistical Analysis

Statistical analysis was done using SPSS Statistics version 18.0 [19]. Internal consistency was measured using Cronbach’s alpha. Criterion validity was assessed using receiver operating characteristic (ROC) analysis which gave the sensitivity and specificity of the PHQ-9 at different cut-off points. The Structured Clinical Interview for DSM-IV (SCID-I) conducted by a psychiatrist was used as the gold standard [17]. Concurrent validity was assessed by correlating the total scores of CESD and PHQ-9. The sensitivity and specificity of the two algorithms of the PHQ-9 and the two-question screener (PHQ-2) in diagnosing MDD were assessed.

3. Results

The sample consisted of 75 cases and 75 controls. The mean age of the sample was 33.0 years. There were 91 females (60.7%). The controls (28.33 years) were significantly younger than the cases (37.51 years) (, , and ). There was no significant difference in gender distribution between cases and controls (χ² = 1.45, , and ).

The mean PHQ-9 total score of the sample was 8.67 (SD 8.22). There was significant difference in the mean PHQ-9 scores between cases (14.71) and controls (2.55) (, , and ). Classification of cases according to the severity of depression based on the PHQ-9 total score showed that 7 (9.2%) had minimal depression (score 1–4), 12 (15.8%) mild depression (score 5–9), 15 (19.7%) moderate depression (score 10–14), 20 (26.3%) moderately severe depression (score 15–19), and 22 (28.9%) severe depression (score 20–27). Of the controls 61 (81.3%) had minimal depression, 12 (16%) had mild depression, one had moderate depression and another had moderate to severe depression, and none had severe depression.

3.1. Validity

The Structured Clinical Interview for DSM-IV Disorders (SCID-1) was used as the “gold standard” [17]. When the categorical algorithm was used to diagnose major depressive disorder, the sensitivity was 0.58 and the specificity was 0.97 (Table 1).

Receiver operating characteristic (ROC) analysis identified sensitivity and specificity at different cut-off points for the diagnostic algorithm using the total score (Figure 1). The area under the curve (AOC) was 0.93. Cut-off score of ≥10 gave a sensitivity of 0.75 and specificity of 0.97 (Table 2).

Concurrent validity was assessed by correlating the total scores of PHQ-9 and Centre for Epidemiological Studies Depression Scale (CESD). The Pearson correlation coefficient was 0.87.

In the two-item categorical algorithm, depression screening is positive if one or more of the two depressive symptom criteria are present. The sensitivity of the two-item screener was 0.80 and the specificity was 0.97 (Table 3).

3.2. Reliability

Cronbach’s alpha was 0.90. The mean item scores and corrected item-total correlations are given in Table 4. The mean scores of the items ranged from 0.57 to 1.36. The lowest item mean (0.57) and the lowest item-total correlation (0.44) were for item 6 Feeling bad about yourself or that you are a failure. Cronbach’s alpha, if item is removed, reduced for all items.

4. Discussion

This study examined the validity and reliability of two algorithms of the PHQ-9 and the two-question screener (PHQ-2) in diagnosing major depressive disorder. When the categorical algorithm was used, the sensitivity was 0.58 and the specificity was 0.97. When the threshold algorithm was used, a cut-off score of ≥10 gave a sensitivity of 0.75 and specificity of 0.97. Cronbach’s alpha was 0.90 which may indicate the unidimensionality of the scale. The sensitivity of the two-item screener (PHQ-2) was 0.80 and the specificity was 0.97.

When the categorical algorithm was used, the PHQ-9 had very high specificity but low sensitivity. There are reports that the categorical algorithm results in low sensitivity (0.42–0.53) but high specificity [11, 20, 21]. The sensitivity and the specificity of a diagnostic test depend on the characteristics of the test and the population in which it is used [22]. Sensitivity is higher when the sample consists of more patients with severe disease. In our sample, although the mean PHQ-9 score was (8.67) higher than that in several other studies, this did not result in high sensitivity.

It is possible that in some cultures emotional problems are expressed differently and this can influence the interpretation of scale items. However low sensitivity was seen with the categorical algorithm but not the threshold algorithm. Therefore the low sensitivity of the categorical algorithm may reflect the stringency of criteria for diagnosis rather than problems with interpretation of items. Similar findings have led other researchers to recommend the use of the threshold algorithm rather than the categorical algorithm [11, 20].

It is thought that patients from non-Western cultures are less likely to acknowledge the presence of low mood. Patients with depressive disorder, from both Western and non-Western cultures, have been found to present initially with somatic symptoms such as musculoskeletal pain and fatigue [23]. The mean score of items of the PHQ-9 in our sample showed that somatic symptoms of poor sleep and lack of energy were commonly acknowledged, but the item most frequently reported by the sample was low mood. Therefore, in our sample, regardless of the presenting complaint, patients with depressive disorder did acknowledge experiencing low mood. This finding has been reported from a study in Thailand too [11].

The PHQ-2 screener had high sensitivity and specificity. The sensitivity of the two-item screener (0.80) was higher than that of the categorical algorithm (0.58) and the threshold algorithm (0.75). The specificity was the same as the other two algorithms.

The United States Preventive Services Taskforce recommends using the first 2 questions in the PHQ-9 “Over the past 2 weeks, have you felt down, depressed, or hopeless?” and “Over the past 2 weeks, have you felt little interest or pleasure in doing things?” in screening for depression in adults because it may be as effective as using more formal instruments [24, 25]. Our findings show that the PHQ-2 is effective in screening for depression as it has good sensitivity and specificity and can be administered in busy outpatient settings with ease. However it is not recommended for diagnosis of major depressive disorder.

Our study has several limitations. We used a case-control design which is known to increase the sensitivity and specificity of the instrument [22]. However the patient sample included an appropriate spectrum of mild and severe disease as well as treated and untreated individuals. A major limitation of the study was that we recruited patients from a tertiary care psychiatry unit. Although this outpatient clinic treated patients who directly present similar to a primary care facility the composition of the patient population would be different to that of a primary care centre.

Patients presenting to primary care services may be diagnosed with specific clinical syndromes that vary in duration and severity over time and also encompass an admixture of somatic and psychological symptoms that do not match current psychiatric diagnostic systems [26]. This is especially true for depressive symptoms. For example, pain may be a presenting symptom of depressive disorder in primary care. Therefore instruments and diagnostic criteria may need to be adapted for use in primary care.

5. Conclusions

We recommend the use of the threshold algorithm rather than the categorical algorithm for screening for depressive disorder, because of the better sensitivity of the former. We also recommend the use of the PHQ-2 screener in all clinical settings, because it has high sensitivity and specificity and can be administered easily.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

T. Vos, A. D. Flaxman, M. Naghavi et al., “Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010,” The Lancet, vol. 380, no. 9859, pp. 2163–2196, 2012.
View at: Google Scholar
R. Hanwella and V. de Silva, “Depression in the physically ill,” The Ceylon medical journal, vol. 53, no. 2, pp. 63–65, 2008.
View at: Google Scholar
R. Hanwella and V. de Silva, “Diagnosis and management of depression,” The Ceylon Medical Journal, vol. 53, no. 2, pp. 60–62, 2008.
View at: Google Scholar
T. B. Ustun and M. von Korff, “Primary mental health services,” in Mental Illness in General Health Care: An International Study, T. B. Ustun and N. Sartorius, Eds., pp. 347–360, John Wiley & Sons, Chichester, UK, 1995.
View at: Google Scholar
A. J. Mitchell, A. Vaze, and S. Rao, “Clinical diagnosis of depression in primary care: a meta-analysis,” The Lancet, vol. 374, no. 9690, pp. 609–619, 2009.
View at: Publisher Site | Google Scholar
M. Cepoiu, J. McCusker, M. G. Cole, M. Sewitch, E. Belzile, and A. Ciampi, “Recognition of depression by non-psychiatric physicians—a systematic literature review and meta-analysis,” Journal of General Internal Medicine, vol. 23, no. 1, pp. 25–36, 2008.
View at: Publisher Site | Google Scholar
R. L. Spitzer, J. B. W. Williams, K. Kroenke et al., “Utility of a new procedure for diagnosing mental disorders in primary care: the PRIME-MD 1000 study,” Journal of the American Medical Association, vol. 272, no. 22, pp. 1749–1756, 1994.
View at: Publisher Site | Google Scholar
R. L. Spitzer, K. Kroenke, and J. B. W. Williams, “Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study,” Journal of the American Medical Association, vol. 282, no. 18, pp. 1737–1744, 1999.
View at: Publisher Site | Google Scholar
C. Diez-Quevedo, T. Rangil, L. Sanchez-Planell, K. Kroenke, and R. L. Spitzer, “Validation and utility of the patient health questionnaire in diagnosing mental disorders in 1003 general hospital Spanish inpatients,” Psychosomatic Medicine, vol. 63, no. 4, pp. 679–686, 2001.
View at: Google Scholar
S. Becker, K. Al Zaid, and E. Al Faris, “Screening for somatization and depression in Saudi Arabia: a validation study of the PHQ in primary care,” International Journal of Psychiatry in Medicine, vol. 32, no. 3, pp. 271–283, 2002.
View at: Publisher Site | Google Scholar
M. Lotrakul, S. Sumrithe, and R. Saipanish, “Reliability and validity of the Thai version of the PHQ-9,” BMC Psychiatry, vol. 8, article 46, 2008.
View at: Publisher Site | Google Scholar
K. A. Wittkampf, L. Naeije, A. H. Schene, J. Huyser, and H. C. van Weert, “Diagnostic accuracy of the mood module of the patient health questionnaire: a systematic review,” General Hospital Psychiatry, vol. 29, no. 5, pp. 388–395, 2007.
View at: Publisher Site | Google Scholar
K. Kroenke, R. L. Spitzer, and J. B. W. Williams, “The patient health questionnaire-2: validity of a two-item depression screener,” Medical Care, vol. 41, no. 11, pp. 1284–1292, 2003.
View at: Publisher Site | Google Scholar
V. de Silva and R. Hanwella, “Mental health in Sri Lanka,” The Lancet, vol. 376, no. 9735, pp. 88–89, 2010.
View at: Google Scholar
V. A. de Silva, S. Ekanayake, and R. Hanwella, “Validation of the Sinhala version of the Centre for Epidemiological Studies Depression scale (CES-D) in out-patients,” Ceylon Medical Journal, vol. 59, no. 1, pp. 8–12, 2014.
View at: Google Scholar
A. Sumathipala and J. Murray, “New approach to translating instruments for cross-cultural research: a combined qualitative and quantitative approach for translation and consensus generation,” International Journal of Methods in Psychiatric Research, vol. 9, no. 2, pp. 87–95, 2000.
View at: Google Scholar
M. B. First, R. L. Spitzer, M. Gibbon, and J. B. W. Williams, Structured Clinical Interview For DSM-IV Axis I Disorders, (SCID), Biometrics Research Department, New York State Psychiatric Institute, New York, NY, USA, 1998.
PHQ Screeners, http://www.phqscreeners.com/overview.aspx.
IBM Corp, IBM SPSS Statistics for Windows, Version 20.0, IBM Corp, Armonk, NY, USA, 2011.
M. Inagaki, T. Ohtsuki, N. Yonemoto et al., “Validity of the Patient Health Questionnaire (PHQ)-9 and PHQ-2 in general internal medicine primary care at a Japanese rural hospital: a cross-sectional study,” General Hospital Psychiatry, vol. 35, no. 6, pp. 592–597, 2013.
View at: Google Scholar
Y. Carballeira, P. Dumont, S. Borgacci et al., “Criterion validity of the French version of Patient Health Questionnaire (PHQ) in a hospital department of internal medicine,” Psychology and Psychotherapy: Theory, Research and Practice, vol. 80, no. 1, pp. 69–77, 2007.
View at: Publisher Site | Google Scholar
A. W. S. Rutjes, J. B. Reitsma, J. P. Vandenbroucke, A. S. Glas, and P. M. M. Bossuyt, “Case-control and two-gate designs in diagnostic accuracy studies,” Clinical Chemistry, vol. 51, no. 8, pp. 1335–1341, 2005.
View at: Publisher Site | Google Scholar
L. J. Kirmayer, J. M. Robbins, M. Dworkind, and M. J. Yaffe, “Somatization and the recognition of depression and anxiety in primary care,” American Journal of Psychiatry, vol. 150, no. 5, pp. 734–741, 1993.
View at: Google Scholar
US Preventive Task Force, http://www.uspreventiveservicestaskforce.org/uspstf09/adultdepression/addeprrs.htm.
M. A. Whooley, A. L. Avins, J. Miranda, and W. S. Browner, “Case-finding instruments for depression: two questions are as good as many,” Journal of General Internal Medicine, vol. 12, no. 7, pp. 439–445, 1997.
View at: Publisher Site | Google Scholar
I. M. Bakker, B. Terluin, H. W. J. van Marwijk, W. van Mechelen, and W. A. B. Stalman, “Test-retest reliability of the PRIME-MD: limitations in diagnosing mental disorders in primary care,” European Journal of Public Health, vol. 19, no. 3, pp. 303–307, 2009.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2014 Raveen Hanwella et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

4481

Downloads

1534

Citations