DoloTest in General Practice Study: Sensitivity and Specificity Screening for Depression

Kristiansen, Kim; Lyngholm-Kjaerby, Pernille; Moe, Claus

doi:https://doi.org/10.1155/2012/472505

International Journal of Family Medicine

On this page

Abstract Introduction Methods Results Discussion Conclusion Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2012 | Article ID 472505 | https://doi.org/10.1155/2012/472505

DoloTest in General Practice Study: Sensitivity and Specificity Screening for Depression

Kim Kristiansen,¹Pernille Lyngholm-Kjaerby,²and Claus Moe³

Academic Editor: P. Van Royen

Received01 Aug 2012

Revised24 Oct 2012

Accepted07 Nov 2012

Published06 Dec 2012

Abstract

Background. Coexistence of pain and depression has significant impact on the patient’s quality of life and treatment outcome. DoloTest is a pain and HRQoL assessment tool developed to provide shared understanding between the clinician and the patient of the condition by a visual profile. Aim. To find the sensitivity and specificity of DoloTest as a screening tool for depression for patients in primary care. Methods. All patients coming to a primary care clinic were asked to fill in a DoloTest and a Major Depression Inventory. Results. 715 (68.5%) of 1044 patients entered the study. 34.4% came due to pain. 16.1% met depression criteria, and 26.8% of patients coming due to pain met criteria for depression. 65.6% of the men and 54.2% of the women meeting the criteria for depression came due to pain. Depressed patients had statistically significant higher scores on all DoloTest domains. Selecting the cutoff value for the domain “low spirits” to be “65” (0–100) for depression gave a sensitivity of 78% (70–85%) and a specificity of 95% (93–96%) for meeting depression criteria. Conclusion. DoloTest can with a high sensitivity and specificity identify persons meeting criteria for depression and is an easy-to-use screening tool to identify patients with the coexistence of pain and depression.

1. Introduction

Chronic pain and depression are among the most common health problems reported by patients attending primary care [1–3]. Diagnosing pain and its coexistence with depression and getting an overview of the pain patient’s situation can be challenging and can have great consequences for the treatment outcome. Numerous studies have found pain associated with a significant limitation in daily activities, physical activities and with poor self-rated health [3, 4]. Pain is also associated with increased prevalence of depressive disorders [5, 6]. Studies from primary care have demonstrated that 22–40% of all contacts to primary care are due to pain [7]. Persistent pain is often comorbid with depression both in general pain conditions [4, 8] and in disease-specific conditions [9]. Though health care providers are advised to pay special attention to pain symptoms in patients with depression [10], studies have demonstrated that primary care physicians tend to associate pain with depression to a significant lesser extent than other somatic symptoms [10], although pain is the most prevalent somatic symptom in patients with depression. This tendency to underestimate the intensity of burden has also been proven for the symptom pain with significant differences between the patient’s and the healthcare provider’s grading of the intensity of the pain [11, 12].

Patients with depression seek care more often for somatic symptoms than for psychological symptoms [13], why care providers must have an increased awareness for this coexistence. There is evidence that optimizing antidepressant therapy and pain self-management in primary care patients may result in improvement of both depression and pain [14]. Coexistence of depression and pain has also shown to be a major risk factor for opioid misuse both by using opioids for stress and sleep problems instead of for pain alone, and by using more opioids than prescribed [15]. It is therefore important that healthcare provider and the patient have an ongoing awareness and understanding of this connection between depression and pain and preferably share understanding of the current state of the condition. DoloTest (Figure 1) has been developed to provide such a shared understanding of the patients situation. It is a validated [16], pain- and health-related quality of life (HRQoL) assessment tool integrating measurement of the intensity of pain with assessment of the intensity of the impact of the pain including mood.

The aim of this study was to determine to which degree DoloTest is useful as a screening tool for depression in primary care for adult (all persons 18 years or older) seeking primary care, and to find the sensitivity and specificity for DoloTest used for screening for depression.

2. Methods

The study is a diagnostic study among the population of patients visiting primary care physician no matter the reason for the visit. The study was conducted in the primary care clinic “Laegehuset NoerreTorv” in Grindsted, Denmark in the period from October 1st 2008 to December 31st, 2008. The clinic is a mixed urban and rural clinic with primary care physicians. The clinic serves approximately 6600 patients.

2.1. Participants

Denmark has open access to primary care free of charge. All patients being 18 years old or older visiting the clinic and not complying with the exclusion criteria were asked to fill in the questionnaires: DoloTest [16] and “Major Depression Inventory” (MDI) [17], both Danish versions. The study included a study population of 715 patients equal to a response rate of 68,5%. When arriving at the clinic, a clinic nurse screened for inclusion/exclusion criteria. Patients who could enter the study were handed the questionnaires together with a letter of introduction and the standardized DoloTest patient introduction [16]. Patients were also asked about age and gender and whether their visit was due to a pain problem or not. Patients were excluded if they meet exclusion criteria: cognitive dysfunction, visual impairment, and patients whose physical condition made filling the test impossible or prior participation in the study.

2.2. Measurements and Variables

DoloTest is a validated pain- and health related quality of life (HRQoL) assessment tool integrating measurement of the intensity of pain with assessment of the intensity of the impact of the pain on eight 100 mm visual analogue scales (VAS). The design of DoloTest provides a presentation of the test result as a visual profile (DoloTest-Profile), with “no problems” toward the centre of each VAS-line and “worst possible” toward the periphery. The larger the DoloTest-Profile the worse the HRQoL, which is immediately understandable for both the patient and the healthcare provider [16]. The DoloTest-Profile enables the patient to take part in the evaluation of the test result and improve communication about the situation including problems related to depression like mood, sleep problems, tiredness functional problems, and allows the patient and the healthcare provider to evaluate response to treatment together. DoloTest is covering eight important aspects of HRQoL (Table 2). The test takes less than 2 minutes to complete [16]. The test results are also available as a DoloTest-Score, the sum of all scored domains, ranging from 0 to 800. DoloTest was filled in with one week recall.

MDI is a validated self-assessment questionnaire developed to cover the diagnostic criteria in WHO’s ICD-10 classification of major depressive disorders [18]. MDI was chosen because it follows the ICD-10 criteria and is easy to use as a self-assessment questionnaire. The MDI can be used both as a measuring instrument and as a diagnostic instrument with algorithms leading to the ICD-10 categories of depression. When used as a diagnostic instrument like in this study, the MDI items are dichotomized to indicate the presence or absence of each of the symptoms.

2.3. Variables

Data comes from 715 consecutive patients coming to primary care, no matter the reason for their visit. Scores on each DoloTest domain (Table 2) measured in millimetres. DoloTest Score is the sum of the measurement on each DoloTest domain in millimetres [16]. Depression was diagnosed according to the instruction for the MDI test [17].

2.4. Statistical Analysis and Ethics

Statistical analysis was made using Mann-Whitney test to compare groups and Chi-square test to compare frequencies using Analyse-It software v. 2.12. was considered significant. Sensitivity/specificity was found using ROC curve analysis.

The study was according to Danish law ethical approved by “the Danish Data Protection Agency”, Copenhagen, Denmark, and all patients participated voluntary and were provided with both oral and written information.

3. Results

3.1. Study Population

A total of 1044 patients were asked to participate. Of those, 302 (31,5%) were not included either because they did not want to participate or due to the exclusion criteria. 27 provided incomplete data. 715 patients (68.5%) were included in the study. Of the 715 patients, 458 (64.1%) were women and 257 (35.9%) men. There were no statistically significant difference between the gender distribution in the study group and the excluded group (). The average age in the study population was 45.7 years and in the excluded group 55.4 years ().

3.2. DoloTest Scores

Table 1 shows that 246 patients (34.4%) stated their visit was due to a pain problem (Study group) and 469 patients (65.6%) came for other reasons than pain (control group).

The study and control groups were sociodemographic identical with no statistical significant difference between the gender and age distributions, 33.6% of the woman and 35.8% of the men came due to pain ().

Table 2 shows that in all domains there are statistically significant difference () between the study group and for the control group. “low spirits” and “pain” were the only domains in study group with statistically significant differences between men and women, women having the highest score. In the total study population, the women in average scored statistically significantly higher than men in all domains except for “pain” and “problems with more strenuous activity”. In the control group, women scored statistically significantly higher in al domains except “pain”, where the women also scored higher than men, however not statistically significant. The DoloTest-Score was statistically significantly higher for women in the whole study population and also for the control group. In the study population the women’s DoloTest-Score had a tendency to be higher than the men’s.

3.3. Major Depressive Disorder and DoloTest Profiles

Table 1 shows the prevalence of patients with depression for the study and control groups.

115 (16.1%) of all the patients met criteria for depression using the MDI-scale. Table 2 presents the prevalence of depression together with the average MDI-rating score for the whole study population as well as specified for the study group and for the control group. In the whole study population, 32 men (12.8%) and 83 women (18.1%) met the criteria for depression using the MDI Scale, and the corresponding prevalence for control group was 11 men (6.7%) and 38 women (12.5%) with statistically significant difference between genders in both groups (). In the study population, 21 men (22.8%) and 45 women (29.2%) met criteria for depression (). The prevalence of patients with depression in study group was statistically significantly higher than in the control group () for men and for women.

For patients meeting criteria for depression and patients not meeting the depression criteria, there was a difference for all DoloTest domains () (Table 3). The domains were scored equally by men and women meeting criteria for depression due to the MDI Scale; however, for patients not meeting criteria for depression, women scored statistically significantly higher than men on five of the domains (Problems with light physical activity, reduced energy and strength, low spirits, reduced social life, and sleeping problems) (Table 3). The numbers in Table 3 are visualized by presented as average DoloTest Profiles in Figure 1.

3.4. Sensitivity and Specificity Screening for Depression

A cut-off value for the domain “to what extent do you experience low spirits” for depression was found using ROC curve analysis. It is desirable to find a cut-off with both a high sensitivity and a high specificity, and from a clinical point of view defining a cutoff with few false positive and high predictive value of positive test is important to help making an accurate clinical decision. Selecting a cutoff point of “65” (Figure 2) will provide a sensitivity of 0.78 (95% CI: 0.70–0.85) and a specificity of 0.95 (95% CI: 0.93–0.96) the predictive value of positive test being 0.74 for detecting that a patient meet criteria for depression. Area under the ROC-curve was 0.95 (95% CI: 0.94–0.97).

4. Discussion

DoloTest has in this study proved useful as a screening tool for patients’ experienced pain and the impact of pain on the patient’s HRQoL as well as a screening tool for patients meeting criteria for depression and thereby for the coexistence of pain and depression. A cut-off value of “65” on the “low spirits” domain provides both high sensitivity (0.78) and high specificity (0.95) and a predicted value on positive test at 0.74.

This study is the first to present health related quality of life (HRQoL) data as DoloTest Profiles and DoloTest Scores for all patients seeking a primary care both for patients whose visit are due to a pain problem and for patients whose visit has other reasons. Furthermore, the study contributes to the growing knowledge about coexistence of pain and depression, finding the prevalence of depression to be statistically significantly higher for both genders in the group visiting primary care physician because of a pain problem than for other problems combined.

4.1. Depression and Pain

Pain symptoms have been found to be associated with reduced psychological and physical health as well as with limitations in daily activities and with social isolation [19, 20] and are found to be a major reason for seeking health care [19, 20]. In this study, 34.4% of the patients stated that their visit to physician was due to pain, which is in accordance with findings in other studies [7].

Depression has shown to be present in 10–15% of all primary care patients [21]. Our study shows that 16.1% of all patients met criteria for depression, and 26.8% whose visit was due to pain, met depression criteria. 57.4% of patients who met the criteria for depression came due to pain. These findings are in good correlation with the literature, though this study captures the pain intensity during the last week, for example, not necessarily persistent pain.

The findings in this study are clinically important since the visual DoloTest Profiles can facilitate both awareness and often otherwise difficult communication about depression and pain, a coexistence leading to increased risk of reduced function, reduced work capacity, increased risk of opioid misuse, reduced HRQoL, and other related problems.

It has been shown that suffering from both pain and depression at the same time besides the low HRQoL is associated with dramatically increased health care costs [22, 23] compared to depression alone, and that treating depression alone does not give sufficient improvement on somatic symptoms like pain [21, 24]. Based on this knowledge, health care providers are encouraged to be aware of pain symptoms in patients with depression as well as depressive symptoms in patients with pain [21, 25]. Furthermore, it is stated that targeted screening for the cooccurrence of pain and depression is warranted [25]. The RESPECT trial [21] found that effective treatment of either depression or pain is dependent on the treatment of the other when they are co-existing. The study concludes “it makes no longer sense to treat one condition without considering the other” [21]. It is therefore of high importance to provide healthcare professionals with tools to screen and identify these patients at risk for suboptimal treatment if not found.

4.2. Screening for Depression

In other studies using Visual Analogue Scale (VAS) as screening tool for depression, it has shown to be a reliable method [26] and VAS has thereby showed to be a valuable tool for assessment of mood [27]. A study looking at using one question from the Subjective Health Complaints (SHC) Inventory found this useful with sensitivity 79%, specificity 81% and predictive value of positive test to be 67% [28]. In the present study, DoloTest has proved as a tool screening both pain and depression, since the DoloTest domain “low spirits” is associated with depression. A cut off value of “65” has been found optimal for the DoloTest domain “low spirits” with a sensitivity of 78% and specificity of 95% to detect persons meeting criteria for depression, and with a predicted value on positive test at 0.74.

Pain is not included in neither the ICD-10 nor the DSM-IV criteria for depression, and it is also noteworthy that pain is not included in the most used tools for depression diagnostics like Hospital Anxiety and Depression Scale (HADS) and Beck Depression Inventory (BDI) [29] or in the Major Depression Inventory [17] (MDI) used in the present study, which increase the risk for not finding the coexistence. Both persistent pain and somatization have been found to be frequently associated with depression, yet few studies on somatization are controlled for depression [30].

4.3. Limitations and Strengths

Data is regarded representative for Denmark as the present study was conducted in a clinic serving both urban and rural areas. In Denmark, all citizens have free and equal access to primary care, as the primary care is financed through the Danish taxation system. The study has some limitations. The nature, diagnosis, or duration of pain were not recorded. All we asked for was experience in “the past week.” As expected the age distribution was statistically significantly higher in the excluded group due to the exclusion criteria cognitive and visual impairment. The scoring on both the DoloTest and MDI was made by the patients themselves and not controlled. Same physician made all diagnoses of meeting criteria for depression based on the MDI scorings; however, a depression diagnosis was not provided through interview or other further examination.

5. Conclusion

DoloTest used as a screening tool for depression criteria had a sensitivity of 78% and specificity of 95%, and a predicted value on positive test at 0.74. Patients meeting criteria for depression had statistically higher pain score and reduced Health Related Quality of Life than patients not meeting criteria for depression.

DoloTest has in this study proved an easy-to-use screening tool in clinical settings for pain and the impact of pain as well as a screening tool for patient meeting criteria for depression. This ease the process of identifying patients with the important coexistence enabling easy identification of this large group of patients needing individualized treatment for more than the pain alone in order to get best possible health related quality of life. Treating both pain and depression when co-existing is very important since it otherwise is found to be associated with risk of reduced function, reduced work capacity, increased risk of opioid misuse, and increased healthcare costs.

Conflict of Interests

K. Kristiansen is a Managing Director for EvidenceProfile ApS, P. Lyngholm-Kjærby is employed by Norpharma A/S, and C. Moe was a Scientific Consultant for EvidenceProfile ApS.

Acknowledgments

The authors want to thank to Per Bech, MD, Professor of Psychiatry, Psychiatric Research Unit, Frederiksborg General Hospital, 3400 Hilleroed for permission to use Major Depression Index (MDI) in this study. DoloTest is a Registered Trademark and protected by copyrights owned by EvidenceProfile ApS, Denmark. The authors have obtained right by EvidenceProfile ApS to use DoloTest in this study.

References

A. J. Means-Christensen, P. P. Roy-Byrne, C. D. Sherbourne, M. G. Craske, and M. B. Stein, “Relationships among pain, anxiety, and depression in primary care,” Depression and Anxiety, vol. 25, no. 7, pp. 593–600, 2008.
View at: Publisher Site | Google Scholar
K. Kroenke, “Patients presenting with somatic complaints: epidemiology, psychiatric co-morbidity and management,” International Journal of Methods in Psychiatric Research, vol. 12, no. 1, pp. 34–43, 2003.
View at: Publisher Site | Google Scholar
O. Gureje, G. E. Simon, and M. Von Korff, “A cross-national study of the course of persistent pain in primary care,” Pain, vol. 92, no. 1-2, pp. 195–200, 2001.
View at: Publisher Site | Google Scholar
M. M. Ohayon and A. F. Schatzberg, “Using chronic pain to predict depressive morbidity in the general population,” Archives of General Psychiatry, vol. 60, no. 1, pp. 39–47, 2003.
View at: Google Scholar
M. J. Bair, R. L. Robinson, G. J. Eckert, P. E. Stang, T. W. Croghan, and K. Kroenke, “Impact of pain on depression treatment response in primary care,” Psychosomatic Medicine, vol. 66, no. 1, pp. 17–22, 2004.
View at: Publisher Site | Google Scholar
W. M. Hooten, “Chronic pain and depression,” in Clinical Pain Management. Chronic Pain, chapter 18, Hodder Arnold, London, UK, 2nd edition, 2008.
View at: Google Scholar
P. Mäntyselkä, E. Kumpusalo, R. Ahonen et al., “Pain as a reason to visit the doctor: a study in Finnish primary health care,” Pain, vol. 89, no. 2-3, pp. 175–180, 2001.
View at: Publisher Site | Google Scholar
O. Gureje, “Treating chronic pain in the context of comorbid depression,” Pain, vol. 134, no. 1-2, pp. 3–4, 2008.
View at: Publisher Site | Google Scholar
L. J. Carroll, J. D. Cassidy, and P. Côté, “Depression as a risk factor for onset of an episode of troublesome neck and low back pain,” Pain, vol. 107, no. 1-2, pp. 134–139, 2004.
View at: Publisher Site | Google Scholar
L. Caballero, E. Aragonès, J. García-Campayo et al., “Prevalence, characteristics, and attribution of somatic symptoms in spanish patients with major depressive disorder seeking primary health care,” Psychosomatics, vol. 49, no. 6, pp. 520–529, 2008.
View at: Publisher Site | Google Scholar
K. D. Bertakis, R. Azari, and E. J. Callahan, “Patient pain in primary care: factors that influence physician diagnosis,” Annals of Family Medicine, vol. 2, no. 3, pp. 224–230, 2004.
View at: Publisher Site | Google Scholar
P. Mäntyselkä, E. Kumpusalo, R. Ahonen, and J. Takala, “Patients' versus general practitioners' assessments of pain intensity in primary care patients with non-cancer pain,” British Journal of General Practice, vol. 51, no. 473, pp. 995–997, 2001.
View at: Google Scholar
A. Wallerblad, J. Möller, and Y. Forsell, “Care-seeking pattern among persons with depression and anxiety: a population-based study in Sweden,” International Journal of Family Medicine, vol. 2012, Article ID 895425, 2012.
View at: Google Scholar
K. Kroenke, M. J. Bair, T. M. Damush et al., “Optimized antidepressant therapy and pain self-management in primary care patients with depression and musculoskeletal pain: a randomized controlled trial,” Journal of the American Medical Association, vol. 301, no. 20, pp. 2099–2110, 2009.
View at: Publisher Site | Google Scholar
A. Grattan, M. D. Sullivan, K. W. Saunders, C. I. Campbell, and M. R. Von Korff, “Depression and prescription opioid misuse among chronic opioid therapy recipients with no history of substance abuse,” The Annals of Family Medicine, vol. 10, no. 4, pp. 304–311, 2012.
View at: Google Scholar
K. Kristiansen, P. Lyngholm-Kjaerby, and C. Moe, “Introduction and validation of dolotest: a new health-related quality of life tool used in pain patients,” Pain Practice, vol. 10, no. 5, pp. 396–403, 2010.
View at: Publisher Site | Google Scholar
http://psykforskhil.dk/.
P. Bech, N.-A. Rasmussen, L. R. Olsen, V. Noerholm, and W. Abildgaard, “The sensitivity and specificity of the Major Depression Inventory, using the Present State Examination as the index of diagnostic validity,” Journal of Affective Disorders, vol. 66, no. 2-3, pp. 159–164, 2001.
View at: Publisher Site | Google Scholar
Consulting IS, “Pain proposal patient survey,” August-September 2010, http://www.mijnpijn.nl/pdf/PainProposalEuropeanReport.pdf.
View at: Google Scholar
J. Hasselström, J. Liu-Palmgren, and G. Rasjö-Wrååk, “Prevalence of pain in general practice,” European Journal of Pain, vol. 6, no. 5, pp. 375–385, 2002.
View at: Publisher Site | Google Scholar
K. Kroenke, J. Shen, T. E. Oxman, J. W. Williams Jr., and A. J. Dietrich, “Impact of pain on the outcomes of depression treatment: results from the RESPECT trial,” Pain, vol. 134, no. 1-2, pp. 209–215, 2008.
View at: Publisher Site | Google Scholar
M. N. Raftery, P. Ryan, C. Normand, A. W. Murphy, D. de la Harpe, and B. E. McGuire, “The economic cost of chronic noncancer pain in ireland: results from the PRIME study, part 2,” Pain, vol. 13, no. 2, pp. 139–145, 2012.
View at: Google Scholar
M. J. Gameroff and M. Olfson, “Major depressive disorder, somatic pain, and health care costs in an urban primary care practice,” Journal of Clinical Psychiatry, vol. 67, no. 8, pp. 1232–1239, 2006.
View at: Google Scholar
T. Greco, G. Eckert, and K. Kroenke, “The outcome of physical symptoms with treatment of depression,” Journal of General Internal Medicine, vol. 19, no. 8, pp. 813–818, 2004.
View at: Publisher Site | Google Scholar
M. Menchetti, M. B. Murri, K. Bertakis, B. Bortolotti, and D. Berardi, “Recognition and treatment of depression in primary care: effect of patients' presentation and frequency of consultation,” Journal of Psychosomatic Research, vol. 66, no. 4, pp. 335–341, 2009.
View at: Publisher Site | Google Scholar
N. Lees and M. Lloyd-Williams, “Assessing depression in palliative care patients using the visual analogue scale: a pilot study,” European Journal of Cancer Care, vol. 8, no. 4, pp. 220–223, 1999.
View at: Publisher Site | Google Scholar
E. P. Ahearn, “The use of visual analog scales in mood disorders: a critical review,” Journal of Psychiatric Research, vol. 31, no. 5, pp. 569–579, 1997.
View at: Publisher Site | Google Scholar
S. E. Reme and H. R. Eriksen, “Is one question enough to screen for depression?” Scandinavian Journal of Public Health, vol. 38, no. 6, pp. 618–624, 2010.
View at: Publisher Site | Google Scholar
A. Garcia-Cebrian, P. Gandhi, K. Demyttenaere, and R. Peveler, “The association ofdepression andpainful physical symptoms-a review oftheEuropean literature,” European Psychiatry, vol. 21, no. 6, pp. 379–388, 2006.
View at: Publisher Site | Google Scholar
D. A. Fishbain, J. E. Lewis, J. Gao, B. Cole, and R. Steele Rosomoff, “Is chronic pain associated with somatization/hypochondriasis? An evidence-based structured review,” Pain Practice, vol. 9, no. 6, pp. 449–467, 2009.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2012 Kim Kristiansen et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

2316

Downloads

503

Citations