- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Rehabilitation Research and Practice
Volume 2013 (2013), Article ID 649875, 15 pages
Healing Pathways: A Program for Women with Physical Disabilities and Depression
1School of Nursing, Oregon Health & Science University, 3455 SW US Veteran’s Hospital Road, Portland, OR 97239, USA
2School of Public Health and Preventive Medicine, Oregon Health & Science University, 3181 SW Sam Jackson Park Road, CB 669, USA
3Regional Research Institute, Portland State University, 600 SW 4th Avenue, Suite 900, Portland, OR 97201, USA
Received 20 December 2012; Revised 7 April 2013; Accepted 10 April 2013
Academic Editor: Francois Prince
Copyright © 2013 Dena Hassouneh et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Objective. The objective of this study was to test the efficacy of the Healing Pathways (HP) program in reducing clinically significantly depressive symptoms in women with physical disabilities (WPD). Healing Pathways is a peer-implemented group mental health treatment program targeting WPD who have clinically significant cooccurring depressive symptoms. Participants. Eighty women were randomized in this trial. Design. This study used a community-based participatory intervention research design. Using community-based recruiting methods, participants were recruited from Centers for Independent Living, local disability service organizations, via Craig's list as well as other community locations such as grocery stores and bus stops. Women participated in the HP program for 14 weeks. Results. The primary outcome variable for this study was reduction in depressive symptoms as measured by the Center for Epidemiologic Depression Scale (CES-D). We found that there was a significant interaction effect of treatment by time on depression scores, F(3,210) = 9.51, , partial . Investigation of the predicted mean profile over time in the intervention group demonstrated that depression scores decreased greatly from baseline to the first posttest and remained stable in the two followups, whereas there was a little change in the mean profile over time in the control group. Conclusion. The HP program has demonstrated initial efficacy in reducing depressive symptoms in women with physical disabilities.
Women are at least twice as likely as men to experience a major depressive episode once in their lifetimes and approximately 70% of the prescriptions written for antidepressants are given to women . The reasons for gender disparities in depression rates include the influence of sex hormones, and the incidence of serious adverse life events such as childhood and adult sexual abuse and male partner violence [2, 3]. Even in the absence of physical disability, depression significantly impairs women’s social and physical functioning [1, 2]. Because many women with physical disabilities (WPD) have poorer health than nonphysically disabled women, they often have fewer reserves to compensate for depressive symptoms [4–6]. Thus, when depression and physical disability cooccur, the effects are usually most severe.
Depression negatively affects almost every conceivable outcome for women with physical disabilities (WPD), from physical health and functioning to employment, quality of life, and mortality [7–15]. This is alarming since women with physical disabilities WPD experience clinically significant depressive symptoms at high rates and may face barriers to accessing needed care. In a study of 443 WPD, Hughes and colleagues found that 51% of the sample had scores signifying mild depression or higher on the Beck Depression Inventory (BDI) [4, 16]. Of those women who were depressed, only 44% had been able to access treatment within the past three months . In a second study of 64 women living with spinal cord injury for at least two years, Hughes and colleagues found that 59.1% of women had clinically significant depressive symptoms as measured by the Center for Epidemiologic Studies Depression Scale (CES-D) [7, 17]. In our study of abuse and health in men and women with spinal cord injury or dysfunction, 53% of our sample of 165 women had clinically significant depressive symptoms as measured by the CES-D .
Consistent with findings cited above, Hughes and colleagues study of 134 depressed WPD found that more than a third of the women had received no treatment for depression within the past three months . Barriers to accessing mental health care that WPD may face include physical illness, transportation, accessibility, and poverty . Another important barrier is the lack of mental health treatment programs available that address the experience of cooccurring physical disability and depression. Although a small number of programs focus on depression as a primary outcome [20–25], we found only one published paper describing a program that builds on WPD’s shared experiences and the strengths of disability communities .
Although WPD are a diverse group, there are some common variables of interest that are associated with depressive symptoms. Coping and health behaviors have been widely cited as important constructs for WPD in terms of their overall health and well-being and the prevention and amelioration of secondary conditions like depression [5, 26–29]. Active coping , spirituality, interpersonal relations, and stress management in particular have been mentioned . Self-esteem both as a global construct and specific to a woman’s body and sexuality have also been identified as important for understanding depressive symptoms. According to Hughes and colleagues, “lowered self-esteem is a common feature of depression” in WPD [30, page 296]. In their study to determine the efficacy of a 6-week self-esteem group intervention for WPD, they found that self-esteem mediated the effect of the intervention on depression . In a study of body and sexual self-esteem, Taleporos and McCabe sampled 1196 participants including 748 persons with physical disabilities and 448 persons without physical disabilities . They found that sexual and body esteem were strong predictors of self-esteem and depression in people with physical disabilities and that this effect was stronger among people with disabilities than in people without disabilities. Loneliness or social participation has also been identified as an important variable related to depression in WPD [32, 33]. In a study of the relevance of depressive symptoms and social support to disability in women with multiple sclerosis and fibromyalgia , Phillips and Stuifbergen found that social support had a large protective effect on depressive symptoms . The authors noted that interventions that promote social connection may particularly be important for WPD.
To help address the serious problem of depression in WPD, to expand available treatment options, and to increase access to affordable treatment we developed and tested the Healing Pathways program using a community-based participatory research design (CBPR). Healing Pathways (HP) is a cross-disability peer implemented strengths-based cognitive behavioral group treatment program. To assess the efficacy of the HP program we conducted a study in partnership with three grass roots consumer-run disability service agencies. The purpose of CBPR is to engage researchers and community members as equal partners to create knowledge that is directly applicable and available to communities, especially those who have historically experienced social and economic marginalization [34, 35]. Our academic-community partnership grew out of ten years of community-placed work and one previous CBPR project. Guiding principles of our collaboration included accessibility to all aspects of the projects across physical disability types and collaborative development of interventions that enable community control over future implementation. See Hassouneh et al.  for more information about the HP partnership and the CBPR methodology employed.
2. Study Aims
The aims of the study were to (1) modify an existing group therapy intervention to address the specific needs of WPD who experience depressive symptoms  and to (2) conduct an efficacy trial of the modified intervention. We hypothesized that WPD receiving the HP program would demonstrate greater improvement in our primary outcome variable depressive symptoms than WPD in the wait-list control group. We also hypothesized that WPD receiving the HP program would demonstrate greater improvement in our secondary outcome variables, coping, health behavior, global self-esteem, body image and sexual self-esteem, and loneliness, compared to WPD in the wait-list control group. Finally we asked the following research question: what are the relative contributions of changes in coping, health behavior, global self-esteem, body image and sexual self-esteem, and loneliness to changes in depressive symptoms?
We screened a total of 101 women and enrolled 89 WPD of age 19–81. Nine women were ineligible and three declined to enroll. Of the 89 WPD enrolled we randomized 80; 44 were assigned to the intervention group and 36 to the wait-list control group. Nine women dropped out prior to the time when randomization occurred due to reasons of illness and moving away. We assessed depressive symptom scores during the initial screening interview using the CES-D. Inclusion criteria for study enrollment included (1) self-reported physical disability requiring some form of disability accommodation and support; and (2) a CES-D score of 16 or higher at the time of enrollment. Exclusion criteria included (1) significant self-reported intellectual disability and/or receipt of developmental disability services; (2) active suicidality; (3) current receipt of other psychotherapy services; and (4) current psychosis. Significant self-reported intellectual disability was ascertained by asking the following two questions: (1) do you have a guardian? and (2) are you receiving development disability services for a cognitive disability? These criteria allowed for inclusion of a wide variety of WPD often with multiple cooccurring conditions. All participants enrolled in the study who completed baseline data were included in the analysis.
The demographic and disability-related characteristics of the participants are presented in Table 1. As presented in the table the majority of participants were European-American (75.95%), employed (73.42%), and single (70.51%) with a household income of less than $20,000 per year (81.01%). With regard to disability 64.63% reported having arthritis or other musculoskeletal disorders, 29.27% reported having a neurological disorder, and 43.9% reported having some other kind of condition. The majority of participants rated their disabilities as moderate (40.51%) or severe (56.76%). Ninety percent of participants reported receiving assistance from others to help them with activities they would normally be able to do themselves if they did not have a disability.
3.2. Description of the HP Program
The HP program is a manualized strengths-based cognitive behavioral group therapy program designed to be implemented by two peers. Program materials include a women’s workbook and a facilitator manual. The final version of the program includes 14 sessions each of 2.5 hours in length. The PI assumed primary responsibility for development of the HP program in collaboration with WPD from Oregon disability communities over the course of two CBPR projects . Development of the HP program was informed by a complete literature review, a series of focus groups, input from an advisory board, and written contributions from WPD community members. The HP program promotes self-empowerment through skill building in four core areas (1) identifying and addressing thoughts and beliefs; (2) identifying and managing emotions; (3) improving interpersonal skills; and (4) developing and strengthening coping and problem-solving skills. The principles underlying cognitive behavioral therapy and strengths-based approaches to promoting healing and personal growth are woven throughout each of these areas and the entire program. Healing Pathways session topics include: (1) introduction to the program and overview of depression in WPD; (2) strengths and goals; (3) mental habits; (4) understanding and managing emotions; (5) sense of self (includes optional content on body image and sexuality); (6) personal identity and role models; (7) violence and abuse; (8) relationships, social support, and physical disability; (9) developing communication skills; (10) stress and coping; (11) wellness; and (12) moving forward.
3.3.1. Selection of Sites
There were two urban and two rural partners in this project. Our originally urban HP partnership evolved primarily from preexisting partnerships that had developed over time through work on a previously completed community-based participatory research project as well as other community-placed research projects. We added rural partners to broaden the impact of our findings. Characteristics sought among partners were commitment to Independent Living Philosophy, a track record of reliability, and commitment to the goals of the project. Community buy-in was also assessed as part of the selection process through a series of meetings with local leaders. Existing team leaders met to discuss potential new partners and selection decisions were made by consensus.
3.3.2. Team Training
We provided a 10-day face-to-face training that included all components necessary for completing the project. Team members attended only those components of the training that were relevant to their roles. All team members received training on research ethics, the importance of confidentiality of participants and data, safety, and guidelines for recruiting.
Community partners identified two WPD peer facilitators who would be trained to implement HP groups. In addition to the 10-day face-to-face training series we also provided additional site specific face-to-face and telephone training support as needed as part of peer facilitator training. Training specific to implementation of groups included the following areas: understanding depression and anxiety; crisis intervention; suicide assessment and intervention; violence and abuse assessment and intervention; and responding to trauma. Peer facilitators also learned about the concept of fidelity and reviewed study procedures for facilitator adherence and competence. Methods of training included instructional videos, self-paced readings, and face-to-face training with mock sessions and role plays. Training was provided by persons from the disability community with recognized expertise in specific areas as well as by Psychiatric Mental Health Nurse Practitioners.
Each community partner identified two to three data collectors to conduct the screening and enrollments and complete data collection interviews. These team members received training guidelines for how to screen and enroll participants including informed consent procedures. Team members demonstrated proficiency conducting three mock screening and enrollment interviews prior to starting actual data collection. We reviewed and practiced safety protocols in detail, often using role play scenarios. We also reviewed protocols related to maintaining follow-up contact with participants in-between time points. Participants who required additional support were provided with one-on-one tutoring until they mastered all content.
3.3.3. Supervision of Lay Leaders
Peer facilitators received clinical supervision as a group for two hours each week with a highly experienced doctorally prepared Psychiatric Mental Health Nurse Practitioner throughout the duration of the intervention period. This clinical supervisor was also available for additional consults as needed throughout the week. In addition, the PI, also a Psychiatric Mental Health Nurse Practitioner, was available for emergency consults seven days a week.
3.3.4. Research Fidelity
We developed tools for measuring intervention fidelity for use specific to this project. These tools included (1) a session specific adherence checklist which included a time measurement index for core elements in each session and (2) a facilitator competence measure. We developed session specific adherence checklists by mapping activities from the facilitator manual. To develop the facilitator competence measure we conducted a literature search for the purpose of identifying existing reliable and valid competence measures. Once we had identified measures with the greatest applicability to the HP curriculum we then adapted items from these existing scales to create the Healing Pathways facilitator competence measure. Next, we pilot tested the competence measure using two independent coders who coded three audio recorded practice sessions. To assess the fidelity of actual group sessions we randomly selected groups for coding each week of the 14-week program. Two independent coders listened to audio recordings of these sessions. Coding was subsequently discussed with the PI. In addition, to elicit qualitative data relevant to intervention fidelity and quality, we asked both coders and group facilitators to complete a narrative for each session. While relevant to intervention fidelity, we used this qualitative information primarily as a means of assessing the quality of sessions, thereby providing a feedback loop for quality improvement. Using these methods of measurement we implemented the HP program with a facilitator adherence of 87% and competence of 2.79 (3 point scale, 3 = most, and 1 = least competent).
All study activities and procedures were approved by the University Internal Review Board. We also obtained a Certificate of Confidentiality from the Department of Health and Human Services to provide additional protection to participants. We used detailed protocols to ensure the safety of participants including protocols addressing suicidal ideation and violence and abuse. All collaborating partners recruited participants for the study using a variety of strategies. We used a flier describing the study and its target population of “women with physical disabilities who have depressive symptoms” as part of our recruitment efforts. Thus, participants who responded to the fliers self-selected based on their perception of themselves as women who experienced both physical disability and depression. Our recruitment strategies included a direct mailing via a durable medical equipment mailing list, advertisements on Craig’s List, and active community recruiting at places such as grocery stores, bus stops, and local disability interest groups including the Multiple Sclerosis Society and United Cerebral Palsy.
In addition to recruiting, each collaborating partner was involved in screening and enrolling participants for the study. We used a two-step informed consent process at screening and enrollment interviews. First we obtained consent for screening and completed screenings. We then obtained consent for enrollment and completed enrollment interviews for those women who were deemed eligible and wanted to participate. Screening and enrollments took place either at the local community partner offices or at a location of the participants’ choosing.
After recruitment, screening and enrollment processes were completed we randomized participants to the intervention or a wait-list control group. We used SPSS as the method of random assignment. The wait-list control group was smaller than the initial group to minimize the number of women who would have to wait for receipt of mental health services as a result of study participation. Women were notified of their random assignment by the same team member who had conducted their screening interviews either in person or over the phone.
3.3.6. Data Collection
We used face-to-face interviews to collect data. Instruments were completed by interviewers who had participated in the aforementioned 10-day training. Participants randomized to the initial treatment group participated in data collection interviews for time points 1–4. During this same time period participants randomized to the wait-list control group completed identical pre- and posttests without participating in the intervention. Participants randomized to the wait-list control group then participated in a different version of the HP program and participated in an additional three data collection time points (time points 5–7). Because we tested two different versions of the program, we have chosen not to combine the results. Therefore we report on time points 1–4 here. Accordingly for the purposes of this paper the wait-list control group is hereafter referred to simply as the control group. The four time points reported on here include the pretest (time point 1), a posttest conducted immediately upon completion of the HP program (time point 2), six-week postintervention (time point 3), and three-month postintervention (time point 4).
4. Outcomes and Measures
All outcome variables and covariates were derived primarily from discussions among the HP partners and a review of empiric literature. We selected our measures and the specific subscales used from those measures based on the goals and outcomes of the HP program including the skill-building focus of the four core areas described above. Our primary outcome measure of depressive symptoms, our secondary outcome measures of coping, health behavior, global self-esteem, body and sexual-self-esteem, and loneliness, and our measures of covariates are described below.
4.1. Depressive Symptoms
We measured our primary outcome variable of depressive symptoms using the Center for Epidemiologic Depression Scale (CES-D). The CES-D is a 20-item measure that assesses mood during the past week using a 4-point Likert scale ranging from 0 = rarely or none (less than a day) to 3 = most or all of the time (5 days). Four of the 20 items are reverse scored, and the total measure is scored by summing all items. A score of 16 or greater signals possible depression. The CES-D has demonstrated excellent reliability with Cronbach’s alphas ranging from 0.85 in community samples to 0.90 in psychiatric samples . In a previous study we conducted with 165 WPD we used the CES-D and obtained a Cronbach’s alpha of 0.92 .
We measured coping using selected sub-scales of the Brief COPE. The Brief COPE contains 30 items to assess a broad range of coping and problem-solving responses with 14 two-item sub-scales. The inventory includes some responses that are expected to be dysfunctional, as well as some that are expected to be functional. We selected six of the 14 sub-scales for use based on their relevance to HP program core skill areas. These include substance abuse, emotional support, positive reframing, self-blame, active coping, and instrumental support. The COPE has been used in previous studies with WPD [29, 40] as well as with depressed women . For each item, the respondent is asked to indicate the frequency of each behavior/thought process, ranging from 1 = I usually do not do this at all to 4 = I usually do this a lot. The subscales are scored using the mean of 4 items. Cronbach’s alphas for COPE subscales range from 0.63 to 0.80 .
4.3. Health Behavior
We measured health behavior using the Health Promoting Lifestyle Profile II (HPLP-II). The HPLP-II is a 52-item global measure of health behavior. It contains six subscales. We selected three of the six sub-scales for use based on their relevance to HP program core skills areas including spirituality, interpersonal relations, and stress management. For each item, the respondent indicates the frequency of each behavior ranging from for never (=1) to for routinely (=4). Scoring uses the mean of items on each subscale. Cronbach’s alphas on HPLP-II subscales range from 0.69 to 0.86 [42, 43].
4.4. Rosenberg Self-Esteem Scale
We measured global self-esteem using the Rosenberg Self-Esteem Scale (RSES). The RSES is a 10-item measure of one’s overall evaluation of the self. The measure uses a 4-point Likert scale ranging from 3 = strongly agree to 0 = strongly disagree. The total measure is scored by summing all items The RSES has been used with WPD in other studies with Cronbach’s alphas reported from 0.70 to 0.90 .
4.5. Body and Sexual Self-Esteem
We measured body and sexual self-esteem using the Physical Disability Sexual and body Esteem Scale (PDBSE). The PDBSE is a 10-item measure of the capacity to feel positive about one’s sexuality and body while living with a physical disability [31, 44]. The measure uses a 4-point Likert scale ranging from 1 = strongly agree to 4 = strongly disagree. The total measure is scored by summing all items. In our previous study with 165 WPD, we obtained a Cronbach’s alpha of 0.90 .
We measured loneliness using the UCLA Loneliness scale-Version 3 (UCLA-LS). The UCLA-LS is a 20-item scale that measures levels of loneliness in everyday life. It includes 9 positive (nonlonely) and 11 negative (lonely) items, randomly distributed throughout the instrument. Participants rate each item on a 4-point Likert scale ranging from 1 = never to 4 = always. The UCLA-LS has previously been used successfully with WPD and women with depression . Nine of the items are worded positively and reversed scored. The total measure is scored by summing all items. Cronbach’s alpha for the scale range from 0.89 to 0.94 [46, 47].
5. Measurement of Covariates
Several studies have identified significant relationships among pain, fatigue, and depressive symptoms in a variety of populations. Specifically, it has been observed that severity of depressive symptoms varies in proportion to the level of pain and/or fatigue experienced [48–52]. Despite the well-established associations between pain, fatigue, and depressive symptoms, it is not clearly understood how these variables interact with physical disability [50, 52]. Substance abuse (as an identified problem rather than as a coping style) has also been shown to be both common in people with disabilities  and associated with depression [54, 55]. Because these variables could potentially influence depressive symptoms in WPD, we included them in our analysis as covariates. Other covariates include age group, socioeconomic status (SES), and physical dependency. We used a demographic questionnaire to collect data on age and SES. The remaining measures are described below.
5.1. Physical Dependency
We measured physical dependency using the Stanford Health Assessment Questionnaire (HAQ). The HAQ is an 8-item measure of ability . Participants are asked to rate each item on a 4-point Likert scale ranging from 0 = without difficulty to 3 = unable to do. The measure is scored using the mean of 8 items. In our previous study with 165 WPD we obtained a Cronbach’s alpha of 0.92 .
5.2. Substance Abuse
We measured substance abuse using the CAGE-AID. The CAGE-AID is a 4-item screening measure that has been used with WPD and depressed women in numerous studies . The CAGE-AID screens for alcohol or drug problems based on the CAGE alcohol screen. Respondents are asked to answer 1 = yes and 0 = no to four questions. The CAGE-AID is scored by counting the number of items answered yes. Score of 1 = possible problem and 2 = probable problem. The CAGE-AID has exhibited strong sensitivity and specificity, ranging from 60 to 95% and from 40 to 95%, respectively [57, 58].
5.3. Pain and Fatigue
To assess pain and fatigue we used verbal rating scales (VRS) of which have been used extensively in clinical practice and research with WPD [59–63]. Participants were asked “On a 0 to 10 scale, where “0” equals no fatigue and “10” equals the worst fatigue imaginable, how severe has fatigue been, on average, during the past week?” The same approach scale was used to assess pain. The VRS for fatigue’s test-retest reliability is strong (0.93). Cronbach’s alpha of the VRS for pain is 0.88 .
5.4. Statistical Analysis
We used SPSS 16.0 and SAS 9.2.2 to conduct our statistical analyses. We computed means, standard deviations, and frequencies for numerical and categorical variables. At the baseline, we perform the comparison for the group difference using Chi-square/Fisher’s Exact test (for qualitative variables and two independent sample t-test/Wilcoxon Rank Sum test (for quantitative variables) when appropriated. To test hypothesis (1) WPD receiving the intervention will demonstrate a greater improvement in depressive symptom scores compared to participants in the control group, we used a mixed effects model in which the outcome of interest is the depressive symptom score, the two fixed-effects are group treatment effect with two levels (intervention versus control), and the time effect has four levels (baseline, posttest, 6-week followup, and 3-month followup). Subject specificity served as a random effect in this model. An interaction treatment-by-time effect was examined to test if the intervention improved the outcome of depressive symptoms. Similarly, to test hypothesis (2) WPD receiving the intervention will demonstrate a greater improvement in coping, health behavior, global self-esteem, body image and sexual self-esteem, and loneliness compared to participants in the control group, we used a mixed effects model on these secondary outcomes. Significant group-by-time interactions, such that the intervention group exhibited significant improvement in the secondary outcomes compared to the control group would provide support for hypothesis 2.
To address the research question: What are the relative contributions of changes in coping, health behavior, global self-esteem, body image and sexual self-esteem, and loneliness to changes in depressive symptoms? we applied a mixed effects model in which the depressive symptom score is the outcome of interest, and each secondary outcome served as a primary predictor. We also included the group treatment, time, and the interaction treatment-by-time in the model as adjusting factors while examining the association. Those secondary outcomes having a significant association with depressive symptom scores were included in the multivariable model for association testing. If slope testing for each of these secondary outcomes was significant, an association between the change in that particular secondary outcome and change in depressive symptoms was established. We also included age and SES in the model as adjusting covariates/factors. We then compared the standardized estimates (slope coefficient estimates) for each significant slope parameter to determine the relative strength of the secondary outcomes in predicting changes in depressive symptoms.
We conducted a per protocol (PP) analysis using mixed-design ANOVAs with complete data, and an intent-to-treat (ITT) analysis using hierarchical linear modeling (HLM). We found ITT provided us with greater power, for example, smaller values. In addition, with ITT, we examined linear and quadratic terms of time effect and found that the quadratic model did not capture the time effect, for example, values > .05. In fact, we studied the overall (mean) trajectories over time of the outcomes of interest and found that the quadratic curve was not supportive. Taking all these observations into account, to maximize all available data, our analysis addressing aims 1 and 2, and research question 1 is based on a mixed effects model. To our knowledge, this statistical method has been widely used in longitudinal studies for the last several decades. The advantage of this method is its flexibility in dealing with missing values; a missing observation does not cause the deletion of other observations from the same subject in the analysis. Thus, we made use of all available data, capturing greater statistical power for hypothesis testing.
Because mixed effects modeling is based on a maximum likelihood approach, the quantity of sum of squares due to each effect or error cannot be obtained. As such it is not possible to compute partial as an effect size measure with this approach. Therefore to compute the effect size, we used a general mixed ANOVA model. In sequence, this statistical method was applied to each aim and research question discussed in detail below. The level of significance of an effect was tested at an alpha of 0.05. If the value of a test was between 0.05 and 0.1, we considered that the effect had a trend toward significance. Because we used a mixed effects model in which a missing value of one observation does not cause the deletion of the observed data of the related-subject from the analysis and we had very few missing values, it was not necessary to use an imputation technique.
Our group retention rate was 81% overall, more specifically 95% in the intervention group; 67% in the control group. We examined the distributions of age for each group, and the assumption of normality was reasonably met. The means and standard deviations were for the intervention and for the control group. We performed a two independent sample t-test as the comparison between the two groups; there was no significant difference in age between the intervention and control groups (). Participants’ age ranges were 28–80 and 19–71 in the intervention and control groups, respectively. We used income as a proxy for SES. To compare the distributions in SES between groups, we subgrouped the number of categories to 3; specifically, we kept the first two categories $0–$10,000 and $10,000–$20,000 and created a new category for those whose salary was greater than $20,000. We performed a Chi-square test as the comparison between the two groups; there was no significant difference in SES between the intervention and control groups (). With regard to ethnicity, 75% (33/44) versus 77.14% (27/35) of the intervention versus the control group, respectively, were European-American; there was no significant difference between the two groups . We also conducted further comparisons between the two groups on the other characteristics/covariates, that is, education (); employment (); marital status ; disability severity (); and receiving assistance from others (). Finally, 71% and 56% of participants in the intervention and control groups, respectively, reported arthritis or musculoskeletal disorders (), 24% and 35% reported neurological disorders (), and 45% and 40% reported other conditions as their disability types (). In summary, there was no statistical significant difference in demographic and disability characteristics between the intervention and control groups. See Table 1 for more details.
We checked the range of values for the other variables and found them to be in the reasonable range. Since the data of our primary outcome (depressive symptoms), secondary outcomes (coping sub-scales (substance abuse, emotional support, positive reframing, self-blame, active coping, instrumental support), health behavior sub-scales (spirituality, interpersonal relations and stress management), global self-esteem, body image and sexual-self-esteem, and loneliness), and other covariates (physical dependency, substance abuse problem, and pain and fatigue) were collected over time, the distributions of each measure at each time point were studied and are summarized in Tables 2(a) and 2(b). We also performed a comparison between the two groups on the primary outcome, depressive symptoms, at baseline and found a significant difference . As shown in Tables 2(a) and 2(b), the (mean ± sd) of depressive score of the two groups at the pretest are 1.71 ± 0.52 versus 1.37 ± 0.5 for the intervention versus control group, respectively. These mean scores indicate, on average, that the intervention group had more severe depression (higher mean score) at baseline. However, the situation was reversed at the final post-test; that is, the depressive score was lower in the intervention group (1.08 ± 0.64) compared to the control group (1.38 ± 0.5). This observation was confirmed with our testing for the interaction between time and group treatment on the depression measure outcome (see below).
Examination of the predicted mean curves over time between the intervention and control groups suggests that interaction effects occurred in depressive symptom score, loneliness, body image and sexual self-esteem, substance use, stress management, interpersonal relations, spirituality, emotional support, positive reframing, and self-blame. We did not identify interaction effects in active coping, instrumental support and global self-esteem (see Figure 1). These suggestions were confirmed by testing for interaction terms between time and group treatment as shown in Table 3. Furthermore, in Figure 1, in the intervention group, we saw a sharp increase/decrease from the pre-test (Time 0) to post-test (Time 1) and that this pattern was either continued or stabilized at three-month followup (Time 4). This kind of pattern occurred in most scales that showed the existence of the aforementioned interaction. On the other hand, in the control group, most mean curves were either flat or unstable over time. Please see Figure 1 for information on the mean curves on covariates, for example, physical dependency, substance abuse, and pain and fatigue.
From Table 3, we found that there was a significant interaction effect of treatment by time on depression symptoms scores (), indicating the efficacy of the intervention program. Furthermore, the plot for depression symptoms scores in Figure 1 shows a sharp decrease from the pretest to posttest and that is stabilized at three-month followup in the intervention group. On the other hand, the mean curve is flat over time in the control group. For coping skills,we found a series of significant treatment-by-time interaction effects: substance use (); emotional support (); positive reframing (); andself-blame (). We did not find enough evidence to support hypothesis 2 on active coping () and instrumental support (), respectively. For health behavior, we found significant interaction treatment-by-time effects on all three selected sub-scales as follows: spirituality (); interpersonal relations (); and stress management (). We also found strong support for hypothesis 2 on loneliness when testing the interaction treatment-by-time effect (). Testing of the interaction treatment-by-time effect for body image and sexual self-esteem also indicated a significant interaction (). However, testing of the interaction treatment-by-time effect for global self-esteem () indicated that the interaction effect was insignificant (see Table 3).
Regarding the effect size difference between the groups, overall, depressive symptom score, loneliness, and spirituality were strong, ranging from 0.1 to 0.16; interpersonal relations, self-blame, positive reframing and emotional support were fairly strong, ranging from 0.06 to 0.09; substance use, stress management, and body image and sexual self-esteem were moderate, ranging from 0.04 to 0.05; and active coping, instrumental support, and global self-esteem were fairly weak, ranging from 0.01 to 0.025 (see Table 3).
We also investigated the covariates—physical dependency, substance abuse problem, and pain and fatigue. We found that substance abuse and the fatigue scales were significant, and thus we included them in the multivariable model for association analysis (see below).
When examining the associated effects of each secondary outcome on the depression symptom score, the slope testing results showed that five of six selected coping sub-scales were significantly associated with changes in depressive symptom scores: substance use [, , partial ]; emotional support [, , partial ]; instrumental support [, , partial ]; positive reframing [, , partial ]; and self-blame [, , partial ]. Active coping was insignificantly associated with changes in depressive scores [, , partial ]. We also found that all three of the selected sub-scales in health behavior were significantly associated with the changes in depressive symptom scores: spirituality [, , partial ]; interpersonal relations [, , partial ]; and stress management [, , partial ]. Furthermore, loneliness was strongly associated with the changes in depressive symptom scores, its slope testing has [, , partial ]; as has body image and sexual self-esteem [, , partial ]. Global self-esteem was barely significantly associated with the changes in depressive scores, and its slope testing has [, , partial ].
The results of the multivariable model which includes eleven secondary outcomes that are singly significantly associated with the primary outcome of depressive symptoms indicate that seven variables remained significant model. We found loneliness to be the strongest in contributing to changes in the outcome of depressive symptoms with a positive association, its standardized estimate of 0.3827. This means that for every 1 point increase in loneliness, we would expect to see a 0.38 increase in the depressive symptom score. Interpersonal relations came in as the second strongest with a positive association, its standardized estimate of 0.3377. With this unexpected finding we found that for every 1 point score increase in interpersonal relations there was roughly a 0.34 score increase in the depression symptom score. The third largest contributor was spirituality with a negative association, its standardized estimate of −0.2799. For every 1 point increase in spirituality, we would expect to see a 0.28 score decrease in the depression score. Emotional support and self-blame came in fourth and fifth, with their negative/positive association, the standardized estimates of −0.135 and 0.144, respectively. Their interpretations were opposite; for every 1 point increase in emotional support, we would expect roughly a 0.14 score decrease in the depression symptom score, and for every 1 point increase in self-blame we would expect roughly a 0.14 score increase in the depression symptom score. Sixth was positive reframing with a negative association, its standardized estimate of −0.077. Every 1 point increase in positive reframing contributed roughly a 0.077 decrease to the depression score. Seventh was substance use with a fairly weak association, its standardized estimate of 0.07. Every 1 point increase in substance use contributed roughly a 0.07 score increase to the depression score.
6.1. Postprogram Focus Group Feedback
We conducted focus groups at the end of the 14-week program with each therapy group. We asked participants to evaluate the program in terms of content, process, and outcomes. With regard to content all of the programmatic content was viewed as important; however, it was suggested that content related to sexuality be made optional. Process feedback strongly suggested that women in the groups wanted more time for personal sharing during each session and that overall there was a belief that a 14-week program was too short to adequately cover all important topics. Finally, we received overwhelmingly strong and positive feedback about the quality of the program and the transformative impact it had had on women’s lives. Women made many positive changes during the program including leaving abusive relationships, expanding their social networks, and achieving gainful employment.
Depression in WPD is a common problem; that is, associated with significant morbidity and mortality. Although several nonpharmacologic treatments for depression are available, we are unaware of any that specifically address the psychosocial issues faced by WPD cross-disability. The HP program offers a novel approach to addressing depression in WPD as a cooccurring condition that draws on both mental health theories and peer empowerment approaches to treatment.
Despite randomization we found differences at baseline on many variables between the intervention and control groups including a statistically significant difference in depressive symptoms with the treatment group having higher depressive symptom scores. This is a limitation of our study. Despite this limitation our findings provide initial support for the HP program’s efficacy in treating depressive symptoms as well as improvements in selected secondary outcomes of coping (substance use, emotional support, positive reframing, self-blame), health behavior (spirituality, stress management), self-esteem (body and sexual), and loneliness, all important for WPD. In addition, the pattern of results suggests that HP’s four core skill areas may explain these outcomes. Identifying and addressing thoughts and beliefs and identifying and managing emotions (the first two skill areas) are foundational skills to improving interpersonal skills and developing and strengthening coping and problem-solving skills (the last two skill areas). It is these latter two skill areas that are manifested most clearly in the associations between our coping, health behavior, body and sexual self-esteem, and loneliness variables and our outcome variable of depressive symptoms. Interpersonal skills can be said to correspond to the variables emotional support and loneliness while coping and problem-solving can be said to correspond to the variables substance abuse, positive reframing, self-blame, spirituality, and stress management.
Three variables were insignificant including active and instrumental coping and global self-esteem. Active coping was not significantly associated with an improvement in depressive symptom scores suggesting that it may lack relevance to the primary outcome of depressive symptoms. Similarly, instrumental coping although singly significantly associated with an improvement in depressive symptoms scores proved insignificant in the multivariate model suggesting it may also lack relevance to the primary outcome when other associated effects are considered jointly. Another possible consideration is the impact of the use of acceptance as a coping strategy. Examination of active and instrumental coping items points to active change efforts, forgoing the possibility of acceptance as a coping strategy (i.e., “doing something about the situation” (active coping) and “getting help and advice from other people” (Instrumental coping). It is possible that acceptance, which was taught as a part of the managing emotions portion of HP, was used by participants as a balancing strategy along with more active strategies resulting in a dilution of the strength of active and instrumental coping approaches. With regard to global self-esteem, improvement in this secondary outcome in the intervention group coupled with the lack of significance suggests that this program element needs strengthening. Focus group participant feedback suggested that a longer program allowing for more in-depth exploration of content would be stronger. This may be an example of program content that was not covered in sufficient depth.
In response to the troubling finding that the Interpersonal Relations sub-scale of the Health Promoting Lifestyle Profile II was both significantly improved and associated with an increase in depressive symptom scores we examined the items and the pattern of responses of this scale. In doing so we found that participants in the intervention group strongly improved relative to the control group on every item. Although some of the items seem to be unarguably positive (e.g., “maintaining meaningful and fulfilling relationships with others), others were not necessarily so. For example, “discuss my problems and concerns with people close to me” may be positive in some instances but not in others. Discussing problems with others repeatedly without movement or change could be a sign of dependency. Similarly, discussing problems with others who are close to you but not very supportive could prove detrimental. Therefore some of the items on the interpersonal relations sub-scale, although in theory measuring positive health behaviors, may not be always positive. This may explain at least in part why the improvement in interpersonal relations was associated with an increase in depressive symptoms.
In addition to statistically significant results we also observed significant changes in women’s lives during our study. Following study completion, participants in one rural town subsequently went on to establish a mental health drop-in center. Others started their own HP groups. Although we did not formally measure changes in employment, anecdotally, we also observed that many women who were experiencing challenges staying employed reported positive changes in sustaining employment. One woman started her own business. Others sought gainful and meaningful employment. Word of this effect eventually led to establishment of a contract with Oregon Vocational Rehabilitation for services to unemployed WPD with cooccurring depression. We developed an untested employment version of the HP program for this purpose. Depression and employment outcomes of the first year of that program look promising. Of the 14 WPD who completed exit interviews a mean 15.6 point drop in CES-D scores was observed. In addition, of those 14 chronically unemployed women, 8 obtained employment suggesting that testing of the employment version of the HP program may be appropriate at some point in the future. In addition to this employment version, the original HP program (described in this paper) continues to be offered to WPD with cooccurring depression in two Oregon communities.
In addition to our work with the original HP program, we are currently engaged in work developing a HP peer facilitator training program to standardize the preparation of peers trained to implement the program using CBPR principles. It is our hope to disseminate the HP program to expand treatment options for WPD with cooccurring depression and in particular to increase options for treatment within disability communities. This approach is consistent with the RE-AIM framework, a model intended to enhance the quality, speed, and public health impact of efforts to translate research into practice in five steps including reaching your intended target population, demonstrating efficacy, adoption by target settings or institutions, implementation (i.e., consistency of delivery of intervention), and maintenance of intervention effects in individuals and settings over time . We are currently focused on the adoption and implementation components of the model.
In conclusion, our study provides support for the efficacy of the HP program in addressing depressive symptoms in WPD and some selected secondary outcomes. Because it is specifically designed for WPD, the HP program has potential to provide WPD with an alternative treatment option for depressive symptoms, that is, culturally relevant and accessible. We hope that disability service organizations, WPD community groups, and rehabilitation counselors find this freely available program useful to their work.
This project was supported by funding from the National Institute of Mental Health 1R01MH079818 and the National Institute of Disability and Rehabilitation Research H133G060135 and H133G110083.
- American Psychological Association, “Women and depression briefing sheet,” 2013, http://www.apa.org/about/gr/issues/women/depression.aspx.
- C. M. Mazure, G. P. Keita, and M. C. Blehar, Summit on Women and Depression—Proceedings and Recommendations, American Psychological Association, Washington, DC, USA, 2002, http://www.apa.org/pi/women/programs/depression/summit-2002.pdf.
- National Institute of Mental Health, “What causes depression in women?” 2009, http://www.nimh.nih.gov/health/publications/women-and-depression-discovering-hope/what-causes-depression-in-women.shtml.
- R. B. Hughes, S. Robinson-Whelen, H. B. Taylor, N. J. Petersen, and M. A. Nosek, “Characteristics of depressed and nondepressed women with physical disabilities,” Archives of Physical Medicine and Rehabilitation, vol. 86, no. 3, pp. 473–479, 2005.
- M. A. Nosek, R. B. Hughes, C. A. Howland, M. E. Young, P. D. Mullen, and M. L. Shelton, “The meaning of health for women with physical disabilities: a qualitative analysis,” Family & Community Health, vol. 27, no. 1, pp. 6–21, 2004.
- T. M. Chase, “Women with spinal cord injury. In Practitioners guide to primary care for women with physical disabilities,” 2002, http://www.berkeleypolicyassociates.com/images/berkeleypolicyassociates.com/Image/photo/20050729_125237/Spinal%20Cord%20Injury.pdf.
- R. B. Hughes, N. Swedlund, N. Petersen, and M. A. Nosek, “Depression and women with spinal cord injury,” Topics in Spinal Cord Injury Rehabilitation, vol. 7, no. 1, pp. 16–24, 2001.
- D. G. Blazer and C. F. Hybels, “The association between successful treatment of depression and physical functioning in older people seeking primary care,” Journal of the American Geriatrics Society, vol. 53, no. 3, pp. 543–544, 2005.
- A. T. F. Beekman, B. W. J. H. Penninx, D. J. H. Deeg, E. de Beurs, S. W. Geerlings, and W. van Tilburg, “The impact of depression on the well-being, disability and use of services in older adults: a longitudinal perspective,” Acta Psychiatrica Scandinavica, vol. 105, no. 1, pp. 20–27, 2002.
- F. Creed and C. Dickens, “Depression in the medically ill,” in Depression and Physical Illness, A. Steptoe, Ed., pp. 3–18, Cambridge University Press, Cambridge, UK, 2007.
- R. M. Carney, J. A. Blumenthal, K. E. Freedland et al., “Depression and late mortality after myocardial infarction in the Enhancing Recovery in Coronary Heart Disease (ENRICHD) study,” Psychosomatic Medicine, vol. 66, no. 4, pp. 466–474, 2004.
- W. J. Katon, “Clinical and health services relationships between major depression, depressive symptoms, and general medical illness,” Biological Psychiatry, vol. 54, no. 3, pp. 216–226, 2003.
- T. W. Strine, D. P. Chapman, R. Kobau, L. Balluz, and A. H. Mokdad, “Depression, anxiety, and physical impairments and quality of life in the U.S. noninstitutionalized population,” Psychiatric Services, vol. 55, no. 12, pp. 1408–1413, 2004.
- J. M. Donohue and H. A. Pincus, “Reducing the societal burden of depression: a review of economic costs, quality of care and effects of treatment,” PharmacoEconomics, vol. 25, no. 1, pp. 7–24, 2007.
- D. D. Dunlop, L. M. Manheim, J. Song, J. S. Lyons, and R. W. Chang, “Incidence of disability among preretirement adults: the impact of depression,” American Journal of Public Health, vol. 95, no. 11, pp. 2003–2008, 2005.
- D. L. Segal, F. L. Coolidge, B. S. Cahill, and A. A. O'Riley, “Psychometric properties of the beck depression inventory-II (BDI-II) among community-dwelling older adults,” Behavior Modification, vol. 32, no. 1, pp. 3–20, 2008.
- L. S. Radloff, “The CES-D scale, a self-report depression scale for use in the general population,” Applied Psychological Measurement, vol. 1, no. 3, pp. 385–401, 1977.
- D. Hassouneh and E. McNeff, Raw unpublished data, 2006.
- R. B. Hughes, M. A. Nosek, and S. Robinson-Whelen, “Correlates of depression in rural women with physical disabilities,” Journal of Obstetric, Gynecologic, and Neonatal Nursing, vol. 36, no. 1, pp. 105–114, 2007.
- S. Robinson-Whelen, R. B. Hughes, H. B. Taylor, J. W. Hall, and L. P. Rehm, “Depression self-management program for rural women with physical disabilities,” Rehabilitation Psychology, vol. 52, no. 3, pp. 254–262, 2007.
- A. Laperriere, G. H. Ironson, M. H. Antoni et al., “Decreased depression up to one year following CBSM+ intervention in depressed women with AIDS: the smart/EST women's project,” Journal of Health Psychology, vol. 10, no. 2, pp. 223–231, 2005.
- J. C. Parker, K. L. Smarr, J. R. Slaughter et al., “Management of depression in rheumatoid arthritis: a combined pharmacologic and cognitive-behavioral approach,” Arthritis & Rheumatism, vol. 49, no. 6, pp. 766–777, 2003.
- N. Tesar, U. Baumhackl, M. Kopp, and V. Günther, “Effects of psychological group therapy in patients with multiple sclerosis,” Acta Neurologica Scandinavica, vol. 107, no. 6, pp. 394–399, 2003.
- S. A. Safren, C. O'Cleirigh, J. Y. Tan et al., “Randomized controlled trial of cognitive behavioral therapy for adherence and depression (CBT-AD) in HIV-Infected individuals,” Health Psychology, vol. 28, no. 1, pp. 1–10, 2009.
- S. Himelhoch, D. R. Medoff, and G. Oyeniyi, “Efficacy of group psychotherapy to reduce depressive symptoms among HIV-infected individuals: a systematic review and meta-analysis,” AIDS Patient Care and STDs, vol. 21, no. 10, pp. 732–739, 2007.
- R. B. Hughes, M. A. Nosek, C. A. Howland, J. Y. Groff, and P. D. Mullen, “Health promotion for women with physical disabilities: a pilot study,” Rehabilitation Psychology, vol. 48, no. 3, pp. 182–188, 2003.
- E. Martz, H. Livneh, M. Priebe, L. A. Wuermser, and L. Ottomanelli, “Predictors of psychosocial adaptation among people with spinal cord injury or disorder,” Archives of Physical Medicine and Rehabilitation, vol. 86, no. 6, pp. 1182–1192, 2005.
- S. H. Barone and K. Waters, “Coping and adaptation in adults living with spinal cord injury,” Journal of Neuroscience Nursing, vol. 44, no. 5, pp. 271–283, 2012.
- M. G. C. Njoku, L. A. Jason, and S. R. Torres-Harding, “The relationships among coping styles and fatigue in an ethnically diverse sample,” Ethnicity and Health, vol. 10, no. 4, pp. 263–278, 2005.
- R. B. Hughes, S. Robinson-Whelen, H. B. Taylor, N. Swedlund, and M. A. Nosek, “Enhancing self-esteem in women with physical disabilities,” Rehabilitation Psychology, vol. 49, no. 4, pp. 295–302, 2004.
- G. Taleporos and M. P. McCabe, “The impact of sexual esteem, body esteem, and sexual satisfaction on psychological well-being in people with physical disability,” Sexuality and Disability, vol. 20, no. 3, pp. 177–183, 2002.
- L. R. Svien, P. Berg, and C. Stephenson, “Issues in aging with cerebral palsy,” Topics in Geriatric Rehabilitation, vol. 24, no. 1, pp. 26–40, 2008.
- L. J. Phillips and A. K. Stuifbergen, “The relevance of depressive symptoms and social support to disability in women with multiple sclerosis or fibromyalgia,” International Journal of Rehabilitation Research, vol. 33, no. 2, pp. 142–150, 2010.
- B. A. Israel, A. J. Schulz, E. A. Parker, and A. B. Becker, “Review of community-based research: assessing partnership approaches to improve public health,” Annual Review of Public Health, vol. 19, pp. 173–202, 1998.
- M. Minkler, Community Organizing and Community Building for Health, Rutgers University Press, Brunswick, NJ, USA, 2nd edition, 2005.
- D. Hassouneh, A. Alcala-Moss, and E. Mcneff, “Practical strategies for promoting full inclusion of individuals with disabilities in community-based participatory intervention research,” Research in Nursing and Health, vol. 34, no. 3, pp. 253–265, 2011.
- D. Hassouneh and E. McNeff, Reflection, Insight, and Self-Empowerment (RISE) Curriculum, Curriculum, Oregon Health & Science University, Portland, Ore, USA, 2012.
- M. Stromborg and S. Olsen, Instruments for Clinical Health Care Research, Jones and Bartlett Publishers, Boston, Mass, USA, 2004.
- D. Hassouneh, G. Hanson, N. Perrin, and E. McNeff, “Abuse and health in individuals with spinal cord injury and dysfunction,” Journal of Rehabilitation, vol. 74, no. 3, pp. 3–9, 2008.
- S. Montel, L. Albertini, and E. Spitz, “Coping strategies as related to medical and demographic data in amyotrophic lateral sclerosis,” Acta Neurologica Scandinavica, vol. 125, no. 2, pp. 136–141, 2012.
- C. S. Carver, M. F. Scheier, and K. J. Weintraub, “Assessing coping strategies: a theoretically based approach,” Journal of Personality and Social Psychology, vol. 56, no. 2, pp. 267–283, 1989.
- A. Berger and S. Walker, “Measuring healthy lifestyle,” in Instruments for Clinical Health Care Research, M. Frank-Stromborg and S. Olsen, Eds., pp. 363–377, Jones and Bartlett Publishers, Sudbury, Mass, USA, 1997.
- M. A. Turk, J. Scandale, P. Rosenbaum, and R. Weber, “Health promotion for women with disabilities: health promoting lifestyle II,” in Abstract #27923 at the 129th Annual Meeting of the AHPA, 2001.
- G. Taleporos and M. P. McCabe, “Development and validation of the physical disability sexual and body esteem scale,” Sexuality and Disability, vol. 20, no. 3, pp. 159–176, 2002.
- S. L. Hopps, M. Pépin, and J. M. Boisvert, “The effectiveness of cognitive-behavioral group therapy for loneliness via interrelay-chat among people with physical disabilities,” Psychotherapy, vol. 40, no. 1-2, pp. 136–147, 2003.
- D. W. Russell, “UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure,” Journal of Personality Assessment, vol. 66, no. 1, pp. 20–40, 1996.
- A. M. Ponizovsky and M. S. Ritsner, “Patterns of loneliness in an immigrant population,” Comprehensive Psychiatry, vol. 45, no. 5, pp. 408–414, 2004.
- S. W. Geerlings, J. W. R. Twisk, A. T. F. Beekman, D. J. H. Deeg, and W. van Tilburg, “Longitudinal relationship between pain and depression in older adults: sex, age and physical disability,” Social Psychiatry and Psychiatric Epidemiology, vol. 37, no. 1, pp. 23–30, 2002.
- C. Dickens, L. McGowan, D. Clark-Carter, and F. Creed, “Depression in rheumatoid arthritis: a systematic review of the literature with meta-analysis,” Psychosomatic Medicine, vol. 64, no. 1, pp. 52–60, 2002.
- P. Flachenecker, T. Kümpfel, B. Kallmann et al., “Fatigue in multiple sclerosis: a comparison of different rating scales and correlation to clinical parameters,” Multiple Sclerosis, vol. 8, no. 6, pp. 523–526, 2002.
- F. Landi, G. Onder, M. Cesari, A. Russo, C. Barillaro, and R. Bernabei, “Pain and its relation to depressive symptoms in frail older people living in the community: an observational study,” Journal of Pain and Symptom Management, vol. 29, no. 3, pp. 255–262, 2005.
- R. Bakshi, Z. A. Shaikh, R. S. Miletich et al., “Fatigue in multiple sclerosis and its relationship to depression and neurologic disability,” Multiple Sclerosis, vol. 6, no. 3, pp. 181–185, 2000.
- S. M. Smedema and D. Ebener, “Substance abuse and psychosocial adaptation to physical disability: analysis of the literature and future directions,” Disability and Rehabilitation, vol. 32, no. 16, pp. 1311–1319, 2010.
- A. A. Dennhardt and J. G. Murphy, “Associations between depression, distress tolerance, delay-discounting, and alcohol related problems in European American and African American college students,” Pscyhology of Addictive Behaviors, vol. 25, no. 4, pp. 595–604, 2011.
- S. B. Hunter, K. E. Watkins, K. A. Hepner et al., “Treating depression and substance use: a randomized controlled trial,” Journal of Substance Abuse Treatment, vol. 43, no. 2, pp. 137–151, 2012.
- Stanford Patient Education Research Center, “Stanford HAQ 8-Item Disability Scale,” 2012, http://patienteducation.stanford.edu/research/haq8.html.
- J. A. Ewing, “Detecting alcoholism. The CAGE questionnaire,” Journal of the American Medical Association, vol. 252, no. 14, pp. 1905–1907, 1984.
- R. L. Brown and L. A. Rounds, “Conjoint screening questionnaires for alcohol and other drug abuse: criterion validity in a primary care practice,” Wisconsin Medical Journal, vol. 94, no. 3, pp. 135–140, 1995.
- D. Frzovic, M. E. Morris, and L. Vowels, “Clinical tests of standing balance: performance of persons with multiple sclerosis,” Archives of Physical Medicine and Rehabilitation, vol. 81, no. 2, pp. 215–221, 2000.
- M. E. Morris, C. Cantwell, L. Vowels, and K. Dodd, “Changes in gait and fatigue from morning to afternoon in people with multiple sclerosis,” Journal of Neurology Neurosurgery and Psychiatry, vol. 72, no. 3, pp. 361–365, 2002.
- M. A. Hanley, M. P. Jensen, D. M. Ehde et al., “Clinically significant change in pain intensity ratings in persons with spinal cord injury or amputation,” The Clinical Journal of Pain, vol. 22, no. 1, pp. 25–31, 2006.
- K. Linde, W. Weidenhammer, A. Streng, A. Hoppe, and D. Melchart, “Acupuncture for osteoarthritic pain: an observational study in routine care,” Rheumatology, vol. 45, no. 2, pp. 222–227, 2006.
- K. A. Herr, K. Spratt, P. R. Mobily, and G. Richardson, “Pain intensity assessment in older adults: use of experimental pain to compare psychometric properties and usability of selected pain scales with younger adults,” The Clinical Journal of Pain, vol. 20, no. 4, pp. 207–219, 2004.
- “RE-AIM,” 2012, http://re-aim.org/.