Abstract

We studied the concurrent, predictive, and discriminate validity of psychopathology scales (e.g., schizotypal and depressive) and temperament traits for hospitalisations due to major depression. Temperament, perceptual aberration, physical and social anhedonia, Depression Subscale of Symptom Checklist (SCL-D), Hypomanic Personality Scale, Schizoidia Scale, and Bipolar II Scale were completed as part of the 31-year follow-up survey of the prospective Northern Finland 1966 Birth Cohort ( males). Several of the scales were related to depression. Concurrent depression was especially related to higher perceptual aberration (effect size when compared to controls, ), subsequent depression to high scores in SCL-D ( ). Physical anhedonia was lower in subjects with subsequent depression than those with other psychiatric disorders ( , nonsignificant). Participants with concurrent ( ) and subsequent ( ) depression had high harm avoidance compared to controls, while differences compared to other psychiatric patients were small. Subjects with depression differed from healthy controls in most of the scales. Many of the scales were useful predictors for future hospital treatments, but were not diagnosis-specific. High harm avoidance is a potential indicator for subsequent depression.

1. Introduction

Several studies have attempted to predict psychiatric symptoms or disorders using various psychological and psychiatric instruments [1, 2]. These scales have clinical importance, for example, when identifying high-risk individuals. They may also help to detect intermediate phenotypes for psychiatric disorders [3]. Potential psychopathological intermediate phenotypes of depression include, for example, depressed mood and anhedonia [4]. The objectiveness of these scales adds to their usefulness in etiological research of psychiatric disorders [5].

Numerous instruments have been used to evaluate depressive symptoms in the general population. For instance, the Symptom Checklist was developed to screen for depression and anxiety in the general population [6]. Personality traits, such as those measured with Cloninger’s [7] temperament dimensions, have been associated with several psychiatric disorders [8]. Particularly high harm avoidance has been associated with depression [8]. The previous longitudinal studies in relation to depression are very few and have included relatively short follow-up period [9, 10]. These studies indicate that harm avoidance may be a phenotypic indicator for risk of depressive episodes [10]. Schizotypal traits, such as anhedonia, are key features both in schizophrenia and depression. In patients with schizophrenia, anhedonia has been strongly associated with the depressive syndrome [11].

The aim of the present study was to evaluate the concurrent, predictive, and discriminate validity of several psychological scales for depression, using a large representative population based sample of adults, with adequate followup. Our hypothesis was that subjects with either concurrent or subsequent depression would score differently in schizotypal and depressive symptom scales and temperament dimensions, when compared to subjects with other psychiatric disorders or healthy controls.

2. Material and Methods

2.1. Participants

The Northern Finland 1966 Birth Cohort (NFBC 1966) is an unselected, general population-based birth cohort ascertained during mid-pregnancy. It comprised of 12,058 live-born children in the Finnish provinces of Lapland and Oulu [12]. We required that all subjects had been living in Finland at the age of 16 ( ; 5,589 males and 5,344 females), as we have previously validated psychiatric diagnoses from the Finnish Hospital Discharge Register in this subsample [13, 14]. Permission to gather data was obtained from the Ministry of Social and Health Affairs and the study design has been approved by, and is under review of, the Ethical Committee of The Northern Ostrobothnia Hospital District. After complete description of the study, written informed consent was obtained from study participants.

In 1997, the questionnaires used for the 31-year followup of the cohort included a large collection of psychopathology scales and four temperament dimensions that were given to all cohort members who participated in a clinical examination [15]. Participants completed these scales at home and returned them in the envelopes provided. The 12-item version of the Infrequency Scale [16] was used to assess careless responding. It contains items that are very unlikely to be true and identifies random response styles. Participants who endorsed three or more items ( ) on this scale were excluded from further analyses. The Symptom Checklist-25 [6, 17, 18] was sent, by post, in a different set of questions, together with several sociodemographic questions and an invitation letter for the clinical examination. In total, 4,941 participants (2,214 males and 2,727 females) adequately completed at least one of these scales.

The Finnish Hospital Discharge Register (FHDR) covers all mental and general hospitals as well as beds in local health centres, prison and military hospitals and private hospitals nationwide. All cohort members, over 16 years old, appearing on the FHDR until the end of 1997 for any mental disorder were identified and their diagnoses were rechecked twice by psychiatrists using DSM-III-R criteria [19]. The reliability of this procedure was moderate for depression ). A more detailed description of the validation process is presented elsewhere [13, 14].

Data was also collected from postal questionnaires sent to all subjects in 1977 and outpatient treatments with self-reported diagnoses. Subjects were asked whether they had any of the following: depression, psychosis, alcohol use disorder, other substance use disorder, or any other psychiatric disorder diagnosed by a medical doctor. Three groups were formed: “depressive disorder” ( ; 68 males, 33%), “other psychiatric disorders” ( ; 77 males, 51%), and “no psychiatric disorders” ( ; 2069 males, 45%). The “depressive disorder” group included subjects with validated hospital care diagnoses of psychotic depression (DSM-III-R codes: 296.24 and 296.34; ) or nonpsychotic depression (296.22, 296.23, 296.31, 296.33, and 311.00; ), or self-reported depressions ( ). “Other psychiatric disorders” included subjects with other psychiatric diagnoses based on either hospital ( ) or self-reported data ( ). In the followup, the same groups were used, but only with nonvalidated data from the FHDR from 1998 to 2010, classified as described above. The distribution of the diagnoses for major depressive disorders (ICD-10 diagnoses: F32-F33 and F341) are presented in Section 3.

When comparing the final sample at the 31-year followup to subjects alive at the age of 16 years, females participated more commonly than males (51.4% versus 40.4%; 134.81, ) and those with tertiary (more than 12 years) and secondary level (10–12 years) education more commonly than those with basic level (9 or less years) education (49.5% and 49.7% versus 25.1%; 343.73, degrees of freedom = 2, ). The attrition analyses for the 31-year follow-up study have previously been described in detail. For individuals with psychiatric hospital diagnoses until 1997, the participation rate was 42% among those with mood disorders and 54% among controls [15].

2.2. Instruments

The questionnaire given to subjects consisted of mental health related true/false questions, which were collected from several psychopathology (e.g., schizotypal) scales and four temperament subscales. All these items, and the 12 items from the Infrequency Scale, were randomly rearranged into a 354-item questionnaire, called “Survey of Opinions and Experiences.” We used the temperament subscales (novelty seeking, harm avoidance, reward dependence, and persistence) from the Temperament and Character Inventory (TCI). The schizotypal scales were the following: Physical Anhedonia Scale (PAS), Social Anhedonia Scale (SAS), Perceptual Aberration Scale (PER), Hypomanic Personality Scale (HPS), Bipolar II Scale (BIP2), and Schizoidia Scale (SCHD). From a separate survey, we included the depression subscale (15 items) of Symptom Checklist (SCL-D) in order to also assess depressive symptoms. The answers to SCL are scored on a scale from 1 (not bothered) to 4 (extremely bothered) [6]. The references and short descriptions for the scales are presented in Table 1. Firstly, we studied these scales in respect to previous hospitalization or current self-reported psychiatric diagnosis in 1997. Secondly, among those without previous psychiatric diagnosis in 1997, these scales were studied in respect to subsequent hospitalizations due to psychiatric causes between 1998 and 2010.

The original English versions of the scales, except SCL-25, were translated into Finnish by one investigator and then back-translated blindly to the original English scale by a professional English translator. The original version and the back-translation were compared, and corrections were made accordingly. The translation was tested in a sample of 50 laboratory workers, and the results indicated that no questions required revision. We used an earlier Finnish translation of the SCL in the current study. We have previously presented validity results in this sample for the SCL-25 [18], temperament [26], and schizotypal scales [27].

2.3. Statistical Methods

We present means, standard deviations (SD), and Student’s t-tests for continuous variables. Mean scores between different groups were compared using effect sizes (Cohen’s ) and two-way analysis of variance, where diagnostic group and gender were used as grouping variables and scale scores as dependent variables. Gender was used as a covariate, as previous meta-analyses have found gender differences in these scales [28, 29]. Cohen [30] interpreted values of 0.2 to 0.5 as small, 0.5 to 0.8 as medium, and 0.8 or over as large effects. We studied associations of all the scales both to depressions and to other psychiatric disorders in order to estimate the specificity of the scales. As substance use disorder is a common diagnosis in other psychiatric diagnoses and a common comorbid diagnosis in depression, we performed additional analysis with substance abuse as a covariate in analysis of variance. All tests are two-tailed. The data was analyzed using the IBM SPSS v. 20.

3. Results

Table 2 shows mean (SD) values for the different scales in categories of concurrent depression, other psychiatric disorders, and no psychiatric disorders. In 1997, those with depression scored statistically significantly ( ) higher than those without previous psychiatric disorders in all studied psychopathology scales, except PAS. The difference was highest in SCL-D (means 1.78 versus 1.33, ) followed by perceptual aberration scale (means 5.09 versus 2.24, ). In temperament dimensions, this difference was statistically significant only in TCI-HA, with higher scores among those with depression ( ). Almost all the scales were related to depression. However, it was only in SCL-D that those with depression differed statistically significantly from those with other psychiatric disorders with a small effect size ( ). No significant differences between these two groups were found in temperament dimensions (Table 2).

Among those with no psychiatric disorders until 1997, 51 (26 males, 51%) new cases with depression requiring hospitalizations emerged during the subsequent followup of thirteen years. This group included subjects with psychotic depression (F323, F333), and nonpsychotic depression (F32-F33, not F323, F33; F341), . In this followup, 57 (36 males, 63%) individuals were hospitalized for other psychiatric disorders. This group included various psychiatric diagnoses. The most common diagnoses were substance use disorder ( ), nonaffective psychosis ( ), and anxiety disorders ( ).

Of the psychopathology scales, the bipolar II scale ( ), SCL-D ( ), SCHD ( ), and SAS ( ) were the strongest predictors for new cases of depression requiring hospitalization. However, the scales were not diagnosis-specific. The greatest difference between depression and other psychiatric disorders requiring hospitalization ( ; NS) was found in PAS.

In temperament dimensions, new cases of depression requiring hospitalization scored high in the harm avoidance when compared to those with no hospitalization due to psychiatric causes (16.96 versus 13.77; , ). No significant differences were found between the two psychiatric groups. Novelty seeking had the highest effect size (ns, ), with lower scores among those with hospitalization due to depression. In additional analyses, between those with depression and other psychiatric disorders we controlled for substance use disorders. The difference between these two groups was statistically significant in harm avoidance in concurrent analyses ( , ) with higher scores among those with hospitalization due to depression. Differences in other temperament traits or in predictive analyses were nonsignificant (Table 3).

4. Discussion

We studied the concurrent, predictive, and discriminate validity of several psychopathology scales and temperamental dimensions in relation to depression. Many of them were related to depression but also to other psychiatric disorders. Harm avoidance ( ) as a temperament dimension and the bipolar II scale ( ) best predicted depression, and also the depression subscale of the SCL associated with depression, especially concurrently ( ). These findings reflect the relatively high predictive value of the scales and confirm their utility as clinical tools for the identification of individuals at risk for psychiatric disorders. None of the scales discriminated well subjects with depression from subjects with other psychiatric disorders. However, when we took into account substance use disorders as a covariate in concurrent analyses, individuals with depression scored statistically significantly higher in harm avoidance than those with other psychiatric disorders.

4.1. Schizotypal Scales

We found that many of the psychopathology scales related to both concurrent and subsequent depression. However, these scales were not diagnosis- specific as these traits were also common in other psychiatric disorders. In the schizotypal (PAS, SAS, and PER) scales, there have been some previous case-control studies in depression, with small sample sizes. These studies have found large effect sizes between psychiatric cases and healthy controls (e.g., students), with cases scoring higher in all of them. In physical anhedonia, effect sizes have varied between 0.92 [31] and 1.79 [32], and in social anhedonia between 0.86 [33] and 1.19 [34]. In perceptual aberration, Katsanis et al. [33] found depressive patients scored higher than healthy controls, with an effect size of 0.57. Loas et al. [35] note that physical anhedonia in depressed patients seems to relate to the severity of the depression and does not appear to identify quantitatively distinct subgroup.

We have previously studied these schizotypal scales in schizophrenia [36]. Individuals with concurrent depression ( ) scored lower than those with schizophrenia ( ) in all schizotypal scales, for example, in physical anhedonia, mean score in schizophrenia was 18.38 and in depression 14.68. When predicting these disorders, differences in scores were smaller; however, those with subsequent schizophrenia scored substantially higher in perceptual aberration (means 4.30 versus 2.96) and hypomanic personality (17.10 versus 12.37) than those with subsequent depression. Interestingly, our results contradict some previous studies such as Blanchard et al. [34], who found that depressive patients had higher scores for social anhedonia than schizophrenia patients (means 18 versus 15). They concluded that schizophrenia patients seem to have stable high scores in social anhedonia whereas, in depressive patients, it correlates with the clinical state. These differences may relate to our sample being based on lifetime diagnoses in population, including also individuals without current treatment or symptoms.

4.2. Depressive Symptoms

Sandanger et al. [37] previously conducted a cross-sectional study of the specificity of SCL-25 for depression. They found that a cutoff of 1.75 points in average was a powerful predictor for depression (crude odds ratio, OR 14.0). However, the scale was also significantly associated with different anxiety disorders (ORs 2.2 to 4.4) and with any disorder (OR 3.9). In a previous study of the NFBC 1966, Veijola et al. [18] compared the SCL-25 with Structured Clinical Interview for DSM-III-R (SCID) diagnoses in a subsample of the cohort. They concluded that SCL-25 might be useful for screening purposes in primary health care and epidemiological surveys. They noted that cases with psychiatric comorbid disorders were screened successfully using the instrument. According to the present study, the depression subscale of the SCL was a quite good ( ) predictor of new cases of depression requiring hospitalization, when compared to those with no new psychiatric disorders requiring hospitalization during the followup. However, specificity was poor ( ), indicating that depressive symptoms also relate to other subsequent psychiatric disorders (Table 3).

4.3. Temperament Dimensions

We found a strong association between depression and harm avoidance, as has also been noted in a recent meta-analysis comparing different psychiatric disorders [8]. This meta-analysis also found a small negative effect size ( ) of lower novelty seeking in major depression, whereas the effect in harm avoidance was very large ( ) when compared to controls. High harm avoidance in depression has been shown to remain, after controlling for age, gender, diagnosis, and depressive state effects [38]. Harm avoidance has also been shown to decrease after treatment response [39]. Interestingly, never-depressed siblings of the probands with major depression are reported as having higher harm avoidance compared to never-depressed siblings of never-depressed controls. Thus, the authors suggested that harm avoidance might be a trait-like characteristic related to a familial vulnerability to depression [40].

In our sample, individuals with concurrent or previous depression had very similar temperament when compared to individuals with other psychiatric disorders, with all the effect sizes being below 0.20. In the extensive meta-analysis by Miettunen and Raevuori [8], depression (23 studies) had higher P, RD, and HA than schizophrenia, but quite similar temperament when compared to alcohol use disorders. It is worth mentioning that, in the present study, about half of the patients with subsequent other psychiatric disorder had a substance use diagnosis (as their only diagnosis or in addition to some other diagnosis). Because of this, we performed additional analyses substance use disorder as additional covariate. We found that in concurrent, but not in predictive analyses, individuals with depression scored significantly higher than those with other psychiatric disorders in harm avoidance.

When we compared current results to our previous schizophrenia study with the NFBC 1966 [36], in those who have already received a diagnosis, harm avoidance was lower ( ) and novelty seeking higher ( ) in depression than in schizophrenia. Those with subsequent depression substantially had higher scores, especially in reward dependency, than those with subsequent schizophrenia (mean scores 14.2 versus 11.8; ).

4.4. Strengths and Limitations

The sample was relatively large and population-based. Unlike many of the previous studies, we also included a comparison group with other psychiatric disorders. The extensive set of scales used is also an advantage. A limitation of the sample is that, although it was large, a low number of cases during the followup also meant that it was not possible to predict diagnoses more specifically. Due to cohort design, it only consists of one age group. As we used the nationwide hospital register to find new cases of depression, our outcome only indicates a very severe form of depression. We cannot avoid the possibility that, at the end of followup, high scorers without psychiatric diagnosis may have a depression diagnosis not requiring hospitalization, as most of the subjects with depressive episode are not treated in psychiatric hospital facilities [41]. It should also be noted that quite a large proportion of eligible subjects did not participate or gave inadequate answers [15].

5. Conclusions

In most of the scales, subjects with depression differed from healthy controls. Many of the scales were useful predictors for subsequent new hospitalisations due to depression. With lack of diagnosis specificity, these scales also predicted other psychiatric diagnoses. Thus, these scales are useful both in clinical work and in etiological research of psychiatric disorders.

Conflict of Interests

The authors declare that they have no conflict of interests.

Acknowledgments

This study has been supported by the Academy of Finland, the European Commission (EURO-BLCS, Framework 5 award QLG1-CT-2000-01643), NARSAD: Brain and Behavior Research Fund (Dr. Mortimer D. Sackler Developmental Psychobiology Research Program), the Sigrid Jusélius Foundation, DAAD (German Academic Exchange Service), and US National Institutes of Health (NIMH) (5R01MH63706:02).