Research Article | Open Access
Marco Innamorati, Stella Tamburello, Anna Contardi, Claudio Imperatori, Antonino Tamburello, Aristide Saggino, Michela Balsamo, "Psychometric Properties of the Attitudes toward Self-Revised in Italian Young Adults", Depression Research and Treatment, vol. 2013, Article ID 209216, 6 pages, 2013. https://doi.org/10.1155/2013/209216
Psychometric Properties of the Attitudes toward Self-Revised in Italian Young Adults
Objectives and Methods. Several researchers have provided support for the critical role of cognitive vulnerabilities in the development of depression. The Attitudes toward Self-Revised (ATS-R) was designed to assess three potential self-regulatory vulnerabilities to depression: High Standards (HS), Self-Criticism (SC), and Negative Generalization (NG). The aim of the study was to assess the psychometric properties of the ATS-R in the Italian young adult population. The ATS-R, the Beck Depression Inventory-II (BDI-II), the Beck Hopelessness Scale (BHS), and the Teate Depression Inventory (TDI) were administered to 857 (320 men and 537 women) young adults. Results. The best-fitting solution for the ATS-R was a 2-factor model, which obtained satisfactory homogeneity of content (HS/SC: Cronbach ; mean interitem correlation = 0.46. NG: Cronbach ; mean interitem correlation = 0.43) and significant correlation with the BDI-II (NG: Pearson , ), the TDI (HS/SC: Pearson , ), and the BHS (HS/SC: Pearson , ; NG: Pearson , ). Conclusions. The Italian version of the ATS-R seems to be a valid instrument for the study of the role of cognitive tendencies as potential vulnerability for depression.
Depression involves a wide variety of pathological conditions which vary along a continuum from more mild to more severe and persistent forms, such as major depressive disorder (MDD). MDD is the most widespread psychiatric disorder in the world [1–4], although its prevalence differs between countries around the world .
At the end of the eighties, the Epidemiological Catchment Area (ECA) study investigated the prevalence of MDD in the US general population and reported 30-day prevalence rates ranging between 1.7% and 3.4% . More recently, the National Comorbidity Survey Replication (NCS-R) estimated a 12-month prevalence of 6.6% . In Italy, the European study on the Epidemiology of Mental Disorders (ESEMeD) estimated rates of 3.0% and 10.0%, respectively, for the 12-month and lifetime MDD prevalence .
Numerous etiological models have been proposed and studied to explain how individuals become depressed. Cognitive theories of depression postulate that the dysfunctional interpretation of a life event may lead the individual to be vulnerable to depression following the occurrence of the stressful event. The most renowned cognitive theories of depression are the hopelessness theory  and the Beck’s theory [12, 13]. Abramson et al.  focused on three maladaptive depressogenic inferential styles which predispose individuals to the development of depression: (1) the tendency to attribute negative events to global and stable causes; (2) the tendency to perceive negative events as having many disastrous consequences; and (3) the tendency to view the self as flawed or deficient following negative events. Beck [12, 13] hypothesized that depressed people have unrealistical and dysfunctional beliefs about the self, the world, and the future, a set of faulty cognitive processes known as the “cognitive triad.”
Several researches have provided support for the critical role of cognitive vulnerability (i.e., a trait-like tendency to interpret information in negative and distorted ways in face of subjectively perceived stressful events ) in the development of depressive disorders [15–18]. For example, Evans et al.  found that holding a negative self-schema is an independent risk factor for the onset of depression in women, whereas Alloy et al.  reported that a negative inferential style increases the risk for the initial onset and recurrence of depressive episodes.
According to Carver and Ganellen , self-punitiveness is a salient feature of depression, associated with the holding of overly high standards, the tendency to be too critical with the self for failing to attain a standard, and the tendency to generalize from a single failure to the broader sense of self-worth. In order to confirm their hypothesis and to assess the relationship among these three processes and depression, the authors developed the Attitudes toward Self (ATS). The ATS was composed of 18 items divided into three subscales: Negative Generalization, High Standards, and Self-Criticism. In 1988, the authors elaborated a revised version of the measure (ATS-R) with a reduced number of items, focusing more explicitly on the cognitive tendencies than the original items . Several studies indicated that, among the three tendencies, negative generalization was the only one reliably related to depression and mediating the relationship between life events and depression [20, 21] and between negative events and self-esteem . Studies constantly indicated that homogeneity of content of the three factors was sufficient (Cronbach alpha > 0.70), except for self-criticism [20–24].
This analysis of the literature suggests the importance to assess cognitive vulnerabilities (CV) to depression and the utility of the ATS-R in measuring three tendencies potentially associated with a higher risk to develop depression. Thus, the aim of the study was to assess the psychometric properties of the ATS-R  in the Italian young adult population.
2. Materials and Methods
Participants were 857 (320 men and 537 women) Italian young adults recruited between January 2011 and May 2011 in Central Italy. Mean age of the sample was 22.41 years (SD = 4.36; range: 18–34 years). Inclusion criteria included age between 18 and 34 years and the ability to read and write in Italian. Exclusion criteria included the presence of any condition affecting the ability to complete the assessment, including illiteracy and denial of informed consent.
The sample was nonrandomly recruited through attendants of adult education classes and advertisement posted to established community groups. More than 89% of the respondents had completed high school at the time of the assessment, and 55.5% of them were university students. Educational attainment in our sample was higher than the national average (according to the National Institute of Statistics (http://www.istat.it/) in Central Italy around 80% of people 20–24 years old complete secondary school, and 40% of people 19–25 years old attend university), and our sample should not be considered representative of the Italian young adult population.
All participants took part voluntarily in the study, gave informed consent, and completed the assessment anonymously.
All participants were administered the ATS-R, the BDI-II, the Teate Depression Inventory (TDI) , and the Beck Hopelessness Scale (BHS) . The assessment protocol was self-administered; the questionnaires were delivered to participants in a group setting or individually and completed in the presence of a researcher, who possibly helped with the compilation.
The ATS-R  is a 10-item scale measuring three potential self-regulatory vulnerabilities to depression (holding overly high standards, the tendency to be self-critical at any failure to perform well, and the tendency to generalize from a single failure to the broader sense of self-worth). Compared to the previous version  ATS-R is characterized by new items focused more explicitly on the cognitive tendencies than the originals, and its shortness reflects the straightforwardness of each cognitive tendency [21, 23].
Respondents are asked to rate the degree to which they agree/disagree with each statement on a 5-point Likert-type scale (ranging from “I agree a lot” to “I disagree a lot”). The Italian version of the ATS-R was translated from the original English version into Italian by two authors of the present study (Marco Innamorati and Michela Balsamo); then, the Italian version was independently and blindly back-translated by a native English speaking researcher.
The BDI-II is a well-known self-report inventory composed of 21 items designed to assess the presence and severity of depressive symptoms, according to DSM-IV  criteria. Respondents endorse specific statements reflecting their feelings over the last two weeks, including today. Each statement is rated on a 4-point Likert-type scale ranging from 0 to 3, based on the severity of depressive symptoms. Importantly, the extensive literature has supported the psychometric properties of the scale in clinical and nonclinical samples [29, 30]. In the current study, Cronbach alpha index was 0.87.
The BHS is a 20-item scale for measuring negative attitudes about the future . When responding to the 20 true-false items on the BHS, individuals either endorse a pessimistic statement or deny an optimistic statement. Research has consistently supported a positive significant relationship between BHS scores and measures of depression, suicidal intent, and suicidal ideation [31–35]. Studies on the Italian population have been carried out successfully  and have led to validation of the scale . In the present study, Cronbach alpha was 0.84.
The TDI is a new 21-item self-report instrument designed to assess the Diagnostic and Statistical Manual of Mental Disorders, fourth edition, text revision (DSM-IV-TR) , criteria for major depression . It was developed via Rasch logistic analysis of responses [38, 39], in order to overcome psychometric inherent weaknesses of existing measures of depression . Each item is rated on a 5-point Likert-type scale ranging from 0 (always) to 4 (never). The total score ranges from 0 to 84, with higher scores indicating more severe depressive symptoms. In the standardization samples, the TDI displayed very good psychometric properties (with an excellent Person separation index, equal to 0.95), no evidence of bias due to item-trait interaction, high sensitivity and specificity, and control of major response sets . In our study, Cronbach’s alpha was 0.92. Pearson for the correlation between the TDI and the BDI-II was 0.65 ().
2.3. Statistical Analysis
The Velicer’s MAP test has been proposed as a rule to find the best solution in exploratory factor analysis. It is accurate under many conditions, although, under certain conditions, it may have a tendency to underestimate the number of factors . SEM was performed with a Robust Diagonally Weighted Least Squares Estimator (DWLSE) on a polychoric correlational matrix using the statistical package Lisrel 8.8 . We evaluated the fit of the model by means of the following indexes: (a) the Root Mean Square Error of Approximation (RMSEA) [44, 45]; (b) the Incremental Comparative Fit Index (CFI) ; (c) the Satorra-Bentler scaled chi-square (SB ); and (d) the Standardized Root Mean Square Residual (SRMSR) . In the design and planning phase, we set a target recruitment size of 800 participants, greater than the standard of 10 participants per parameter estimated and a minimum of 300 participants reported in the literature [46, 47]. This sample size was set to have adequate power to have stability of the factorial solution.
According to the results from the SEM and the Velicer’s MAP test, we performed an exploratory factor analysis using ordinary least squares to find minimum residual (MINRES). We used an oblique rotation method (ProMAX) because we expected that the ATS-R factors are correlated.
We reported Cronbach alphas, interitem mean correlations, and corrected item-total indices (i.e., discrimination indices) for the best-fitting factor model. Also, the convergent validity of the ATS-R with the BDI-II and the BHS was investigated by means of Pearson correlation coefficients. To test whether scores on the ATS-R dimensions were independently associated with depressive severity, we performed a generalized linear model with the BDI-II as dependent variable and the ATS-R factors and the BHS as independent variables. We reported odds ratio and their 95% confidence interval (CI) as indices of association. In addition, multivariate general linear model (GLM) was used to assess whether scores on the ATS-R factors were associated with the respondent’s sex.
3.1. Depression and Hopelessness Severity
One hundred twelve respondents (13.1% of the sample) had scores of 20 and higher on the BDI-II, indicative of moderate to severe depression, and 136 respondents (15.9% of the sample) had scores between 14 and 19, indicative of mild depression. Finally, 29.7% of the respondents reported scores of 9 or higher on the BHS, indicating severe hopelessness.
3.2. Factorial Validity
The Velicer’s MAP test indicated that the best number of factors to extract was two. Furthermore, the three factor model proposed by Carver et al.  had poor fit (SB ; ; RMSEA = 0.10; 90% CI for RMSEA = 0.093/0.11; CFI = 0.94; SRMR = 0.075).
As a result, we performed a MINRES factor analysis which indicated that items no. 1, no. 3, no. 4, no. 6, and no. 7 load on the first factor (“High Standards/Self-Criticism”), while items no. 2, no. 8, no. 9, and no. 10 load on the second factor (“Negative Generalization”) (see Table 1). The item no. 5, which originally was included in the Negative Generalization factor, did not load on any factor, while items no. 3, no. 6, and no. 9, which originally were included in the Self-Criticism factor, loaded sparsely on the “High Standards/Self-Criticism” (items no. 3, no. 6) and Negative Generalization (item no. 9) factors.
3.3. Reliability and Convergent Validity
Factors had satisfactory homogeneity of content (High Standards/Self-Criticism: Cronbach ; mean interitem correlation = 0.46. Negative Generalization: Cronbach ; mean interitem correlation = 0.43) (see Table 1) and correlated significantly with the BHS (High Standards/Self-Criticism: Pearson ; . Negative Generalization: Pearson ; ). The pattern of correlations with measures of depression was less clear: Negative Generalization correlated significantly with the BDI-II (Pearson ; ), and nonsignificantly with the TDI (Negative Generalization: Pearson ; ), while High Standards/Self-Criticism correlated significantly with the TDI (Pearson ; ) and nonsignificantly with the BDI-II (Pearson ; ).
The GLM indicated that both the ATS-R factors were independently associated with the BDI-II even when controlling for the severity of hopelessness. Young adults with higher depressive symptoms severity were (1) 1.23 times more likely to have higher High Standards/Self-Criticism scores (95% confidence interval: 1.08/1.39; ); (2) 1.36 times more likely to have higher Negative Generalization scores (95% confidence interval: 1.17/1.58; ); and (3) 2.66 times more likely to have higher BHS scores (95% confidence interval: 2.28/3.11; ).
The GLM analysis indicated that sex had a significant effect (Wilks ; ): men and women differed for High Standards/Self-Criticism mean scores ( and , resp., for males and females; ; ) but not for Negative Generalization scores ( and , resp., for males and females; ; ).
Our results indicated that the three-factor solution obtained by Carver et al.  did not fit well the structure of the Italian version of the ATS-R. In our sample of Italian young adults, the ATS-R seems to measure two self-regulatory attitudes toward the self: the tendency to generalize from a single failure to a broader sense of personal inadequacy (“Negative Generalization”) and one dimension assessing the tendency to hold overly high standards and to be self-critical (“High Standards/Self-Criticism”). Furthermore, the pattern of loadings was partly discordant from that reported by Carver et al. . Nonetheless, the pattern of loadings resulting from the factor analysis is consistent with the results reported by Carver : in their research, the authors reported that Self-Criticism was significantly associated with the dimensions High Standards (; ) and Negative Generalization (; ), while the High Standards factor was almost unrelated to Negative Generalization (; .) factor. In fact, in our sample, Negative Generalization and High Standards resulted in two independent factors, while the items originally loading on Self-Criticism loaded sparsely on the two remaining factors.
Our findings about the convergent validity of the ATS-R are only partially consistent with those reported by Carver et al.  and Carver . While in the bivariate analyses, only the dimension of Negative Generalization correlated significantly with depression as measured with the BDI-II; at the multivariate level also the dimension High Standards/Self-Criticism resulted independently associated with depression, and not only the BHS and the Negative Generalization factor. These results suggest that a tendency to generalize from a single failure to a broader sense of personal inadequacy, a pessimistic view of the future, the holding of overly high standards, and the tendency to be self-critical are all important in the phenomenology of depression. However, there could be some differences between sexes. For example, while male and female Italian young adults did not differ in their tendency to generalize from a single failure to a broader sense of personal inadequacy, male young adults reported to hold more overly high standards and the tendency to be more self-critical at any failure to perform well. Furthermore, the effect sizes of the correlations between Negative Generalization, hopelessness, and depression were stronger in men than in women. This is discordant with Carver , who investigated the role of the ATS-R dimensions as prospective predictors of depressive symptoms in 336 US undergraduates. In their sample, the author reported that women had higher tendency toward Negative Generalization than did men, but the groups did not differ for the tendency to be self-critical or the holding of overly high standards. However, the author did not investigate whether the size of the associations between the ATS-R dimensions and depression may differ between sexes.
Reliability indices for the ATS-R factors were satisfactory but not good (Cronbach alphas between 0.75 and 0.81), due to a good homogeneity of content (mean interitem correlation >0.40 for both the factors), but the low number of items included in each factor. For Carver et al. , the brevity of the scale is a strength of the ATS-R, reflecting the fact that the essence of the cognitive tendencies measured with the ATS-R is “relatively straightforward.” However, from a psychometric point of view, scale’s brevity might be a limitation for the use of the instrument in clinical settings .
Our findings have some limitations in their generalizability. First, we examined cognitive diatheses for depression in a sample of young adults recruited from the general population, a population in which the level of depression is generally low. Second, we used only self-report measures potentially biased by social desirability. Third, we did not assess other important psychometric characteristics of the ATS-R, such as the test-retest reliability. On the other hand, to our knowledge, this is the first study examining psychometric properties of the ATS-R in a sample of Italian young adults.
In conclusion, the Italian version of the ATS-R seems to be a valid instrument for the study of the role of cognitive tendencies as potential diathesis in the development of depression. Further research is needed to verify whether the psychometric properties and the factor structure of the ATS-R obtained in our sample are also replicable in clinical samples and in samples of adolescents and older adults.
Conflict of Interests
The authors declare that they have no conflict of interests for this research.
All authors have made substantial contributions to conception and design or acquisition of data or analysis and interpretation of data, have been involved in drafting the paper or revising it critically for important intellectual content, and have given final approval of the version to be published.
- D. S. Hasin, R. D. Goodwin, F. S. Stinson, and B. F. Grant, “Epidemiology of major depressive disorder: results from the National Epidemiologic Survey on Alcoholism and Related Conditions,” Archives of General Psychiatry, vol. 62, no. 10, pp. 1097–1106, 2005.
- C. Blanco, M. Okuda, J. C. Markowitz, S.-M. Liu, B. F. Grant, and D. S. Hasin, “The epidemiology of chronic major depressive disorder and dysthymic disorder: results from the national epidemiologic survey on alcohol and related conditions,” Journal of Clinical Psychiatry, vol. 71, no. 12, pp. 1645–1656, 2010.
- V. Lehtinen and M. Joukamaa, “Epidemiology of depression: prevalence, risk factors and treatment situation,” Acta Psychiatrica Scandinavica, vol. 89, no. 377, pp. 7–10, 1994.
- M. M. Ohayon, “Epidemiology of depression and its treatment in the general population,” Journal of Psychiatric Research, vol. 41, no. 3-4, pp. 207–213, 2007.
- M. M. Weissman, R. C. Bland, G. J. Canino et al., “Cross-national epidemiology of major depression and bipolar disorder,” Journal of the American Medical Association, vol. 276, no. 4, pp. 293–299, 1996.
- D. A. Regier, J. H. Boyd, J. D. Burke Jr. et al., “One-month prevalence of mental disorders in the United States, based on five epidemiologic catchment area sites,” Archives of General Psychiatry, vol. 45, no. 11, pp. 977–986, 1988.
- R. C. Kessler, P. Berglund, O. Demler et al., “The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R),” Journal of the American Medical Association, vol. 289, no. 23, pp. 3095–3105, 2003.
- G. de Girolamo, G. Polidori, P. Morosini et al., “La prevalenza dei disturbi mentali in italia. Il progetto ESEMED-WMH,” Una sintesi. Roma: Centro Nazionale di Epidemiologia, Sorveglianza e Promozione della Salute, 2005.
- World Health Organisation, “Depression. What is depression?” World Health Organisation, Geneva, Switzerland, 2011, http://www.who.int/mental_health/management/depression/definition/en/index1.html.
- T. B. Üstün, J. L. Ayuso-Mateos, S. Chatterji, C. Mathers, and C. J. L. Murray, “Global burden of depressive disorders in the year 2000,” British Journal of Psychiatry, vol. 184, pp. 386–392, 2004.
- L. Y. Abramson, G. I. Metalsky, and L. B. Alloy, “Hopelessness depression: a theory-based subtype of depression,” Psychological Review, vol. 96, no. 2, pp. 358–372, 1989.
- A. T. Beck, Depression: Clinical, Experimental, and Theoretical Aspects, Harper & Row, New York, NY, USA, 1967.
- A. T. Beck, “Cognitive models of depression,” Journal of Cognitive Psychotherapy, vol. 1, pp. 5–37, 1987.
- M. Zhong, X. Wang, J. Xiao et al., “Amygdala hyperactivation and prefrontal hypoactivation in subjects with cognitive vulnerability to depression,” Biological Psychology, vol. 88, no. 2-3, pp. 233–242, 2011.
- L. Y. Abramson, L. B. Alloy, B. L. Hankin et al., “Cognitive vulnerability-stress models of depression in a self-regulatory and psychobiological context,” in Handbook of Depression, I. H. Gotlib and C. L. Hammen, Eds., pp. 268–294, The Guilford Press, New York, NY, USA, 2002.
- L. B. Alloy, L. Y. Abramson, W. G. Whitehouse, M. E. Hogan, C. Panzarella, and D. T. Rose, “Prospective incidence of first onsets and recurrences of depression in individuals at high and low cognitive risk for depression,” Journal of Abnormal Psychology, vol. 115, no. 1, pp. 145–156, 2006.
- B. M. Iacoviello, L. B. Alloy, L. Y. Abramson, W. G. Whitehouse, and M. E. Hogan, “The course of depression in individuals at high and low cognitive risk for depression: a prospective study,” Journal of Affective Disorders, vol. 93, no. 1–3, pp. 61–69, 2006.
- J. Evans, J. Heron, G. Lewis, R. Araya, and D. Wolke, “Negative self-schemas and the onset of depression in women: longitudinal study,” British Journal of Psychiatry, vol. 186, pp. 302–307, 2005.
- C. S. Carver and R. J. Ganellen, “Depression and components of self-punitiveness: high standards, self-criticism, and overgeneralization,” Journal of Abnormal Psychology, vol. 92, no. 3, pp. 330–337, 1983.
- C. S. Carver, L. La Voie, J. Kuhl et al., “Cognitive concomitants of depression: a further examination of the roles of generalization, high standards, and self-criticism,” Journal of Social and Clinical Psychology, vol. 7, pp. 350–365, 1988.
- C. S. Carver, “Generalization, adverse events, and development of depressive symptoms,” Journal of Personality, vol. 66, no. 4, pp. 606–619, 1998.
- A. M. Hayes, M. S. Harris, and C. S. Carver, “Predictors of self-esteem variability,” Cognitive Therapy and Research, vol. 28, no. 3, pp. 369–385, 2004.
- L. R. Eisner, S. L. Johnson, and C. S. Carver, “Cognitive responses to failure and success relate uniquely to bipolar depression versus mania,” Journal of Abnormal Psychology, vol. 117, no. 1, pp. 154–163, 2008.
- C. S. Carver and S. L. Johnson, “Tendencies toward mania and tendencies toward depression have distinct motivational, affective, and cognitive correlates,” Cognitive Therapy and Research, vol. 33, no. 6, pp. 552–569, 2009.
- M. Balsamo and A. Saggino, Il Teate Depression Inventory—Manuale di Standardizzazione, Hoegrefe, Berne, Germany.
- A. T. Beck, A. Weissman, D. Lester, and L. Trexler, “The measurement of pessimism: the hopelessness scale,” Journal of Consulting and Clinical Psychology, vol. 42, no. 6, pp. 861–865, 1974.
- C. S. Carver, R. J. Ganellen, and V. Behar-Mitrani, “Depression and cognitive style. Comparisons between measures,” Journal of Personality and Social Psychology, vol. 49, no. 3, pp. 722–728, 1985.
- American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders, American Psychiatric Association, Washington, DC, USA, 4th edition, 2000.
- P. A. Arbisi, “Review of the beck depression inventory-II,” in The 14th Mental Measurements Yearbook, B. S. Plake and J. C. Impara, Eds., Buros Institute of Mental Measurements, Lincoln, Neb, USA, 2001.
- M. Balsamo and A. Saggino, “Test per l’assessment della depressione nel contesto italiano: un’analisi critica,” Psicoterapia Cognitiva e Comportamentaie, vol. 13, pp. 167–199, 2007.
- A. T. Beck, G. Brown, R. J. Berchick, B. L. Stewart, and R. A. Steer, “Relationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients,” American Journal of Psychiatry, vol. 147, no. 2, pp. 190–195, 1990.
- E. David Klonsky, R. Kotov, S. Bakst, J. Rabinowitz, and E. J. Bromet, “Hopelessness as a predictor of attempted suicide among first admission patients with psychosis: a 10-year cohort study,” Suicide and Life-Threatening Behavior, vol. 42, no. 1, pp. 1–10, 2012.
- M. Bouvard, S. Charles, J. Guerin, G. Aimard, and J. Cottraux, “Study of Beck's hopelessness scale. Validation and factor analysis,” L'Encephale, vol. 18, no. 3, pp. 237–240, 1992.
- M. Innamorati, M. Pompili, X. Gonda et al., “Psychometric properties of the Gotland Scale for Depression in Italian psychiatric inpatients and its utility in the prediction of suicide risk,” Journal of Affective Disorders, vol. 132, no. 1-2, pp. 99–103, 2011.
- M. Innamorati, M. Pompili, G. Serafini et al., “Psychometric properties of the suicidal history self-rating screening scale,” Archives of Suicide Research, vol. 15, no. 1, pp. 87–92, 2011.
- M. Pompili, R. Tatarelli, J. R. Rogers, and D. Lester, “The hopelessness scale: a factor analysis,” Psychological Reports, vol. 100, no. 2, pp. 375–378, 2007.
- M. Pompili, P. Iliceto, D. Lester et al., BHS Beck Hopelessness Scale: Manuale, Giunti O.S. Organizzazioni Speciali, Firenze, Italy, 2009.
- G. Rasch, Probabilistic Models for Some Intelligence and Attainment Tests, University of Chicago Press, Chicago, Ill, USA, 1980.
- D. Andrich, “Models for measurement, precision, and the nondichotomization of graded responses,” Psychometrika, vol. 60, no. 1, pp. 7–26, 1995.
- B. P. O'Connor, “SPSS and SAS programs for determining the number of components using parallel analysis and Velicer's MAP test,” Behavior Research Methods, Instruments, and Computers, vol. 32, no. 3, pp. 396–402, 2000.
- W. F. Velicer, “Determining the number of components from the matrix of partial correlations,” Psychometrika, vol. 41, no. 3, pp. 321–327, 1976.
- R. D. Ledesma and P. Valero-Mora, “Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out Parallel Analysis,” Practical Assessment, Research & Evaluation, vol. 12, pp. 1–11, 2007.
- K. G. Jöreskog and D. Sörbom, “LISREL for Windows [Computer software],” Lincolnwood, Ill, USA, Scientific Software International, 2006.
- M. W. Browne and R. Cudek, “Alternative ways of assessing model fit,” in Testing Structural Equation Models, J. S. Long, Ed., pp. 136–162, Sage, Newbury Park, Calif, USA, 1993.
- L.-T. Hu and P. M. Bentler, “Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives,” Structural Equation Modeling, vol. 6, no. 1, pp. 1–55, 1999.
- K. G. Joreskog and D. Sorbom, LISREL 7: User's Reference Guide, Scientific Software, Mooresville, Ind, USA, 1989.
- F. J. Floyd and K. F. Widaman, “Factor analysis in the development and refinement of clinical assessment instruments,” Psychological Assessment, vol. 7, no. 3, pp. 286–299, 1995.
- J. C. Nunnally and I. H. Bernstein, Psychometric Theory, McGraw-Hill, New York, NY, USA, 3rd edition, 1994.
Copyright © 2013 Marco Innamorati et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.