Research Article | Open Access
Maira Okada de Oliveira, Ricardo Nitrini, Mônica Sanches Yassuda, Sonia Maria Dozzi Brucki, "Vocabulary Is an Appropriate Measure of Premorbid Intelligence in a Sample with Heterogeneous Educational Level in Brazil", Behavioural Neurology, vol. 2014, Article ID 875960, 6 pages, 2014. https://doi.org/10.1155/2014/875960
Vocabulary Is an Appropriate Measure of Premorbid Intelligence in a Sample with Heterogeneous Educational Level in Brazil
Crystallized intelligence refers to one’s knowledge base and can be measured by vocabulary tests. Fluid intelligence is related to nonverbal aspects of intelligence, depends very little on previously acquired knowledge, and can be measured by tests such as Block Design (BD) and Raven Colored Matrices (RCM). Premorbid intelligence quotient (IQ) refers to one’s intellectual ability level previous to the onset of disorders like mild cognitive impairment (MCI) and Alzheimer’s disease (AD) and it is important to estimate disease severity. The objective was to compare performance in tests that measure crystallized and fluid intelligence in healthy subjects and patients with amnestic MCI (aMCI) and AD. One hundred forty-four participants (aMCI (), AD (), and healthy controls ()) were submitted to neuropsychological tests (WAIS-III vocabulary, BD, and RCM). There were significant among groups, except for vocabulary, indicating a relative stability of crystallized intelligence in the continuum from normal to pathological cognitive decline. Vocabulary seems to be stable during the progression of the disease and useful as a measure of premorbid intelligence, that is, to estimate previous function in relation to the level of education and, as a collateral measure of cognition in people with low education.
In the early 1940s, two types of intelligence were distinguished . One type of intelligence was described to have a physiological substrate, to reach its peak in early adulthood, and to decline linearly with age. The other type was purported to be influenced by cultural experience and to remain preserved throughout most of adulthood. Years later, a bifactorial model of intelligence described the former type as fluid and the latter as crystallized intelligence . This model proved to be quite influential in the field of Gerontology as longitudinal studies confirmed their differential paths of change in adulthood .
Crystallized intelligence is associated with an individual’s knowledge base, such as knowing the vocabulary and rules of the language and historical facts. It encompasses skills required in the navigation of everyday situations and it is usually associated with the notion of “social intelligence” or “common sense” . Crystallized intelligence is influenced by educational experience. Vocabulary and world knowledge are tasks frequently used to assess this type of intelligence [5–7]. Previous studies have repeatedly shown that crystallized intelligence remains stable in adulthood .
On the other hand, fluid intelligence relates to tasks that depend little on previously acquired knowledge and culture. It is thought to be composed of mental operations that individuals engage in when faced with a relatively new challenge, which cannot be executed automatically [4, 8]. Longitudinal studies have reported that it follows a linear trajectory of decline after the third decade of life [9, 10]. Tests such as Block Design (BD)  and Raven Colored Matrices (RCM) are frequently used to measure fluid intelligence as they require the ability to solve novel problems [10–13]. Traditional measures of fluid intelligence may also include perceptual speed and mental rotation .
Crystallized and fluid intelligence measures, such as Vocabulary and BD, respectively, have been used in neuropsychology to generate an estimate of the intelligence quotient (IQ) [15–20]. Although the IQ index has been highly questioned in its ability to predict future outcomes in children and adolescents, in the cognitive aging field, it has been used as a proxy measure for cognitive reserve, that is, one individual’s ability to withstand neuropathological lesions before showing cognitive decline . Knowing one’s premorbid IQ, or the estimated intellectual performance level that a person had before the onset of a disease, may be useful in assessing the magnitude of cognitive decline in mild cognitive impairment (MCI) and Alzheimer’s disease or other dementia subtypes. For this purpose, ideal premorbid IQ measures should be little impacted by neurocognitive disease. Using premorbid IQ measures that change as the disease progresses could lead to the underestimation of dementia severity.
Premorbid IQ has been measured by tests based on reading ability, such as the National Adult Reading Test (NART)  or Wide Range Achievement Test-Revised (WRAT-R) . Vocabulary tests have also been extensively used [24–27]. This practice rests on the assumption that these linguistic abilities will only decline in the later stages of neurodegenerative diseases such as AD. In fact, some studies have shown that tests measuring linguistic abilities do not differ in healthy individuals, MCI, and AD [28–31]. On the other hand, Taylor  found that performance on the NART is clearly influenced by severity of dementia. Therefore, some authors have suggested that premorbid abilities should be estimated based on demographic variables, such as education, social class, and occupational attainment or level of engagement in cognitive activities .
In developing countries, the evaluation of cognition in individuals with low levels of education is a major challenge, as low cognitive performance may be due to neurological disorder or low exposure to formal education, and heterogeneous quality of schooling, as well. Therefore, in this context, assessment of premorbid IQ might be useful to estimate cognitive change . To date, little is known about ideal measures of premorbid intelligence in the context of heterogeneous education background, as most studies in this field have been conducted in high-income countries.
The present study was designed to compare performance of tests that measure crystallized and fluid intelligence in healthy older adults and patients with amnestic MCI (aMCI) and AD. Our aim was to determine which tests would be stable among the diagnostic groups, so that they may be used as a measure of premorbid intelligence in a sample with heterogeneous educational levels.
2.1. Participants and Procedures
The sample consisted of 144 older adults who were classified into three levels of cognitive performance: normal controls (NC) (), patients diagnosed as having amnestic mild cognitive impairment (aMCI) (), or patients diagnosed as having AD ().
The following criteria were used for inclusion in the study: at least one year of formal or informal education, being able to read the one sentence, being 60 years of age and older, and presence of an informant. Exclusion criteria included having 15-item Geriatric Depression Scale score higher than six points and the presence of other psychiatric disorders or sensory deficits that might hinder cognitive testing . Participants were not excluded from the study if they were taking antidepressants (for at least two months in stable doses) and GDS scores were six and lower.
NC were healthy volunteers, without history of neurological or psychiatric diseases, who showed no evidence of cognitive impairment and depression (lower than six) . Healthy controls were included in the study if they fulfilled these criteria: absence of cognitive decline according to education-adjusted cut-off scores of the Mini-Mental State Examination (MMSE)  and a score lower than two on the Functional Activities Questionnaire (FAQ) . They were recruited at outpatient units at the hospitals mentioned below which assisted patients who had conditions which did not affect cognition, such as internal medicine.
Patients with aMCI and AD were recruited from the Cognitive Neurology Outpatient Clinic at the University of São Paulo School of Medicine and the Cognitive Neurology Outpatient Clinic from the Santa Marcelina Hospital in São Paulo, Brazil.
Diagnostic criteria for probable AD were based on NINCDS-ADRDA . All AD patients were being treated with stable doses of cholinesterase inhibitors. Patients were excluded from the study if they had moderate or severe dementia, dementia caused by other etiologies, and a Cornell Scale for Depression in Dementia score higher than seven .
Diagnostic criteria for aMCI were based on the international consensus by Winblad et al.  aMCI patients had scores lower than five in the FAQ and cognitive impairment in at least one cognitive test including an episodic memory measure. The aMCI group included patients with impairment exclusively in episodic memory (single domain aMCI) and in episodic memory and other cognitive domains (multiple domain aMCI). Cognitive impairment was identified when performance in cognitive tests (adjusted by education and age) was below 1.5 standard deviations (SD).
All patients and NC participants were evaluated by neuropsychologists and neurologists of the services mentioned above. They completed a comprehensive neuropsychological battery and their informants completed functional evaluation questionnaires, as described below. Laboratory and neuroimaging exams were carried according to the recommended consensus criteria of the Brazilian Academy of Neurology . Clinical diagnosis was completed by trained neurologists after the review of all the available clinical information.
The neuropsychological assessment included the following tests: Dementia Rating Scale [41, 42], Mini-Mental State Examination [35, 43], Rey Auditory Verbal Learning Test (RAVLT) , 10 black and white pictures of the Brief Cognitive Screening Battery [45–47], Block Design (BD) and Vocabulary subtests from the Wechsler Adult Intelligence Scale (WAIS-III) [6, 48], and Raven’s Colored Matrices (RCM) [49, 50].
In the present analysis, BD and RCM were used as measures of fluid intelligence and Vocabulary was used as a measure of crystalized intelligence. Estimated IQ scores were calculated by summing the standardized scores of BD and Vocabulary, according to usual procedures .
This study was approved by the Ethics Committee of the Hospital das Clinicas from the University of São Paulo School of Medicine and Hospital Santa Marcelina under the Protocol no. 0632/09. All subjects who agreed to participate, or the caregiver of the dementia patients, signed a written informed consent.
2.3. Statistical Analysis
Normal distribution was evaluated with Kolmogorov-Smirnov test. As most cognitive variables did not follow normal distribution, diagnostic groups were compared with the Kruskal-Wallis test and multiple comparisons test. For categorical variables such as sex, the chi-square test was used. Spearman’s correlation analyses were calculated to investigate the associations among age, education, MMSE, Vocabulary, BD, and RCM.
Two regression analyses were computed with clinical diagnosis as the dependent variable (NC × MCI and NC × AD) and age, education, sex, Vocabulary, BD, and RCM as independent variables. All statistical analyses were carried out using the Statistical Package for the Social Sciences (SPSS) program, version 15.0. The level of significance accepted was .
There were no significant differences among groups regarding gender distribution and education. As to age, the AD group was older than NC and aMCI (Table 1).
|Note. P value for gender comparisons refers to the chi-square test, and, for age and education, it refers to the Kruskal-Wallis test; aNC differ from AD; aMCI differs from AD. F: female; M: male; SD: standard deviation; NC: normal controls; aMCI: amnestic mild cognitive impairment; AD: Alzheimer’s disease; Min: minimum value; Max: maximum value. |
There were significant differences between the NC and the aMCI and the AD groups for the MMSE, BD, RCM, and estimated IQ. No differences were observed among the three groups for Vocabulary, indicating stability of this variable across diagnostic groups (Table 2).
|Note. P value refers to Kruskal-Wallis test; SD: standard deviation; MCI: mild cognitive impairment; AD: Alzheimer’s disease; MMSE: Mini-Mental State Exam; IQ: intelligence quotient; BD: Block Design; RCM: Raven Colored Matrices.|
aAll groups differ.
bNC differ from AD and aMCI; MCI is equal to AD.
Spearman correlations (Table 3) indicated that age was not associated with MMSE scores. Education was associated with MMSE scores in the three diagnostic groups. Vocabulary, BD, and RCM were associated with MMSE scores among NC and aMCI participants, but not among AD patients.
|Note. *P < 0.05; **P < 0.01; MMSE: Mini-Mental State Exam; BD: Block Design; RCM: Raven Colored Matrices; aMCI: amnestic mild cognitive impairment; AD: Alzheimer’s disease.|
Regression analyses, with clinical diagnosis as the dependent variable, suggested that the scores for RCM were associated with aMCI diagnosis (Table 4) and BD and age were associated with AD diagnosis. Scores for Vocabulary are not significantly associated with MCI or AD diagnosis.
|Note. MMSE: Mini-Mental State Exam; BD: Block Design; RCM: Raven Colored Matrices; aMCI: amnestic mild cognitive impairment; AD: Alzheimer’s disease.|
The goal of the present study was to compare the performance of healthy controls, aMCI, and AD patients with heterogeneous levels of education on measures of crystallized and fluid intelligence so that an appropriate measure of premorbid intelligence could be identified. Vocabulary scores were statistically equivalent across the three diagnostic groups, suggesting that it would be an appropriate measure of premorbid IQ in a sample with heterogeneous educational background. Regression analyses confirmed these results, as Vocabulary scores were not associated with diagnosis of aMCI or AD.
Having both premorbid and current measures of intelligence may be useful in determining the severity of the disease affecting the patient, because the examiner is able to estimate the patient’s premorbid abilities (using a Vocabulary test) and how much the disease has impaired his or her current performance (using RCM and BD). In fact, cognitive scores may need to be interpreted according to premorbid IQ levels, as suggested by recent studies in Portugal . These measures may also be useful in a rehabilitation program as Vocabulary scores may indicate visible intervention strategies.
In patients with limited education, it may be difficult to interpret fluid intelligence measures (current intelligence), as low scores might be due to lack of education or due to neurodegenerative processes affecting regions used to perform the tests. By using the Vocabulary subtest, the examiner may have some knowledge of the premorbid intellectual resources of this patient. Clinicians currently use demographic information (education and occupation) to estimate previous functioning; however, some patients have greater cognitive reserve through lifelong habits (i.e., reading, writing and high demand activities) and often surpass patients who may have more years of formal education. Questionnaires may be used to estimate reserve associated with intellectual engagement, yet, such questionnaires need to be validated for specific populations, whereas WAIS Vocabulary subtest is validated and normed for most nations, enabling cross-cultural comparisons.
The limitations of this study were that the examiner was not blinded to diagnosis and there were age differences between groups; however, age did not correlate with any cognitive results. In conclusion, Vocabulary seems to be a measure of premorbid intelligence and it may be useful to estimate previous function in relation to educational level and the magnitude of cognitive change.
Conflict of Interests
The authors have no conflict of interests with any commercial or other associations in connection with the submitted paper.
Maira Okada de Oliveira designed the study, collected and analyzed the data, and wrote the paper. Ricardo Nitrini designed the study and supervised the data collection. Mônica Sanches Yassuda assisted with data analyses and assisted with writing the paper. Sonia Maria Dozzi Brucki designed the study, supervised the data collection, and assisted with writing the paper.
This study received financial support from Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP) Grant no. 2009/06475-5.
- D. O. Hebb, “Clinical evidence concerning the nature of normal adult test performance,” Psychological Bulletin, vol. 38, p. 593, 1941.
- J. L. Horn and R. B. Cattell, “Age differences in primary mental ability factors,” Journals of Gerontology, vol. 21, no. 2, pp. 210–220, 1966.
- K. W. Schaie and S. L. Willis, “Age difference patterns of psychometric intelligence in adulthood: generalizability within and across ability domains,” Psychology and Aging, vol. 8, no. 1, pp. 44–55, 1993.
- J. L. Horn, “Measurement of intellectual capabilities: a review of theory,” in Woodcock-Johnson Technical Manual, K. S. McGrew, J. K. Werder, and R. W. Woodcock, Eds., pp. 197–232, Riverside, Chicago, Ill, USA, 1991.
- L. J. Cronbach, Fundamentos da Testagem Psicológica, Artes Médicas, Porto Alegre, Brazil, 1996.
- E. Nascimento, “Adaptação, validação e normatização do WAIS-III para uma amostra brasileira,” in WAIS-III: Manual Para Administração e Avaliação, D. Wechsler, Ed., Casa do Psicólogo, São Paulo, Brazil, 2004.
- J. E. Birren and D. F. Morrison, “Analysis of the WAIS subtests in relation to age and education,” Journal of gerontology, vol. 16, pp. 363–369, 1961.
- K. S. McGrew, “Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework,” in Contemporary Intellectual Assessment Theories, Tests, and Issues, D. P. Flanagan, J. L. Gensahaft, and P. L. Harrison, Eds., pp. 51–79, Guilford, New York, NY, USA, 1997.
- J. L. Horn and R. B. Cattell, “Age differences in fluid and crystallized intelligence,” Acta Psychologica, vol. 26, pp. 107–129, 1967.
- J. M. Bugg, N. A. Zook, E. L. DeLosh, D. B. Davalos, and H. P. Davis, “Age differences in fluid intelligence: contributions of general slowing and frontal decline,” Brain and Cognition, vol. 62, no. 1, pp. 9–16, 2006.
- J. C. Raven, Manual for the Colored Progressive Matrices (Revised), NFER-Nelson, Windsor, UK, 1984.
- C. H. M. Smits, J. H. Smit, Heuvel, and N. Jonker C, “Norms for an abbreviated Raven's coloured progressive matrices in an older sample,” Journal of Clinical Psychology, vol. 53, pp. 687–697, 1997.
- E. Dierckx, S. Engelborghs, R. de Raedt et al., “Differentiation between dementia and depression among older persons: can the difference between actual and premorbid intelligence be useful?” Journal of Geriatric Psychiatry and Neurology, vol. 21, no. 4, pp. 242–249, 2008.
- A. Miyake, N. P. Friedman, D. A. Rettinger, P. Shah, and M. Hegarty, “How are visuospatial working memory, executive functioning, and spatial abilities related? a latent-variable analysis,” Journal of Experimental Psychology: General, vol. 130, no. 4, pp. 621–640, 2001.
- J. T. Kenny, L. Friedman, R. L. Findling et al., “Cognitive impairment in adolescents with schizophrenia,” The American Journal of Psychiatry, vol. 154, no. 11, pp. 1613–1615, 1997.
- S. J. Thompson, L. Leigh, R. Christensen et al., “Immediate neurocognitive effects of methylphenidate on learning-impaired survivors of childhood cancer,” Journal of Clinical Oncology, vol. 19, no. 6, pp. 1802–1808, 2001.
- W. J. Ringe, K. C. Saine, L. H. Lacritz, L. S. Hynan, and C. M. Cullum, “Dyadic short forms of the Wechsler adult intelligence scale-III,” Assessment, vol. 9, no. 3, pp. 254–260, 2002.
- S. Tramontina, S. Martins, M. B. Michalowski et al., “Estimated mental retardation and school dropout in a sample of students from state public schools in Porto Alegre, Brazil,” Revista Brasileira de Psiquiatria, vol. 24, no. 4, pp. 177–181, 2002.
- M. A. S. Mantoan, T. I. da Silva, N. B. Alonso et al., “Neuropsychological assessment and quality of life in patients with refractory temporal lobe epilepsy related to hippocampal sclerosis,” Journal of Epilepsy and Clinical Neurophysiology, vol. 12, no. 4, pp. 201–206, 2006.
- A. C. Coutinho and E. Nascimento, “Abbreviated forms of the WAIS-III for intelligence assessment,” Avaliação Psicológica, vol. 9, no. 1, pp. 25–33, 2010.
- Y. Stern, “Cognitive reserve in ageing and Alzheimer’s disease,” The Lancet Neurology, vol. 11, pp. 1006–1012, 2012.
- H. E. Nelson, National Adult Reading Test (NART): Test Manual, NFER Nelson, Windsor, UK, 1982.
- S. Jastak and G. S. Wilkinson, Wide Range Achievement Test, Jastak Associates, Wilmington, Del, USA, 3 edition, 1993.
- A. Wittorf, G. Wiedemann, and S. Klingberg, “Multiple-choice vocabulary intelligence test MWT in schizophrenia: valid measure of premorbid intelligence?” Psychiatrische Praxis, vol. 41, no. 2, pp. 95–100, 2014.
- R. E. Green, B. Melo, B. Christensen, L.-A. Ngo, G. Monette, and C. Bradbury, “Measuring premorbid IQ in traumatic brain injury: an examination of the validity of the Wechsler Test of Adult Reading (WTAR),” Journal of Clinical and Experimental Neuropsychology, vol. 30, no. 2, pp. 163–172, 2008.
- D. Flügel, A. O'Toole, P. J. Thompson et al., “A neuropsychological study of patients with temporal lobe epilepsy and chronic interictal psychosis,” Epilepsy Research, vol. 71, no. 2-3, pp. 117–128, 2006.
- C. Solé-Padullés, D. Bartrés-Faz, C. Junqué et al., “Brain structure and function related to cognitive reserve variables in normal aging, mild cognitive impairment and Alzheimer's disease,” Neurobiology of Aging, vol. 30, no. 7, pp. 1114–1124, 2009.
- A. M. Maddrey, C. M. Cullum, M. F. Weiner, and C. M. Filley, “Premorbid intelligence estimation and level of dementia in Alzheimer's disease,” Journal of the International Neuropsychological Society, vol. 2, no. 6, pp. 551–555, 1996.
- R. E. O’Carroll, E. M. Baike, and J. E. Whittick, “Does the national adult reading test hold in dementia?” British Journal of Clinical Psychology, vol. 26, pp. 315–316, 1987.
- L. Paque and E. K. Warrington, “A longitudinal study of reading ability in patients suffering from dementia,” Journal of the International Neuropsychological Societ, vol. 1, no. 6, pp. 517–524, 1995.
- O. Almkvist and I.-M. Tallberg, “Cognitive Decline From Estimated Premorbid Status Predicts Neurodegeneration in Alzheimer's Disease,” Neuropsychology, vol. 23, no. 1, pp. 117–124, 2009.
- R. Taylor, “National Adult Reading Test performance in established dementia,” Archives of Gerontology and Geriatrics, vol. 29, no. 3, pp. 291–296, 2000.
- P. Vemuri, S. D. Weigand, S. A. Przybelski et al., “Cognitive reserve and Alzheimer's disease biomarkers are independent determinants of cognition,” Brain, vol. 134, no. 5, pp. 1479–1492, 2011.
- O. P. Almeida and S. A. Almeida, “Confiabilidade da versão brasileira da Escala de Depressão em Geriatria (GDS) versão reduzida,” Arquivos de Neuro-Psiquiatria, vol. 57, no. 2, pp. 421–426, 1999.
- S. M. D. Brucki, R. Nitrini, P. Caramelli, P. H. F. Bertolucci, and I. H. Okamoto, “Sugestões para o uso do Mini-Exame do Estado Mental no Brasil,” Arquivos de Neuro-Psiquiatria, vol. 61, no. 3, pp. 777–781, 2003.
- R. I. Pfeffer, T. T. Kurosaki, and C. H. Harrah Jr., “Measurement of functional activities in older adults in the community,” Journals of Gerontology, vol. 37, no. 3, pp. 323–329, 1982.
- G. McKhann, D. Drachman, and M. Folstein, “Clinical diagnosis of Alzheimer's disease: Report of the NINCDS-ADRDA work group under the auspices of Department of Health and Human Services Task Force on Alzheimer's disease,” Neurology, vol. 34, no. 7, pp. 939–944, 1984.
- M. T. Carthery-Goulart, R. Areza-Fegyveres, R. R. Schultz et al., “Brazilian version of the cornell depression scale in dementia,” Arquivos de Neuro-Psiquiatria, vol. 65, no. 3, pp. 912–915, 2007.
- B. Winblad, K. Palmer, M. Kivipelto et al., “Mild cognitive impairment—beyond controversies, towards a consensus: report of the International Working Group on Mild Cognitive Impairment,” Journal of Internal Medicine, vol. 256, no. 3, pp. 240–246, 2004.
- R. Nitrini, P. Caramelli, C. M. C. Bottino, B. P. Damasceno, S. M. D. Brucki, and R. Anghinah, “Diagnóstico de doença de Alzheimer no Brasil: critérios diagnósticos e exames complementares,” Arquivos de Neuro-Psiquiatria, vol. 63, no. 3, pp. 713–719, 2005.
- S. Mattis, Dementia Rating Scale. Professional Manual, Psychological Assessment Resource, Lutz, Fla, USA, 1988.
- C. S. Porto, H. C. Fichman, P. Caramelli, V. S. Bahia, and R. Nitrini, “Brazilian version of the mattis dementia rating scale: diagnosis of mild dementia in alzheimer's disease,” Arquivos de Neuro-Psiquiatria, vol. 61, no. 2, pp. 339–345, 2003.
- M. F. Folstein, S. E. Folstein, and P. R. McHugh, “Mini-mental state. A practical method for grading the cognitive state of patients for the clinician,” Journal of Psychiatric Research, vol. 12, pp. 189–198, 1975.
- L. F. Malloy-Diniz, V. A. P. Lasmar, L. D. S. R. Gazinelli, D. Fuentes, and J. V. Salgado, “The Rey Auditory-Verbal Learning Test: applicability for the Brazilian elderly population,” Revista Brasileira de Psiquiatria, vol. 29, no. 4, pp. 324–329, 2007.
- R. Nitrini, B. H. Lefèvre, S. C. Mathias et al., “Neuropsychological tests of simple application for diagnosing dementia,” Arquivos de Neuro-Psiquiatria, vol. 52, no. 4, pp. 457–465, 1994.
- R. Nitrini, P. Caramelli, E. Herrera Jr. et al., “Performance of illiterate and literate nondemented elderly subjects in two tests of long-term memory,” Journal of the International Neuropsychological Society, vol. 10, no. 4, pp. 634–638, 2004.
- R. Nitrini, P. Caramelli, C. S. Porto et al., “Brief cognitive battery in the diagnosis of mild Alzheimer`s disease in subjects with medium and high levels of education,” Dementia e Neuropsychologia, vol. 1, pp. 32–36, 2007.
- D. Wechsler, WAIS-III: Administration and Scoring Manual, The Psychological Corporation, San Antonio, Tex, USA, 1997.
- J. C. Raven, Manual for the Coloured Progressive Matrices (Revised), NFER-Nelson, Windsor, UK, 1984.
- A. L. Angelini, I. C. B. Alves, E. M. Custódio, W. F. Duarte, and J. L. M. Duarte, Manual Matrizes Progressivas Coloridas de Raven: Escala Especial, Centro Editor de Testes e Pesquisas em Psicologia, São Paulo, Brazil, 1999.
- L. Alves, M. R. Simões, C. Martins, S. Freitas, and I. Santana, “Premorbid IQ influence on screening tests' scores in healthy patients and patients with cognitive impairment,” Journal of Geriatric Psychiatry and Neurology, vol. 26, no. 2, pp. 117–126, 2013.
Copyright © 2014 Maira Okada de Oliveira et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.