Clinical Study | Open Access
Livia M. M. Pontes, Camila B. Martins, Isabel C. Napolitano, Juliana R. Fonseca, Graça M. R. Oliveira, Sandra M. K. Iso, Anny K. P. M. Menezes, Adriana D. B. Vizzotto, Elaine S. di Sarno, Hélio Elkis, "Cognitive Training for Schizophrenia in Developing Countries: A Pilot Trial in Brazil", Schizophrenia Research and Treatment, vol. 2013, Article ID 321725, 10 pages, 2013. https://doi.org/10.1155/2013/321725
Cognitive Training for Schizophrenia in Developing Countries: A Pilot Trial in Brazil
Cognitive deficits in schizophrenia can massively impact functionality and quality of life, furthering the importance of cognitive training. Despite the development of the field in Europe and in the United States, no programmes have been developed and tested in developing countries. Different cultural backgrounds, budget restrictions, and other difficulties may render treatment packages created in high income countries difficult for adoption by developing nations. We performed a pilot double-blind, randomized, controlled trial in order to investigate the efficacy and feasibility of an attention and memory training programme specially created in a developing nation. The intervention used simple, widely available materials, required minimal infrastructure, and was conducted in groups. The sample included seventeen stable Brazilians with schizophrenia. Sessions were conducted weekly during five months. The cognitive training group showed significant improvements in inhibitory control and set-shifting over time. Both groups showed improvements in symptoms, processing speed, selective attention, executive function, and long-term visual memory. Improvements were found in the control group in long-term verbal memory and concentration. Our findings reinforce the idea that cognitive training in schizophrenia can be constructed using simple resources and infrastructure, facilitating its adoption by developing countries, and it may improve cognition.
Impaired cognitive functioning in schizophrenia was early recognized [1, 2] and described as one of the core symptoms . Deficits may be present since the first manifestations of the disease or may appear before the onset of symptoms . Up to 80% of all people with schizophrenia may present significant deficits .
Main deficits involve attention, memory, and executive functions, but other domains can also be affected, such as visuospatial ability, language, learning, and motor coordination [3, 6, 7]. Cognitive deficits have been related to impairment in functional abilities [8–10], compromising the ability to lead an independent life, to benefit from psychosocial treatments, to create and maintain social relationships, to find and keep a job, and to maintain academic development [6, 11–13]. Improvements in cognitive functions can increase benefits from other psychosocial rehabilitation programmes ; therefore, treatment of schizophrenia could also include cognitive training.
A large number of outpatient consultations and re-hospitalization rates , difficulty in maintaining a job , and claims for sickness/disability benefits at an early age  are some factors that place schizophrenia amongst the most costly illnesses in the world . In Brazil, cost estimates for the public health system in the most economically developed State (São Paulo) indicate that schizophrenia costs correspond to 2.2% of its total expenditure on health .
Despite the fact that guidelines published by high income countries, The Schizophrenia Patients Outcome Research Team (PORT)  in the USA and the National Institute for Health and Clinical Excellence (NICE) in the UK , did not recommend cognitive remediation as an effective treatment, the largest and most updated meta-analysis  indicated durable and positive effects on cognition and psychosocial functioning. Connections between results and aspects of the treatment (type of approach used and the use of computerized resources) were not found. Clinically stable persons seem to benefit more from interventions, and improvement in functioning is enhanced when cognitive training is used together with psychiatric interventions. Methodological rigor was not found to be related to treatment results as the most rigorous studies found only small to moderate effects. The type of control condition (active versus passive) also does not interfere with cognitive outcomes .
Even in low- and middle-income countries (LAMICs), a recent report  indicated that cognitive remediation is more cost-effective than usual care in improving working memory and executive functioning at no additional cost.
Numerous treatment programmes and studies have been created and conducted in the United States and Europe [23, 25]. To the best of our knowledge, no programmes have been created and tested in developing countries. It is estimated that 25  to 41.7 million people  are affected by schizophrenia in LAMIC; hence, the majority of persons affected live in such countries .
Developing countries suffer from a lack of psychosocial interventions for treating many mental health conditions and a lack of qualified mental health professionals [26, 29–31]. Suggestions to tackle some of these difficulties include training nonspecialist health professionals to deliver psychosocial interventions [29, 30], employment of inexpensive technology, and programmes conducted in groups, which not only are more cost effective but can help address social skills’ difficulties in schizophrenia .
These aspects stress the need to create treatment programmes adapted to the challenges faced by LAMIC. Additionally, changes in clinical practice in a developing country are more likely to be adopted by policy makers when the research is conducted in that specific country than when conducted in a high income country .
This study aims to investigate the efficacy and feasibility of a noncomputerized attention and memory training programme for people with schizophrenia, created in a developing country. The programme employed simple and easily accessible materials, was constructed to be delivered in groups, requires minimal infrastructure, and can be facilitated by different trained mental health professionals. Our intent is also to raise awareness of the necessity of more research on the adoption of cognitive remediation programmes for schizophrenia in developing countries.
2.1. Study Locale and IRB Approvals
This study was performed at the Schizophrenia Programme at the Institute of Psychiatry of the University of São Paulo Medical School (FMUSP) and at the Integrated Mental Health Care Centre of the Santa Casa de Misericórdia of São Paulo Hospital. Institution Review Boards of both University hospitals approved the protocol (University of São Paulo General Hospital—Protocol no. 1122/07; Santa Casa de Misericórdia of São Paulo Hospital—Protocol number 162/09).
2.2. Selection of Participants
Eligible participants were assessed by experienced psychiatrists and had to fulfill the diagnostic criteria for schizophrenia according to the DSM-IV-R, be between 18 and 50 years of age, be under treatment with atypical antipsychotic medication, be clinically stable (i.e., a score of 60 or less on the positive and negative syndrome scale for schizophrenia—PANSS) , be fluent in written Portuguese, and agree to sign the informed consent form. Exclusion criteria were a history or evidence of neurological conditions (e.g., epilepsy or brain trauma); an estimated I.Q. (as measured by Vocabulary and Block Design subtests of Wechsler Adult Intelligence Scale Revised—WAIS-R)  under 70 (i.e., below the borderline range); current dependency on alcohol or psychoactive substances, except tobacco; and participation in any cognitive training programme in the previous six months.
Outpatients of both centres were asked by their psychiatrists to voluntarily take part in the research. Fifty-seven outpatients were initially invited. Forty volunteers gave their written consent to take part in the trial. One person was excluded due to the presence of prominent disorganization symptoms. Thirty-five people were screened, and eighteen were included. One participant got a job and had to stop halfway through the study, but her data were included in the analysis (intention-to-treat approach). The final sample comprised seventeen participants. These aspects are illustrated in the CONSORT Diagram, in Figure 1, as well as reasons for not meeting eligibility criteria.
As we aimed to pilot test a treatment programme, there was no sample size calculation.
Two of the authors (LMMP and ADBV) interviewed volunteers for eligibility criteria and demographic data on the first visit. Subjects who met inclusion criteria underwent symptoms and I.Q. evaluations. If the determined scores were achieved, volunteers were sent for cognitive assessment, which was done both at baseline and after intervention and included Trail Making Test , Stroop Color Naming Test , Modified Wisconsin Card Sorting Test [37, 38], and Logical Memory and Visual Reproduction subtests from the Wechsler Memory Scale III .
PANSS evaluations were carried out either by masked psychiatrists or psychologists, who were trained and had a minimum intraclass correlation coefficient of . All the other instruments were applied by masked neuropsychologists who had specialists’ degrees, trained by the Psychology Department of the Institute of Psychiatry at the University of São Paulo Medical School.
Block randomization was generated via the randomization.com website  by a professional who was not involved in the study. This professional created cards designed to assign individuals to one of two conditions: group 1, the experimental group, which received the cognitive training (CT) or group 2, the control condition group, which received reading training.
Although it has been reported that masking allocation of participants has no effect on cognition or functioning in cognitive training in schizophrenia , in order to guarantee the double-blind design, volunteers were told that they would be drawn by lot to take part in one of two kinds of cognitive training. If one of the treatments proved superior to the other, the person could take part in this treatment after the study was over.
Medication dosage was adjusted at the discretion of each participant’s psychiatrist and was not controlled throughout the study.
2.4. Cognitive Attention and Memory Training
Training was conducted by the first author in both treatment centres. It comprised 20 group sessions, in weekly frequency, lasting between 40 and 60 minutes, over 5 months. Although our programme was shorter than the average reported in the literature (32.2 hours divided over 16.7 weeks) , we wanted to test the efficacy of a shorter programme (20 hours, over 20 weeks) due to important hurdles of longer and more intensive treatment programmes in a developing country. Requiring patients to come to the hospital more than once a week is problematic, as patients (a) have limited budgets for transportation, (b) generally live far from treatment centres and (c) there is a limited workforce and a great number of patients, which necessitates mental health professionals being involved in different duties, making it difficult for them to dedicate more time only to one treatment programme.
This programme was created according to the cognitive neuropsychology theory (understanding of the normal performance of the cognitive function to be trained), and cognitive retraining approaches (stimulation of cognitive functions through drill and practice) . It included restorative activities (repetition and practice) and compensatory strategies. Considering that motivation is an important aspect of schizophrenia and can interfere with treatment compliance, activities were developed to be pleasurable and motivating.
Sessions were constructed hierarchically by level of difficulty and were planned to resemble daily activities. Infrastructure demands were minimal: one room large enough to fit 10 people, a table and chairs to accommodate participants and therapist, paper and pencil for participants, and prepared worksheets. Easily accessible materials were used, for example, newspaper headlines, books, magazine pictures, playing cards, music, short stories, supermarket lists, pictures of clothes, objects, and fruits. Activities and worksheets were prepared by two authors (LMMP, HE) and organized in a manual .
The first 10 sessions focused on the training of attention, as this is a basic cognitive function that supports many other functions, including memory . The last 10 sessions concentrated on memory training. Each activity was used in two sessions in order to propitiate a better learning and cognitive efficiency.
The promotion of metacognition through questions about the use of cognition promotes analogical reasoning (i.e., the ability to recognize similarities between tasks), self-regulation, and a more active participation, facilitating learning and generalisation [44, 45]. Contextualisation of activities seems to promote motivation, as the practical usefulness of the activity and its connection to real life situations is made clear . At the beginning of each session, it was explained to participants which cognitive function was going to be practiced and where such function was generally used in daily activities (contextualisation). They were then stimulated (through questions) to think about how they used the function in their lives, difficulties encountered, and the importance of good performance of such function (metacognition). From the second session on, they were also questioned whether they used the previously taught strategies. Barriers to the use (lack of opportunity, forgetfulness, misunderstanding of the strategy, seeing the strategy as too difficult, etc.) were discussed (metacognition).
Verbalisation was taught and stimulated throughout the training as it facilitates information processing and memorisation. Positive reinforcement was also used to acknowledge participants’ involvement and effort in the training, as it has shown to be effective in this population .
As memory impairment in schizophrenia seems to be related to difficulties in organising the material to be remembered , for the memory training two main organisation procedures were used: categorisation and expanded rehearsal [47, 48].
No frequency criterion was used, but absences were checked by telephone, and the person was encouraged to attend the next session.
Detailed description of each activity can be provided by the first author upon request.
2.5. Control Group
The same number, frequency, and duration of sessions were employed in the control group, and training was also conducted by the first author. Training comprised reading activities (magazines or newspapers articles). In order to resemble cognitive training, allow participant blinding, and match groups for professional and participant interaction and motivational aspects, articles were also hierarchically arranged by difficulty level (beginning with shorter ones and moving on to longer ones). A strategy was taught: first the title, subtitles, pictures captions, and charts/tables were read aloud by the therapist, and participants were encouraged to express their views on what was going to be covered by the article. Then, the whole article was read, and participants were requested to express their understanding of the theme and give their opinion on the subject. Texts were presented in the same order to all control groups. Themes involving schizophrenia-related issues were avoided so that this intervention would not resemble psychotherapy.
Absences were also checked by telephone, and the person encouraged to attend the next session.
2.6. Statistical Analysis
Data were analysed according to an intention-to-treat approach and the last observation carried forward of the participant who stopped training halfway through was included in this analysis. Only nonparametric tests were used, and this decision was made on two main pillars: (1) the sample size was very small, and nonparametric tests are less sensitive to outliers; (2) non-parametric tests are suitable for analyses of continuous, ordinal variables .
For baseline comparisons between groups, the Mann-Whitney Test was used for the continuous variables, and the Chi-squared test was used for the categorical variables. For cognitive performance comparisons between the experimental and control groups at different moments (baseline and after intervention), a nonparametric analysis of repeated measures [49–52] was used. This method tests the hypotheses of the existence of an effect either between groups (CT and control) or within groups (repetitions-changes over time), as well as the interaction between these factors (groups and changes over time). Detailed descriptions of this method can be obtained elsewhere [49–51, 53].
Groups were matched for demographic and clinical characteristics at baseline, except for Visual Reproduction II, in which the experimental group had a higher score than the control group. Treatment attendance indicated that although the control group had a higher mean of attendance than the experimental group such difference was not significant (Table 1).
|SE: standard error, °Fisher's exact test, and *Mann-Whitney test for independent samples.|
SPU: Schizophrenia Project Unit at the Institute of Psychiatry of University of São Paulo (USP) Medical School.
PANSS: positive and negative syndrome scale for schizophrenia, MWCST: modified Wisconsin card sorting test.
After five months of cognitive training, significant differences were found within groups both on the positive () and the general psychopathology () subscales of the PANSS, indicating that over time, the symptoms of both groups had improved (Table 2).
|Interaction: groups time.|
SE: standard error.
Regarding attention measures (Table 2), both groups improved significantly in processing speed (Trail Making A, ), but the interaction effect () indicates that the control group had a larger improvement than the CT group, with a large effect-size (). In Trail Making B, significant effects were found within groups in set-shifting (Trail Making B, ), indicating an improvement in the CT group over time and a decrease in the control group. In the Stroop Test, both groups presented a significant improvement in selective attention over time (Card II, ), but the absence of an interaction effect does not allow for a comparison between the improvements of the groups. A significant interaction effect favouring the CT group was found in the Stroop Test card III (), indicating an improvement in inhibitory control, with a large effect-size (). Regarding executive functioning, both groups showed an improvement in perseverative errors on the MWCST in their scores over time (), but no interaction effect was found, precluding a comparison of improvement between the two groups. A significant interaction effect favouring the control group was found in concentration (MWCST failure to maintain set, ), with a large effect-size ().
Memory assessments (Table 2) indicated no significant differences in short-term verbal and visual memories (Logical Memory I and Visual Reproduction I). A significant interaction effect and a large effect-size favouring the control group were found in long-term verbal memory (Logical Memory II, ; ). This indicates that while the CT group’s performance deteriorated, the control group’s improved. A significant improvement was found within groups in long-term visual memory (Visual Reproduction II, ), but no differential effects were found in interaction, indicating that although both groups improved over time none of the groups improved more than the other.
Our noncomputerized cognitive training programme seems to significantly improve performance in a cognitive measure of attention, inhibitory control, as measured by the Stroop Color Naming Test [36, 56], with a large effect-size. However, these results need further investigation in order to be corroborated. A review  defines positive results as a significant improvement in at least one outcome measure in relation to the control group, reinforcing the impression that our results are positive, albeit still very modest. As described in the literature, attention and information processing deficits are associated with functional impairment, especially in social functioning [6, 58]. Inhibitory control is much applied to social situations; it prevents impulsive reactions and enables distracting stimuli to be inhibited so that attention can be better focused. Therefore, an improvement in inhibitory control can represent moderate to large functional gains, which could not be verified in this study because a functional measure of attention was not available in Portuguese.
Set-shifting was also improved in the CT group, whereas it deteriorated in the control group. This can be understood by the fact that while this function was trained for four sessions in the CT group, the reading of texts in the control group did not require attention shifting; on the contrary, attention focus was maintained on the same theme throughout the session.
Other findings related to attention, although positive, did not show significant differences between groups (selective attention, executive function) or indicated a greater improvement of the control group (processing speed and concentration). They may indicate that the reading intervention was beneficial to these cognitive functions, although this cannot be generalized due to the small sample size. The reading intervention seems to have taught participants to process initial information, gradually directing their attention to the theme and organizing the information to be learned (demanding on executive function). The gradation of texts demanded the development of processing speed and selective attention, because more information had to be processed, and attention had to be focused longer in each session.
Regarding memory effects, information storage seems to be preserved in schizophrenia, as shown in recognition tasks , but retrieval of both immediate and delayed information has been described as the most impaired memory function and also considered a trait of this disorder . A significant result was found on long-term verbal memory in favour of the control group. These results can be understood when one considers that in the control group both short-term and long-term verbal memories were evoked by the reading of texts and subsequent discussion between participants. Furthermore, participants sometimes commented on the theme read in the previous sessions, and family members reported that they would also make observations about the text later at home, indicating that long-term verbal memory was being exercised. The decrease in long-term verbal memory in the CT group can be understood in the light of utilization deficiency [61, 62], which considers that the use of a memory strategy may not lead to benefits in recall, and it can even lower information retrieval. This can occur because, although the strategy might be used correctly, it might be employed in a simpler or less effective manner. Some factors seem to account for this: the availability of mental resources (whenever a new strategy is taught, most mental effort is concentrated on the execution of the strategy, leaving few resources to be allocated to the recall of information); previous knowledge (it is easier to recall familiar rather than unfamiliar information); co-occurrence of one or more strategies; differences in metamemory; difficulty in inhibiting the use of an ineffective strategy learned previously; and other factors, such as motivation and self-efficacy. However, utilization deficiency is considered in a continuum in the development of strategies as the most sophisticated one, frequently preceding significant benefits with the use of the strategy. This might be an indication that further training of verbal memory could have resulted in larger improvements.
Treatment attendance showed that both interventions had similar acceptability rates among participants, indicating that the cognitive exercises proposed were as engaging and motivating as structured reading activities. Nevertheless, the present effects were observed in individuals who on average attended about 14 sessions (out of 20) of training and may be different for individuals who are more/less adherent to the intervention. Although no significant differences were found in attendance, it is possible that participating in more sessions contributed to the positive findings of the control group.
Neuropsychological tests might not be sensitive enough to capture smaller improvements in cognition, so the uses of functional measures are encouraged . At the time of data collection, there was no functional measure available in Portuguese. Recently, an instrument has been translated and adapted for Portuguese , Direct Assessment of Functional Status (DAFS-BR).
Receiving professional attention, feeling cared for, and interacting socially may contribute to the lowering of anxiety, which leads to an improvement in cognition and symptoms . These factors may have contributed to the improvement in symptoms and cognition found in both groups.
Although medication effects cannot be completely ruled out on the improvement of symptoms, participants were stable from the onset of treatment, so any medication effect might have reached its peak before the commencement of the trial.
This study contains significant limitations which means that it is not yet possible to recommend or justify its adoption. The first one is that although this is a controlled trial, the final sample is quite small, with limited statistical power to arrive at more robust conclusions and generalisations.
Secondly, although data points to the superiority of second generation antipsychotics (SGAs) in a series of cognitive domains , some volunteers were also using other types of drugs including anticholinergic medication, which is known to interfere with cognitive functioning . However, any interference may have affected both groups equally.
Thirdly, a learning effect with neuropsychological instruments cannot be excluded, but such an effect is likely to be modest after five months and to affect both groups equally.
In fourth place, it seems that the control condition led to some degree of cognitive training, as it shared elements with the experimental group; it demanded the use of several cognitive functions, and it comprised strategies that seemed to train cognition somewhat (strategy use, prompts to aid attention, and comprehension exercises). The inclusion of an active control condition was chosen because it facilitated participant masking and allowed groups to be matched for important cognitive training characteristics: gradation of difficulty level and motivation. It has been proposed that active control conditions are important in order to identify effects that are specific to the treatment programme [21, 23]. Nevertheless, reading activities have been used as part of a cognitive training programme for schizophrenia , reinforcing the notion that this activity might favour cognitive performance in this population. Additionally, negative results for cognition have been found in a recent study where an active control condition was used , highlighting the need for replication of our research with a passive control condition. The inclusion of both active and passive control conditions is important as it allows for the identification of important treatment elements and whether the treatment programme is effective and worth investing in .
In fifth place, as there was no follow-up period, the durability of the findings cannot be assessed.
Finally, even though we adopted the standard significance level of 5% () the possibility of a Type I error is present.
To our knowledge, this was the first research aimed to pilot test a new cognitive training programme for schizophrenia specifically designed for a developing country. However, it is possible that studies were missed due to the lack of indexation of LAMIC journals in major databases  or to the hurdles in publishing research on mental health conducted in LAMIC .
Our programme can address some of the recommendations made for treatment interventions for schizophrenia in LAMIC: (a) it is affordable, feasible, and acceptable ; (b) it can be facilitated by nonspecialist health professionals [29, 30]; (c) it uses inexpensive resources and can be conducted in groups ; and (d) it has an underlying rationale with a structured environment, essential to the rehabilitation of severe mental disorders .
The present findings, despite the small sample size, seem promising, due to the methodological rigor of our study.
Recommendations for future studies include a larger sample, preferably with sample size calculation, the use of a passive control condition, and the inclusion of a functional assessment measure.
Conflict of Interests
The author Professor Helio Elkis acted as a consultant, received travel support, was Member of the Speakers Bureau or received research grants from: Eli Lilly, Janssen, Pfizer, Sanofi-Synthelabo, Astra-Zeneca, Biossintética, Bristol Myers Squib, Acadia, Lundbeck, Novartis, and Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP). All other authors declare that they have no conflict of interests.
- E. Kraepelin, “Dementia praecox,” in Clinical Psychiatry, E. Kraepelin, Ed., Scholar’s Facsimiles & Reprints, New York, NY, USA, 1907.
- E. Bleuler, Dementia Praecox or the Groups of Schizophrenias, International Universities Press, New York, NY, USA, 1950.
- V. P. Bozikas, M. H. Kosmidis, G. Kiosseoglou, and A. Karavatos, “Neuropsychological profile of cognitively impaired patients with Schizophrenia,” Comprehensive Psychiatry, vol. 47, no. 2, pp. 136–143, 2006.
- T. D. Cannon, C. E. Bearden, J. M. Hollister, I. M. Rosso, L. E. Sanchez, and T. Hadley, “Childhood cognitive functioning in Schizophrenia patients and their unaffected siblings: a prospective cohort study,” Schizophrenia Bulletin, vol. 26, no. 2, pp. 379–393, 2000.
- R. S. E. Keefe, C. E. Eesley, and M. P. Poe, “Defining a cognitive function decrement in Schizophrenia,” Biological Psychiatry, vol. 57, no. 6, pp. 688–691, 2005.
- P. D. Harvey and T. Sharma, Understanding and Treating Cognition in Schizophrenia: A Clinician’s Handbook, Martin Dunitz, London, UK, 2002.
- M. Fioravanti, O. Carlone, B. Vitale, M. E. Cinti, and L. Clare, “A meta-analysis of cognitive deficits in adults with a diagnosis of Schizophrenia,” Neuropsychology Review, vol. 15, no. 2, pp. 73–95, 2005.
- D. L. Braff, “Information processing and attention dysfunctions in Schizophrenia,” Schizophrenia Bulletin, vol. 19, no. 2, pp. 233–259, 1993.
- T. Wykes, C. Reeder, J. Corner, C. Williams, and B. Everitt, “The effects of neurocognitive remediation on executive processing in patients with Schizophrenia,” Schizophrenia Bulletin, vol. 25, no. 2, pp. 291–307, 1999.
- M. F. Green, R. S. Kern, D. L. Braff, and J. Mintz, “Neurocognitive deficits and functional outcome in Schizophrenia: are we measuring the 'right stuff'?” Schizophrenia Bulletin, vol. 26, no. 1, pp. 119–136, 2000.
- J. Seltzer, G. Cassens, C. Ciocca, and L. O'Sullivan, “Neuropsychological rehabilitation in the treatment of Schizophrenia,” Connecticut Medicine, vol. 61, no. 9, pp. 597–608, 1997.
- B. López-Luengo and C. Vásquez, “Effects of attention process training on cognitive functioning of Schizophrenic patients,” Psychiatric Research, vol. 119, pp. 41–53, 2003.
- L. C. Monteiro, V. A. Silva, and M. R. Louzã, “Insight, cognitive dysfunction and symptomatology in Schizophrenia,” European Archives of Psychiatry and Clinical Neuroscience, vol. 258, no. 7, pp. 402–405, 2008.
- L. C. Monteiro and M. R. Louzã, “Cognitive deficits in Schizophrenia: functional consequences and therapeutic approaches,” Revista de Psiquiatria Clínica, vol. 34, supplement 2, pp. 179–183, 2007.
- A. P. Werneck, J. C. Hallak, E. Nakano, and H. Elkis, “Time to rehospitalization in patients with Schizophrenia discharged on first generation antipsychotics, non-clozapine second generation antipsychotics, or clozapine,” Psychiatry Research, vol. 188, no. 3, pp. 315–319, 2011.
- A. K. Siano, L. C. Ribeiro, and M. S. Ribeiro, “Concession of sickness benefit to social security beneficiaries due to mental disorders,” Revista Brasileira de Psiquiatria, vol. 33, no. 4, pp. 323–331, 2011.
- W. Rössler, H. Joachim Salize, J. van Os, and A. Riecher-Rössler, “Size of burden of Schizophrenia and psychotic disorders,” European Neuropsychopharmacology, vol. 15, no. 4, pp. 399–409, 2005.
- R. J. Leitão, M. B. Ferraz, A. C. Chaves, and J. J. Mari, “Cost of Schizophrenia: direct costs and use of resources in the State of São Paulo,” Revista de Saude Publica, vol. 40, no. 2, pp. 304–309, 2006.
- S. R. McGurk, E. W. Twamley, D. I. Sitzer, G. J. McHugo, and K. T. Mueser, “A meta-analysis of cognitive remediation in Schizophrenia,” The American Journal of Psychiatry, vol. 164, no. 12, pp. 1791–1802, 2007.
- A. Medalia and J. Choi, “Cognitive remediation in Schizophrenia,” Neuropsychology Review, vol. 19, no. 3, pp. 353–364, 2009.
- L. B. Dixon, F. Dickerson, A. S. Bellack et al., “The 2009 Schizophrenia PORT psychosocial treatment recommendations and summary statements,” Schizophrenia Bulletin, vol. 36, no. 1, pp. 48–70, 2010.
- National Institute for Clinical Excellence, “Schizophrenia,” The NICE guideline on core interventions in the treatment and management of schizophrenia in adults in primary and secondary care, Updated edition, London, UK, NICE, 2010.
- T. Wykes, V. Huddy, C. Cellard, S. R. McGurk, and P. Czobor, “A meta-analysis of cognitive remediation for Schizophrenia: methodology and effect sizes,” The American Journal of Psychiatry, vol. 168, no. 5, pp. 472–485, 2011.
- A. Patel, M. Knapp, R. Romeo et al., “Cognitive remediation therapy in Schizophrenia: cost-effectiveness analysis,” Schizophrenia Research, vol. 120, no. 1–3, pp. 217–224, 2010.
- D. I. Velligan, R. S. Kern, and J. M. Gold, “Cognitive rehabilitation for Schizophrenia and the putative role of motivation and expectancies,” Schizophrenia Bulletin, vol. 32, no. 3, pp. 474–485, 2006.
- V. Patel, S. Farooq, and R. Thara, “What is the best approach to treating Schizophrenia in developing countries?” PLoS Medicine, vol. 4, no. 6, pp. 0963–0966, 2007.
- M. J. de Jesus, D. Razzouk, R. Thara, J. Eaton, and G. Thornicroft, “Packages of care for Schizophrenia in low- and middle-income countries,” PLoS Medicine, vol. 6, no. 10, Article ID e1000165, 2009.
- K. T. Mueser and S. R. McGurk, “Schizophrenia,” The Lancet, vol. 363, no. 9426, pp. 2063–2072, 2004.
- P. Deva, “Psychiatric rehabilitation and its present role in developing countries,” World Psychiatry, vol. 5, no. 3, pp. 164–165, 2006.
- C. Kieling, H. Baker-Henningham, M. Belfer et al., “Child and adolescent mental health worldwide: evidence for action,” The Lancet, vol. 378, no. 9801, pp. 1515–1525, 2011.
- T. Rangaswamy and J. Sujit, “Psychosocial rehabilitation in developing countries,” International Review of Psychiatry, vol. 24, no. 5, pp. 499–503, 2012.
- G. Gregório, M. Tomlinson, J. Gerolin et al., “Setting priorities for mental health research in Brazil,” Revista Brasileira de Psiquiatria, vol. 34, pp. 434–439, 2012.
- G. E. Guindon, J. N. Lavis, F. Becerra-Posada et al., “Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of health care providers,” Canadian Medical Association Journal, vol. 182, no. 9, pp. E362–E372, 2010.
- S. R. Kay, A. Fiszbein, and L. A. Opler, “The positive and negative syndrome scale (PANSS) for Schizophrenia,” Schizophrenia Bulletin, vol. 13, no. 2, pp. 261–276, 1987.
- D. Wechsler, Wechsler Adult Intelligence Scale-Revised, The Psychological Corporation, San Antonio, Tex, USA, 1981.
- O. Spreen and E. A. Strauss, Compendium of Neuropsychological Tests: Administration, Norms and Commentary, Oxford University Press, Oxford, UK, 2ed edition, 1998.
- H. E. Nelson, “A modified card sorting test sensitive to frontal lobe defects,” Cortex, vol. 12, no. 4, pp. 313–324, 1976.
- G. I. de Zubicaray, G. A. Smith, J. B. Chalk, and J. Semple, “The modified card sorting test: test-retest stability and relationships with demographic variables in a healthy older adult sample,” British Journal of Clinical Psychology, vol. 37, no. 4, pp. 457–466, 1998.
- D. Wechsler, Wechsler Memory Scale: Administration and Scoring Manual, The Psychological Corporation, San Antonio, Tex, USA, 3rd edition, 1997.
- G. E. Dallal, “Randomization.com,” 2013, http://www.randomization.com/.
- B. A. Wilson, Case Studies in Neuropsychological Rehabilitation, Oxford University Press, Oxford, UK, 1999.
- L. M. M. Pontes and H. Elkis, Treinamento de Atenção e Memória na Esquizofrenia: Um Manual Prático, Artmed, Porto Alegre, Brazil, 2013.
- S. J. Luck and J. M. Gold, “The construct of attention in Schizophrenia,” Biological Psychiatry, vol. 64, no. 1, pp. 34–39, 2008.
- T. Wykes and C. Reeder, Cognitive Remediation Therapy for Schizophrenia: Theory and Practice, Routledge, London, UK, 2005.
- D. R. Muller and V. Roder, “Integrated psychological therapy and integrated neurocognitive therapy,” in Neurocognition and Social Cognition in Schizophrenia Patients: Basic Concepts and Treatment, V. Roder and A. Medalia, Eds., vol. 177, pp. 118–144, Karger, Basel, Switzerland, 2010.
- A. Medalia and J. Choi, “Motivational enhancements in Schizophrenia,” in Neurocognition and Social Cognition in Schizophrenia Patients: Basic Concepts and Treatment, V. Roder and A. Medalia, Eds., vol. 177, pp. 158–172, Karger, Basel, Switzerland, 2010.
- C. R. Green, Total Memory Workout: Eight Easy Steps to Maximum Memory Fitness, Piatkus Books, London, UK, 2000.
- L. P. de Vreese, M. Neri, M. Fioravanti, L. Belloi, and O. Zanetti, “Memory rehabilitation in Alzheimer's disease: a review of progress,” International Journal of Geriatric Psychiatry, vol. 16, no. 8, pp. 794–809, 2001.
- E. Brunner and F. Langer, “Nonparametric analysis of ordered categorical data in designs with longitudinal observations and small sample sizes,” Biometrical Journal, vol. 42, no. 6, pp. 663–675, 2000.
- E. Brunner and M. L. Puri, “Nonparametric methods in factorial designs,” Statistical Papers, vol. 42, no. 1, pp. 1–52, 2001.
- J. M. Singer, F. Z. Poleto, and P. Rosa, “Parametric and nonparametric analyses of repeated ordinal categorical data,” Biometrical Journal, vol. 46, no. 4, pp. 460–473, 2004.
- E. M. P. Barretto, M. Kayo, B. S. Avrichir et al., “A preliminary controlled trial of cognitive behavioral therapy in clozapine-resistant Schizophrenia,” Journal of Nervous and Mental Disease, vol. 197, no. 11, pp. 865–868, 2009.
- D. A. Shah and L. V. Madden, “Nonparametric analysis of ordinal data in designed factorial experiments,” Phytopathology, vol. 94, no. 1, pp. 33–43, 2004.
- J. A. Cohen, “Power Primer,” Psychological Bulletin, vol. 112, no. 1, pp. 155–159, 1992.
- H. Elkis, L. Friedman, A. Wise, and H. Y. Meltzer, “Meta-analyses of studies of ventricular enlargement and cortical sulcal prominence in mood disorders: comparisons with controls or patients with Schizophrenia,” Archives of General Psychiatry, vol. 52, no. 9, pp. 735–746, 1995.
- J. R. Stroop, “Studies of interference in serial verbal reactions,” Journal of Experimental Psychology, vol. 18, no. 6, pp. 643–662, 1935.
- E. W. Twamley, D. V. Jeste, and A. S. Bellack, “A review of cognitive training in Schizophrenia,” Schizophrenia Bulletin, vol. 29, no. 2, pp. 359–382, 2003.
- K. S. Cadenhead and D. L. Braff, “Information processing and attenttion in Schizophrenia: clinical and functional correlates and treatment of cognitive impairment,” in Cognition in Schizophrenia: Impairments, Importance and Treatment Strategies, T. Sharma and P. Harvey, Eds., pp. 92–106, Oxford University Press, New York, NY, USA, 2000.
- R. C. Gur, S. T. Moelter, and D. J. Ragland, “Learning and memory in Schizophrenia,” in Cognition in Schizophrenia: Impairments, Importance and Treatment Strategies, T. Sharma and P. Harvey, Eds., pp. 73–91, Oxford University Press, New York, NY, USA, 2000.
- A. Aleman, R. Hijman, E. H. F. de Haan, and R. S. Kahn, “Memory impairment in Schizophrenia: a meta-analysis,” The American Journal of Psychiatry, vol. 156, no. 9, pp. 1358–1366, 1999.
- D. F. Bjorklund, P. H. Miller, T. R. Coyle, and J. L. Slawinski, “Instructing children to use memory strategies: evidence of utilization deficiencies in memory training studies,” Developmental Review, vol. 17, no. 4, pp. 411–441, 1997.
- H. S. Waters, “Memory strategy development: do we need yet another deficiency?” Child Development, vol. 71, no. 4, pp. 1004–1012, 2000.
- F. S. Pereira, A. M. Oliveira, B. S. Diniz, O. V. Forlenza, and M. S. Yassuda, “Cross-cultural adaptation, reliability and validity of the DAFS-R in a sample of Brazilian older adults,” Archives of Clinical Neuropsychology, vol. 25, no. 4, pp. 335–343, 2010.
- P. D. Harvey and R. S. E. Keefe, “Studies of cognitive change in patients with Schizophrenia following novel antipsychotic treatment,” The American Journal of Psychiatry, vol. 158, no. 2, pp. 176–184, 2001.
- G. E. Hogarty, S. Flesher, R. Ulrich et al., “Cognitive enhancement therapy for Schizophrenia: effects of a 2-year randomized trial on cognition and behavior,” Archives of General Psychiatry, vol. 61, no. 9, pp. 866–876, 2004.
- C. P. Szabo, J. J. Mari, C. Kieling, and H. Herrman, “The role of the World Psychiatric Association in facilitating development of psychiatric publications from low- and middle-income countries,” Revista Brasileira de Psiquiatria, vol. 34, no. 1, pp. 12–15, 2012.
Copyright © 2013 Livia M. M. Pontes et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.