Case Report | Open Access
Top-Down Computerized Cognitive Remediation in Schizophrenia: A Case Study of an Individual with Impairment in Verbal Fluency
The objective of this case study was to assess the specific effect of cognitive remediation for schizophrenia on the pattern of cognitive impairments. Case A is a 33-year-old man with a schizophrenia diagnosis and impairments in visual memory, inhibition, problem solving, and verbal fluency. He was provided with a therapist delivered cognitive remediation program involving practice and strategy which was designed to train attention, memory, executive functioning, visual-perceptual processing, and metacognitive skills. Neuropsychological and clinical assessments were administered at baseline and after three months of treatment. At posttest assessment, Case A had improved significantly on targeted (visual memory and problem solving) and nontargeted (verbal fluency) cognitive processes. The results of the current case study suggest that (1) it is possible to improve specific cognitive processes with targeted exercises, as seen by the improvement in visual memory due to training exercises targeting this cognitive domain; (2) cognitive remediation can produce improvements in cognitive processes not targeted during remediation since verbal fluency was improved while there was no training exercise on this specific cognitive process; and (3) including learning strategies in cognitive remediation increases the value of the approach and enhances participant improvement, possibly because strategies using verbalization can lead to improvement in verbal fluency even if it was not practiced.
Cognitive impairments are a core feature of schizophrenia with impairments in nearly every cognitive domain [1, 2]. A recent meta-analysis  demonstrated that patients with schizophrenia scored significantly lower than did controls across all cognitive tests and domains with largest impairments in processing speed and episodic memory [2, 3]. While 70%–80% of individuals with schizophrenia demonstrate cognitive impairments, one standard deviation below the mean of healthy comparison subjects (i.e., 16th percentile) [3, 4], relative to the general population, nearly 100% demonstrate decreased performance relative to their own premorbid cognitive status [5, 6]. Cognitive impairments in attention, verbal memory, and executive functioning have demonstrable prognostic value; that is, the degree of impairment predicts ability to achieve functional goals through treatment [7–9].
In considering the improvement of functioning, it is important to take account of any specific cognitive difficulties that are related to functioning outcomes. Episodic memory is one of the cognitive domains usually associated with poor social functioning . However, one overlooked cognitive deficit that can negatively impact social life is verbal fluency . Verbal fluency is generally considered as a measure of executive functions. To assess verbal fluency, participants are asked to name as many items as possible from a given category in a given time period. The category may be semantic, such as animals or types of fruit, or phonemic, such as words that begin with the letter . Some studies have demonstrated that patients with schizophrenia produce fewer items and do not use recall strategies (e.g., farm animals and wild animals) during letter and semantic fluency tests . Impairment in verbal fluency was more severe for semantic fluency (effect size = 1.21) than for letter fluency (effect size = 0.98) [2, 13].
Considering the generalized cognitive impairments, several psychological treatment strategies have therefore been developed to improve cognitive functioning in this population and they are referred to as cognitive remediation strategies. As defined at the Cognitive Remediation Experts Workshop (Florence, Italy, April 2010), cognitive remediation for schizophrenia refers to “a behavioral training based intervention that aims to improve cognitive processes (…) with the goal of durability and generalization.” Two recent meta-analyses [14, 15] demonstrated that cognitive remediation for individuals with schizophrenia has a positive, moderate effect on overall cognition, psychosocial functioning, and symptoms. Moreover, greater effects on psychosocial functioning were observed when cognitive remediation was combined with psychiatric rehabilitation . However, transfer of gains from the research context to everyday life is of moderate effect size across cognitive rehabilitation studies that included measures of psychosocial functioning [14, 15]. Cognitive remediation tasks are typically quite structured and are therefore significantly different from the situations that individuals with schizophrenia encounter in everyday life . Currently, cognitive remediation with schizophrenia patients includes two primary approaches: “drill and practice” and “drill, practice, and strategy” . The first is a bottom-up approach that trains cognitive processes by repetition, using exercises that focus on specific impaired processes . The second is a top-down approach that also trains cognitive processes by repetition. However, this approach also provides patients with strategies for applying the practiced processes in daily life [18, 19]. That is, the “drill, practice, and strategy” remediation approach provides cues for managing real-life situations. Cognitive remediation programs that incorporate strategies and methods for addressing beliefs and motivation, rather than relying solely on drill and practice, are associated with more positive psychosocial outcomes . Moreover, in developing interventions for improving social functioning in this population, it has been useful to conceptualize communication behavior in terms of social skills and constituent elements of social skills . One such cognitive remediation program for individuals with schizophrenia is the Computerized Interactive Remediation of Cognition Training for Schizophrenia, CIRCuiTS . The CIRCuiTS program targets difficulties with goal-directed behavior in daily life. The objectives of the program are to develop a list of individualized goals, to create an action plan for cognitive training and to implement strategies designed to facilitate the transfer of skills into everyday life.
Patients with schizophrenia have heterogeneous cognitive profiles. The CIRCuiTS program software addresses multiple cognitive processes and allows therapists to remove or adjust exercises to adapt therapy sessions as needed. To highlight specific cognitive deficits that are less visible in a larger sample, the present paper presents a case study of cognitive remediation in a patient with schizophrenia. The patient (Case A) demonstrated global cognitive impairment, with specific impairment in verbal fluency. He participated in a three-month general top-down cognitive remediation program. We hypothesized that Case A would improve performance in the cognitive domains observed to be impaired at neuropsychological baseline and targeted by the CIRCuiTS program. Moreover, as verbalization is one of the primary strategies in the CIRCuiTS program, we anticipated that this may have a beneficial effect on verbal fluency even though it is not directly targeted by specific exercises.
2. Case Report
This research project was approved by the appropriate ethics committee at Centre de Recherche de l’Institut Universitaire en Santé Mentale in Quebec City, Canada. Participants with schizophrenia were recruited and consented to participate. They were informed that they could withdraw participation at any time. The current paper presents a case study drawn from the larger sample recruited for this project. Case A was a young participant with recent-onset schizophrenia.
The inclusion criteria for the larger study were (1) confirmed DSM-IV-TR  schizophrenia diagnosis within the last ten years; (2) clinical status permitting reliable cognitive assessment; and (3) cognitive difficulties in visual episodic memory, immediate recall or delayed recall below the 16th percentile, as measured by the Rey complex figure test (RCFT). Exclusion criteria were (1) brain and metabolic disorders known to cause neuropsychological impairments; (2) substance dependence within the past six months; and (3) Intelligent Quotient below 70.
Case A was a 33-year-old man who lived alone. He had completed 13 years of education and had obtained a professional certificate in institutional plumbing. He was diagnosed with depression at age 28 and with schizophrenia (DSM-IV) at age 30. He had a past history of amphetamine dependence. His pharmacological treatment, which did not change throughout the intervention, included metformin ( mg) for diabetes, modafinil (100 mg) to decrease sleepiness, atorvastatin (10 mg) for hypercholesterolemia, atenolol (12 mg) for recurrent migraines, clozapine (200 mg h.s.), desvenlafaxine (50 mg) for musical obsessions meeting criteria for obsessional compulsive disorder (in complete remission throughout the intervention), and two drops of atropine (1% h.s.) for hypersialorrhea. The patient met with his psychiatrist approximately once per month and with his psychologist and occupational therapist twice per month. Socially, Case A saw only members of his family once or twice a week; he has worked as a plumber until 2008 and has been unemployed since 2008.
2.1. Cognitive Complaints
At the first therapy session, Case A’s therapist presented the cognitive remediation program and explained the study procedure in detail. Difficulties in daily life were also discussed. Case A reported the following cognitive complaints: difficulty retaining information, concentration and comprehension problems, and memory loss. The set of goals of cognitive remediation treatment was jointly agreed by both therapist and patient. Case A’s objectives derived directly from his complaints and included the following: read a newspaper article and understand the text, read an entire book and retain the thread of the plot, and watch a movie without the use of the “pause” or “rewind” buttons.
3. Materials and Methods
3.1. Neuropsychological and Clinical Assessments
Nine neuropsychological tests and two clinical tests were used to assess Case A before the cognitive remediation (Table 1). When a score below the 16th percentile was observed in at least one variable of a cognitive domain, then the cognitive domain was considered as impaired.
The experimental design included three steps: baseline assessment, a three-month cognitive remediation (CIRCuiTS), and posttest assessment. Baseline and posttest assessments both consisted of neuropsychological and clinical assessments; neuropsychological assessment was conducted by a research assistant, and clinical assessment was conducted by Case A’s treating psychiatrist who had treated him since the beginning of treatment.
3.2.1. Baseline Assessment
At baseline, Case A demonstrated pathological scores (<5th percentile) or impairments/difficulties (<16th percentile) in four of the nine cognitive domains assessed with neuropsychological tests (Table 2): visual episodic memory (immediate and delayed recalls), selective attention (inhibition variable), initiation/strategic search (phonemic and semantic categories), and problem solving (high trial number of first category in a card sorting test). Poor verbal fluency was also qualitatively observed during the baseline evaluation session (i.e., poverty of speech). Case A’s scores were within the normal range (from 21st to 97th percentiles) for all of the remaining cognitive processes assessed (verbal episodic memory, working memory, sustained attention, and planning). Finally, Case A seemed to have good metacognitive skills because his cognitive deficits were congruent with his cognitive complaints (retaining information, concentration and comprehension problems, and memory loss).
|aGlobal IQ was reported in standardized score. |
bThe PR of CPT scale is reversed. Higher PR indicates more severe impairment.
Percentile rank:PR. The scores correspond to the raw score obtained for each variable; California verbal learning test-II: CVLT-II; Rey complex figure test: RCFT; global IQ as measured with the WAIS-III; continuous performance test-II: CPT-II; Wisconsin card sorting test-128 cards: WCST; global assessment of functioning: GAF; Positive and Negative Syndrome Scale: PANSS; not applicable (n/a).
*Deficit at baseline improved to normal at posttest scores.
3.2.2. Cognitive Remediation
The cognitive remediation program used is named CIRCuiTS . Several cognitive remediation programs exist. The originality of CIRCuiTS can be summarized in key points. First, CIRCuiTS is theory-driven based on a metacognitive model of the relationship between cognitive and functional change. Using a strategy-based approach, CIRCuiTS has an integrated focus on the transfer of cognitive skills to daily activities. It aims to develop metacognitive regulation and metacognitive knowledge, which are hypothesized to be important for the appropriate generalization of cognitive skills to daily living . The focus on transfer also comes from its use of real-world goals, homework to facilitate in vivo use of new strategies, and a formulation-based approach in which the impact of cognitive strengths and difficulties on daily living skills is considered. All of these factors are known to be associated with increased motivation [25, 26]. Second, CIRCuiTS has high feasibility and acceptability among both service users and therapists as seen in a series of quantitative and qualitative studies designed to inform and test the development of CIRCuiTS . Third, CIRCuiTS has high adaptability to individual differences because it is based on a flexible modular system .
CIRCuiTS is a computerized psychological therapy program; although patients can use the program independently, it is ideally administered by a therapist. Various cognitive training techniques and strategies are employed, including simplification and errorless learning. Those techniques have been proven to be effective in improving cognitive performance in empirical studies . CIRCuiTS was designed to be completed in forty therapy sessions, at a minimum of three sessions per week. Therapy sessions last up to one hour, but therapists can adjust time according to the patient.
A therapy session consists of multiple (approximately 4–8) activities covering a wide range of cognitive functions: attention, memory, executive functions, visual-perceptual processing, and metacognitive skills. The activities are designed to target verbal skills, nonverbal skills, or both. Tasks are rotated to be diverse, interesting, and engaging for participants. The CIRCuiTS program includes two types of tasks: (1) abstract tasks, which are designed to improve cognitive functions in an abstract context (e.g., remembering a list of words), and (2) exercises, that is, complex tasks designed to reflect everyday activities (e.g., make a daily schedule and read a letter). Whereas abstract tasks are performed throughout the CIRCuiTS program, exercises are introduced gradually across sessions; the final sessions of the program consist primarily of exercises. The rationale is that patients learn new cognitive skills in an abstract context and subsequently gradually transfer the skills to everyday life. That overall objective of the program is for participants to eventually apply cognitive skills and new strategies developed in therapy in daily life.
3.3. Therapist Strategies
Verbalization of cues, prompts, and strategies for completing a given task are key therapist strategies. During a task, the therapist verbalizes hints for the participant, in order to facilitate mentalization of relevant strategies. Verbalized prompts are often used repetitively; participants becomes increasingly independent as therapy progresses, with the therapist verbalising key instructions at first and the participant gradually taking over the verbalisation process which occurs first overtly (out loud) and, later, covertly (mentally). For example, in the “learning a list” task, the therapist may encourage the participant to repeat the list of words to him or herself.
3.4. Clinical Hypotheses
Given a program that specifically addressed and targeted many of Case A’s particular deficits, we expected improvement in each of his impaired scores. Improvements were expected in visual episodic memory (as measured by the RCFT), selective attention/inhibition (as measured by the Stroop inhibition test), and problem solving (as measured by the WCST). The underlying skills of verbal fluency were not directly practiced in CIRCuiTS. However, verbalization is one of the primary strategies used by the therapist and the patient during the therapy. Improvement in verbal fluency was therefore expected. No baseline deficits were observed in verbal episodic memory, working memory, or sustained attention and planning, and therefore no significant improvements were expected.
3.5. Statistical Analysis
Two approaches were adopted to estimate changes on main outcomes after cognitive remediation. First, the Reliable Change Index (RCI)  was calculated to determine whether posttherapy change observed for each variable for each participant reaches significance level. RCI, similar to a Z-change score, (a) allows estimating the extent by which a patient distance themselves from a distribution of similar symptomatic patients who were not exposed to the intervention, while (b) controlling for the instrument reliability and (c) allowing a conclusion about the “statistical significance” of the change. RCI larger than 1.96 are seen as statistically significant at a two-tailed 5% alpha level. It can be noted that this statistical approach is quite conservative ; a minimum change of two standard deviations is required to be considered significant. The conservative threshold means that an observed change is unlikely to be attributable to simple measurement unreliability or practice effect within pre- and posttests .
The RCI were computed with these variables. The standard deviations for the neuropsychological variables were gathered from our laboratory (M. Maziade). The results have been published previously in Schizophrenia Bulletin. However, to have a greater sample size, we used unpublished standard deviations collected from our laboratory since the publication of the paper in Schizophrenia Bulletin. Only one neuropsychological variable, the Stroop from the D-KEFS battery, was gathered from a paper in the literature . The standard deviations for the clinical variables were obtained from published research: Positive and Negative Syndrome Scale (PANSS)  and global assessment of functioning (GAF) . We fixed the same test-retest to 0.80 as a standard for each test. The reliability of 0.80 to 0.90 is considered as the minimum acceptable for internal consistency and 0.70 is the minimum for the test-retest reliability .
The second approach (less conservative) was to consider the movement of scores from below to above the 16th percentile on instruments with available clinical normative data. In clinical practice, a score above the 16th percentile is considered as normal performance. As a consequence, changes in status from “deficit” to “normal” performance were considered to be a clinical improvement.
4.1. Neuropsychological Assessment
Difference between baseline and posttest assessment scores was calculated, and RCI are reported in Table 3.
|Abbreviations: RCI: Reliable Change Index; GAF: Global Assessment of Functioning; PANSS: Positive and Negative Syndrome Scale.|
*Significant with unilateral criteria (cut off = 1.64); **Significant with bilateral criteria (cut-off = 1.96).
The conservative method revealed that Case A significantly improved on RCFT immediate recall (RCI = 2.68) and RCFT delayed recall (RCI = 1.86). The expected improvement in verbal fluency was observed for both categories (phonemic fluency, RCI = 2.20; categorical fluency, RCI = 2.51). However, the expected improvement in selective attention between baseline and posttest assessments was not observed. Case A’s score on the Stroop inhibition test remained unchanged, at the threshold of deficit (percentile = 16).
Finally, the less conservative method revealed that difficulties observed at baseline in problem solving (percentile = 11–16) disappeared at posttest assessment (percentile > 16); however, RCI was not significant.
4.2. Clinical Assessment
No significant change was observed in clinical symptoms (as assessed with the PANSS) or in social functioning (assessed with the GAF) (Table 3).
4.3. Clinical Change during Cognitive Remediation Therapy
The clinical case formulation (see Table 1 in the supplemental material; see Supplementary Material available online at http://dx.doi.org/10.1155/2015/242364) pointed out severe difficulties in verbal fluency but important strengths with good comprehension and high motivation. Verbal fluency was not practiced with specific exercise during cognitive remediation with CIRCuiTS. At the beginning of therapy, Case A was unable to identify examples where the strategies learned in CIRCuiTS might be useful in his daily life. By midtreatment, it was expected that Case A would be able to identify applications in his daily life independently, but this was not the case. Case A’s deficit in verbal fluency could prevent him from verbally generating a list of applications during the therapy session. His therapist therefore asked him to make a list of the areas of his life in which he experienced cognitive difficulties (e.g., work, friends, or medication) as homework for the following session. The task was very difficult for him, but, after several drafts, the final version was exhaustive, with concrete examples that reflected his daily life. In the following session, Case A’s therapist asked him to use a CIRCuiTS strategy to organize his list. Case A successfully categorized each of the identified situations (e.g., food, interests, and social situations) and the list was used for the remainder of therapy. By asking participants to verbalize strategies during and after training exercises, the CIRCuiTS program helps participants gain awareness of strategies and generate new strategies if application efforts are not successful. The list was an interactive document open to modification and enhancement; it served to keep track of the objectives set at the beginning of therapy. As mentioned in the clinical case formulation (see Table 1 in the supplemental material), Case A’s goals were very concrete and directly linked to his daily life (e.g., read a book). The “list” strategy was used because Case A demonstrated deficits in verbal fluency. This deficit made him a unique and interesting case study; however, the strategy is likely to be applicable and useful for other participants, even in the absence of verbal fluency problems.
Case A’s problem in verbal fluency also included slowing down during reading and difficulties to synthesize instructions which led to a decrease in the number of exercises performed during a session. This synthesis problem could be due to Case A’s cognitive behavioral style (see Table 1 in the supplemental material). Effectively, the clinical case formulation reported some difficulties such as sensitivity to interference or trouble to stay focus/concentrate for a long time. Thus, the first task of Case A was to learn to concentrate by buying the newspaper, choosing an article, reading it alone, and trying to summarize it by writing, taking his time. The strategy chosen by the patient was to highlight important information in the text to bring out the essential meaning. The first summary of Case A looked like a “copy and paste” of the original text, but it became more and more accurate. At the next session, Case A had to read aloud the summary he had previously prepared at home in order to learn to take breaks during his reading time. Then, Case A had to do it again without looking at his paper. The first attempts were quite laborious with too much detail without understanding the main message of the text. The same homework was repeated until Case A was able to summarize a text briefly and to understand its meaning.
Overall, the main strategies that Case A used in therapy and at home were to highlight a text (e.g., in the newspaper), to buy and use a notebook, to categorize the information (e.g., shopping list), to say the information out loud, the self-repetition, to take break during reading, to check his answer before validating it, and to plan before beginning a task. these strategies allowed him to reach two of the three expected goals mentioned in the formulation case, plus four others not expected: read the newspaper, cook, watch movie, play board game, and remember birthdays and phone numbers.
We hypothesized that Case A’s performance would improve in each of the cognitive domains identified as impaired at baseline and targeted by CIRCuiTS, including visual memory, inhibition, and problem solving. The hypothesis was partially validated: Case A improved significantly in visual memory (conservative method) and in problem solving (less conservative method). Since verbalization is a strategy widely used in CIRCuiTS cognitive remediation, improvement in verbal fluency was expected even though it was not directly practiced by specific exercise. This second hypothesis was validated. The effects of cognitive remediation were observed only on the neuropsychological measures in this case study. No significant changes were observed in global functioning or in positive/negative symptoms.
Where visual memory was concerned, Case A’s improvement was clear: his scores were normal at posttest assessment. Exercises used to train visual memory in the CIRCuiTS program primarily involved copying and recalling images, as well as practicing memory for faces and places. Case A’s therapist taught him several strategies for visual memory, including using a grid for visual cues, focusing on one attribute at a time (e.g., face, body, and name), taking notes, and visual scanning (left/right and up/down). Case A seemed to integrate these strategies by the end of therapy, as demonstrated by his improvement in visual memory at posttest assessment. This observation is consistent with recent literature demonstrating improvement in visual memory after basic visual processing training via computer .
We expected an improvement in inhibition processes, but none was observed. Case A’s impairment remained near the deficit threshold at posttest assessment. According to Lecardeur et al. , improvement is rarely observed in individuals with small to moderate deficits (0.5 to 1.5 standard deviation from the norm), and the usefulness of cognitive remediation in such cases is not certain. In the present case study, baseline score was on the edge between deficit and normality (percentile: 16, one standard deviation from the norm) and the opportunity for improvement was therefore limited.
Case A demonstrated improvement (with less conservative method) in problem solving at posttest assessment. Cognitive remediation included several exercises designed to train problem solving, including “seating plan” and “plan-a-day.” In the first type of exercise, Case A’s task was to seat individuals at a table while respecting instructions about who should not be seated together. In the second type of exercise, his task was to organize and schedule a list of activities and to-do items in a diary, respecting the instructions given. During the two exercises, Case A used the following strategies: prioritize and follow the simplest rule; place tasks with a fixed time into the schedule first. He learned to dissect instructions before initiating a task and to write down the steps to solve a problem. These strategies appear to have been effective: Case A’s problem solving score improved from impaired to within the normal range at posttest assessment. A similar study  demonstrated that, at least in the planning/problem solving domains, patients with impaired performance are likely to benefit from interventions with very specific targets. The authors compared the impact of two types of cognitive remediation: specific problem solving training and basic cognition training. The results demonstrated that only specific training (i.e., “plan-a-day” task) resulted in improved problem solving.
Finally, we expected that the verbalization strategy applied in therapy would result in observable improvements in Case A’s verbal fluency. This hypothesis was supported for both semantic fluency and phonemic fluency; improvements in verbal fluency were observed during the remediation sessions and Case A also reported improvements in everyday life. That verbal fluency improved despite lack of direct training demonstrates that cognitive remediation had a nonspecific effect. This finding is corroborated by a meta-analysis  where computer-assisted cognitive remediation yielded comparable effects in targeted and nontargeted cognitive domains.
In the current case study, one possible explanation for the observed nonspecific improvement is the type of cognitive remediation used in the CIRCuiTS program; namely, the “drill, practice, and strategy” approach. “Drill and practice” remediation does not focus on strategies (e.g., verbalization). Therefore, if it does not focus on verbal fluency exercises making improvement in verbal fluency is unlikely. In contrast, the “drill, practice, and strategy” approach is likely to have a widespread effect and to generate nonspecific improvements . Vianin et al.  demonstrated this effect. They measured brain activity during a verbal fluency task in eight patients with schizophrenia (experimental group) before and after participation in a cognitive remediation program that did not target verbal fluency. They compared the results with those of a control group of individuals who did not receive remediation. Following cognitive remediation, neuroimaging results revealed greater activation of Broca’s area during verbal fluency tasks in the experimental group compared to in the control group. The authors hypothesized that the observed brain changes were attributable to verbal mediation techniques such as verbalization. Finally, the current case study corroborates the fact that cognitive remediation therapy benefits more to patients with schizophrenia with low initial memory performances . Effectively, Case A’s baseline performance was very low in visual episodic memory and this impairment could allow him to have general benefit of cognitive remediation by obtaining specific and nonspecific improvements.
There are several limitations to the present study. First, the case study presented here did not assess the long-term effect of cognitive remediation. It would be interesting to conduct a follow-up assessment of cognitive performance; such an assessment would permit observation of change in social functioning (ongoing project). Second, the case study design is often considered to be less valid than are group designs, because of threats to internal and external validity. However, many authors have argued that single-case studies play an important role in evidence-based clinical practice of cognitive remediation . Finally, the administration of the same neuropsychological battery at baseline and at posttest assessment may have positively influenced posttest scores. Therefore, the problem solving’s improvement observed with the less conservative method must be interpreted with caution because it could be due to the practice effect.
This case study highlights several important points. First, cognitive processes improved when the participant’s training focused on specific targets such as visual memory and problem solving. Second, when cognitive remediation includes learning strategies, cognitive processes such as verbal fluency may improve even though they are not practiced by specific exercises. That is, learning strategies can produce generalized improvements and enhance the positive impact of cognitive remediation. In the light of this case study, cognitive remediation appears to be an interesting avenue, workable, and advantageous for patients with schizophrenia. Therefore, the use of cognitive remediation in clinical practice represents an obvious interest and could lead to positive impact on social functioning.
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
The supplementary material is about Case A’s clinical case formulation which describes his difficulties and his strengths concerning cognitive functions, cognitive behavioral style, no cognitive factors, coping and compensation strategies.
- R. W. Heinrichs and K. K. Zakzanis, “Neurocognitive deficit in schizophrenia: a quantitative review of the evidence,” Neuropsychology, vol. 12, no. 3, pp. 426–445, 1998.
- J. Schaefer, E. Giangrande, D. R. Weinberger, and D. Dickinson, “The global cognitive impairment in schizophrenia: consistent over decades and around the world,” Schizophrenia Research, vol. 150, no. 1, pp. 42–50, 2013.
- D. Dickinson, M. E. Ramsey, and J. M. Gold, “Overlooking the obvious: a meta-analytic comparison of digit symbol coding tasks and other cognitive measures in schizophrenia,” Archives of General Psychiatry, vol. 64, no. 5, pp. 532–542, 2007.
- B. W. Palmer, S. E. Dawes, and R. K. Heaton, “What do we know about neuropsychological aspects of schizophrenia?” Neuropsychology Review, vol. 19, no. 3, pp. 365–384, 2009.
- J. M. Gold, “Is cognitive impairment in schizophrenia ready for diagnostic prime time?” World Psychiatry, vol. 7, no. 1, pp. 32–33, 2008.
- C. M. Wilk, J. M. Gold, K. Humber, F. Dickerson, W. S. Fenton, and R. W. Buchanan, “Brief cognitive assessment in schizophrenia: Normative data for the Repeatable Battery for the Assessment of Neuropsychological Status,” Schizophrenia Research, vol. 70, no. 2-3, pp. 175–186, 2004.
- M. F. Green, R. S. Kern, and R. K. Heaton, “Longitudinal studies of cognition and functional outcome in schizophrenia: Implications for MATRICS,” Schizophrenia Research, vol. 72, no. 1, pp. 41–51, 2004.
- K. H. Nuechterlein, K. L. Subotnik, M. F. Green et al., “Neurocognitive predictors of work outcome in recent-onset schizophrenia,” Schizophrenia Bulletin, vol. 37, supplement 2, pp. S33–S40, 2011.
- C. R. Bowie, C. Depp, J. A. McGrath et al., “Prediction of real-world functional disability in chronic mental disorders: a comparison of schizophrenia and bipolar disorder,” The American Journal of Psychiatry, vol. 167, no. 9, pp. 1116–1124, 2010.
- M. F. Green, R. S. Kern, D. L. Braff, and J. Mintz, “Neurocognitive deficits and functional outcome in schizophrenia: are we measuring the ‘right stuff’?” Schizophrenia Bulletin, vol. 26, no. 1, pp. 119–136, 2000.
- M. D. Lezak, Neuropsychological Assessment, Oxford University Press, Oxford, UK, 1995.
- E. M. Joyce, S. L. Collinson, and P. Crichton, “Verbal fluency in schizophrenia: relationship with executive function, semantic memory and clinical alogia,” Psychological Medicine, vol. 26, no. 1, pp. 39–49, 1996.
- C. E. Bokat and T. E. Goldberg, “Letter and category fluency in schizophrenic patients: a meta-analysis,” Schizophrenia Research, vol. 64, no. 1, pp. 73–78, 2003.
- T. Wykes, V. Huddy, C. Cellard, S. R. McGurk, and P. Czobor, “A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes,” The American Journal of Psychiatry, vol. 168, no. 5, pp. 472–485, 2011.
- S. R. McGurk, E. W. Twamley, D. I. Sitzer, G. J. McHugo, and K. T. Mueser, “A meta-analysis of cognitive remediation in schizophrenia,” The American Journal of Psychiatry, vol. 164, no. 12, pp. 1791–1802, 2007.
- M. N. Levaux, F. Larøi, M. Malmedier, I. Offerlin-Meyer, J. Danion, and M. Van der Linden, “Rehabilitation of executive functions in a real-life setting: goal management training applied to a person with schizophreni,” Case Reports in Psychiatry, vol. 2012, Article ID 503023, 15 pages, 2012.
- S. Barlati, G. Deste, L. de Peri, C. Ariu, and A. Vita, “Cognitive remediation in schizophrenia: current status and future perspective,” Schizophrenia Research and Treatment, vol. 2013, Article ID 156084, 12 pages, 2013.
- A. Medalia and J. Choi, “Cognitive remediation in schizophrenia,” Neuropsychology Review, vol. 19, no. 3, pp. 353–364, 2009.
- T. Wykes, C. Reeder, J. Corner, C. Williams, and B. Everitt, “The effects of neurocognitive remediation on executive processing in patients with schizophrenia,” Schizophrenia Bulletin, vol. 25, no. 2, pp. 291–307, 1999.
- A. Medalia and A. M. Saperstein, “Does cognitive remediation for schizophrenia improve functional outcomes?” Current Opinion in Psychiatry, vol. 26, no. 2, pp. 151–157, 2013.
- A. S. Bellack, K. T. Mueser, S. Gingerich, and J. Agresta, Social Skills Training for Schizophrenia: A Step-by-Step Guide, Guilford Press, New York, NY, USA, 2nd edition, 2004.
- C. Reeder and T. Wykes, Computerised Interactive Remediation of Cognition—Interactive Training for Schizophrenia (CIRCUITS), Kings College, London, UK, 2010.
- American Psychiatric Association, Diagnostic and Statistical Manual of Mental Disorders: DSM-IV-TR, American Psychiatric Association, Washington, DC, USA, 2000.
- T. Wykes and C. Reeder, Cognitive Remediation Therapy for Schizophrenia: Theory and Practice, Routledge, 2005.
- R. M. Ryan and E. L. Deci, “Intrinsic and extrinsic motivations: classic definitions and new directions,” Contemporary Educational Psychology, vol. 25, no. 1, pp. 54–67, 2000.
- J. Choi, T. Mogami, and A. Medalia, “Intrinsic motivation inventory: an adapted measure for schizophrenia research,” Schizophrenia Bulletin, vol. 36, no. 5, pp. 966–976, 2010.
- C. Reeder, V. Harris, A. Pickles, A. Patel, M. Cella, and T. Wykes, “Does change in cognitive function predict change in costs of care for people with a schizophrenia diagnosis following cognitive remediation therapy?” Schizophrenia Bulletin, vol. 40, no. 6, pp. 1472–1481, 2014.
- C. J. Press, R. J. Drake, and N. Husain, “South Asians’ attitudes towards cognitive remediation after first episodes of psychosis,” Schizophrenia Research, vol. 117, no. 2-3, p. 512, 2010.
- N. S. Jacobson and P. Truax, “Clinical significance: a statistical approach to defining meaningful change in psychotherapy research,” Journal of Consulting and Clinical Psychology, vol. 59, no. 1, pp. 12–19, 1991.
- J. Marsden, B. Eastwood, C. Wright, C. Bradbury, J. Knight, and P. Hammond, “How best to measure change in evaluations of treatment for substance use disorder,” Addiction, vol. 106, no. 2, pp. 294–302, 2011.
- R. K. Heaton, N. Temkin, S. Dikmen et al., “Detecting change: a comparison of three neuropsychological methods, using normal and clinical samples,” Archives of Clinical Neuropsychology, vol. 16, no. 1, pp. 75–91, 2001.
- C. Simonsen, K. Sundet, A. Vaskinn et al., “Neurocognitive dysfunction in bipolar and schizophrenia spectrum disorders depends on history of psychosis rather than diagnostic group,” Schizophrenia Bulletin, vol. 37, no. 1, pp. 73–83, 2011.
- S. Bayard, D. Capdevielle, J.-P. Boulenger, and S. Raffard, “Dissociating self-reported cognitive complaint from clinical insight in schizophrenia,” European Psychiatry, vol. 24, no. 4, pp. 251–258, 2009.
- E. H. Strauss, E. M. Sherman, and O. Spreen, A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary, Oxford University Press, New York, NY, USA, 3rd edition, 2006.
- T. S. Surti, S. Corbera, M. D. Bell, and B. E. Wexler, “Successful computer-based visual training specifically predicts visual memory enhancement over verbal memory improvement in schizophrenia,” Schizophrenia Research, vol. 132, no. 2-3, pp. 131–134, 2011.
- L. Lecardeur, S. Meunier-Cussac, and S. Dollfus, “Cognitive deficits in first episode psychosis patients and people at risk for psychosis: from diagnosis to treatment,” Encephale, vol. 39, supplement 1, pp. S64–S71, 2013.
- K. Rodewald, D. V. Holt, M. Rentrop et al., “Predictors for improvement of problem-solving during cognitive remediation for patients with schizophrenia,” Journal of the International Neuropsychological Society, vol. 20, no. 4, pp. 455–460, 2014.
- O. Grynszpan, S. Perbal, A. Pelissolo et al., “Efficacy and specificity of computer-assisted cognitive remediation in schizophrenia: a meta-analytical study,” Psychological Medicine, vol. 41, no. 1, pp. 163–173, 2011.
- X. Seron, “L'évaluation de l'efficacité des traitements,” in Traité de Neuropsychologie Clinique, X. Seron and M. van der Linden, Eds., vol. 2, pp. 39–62, Solal, Marseille, France, 2000.
- P. Vianin, S. Urben, P. Magistretti, P. Marquet, E. Fornari, and L. Jaugey, “Increased activation in Broca's area after cognitive remediation in schizophrenia,” Psychiatry Research, vol. 221, no. 3, pp. 204–209, 2014.
- B. Pillet, Y. Morvan, A. Todd et al., “Cognitive remediation therapy (CRT) benefits more to patients with schizophrenia with low initial memory performances,” Disability and Rehabilitation, pp. 1–8, 2014.
- M. Perdices and R. L. Tate, “Single-subject designs as a tool for evidence-based clinical practice: are they unrecognised and undervalued?” Neuropsychological Rehabilitation, vol. 19, no. 6, pp. 904–927, 2009.
- D. Wechsler, Wechsler Adult Intelligence Scale, The Psychological Corporation, San Antonio, Tex, USA, 3rd edition, 2005.
- D. Delis, J. Kramer, E. Kaplan, and B. Ober, “California verbal learning test manual,” USA Patent, San Antonio, Tex, USA, 1987.
- J. Meyers and K. Meyers, Rey Complex Figure Test and Recognition Trial (RCFT), Psychological Assessment Resources, Odessa, Fla, USA, 1995.
- K. Conners, “Continuous Performance Test II,” Psychological Assessment Resources, 1999.
- D. C. Delis, E. Kaplan, and J. H. Kramer, Delis-Kaplan Executive Function System (D-KEFS), Psychological Corporation, 2001.
- D. Wechsler, WMS-III Manual, The Psychological Corporation, New York, NY, USA, 1997.
- R. K. Heaton, G. J. Chelune, J. L. Talley, G. G. Kay, and G. Curtiss, Wisconsin Card Sorting Test: Manual Revised and Expanded, Research Edition (WCST-CV:4) 128 Cards, Psychological Assessment Resources, Odessa, Fla, USA, 1993.
- W. Culbertson and E. Zillmer, The Tower of London DX (TOLDX) Manual, Multi-Health Systems, North Tonawanda, NY, USA, 2001.
- S. R. Kay, L. A. Opler, and J.-P. Lindenmayer, “The Positive and Negative Syndrome Scale (PANSS): rationale and standardisation,” British Journal of Psychiatry, vol. 155, no. 7, pp. 59–65, 1989.
- American Psychiatric Association, Diagnostic Criteria from DSM-IV, American Psychiatric Association, 1994.
Copyright © 2015 Marjolaine Masson et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.