- About this Journal ·
- Abstracting and Indexing ·
- Advance Access ·
- Aims and Scope ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Volume 2013 (2013), Article ID 154867, 8 pages
Working Memory Training in Patients with Chronic Schizophrenia: A Pilot Study
1Department of Cognitive Psychology and Methodology, University of Basel, Missionstrasse 60/62, 4055 Basel, Switzerland
2Department of General Psychiatry, University Psychiatric Hospitals, Wilhelm Klein-Strasse 27, 4012 Basel, Switzerland
3Division of Molecular and Cognitive Neuroscience, University of Basel, Switzerland
Received 22 November 2012; Revised 14 January 2013; Accepted 16 January 2013
Academic Editor: Jörg Richter
Copyright © 2013 Martina Hubacher et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Background. There is evidence that patients with schizophrenia suffer from decline in working memory performance with consequences for psychosocial outcome. Objective. To evaluate the efficacy of a computerized working memory training program (BrainStim) in patients with chronic schizophrenia. Methods. Twenty-nine inpatients with chronic schizophrenia were assigned to either the intervention group receiving working memory training () or the control group without intervention (). Training was performed four times a week for 45 minutes during four weeks under neuropsychological supervision. At baseline and followup all participants underwent neuropsychological testing. Results. Pre-post comparisons of neuropsychological measures showed improvements in visual and verbal working memories and visual short-term memory with small and large effect sizes in the intervention group. In contrast, the control group showed decreased performance in verbal working memory and only slight changes in visual working memory and visual and verbal short-term memories after 4 weeks. Analyses of training profiles during application of BrainStim revealed increased performance over the 4-week training period. Conclusions. The applied training tool BrainStim improved working memory and short-term memory in patients with chronic schizophrenia. The present study implies that chronic schizophrenic patients can benefit from computerized cognitive remediation training of working memory in a clinical setting.
Cognitive dysfunctions are known to be a core feature of schizophrenia. Nearly 95% of all schizophrenic patients are impaired in cognitive functioning, 65% of the patients show deficits in cognitive flexibility, 75% show poorer performance in planning tasks, and 65% show deficits in working memory . These deficits appear early in the disease course and might exist before the first positive or even negative symptoms become manifested . Additionally, cognitive performance appears to be a possible predictor for remission . The significance of impaired cognitive functioning in schizophrenia is highlighted by the discussion about the inclusion of cognitive impairment in the DSM criteria [4, 5].
Among cognitive functions, working memory is fundamental. This function includes attending to current events, maintaining and manipulating incoming information, and integrating them into long-term memory. Working memory actively processes and stores information . In the original model proposed by Baddeley and Hitch , working memory contains three subsystems, a phonological loop, and a visuospatial sketchpad, which represent the two modality-specific slave systems. These two slave systems are controlled and regulated by the central executive. In a revised model, Baddeley  added the episodic buffer, a multimodal storage system with limited capacity that supports the exchange between the first two slave systems. Due to the functions of working memory, and its impact as interface between perception, long-term memory and higher cognitive functions, it is likely that malfunctioning highly affects everyday life. Since, in schizophrenic patients, working memory deficits can be observed in all three traditional subsystems [9, 10] it is not astonishing that a wide range of behaviours is affected . Although antipsychotic medication ameliorates positive and negative symptoms of the disease, unfortunately, the cognitive problems do not seem to improve [12–14] and are described to be stable over time . Thus, alternative approaches able to improve cognitive functioning per se and the important domain working memory in particular are warranted.
Although some studies reported failure to generalize beyond practice effects (e.g., [16, 17]), there is a tantamount of evidence that cognitive training might be beneficial in patients with schizophrenia. Further, it seems to be the best-supported approach to treat cognitive impairment . A meta-analysis by McGurk et al.  including 26 studies with computerized and noncomputerized trainings reports a medium effect size on cognitive functioning after remediation training, as well as psychosocial functioning, and a small effect on clinical symptoms. Cavallaro and colleagues  showed the effectiveness of computer-aided remediation on several cognitive domains. A meta-analysis by Grynszpan et al.  confirms the moderate effect of computerized training in schizophrenia. Especially in working memory, improvements are reported after a combination of work-therapy and neurocognitive enhancement therapy [22, 23], as well as after computer-assisted cognitive remediation [24, 25]. A recent meta-analysis composing 40 studies on the efficacy of cognitive remediation in schizophrenia  confirms that patients profit from this kind of intervention. Effect sizes on the posttreatment cognitive outcomes over all studies were described to be small to moderate.
Moreover, though some of the studies tackled working memory capacity, the tests and their presentation mode administered as part of the exercises were heterogeneous. To follow our hypothesis of working memory being one of the central components for efficient cognitive functioning we applied a computerized tool called BrainStim to inpatients with chronic schizophrenia and compared their posttreatment cognitive performance to those of an untrained control group. The training tool BrainStim has already been evaluated in a pilot study on healthy elderly people  and on patients with multiple sclerosis [28, 29]. In both studies, positive effects were especially found for working memory performance, while transfer effects to other cognitive domains turned out to be rather small.
Thus, our hypotheses for the present study were that (a) inpatients with chronic schizophrenia in the treatment group would benefit from training by improving their working memory performance, while performance of untrained patients was assumed to remain stable, and (b) increased performance within the training as an indicator of learning capability can be shown in patients with chronic schizophrenia.
Forty-four inpatients from the University Psychiatric Hospitals in Basel, Switzerland, were recruited. All participants had a definite diagnosis of schizophrenia according to ICD-10 and were treated as inpatients for treatment of exacerbation of their disorder and/or for (long term) rehabilitation. At the time of study enclosure they were all stable since more than two weeks (based on evaluation of treating psychiatrist). 23 patients were included in the training group, whereas the other 21 participants were put on a waiting list and served as control group with the opportunity to complete the training after one month. 7 patients of the intervention group (30%) quit the training due to their discharge from the hospital, and one more had to be excluded due to a lack of compliance in the posttest. In the control group, 7 patients (33%) quit because of discharge from the hospital. The remaining 15 patients in the training group were all diagnosed with paranoid schizophrenia (F20.0). In the control group () there was one patient with a hebephrenic schizophrenia (F20.1) as well as one patient with an undifferentiated type of schizophrenia (F20.3); the other 12 participants all had a diagnosis of paranoid schizophrenia (F20.0). Details on medication are shown in Table 1. All patients gave written informed consent to participate in the study, which was approved by the local ethics committee of the University of Basel, Switzerland.
All participants were examined twice by a neuropsychological testbattery the first time to assess baseline performance and the second time to evaluate posttreatment effects. After baseline testing the intervention group received the training by means of the BrainStim software  during four weeks, four times a week for 45 minutes, supervised by a master student in psychology, whereas the control group solely received routine clinical treatment. The efficacy of the treatment schedule was verified in a former study by Vogt et al. .
2.3. Training Tool BrainStim
BrainStim is a computerized program to improve working memory performance. It contains three different modules: two focusing on the spatial aspects of working memory and the third on the verbal aspects. The first module, called City Map, trains spatial orientation. Participants have to memorize either a visually or verbally presented route. Afterwards, the route has to be reconstructed from memory on a virtual city map. The module Find Pairs trains visual memory. Patients have to remember the location of two similar turned over cards. The last module, Memorize Numbers, presents numbers for a short period of time, and patients are asked to recall them, after solving an arithmetic distraction task. This module focuses on verbal working memory and the central executive. All modules automatically adapt their level of difficulty according to the performance of the user. After several correct answers, the level increases to a higher degree, whereas after a certain number of incorrect answers the user was forced to repeat the previous level. With each added level the amount of information to be memorized increases. BrainStim stores all training data in logfiles for further analysis.
2.4. Applied Neuropsychological Measures
During baseline assessment, depression was measured with the German version of the Center for Epidemiologic Studies Depression Scale (CES-D ; Allgemeine Depressionsskala, ADS ), and the premorbid intellectual level was assessed with a German multiple-choice vocabulary IQ test, MWT-A . The neuropsychological test battery included the following tests: verbal fluency test measuring executive functions and mental speed; selective reminding test assessing verbal short- and long-term memory by means of three measures: long-term retrieval, consistent long-term retrieval, and delayed recall; 10/36 spatial recall test measuring visual short- and long-term memory by an immediate and a delayed recall version; Symbol Digit Modalities Test (SDMT) to test for information processing speed and working memory; and 1-back task, adapted from the Test Battery for Attention Performance (TAP ) to test for short-term memory and attention. For short-term memory we additionally applied the Corsi Blocks Forward and the Digit Span Forward from the Wechsler Memory Scale revised (WMS-R ). Working memory, the domain of major interest in our study, was measured with the Paced Auditory Serial Addition Test (PASAT), the 2-back and 3-back task, adapted from the TAP , the Corsi Blocks backward, and the Digit Span Backward from the WMS-R . Completion of the test battery took approximately 75 to 90 minutes.
Taking into account the already proven specificity of BrainStim on working memory performance in previous studies [27, 28], to disburden the patients and to hereby improve adherence until the end of the study, only the following tests were applied for the posttreatment assessment: the PASAT, the 1-back, 2-back and 3-back tasks, the Corsi Blocks Forward and Backward as well as the Digit Span task Forward and Backward. This posttreatment assessment took approximately 30 minutes to be completed.
To evaluate cognitive performance, values corrected for age were calculated. Patients cognitive performance was classified as reduced if they reached a value smaller than −1.65 since this cutoff represents the ninetieth confidence interval. About one-third of the participants could not complete the PASAT, 1-back and/or 2-back tasks and more than three-quarters could not complete the 3-back task. Therefore these tests were excluded from further analyses. Due to the small sample sizes, comparison between groups on cognitive and psychosocial variables was performed using the nonparametric Mann-Whitney U Test.
The log files of the training tool BrainStim were read out, and average levels of difficulty from first and last training were compared. It has to be noted that not all patients were able to complete all 16 training sessions (11 patients completed all sessions and 4 completed only 15 sessions), therefore; analysis was computed by means of the last observation carried forward method. To check whether the improvement of performance was significant, the averaged levels of difficulty from the first and the last available training were compared using the nonparametric Wilcoxon signed-ranks test (exact). This nonparametric test was also chosen due to the small sample size.
To quantify the comparison between pre- and posttest performance, value differences between pre- and posttest were calculated for both participant groups. Mann-Whitney U Test was used to evaluate these differences between the two groups. Further, Cohen’s for effect sizes was calculated . Therefore, the mean differences between the training group  and the control group (CG) were divided by the pooled standard deviation . To evaluate the size of the effect, was rated as a small effect, as a moderate, and as a large effect.
As displayed in Table 1, the 15 patients (women: 6; men: 9) in the training group and the 14 patients (women: 8; men: 6) in the control group showed no significant differences with regard to gender (, ), education, age, severity of illness (rating based on the clinical experience of the treating psychiatrist), and duration of illness and depression. The control group seemed to have a slightly higher intellectual level.
All patients showed rather poor cognitive performance. In the training group 12 out of 15 patients (80%) showed reduced performance in one or more cognitive domains, and in the control group 13 of 14 (93%) showed impaired cognition. However, cognitive profiles did not differ between the intervention and control groups at baseline, except for mental speed.
Mean depression score was below the cutoff value (>23) in both groups. When analysing individual data, 6 out of 15 patients (40%) in the intervention group and 5 out of 14 patients (36%) in the control group had a total score above the cutoff, indicating comorbid depression.
3.2. Training Tool BrainStim
In our group of 15 patients, who received the training, 11 patients completed all 16 sessions of training, while 4 completed only 15 sessions.
Figure 1 illustrates the averaged training performance in the three modules. In all three modules the patients were able to increase the level of task difficulty during the four weeks of training. With training, the curve of City Map visual seems to approach asymptotically the highest level, whereas progress in the other modules is considerably smaller.
Means and standard deviations of levels of difficulty for the first and last training are displayed in Table 2. In all three modules participants managed to significantly increase their performance: City Map with visual instructions (, ), City Map with verbal instructions (, ), Find Pairs (, ), and Memorize Numbers (, ).
3.3. Neuropsychological Test Battery
Means and standard deviations for each test, effect sizes and results of the Mann-Whitney U Test are displayed in Table 3, and changes in values of cognitive performance are shown in Figure 2. In verbal short-term memory (Digit Span Forward), both groups remained stable in their performance. In visual short-term memory (Corsi Blocks Forward) both groups showed an increased outcome after four weeks. Patients with training increased more than patients in the control group. Although this difference was not statistically significant, Cohen’s implied a relevant effect. The group without training decreased in verbal working memory performance (Digit Span Backward) whereas the trained group improved. Here, a significant difference between the two groups was found and Cohen’s indicated a large effect. In visual working memory performance (Corsi Blocks Backward) both groups improved slightly, but no statistically significant difference was detectable between the two groups.
In the present study, the effectiveness of a computerized remediation training for working memory was evaluated in patients with chronic schizophrenia. During the training itself, patients showed improved performance when comparing the lasttioniry to the first training sessions in all three modules indicating learning potential.
Concerning the postintervention effects on the neuropsychological outcomes no effects were found for verbal short-term memory. The training showed no differential effect on this cognitive domain, confirming our expectations. This result is in accordance with Klingberg et al. , who did not find changes in verbal short-term memory in the stabilization phase of schizophrenia. Further, a small but not statistically significant effect was found on visual short-term memory. Trained patients improved more than untrained subjects. The improvement detected in both groups leads to the conclusion that this domain may recover in the stabilization phase after an acute schizophrenic episode, but that recovery can be supported and increased by a cognitive training.
In verbal working memory, a large effect was found. Patients who received the training showed an increased performance after four weeks, whereas patients without training decreased. Our findings on verbal working memory are in accordance with results by McGurk et al.  who reported medium effect sizes for this cognitive domain. In visual working memory patients with training improved more than patients without. Although this effect was not statistically significant it goes into the expected direction.
In contrast to the results in our study, several studies recently showed no effectiveness of their computer-assisted cognitive remediation therapy on most cognitive functions, including working memory [16, 40, 41]. In a most recent study by Rass and coworkers  the authors were not able to show a generalized effect on the basis of a computer-assisted training programme. However, the training sessions were administered biweekly for two hours, each indicates that not a massed training was administered. Most importantly, their groups showed no systematic variation between treatment and comparison groups. Thus, an increase in sample size would have led to a statistical difference hardly. In contrast, our training sessions were scheduled four times a week for 45 minutes each, and our groups showed a systematic direction towards a better outcome for the intervention group. Cavallaro et al.  reported effects on several cognitive domains but not on working memory. A possible explanation for this discrepancy may be due to the content of training. Previous studies focused on other cognitive domains then working memory and trained according to other treatment regimen. Thus, not every training seems to provoke beneficial effects meaning that content and modality of training may be more important than what has been formerly assumed. Further studies should compare different treatment programs to investigate the mechanisms of cognitive intervention and to finally specify a gold-standard for cognitive remediation in schizophrenia.
An additional next step would be to study the underlying neural mechanisms of cognitive remediation in schizophrenia. Haut et al.  reported increased activation in attention and working memory networks after a training designed to train these cognitive functions. Subramaniam and colleagues  recently described that improvements in reality monitoring correlated with medial prefrontal cortex activity after training.
Despite the fact that our hypotheses were corroborated, the present pilot study has several limitations, which have to be considered. First, even if the characteristics of the two groups of patients at baseline did not differ systematically, they differed in terms of premorbid intellectual level, in that the control group had higher measures, and in terms of executive functioning, in that the intervention group scored higher. This might have influenced the effects of our training. A higher intellectual level and thus a higher cognitive brain reserve as well as higher scores in executive functioning may support effectiveness of such an intervention.
Second, symptom severity was only rated by treating psychiatrists at baseline but not after the cognitive intervention. Thus we cannot relate changes in symptom severity to improvements in working memory after 4 weeks.
Third, only four cognitive outcome measures could finally be included into the statistical analyses since most participants could not complete the more complex tasks such as the n-back and PASAT. This demonstrates the degree of impairment in this patient cohort and the need for specified additional cognitive treatment approaches. Of interest is that after the training more patients were finally be able to complete these tasks, and they reported to feel more confident to do so. Although the observed changes cannot be rated statistically, they are certainly of relevance for patients. Fourth, the drop-out rate was high. One third of patients did not complete the study. All of them refused to return to the clinic for the training or neuropsychological posttesting after their discharge. In contrast to other studies, participants in this study got no financial compensation, which might be reflected by the high drop-out rate. However, a design without any financial incentive represents rather a daily clinical routine and is, therefore, more appropriate in predicting training success in this setting. Fifth, to overcome patients’ adherence problem we decided to shorten the posttraining neuropsychological battery and to solely focus on working memory outcomes. By this approach, transfer effects of training could not be assessed. Sixth, the training was supervised one-by-one. Patients often reported that they enjoyed the additional advertence. Therefore, it is likely that at least a part of the improvement might be due to this additional advertence and the related additional effort the patients were willing to invest. Unfortunately, the present design does not allow separating the effects of training from the possible effects of additional advertence and motivation. We would suggest including an active control group additionally to the treatment-as-usual group for further studies. Seventh, patients were assigned to the treatment or waiting control groups consecutively by their inclusion in the study the (first 15 patients were assigned to the treatment group, and the following 14 patients were assigned to the waiting control group) meaning that no real randomisation took place. Eightly, a follow-up testing to survey long-term effects of cognitive remediation is missing. Wykes et al.  reported increased working memory performance, compared to baseline, 6 months after the end of their cognitive remediation training. Though the persistence of cognitive remediation has already been described in other studies we cannot assume that follow-up effects would also have been detectable in our study. Follow-up measurements necessarily have to be included in further studies to address this important topic.
A last limitation to discuss is the small sample size of the two groups. The found effects should be verified in a larger sample. In a larger cohort the different improvement of the two groups in visual working memory might even reach statistical significance. Further, effect sizes were calculated to quantify the changes in cognitive performance. Wykes and Huddy  discuss that size of effect does not necessarily matter. They show that improvement in cognition may have no effect on functioning. The present study includes no scales measuring general functioning or factors of daily living. Therefore, a transfer of better cognitive abilities into work rehabilitation and quality of life cannot be evaluated, but it can be presumed from other studies that there might be an effect [46, 47]. One study showed that especially auditory attention and working memory improvement predict changes in life skills after cognitive remediation therapy . Cognitive outcome influences negative symptoms , what in turn affects the daily outcome . Actually, Lecardeur et al.  even report an influence on psychotic symptoms.
Despite the unidirectional variation between the groups, showing a clear advantage for the training group, medication together with illness severity and chronicity might have attenuated our results. Thus, explanatory power of this study is restricted due to its limitations, and generalisation of the results should be regarded with caution. Nevertheless, this study clearly shows beneficial effects even in patients with chronic schizophrenia. Additional to the statistical proofs, patients reported to have enjoyed training, that they could transfer learned strategies to everyday life, and that they wished to work with a computer in the future, since for several participants it was the first time to work with computers. A couple of patients took the opportunity to work with another computerized training in occupational therapy. This feedback is consistent with the one reported by Bender et al. . Combined with other interventions cognitive trainings seem to be more effective , and the effects of intervention are more durable . Therefore, in sum, cognitive training seems to be a valuable additional treatment approach for schizophrenic patients in clinical everyday life, besides the usual medication-based treatments.
Conflict of Interests
All authors declare that they have no conflict of interests.
The authors thank all patients who participated in this study. Further, they like to thank Claudia Burn, Corinne Spillmann, Isabelle Weiss, Silvia Balu, Cornelia Witthauer, and Annina Glaeser for neuropsychological testing and training of the patients.
- R. Morice and A. Delahunty, “Frontal/executive impairments in schizophrenia,” schizophrenia Bulletin, vol. 22, no. 1, pp. 125–137, 1996.
- T. A. Niendam, C. E. Bearden, I. M. Rosso et al., “A prospective study of childhood neurocognitive functioning in schizophrenic patients and their siblings,” American Journal of Psychiatry, vol. 160, no. 11, pp. 2060–2062, 2003.
- L. Helldin, J. M. Kane, U. Karilampi, T. Norlander, and T. Archer, “Remission and cognitive ability in a cohort of patients with schizophrenia,” Journal of Psychiatric Research, vol. 40, no. 8, pp. 738–745, 2006.
- S. A. Chong, “Inclusion of cognitive impairment in the DSM diagnosis of schizophrenia: if not now, when?” World Psychiatry, vol. 7, no. 1, pp. 37–38, 2008.
- R. S. E. Keefe, “Should cognitive impairment be included in the diagnostic criteria for schizophrenia?” World Psychiatry, vol. 7, no. 1, pp. 22–28, 2008.
- A. Baddeley, “Working memory,” Science, vol. 255, no. 5044, pp. 556–559, 1992.
- A. D. Baddeley and G. Hitch, “Working Memory,” Psychology of Learning and Motivation, vol. 8, pp. 47–89, 1974.
- A. Baddeley, “The episodic buffer: a new component of working memory?” Trends in Cognitive Sciences, vol. 4, no. 11, pp. 417–423, 2000.
- N. F. Forbes, L. A. Carrick, A. M. McIntosh, and S. M. Lawrie, “Working memory in schizophrenia: a meta-analysis,” Psychological Medicine, vol. 39, no. 6, pp. 889–905, 2009.
- J. Lee and S. Park, “Working memory impairments in schizophrenia: a meta-analysis,” Journal of Abnormal Psychology, vol. 114, no. 4, pp. 599–611, 2005.
- J. M. Gold, C. M. Wilk, R. P. McMahon, R. W. Buchanan, and S. J. Luck, “Working memory for visual features and conjunctions in schizophrenia,” Journal of Abnormal Psychology, vol. 112, no. 1, pp. 61–71, 2003.
- P. D. Harvey, M. F. Green, C. Bowie, and A. Loebel, “The dimensions of clinical and cognitive change in schizophrenia: evidence for independence of improvements,” Psychopharmacology, vol. 187, no. 3, pp. 356–363, 2006.
- S. Leucht, C. Corves, D. Arbter, R. R. Engel, C. Li, and J. M. Davis, “Second-generation versus first-generation antipsychotic drugs for schizophrenia: a meta-analysis,” The Lancet, vol. 373, no. 9657, pp. 31–41, 2009.
- A. Reichenberg and P. D. Harvey, “Neuropsychological impairments in schizophrenia: integration of performance-based and brain imaging findings,” Psychological Bulletin, vol. 133, no. 5, pp. 833–858, 2007.
- R. H. Pietrzak, P. J. Snyder, C. E. Jackson et al., “Stability of cognitive impairment in chronic schizophrenia over brief and intermediate re-test intervals,” Human Psychopharmacology, vol. 24, no. 2, pp. 113–121, 2009.
- D. Dickinson, W. Tenhula, S. Morris et al., “A randomized, controlled trial of computer-assisted cognitive remediation for schizophrenia,” American Journal of Psychiatry, vol. 167, no. 2, pp. 170–180, 2010.
- O. Rass, J. K. Forsyth, A. R. Bolbecker, et al., “Computer-assisted cognitive remediation for schizophrenia:a randomized single-blind pilot study,” schizophrenia Research, vol. 139, no. 1–3, pp. 92–98, 2012.
- D. C. Goff, M. Hill, and D. Barch, “The treatment of cognitive impairment in schizophrenia,” Pharmacology Biochemistry and Behavior, vol. 99, no. 2, pp. 245–253, 2011.
- S. R. McGurk, E. W. Twamley, D. I. Sitzer, G. J. McHugo, and K. T. Mueser, “A meta-analysis of cognitive remediation in schizophrenia,” American Journal of Psychiatry, vol. 164, no. 12, pp. 1791–1802, 2007.
- R. Cavallaro, S. Anselmetti, S. Poletti et al., “Computer-aided neurocognitive remediation as an enhancing strategy for schizophrenia rehabilitation,” Psychiatry Research, vol. 169, no. 3, pp. 191–196, 2009.
- O. Grynszpan, S. Perbal, A. Pelissolo et al., “Efficacy and specificity of computer-assisted cognitive remediation in schizophrenia: a meta-analytical study,” Psychological Medicine, vol. 41, no. 1, pp. 163–173, 2011.
- M. Bell, G. Bryson, and B. E. Wexler, “Cognitive remediation of working memory deficits: Durability of training effects in severely impaired and less severely impaired schizophrenia,” Acta Psychiatrica Scandinavica, vol. 108, no. 2, pp. 101–109, 2003.
- T. C. Greig, W. Zito, B. E. Wexler, J. Fiszdon, and M. D. Bell, “Improved cognitive function in schizophrenia after one year of cognitive training and vocational services,” schizophrenia Research, vol. 96, no. 1–3, pp. 156–161, 2007.
- T. D'Amato, R. Bation, A. Cochet et al., “A randomized, controlled trial of computer-assisted cognitive remediation for schizophrenia,” schizophrenia Research, vol. 125, no. 2-3, pp. 284–290, 2011.
- M. M. Kurtz, J. C. Seltzer, D. S. Shagan, W. R. Thime, and B. E. Wexler, “Computer-assisted cognitive remediation in schizophrenia: What is the active ingredient?” Schizophrenia Research, vol. 89, no. 1–3, pp. 251–260, 2007.
- T. Wykes, V. Huddy, C. Cellard, S. R. McGurk, and P. Czobor, “A meta-analysis of cognitive remediation for schizophrenia: methodology and effect sizes,” American Journal of Psychiatry, vol. 168, no. 5, pp. 472–485, 2011.
- I. K. Penner, M. Kobel, M. Stöcklin, K. Opwis, and P. Calabrese, “BrainStim—hirnstimulation als Präventions- und Therapiemassnahme?” Neurogeriatrie, vol. 4, no. 3, pp. 109–115, 2007.
- A. Vogt, L. Kappos, P. Calabrese et al., “Working memory training in patients with multiple sclerosis—comparison of two different training schedules,” Restorative Neurology and Neuroscience, vol. 27, no. 3, pp. 225–235, 2009.
- A. K. Vogt, M. Stoecklin, L. Gschind, K. Opwis, and I. K. Penner, “BrainStim-Wirksamkeit eines neu entwickelten kognitiven Trainingsprogramms bei MS,” Journal of NeuroEngineering and Rehabilitation, vol. 14, no. 2, 2008.
- I. K. Penner, M. Kobel, and K. Opwis, “BrainStim—a recently developed tool to train different aspects of working memory,” in Proceedings of the INS/GNP Conference., pp. 17–19, 2006.
- L. S. Radloff, “The CES-D scale: a self report depression scale for research in the general population,” Applied Psychological Measurement, vol. 1, pp. 385–401, 1977.
- M. Hautzinger and M. Bailer, Allgemeine Depressionsskala (ADS), Beltz PVU, Weinheim, Germany, 1993.
- S. Lehrl, J. Merz, G. Burkhard, and S. Fischer, Mehrfachwahl-Wortschatz-Intelligenztest (MWT-A). Manual, Spitta, Balingen, Germany, 1991.
- P. Zimmermann and B. Fimm, Testbatterie Zur Aufmerksamkeitsprüfung, Psytest, Würselen, Germany, 1992.
- C. Härting, H. J. Markowitsch, H. Neufeld, P. Calabrese, and K. Deisinger, WMS-R Wechsler Gedächtnis Test—Revidierte Fassung, Hans Huber, Bern, Switzerland, 2000.
- D. Gronwall and H. Sampson, The Psychological Effects of Concussion, Auckland University Press, Auckland, New Zealand, 1974.
- J. Cohen, Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum Associates, Hillsdale,, NJ, USA, 1988.
- T. R. Knosche and M. Tittgemeyer, “The role of long-range connectivity for the characterization of the functional-anatomical organization of the cortex,” Frontiers in Systems Neuroscience, vol. 5, article 58, 2011.
- S. Klingberg, A. Wittorf, S. Sickinger, G. Buchkremer, and G. Wiedemann, “Course of cognitive functioning during the stabilization phase of schizophrenia,” Journal of Psychiatric Research, vol. 42, no. 4, pp. 259–267, 2008.
- R. S. Keefe, S. Vinogradov, A. Medalia, et al., “Feasibility and pilot efficacy results from the multisite Cognitive Remediation in the schizophrenia Trials Network (CRSTN) randomized controlled trial,” Journal of Clinical Psychiatry, vol. 73, no. 7, pp. 1016–1022, 2012.
- N. V. Murthy, H. Mahncke, B. E. Wexler, et al., “Computerized cognitive remediation training for schizophrenia: an open label, multi-site, multinational methodology study,” schizophrenia Research, vol. 139, no. 1–3, pp. 87–91, 2012.
- K. M. Haut, K. O. Lim, and A. MacDonald, “Prefrontal cortical changes following cognitive training in patients with chronic schizophrenia: effects of practice, generalization, and specificity,” Neuropsychopharmacology, vol. 35, no. 9, pp. 1850–1859, 2010.
- K. Subramaniam, T. L. Luks, M. Fisher, G. V. Simpson, S. Nagarajan, and S. Vinogradov, “Computerized cognitive training restores neural activity within the reality monitoring network in schizophrenia,” Neuron, vol. 73, no. 4, pp. 842–853, 2012.
- T. Wykes, C. Reeder, S. Landau et al., “Cognitive remediation therapy in schizophrenia: randomised controlled trial,” British Journal of Psychiatry, vol. 190, pp. 421–427, 2007.
- T. Wykes and V. Huddy, “Cognitive remediation for schizophrenia: it is even more complicated,” Current Opinion in Psychiatry, vol. 22, no. 2, pp. 161–167, 2009.
- M. D. Bell and G. Bryson, “Work Rehabilitation in schizophrenia: does cognitive impairment limit improvement?” Schizophrenia Bulletin, vol. 27, no. 2, pp. 269–279, 2001.
- M. S. Ritsner, “Predicting quality of life impairment in chronic schizophrenia from cognitive variables,” Quality of Life Research, vol. 16, no. 6, pp. 929–937, 2007.
- M. M. Kurtz, J. C. Seltzer, M. Fujimoto, D. S. Shagan, and B. E. Wexler, “Predictors of change in life skills in schizophrenia after cognitive remediation,” schizophrenia Research, vol. 107, no. 2-3, pp. 267–274, 2009.
- D. M. Bellucci, K. Glaberman, and N. Haslam, “Computer-assisted cognitive rehabilitation reduces negative symptoms in the severely mentally ill,” schizophrenia Research, vol. 59, no. 2-3, pp. 225–232, 2003.
- J. Ventura, G. S. Hellemann, A. D. Thames, V. Koellner, and K. H. Nuechterlein, “Symptoms as mediators of the relationship between neurocognition and functional outcome in schizophrenia: a meta-analysis,” schizophrenia Research, vol. 113, no. 2-3, pp. 189–199, 2009.
- L. Lecardeur, E. Stip, M. Giguere, G. Blouin, J. P. Rodriguez, and M. Champagne-Lavau, “Effects of cognitive remediation therapies on psychotic symptoms and cognitive complaints in patients with schizophrenia and related disorders: a randomized study,” schizophrenia Research, vol. 111, no. 1–3, pp. 153–158, 2009.
- S. Bender, A. Dittmann-Balcar, G. Prehn, R. Thienel, S. Peters, and M. Gastpar, “Subjektives Erleben eines computer-gestützten kognitiven Trainings durch Patienten mit Schizophrenien,” Nervenarzt, vol. 75, no. 1, pp. 44–50, 2004.
- C. R. Bowie, S. R. McGurk, B. Mausbach, T. L. Patterson, and P. D. Harvey, “Combined cognitive remediation and functional skills training for schizophrenia: effects on cognitionFunctional competence, and real-world Behavior,” American Journal of Psychiatry, 2012.