Research Article | Open Access
John Stratton, Philip T. Yanos, Paul Lysaker, "Insight, Neurocognition, and Schizophrenia: Predictive Value of the Wisconsin Card Sorting Test", Schizophrenia Research and Treatment, vol. 2013, Article ID 696125, 6 pages, 2013. https://doi.org/10.1155/2013/696125
Insight, Neurocognition, and Schizophrenia: Predictive Value of the Wisconsin Card Sorting Test
Lack of insight in schizophrenia is a key feature of the illness and is associated with both positive and negative clinical outcomes. Previous research supports that neurocognitive dysfunction is related to lack of insight, but studies have not examined how neurocognition relates to change in insight over time. Therefore, the current study sought to understand how performance on the Wisconsin Card Sorting Test (WCST) differed between participants with varying degrees of change in insight over a 6-month period. Fifty-two patients with schizophrenia or schizoaffective disorder were administered the WCST and Positive and Negative Syndrome Scale (PANSS) at baseline, and the PANSS was again administered at a 6-month follow-up assessment. Results indicated that while neurocognition was related to insight at baseline, it was not related to subsequent change in insight. The implications of findings for conceptualization and assessment of insight are discussed.
Lack of insight into one’s illness has been cited as common among people with psychotic disorders and in particular schizophrenia. Lack of insight can be manifested in the denial or lack of awareness of the presence or impact of symptoms or the need for treatment . Those with schizophrenia have been found to have higher levels of impaired insight in comparison to other psychotic disorders [2–6], with some studies citing this as the most common clinical phenomenon linked with schizophrenia [7, 8]. From a broader perspective, lack of insight reflects not so much the absence of a single piece of knowledge but a failure to construct an adaptive narrative account of the challenges posed by having a psychiatric illness [9, 10].
Although not a diagnostic criterion, lack of insight has become an important topic in the schizophrenia literature due to its utility as a prognosis indicator [11, 12] and potential marker of a subtype of the illness . A better understanding of the etiological correlates of insight could enhance treatment modalities , improve prevention, and elucidate the relationship between insight and other clinical symptoms . A number of such associations have already been found, including correlations between poor insight and severity of psychopathology [4, 15, 16], increased number of hospitalizations [4, 15], violent behavior [17, 18], lower treatment adherence [4, 19, 20], and poor premorbid or present adjustment . Despite recognition as an important concept within behavioral science, reaching consensus as to what constitutes insight has proved challenging. Initially, insight was considered a dichotomous construct that was either present or absent and was measured by a patient’s verbal recognition of existing psychological difficulties . This conceptualization, however, has evolved into one of multidimensionality, where insight incorporates a multitude of phenomena , and is measured on a continuum. With this multidimensional approach have come a variety of new definitions. Such definitions include a combination of any number of the following dimensions: acceptance of the illness label, awareness of having a mental disorder, perceived need for treatment, awareness of treatment benefit, attribution of benefits to treatment, awareness of signs and symptoms, awareness of social consequences of illness, attribution of signs and symptoms to having a mental disorder, and lack of judgment . Additionally, it has been argued that, beyond these dimensions, ethnicity, culture, interpersonal factors, education, social class, or intellectual functioning plays important roles in insight . Despite inconsistent definitions across studies, there are a number of common components to the majority of definitions, with most including awareness of having a mental disorder and awareness and attribution of symptoms [22, 24–27].
As a result of the inconsistency in defining insight, there is a lack of continuity in how the construct is measured an inconsistency used by some to explain contradictory findings within the insight and the psychosis literature . In part, the difficulty of defining and measuring insight is explained by one’s theoretical orientation regarding the origins of impaired insight . Existing theories attribute insight to positive, negative, and disorganized symptoms [1, 29], to defense mechanisms [30–33], and to culturally dependent and socially constructed views of insight .
Those utilizing a neurological framework for understanding impaired insight hypothesize that, like those suffering from anosognosia (a clinical syndrome in which neurological disturbances are denied), lack of insight in psychosis results from abnormalities in neuroanatomical structures . Similarly, those conceptualizing insight as a result of neurocognitive dysfunction suggest that neurocognitive impairment decreases one’s capacity to construct a personal narrative for understanding one’s experience with illness, a concept that is thought to be involved in insight [9, 10].
Within the neurocognitive dysfunction literature, discrepant results have been found regarding the association between such dysfunction and diminished insight [15, 35–37]. Like the broader area of neurocognition and insight, studies investigating executive functioning and diminished insight have produced contradictory findings. Despite lacking strong consensus, studies have, with some consistency, found cross-sectional associations between impaired insight and the WCST. Specifically, previous research indicates that categories completed and perseverative errors from the WCST are significantly, albeit modestly, associated with insight [38–44]. Some, however, have failed to replicate such findings [26, 45–48].
In 2006, a meta-analysis, conducted by Aleman et al. , included 35 studies investigating the relationship between various insight measures and five cognitive domains (total cognition, IQ only, memory, frontal executive function, and performance on the WCST). Results from this study indicated a significant cross-sectional relationship between insight and the WCST, with an effect size of . Aleman et al.  noted the unique role perseveration errors played in impaired insight. This conclusion proffered by Aleman et al.  is found elsewhere within the literature [23, 43, 49].
While there appears a modest cross-sectional relationship between the WCST and insight, contradictory results have made the nature of this relationship unclear. A major limitation of prior studies is that they have not examined whether the WCST predicts change in insight over time. A better understanding of the prospective relationship between WCST (specifically perseveration errors) and insight could provide useful information about the trajectory of patients with impaired insight. Therefore, the current study aimed to assess how performance on neurocognitive measures differed between participants with varying degrees of insight over a 6-month period. It was hypothesized that those with worsening insight would show more neurocognitive dysfunction than those who remained stable or improved in insight.
2. Materials and Methods
Participants were 52 patients (51 male, 1 female) receiving outpatient services from either a midwestern psychiatric outpatient VA clinic or a local CMHC. Participants received a DSM-IV diagnosis of schizophrenia or schizoaffective disorder . The mean number of lifetime hospitalizations was 7.8 with an average first occurrence at age 27 . The mean age was 47.2 . Mean education was 13.8 . Participants were primarily White and African American , with one Latino. No participants had been hospitalized, changed medication, or changed housing in the month prior to enrolling in the study. Participants with active substance dependence or intellectual disability were excluded from participation.
Clinical symptoms of schizophrenia were assessed using the PANSS [50, 51]. The scale is composed of 30 items and is used widely in clinical and research settings. It is regarded as a reliable tool for symptom assessment . In accordance with previous research on the factor structure of the PANSS [53, 54], the current study utilized the five-factor model (hostility, emotional discomfort, positive and negative symptoms, and cognition) in assessing clinical symptoms of schizophrenia .
Insight was assessed using the PANSS item G12. G12 is a global clinical assessment of lack of judgment and insight. It measures one’s level of insight by assessing one’s ability to recognize psychiatric illness, need for treatment, decision-making, and planning.
Executive functioning was assessed using the WCST. The WCST was developed by Grant and Berg in 1948  and is thought to measure preservation, set shifting, and abstract thinking [56, 57]. The WCST is a common measure of executive functioning within the neuropsychological literature [58–60].
Participants were recruited from VA Medical Center’s comprehensive day hospital where they were receiving outpatient treatment. Participants were in a postacute or stable phase of their disorder (no hospitalizations or alterations in their medication or housing within the last month). Through chart reviews, individuals identified as having a history of mental retardation were excluded from the study. Once informed consent was obtained, a clinical psychologist confirmed diagnoses using the Structured Clinical Interview from DSM-IV (SCID) . Participants were then given the WCST and PANSS at baseline and the PANSS again at a 6-month follow-up assessment.
Initially, a correlation matrix was created using the variables of insight (change scores), insight at baseline, WCST (perseveration errors, categories completed) demographics, and total scores of the PANSS five factors (positive symptoms, negative symptoms, cognition, hostility, and emotional discomfort; the cognition total score did not include the G12 item as this was used to assess insight). Insight change scores were computed prior to analysis by subtracting baseline from endpoint insight scores. Any variable found to correlate significantly with insight was then entered into a multiple regression analysis. To account for baseline insight scores, insight change scores were entered as the dependent variable.
To examine if different patterns would appear if insight change was assessed categorically, participants were grouped into one of 3 groups based on their insight change scores: those that improved in insight, those that declined in insight, and those that did not change. A MANOVA was then conducted to assess whether those with worsening insight over 6-months demonstrate more neurocognitive dysfunction when compared to those with improved or static insight. WCST variables (categories completed, perseverative responses) and change scores from the PANSS five factors were entered as outcome variables. PANSS change scores were created by subtracting endpoint from baseline factor scores for the following factors: positive, negative, cognition (excluding G12), hostility, and emotional discomfort.
Table 1 shows correlations between variables of interest (change in insight, baseline insight, PANSS factors, and WCST). As this table indicates, no variables were significantly correlated with change in insight. The PANSS cognitive factor was most strongly correlated with baseline insight. WCST categories completed had a more modest, yet significant, negative correlation with baseline insight.
|Correlation is significant at the 0.05 level (2-tailed).|
**Correlation is significant at the 0.01 level (2-tailed).
Since no significant relationships were found between change in insight and other variables, a regression analysis predicting change in insight was not preformed. However, based on the relationships found in the correlation matrix, a multiple regression predicting baseline insight was conducted, with WCST categories completed, the PANSS cognitive factor, perseveration errors, and the PANSS negative factor entered as predictors. Perseveration errors and the PANSS negative factor were included in this regression analysis since they approached significant correlations with baseline insight. Results indicated that the model significantly predicted baseline insight . Of the predictors, only the PANSS cognitive factor significantly contributed to the model (beta = .575, ).
Participants were then grouped into categories based on whether their insight score increased, decreased, or did not change between baseline and 6 months. 10 participants (20%) were categorized as improved, 8 as decreased (15%), and 33 (65%) were unchanged. Mean WCST perseverative responses was 41.5 for the improved insight group, 42.75 for the declined insight group, and 38.94 for the unchanged insight group. Mean WCST categories completed for the improved, declined, and unchanged insight groups were 3.1 (), 3.5 , and 3.3 , respectively. To assess if the WCST or PANSS scores differed between these 3 groups, a MANOVA was conducted, which failed to demonstrate a statistically significant difference between groups on any of the outcome variables .
Neither the PANSS cognitive factor nor WCST variables were found to statistically significantly predict change in insight, thus failing to support the current study’s hypothesis. Similarly, a MANOVA failed to find group differences on WCST variables between insight trajectories. These findings indicate that neurocognition remains similar across insight trajectories. One possible interpretation of these findings is that neurocognitive functioning, and specifically the capacity for cognitive flexibility, is unassociated with insight trajectory and that other factors would account for insight change. In addition, the regression analysis predicting baseline insight indicated that, despite a significant correlation between WCST perseveration errors and baseline insight, WCST perseveration errors did not significantly contribute to the prediction of insight when other factors were included in the equation. While perseveration errors have been found to be predictive of insight by others [43, 49], the predictive value of perseveration went unsupported in this study, a conclusion also drawn by Collins et al.  and Rossell et al. . Like perseveration errors, categories completed also failed to predict baseline insight. Of those studies assessing whether categories completed predict insight, most have found this variable to have little to no predictive value [39, 41, 62].
An alternative explanation for finding a lack of relationship between the WCST and insight change is the lack of sensitivity of the current study’s insight measure. While the PANSS item G12 measures the concepts of awareness of illness, illness severity, and need for treatment, this item could simply be measuring fluctuations in agreement or rejection of symptoms/labels and failing to capture aspects of insight that some argue to be central to the construct (i.e., capacity to construct a personal narrative of illness experience that can be understood by others). Therefore, it is possible that insight, as measured by the PANSS, functions independently of neurocognition. Perhaps a more sensitive measure of insight, like that proposed by Lysaker et al. [9, 10], would better capture the relationship between neurocognitive dysfunction and changes in insight over time. Indeed, the capacity to construct a personal narrative would be diminished by problems in forming concepts, profiting from correction, and conceptual flexibility (perseveration errors). It is presumable that the capacity for abstract thinking, change and refinement of a narrative, and integration of feedback from others would aid in the construction of a coherent and understandable narrative.
Despite adding to the literature by assessing the prospective relationship between neurocognition and insight, the current study had a number of limitations. First, the sample size was small, restricting statistical power. Although a smaller sample size is not uncommon within this vein of research [41, 62], a larger sample would provide a better understanding of the relationships between the current study’s variables and allow more confident interpretations of these relationships. Second, change in insight groups was small; therefore, the lack of findings could be the result of a restriction in range for the insight variable. Third, insight was measured using the G12 item of the PANSS. Although this measure of insight is common within the literature, an independent insight scale would have provided greater confidence in interpreting the relationship between insight and the PANSS cognitive factor. Using a measure of insight that facilitated analyzing various components of insight (i.e., current awareness of symptoms, past awareness of symptoms) could have provided a better understanding of how different aspects of insight relate to neurocognitive and clinical variables. Fourth, assessing WCST at multiple points in time would have provided further opportunity to understand the relationship between WCST and insight. Finally, participants in this study were relatively stable outpatients. Investigating insight in a first episode or inpatient sample may have provided a greater degree of variance in insight and symptom severity.
Future research should investigate neurocognitive difference between insight trajectories using a multidimensional measure of insight, as opposed to a unidimensional measure. Specifically, assessing whether WCST (perseveration errors or categories completed) relates to various aspects of insight (rather than insight as a whole) could shed light on the nature of the insight-neurocognition relationship. Utilizing a measure of insight that incorporates a narrative approach could prove useful in understanding how neurocognitive dysfunction, and perseveration errors in particular, affects one’s ability for narrative construction. One possibility that remains unexplored is that poorer neurocognition could lead to an inability to construct a personal narrative that provides an alternate understanding of illness experiences (e.g., one that does not involve mental illness). This inability to construct a personal narrative could actually result in higher superficial insight (e.g., shallow agreement with the label but no in-depth understanding) for individuals with diminished neurocognition as they would be unable to provide alternative accounts of their symptoms (see Roe et al. , for a discussion of how narrative insight can be independent from more superficial insight). This could ultimately lead to greater denial so as to avoid the negative stigma attached to identification with mental illness.
Findings from the current study lend mixed support for the relationship between neurocognition and insight. While WCST was not found to be predictive of insight, the PANSS cognitive factor significantly contributed to the regression model, suggesting a relationship between insight and a more general measure of cognition. These findings suggest that performance on the WCST fails to delineate between insight trajectories, when insight is conceptualized as need for treatment, illness awareness, and illness severity. A narrative approach to understanding insight may help in elucidating how neurocognition relates to insight trajectory, as conceptual flexibility, concept formation, and benefitting from feedback likely contribute to the capacity to construct a personal narrative.
- K. Osatuke, J. Ciesla, J. W. Kasckow, S. Zisook, and S. Mohamed, “Insight in schizophrenia: a review of etiological models and supporting research,” Comprehensive Psychiatry, vol. 49, no. 1, pp. 70–77, 2008.
- X. F. Amador, M. Flaum, N. C. Andreasen et al., “Awareness of illness in schizophrenia and schizoaffective and mood disorders,” Archives of General Psychiatry, vol. 51, no. 10, pp. 826–836, 1994.
- X. F. Amador and J. M. Gorman, “Psychopathologic domains and insight in schizophrenia,” Psychiatric Clinics of North America, vol. 21, no. 1, pp. 27–42, 1998.
- J. P. McEvoy, L. J. Apperson, P. S. Appelbaum et al., “Insight in schizophrenia. Its relationship to acute psychopathology,” Journal of Nervous and Mental Disease, vol. 177, no. 1, pp. 43–47, 1989.
- A. Michalakeas, C. Skoutas, A. Charalambous et al., “Insight in schizophrenia and mood disorders and its relation to psychopathology,” Acta Psychiatrica Scandinavica, vol. 90, no. 1, pp. 46–49, 1994.
- S. Pini, G. B. Cassano, L. Dell'Osso, and X. F. Amador, “Insight into illness in schizophrenia, schizoaffective disorder, and mood disorders with psychotic features,” American Journal of Psychiatry, vol. 158, no. 1, pp. 122–125, 2001.
- W. T. Carpenter Jr., J. S. Strauss, and J. J. Bartko, “Flexible system for the diagnosis of schizophrenia: report from the WHO International Pilot Study of Schizophrenia,” Science, vol. 182, no. 4118, pp. 1275–1278, 1973.
- N. Sartorius, R. Shapiro, M. Kimura, and K. Barrett, “WHO international pilot study of schizophrenia,” Psychological Medicine, vol. 2, no. 4, pp. 422–425, 1972.
- P. H. Lysaker, P. T. Yanos, and D. Roed, “The role of insight in the process of recovery from schizophrenia: a review of three views,” Psychosis, vol. 1, no. 2, pp. 113–121, 2009.
- P. H. Lysaker, K. D. Buck, G. Salvatore, R. Popolo, and G. Dimaggio, “Lack of awareness of illness in schizophrenia: conceptualizations, correlates and treatment approaches,” Expert Review of Neurotherapeutics, vol. 9, no. 7, pp. 1035–1043, 2009.
- M. A. Cooke, E. R. Peters, K. E. Greenwood, P. L. Fisher, V. Kumari, and E. Kuipers, “Insight in psychosis: influence of cognitive ability and self-esteem,” British Journal of Psychiatry, vol. 191, no. 3, pp. 234–237, 2007.
- R. G. Schwartz, “The relationship between insight, illness and treatment outcome in schizophrenia,” Psychiatric Quarterly, vol. 69, no. 1, pp. 1–22, 1998.
- W. T. Carpenter Jr., J. J. Bartko, C. L. Carpenter, and J. S. Strauss, “Another view of schizophrenia subtypes. A report from the international pilot study of schizophrenia,” Archives of General Psychiatry, vol. 33, no. 4, pp. 508–516, 1976.
- L. Buchy, M. Bodnar, A. Malla, R. Joober, and M. Lepage, “A 12-month outcome study of insight and symptom change in first-episode psychosis,” Early Intervention in Psychiatry, vol. 4, no. 1, pp. 79–88, 2010.
- M. J. Cuesta and V. Peralta, “Lack of insight in schizophrenia,” Schizophrenia Bulletin, vol. 20, no. 2, pp. 359–366, 1994.
- M. Varga, A. Magnusson, K. Flekkøy, A. S. David, and S. Opjordsmoen, “Clinical and neuropsychological correlates of insight in schizophrenia and bipolar I disorder: does diagnosis matter?” Comprehensive Psychiatry, vol. 48, no. 6, pp. 583–591, 2007.
- C. Arango, A. C. Barba, T. González-Salvador, and A. C. Ordóñez, “Violence in inpatients with schizophrenia: a prospective study,” Schizophrenia Bulletin, vol. 25, no. 3, pp. 493–503, 1999.
- M. Soyka, C. Graz, R. Bottlender, P. Dirschedl, and H. Schoech, “Clinical correlates of later violence and criminal offences in schizophrenia,” Schizophrenia Research, vol. 94, no. 1–3, pp. 89–98, 2007.
- A. David, A. Buchanan, A. Reed, and O. Almeida, “The assessment of insight in psychosis,” British Journal of Psychiatry, vol. 161, pp. 599–602, 1992.
- D. O. Perkins, “Predictors of noncompliance in patients with schizophrenia,” Journal of Clinical Psychiatry, vol. 63, no. 12, pp. 1121–1128, 2002.
- G. Dȩbowska, A. Grzywa, and K. Kucharska-Pietura, “Insight in paranoid schizophrenia—its relationship to psychopathology and premorbid adjustment,” Comprehensive Psychiatry, vol. 39, no. 5, pp. 255–260, 1998.
- A. R. Mintz, K. S. Dobson, and D. M. Romney, “Insight in schizophrenia: a meta-analysis,” Schizophrenia Research, vol. 61, no. 1, pp. 75–88, 2003.
- J. McFarland, C. McDonald, and B. Hallahan, “Insight in mental illness: an educational review,” Irish Journal of Psychological Medicine, vol. 26, no. 1, pp. 32–36, 2009.
- C. Tranulis, E. Corin, and L. J. Kirmayer, “Insight and psychosis: comparing the perspectives of patient, entourage and clinician,” International Journal of Social Psychiatry, vol. 54, no. 3, pp. 225–241, 2008.
- A. S. David, “Insight and psychosis,” British Journal of Psychiatry, vol. 156, pp. 798–808, 1990.
- F. B. Dickerson, J. J. Boronow, N. Ringel, and F. Parente, “Lack of insight among outpatients with schizophrenia,” Psychiatric Services, vol. 48, no. 2, pp. 195–199, 1997.
- S. Fennig, S. Naisberg-Fennig, and T. J. Craig, “Assessment of insight in psychotic disorders,” Israel Journal of Psychiatry and Related Sciences, vol. 33, no. 3, pp. 175–187, 1996.
- I. S. Marková, K. H. Roberts, C. Gallagher, H. Boos, P. J. McKenna, and G. E. Berrios, “Assessment of insight in psychosis: a re-standardization of a new scale,” Psychiatry Research, vol. 119, no. 1-2, pp. 81–88, 2003.
- T. van Putten, E. Crumpton, and C. Yale, “Drug refusal in schizophrenia and the wish to be crazy,” Archives of General Psychiatry, vol. 33, no. 12, pp. 1443–1446, 1976.
- C.-H. Kim, K. Jayathilake, and H. Y. Meltzer, “Hopelessness, neurocognitive function, and insight in schizophrenia: relationship to suicidal behavior,” Schizophrenia Research, vol. 60, no. 1, pp. 71–80, 2003.
- L. Lewis, “Mourning, insight, and reduction of suicide risk in schizophrenia,” Bulletin of the Menninger Clinic, vol. 68, no. 3, pp. 231–244, 2004.
- D. Mechanic, D. McAlpine, S. Rosenfield, and D. Davis, “Effects of illness attribution and depression on the quality of life among persons with serious mental illness,” Social Science and Medicine, vol. 39, no. 2, pp. 155–164, 1994.
- M. Pompili, A. Ruberto, G. D. Kotzalidis, P. Girardi, and R. Tatarelli, “Suicide and awareness of illness in schizophrenia: an overview,” Bulletin of the Menninger Clinic, vol. 68, no. 4, pp. 297–318, 2004.
- A. Takai, M. Uematsu, H. Ueki, K. Sone, and H. Kaiya, “Insight and its related factors in chronic schizophrenic patients: a preliminary study,” European Journal of Psychiatry, vol. 6, no. 3, pp. 159–170, 1992.
- A. Aleman, N. Agrawal, K. D. Morgan, and A. S. David, “Insight in psychosis and neuropsychological function: meta-analysis,” British Journal of Psychiatry, vol. 189, pp. 204–212, 2006.
- O. P. Almeida, R. Levy, R. J. Howard, and A. S. David, “Insight and paranoid disorders in late life (late paraphrenia),” International Journal of Geriatric Psychiatry, vol. 11, no. 7, pp. 653–658, 1996.
- G. Donohoe, A. Corvin, and I. H. Robertson, “Are the cognitive deficits associated with impaired insight in schizophrenia specific to executive task performance?” Journal of Nervous and Mental Disease, vol. 193, no. 12, pp. 803–808, 2005.
- F. Larøi, M. Fannemel, U. Rønneberg et al., “Unawareness of illness in chronic schizophrenia and its relationship to structural brain measures and neuropsychological tests,” Psychiatry Research, vol. 100, no. 1, pp. 49–58, 2000.
- V. Simon, M. de Hert, M. Wampers, J. Peuskens, and R. van Winkel, “The relation between neurocognitive dysfunction and impaired insight in patients with schizophrenia,” European Psychiatry, vol. 24, no. 4, pp. 239–243, 2009.
- P. Lysaker and M. Bell, “Insight and cognitive impairment in schizophrenia: performance on repeated administrations of the Wisconsin Card Sorting Test,” Journal of Nervous and Mental Disease, vol. 182, no. 11, pp. 656–660, 1994.
- T. E. Smith, J. W. Hull, L. M. Israel, and D. F. Willson, “Insight, symptoms, and neurocognition in schizophrenia and schizoaffective disorder,” Schizophrenia Bulletin, vol. 26, no. 1, pp. 193–200, 2000.
- L. N. P. Voruganti, R. J. Heslegrave, and A. G. Awad, “Neurocognitive correlates of positive and negative syndromes in schizophrenia,” Canadian Journal of Psychiatry, vol. 42, no. 10, pp. 1066–1071, 1997.
- D. A. Young, R. Davila, and H. Scher, “Unawareness of illness and neuropsychological performance in chronic schizophrenia,” Schizophrenia Research, vol. 10, no. 2, pp. 117–124, 1993.
- D. A. Young, K. K. Zakzanis, C. Bailey et al., “Further parameters of insight and neuropsychological deficit in schizophrenia and other chronic mental disease,” Journal of Nervous and Mental Disease, vol. 186, no. 1, pp. 44–50, 1998.
- L. Arduini, A. Kalyvoka, P. Stratta, O. Rinaldi, E. Daneluzzo, and A. Rossi, “Insight and neuropsychological function in patients with Schizophrenia and bipolar disorder with psychotic features,” Canadian Journal of Psychiatry, vol. 48, no. 5, pp. 338–341, 2003.
- A. A. Collins, G. J. Remington, K. Coulter, and K. Birkett, “Insight, neurocognitive function and symptom clusters in chronic schizophrenia,” Schizophrenia Research, vol. 27, no. 1, pp. 37–44, 1997.
- M. J. Cuesta, V. Peralta, F. Caro, and J. de Leon, “Is poor insight in psychotic disorders associated with poor performance on the Wisconsin Card Sorting Test?” American Journal of Psychiatry, vol. 152, no. 9, pp. 1380–1382, 1995.
- O. Freudenreich, T. Deckersbacti, and D. C. Goff, “Insight into current symptoms of schizophrenia. Association with frontal cortical function and affect,” Acta Psychiatrica Scandinavica, vol. 110, no. 1, pp. 14–20, 2004.
- M. S. Keshavan, J. Rabinowitz, G. Desmedt, P. D. Harvey, and N. Schooler, “Correlates of insight in first episode psychosis,” Schizophrenia Research, vol. 70, no. 2-3, pp. 187–194, 2004.
- S. R. Kay, L. A. Opler, and J.-P. Lindenmayer, “Reliability and validity of the positive and negative syndrome Scale for schizophrenics,” Psychiatry Research, vol. 23, no. 1, pp. 99–108, 1988.
- S. R. Kay, L. A. Opler, and J.-P. Lindenmayer, “The positive and negative syndrome scale (PANSS): rationale and standardisation,” British Journal of Psychiatry, vol. 155, supplement 7, pp. 59–65, 1989.
- R. Emsley, J. Rabinowitz, M. Torreman et al., “The factor structure for the positive and negative syndrome scale (PANSS) in recent-onset psychosis,” Schizophrenia Research, vol. 61, no. 1, pp. 47–57, 2003.
- A. Fresán, C. de La Fuente-Sandoval, C. Loyzaga et al., “A forced five-dimensional factor analysis and concurrent validity of the positive and segative syndrome scale in Mexican schizophrenic patients,” Schizophrenia Research, vol. 72, no. 2-3, pp. 123–129, 2005.
- C. Lançon, P. Auquier, G. Nayt, and G. Reine, “Stability of the five-factor structure of the positive and negative syndrome scale (PANSS),” Schizophrenia Research, vol. 42, no. 3, pp. 231–239, 2000.
- M. D. Bell, P. H. Lysaker, J. L. Beam-Goule, R. M. Milstein, and J.-P. Lindenmaye, “Five-Component model of schizophrenia: assessing the factorial invariance of the positive and negative syndrome scale,” Psychiatry Research, vol. 52, no. 3, pp. 295–303, 1994.
- P. Eling, K. Derckx, and R. Maes, “On the historical and conceptual background of the Wisconsin Card Sorting Test,” Brain and Cognition, vol. 67, no. 3, pp. 247–253, 2008.
- B.-J. Thurston-Snoha and R. R. J. Lewine, “Intact Wisconsin card sorting test performance: implications for the role of executive function in schizophrenia,” British Journal of Clinical Psychology, vol. 46, no. 3, pp. 361–369, 2007.
- S. Friis, K. Sundet, B. R. Rund, P. Vaglum, and T. H. McGlashan, “Neurocognitive dimensions characterising patients with first-episode psychosis,” British Journal of Psychiatry, vol. 181, supplement 43, pp. s85–s90, 2002.
- Z. Liu, J. Zhao, and W. C. C. Tam, “Attention and executive function impairments in unaffected siblings of patients with schizophrenia,” Hong Kong Journal of Psychiatry, vol. 13, no. 2, pp. 8–11, 2003.
- R. A. Reed, M. Harrow, E. S. Herbener, and E. M. Martin, “Executive function in schizophrenia: is it linked to psychosis and poor life functioning?” Journal of Nervous and Mental Disease, vol. 190, no. 11, pp. 725–732, 2002.
- M. B. First, R. L. Spitzer, M. Gibbon, and J. B. W. Williams, Structured Clinical Interview For DSM-IV Axis I Disorders, American Psychiatric Association, Arlington, Va, USA, 1997.
- S. L. Rossell, J. Coakes, J. Shapleske, P. W. R. Woodruff, and A. S. David, “Insight: its relationship with cognitive function, brain volume and symptoms in schizophrenia,” Psychological Medicine, vol. 33, no. 1, pp. 111–119, 2003.
- D. Roe, I. Hasson-Ohayon, S. Kravetz, P. T. Yanos, and P. H. Lysaker, “Call it a monster for lack of anything else: narrative insight in psychosis,” Journal of Nervous and Mental Disease, vol. 196, no. 12, pp. 859–865, 2008.
Copyright © 2013 John Stratton et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.