Psychiatry Journal

Psychiatry Journal / 2013 / Article

Clinical Study | Open Access

Volume 2013 |Article ID 565191 |

Thomas Johansen, Winand H. Dittrich, "Cognitive Performance in a Subclinical Obsessive-Compulsive Sample 1: Cognitive Functions", Psychiatry Journal, vol. 2013, Article ID 565191, 10 pages, 2013.

Cognitive Performance in a Subclinical Obsessive-Compulsive Sample 1: Cognitive Functions

Academic Editor: Umberto Albert
Received31 Jan 2013
Revised12 Jun 2013
Accepted15 Jun 2013
Published09 Jul 2013


Individuals who are not clinically diagnosed with obsessive-compulsive disorder (OCD) but still display obsessive-compulsive (OC) tendencies may show cognitive impairments. The present study investigated whether there are subgroups within a healthy group showing characteristic cognitive and emotional performance levels similar to those found in OCD patients and whether they differ from OCD subgroups regarding performance levels. Of interest are those cases showing subclinical symptomatology. The results revealed no impairments in the subclinical OC participants on the neuropsychological tasks, while evidence suggests that there exist high and low scores on two standardised clinical instruments (Yale-Brown Obsessive Compulsive Scale and Cognitive Assessment Instrument of Obsessions and Compulsions) in a healthy sample. OC symptoms may diminish the quality of life and prolong sustainable return to work. It may be that occupational rehabilitation programmes are more effective in rectifying subclinical OC tendencies compared to the often complex symptoms of diagnosed OCD patients. The relationship between cognitive style and subclinical OC symptoms is discussed in terms of how materials and information might be processed. Although subclinical OC tendencies would not seem to constitute a diagnosis of OCD, the quality of treatment programmes such as cognitive behavioural therapy can be improved based on the current investigation.

1. Introduction

Obsessive thoughts and compulsive behaviours are not uncommon in the general healthy population. The prevalence and nature of obsessive-compulsive (OC) phenomena in nonclinical populations have revealed that up to 80% of the general population may experience intrusive, unpleasant, and unwanted thoughts similar to those seen in obsessive-compulsive disorder (OCD) [1]. These thoughts are commonly known as subclinical OC tendencies [2, 3]. However, these thoughts are generally not acted upon and not interpreted as harmful, unlike in individuals suffering from OCD, who give these thoughts meaning by attributing a cause to their recurrence [4] and interpret them as harmful and trying to resist them [1]. Abnormal and normal obsessions seem to share form and content similarities, but abnormal obsessions appear more frequent, more intense, and of longer duration and hence produce more discomfort [3, 5]. Similarly, there is also some evidence to suggest that continuities between abnormal and normal compulsions also exist, showing overlap in content, but eliciting more discomfort and being more intense and time consuming in OCD patients [2]. There are many nonclinical and completely normal manifestations of OC behaviours and thoughts, because perceptions of perfectionism, cleaning, and ethical and moral behaviour vary between people [6]. It appears that obsessions in OCD patients are misinterpreted as personally meaningful to an exaggerated extent, which constitutes a clinical diagnosis, while obsessions in subclinical OC populations are appraised in a way not implicating, for example, personal responsibility [7]. When directly comparing subclinical OC groups and nonclinical groups, the former seem to score higher in depression and anxiety [8, 9].

Subclinical OC tendencies have been proposed to be another dimension of OCD; that is, individuals who do not meet diagnostic criteria for OCD but still are vulnerable to neuropsychological deficits [10, 11]. Studying these OC tendencies will contribute to a better understanding of the nature of clinical OCD and the various forms in which it can be manifested [9] and it could have the potential to detect nonclinical individuals who are at risk of developing OCD, based on neuropsychological performance profiles [10]. In contrast to studying OCD patients, the effects of confounding factors such as medication and symptomatic state are avoided when assessing nonclinical individuals [12].

The first studies to systematically establish performance differences between subclinical and nonclinical individuals did not focus on cognitive deficits but rather relied mostly on behavioural experiments and questionnaire measures. Typically, healthy individuals (mostly students) were administered the Maudsley Obsessional Compulsive Inventory [13] and OC checkers were identified based on their endorsement of self-reported checking behaviour [1416]. The results of these studies repeatedly confirmed impaired memory for actions in subclinical checkers compared to nonclinical checkers, a finding that has been replicated [17]. Memory impairments in the recall of past actions are thought to be related to checking compulsions, a lack of confidence in one’s memory for actions, and the worry of forgetting (obsessions), which seem to drive the urge to carry out compulsive behaviours in subclinical individuals [15]. Similarly, the ability to distinguish between real and imagined events has also been found to be impaired in subclinical checkers [15], while the recall of verbal material has been reported to be intact [17]. A study comparing clinical OC checkers, subclinical checkers, and nonclinical checkers did not find differences in memory accuracy, but the two OC checker groups displayed reduced confidence levels in their memories [18]. A critique of the early memory research using subclinical populations was the lack of memory scenarios that induced a sense of personal responsibility [19], which may have produced different results or even stronger effects.

Neuropsychological tasks have been used to investigate cognitive functioning in subclinical OC individuals. The performance on the Wisconsin Card Sorting Test (WCST) [20] revealed that subclinical checkers relative to nonclinical checkers made more total errors and perseverative errors and needed more time to complete the task [21]. This is in contrast to Mataix-Cols et al. [12], reporting no impairments in a group of subclinical individuals on the WCST as well as the Rey Auditory Verbal Learning Test [22], Trail Making Test part B [23], Controlled Oral Word Association Test [24], and the Stroop task [25]. On the other hand, they reported deficits on the Tower of Hanoi in subclinical individuals who needed more moves to solve the towers compared to healthy controls, an effect not related to clinical state, and it was suggested that a deficit in manipulating spatial information could be regarded as a trait marker in OCD [12]. The impairment on the Tower of Hanoi in subclinical individuals has later been confirmed, whereas the intact performance on the Rey Auditory Verbal Learning Test remained [11]. Furthermore, impairments have been demonstrated on a design fluency test in subclinical compared to nonclinical individuals even after controlling for mood, which suggest an inability to organise nonstructured material [26]. Memory abilities were investigated in subclinical and nonclinical checkers [27] and showed that subclinical checkers were impaired in response monitoring using the Self-Ordered Pointing Task [28] but displayed better performance compared to nonclinical checkers in reproducing abstract visuospatial designs after a 30-minute delay period. When controlling for trait anxiety symptoms, which was found to be significantly higher in the subclinical checkers, the effects of response monitoring were not as strong, but the visuospatial differences increased.

Other notable impairments in subclinical OC individuals have been found for manipulating information in visual working memory [29], lower scores on the Wechsler Memory Scale [14, 16, 30], set-shifting on the Object Alternation Test [31], the Delayed Alternation Test [32], and the TMT-B, but intact performance on the Controlled Oral Word Association Test and the WCST [33]. The Test of Everyday Attention [34] has revealed impairments in high-OC individuals [35], while subclinical individuals have been reported to perform to the same standard as nonclinical controls on the Stroop task [36]. Finally, an attentional bias for threatening information has been found in subclinical undergraduate students [37].

Subclinical psychological symptoms, or similarly the notion of common mental disorders such as anxiety and depression, are major determinants of sick leave in the OECD countries [38]. Elucidating and better understanding the implications of subclinical psychological tendencies on the working life seem an avenue worth considering and are highlighted in the present study.

There seem to be two extreme cutoff points in subclinical OC research, one “liberal” and one “conservative”, and then everything in between [9]. This is based on the results from a large student population where the performance on the Padua Inventory [39] was used to group the participants into those scoring 1, 1.5, or 2 standard deviations above the mean. These three groups did not differ in most clinical symptomatology related to obsessions, anxiety, and depression, but they all scored higher compared to a matched nonclinical control group [9]. Also, ratings on the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS) [40] in diagnosed OCD patients revealed that symptoms were still present after a two-year follow-up study [41], and similar findings have been proposed using the revised version of the Obsessive Compulsive Inventory in students [42].

The current study aimed to systematically investigate the cognitive profile in subclinical OC individuals on a range of cognitive tasks. Because of the limited research conducted on subclinical individuals and the lack of any established findings, it could be expected that the cognitive performance is only deficient to a minor degree in subclinical individuals, whereas in clinically diagnosed OCD individuals the cognitive processing may be detrimental to a major degree. Therefore, the performance of subclinical individuals may only be associated with a minor change in cognitive processing compared to OCD patients [4348]. According to the scores on the Y-BOCS and the Cognitive Assessment Instrument of Obsessions and Compulsions (CAIOC) [43], a sample of healthy individuals was split into those scoring high (subclinical OC group) and low (nonclinical control group) in OC tendencies using relevant cutoff criteria. Although Mataix-Cols et al. [9] have suggested a range of reliable cutoff criteria to assess clinical morbidity in subclinical research, these may not be appropriate to apply in cognitive neuropsychological research, and it was decided to explore several criteria to assess how they impacted on neuropsychological performance.

2. Methods

2.1. Participants

There were 70 healthy individuals (47 female, 23 male) who participated, and the mean age was 37.2 years (standard deviation (SD) = 14.6). The participants who volunteered to take part were recruited from a student and a general population in the south east of England, UK, by newspaper, posted advertisements, and medical and ancillary staff from a local hospital in the south east of England, UK. Exclusion criteria constituted having experienced current or past history of DSM-IV-TR Axis I disorders according to assessment with the Mini International Neuropsychiatric Interview (MINI) [49]. The study was approved by the County Partnership NHS Trust Local Research Ethics Committee, UK. Data in this paper were obtained according to the Helsinki Declaration.

2.2. Materials
2.2.1. Clinical and Psychological Background Measures

MINI. It is designed as a semistructured interview for the major Axis I psychiatric disorders in DSM-IV-TR and ICD-10.

Y-BOCS. It is a commonly used clinical, semistructured interview which assesses the severity of obsessions and compulsions. The scale includes a 10-item symptom checklist designed to uncover the main target symptoms ranging from a total score of 0 to 40. The severity of these symptoms is evaluated in terms of the time (hours) spent on obsessions and compulsions, the distress and interference they cause, the degree of resistance to symptoms, and the control the patient has over them. A score below 16 indicates mild OCD, a score between 16 and 25 indicates moderate OCD, and a score higher than 25 indicates severe OCD.

Montgomery-Åsberg Depression Rating Scale (MADRS) [50]. It consists of ten statements, ranking from 0 to 6, where 6 is considered to be most associated with depression. This can be used to monitor a patient’s state over time, and those scoring high for questions such as reduced appetite, pessimistic thought, and concentration difficulties would be most depressed. A score of 16 and above on the MADRS is the DSM-IV-TR criterion for depression. Maximum score on the MADRS is 60.

State-Trait Anxiety Inventory (STAI) [51]. It is a 40-item self-report questionnaire which includes separate measures of state and trait anxiety. The STAI clearly differentiates between the temporary condition of state anxiety and the more general and long-standing quality of trait anxiety. Typical state anxiety statements are as follows: I feel calm, I feel secure, and I am tense. Typical trait anxiety statements are worded similarly: I feel pleasant, I tire quickly, and I feel like crying. Maximum score on the STAI is 80.

CAIOC. It evaluates the cognitive and executive impairments that are hypothesised to underpin the impact of OCD symptoms on functioning, including obsessions and compulsions. The CAIOC was devised to fulfil the need for a brief, simple clinician, and patient-friendly instrument providing a reliable and valid dimensional measure of cognitive and clinical symptoms in patients suffering with OCD. It is designed to take less than 10 minutes to complete, with 18 questions ranked 0–6. In all cases 6 is considered to be most associated with functional impairment, and 0, the least on each assessment question. The CAIOC has been validated as a self-rated instrument but can also be administered by an experienced clinician. The final version of the CAIOC contains 13 items, reduced from 18 through the validation procedure. However, the 18-item version was used in the present study to capture all relevant functional impairments thought to be associated with OCD. The maximum score on the CAIOC-18 is 108.

Compulsive Personality Assessment Scale (CPAS) [52]. It is based on the eight DSM-IV-TR factors for obsessive-compulsive personality disorder (preoccupation with details, perfectionism, workaholism, overconscientiousness, hoarding, need for control, miserliness, and rigidity). Symptoms which were present in adolescence or early adulthood as well as at the time of rating should be considered and quantified. Maximum score on the CPAS is 32.

Sheehan Disability Scale (SDS) [53]. It is a self-rated scale assessing perceived impairment along the three dimensions work, social life and leisure activities, and family life and home responsibilities. Maximum score on the SDS is 30.

Locus of Control (LoC) [54]. It is assessing the extent to which individuals believe that they can control events that affect them. Individuals with a high internal locus of control believe that events result primarily from their own behaviour and actions. Those with a high external locus of control believe that factors such as other people, chance, and fate primarily determine events. Those with a high internal locus of control have better control of their behaviour and tend to exhibit more political behaviours than externals. It is expected that OCD patients may endorse external statements more than internal because they are suggested to exhibit a dysfunctional belief system where factors not under their control may mediate the obsessions and compulsions. The maximum external score is 23.

National Adult Reading Test (NART) [55]. It is a word recognition test that utilises the high correlation between reading ability and intelligence in the general population. The test is composed of a list of 50 irregular words (pronunciation does not follow the normal phonetic rules) printed in order of increasing difficulty. The predicted verbal IQ score is determined from the number of reading errors the individual makes. The NART is a valid and reliable estimate of pre-morbid verbal intelligence.

2.2.2. Neuropsychological Measures

The following neuropsychological tasks from the Cambridge Neuropsychological Test Automated Battery (CANTAB) [56] were administered: affective go/no-go (AGN; assesses information processing biases for positive and negative stimuli), Cambridge gambling task (CGT; assesses impulse control and risk taking in decision making), intra/extradimensional set shift (IED; tests rule acquisition and attentional set shifting), simple reaction time (SRT; measures speed of response to a single stimulus), choice reaction time (CRT; measures speed of choice responses), spatial recognition memory (SRM; tests recognition memory for spatial locations), spatial working memory (SWM; tests working memory and strategy use), and stockings of Cambridge (SOC; assesses spatial planning and motor control). Also, administered were the Iowa Gambling Task (IGT; assesses decision making under ambiguous conditions) [57] and the paper and pencil verbal and nonverbal reasoning tests [58]. All tests apart from the verbal and nonverbal reasoning tests were administered on a Hewlett-Packard portable laptop with a screen size of 330 millimetres in width and 210 millimetres in height. A Magic-Touch sensitive screen matching the size of the laptop screen and a press pad were used to record the participants’ responses on the CANTAB tasks, whereas the laptop keyboard was used for the IGT.

2.3. Procedure

The participants were rated on clinical measures (Y-BOCS, MADRS, and CPAS) and the NART. The self-rated clinical and psychological measures (STAI, CAIOC, SDS, and LoC) were completed on the day of testing. For each participant the neuropsychological testing was completed in one session. If this was not possible, a new testing session was arranged within the same week or the week after. In total, the screening interview (MINI), clinical ratings, and self-rated measures took 45 minutes, and the neuropsychological testing lasted for 2 hours and 30 minutes including breaks.

Two measures were used to allocate participants to either the subclinical group or the nonclinical group. To warrant inclusion in either the subclinical or nonclinical group, only participants scoring above or below the sample mean on both the Y-BOCS and the CAIOC were included. This decision was taken because group inclusion in the subclinical domain should be based on a wide range of OC tendencies.

2.4. Data Analysis

Scores on the background variables Y-BOCS, CAIOC, STAI-state, STAI-trait, and SDS were analysed using the nonparametric Mann-Whitney test because of unequal variance in the subclinical and nonclinical groups. A logarithmic (base 10) transformation was performed for initial thinking times on the SOC to reduce skewness and improve normality. The study used a mixed design, with the between-subjects factor group (subclinical/nonclinical) and within-subject factors (different conditions of neuropsychological tasks, IGT: block (disadvantageous card selections in block 1/2/3/4/5); CGT: ratio of coloured boxes (6 : 4/7 : 3/8 : 2/9 : 1) and condition (ascending/descending); SWM: difficulty level (4/6/8 box-search problems); SOC: number of moves prior to obtaining the correct solution for each difficulty level (easy/hard), initial thinking time prior to moving the first ball for each difficulty level (easy/hard), and subsequent thinking time until obtaining the correct solution for each difficulty level (easy/hard); AGN: valence (happy/sad/neutral) and block (shift/nonshift)). When appropriate, the data from the neuropsychological task performance were submitted to repeated measures analysis of variance (ANOVA), one-way ANOVA, or independent samples -tests. The significance level alpha was set at 0.05 and only values below the alpha level are reported. The partial eta squared ( ) was used as an effect size measure, which indicates the proportion of total variability attributable to a factor when analysing three or more groups. When comparing two groups, Cohen’s [59] suggestion that effect sizes of .20 are small, .50 are medium, and .80 are large was followed. When the sphericity assumption was violated for repeated measures ANOVA, the Huynh-Feldt was reported. The categorical variables gender and handedness were subject to Pearson’s chi-square analyses. Correlations between the Y-BOCS, MADRS, STAI-state, STAI-trait, CAIOC, and the neuropsychological task measures were examined using Pearson product-moment correlation coefficient.

3. Results

The results of the background measures are described first, followed by the neuropsychological performance in the subclinical and nonclinical groups.

3.1. Background Characteristics in the Subclinical and Nonclinical Group

The 70 healthy participants had a mean score of 2.3 (SD = 2.0) on the Y-BOCS and 27.9 (SD = 14.2) on the CAIOC. From the 70 participants, 26 (37% of the sample) met the criteria for inclusion in the subclinical group (i.e., scoring above the sample mean on both the Y-BOCS and the CAIOC) and 23 (33% of the sample) fulfilled the criteria for a grouping in the nonclinical control group (i.e., scoring below the sample mean on both the Y-BOCS and the CAIOC). Consequently, 21 (30% of the sample) participants were excluded from any further analysis.

From Table 1, it can be seen that the subclinical group scored significantly higher compared to the nonclinical group in ratings on the Y-BOCS, , , CPAS, , , and CAIOC, , . A paired-samples -test confirmed that trait anxiety in the subclinical group (M = 38.5, SD = 9.4) was significantly higher compared to state anxiety (M = 33.7, SD = 8.7), , .

Variable Sub-clinical 
( )
( )

Age (years)35.513.041.315.1
Education (years)
STAI-state#33.7 8.7 31.7 11.7
STAI-trait#38.59.433.5 9.0

Note. CAIOC: cognitive assessment instrument of obsessions and compulsions; CPAS: compulsive personality assessment scale; LoC: locus of control; MADRS: montgomery-Åsberg depression rating scale; SDS: sheehan disability scale; STAI: state-trait anxiety inventory; Y-BOCS: Yale-Brown obsessive compulsive scale; #nonparametric Mann-Whitney test used because of unequal variance in the two groups.
3.2. Decision-Making

On the IGT, each participant made 100 card selections choosing from four different card decks. The number of times the disadvantageous cards were selected in each of five blocks was counted to assess whether the decision-making selection was random or deliberate. A two-way repeated measures ANOVA revealed that the number of disadvantageous card selections in each block was broadly similar in both groups (Table 2).

Variable Sub-clinical 
( )
( )

 Block 110.14.710.43.2
 Block 28.64.810.05.0
 Block 49.14.410.04.1
 Rational 6 : 4 (%)94.58.592.111.3
 Rational 7 : 3 (%)94.511.994.66.9
 Rational 8 : 2 (%)96.96.495.97.4
 Rational 9 : 1 (%)98.13.498.43.9
 Deliberation 6 : 4 (ms)22468672427948
 Deliberation 7 : 3 (ms)20286762271731
 Deliberation 8 : 2 (ms)19305901932468
 Deliberation 9 : 1 (ms)18787661946581
 Points gambled 6 : 4 (%)47.713.744.914.9
 Points gambled 7 : 3 (%)58.314.454.816.5
 Points gambled 8 : 1 (%)68.015.465.915.5
 Points gambled 9 : 1 (%)72.317.068.116.6

Note. ms: milliseconds; #there was no difference in decision-making performance between the two groups (IGT = CGT).

On the CGT, three separate three-way repeated measures ANOVAs were conducted to investigate the performance of the two groups for percentage of rational decisions, deliberation time, and percentage of points gambled in the ascending and descending conditions as a function of the ratio of coloured boxes. There were main effects of colour ratio for rational decisions, , , , deliberation time, , , , and points gambled, , , . For points gambled, there was also a main effect for condition, , , . Therefore, both groups displayed comparable decision-making behaviour, tending to be more rational, deliberate shorter and increase the bets at the more favourable ratios of red and blue boxes compared to the unfavourable (Table 2).

3.3. Visuospatial Working Memory

On the SRM the subclinical participants (M = 87.1%, SD = 7.5) recognised significantly more correct locations compared to the nonclinical participants (M = 81.1%, SD = 10.4), , . On the SWM, a two-way repeated measures ANOVA was conducted to compare the performance in the two groups for between-search errors at the 4, 6, and 8 box difficulty levels. As expected, results revealed a main effect for difficulty level, , , (sphericity assumption violated, Huynh-Feldt reported), indicating that more errors were made when the level of difficulty increased (Table 3).

Variable Sub-clinical 
( )
( )

 Recognition (%) 87.17.581.110.4.024
 Latency (ms)22656402361800
 Errors 4 boxes0.
 Errors 6 boxes6.
 Errors 8 boxes17.011.519.313.9
 Latency (ms)757259782284

Note. ms: milliseconds.
3.4. Attention

On the SRT and CRT, the two groups did not differ in mean correct reaction time and percentage of correct trials (Table 4).

Variable Sub-clinical
( )
( )

 Reaction time (ms)2585525743
 % correct97.81.998.41.4
 Reaction time (ms)3094532556
 % correct98.

Note. ms: milliseconds.
3.5. Planning and Behavioural Organisation

On the SOC, the performance in the two groups was examined with three separate two-way repeated measures ANOVAs for the easy and hard difficulty levels related to the number of moves needed prior to obtaining the correct solution and initial and subsequent thinking time. For number of moves, the result revealed a main effect for difficulty level, , , , indicating that participants needed more moves to solve the problems at the hard difficulty level compared to the easy. Main effects for difficulty level related to initial, , , , and subsequent thinking time, , , , were also identified and indicated that participants required, as expected, more initial and subsequent thinking time to solve the problems at the hard difficulty level compared to the easy (Table 5).

Variable Sub-clinical ( ) Non-clinical ( )

 Extradimensional shift stage12.95.816.18.3
 Intradimensional shift stage7.
 Final stage8.
 Latency (ms)13613991394308
 Moves easy2.
 Moves hard5.
 Initial thinking time easy (ms) 2321119332911998
 Initial thinking time hard (ms)7017570283205272
 Subsequent thinking time easy (ms)545777421873
 Subsequent thinking time hard (ms)1071128413191319
 Perfect solutions8.

Note. ms: milliseconds.
3.6. Affective Go/No-Go

On the AGN, three separate three-way repeated measures ANOVAs were conducted to compare the performance in the two groups for reaction time, number of false alarm responses, and target misses to happy, sad, and neutral words in the shift and nonshift block conditions (Table 6). For reaction time, the results revealed a main effect for valence, , , , indicating that participants had faster reaction times to happy and sad compared to neutral target words as well as responding faster to happy compared to sad target words. For false alarm responses, the results revealed a main effect for valence, , , , indicating that participants made more false alarm responses to neutral distractors compared to happy and sad as well as to happy distractors compared to sad. For misses, the results revealed a main effect for valence, , , , indicating that participants missed more neutral targets compared to happy and sad as well as missing more happy targets compared to sad.

Variable Sub-clinical 
( )
( )

Happy targets (ms)4878046453
Sad targets (ms)4896847852
Neutral targets (ms)5379851772
Happy false alarms12.56.313.97.0
Sad false alarms10.36.611.66.7
Neutral false alarms16.47.317.76.5
Happy misses8.
Sad misses6.
Neutral misses12.79.911.28.0

Note. ms: milliseconds.

4. Discussion

Remarkably, few systematic studies have so far reported the relationship between subclinical OC tendencies in healthy individuals and the performance on standardised neuropsychological tasks. It was found that, in a healthy population, there exist high and low scorers on clinical measures, which constituted a subclinical group and a nonclinical control group. Contrary to general expectations, the subclinical group performed to the same standard compared to the nonclinical control group on all cognitive tasks. In fact, the only performance difference that was revealed indicated a superior visuospatial recognition ability in the subclinical compared to the nonclinical participants. The significantly higher OC symptom severity observed in the subclinical compared to the nonclinical group extend previous results [8, 9, 42].

The present study is believed to be the most comprehensive investigation of neuropsychological performance in subclinical and nonclinical individuals to date employing a wide range of cognitive tasks. The findings may generalise more reliably to the healthy population showing OC tendencies because the age range in both the subclinical and the nonclinical group was from 18 to 77 years. This is in contrast to previous studies recruiting undergraduate students only [11, 12, 60]. Previously, the literature had presented intact [12] and impaired [21] findings on the WCST and evidence for deficits in subclinical individuals on the Tower of Hanoi [11, 12], the Object Alternation Test, and the Delayed Alternation Test [33]. Despite the null findings in the present study, correlation analyses were conducted and confirmed that neuropsychological performance in the subclinical individuals was not affected by depression and anxiety symptoms. Future studies might consider including highly anxious and depressed individuals as subclinical control groups to investigate whether differences in cognitive functioning relative to subclinical OC individuals exist to fully account for a wider range of clinical symptoms severity.

The present results do not support the notion of endophenotypic markers to be present in OCD, that is, trait markers that can predict cognitive impairment and that are postulated to be linked to neural substrates that can reveal who are genetically at risk of developing mental disorders [61, 62]. Following this concept, it is claimed that some individuals, such as first degree relatives of patients with OCD [63] and OCD patients whose symptoms improved following successful pharmacological treatment [64], demonstrated impairments on selective neuropsychological tasks and could therefore be vulnerable because cognitive deficits may reflect trait markers rather than state markers [62]. The notion of an endophenotype is one that is heritable and is assumed to be present at a higher rate in nonaffected family members than in the general population [61]. Endophenotypes are claimed to be open to genetic dissection, and hence, more reliable components associated with psychiatric illnesses than the diagnostic categories themselves [61]. However, the present results support the proposal in a recent review that endophenotype markers are no more reliable measures of genetic susceptibility to develop psychiatric disorders than the clinical and behavioural symptoms themselves [65]. That is, if OC trait markers negatively affect neuropsychological performance, one would assume that the current subclinical group might have performed worse than the nonclinical control group. Moreover, the OC (Y-BOCS) and functional impairment tendencies (CAIOC) could affect cognitive processing, but not to a degree detrimental to cognitive functioning, which is in contrast to how cognitive processing can manifest itself to a much more damaging degree in OCD patients [4348]. Subclinical groups within the healthy population seem to be distinguished from OCD patients based on their neuropsychological performance on selective cognitive tasks only on the basis of different degrees of information processing capabilities. Furthermore, the impairment established on the WCST in subclinical checkers in Goodwin and Sher [21] demonstrated that these individuals’ performance was within the range of normal functioning, which supports the notion that cognitive processing is altered in subclinical individuals but not to a degree which seems damaging to cognitive abilities. Since obsessions and compulsions in diagnosed OCD patients are experienced as more intense and discomforting [3], the neuropsychological performance may in some instances depend on the clinical state in OCD patients showing cognitive impairment [66].

In occupational rehabilitation, it is well known that recovering patients may have subclinical tendencies in relation to various psychological disorders [67]. A range of factors have been identified to be important in prolonging the time to return to work in people who have been on long-term sickness absence. The most common are stress, fatigue, anxiety, depression, and musculoskeletal and chronic pain [67, 68], and consequently, these are the most common medical reasons for sick leave and disability pension [38, 69]. Here, we briefly mention the link between reduced work ability, return to work, and common mental disorders not dissimilar to subclinical psychological disorders as highlighted in the present study.

Subclinical OC tendencies can be viewed as a particular cognitive style mediated by particular ways of thinking and coping, affecting quality of life. OC tendencies can be characterised by stereotypical and narrow ways of processing information, which could lead to particular ways of carrying out behavioural actions, resembling compulsions. Findings from Burns and Fedewa [70] could be used to support this idea as they viewed perfectionism as a thinking style. Perfectionism can be characterised by ruminations over fears of making mistakes, which leads to failures being overexaggerated by the obsessional thoughts [71]. One can also distinguish between positive and negative perfectionism, justifying perfectionism as a thinking style [70]. OC tendencies could be perceived as a cognitive style in the same way as with perfectionism. There seem to be several definitions of thinking styles, varying slightly in their meaning, but Riding and Cheema [72] suggested two distinct dimensions of thinking styles, defining one as the “wholist-analytic style dimension” in which an individual tends to organise information in wholes or parts [73, page 316], and the other as “verbal-imagery style dimension” in which an individual is inclined to represent information during thinking verbally or in mental pictures [73, page 316]. These definitions could be incorporated to explain OC tendencies as it could be assumed that the verbal-imagery style dimension seems to fit with the characteristics of obsessive thinkers. Moreover, the cognitive thinking style framework outlined here is worth following up considering that in a large epidemiological survey of 2200 respondents, it was revealed that approximately 22–26% suffered from obsessions and compulsions, but only 0.6% received a formal DSM-IV diagnosis of OCD after clinical reappraisal [74]. This indicates that subclinical tendencies seem widespread in the general population. Therefore, exploring the relationship of obsessive thinking styles and holistic versus verbal styles in greater detail is worthwhile.

5. Conclusions

The cutoff scores to constitute an inclusion in the subclinical and nonclinical groups were conservative estimations, because only those individuals who scored either above or below the mean on both the Y-BOCS and the CAIOC were included. This was done to ensure that the individuals forming the subclinical group reflected true OC and functional impairment tendencies. It has also been demonstrated that a range of clinical inclusion criteria can be used in subclinical research [9]. Therefore, an even stricter cutoff point was also applied where inclusion in the two groups was determined by those individuals scoring above the 75th (subclinical) and below the 25th (nonclinical) percentile of the distribution on both the Y-BOCS and the CAIOC. However, following these cutoff criteria none of the results changed, which may be due to a small sample size and consequently a lack of power. For prospective studies, it is recommended that the question of OC tendencies in a subclinical sample is investigated with a larger sample size applying a more extreme cutoff criterion comparing the two groups, for example, using the upper and lower quartile of the distribution. This may lead to more reliable criteria elucidating cognitive performance differences between subclinical nonclinical individuals.

Overall, OC and functional impairment tendencies in the subclinical group were not detrimental to cognitive performance. The current study has provided new knowledge about cognitive functioning in subclinical individuals. These preliminary results can be used in prospective studies to form both new and specific predictions about subclinical behaviour related to cognitive functioning and furthermore, to tailor more effective cognitive behavioural therapy programmes for subclinical OC individuals.

Conflict of Interests

The authors declare that they have no conflict of interests.


The authors would like to thank David Hart at Cambridge Cognition, UK, and Professor Nils Inge Landrø at the University of Oslo, Norway, for their support. Thanks are also due to Mahrufa Choudhury and Liane Metcalfe for technical assistance.


  1. S. Rachman and P. de Silva, “Abnormal and normal obsessions,” Behaviour Research and Therapy, vol. 16, no. 4, pp. 233–248, 1978. View at: Publisher Site | Google Scholar
  2. P. Muris, H. Merckelbach, and M. Clavan, “Abnormal and normal compulsions,” Behaviour Research and Therapy, vol. 35, no. 3, pp. 249–252, 1997. View at: Publisher Site | Google Scholar
  3. P. M. Salkovskis and J. Harrison, “Abnormal and normal obsessions. A replication,” Behaviour Research and Therapy, vol. 22, no. 5, pp. 549–552, 1984. View at: Publisher Site | Google Scholar
  4. J. C. Magee and B. A. Teachman, “Why did the white bear return? Obsessive-compulsive symptoms and attributions for unsuccessful thought suppression,” Behaviour Research and Therapy, vol. 45, no. 12, pp. 2884–2898, 2007. View at: Publisher Site | Google Scholar
  5. S. Rachman, “A cognitive theory of obsessions,” Behaviour Research and Therapy, vol. 35, no. 9, pp. 793–802, 1997. View at: Publisher Site | Google Scholar
  6. J. Simpson, J. Cove, N. Fineberg, R. M. Msetfi, and L. J. Ball, “Reasoning in people with obsessive-compulsive disorder,” The British Journal of Clinical Psychology, vol. 46, no. 4, pp. 397–411, 2007. View at: Publisher Site | Google Scholar
  7. K. M. Corcoran and S. R. Woody, “Appraisals of obsessional thoughts in normal samples,” Behaviour Research and Therapy, vol. 46, no. 1, pp. 71–83, 2008. View at: Publisher Site | Google Scholar
  8. H. R. Dent and P. M. Salkovskis, “Clinical measures of depression, anxiety and obsessionality in non-clinical populations,” Behaviour Research and Therapy, vol. 24, no. 6, pp. 689–691, 1986. View at: Google Scholar
  9. D. Mataix-Cols, J. Vallejo, and M. Sànchez-Turet, “The cut-off point in sub-clinical obsessive-compulsive research,” Behavioural and Cognitive Psychotherapy, vol. 28, no. 3, pp. 225–233, 2000. View at: Publisher Site | Google Scholar
  10. N. A. Gibbs, “Nonclinical populations in research on obsessive-compulsive disorder: a critical review,” Clinical Psychology Review, vol. 16, no. 8, pp. 729–773, 1996. View at: Publisher Site | Google Scholar
  11. D. Mataix-Cols, “Declarative and procedural learning in individuals with subclinical obsessive-compulsive symptoms,” Journal of Clinical and Experimental Neuropsychology, vol. 25, no. 6, pp. 830–841, 2003. View at: Publisher Site | Google Scholar
  12. D. Mataix-Cols, C. Junqué, M. Sànchez-Turet, J. Vallejo, K. Verger, and M. Barrios, “Neuropsychological functioning in a subclinical obsessive-compulsive sample,” Biological Psychiatry, vol. 45, no. 7, pp. 898–904, 1999. View at: Publisher Site | Google Scholar
  13. R. J. Hodgson and S. Rachman, “Obsessional-compulsive complaints,” Behaviour Research and Therapy, vol. 15, no. 5, pp. 389–395, 1977. View at: Publisher Site | Google Scholar
  14. K. J. Sher, R. O. Frost, M. Kushner, T. M. Crews, and J. E. Alexander, “Memory deficits in compulsive checkers: replication and extension in a clinical sample,” Behaviour Research and Therapy, vol. 27, no. 1, pp. 65–69, 1989. View at: Publisher Site | Google Scholar
  15. K. J. Sher, R. O. Frost, and R. Otto, “Cognitive deficits in compulsive checkers: an exploratory study,” Behaviour Research and Therapy, vol. 21, no. 4, pp. 357–363, 1983. View at: Publisher Site | Google Scholar
  16. K. J. Sher, B. Mann, and R. O. Frost, “Cognitive dysfunction in compulsive checkers: further explorations,” Behaviour Research and Therapy, vol. 22, no. 5, pp. 493–502, 1984. View at: Publisher Site | Google Scholar
  17. C. S. Rubenstein, Z. F. Peynircioglu, D. L. Chambless, and T. A. Pigott, “Memory in sub-clinical obsessive-compulsive checkers,” Behaviour Research and Therapy, vol. 31, no. 8, pp. 759–765, 1993. View at: Publisher Site | Google Scholar
  18. R. J. McNally and P. A. Kohlbeck, “Reality monitoring in obsessive-compulsive disorder,” Behaviour Research and Therapy, vol. 31, no. 3, pp. 249–253, 1993. View at: Publisher Site | Google Scholar
  19. R. O. Frost and K. J. Sher, “Checking behavior in a threatening situation,” Behaviour Research and Therapy, vol. 27, no. 4, pp. 385–389, 1989. View at: Publisher Site | Google Scholar
  20. E. A. Berg, “A simple objective test for measuring flexibility in thinking,” Journal of General Psychology, vol. 39, no. 1, pp. 15–22, 1948. View at: Publisher Site | Google Scholar
  21. A. H. Goodwin and K. J. Sher, “Deficits in set-shifting ability in nonclinical compulsive checkers,” Journal of Psychopathology and Behavioral Assessment, vol. 14, no. 1, pp. 81–92, 1992. View at: Google Scholar
  22. O. Spreen and E. Strauss, A Compendium of Neuropsychological Tests, Oxford University Press, New York, NY, USA, 2nd edition, 1998.
  23. R. M. Reitan, “Validity of the trailmaking test as an indication of organic brain damage,” Perceptual and Motor Skills, vol. 8, pp. 271–276, 1958. View at: Google Scholar
  24. A. L. Benton and K. Hamsher, Eds., Multilingual Aphasia Examination, AJA Associates, Iowa City, Iowa, USA, 1989.
  25. J. R. Stroop, “Studies of interference in serial verbal reactions,” Journal of Experimental Psychology, vol. 18, no. 6, pp. 643–662, 1935. View at: Publisher Site | Google Scholar
  26. D. Mataix-Cols, M. Barrios, M. Sànchez-Turet, J. Vallejo, and C. Junqué, “Reduced design fluency in subclinical obsessive-compulsive subjects,” Journal of Neuropsychiatry and Clinical Neurosciences, vol. 11, no. 3, pp. 395–397, 1999. View at: Google Scholar
  27. R. M. Roth and J. Baribeau, “Performance of subclinical compulsive checkers on putative tests of frontal and temporal lobe memory functions,” Journal of Nervous and Mental Disease, vol. 184, no. 7, pp. 411–416, 1996. View at: Publisher Site | Google Scholar
  28. M. Petrides and B. Milner, “Deficits on subject-ordered tasks after frontal- and temporal-lobe lesions in man,” Neuropsychologia, vol. 20, no. 3, pp. 249–262, 1982. View at: Publisher Site | Google Scholar
  29. D. Mataix-Cols, C. Junqué, J. Vallejo, M. Sànchez-Turet, K. Verger, and M. Barrios, “Hemispheric functional imbalance in a sub-clinical obsessive-compulsive sample assessed by the continuous performance test, identical Pairs version,” Psychiatry Research, vol. 72, no. 2, pp. 115–126, 1997. View at: Publisher Site | Google Scholar
  30. D. Wechsler, “A standardized memory test for clinical use,” Journal of Psychology, vol. 19, no. 1, pp. 87–95, 1945. View at: Publisher Site | Google Scholar
  31. M. Freedman, “Object alternation and orbitofrontal system dysfunction in Alzheimer's and Parkinson's disease,” Brain and Cognition, vol. 14, no. 2, pp. 134–143, 1990. View at: Google Scholar
  32. M. Freedman and M. Oscar-Berman, “Comparative neuropsychology of cortical and subcortical dementia,” Canadian Journal of Neurological Sciences, vol. 13, no. 4, pp. 410–414, 1986. View at: Google Scholar
  33. M. B. Spitznagel and J. A. Suhr, “Executive function deficits associated with symptoms of schizotypy and obsessive-compulsive disorder,” Psychiatry Research, vol. 110, no. 2, pp. 151–163, 2002. View at: Publisher Site | Google Scholar
  34. I. H. Robertson, T. Ward, V. Ridgeway, and I. Nimmo-Smith, The Test of Everyday Attention, Thames Valley Test Company, Bury, UK, 1994.
  35. J. Pleva and T. D. Wade, “An investigation of the relationship between responsibility and attention deficits characteristic of obsessive-compulsive phenomena,” Behavioural and Cognitive Psychotherapy, vol. 30, no. 4, pp. 399–414, 2002. View at: Publisher Site | Google Scholar
  36. G. Hajcak and R. F. Simons, “Error-related brain activity in obsessive-compulsive undergraduates,” Psychiatry Research, vol. 110, no. 1, pp. 63–72, 2002. View at: Publisher Site | Google Scholar
  37. N. Amir, S. Najmi, and A. S. Morrison, “Attenuation of attention bias in obsessive-compulsive disorder,” Behaviour Research and Therapy, vol. 47, no. 2, pp. 153–157, 2009. View at: Publisher Site | Google Scholar
  38. OECD, Sickness, Disability and Work: Breaking the Barrier. A Synthesis of Findings Across OECD Countries, OECD, Paris, France, 2010.
  39. E. Sanavio, “Obsessions and compulsions: the padua inventory,” Behaviour Research and Therapy, vol. 26, no. 2, pp. 169–177, 1988. View at: Google Scholar
  40. W. K. Goodman, L. H. Price, S. A. Rasmussen et al., “The Yale-Brown obsessive compulsive scale. I. Development, use and reliability,” Archives of General Psychiatry, vol. 46, no. 11, pp. 1006–1011, 1989. View at: Google Scholar
  41. D. Mataix-Cols, S. L. Rauch, L. Baer et al., “Symptom stability in adult obsessive-compulsive disorder: data from a naturalistic two-year follow-up study,” The American Journal of Psychiatry, vol. 159, no. 2, pp. 263–268, 2002. View at: Publisher Site | Google Scholar
  42. M. A. Fullana, M. Tortella-Feliu, X. Caseras, Ó. Andión, R. Torrubia, and D. Mataix-Cols, “Psychometric properties of the Spanish version of the obsessive-compulsive inventory—revised in a non-clinical sample,” Journal of Anxiety Disorders, vol. 19, no. 8, pp. 893–903, 2005. View at: Publisher Site | Google Scholar
  43. W. H. Dittrich, T. Johansen, and N. A. Fineberg, “Cognitive assessment instrument of obsessions and compulsions (CAIOC-13)—a new 13-item scale for evaluating functional impairment associated with OCD,” Psychiatry Research, vol. 187, no. 1-2, pp. 283–290, 2011. View at: Publisher Site | Google Scholar
  44. W. H. Dittrich, T. Johansen, N. A. Fineberg, and N. I. Landro, “Cognitive performance and specific deficits in OCD symptom dimensions: II. Spatial memory and impaired recognition of visuospatial object locations,” German Journal of Psychiatry, vol. 14, no. 1, pp. 1–12, 2011. View at: Google Scholar
  45. W. H. Dittrich, T. Johansen, N. I. Landro, and N. A. Fineberg, “Cognitive performance and specific deficits in OCD symptom dimensions: III. Decision-making and impairments in risky choices,” German Journal of Psychiatry, vol. 14, no. 1, pp. 13–25, 2011. View at: Google Scholar
  46. W. H. Dittrich, T. Johansen, L. Metcalfe, and N. I. Landrø, “Cognitive performance and specific deficits in OCD symptom dimensions: IV. Impairments in manual movement control,” German Journal of Psychiatry, vol. 15, pp. 32–40, 2012. View at: Google Scholar
  47. W. H. Dittrich, T. Johansen, K. Trotter, H. Dawes, and U. Kischka, “Pointing and the interference effect in obsessive-compulsive disorder (OCD),” Scandinavian Journal of Psychology, vol. 54, no. 3, pp. 222–229, 2013. View at: Publisher Site | Google Scholar
  48. W. H. Dittrich, T. Johansen, A. K. Padhi, I. E. Smith, S. R. Chamberlain, and N. A. Fineberg, “Clinical and neurocognitive changes with modafinil in obsessive-compulsive disorder: a case report,” Psychopharmacology, vol. 212, no. 3, pp. 449–451, 2010. View at: Publisher Site | Google Scholar
  49. D. V. Sheehan, Y. Lecrubier, K. H. Sheehan et al., “The mini-international neuropsychiatric interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10,” Journal of Clinical Psychiatry, vol. 59, no. 20, pp. 22–33, 1998. View at: Google Scholar
  50. S. A. Montgomery and M. Åsberg, “A new depression scale designed to be sensitive to change,” The British Journal of Psychiatry, vol. 134, no. 4, pp. 382–389, 1979. View at: Google Scholar
  51. C. D. Spielberger, R. L. Gorsuch, R. E. Lushene, P. R. Vagg, and G. A. Jacobs, Manual for the State-Trait Anxiety Inventory, Consulting Psychologists Press, Palo Alto, Calif, USA, 1983.
  52. N. A. Fineberg, P. Sharma, T. Sivakumaran, B. Sahakian, and S. Chamberlain, “Does obsessive-compulsive personality disorder belong within the obsessive-compulsive spectrum?” CNS Spectrums, vol. 12, no. 6, pp. 467–482, 2007. View at: Google Scholar
  53. D. V. Sheehan, K. Harnett-Sheehan, and B. A. Raj, “The measurement of disability,” International Clinical Psychopharmacology, vol. 11, no. 3, pp. 89–95, 1996. View at: Google Scholar
  54. J. B. Rotter, “Generalized expectancies for internal versus external control of reinforcement,” Psychological Monographs, vol. 80, no. 1, pp. 1–28, 1966. View at: Google Scholar
  55. H. E. Nelson, National Adult Reading Test (NART): Test Manual, NFER—Nelson, Windsor, UK, 1982.
  56. B. J. Sahakian, R. G. Morris, J. L. Evenden et al., “A comparative study of visuospatial memory and learning in Alzheimer-type dementia and Parkinson's disease,” Brain, vol. 111, no. 3, pp. 695–718, 1988. View at: Google Scholar
  57. A. Bechara, A. R. Damasio, H. Damasio, and S. W. Anderson, “Insensitivity to future consequences following damage to human prefrontal cortex,” Cognition, vol. 50, no. 1–3, pp. 7–15, 1994. View at: Google Scholar
  58. Athey Educational, Athey educational, 2001,
  59. J. Cohen, “A power primer,” Psychological Bulletin, vol. 112, no. 1, pp. 155–159, 1992. View at: Google Scholar
  60. C. Cuttler and P. Graf, “Sub-clinical compulsive checkers' prospective memory is impaired,” Journal of Anxiety Disorders, vol. 21, no. 3, pp. 338–352, 2007. View at: Publisher Site | Google Scholar
  61. I. I. Gottesman and T. D. Gould, “The endophenotype concept in psychiatry: etymology and strategic intentions,” The American Journal of Psychiatry, vol. 160, no. 4, pp. 636–645, 2003. View at: Publisher Site | Google Scholar
  62. L. Menzies, S. Achard, S. R. Chamberlain et al., “Neurocognitive endophenotypes of obsessive-compulsive disorder,” Brain, vol. 130, no. 12, pp. 3223–3236, 2007. View at: Publisher Site | Google Scholar
  63. S. R. Chamberlain, N. A. Fineberg, L. A. Menzies et al., “Impaired cognitive flexibility and motor inhibition in unaffected first-degree relatives of patients with obsessive-compulsive disorder,” The American Journal of Psychiatry, vol. 164, no. 2, pp. 335–338, 2007. View at: Publisher Site | Google Scholar
  64. M. M. A. Nielen and J. A. den Boer, “Neuropsychological performance of OCD patients before and after treatment with fluoxetine: evidence for persistent cognitive deficits,” Psychological Medicine, vol. 33, no. 5, pp. 917–925, 2003. View at: Publisher Site | Google Scholar
  65. J. Flint and M. R. Munafò, “The endophenotype concept in psychiatric genetics,” Psychological Medicine, vol. 37, no. 2, pp. 163–180, 2007. View at: Publisher Site | Google Scholar
  66. L. Henderson and W. Dittrich, “Decomposing the corpus of neuropsychological tests,” Psycoloquy, vol. 4, no. 32, article 3, 1993. View at: Google Scholar
  67. I. Øyeflaten, M. Hysing, and H. R. Eriksen, “Prognostic factors associated with return to work following multidisciplinary vocational rehabilitation,” Journal of Rehabilitation Medicine, vol. 40, no. 7, pp. 548–554, 2008. View at: Publisher Site | Google Scholar
  68. J. K. Fadyl, K. M. McPherson, P. J. Schlter, and L. Turner-Stokes, “Factors contributing to work-ability for injured workers: literature review and comparison with available measures,” Disability and Rehabilitation, vol. 32, no. 14, pp. 1173–1183, 2010. View at: Publisher Site | Google Scholar
  69. S. Brage, C. Ihlebæk, B. Natvig, and D. Bruusgaard, “Musculoskeletal disorders as causes of sick leave and disability benefits,” The Journal of the Norwegian Medical Association, vol. 130, pp. 2369–2370, 2010. View at: Google Scholar
  70. L. R. Burns and B. A. Fedewa, “Cognitive styles: links with perfectionistic thinking,” Personality and Individual Differences, vol. 38, no. 1, pp. 103–113, 2005. View at: Publisher Site | Google Scholar
  71. G. L. Flett, P. L. Hewitt, K. R. Blankstein, and L. Gray, “Psychological distress and the frequency of perfectionistic thinking,” Journal of Personality and Social Psychology, vol. 75, no. 5, pp. 1363–1381, 1998. View at: Google Scholar
  72. R. J. Riding and I. Cheema, “Cognitive styles—an overview and integration,” Educational Psychology, vol. 11, no. 3-4, pp. 193–215, 1991. View at: Publisher Site | Google Scholar
  73. R. J. Riding, International Perspectives on Individual Difference, vol. 1, Ablex Publishing, Norwood, NJ, USA, 2000.
  74. M. B. Stein, D. R. Forde, G. Anderson, and J. R. Walker, “Obsessive-compulsive disorder in the community: an epidemiologic survey with clinical reappraisal,” The American Journal of Psychiatry, vol. 154, no. 8, pp. 1120–1126, 1997. View at: Google Scholar

Copyright © 2013 Thomas Johansen and Winand H. Dittrich. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

More related articles

 PDF Download Citation Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

Article of the Year Award: Outstanding research contributions of 2020, as selected by our Chief Editors. Read the winning articles.