- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Volume 2012 (2012), Article ID 174079, 12 pages
Metacognitive Performance, the Tip-of-Tongue Experience, Is Not Disrupted in Parkinsonian Patients
1Department of Psychology, Central Michigan University, Health Professions Building, Room 2181, 1280 E. Campus Drive, Mount Pleasant, MI 48859, USA
2Department of Psychiatry & Psychology, Behavioral Health Services, Lutheran Hospital, 1730 W. 25th Street, Cleveland, OH 44113, USA
3Department of Psychology, Central Michigan University, Mount Pleasant, MI 48859, USA
4Department of Psychology, DePaul University, Chicago, IL 60614, USA
5Department of Psychology, Central Michigan University, 101 Sloan Hall, Mount Pleasant, MI 48859, USA
Received 22 March 2011; Revised 12 December 2011; Accepted 12 January 2012
Academic Editor: Gregory P. Crucian
Copyright © 2012 Justin D. Oh-Lee et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
The present study investigated whether a form of metamemory, the tip-of-tongue phenomenon (TOT), was affected in patients with Parkinson's disease (PD). The PD patient (), age-matched elderly control (), and college student control () groups were compared on a motor timing task and TOT measures. Motor timing was assessed using a cued hand-clapping task, whereas TOT was assessed using general knowledge questions. The results indicated that motor timing was significantly impaired in the PD group relative to both control groups. However, all of the TOT metacognitive measures: frequency, strength, and accuracy were statistically equivalent between the PD patients and elderly control groups, both of whom showed significantly better memory performance than college controls. These findings demonstrate that TOT metamemory is not compromised in PD patients, and that further insight into TOT mechanisms in PD may prove helpful in developing novel intervention strategies to enhance memory and general cognitive functions in these patients.
Parkinson’s disease (PD) is a chronic, progressive neurodegenerative disorder characterized by the selective degeneration of dopamine-producing neurons extending from the substantia nigra pars compacta (SNc) to the striatum . Whereas motor symptoms are perhaps the most obvious and well-known clinical features of PD , there is also a constellation of nonmotor symptoms that precede motor symptoms, which are both debilitating and problematic . Cognitive deficits are perhaps the broadest group of nonmotor symptoms, and these symptoms can be generally grouped into categories of impairments in visuospatial function , learning and memory , and executive function [6, 7]. These early cognitive symptoms are thought to be, at least partly, the result of a denervation of dopaminergic neurotransmission from the SNc  and may share common underlying pathogenic factors to motor symptoms manifested at later stages of the disease .
Dopamine dysfunction in PD has also been associated with a range of memory difficulties , including working memory [11–13], prospective memory [14, 15], emotional memory , and category memory . Moreover, memory deficits are often observed before any clinically significant motor symptoms are detected , giving them both diagnostic and therapeutic relevance . Unfortunately, the treatment of memory impairments is often difficult, particularly when multiple symptoms are present . One potentially useful strategy for improving memory in PD is to promote one’s ability to monitor and control one’s own cognitive functions, also known as metacognition [20–22]. The rationale behind these investigations is that poor memory performance in PD may stem from poor monitoring and control of one’s memory functions [23, 24]. Monitoring and control can occur at every stage of memory operation (i.e., encoding, storage, and retrieval), and the assumption is that one’s awareness of the current state of memory at each stage or metacognitive knowledge is causally related to the control processes one would adopt (e.g., spending more time searching for the answer). Among PD patients, many of the studies have focused on metamemory processes referred to as feelings-of-knowing (FOK) judgments [25–27]. In the present investigation, another, albeit similar, type of metacognitive judgments, referred to as a tip-of-the-tongue (TOT) metamemory judgments, was investigated because there is some evidence to indicate that these two types of judgments are based on different processes, which may be supported by distinct neural basis. In the present study, we focused on TOT during retrieval, because for elderly population including PD patients, TOT judgments associated with retrieving the knowledge they already have are not only central in decision making and in day-to-day activities, but also has an important clinical and prognostic implications.
FOK judgments are one’s judgment that a piece of information that cannot currently be recalled is still in memory and can be recognized correctly if shown it at a later point in time [28–30]. Several studies demonstrated that the integrity of the frontal lobe function associated with executive cognitive function appears to be closely related to FOK [28, 29, 31]. Patients with frontal lobe injuries have also shown deficits in FOK accuracy . Further support for the link between FOK and PFC comes from studies which have demonstrated that FOK metacognitive abilities are severely impaired in PD patients [25–27], who exhibit PFC dysfunction that is associated with degeneration of the basal ganglia motor circuitry [33, 34]. Also consistent are results from prospective memory studies indicating that patients with PD were preferentially impaired on event-based or time-based prospective memory tasks with higher levels of executive control, possibly associated with prefrontal lobe dysfunction in PD [14, 15, 35].
The first behavioral investigation of FOK was conducted by Hart  using the RJR (recall-judgment-recognition) paradigm. In this paradigm, participants are asked to answer general knowledge questions. If they are unable to retrieve the answer, they are asked to judge whether they have the answer (even though they are unable to retrieve it at the moment) and would be able to recognize the answer if it is presented among distractors at a later point in time. The RJR paradigm has been used to assess FOK in both episodic (e.g., paired-associate lists) and semantic memory (e.g., general knowledge questions) [31, 36, 37]. In the present study, general knowledge questions were used because answering these questions represents semantic modality that involves judgments about already existing information that is well integrated in the semantic network [38–40].
A TOT experience reflects a state of mind in which people are temporarily unable to think of target words or sought after information but feel that retrieval is imminent. A TOT is a frustrating emotional experience of not being able to retrieve the information on demand, but having an intense feeling that the sought-after information will pop into one’s mind at any moment [41–43]. This intense feeling of imminence that the sought-after information will come to consciousness  is what differentiates TOTs from FOKs . It has been suggested that TOTs are qualitatively different from FOK experiences [31, 43, 45] and that TOT and FOK are disparate neuropsychological states, perhaps regulated by different neural substrates [29, 46].
Studies in the area of neuroimaging have indicated that brain activity differs during TOT and FOK experiences. TOT appears to be localized within specific frontal lobe areas, but FOK activity is more generalized throughout the frontal and limbic areas. Activity in the anterior cingulate cortex (ACC), right dorsolateral prefrontal cortex, and right inferior cortex is uniquely associated with TOT judgments and resolution during the retrieval process [46–48]. On the other hand, the same ACC-prefrontal regions together with left prefrontal regions along the inferior frontal gyrus and several parietal regions were associated with FOK judgments [46, 47]. These differences in the neural correlates are reflected, in part, by the overall selective effect of PFC functioning on FOK, but not on TOT experiences. This research together with multiple independent observations [31, 45, 48–50] indicates that different areas of the brain may be activated during TOT as opposed to FOK and further lends support for the notion that TOT and FOK are disparate cognitive states, perhaps regulated by different neural substrates. It is, therefore, possible that TOT, but not FOK, is localized within specific areas including the right prefrontal and ACC regions, and the damages to within these brain regions summate to produce impairments on tasks sensitive to TOT metacognitive processes. On the other hand, if these brain regions remain intact, TOT should not be impaired in these individuals. Based on these studies and current findings pointing to the dissociation between FOK and TOT judgments, with FOK, but not TOT, being closely linked to generalized PFC function, it could be predicted that TOT metacognitive function, subserved by localized and specific frontal areas, may remain unaltered in PD patients [29, 31, 46].
In regards to TOTs in PD, one study revealed that PD patients experience TOT-like states when given a variety of verbal and naming tasks, such that participants experienced word-finding difficulties in the absence of memory loss . In this study, PD patients showed impaired semantic performances during confrontation naming and category naming tasks, suggesting a problem in cognitive strategies necessary for appropriate word production and naming . Although these behavioral deficiencies share some characteristics of TOT phenomenon, TOT metamemory was not directly measured in their study. The present study utilizes aforementioned RJR paradigm with general knowledge questions to evaluate comprehensive measures of TOT metamemory: its frequency, strength, and accuracy, during semantic knowledge retrieval process.
The goal of this study was to examine whether there is a deficit in TOT in nondemented patients with PD. In the present study, groups of PD patients, elderly control participants, and college control participants were compared on a motor timing task and a TOT metamemory task. First, PD patients and control participants were compared on their ability to clap in time to a cued metronome beat to show that PD patients exhibit typical motor impairment . Second, PD patients and control participants were compared on a TOT task based on general knowledge questions. Because motor timing impairment in PD is closely linked to dysfunction in PFC [52–56], and because TOT does not appear closely linked to PFC function, it was predicted that individuals with PD would not show compromised TOT metacognition. The absence of TOT deficit would provide evidence that cortical and subcortical networks mediating this function are most likely still intact in patients with PD. Having intact metamemory functions, such as TOT, is believed to be important for normal functioning of one’s memory, such as selecting effective retrieval strategies , and consequently would lead to improvement in the quality of life for these patients [58, 59]. The present study was, therefore, designed to test the hypothesis that TOT metamemory is unimpaired in PD patients who demonstrate motor response timing deficits.
Twenty two PD patients (13 men and 9 women) were recruited from various mid-Michigan Parkinson’s disease support groups. These patients received $25 for their participation and were tested in their home or at a local community center. They ranged in age from 55 to 83 years (Table 1). PD diagnosis was made by the patient’s primary neurologist prior to this study. Patients were asked to report the time elapsed since their first diagnosis of PD and asked to indicate their perceived symptom severity . At the time of testing, the average disease duration of the PD patients was 8.52 years . Patients were assessed on their regular medication (levodopa = 14, dopamine agonists = 11, COMT inhibitor = 5, MAO-B inhibitor = 4, anticholinergic = 1, and NMDA receptor antagonist = 1, SSRI = 2, with the exception of one individual who was taking no medication). Twenty two normal elderly control participants (9 men and 13 women) were either spouses or family members of those PD patients. Elderly control participants received $15 for participation and were tested in their home or at a local community center. Elderly participants ranged in age from 49 to 86 years (Table 1). Forty six normal college control participants (23 men and 23 women) were recruited from the subject pool at Central Michigan University. They received extra course credit. Participants ranged in age from 18 to 34 years (Table 1). The guidelines for ethical treatment of human participants were followed with approval given by the IRB at Central Michigan University.
Participant’s age, educational background, and Mini-Mental State Examination (MMSE) scores are summarized in Table 1. The elderly control group did not differ from the PD with regard to age, education level, or MMSE scores.
2.2. Materials and Procedure
Participants, tested individually, were given verbal instructions as well as a written copy of the instructions. They were informed that they would be participating in a motor timing task, where they would be asked to clap in time to a cued metronome beat. The Groove metronome device and software were used (New York, NY) . Participants were asked to put on a headphone and a touch-sensitive hand device. They then clapped their hands in time to a cued metronome beat, which provided an auditory feedback. Visual feedback was provided via the computer monitor, such that participants could see how many milliseconds they were off from the cued beat with each clap. Their average timing responses were recorded by the computer program in an average of milliseconds they were off from the cued sound. It also provided the percentage of times the participants responded early and late (% early/late) during each session. Timing scores ranged from 0 to 500 milliseconds, with zero indicating that the participant was clapping directly on time with the cued metronome beat. Participants performed three different sessions (1 minute, 2 minute, and 1 minute) with a short break (30–40 seconds) between each session. In addition, motor impairment was assessed by asking the PD patients the extent to which they felt physically impaired by PD, as well as to indicate the extent to which they felt mentally impaired by PD. Scores on this index range from 1 to 7, with 1 indicating no impairment and 7 indicating severe impairment.
TOT performance was assessed by 30 general knowledge questions from the Nelson and Narens  norms that were presented on a computer screen, one at a time. These questions were the same as those used by Widner et al.  and were selected from the questions that had a normative recall probability between and . For each question, participants were asked to orally respond with (1) the answer they thought fit, (2) say “do not know” if they did not know the answer, or (3) indicate that they were having a TOT experience, where they believed that they knew the answer but they could not currently recall it and that the answer would pop into their mind at any moment. When participants indicated a TOT state, they were asked to provide the strength of TOT experience by indicating how strong this feeling was on a scale of 1–20 (1—extremely weak; 20—extremely strong). They were given 20 seconds for each question, and the experimenter wrote down the response given for each question. No feedback was provided. Next, participants were given a 4-alternative forced-choice recognition test. With each question, participants were asked to choose a correct answer without leaving any questions blank.
The accuracy of TOT responses was examined by a Goodman-Kruskal gamma correlation computed for each participant . The gamma correlation measures the association between TOT reports and subsequent recognition performance. The assumption is that if one has the answer, but is unable to retrieve it for the moment, they are likely to be able to recognize it on a subsequent recognition test. Just like any other correlational measure, gamma correlation ranges from −1 to +1. The correlation of 0 indicates no association between TOT responses and recognition performance, whereas the correlation of +1 indicates the perfect association between TOT responses and recognition performance. It is difficult, if not impossible, to interpret the correlation of −1. The gamma is computed based on four measures created by a matrix consisting of TOT (yes or no) and recognition (yes or no). The four measures are frequency counts of (a) the items with TOT responses that are correctly recognized, (b) the items with TOT responses that were not correctly recognized, (c) the items without TOT responses that were correctly recognized, and (d) the items without TOT that were not correctly recognized. The gamma score is computed by the following formula, gamma = (ad − bc)/(ad + bc). This means that when the sum of the two products (ad and bc) is zero, the gamma score is undetermined, and therefore, we had to exclude these participants from the analysis. Four participants from the PD patient group (18.2%), five participants from the elderly control group (22.7%), and three participants from the college student group (6.5%) were excluded. Because the percentage of excluded participants was not greater in the PD patient group than in the elderly control group, we proceeded with this analysis.
3.1. Timing Performance
Figure 1 shows the mean timing deviation from the cued metronome beat for the first, second, and third sessions for the PD patient, elderly control, and college student groups. As shown, the PD patients showed lower timing accuracy than the elderly control and college student groups. A 3 (group: PD patient, elderly control, and college student) × 3 (session intervals: first, second, and third) mixed-design analysis of variance (ANOVA) was conducted, with group as a between-subjects variable and session interval as a within-subjects variable. Due to a computer failure to record data, one college student was excluded from the analysis. The results indicated that the main effect of group was significant, , , , and . However, the main effect of interval, , , , and , as well as the group × interval interaction, , , , and , was not significant. Fisher LSD tests comparing the three groups indicated that the PD patient group showed significantly lower timing accuracy (, ) than the elderly control (, ) and college student (, ) groups, with the latter two groups showing no difference from each other. It is also important to note that those PD patients who showed overall timing deficit had a greater proportion of their clapping responses occurring before the cued beat (indexed by % early responses) than the corresponding elderly control (≤70 years) and college student groups: early responses, respectively, .
3.2. Memory Performance
Figure 2 shows the mean proportion of (1) correctly recalled items, (2) incorrectly recalled items, and (3) correctly recognized items. Because the recognition test was a forced-choice test, the false alarm rate is the inverse of the mean correctly recognized items. As shown, all three measures showed comparable performance between PD patients and elderly control participants. These two groups, in turn, performed better than college students. A one-way between-subjects ANOVA was used to compare the three groups on each measure. For the correctly recalled items, the difference among the groups was significant, , , and . Fisher LSD tests showed that the difference between the PD patient (, ) and elderly control () groups was not significant. Fisher LSD tests further showed that these two groups recalled a significantly greater number of correct answers than the college student group (, ). For the incorrectly recalled items (i.e., commission errors), the difference among the groups was significant, , , , and . Fisher LSD tests showed that the PD patient (, and elderly control (, ) groups were not different from each other. The college student group (, ) showed significantly fewer incorrectly recalled items than the PD patient and elderly control groups. The correctly recognized items showed a similar pattern. The difference among the groups for correctly recognized items was significant,, , , and . Fisher LSD tests showed that the difference was not significant between the PD patient (, ) and elderly control (, ) groups. These two groups, in turn, outperformed the college student group (, ). These results indicated that memory performance was similar between the PD patient and elderly control groups. Both the PD patient and elderly control groups showed better performance than the college student group. PD patient group showed no evidence of memory deficiency on general knowledge questions.
3.3. Metamemory Performance
Figure 3 shows the mean proportion of (1) “do not know” responses, (2) correctly recognized items that participants said “do not know” (“do not know correct”), and (3) TOT responses across PD patients, elderly control participants, and college students. Figure 3 also shows TOT accuracy across the three groups, measured by Goodman-Kruskal gamma correlation between TOT responses and recognition performance [31, 62]. As shown, PD patients and elderly control participants showed similar performance on the “do not know” and “do not know correct” measures. For each measure, we conducted a one-way between-subjects ANOVA comparing the three groups. The results showed that the difference among the groups was significant for the “do not know” measure, , , , and . Fisher LSD tests showed that the PD patient (, ) and elderly control groups (, ) made fewer “do not know” responses than the college student group (, ). No difference was found between the PD patient and elderly control groups. The results for the “do not know correct” measure revealed that the difference among the group was not significant, , , , and , indicating that the accuracy of “do not know” responses was similar among PD patients (, ), elderly control participants (, ), and college students (, ). Next, we analyzed the total number of TOT responses. The results showed that the difference among the groups was not significant, , , , and , indicating that the PD patient (, ), elderly control (, ), and college student (, ) groups showed similar TOT responses (expressed as a proportion of total number of responses). Because the PD and elderly control groups showed higher recall than the college student group, TOT responses were conditionalized on unrecalled items (i.e., TOT plus “do not know” responses); that is, what proportion of unrecalled items participants responded with TOT responses? One-tailed planned -tests were conducted because the literature indicated that elderly adults tend to experience TOT at a higher frequency than young adults [37, 63]. The results indicated that the difference between the PD patient (, ) and college student groups (, ) was significant, , . The difference between the elderly control (,) and college student groups also approached significance,, . Because no difference was found between the PD patient and elderly control groups, , , these two groups were combined and compared with the college student group. The difference was significant, , , indicating that the older group (, ) showed a higher tendency of making TOT responses than the younger group (, ).
In terms of TOT accuracy, the groups differed on gamma scores, , , , and . Fisher LSD tests showed that the gamma scores were similar between PD patients (, ) and elderly control participants (, ). The gamma score was significantly lower for the college student group (, ) than the PD patient and elderly control groups, indicating that the accuracy of TOT responses was lower for the college student group than for the PD patient and elderly control groups. Recently, a question was raised as to whether gamma is the best measure of metacognitive accuracy. Benjamin and Diaz  recommend two alternative measures, signal detection (da) and G*. Unfortunately, the former is not suitable for the present data because it requires at least a contingency table. Furthermore, G* discards those participants who showed perfect accuracy. In fact, using G*, only six participants remained in the PD patient and elderly control groups because many participants in these groups were very conservative. Using the remaining participants, a one-way ANOVA did not show a difference among the groups, , , , and . We also computed Hart difference score statistic (D) , which, according to Benjamin and Diaz, did better than gamma in their simulation. The results of a one-way ANOVA based on D also showed a nonsignificant difference among the groups, , , , and . All these measures provided converging evidence that the PD patients did not show impairment in TOT accuracy.
To assess the effects of age and the amount of general knowledge on gamma correlation (i.e., TOT accuracy), an analysis of covariance (ANCOVA) was conducted using the age and the number of correctly recognized answers as variables. When the low, medium, and high knowledge groups were compared with age as a covariate, no difference was found among the groups, , , , and . The difference was also nonsignificant when the young, middle, and old age groups were compared with general knowledge as a covariate, , , , and . However, age as well as the number of correctly recognized answers significantly correlated with gamma score: age , , and correctly recognized answer , . Further, age was significantly correlated with the number of correctly recognized answers, , . A linear regression showed that age and the number of correctly recognized answers jointly accounted for 9% of variance (), , . However, neither alone significantly predicted TOT accuracy.
We also predicted that the MMSE score would be positively correlated with the TOT accuracy for the PD patients and elderly. The results showed that the correlation was nonsignificant for the PD patients, , (one-tailed) but significant for elderly, , (one-tailed). Combining the PD patients and elderly, the correlation was significant, , (one-tailed). In contrast, the correlation was much smaller for college students between the TOT gamma and the MMSE score, , (one-tailed). In summary, TOT accuracy and MMSE are related in PD patients and elderly, but not for college controls.
The strength of TOT states showed similar patterns. A mean TOT strength was computed for each participant using all TOT responses as well as using only TOT responses that were accurate (i.e., the ones that participants selected correct answers on the subsequent recognition test). Because both analyses produced similar results, the results from the former analysis will be presented here. An attempt was also made to compute the mean strength of inaccurate TOT; however, due to a small number of these responses, we were unable to proceed with this analysis. A one-way between-subjects ANOVA comparing all three groups showed that the difference was significant, , , , and . Fisher LSD tests showed that the elderly control group (, ) showed higher strength than the college student group (, ). The PD group (, ) was not different from either group. In sum, there was no evidence that PD patients had metamemory deficiency. Both the PD patient and elderly control groups performed similarly on all metamemory measures: frequency, strength, and accuracy of TOT.
Based on the hypothesis testing procedures reported above, there was no statistical difference between the PD and elderly control groups. However, the failure to reject the null hypothesis does not mean that the two groups are equivalent because the value is “the probability of data given that the null hypothesis is true” rather than “the probability that the null hypothesis is true given the data” [66, page 372]. To further support the equivalence of the two groups, the procedure that would establish statistical equivalence, described by Tryon  and Tryon and Lewis , was performed for each memory and metamemory measure as follows. First, the 95% inferential confidence interval (ICI) was computed for each group based on the revised formula described by Tryon and Lewis [67, Equation 9, page 274]. If there is an overlap in 95% ICI between the PD and elderly control groups, the difference is not statistically significant. Then, the question becomes whether the two groups are equivalent or the decision is indeterminant. Second, the value of the delta (Δ) was set. This is the amount of difference between the two groups “that is considered to be inconsequential” based on “substantive grounds that have been established apart from the analysis at hand by professional consensus or other means” [67, page 273]. There is no fast and easy method of determining Δ; however, for the purpose of the present investigation, we used the width of the 95% confidence internal (CI) for the elderly control group because if the PD group is equivalent to the elderly control group, the likely location of the population mean should be the same between these two groups. Third, the equivalence range () was computed for each measure based on the procedure described by Tryon and Lewis. This range was based on 100 (1 − 2α)% ICI, using the shrinkage factor (). Equivalence between two groups is established when [67, Equation 23, page 276]. The assumption is that the difference between the lowest and the highest ends of 90% ICI (based on both groups) should not exceed . As shown in Tables 2 and 3, for memory performance and metamemory performance, respectively, statistical equivalence is demonstrated in all but the TOT measure. However, when the TOT responses were conditionalized on unrecalled items (i.e., proportion of TOTs in unrecalled items), (.19) did not exceed (.21), indicating that the two means were equivalent.
The present study investigated whether a form of metacognition, tip-of-tongue (TOT), was affected by Parkinson’s disease (PD). Patients with PD showed lower motor response timing accuracy but uncompromised TOT performance, compared to both control groups. Both the PD patient and elderly control groups showed similar level on all TOT measures: frequency, strength, and accuracy, despite the fact that the PD patients showed significantly worse timing accuracy than the elderly control and college student groups. Further, general knowledge was uncompromised by PD on both recall and recognition tests; the PD patient group showed a similar level of performance to the elderly control group, which was higher than that of the college student control group.
A variety of neuropsychological studies have reported a deficit in the ability of PD patients to accurately perceive duration and correctly timed motor responses [56, 68]. Accordingly, it was expected that PD patients would show lower timing accuracy relative to controls (elderly and college students) in performing the metronome timing task. The metronome timing task used in the present study involves several components of the working memory functions, including maintenance, manipulation, and monitoring of cognitive resource as related to timing interval, internal and external cues, and stimuli pacing [69, 70]. The present results agree with previous reports that PD patients have significantly worse motor timing than age-matched controls, suggesting that the brain regions affected in PD may play a direct role in such tasks . In fact, a large number of studies have shown that human motor timing behavior is closely linked to the prefrontal cortex (PFC) and the basal ganglia activity, brain regions severely compromised in PD [54, 68, 71]. The present results are therefore consistent with the hypothesis that motor timing performance deficit in PD patients is closely related to a dysfunction of the prefrontal-basal ganglia circuits.
In contrast to the motor timing performance, there was no evidence that PD patients had deficiency in TOT metacognition. Both PD patients and elderly groups showed significantly greater TOT responses as well as TOT accuracy than did college group, showing about 200% and 206% accuracy increase compared with college group, respectively. In fact, both the PD patient and elderly control groups performed similarly on all metamemory measures: frequency, strength, and accuracy of TOT. It has been suggested that TOTs are simply strong FOK experiences , but evidence that refutes this claim has been reported. For example, Widner et al.  using perseveration errors made during the Wisconsin Card Sorting Task, as an index of PFC functioning, reported that the TOT judgments were not related to PFC functioning. In their study, PFC functioning had an impact on FOKs, but did not impact TOTs. The present results are compatible with a view that the TOT and FOK are disparate cognitive processes subserved by different neural substrates. The results also support a notion that the activation of the localized specific brain regions including the right prefrontal and ACC regions may be closely associated with the neuropsychological processes involved in both TOT judgment and retrieval. PD patients in the present study did not show impairments in TOT experience, and, therefore, it is conceivable that these brain regions remained intact and functional. In fact, the present results revealed that the MMSE scores were positively correlated with TOT accuracy scores in PD patients and elderly, further supporting the view that PD patients in the present study did not have damage in frontal lobe areas associated with TOT metacognition as well as with certain aspects of cognitive control.
In addition, although PD is associated with emotional impairment [16, 73, 74], a feeling of imminence and emotional reactions [75–77] that often accompanies TOT experience appears to be unaffected in PD patients. Taken together, the present findings support the postulate that TOT metacognitive function may not be directly related to dopamine deficiency in PD patients, which influence the overall prefrontal executive networks, but perhaps is likely due to dysfunction within a localized specific neural network [29, 46]. Future research, such as fMRI morphometry, will be needed to further delineate the precise nature of metacognitive and associated neural function in normal subjects as well as PD patients. Elucidating and characterizing a specific neural function associated with unimpaired TOT metacognition in PD patients may have significant therapeutic and prognostic implications for PD and other dopamine-related disorders.
Uncompromised TOT metacognition among the PD patients may also depend on the nature of the memory task. In regard to another metacognitive measure FOK, some studies showed impaired FOK among PD patients [27, 78], whereas others showed intact FOK among PD patients [25, 26]. The disparate results are likely to be based on the difference in the nature of the memory task; that is, those studies that used an episodic memory task showed impaired FOK [27, 78], whereas those studies that used a semantic memory task showed spared FOK [26, 79]. Similarly, PD patients may show impaired TOT if the task is episodic in nature (e.g., paired-associate learning) rather than semantic in nature (e.g., general knowledge questions). In fact, in the present study, there was no evidence of impaired semantic memory by the PD patient group relative to both control groups; both correct recall and recognition showed comparable performance between PD patients and elderly participants, both of which, in turn, performed much better than college students. The episodic, but not semantic [38, 39], memory is thought to involve context retrieval and executive control operations that are closely linked to prefrontal cortical (PFC) executive functions [27, 32, 80, 81]. Given this, the present results appear to be in line with the hypothesis that PFC deficit in PD patients is closely related to a dysfunction of the episodic, but not semantic metacognition [27, 46, 82].
One weakness of the present study was that metacognitive control was not directly measured. That is, TOT is an indicator of metacognitive knowledge; however, how this knowledge is used to control retrieval might show impairment among PD patients. A future question should be whether participants would show longer retrieval time when they experience TOT. This question could be answered by measuring participants’ response time in reporting TOT experience as well as response time associated with TOT resolution.
In regard to TOT and aging, it is well established that older adults experience more TOTs than younger adults, possibly due to age-related cognitive changes [37, 83]. The present results were consistent with these findings because when TOT responses were conditionalized on unrecalled items, older adults (PD patients and elderly control groups combined) showed a higher tendency of responding with TOT than the college student control group.
In terms of TOT accuracy, the present results were consistent with the incremental and metacognitive perspectives which argue for TOT accuracy increasing with aging as a result of knowledge culmination and memory network expansion [31, 84]. Conceivably, broader and stronger knowledge base in older adults including PD patients may have contributed to providing more familiar cues (the cue familiarity heuristics) and more target-related information (the accessibility heuristics) to increase the TOT accuracy [23, 26, 85]. This interpretation based on the increment view is consistent with the current data, in that the level of general knowledge (indexed by the number of correctly recognized answers), as well as age, covaried with TOT accuracy, suggesting that participants who had more knowledge were more likely to have more accurate TOT metacognitive judgments, regardless of age.
In regard to motor timing performance and the TOT metacognitive function, there was a dissociation between the accuracy of TOT judgments and the level of motor timing-related functioning. The results indicated that TOT accuracy (indexed by gamma correlations) was not affected by the level of motor timing accuracy (low- versus high-accuracy group) in any of the subject groups examined. There was also no correlation between motor timing accuracy and gamma correlation scores in any groups. The data indicated that TOT metamemory and motor timing performance may represent distinct cognitive functions, potentially mediated by functionally and structurally different systems from one another. To the extent that the motor timing abilities are related to the prefrontal cortical (PFC) function [68, 70], our results suggest the possibility that TOT experiences are indeed different from other metacognitive processes that require PFC function, such as in FOK and prospective memory performance [27, 31, 43]. Consistent with this theme, both FOK metamemory and prospective memory are impaired in PD [14, 15, 25, 26]. Further study examining both FOK and TOT in the same PD patient group, however, is required before any concrete conclusions can be established. Nevertheless, based on the current data, it can be concluded that despite patients with PD showing significant motor response timing impairment (an index of prefrontal and working memory impairment), they were not impaired in their TOT metamemory performance compared to age-matched adults.
One caveat to above interpretations is that PD patients examined in the current study were ON anti-Parkisonian medication, primarily dopaminergic agonists (DA). Despite inconsistent and incomplete reports on the effects of DA drugs on motor timing functions, , administration of DA agonist has been found to cause alterations in these functions including clock speed shifts to an earlier time, relative to the feedback time . In the current study, PD patients displayed this effect with a greater proportion of clapping responses occurring early, relative to the cue (~16% greater shift to early responses), than did age-matched adults (80% and 69% early responses by PD and elderly, resp.). Consequently, it is difficult, if not impossible, to rule out the possibility that the null difference in TOT measures between the PD patient and elderly control groups might have resulted from an anti-Parkinsonian drug-related effect. More accurate and careful interpretation of current data must await further research that examines the effects of DA drugs on metacognition and motor timing learning in PD patients while ON or OFF medication.
In view of the previously reported association between metacognitive abilities with competence in problem solving and learning new skills [20, 87, 88], the present results appear to be relevant to efficiency in memory retrieval process and quality of life for PD patients [15, 43, 89]. Conceivably, PD patients without dementia could benefit from intervention strategies (e.g., implementation intention) that are based on metacognitive abilities (e.g., metacognitive knowledge, skill, and belief) in ways that will help promote qualities such as self-evaluation, self-monitoring, self-control, self-motivation, and everyday functional capability [88, 90–92]. Being in a TOT state is often frustrating experience, but it may be used as a cue or strategy (think some more immediately, think some more later, or look up the answer) to facilitate retrieval . Accordingly, PD patients may be trained to use TOT states to select effective and appropriate retrieval strategies in ways that will help improve their overall cognitive functions.
The future investigation should also include metacognitive judgments that are made at encoding or judgments of learning (JOL), which is one’s judgment that a given item is learned adequately enough for successful retrieval on a future test. Research has shown that JOLs are causally related to monitoring and control of the acquisition of to-be-learned materials [49, 93–95]. The issue is whether PD patients would be able to use JOL for effective monitoring and control of their operations during acquisition. Previous studies have shown that frontal lobe damages would be likely to lead to impairment in JOL  even though no JOL impairment was found when medial prefrontal cortex was damaged . Taken together, it could be predicted that JOL metacognitive function may also remain uncompromised in PD patients. If this is the case, it will confer unique opportunities for development of safer and more effective cognitive intervention strategies in patients with PD as well as other related neurodegenerative diseases. Given the close link between cognitively demanding tasks on postural and motor stability in PD patients [98, 99], further study into this issue is obviously critical to better understand the contribution of metacognitive abilities in the human memory retrieval process, as well as in the overall cognitive and motor functions. The present findings also provide further support to the existing literature on cognitive abilities, which are not as severely impaired as was once purported in PD, including selective attention, decision-making, verbal memory, and adaptive abilities [26, 100–103]. By fully understanding which cognitive neural functions are unimpaired in PD, more effective training strategies can be developed to improve patient’s symptom management strategies and their quality of life.
The present findings, collectively, support the view that TOT metamemory judgment is not impaired in PD patients, and that varied metacognitive functions (TOT, FOK, and prospective memory) may be differentially affected by the disease. The findings also suggest potential implications of TOT metacognitive abilities related to memory retrieval processes as well as to general cognitive and motor functions in PD. Further study into this issue is obviously critical to the development of novel behavioral therapeutic options that may prove useful in enhancing memory function and overall quality of life in these patients.
- O. Hornykiewicz, “Die Topische Lokalisation und das Verhalten von Noradrenalin und Dopamin in der substantia nigra des normalen und Parkinsonkranken Menschen,” Wiener klinische Wochenschrift, vol. 75, pp. 309–312, 1963.
- J. Jankovic, “Parkinson's disease: clinical features and diagnosis,” Journal of Neurology, Neurosurgery and Psychiatry, vol. 79, no. 4, pp. 368–376, 2008.
- B. R. Thanvi, S. K. Munshi, N. Vijaykumar, and T. C. N. Lo, “Neuropsychiatric non-motor aspects of Parkinson's disease,” Postgraduate Medical Journal, vol. 79, no. 936, pp. 561–565, 2003.
- B. E. Levin and H. L. Katzen, “Early cognitive changes and nondementing behavioral abnormalities in Parkinson's disease,” Advances in Neurology, vol. 96, pp. 84–94, 2005.
- K. Dujardin and B. Laurent, “Dysfunction of the human memory systems: role of the dopaminergic transmission,” Current Opinion in Neurology, vol. 16, no. 2, pp. S11–S16, 2003.
- B. Dubois and B. Pillon, “Cognitive deficits in Parkinson's disease,” Journal of Neurology, vol. 244, no. 1, pp. 2–8, 1997.
- A. McKinlay, R. C. Grace, J. C. Dalrymple-Alford, and D. Roger, “Characteristics of executive function impairment in Parkinson's disease patients without dementia,” Journal of the International Neuropsychological Society, vol. 16, no. 2, pp. 268–277, 2010.
- S. Tisch, P. S. Silberstein, P. Limousin-Dowsey, and M. Jahanshahi, “The basal ganglia: anatomy, physiology, and pharmacology,” Psychiatric Clinics of North America, vol. 27, no. 4, pp. 757–799, 2004.
- D. J. Zgaljardic, J. C. Borod, N. S Foldi et al., “An examination of executive dysfunction associated with frontostriatal circuitry in Parkinson's disease,” Journal of Clinical and Experimental Neuropsychology, vol. 28, no. 7, pp. 1127–1144, 2006.
- E. Mohr, G. Fabbrini, J. Williams et al., “Dopamine and memory function in Parkinson's disease,” Movement Disorders, vol. 4, no. 2, pp. 113–120, 1989.
- E. A. Kensinger, D. K. Shearer, J. J. Locascio, J. H. Growdon, and S. Corkin, “Working memory in mild Alzheimer's disease and early Parkinson's disease,” Neuropsychology, vol. 17, no. 2, pp. 230–239, 2003.
- C. Whittington, J. Podd, and S. Stewart-Williams, “Memory deficits in Parkinson's disease,” Journal of Clinical and Experimental Neuropsychology, vol. 28, no. 5, pp. 738–754, 2006.
- R. Beato, R. Levy, B. Pillon et al., “Working memory in Parkinson's disease patients: clinical features and response to levodopa,” Arquivos de Neuro-Psiquiatria A, vol. 66, no. 2, pp. 147–151, 2008.
- A. Costa, A. Peppe, C. Caltagirone, and G. A. Carlesimo, “Prospective memory impairment in individuals with Parkinson's disease,” Neuropsychology, vol. 22, no. 3, pp. 283–292, 2008.
- E. R. Foster, M. A. McDaniel, G. Repovš, and T. Hershey, “Prospective memory in parkinson disease across laboratory and self-reported everyday performance,” Neuropsychology, vol. 23, no. 3, pp. 347–358, 2009.
- H. M. Gray and L. Tickle-Degnen, “A meta-analysis of performance on emotion recognition tasks in Parkinson's disease,” Neuropsychology, vol. 24, no. 2, pp. 176–191, 2010.
- J. V. Filoteo and W. T. Maddox, “Category learning in parkinson's disease,” Research Progress in Alzheimer's Disease and Dementia, vol. 3, pp. 1–24, 2007.
- R. M. Marié and G. L. Defer, “Working memory and dopamine: clinical and experimental clues,” Current Opinion in Neurology, vol. 16, no. 2, pp. S29–S35, 2003.
- L. A. Mackin, “Understanding Parkinson's disease: detection and early disease management,” Lippincott's Primary Care Practice, vol. 4, no. 6, pp. 595–607, 2000.
- J. H. Flavell, “Speculations about the nature and development of development of meta cognition,” in Metacognition, Motivation, and Understanding, F. E. Wienert and R.H. Kluwe, Eds., pp. 21–29, Prince Hall, Hillsdale, NJ, USA, 1987.
- A. Perrotin, S. Belleville, and M. Isingrini, “Metamemory monitoring in mild cognitive impairment: evidence of a less accurate episodic feeling-of-knowing,” Neuropsychologia, vol. 45, no. 12, pp. 2811–2826, 2007.
- S. Ghetti, K. E. Lyons, F. Lazzarin, and C. Cornoldi, “The development of metamemory monitoring during retrieval: the case of memory strength and memory absence,” Journal of Experimental Child Psychology, vol. 99, no. 3, pp. 157–181, 2008.
- A. Koriat, “Metacognition research: an interim report,” in Applied Metacognition, T. J. Perfect and B. L. Schwartz, Eds., pp. 261–286, Cambridge University Press, Cambridge, UK, 2002.
- L. K. Son and B. L. Schwartz, “The relation between metacognitive monitoring and control,” in Applied Metacognition, T. J. Perfect and B. L. Schwartz, Eds., pp. 15–38, Cambridge University Press, Cambridge, UK, 2002.
- L. Coulter, “The feeling of knowing in depressed and nondepressed patients with parkinson's disease,” Journal of Clinical and Experimental Neuropsychology, vol. 11, p. 91, 1989.
- S. J. Ivory, R. G. Knight, B. E. Longmore, and T. Caradoc-Davies, “Verbal memory in non-demented patients withidiopathic Parkinson's disease,” Neuropsychologia, vol. 37, no. 7, pp. 817–828, 1999.
- C. Souchay, M. Isingrini, and R. Gil, “Metamemory monitoring and Parkinson's disease,” Journal of Clinical and Experimental Neuropsychology, vol. 28, no. 4, pp. 618–630, 2006.
- A. C. Miner and L. M. Reder, “A new look at feeling of knowing: its metacognitive role in regulating question answering,” in Metacognition, J. Metcalfe and A. P. Shimamura, Eds., pp. 47–70, The Massachusetts Institute of Technology Press, Cambridge, MA, USA, 2004.
- A. Maril, J. S. Simons, J. P. Mitchell, B. L. Schwartz, and D. L. Schacter, “Feeling-of-knowing in episodic memory: an event-related fMRI study,” NeuroImage, vol. 18, no. 4, pp. 827–836, 2003.
- J. T. Hart, “Memory and the feeling-of-knowing experience,” Journal of Educational Psychology, vol. 56, no. 4, pp. 208–216, 1965.
- R. L. Widner, H. Otani, and S. E. Winkelman, “Tip-of-the-tongue experiences are not merely strong feeling-of-knowing experiences,” Journal of General Psychology, vol. 132, no. 4, pp. 392–407, 2005.
- D. M. Schnyer, M. Verfaellie, M. P. Alexander, G. LaFleche, L. Nicholls, and A. W. Kaszniak, “A role for right medial prefrontal cortex in accurate feeling-of-knowing judgments: evidence from patients with lesions to frontal cortex,” Neuropsychologia, vol. 42, no. 7, pp. 957–966, 2004.
- C. I. Higginson, V. L. Wheelock, D. Levine, D. S. King, C. T. E. Pappas, and K. A. Sigvardt, “Cognitive deficits in essential tremor consistent with frontosubcortical dysfunction,” Journal of Clinical and Experimental Neuropsychology, vol. 30, no. 7, pp. 760–765, 2008.
- J. A. Grahn, J. A. Parkinson, and A. M. Owen, “The role of the basal ganglia in learning and memory: neuropsychological studies,” Behavioural Brain Research, vol. 199, no. 1, pp. 53–60, 2009.
- S. Raskin, S. A. Woods, A. J. Poquette, et al., “A differential deficit in time versus event-based prospective memory in Parkinson's disease,” Neuropsychology, vol. 25, no. 2, pp. 201–209, 2011.
- R. L. Widner, S. M. Smith, and W. G. Graziano, “The effects of demand characteristics on the reporting of tip-of-the-tongue and feeling-of-knowing states,” American Journal of Psychology, vol. 109, no. 4, pp. 525–538, 1996.
- B. L. Schwartz, Tip-of-the-Tongue States: Phenomenology, Mechanism, and Lexical Retrieval, Lawrence Erlbaum, Mahwah, NJ, USA, 2002.
- A. Koriat, “Monitoring one's own knowledge during study: a cue-utilization approach to judgments of learning,” Journal of Experimental Psychology, vol. 126, no. 4, pp. 349–370, 1997.
- B. L. Schwartz and S. M. Smith, “The retrieval of related information influences tip-of-the-tongue states,” Journal of Memory and Language, vol. 36, no. 1, pp. 68–86, 1997.
- O. Juncos-Rabadan, N. Rodriguez, D. Facal, J. Cuba, and A. X. Pereiro, “Tip-of-the-tongue for proper names in mild cognitive impairment: semantic or post-semantic impairments?” Journal of Neurolinguistics, vol. 24, pp. 636–651, 2011.
- A. Koriat, R. Levy-Sadot, E. Edry, and S. de Marcas, “What do we know about what we cannot remember? Accessing the semantic attributes of words that cannot be recalled,” Journal of Experimental Psychology, vol. 29, no. 6, pp. 1095–1105, 2003.
- R. Brown and D. McNeill, “The “tip of the tongue” phenomenon,” in Cognitive Psychology, D. A. Barlota and E. J. Marsh, Eds., pp. 418–430, Psychology Press, New York, NY, USA, 2003.
- B. L. Schwartz, “Working memory load differentially affects tip-of-the-tongue states and feeling-of-knowing judgments,” Memory and Cognition, vol. 36, no. 1, pp. 9–19, 2008.
- R. L. Widner and S. M. Smith, “Feeling-of-knowing judgments from the subject's perspective,” American Journal of Psychology, vol. 109, no. 3, pp. 373–387, 1996.
- Y. Otsuka and N. Osaka, “Working memory in the elderly: role of prefrontal cortex,” Japanese Psychological Research, vol. 48, pp. 518–529, 2005.
- A. Maril, J. S. Simons, J. J. Weaver, and D. L. Schacter, “Graded recall success: an event-related fMRI comparison of tip of the tongue and feeling of knowing,” NeuroImage, vol. 24, no. 4, pp. 1130–1138, 2005.
- A. Maril, J. S. Simons, J. P. Mitchell, B. L. Schwartz, and D. L. Schacter, “Feeling-of-knowing in episodic memory: an event-related fMRI study,” NeuroImage, vol. 18, no. 4, pp. 827–836, 2003.
- M. Lindín, F. Díaz, A. Capilla, T. Ortiz, and F. Maestú, “On the characterization of the spatio-temporal profiles of brain activity associated with face naming and the tip-of-the-tongue state: a magnetoencephalographic (MEG) study,” Neuropsychologia, vol. 48, no. 6, pp. 1757–1766, 2010.
- B. L. Schwartz, “Working memory load differentially affects tip-of-the-tongue states and feeling-of-knowing judgments,” Memory and Cognition, vol. 36, no. 1, pp. 9–19, 2008.
- L. Davachi, A. Maril, and A. D. Wagner, “When keeping in mind supports later bringing to mind: neural markers of phonological rehearsal predict subsequent remembering,” Journal of Cognitive Neuroscience, vol. 13, no. 8, pp. 1059–1070, 2001.
- R. Matison, R. Mayeux, J. Rosen, and S. Fahn, ““Tip-of-the-tongue” phenomenon in Parkinson's disease,” Neurology, vol. 32, no. 5, pp. 567–570, 1982.
- C. J. MacDonald and W. H. Meck, “Systems-level integration of interval timing and reaction time,” Neuroscience and Biobehavioral Reviews, vol. 28, no. 7, pp. 747–769, 2004.
- C. R. G. Jones, T. J. L. Malone, G. Dirnberger, M. Edwards, and M. Jahanshahi, “Basal ganglia, dopamine and temporal processing: performance on three timing tasks on and off medication in Parkinson's disease,” Brain and Cognition, vol. 68, no. 1, pp. 30–41, 2008.
- W. H. Meck and A. M. Benson, “Dissecting the brain's internal clock: how frontal-striatal circuitry keeps time and shifts attention,” Brain and Cognition, vol. 48, no. 1, pp. 195–211, 2002.
- C. V. Buhusi and W. H. Meck, “What makes us tick? Functional and neural mechanisms of interval timing,” Nature Reviews Neuroscience, vol. 6, no. 10, pp. 755–765, 2005.
- W. H. Meck, “Neuroanatomical localization of an internal clock: a functional link between mesolimbic, nigrostriatal, and mesocortical dopaminergic systems,” Brain Research, vol. 1109, no. 1, pp. 93–107, 2006.
- B. L. Schwartz, “The strategic control of retrieval during tip-of-the-tongue states,” Korean Journal of Thinking & Problem Solving, vol. 12, no. 1, pp. 27–37, 2002.
- T. O. Nelson and L. Narens, “The role of metacognition in problem solving,” in Metacognition, J. Metcalfe and A. Shiminura, Eds., pp. 207–226, MIT Press, Cambridge, MA, USA, 1994.
- B. Finn, “Framing effects on metacognitive monitoring and control,” Memory and Cognition, vol. 36, no. 4, pp. 813–821, 2008.
- A. M. Johnson, C. C. Pollard, P. A. Vernon, J. L. Tomes, and M. S. Jog, “Memory perception and strategy use in Parkinson's disease,” Parkinsonism and Related Disorders, vol. 11, no. 2, pp. 111–115, 2005.
- T. M. Libkuman, H. Otani, and N. Steger, “Training in timing improves accuracy in golf,” Journal of General Psychology, vol. 129, no. 1, pp. 77–96, 2002.
- T. O. Nelson, “A comparison of current measures of the accuracy of feeling-of-knowing predictions,” Psychological Bulletin, vol. 95, no. 1, pp. 109–133, 1984.
- A. S. Brown and L. A. Nix, “Age-related changes in the tip-of-the-tongue experience,” American Journal of Psychology, vol. 109, no. 1, pp. 79–91, 1996.
- A. S. Benjamin and M. Diaz, “Measurement of relative metanemonic accuracy,” in Handbook of Metamemory and Memory, J. Dunlosky and R. A. Bjork, Eds., pp. 1–34, Psychology Press, Hillsdale, NJ, USA, 2008.
- J. T. Hart, “Memory and the feeling-of-knowing experience,” Journal of Educational Psychology, vol. 56, no. 4, pp. 208–216, 1965.
- W. W. Tryon, “Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: an integrated alternative method of conducting null hypothesis statistical tests,” Psychological Methods, vol. 6, no. 3, pp. 371–386, 2001.
- W. W. Tryon and C. Lewis, “An inferential confidence interval method of establishing statistical equivalence that corrects Tryon's (2001) reduction factor,” Psychological Methods, vol. 13, no. 3, pp. 272–277, 2008.
- W. H. Meck, T. B. Penney, and V. Pouthas, “Cortico-striatal representation of time in animals and humans,” Current Opinion in Neurobiology, vol. 18, no. 2, pp. 145–152, 2008.
- P. A. Lewis, A. M. Wing, P. A. Pope, P. Praamstra, and R. C. Miall, “Brain activity correlates differentially with increasing temporal complexity of rhythms during initialisation, synchronisation, and continuation phases of paced finger tapping,” Neuropsychologia, vol. 42, no. 10, pp. 1301–1312, 2004.
- P. A. Pope, P. Praamstra, and A. M. Wing, “Force and time control in the production of rhythmic movement sequences in Parkinson's disease,” European Journal of Neuroscience, vol. 23, no. 6, pp. 1643–1650, 2006.
- A. Thiel, R. Hilker, J. Kessler, B. Habedank, K. Herholz, and W. D. Heiss, “Activation of basal ganglia loops in idiopathic Parkinson's disease: a PET study,” Journal of Neural Transmission, vol. 110, no. 11, pp. 1289–1301, 2003.
- A. Koriat and R. Levy-Sadot, “The combined contributions of the cue-familiarity and accessibility heuristics to feelings of knowing,” Journal of Experimental Psychology, vol. 27, no. 1, pp. 34–53, 2001.
- C. H. Adler, “Nonmotor complications in Parkinson's disease,” Movement Disorders, vol. 20, no. 11, pp. S23–S29, 2005.
- T. D. Hälbig, U. A. Kopp, F. Wodarz et al., “Dopaminergic modulation of emotional memory in Parkinson's disease,” Journal of Neural Transmission, vol. 115, no. 8, pp. 1159–1163, 2008.
- B. L. Schwartz, “The relation of tip-of-the-tongue states and retrieval time,” Memory and Cognition, vol. 29, no. 1, pp. 117–126, 2001.
- B. L. Schwartz, “The effects of emotion on tip-of-the-tongue states,” Psychonomic Bulletin and Review, vol. 17, no. 1, pp. 82–87, 2010.
- B. L. Schwartz, “The effects of emotion on tip-of-the-tongue states,” Psychonomic Bulletin and Review, vol. 17, no. 1, pp. 82–87, 2010.
- B. Baran, A. I. Tekcan, H. Gürvit, and A. Boduroglu, “Episodic memory and metamemory in Parkinson's disease patients,” Neuropsychology, vol. 23, no. 6, pp. 736–745, 2009.
- B. R. Reed, W. J. Jagust, and L. Coulter, “Anosognosia in Alzheimer's disease: relationships to depression, cognitive function, and cerebral perfusion,” Journal of Clinical and Experimental Neuropsychology, vol. 15, no. 2, pp. 231–244, 1993.
- D. Fernandez-Duque, J. A. Baird, and M. I. Posner, “Executive attention and metacognitive regulation,” Consciousness and Cognition, vol. 9, no. 2, pp. 288–307, 2000.
- Y. Nagahama, T. Okina, N. Suzuki, H. Nabatame, and M. Matsuda, “The cerebral correlates of different types of perseveration in the Wisconsin Card Sorting Test,” Journal of Neurology, Neurosurgery and Psychiatry, vol. 76, no. 2, pp. 169–175, 2005.
- H. Kikyo, K. Ohki, and Y. Miyashita, “Neural correlates for feeling-of-knowing: an fMRI parametric analysis,” Neuron, vol. 36, no. 1, pp. 177–186, 2002.
- M. T. Farrell and L. Abrams, “Tip-of-the-tongue states reveal age differences in the syllable frequency effect,” Journal of Experiment Psychology, vol. 37, no. 1, pp. 277–285, 2011.
- B. L. Schwartz and L. D. Frazier, “Tip-of-the-tongue states and aging: contrasting psycholinguistic and metacognitive perspectives,” Journal of General Psychology, vol. 132, no. 4, pp. 377–391, 2005.
- D. J. Dahlgren, “Impact of knowledge and age on tip-of-the-tongue rates,” Experimental Aging Research, vol. 24, no. 2, pp. 139–153, 1998.
- D. Z. Press, D. J. Mechanic, D. Tarsy, and D. S. Manoach, “Cognitive slowing in parkinson's disease resolves after practice,” Journal of Neurology Neurosurgery and Psychiatry, vol. 73, no. 5, pp. 524–528, 2002.
- A. Desoete, H. Roeyers, and A. Buysse, “Metacognition and mathematical problem solving in grade 3,” Journal of Learning Disabilities, vol. 34, no. 5, pp. 435–447, 2001.
- W. Schneider, “The development of metacognitive knowledge in children and adolescents: major trends and implications for education,” Mind, Brain, and Education, vol. 2, no. 3, pp. 114–121, 2008.
- A. B. Warriner and K. R. Humphreys, “Learning to fail: reoccurring tip-of-the-tongue states,” Quarterly Journal of Experimental Psychology, vol. 61, no. 4, pp. 535–542, 2008.
- M. A. McDaniel, D. C. Howard, and K. M. Butler, “Implementation intentions facilitate prospective memory under high attention demands,” Memory and Cognition, vol. 36, no. 4, pp. 716–724, 2008.
- S. Goebel, H. M. Mehdorn, and B. Leplow, “Strategy instruction in Parkinson's disease: influence on cognitive performance,” Neuropsychologia, vol. 48, no. 2, pp. 574–580, 2010.
- S. Raskin, “Current approaches to cognitive rehabilitation,” in Handbook of Medical Neuropsychology: Applications of Cognitive Neuroscience, C. Armstrong and L. Morrow, Eds., pp. 505–518, Springer Press, New York, NY, USA, 2010.
- N. Kornell and J. Metcalfe, ““blockers” do not block recall during tip-of-the-tongue states,” Metacognition and Learning, vol. 1, no. 3, pp. 248–261, 2006.
- J. Metcalfe, “Is study time allocated selectively to a region of proximal learning?” Journal of Experimental Psychology, vol. 131, no. 3, pp. 349–363, 2002.
- B. L. Schwartz and J. Metcalfe, “Tip-of-the-tongue (TOT) states: retrieval, behavior, and experience,” Memory and Cognition, vol. 39, no. 5, pp. 737–749, 2011.
- J. Vilkki, O. Surma-Aho, and A. Servo, “Inaccurate prediction of retrieval in a face matrix learning task after right frontal lobe lesions,” Neuropsychology, vol. 13, no. 2, pp. 298–305, 1999.
- M. Modirrousta and L. K. Fellows, “Medial prefrontal cortex plays a critical and selective role in 'feeling of knowing' meta-memory judgments,” Neuropsychologia, vol. 46, no. 12, pp. 2958–2965, 2008.
- R. Camicioli, Y. Wang, C. Powell, A. Mitnitski, and K. Rockwood, “Gait and posture impairment, parkinsonism and cognitive decline in older people,” Journal of Neural Transmission, vol. 114, no. 10, pp. 1355–1361, 2007.
- J. D. Holmes, M. E. Jenkins, A. M. Johnson, S. G. Adams, and S. J. Spaulding, “Dual-task interference: the effects of verbal cognitive tasks on upright postural stability in parkinson's disease,” Parkinson's Disease, Article ID 696492, pp. 1–5, 2010.
- M. Emre, “Dementia associated with Parkinson's disease,” The Lancet Neurology, vol. 2, no. 4, pp. 229–237, 2003.
- A. McKinlay, J. C. Dalrymple-Alford, R. C. Grace, and D. Roger, “The effect of attentional set-shifting, working memory, and processing speed on pragmatic language functioning in Parkinson's disease,” European Journal of Cognitive Psychology, vol. 21, no. 2-3, pp. 330–346, 2009.
- M. K. York and J. K. Alvarez, “Cognitive impairments associated with Parkinson's disease,” in Neurorehabilitation in Parkinson's Disease: an Evidence Based Treatment Model, M. Trail, E. Protas, and E. Lai, Eds., pp. 71–100, Slack Incorporated, Thorofare, NJ, USA, 2008.
- S. McPherson and J. Cummings, “Neuropsychological aspects of Parkinson's disease and Parkinsonism,” in Neuropsychological Assessment of Neuropsychiatric and Neuromedical Disorders, I. Grant and K. Adams, Eds., pp. 199–222, Oxford University Press, New York, NY, USA, 2009.