Mild Brain InjuryView this Special Issue
Research Article | Open Access
Grant L. Iverson, Ruben J. Echemendia, Amanda K. LaMarre, Brian L. Brooks, Michael B. Gaetz, "Possible Lingering Effects of Multiple Past Concussions", Rehabilitation Research and Practice, vol. 2012, Article ID 316575, 7 pages, 2012. https://doi.org/10.1155/2012/316575
Possible Lingering Effects of Multiple Past Concussions
Background. The literature on lingering or “cumulative” effects of multiple concussions is mixed. The purpose of this study was to examine whether athletes with a history of three or more concussions perform more poorly on neuropsychological testing or report more subjective symptoms during a baseline, preseason evaluation. Hypothesis. Athletes reporting three or more past concussions would perform more poorly on preseason neurocognitive testing. Study Design. Case-control study. Methods. An archival database including 786 male athletes who underwent preseason testing with a computerized battery (ImPACT) was used to select the participants. Twenty-six athletes, between the ages of 17 and 22 with a history of three or more concussions, were identified. Athletes with no history of concussion were matched, in a case-control fashion, on age, education, self-reported ADHD, school, sport, and, when possible, playing position and self-reported academic problems. Results. The two groups were compared on the four neuropsychological composite scores from ImPACT using multivariate analysis of variance followed by univariate ANOVAs. MANOVA revealed no overall significant effect. Exploratory ANOVAs were conducted using Verbal Memory, Visual Memory, Reaction Time, Processing Speed, and Postconcussion Scale composite scores as dependent variables. There was a significant effect for only the Verbal Memory composite. Conclusions. Although inconclusive, the results suggest that some athletes with multiple concussions could have lingering memory deficits.
Sport-related concussions result in temporary neurocognitive deficits and subjectively experienced physical, emotional, and cognitive symptoms in the initial hours, days, and sometimes weeks after injury [1–17]. In group studies, athletes tend to recover in terms of perceived symptoms and neuropsychological test performance within 2–28 days, with most studies suggesting recovery occurs in 5–10 days [7, 10, 13, 15–17]. There is some evidence suggesting that high school athletes might recover more slowly than university or professional athletes [18–21].
Athletes with prior concussions are at statistically increased risk for a future concussion [22–25]. Even more concerning is whether athletes with previous concussions are at risk for long-term damage to the structure and/or function of their brains. Numerous studies have been published employing cross-sectional methodologies in an attempt to determine whether groups of previously concussed athletes appear to have lingering effects detectable using symptom rating scales, neuropsychological testing, and electrophysiology. Literature on this subject is somewhat mixed, partly due to methodological differences and limitations across studies. Moreover, some aspects of the research designs and data analyses vary considerably across studies, and many researchers have not consistently reported effect sizes. Sample size is usually the limitation because the accrual of multiply concussed athletes is slow. For example, several published studies have sample sizes of multiply concussed athletes of fewer than 20 (e.g., [26–31]). Other studies do not define the injury severity characteristics of prior concussions (e.g., [9, 27, 32–40]) or when the prior concussions occurred (e.g., [9, 22, 27, 28, 30, 32, 34–38]). Most studies rely on a cross-sectional methodology of examining small [28, 29, 34, 41] or large [2, 22, 27, 32, 35, 38–40, 42] groups of athletes during baseline preseason testing. Some studies, however, have followed multiply concussed athletes prospectively [2, 22, 29, 32–34, 38, 43, 44].
Despite the methodological challenges associated with this area of research, there is an accumulation of evidence that some athletes with a history of multiple concussions might have lingering, long-lasting adverse effects. In a large scale NCAA study, Collins and colleagues  reported that athletes with a history of two or more concussions (i.e., 2–10) reported more symptoms and performed more poorly on two neuropsychological tests than athletes with no concussion history. Other studies have reported that athletes with a history of three or more concussions have changes in electrophysiology, [28, 31, 40] subjective symptoms, [28, 34] and neuropsychological test performance . One large study involving jockeys () reported that those with two or more previous concussions did not report more subjective symptoms or perform more poorly on neuropsychological testing than those with no previous concussion. When comparing jockeys with a history of one prior concussion to those with two or more prior concussions, those with more injuries performed more poorly on a single neuropsychological test (Stroop Color-Word Test) . Stephens et al.  administered a battery of neuropsychological tests to a group of athletes and found that those with previous concussions performed more poorly on a test of attention and a visual memory test. In contrast, some large-scale studies have not found differences in neurocognitive functioning in multiply concussed athletes [27, 32, 45].
Due to concerns that the mixed results observed in the literature are due to differences in the type of neuropsychological tests employed, Bruce and Echemendia  investigated the relationship between self-reported history of concussion and neuropsychological test performance in a large multisport sample of college athletes using three testing approaches: (1) performance on a computerized neuropsychological test battery (ImPACT), (2) performance on traditional paper-pencil neurocognitive tests, and (3) the relationship between concussion history and performance on both traditional neuropsychological tests and computerized neuropsychological tests. None of the approaches yielded statistically significant relationship between history of multiple concussion and neurocognitive deficits. Finally, evaluations of mechanisms of cumulative subconcussive impacts have not shown a definitive link between repeated impacts such as exposure to heading a soccer ball [42, 47] or impact biomechanics in football to concussion . Thus, recent studies have not clearly demonstrated whether a lingering effect of three or more previous concussions can be reliably detected. Moreover, given that most research designs are cross-sectional (not prospective), statements about causation must be made cautiously.
Given the contradictory findings, more research is needed. The purpose of this study was to examine whether athletes with a history of three or more concussions perform more poorly on neuropsychological testing, or report more subjective symptoms, during a baseline, preseason evaluation. A precise matching of athletes on numerous variables, in a case-control fashion, was used to improve the methodological rigor of the study.
An archival database including 786 male athletes who underwent preseason testing with a computerized battery (ImPACT) was used to select the participants. Twenty-six athletes, between the ages of 17 and 22 (mean age = 19.7, SD = 1.4), with a self-reported history of three or more concussions, were identified (16 sustained three previous concussions, six four previous concussions, two five previous concussions, one six previous concussions, and one ten previous concussions). Athletes with no self-reported history of concussion were precisely matched, in a case-control fashion, on age (, SD = 1.4; , ; each person matched within 6–12 months of age) and education (, SD = 1.1; , ; each person matched within one year of education). Athletes with no previous history of concussion were precisely matched on self-reported ADHD (two subjects in each group). Matching was also attempted with self-reported learning problems (two subjects in the three or more concussions group and one subject in the no concussion group), the need for “special education” (one subject in the three or more concussions group and no subjects in the no concussion group), and repeated grades (three subjects in the three or more concussions group and two subjects in the no concussion group).
In addition to matching the above demographic and academic information, we also sought to match the participants on athletic variables. With the exception of one lacrosse player who was matched to a baseball player in the three or more group, we matched each of the athletes on the sport that they played (e.g., football, 30.8%; soccer, 23.1%; ice hockey, 15.4%; lacrosse, 15.4%; wrestling, 7.7%; and water polo, 3%). When possible, position played (e.g., forward in ice hockey, linebacker in football, goalkeeper in soccer, and weight class in wrestling) and school attended or the organization that they identified was also matched to controls.
ImPACT is a brief computer-administered neuropsychological test battery that consists of six individual test modules that measure aspects of cognitive functioning including attention, memory, reaction time, and processing speed. Each module contributes to the calculation of four composite scores, Verbal Memory, Visual Memory, Reaction Time, and Processing Speed.(i)The Verbal Memory composite score represents the average percent correct for a word recognition paradigm, a symbol number match task, and a letter memory task with an accompanying interference task. These tests are conceptually similar to traditional verbal learning (word list) tasks and the auditory consonant trigrams test (i.e., the Brown-Peterson short-term memory paradigm), although the information is presented visually on the computer, not verbally by an examiner.(ii)The Visual Memory composite score is comprised of the average percent correct scores for two tasks; a recognition memory task that requires the discrimination of a series of abstract line drawings, and a memory task that requires the identification of a series of illuminated X’s or O’s after an intervening task (mouse clicking a number sequence from 25 to one). The first test taps immediate and delayed memory for visual designs and the second test measures short-term spatial memory (with an interference task).(iii)The Reaction Time composite score represents the average response time (in milliseconds) on a choice reaction time, a go/no-go task, and the previously mentioned symbol match task (which is similar to a traditional digit symbol task).(iv)The Processing Speed composite represents the weighted average of three tasks that are done as interference tasks for the memory paradigms.
In addition to the cognitive measures, ImPACT also contains a Postconcussion Symptom Scale that consists of 21 commonly reported symptoms (e.g., headache, dizziness, “fogginess”). The dependent measure is the total score derived from this 21-item scale.
The reliability [49–52] and validity [26, 53, 54] of the cognitive composite scores and the Postconcussion Symptom Scale [55–57], and the sensitivity of the battery to the acute effects of concussion [14, 15, 50, 58–62] have been examined in a number of studies. In three studies, the test-retest reliability of ImPACT over brief [49, 50] and long  retest intervals was considered adequate, and in one study stability was poor . In regards to concurrent validity, the ImPACT composites measuring speed and reaction time showed medium correlations with the Symbol Digit Modalities Test, Trails B, and Digit Symbol [26, 53, 54], and the memory composites showed medium to large correlations with the Brief Visuospatial Memory Test [26, 53, 54].
The athletes with previous concussions and the control subjects were compared on the four neuropsychological composite scores from ImPACT using multivariate analysis of variance (MANOVA) followed by univariate ANOVAs. Box’s Test was nonsignificant (), indicating that the covariance matrices were similar across the dependent variables. Levene’s test was nonsignificant for all four composite scores, indicating that the assumption of homogeneity of variance was not violated. Across the two groups, however, there were some departures from normality on individual composite scores as assessed by the Kolmogorov-Smirnoff procedure. MANOVA and ANOVA tend to be quite robust to these violations of underlying general linear model assumptions. MANOVA, with the four cognitive composite scores as dependent variables and group membership as an independent variable, revealed no overall significant effect (F(4, 47) = 1.6, , observed power = .46). The power for this analysis was low, increasing the risk for a type II statistical error. Therefore, exploratory one-way analyses of variance were conducted using Verbal Memory, Visual Memory, Reaction Time, Processing Speed, and Postconcussion Symptom composite scores as dependent variables and group membership as the independent variable. There was a significant effect for only the Verbal Memory composite (, Cohen’s , medium effect size). The Visual Memory and Postconcussion Symptom composite scores were both not significant in the one-way analyses ( and , resp.), although there were small-medium effect sizes for both ( and , resp.). Performances on the Processing Speed and Reaction Time composites were very similar between groups. A summary of the athletes’ performance on ImPACT, including age-adjusted percentile rank normative scores, is presented in Table 1.
|Note: SD: standard deviation. “Percentile ranks” refer to the age adjusted percentile ranks for each raw score from the ImPACT normative data. By convention, Cohen’s effects sizes are interpreted as follows: small: 0.2, medium: 0.5, and large: 0.8.|
The results of this study were provocative but not persuasive. There was modest evidence that athletes with multiple concussions could have a lingering deficit in memory. Athletes with three or more previous concussions performed more poorly on the Verbal Memory composite score (Cohen’s , medium effect) than athletes with fewer concussions. In a previous study, Iverson and colleagues reported a nonsignificant trend for athletes with three or more concussions to have worse preseason memory performance on ImPACT than those with no previous concussions (Cohen’s , medium effect size), and recently concussed athletes with a history of multiple concussions had significantly greater decrements on the memory composite compared to concussed athletes with no injury history . The present study, like several previous studies, is underpowered, which might explain why the medium effect sizes for Visual Memory and the total score from the Postconcussion Scale were not significant.
The literature to date regarding cumulative effects is not definitive. Some researchers have reported that groups of athletes with a history of multiple concussions perform more poorly on neuropsychological testing compared to those with fewer or no concussions [2, 39], whereas others have not [27, 31, 32]. Some researchers have reported that athletes with a history of multiple concussions report more subjective symptoms during preseason testing [2, 28, 34, 45], whereas others have not . In the previously discussed large-scale study with jockeys, Wall and colleagues  emphasized that those individuals with two or more concussions versus a single past concussion performed more poorly on the Stroop Color-Word test, suggesting that “multiple concussions may interfere with executive skills, including response initiation/inhibition, divided attention, and concentration” (page 519). However, there was no significant difference between jockeys who were multiply concussed and those who were never concussed on the Stroop test (). Moreover, the jockeys with one or more past concussions actually performed significantly better on a test of attention and processing speed (digit symbol-coding) than jockeys with no previous concussions (, small effect size). Therefore, although the authors emphasized the possibility of an adverse lingering neurocognitive effect of multiple concussions, the results from that study could be interpreted as equivocal.
In the previous large-scale NCAA football study, Collins and colleagues  reported that “a history of concussion is significantly and independently associated with long-term deficits in the domains of executive functioning and speed of information processing” (page 968). Indeed, those players with a history of two or more concussions performed more poorly on Trails B () and the Symbol Digit Modalities Test (). These findings appear to support their conclusion regarding long-term deficits. However, it is interesting to note that players with one previous concussion performed significantly better than players with no previous concussions on Digit Span (; , small effect), Symbol Digit Modalities Test (, ), Trails A (, ), and Trails B (, ). The effect sizes, however, were very small. Nonetheless, a trend toward better neuropsychological performance in those with a history of concussion is difficult to understand and reconcile.
Belanger and colleagues  conducted a meta-analysis of the literature on lingering effects of multiple concussions. Eight studies met inclusion criteria, contributing 614 cases of multiple concussions and 926 control cases of a single concussion. There was no significant overall effect of multiple concussions on symptom reporting or neuropsychological test performance. However, using specific cognitive domains as a moderator, they reported that worse performance in both executive functions (; small effect) and delayed memory (; small effect) was associated with multiple concussions. As noted in the Introduction, there are numerous and important methodological differences and limitations in this literature. There is considerable heterogeneity in sample sizes, outcome measures, research design, and data analyses. These methodological differences and limitations make the literature challenging to interpret and to compare. Nonetheless, the lack of convergent evidence across studies and the meta-analysis suggests that lingering neurocognitive difficulties (a) are difficult to detect with standard neuropsychological testing and/or (b) might be present in only a subset of athletes and are thus obscured in group analyses.
The present study, unfortunately, is not immune to some of those same limitations. First, the relatively small sample sizes decreased the statistical power of the study. Small sample sizes of multiply concussed athletes have been a common methodological limitation in previous studies (e.g., [27–31, 34]). This limitation is difficult to overcome because of the difficulty identifying a large cohort of multiply concussed athletes. From a database of 786 subjects, we were able to extract only 26 with history of three or more injuries. Second, we were unable to define the severity of prior concussions. This limitation also is common in the literature (e.g., [9, 27, 32–39]). Third, we were unable to determine when the prior concussions occurred. This limitation, too, is common in the literature (e.g., [9, 22, 27, 28, 30, 32, 34–38]). Lastly, similar to past studies [2, 22, 27–29, 32, 34, 35, 38, 39, 41], we utilized a cross-sectional methodology (not longitudinal). Thus, clear causal inferences cannot be made.
Despite these aforementioned limitations, this study used a careful matching methodology. The rigor of this matching process minimized the likelihood that any differences found in neurocognitive performance are attributable to extraneous factors, such as age, education, self-reported ADHD, academic, or learning problems; sport; position played, and school or organization. Of course, more research is needed to better understand the extent to which there are lingering effects of multiple concussions, how the field best measures those effects, and how we use this information when making decisions regarding athletes’ return to play.
Drs. G. Iverson and R. Echemendia have been reimbursed by the government, professional scientific bodies, and commercial organizations for discussing or presenting research relating to MTBI and sport-related concussion at meetings, scientific conferences, and symposiums. Dr. G. Iverson has received past research funding from ImPACT Applications, Inc. The developers or publishers of ImPACT did not provide funding for, nor influence the conduct of, this study.
- W. B. Barr and M. McCrea, “Sensitivity and specificity of standardized neurocognitive testing immediately following sports concussion,” Journal of the International Neuropsychological Society, vol. 7, no. 6, pp. 693–702, 2001.
- M. W. Collins, S. H. Grindel, M. R. Lovell et al., “Relationship between concussion and neuropsychological performance in college football players,” Journal of the American Medical Association, vol. 282, no. 10, pp. 964–970, 1999.
- J. S. Delaney, V. J. Lacroix, C. Gagne, and J. Antoniou, “Concussions among university football and soccer players: a pilot study,” Clinical Journal of Sport Medicine, vol. 11, no. 4, pp. 234–240, 2001.
- D. Erlanger, D. Feldman, K. Kutner et al., “Development and validation of a web-based neuropsychological test protocol for sports-related return-to-play decision-making,” Archives of Clinical Neuropsychology, vol. 18, no. 3, pp. 293–316, 2003.
- D. Erlanger, E. Saliba, J. Barth, J. Almquist, W. Webright, and J. Freeman, “Monitoring resolution of postconcussion symptoms in athletes: preliminary results of a web-based neuropsychological test protocol,” Journal of Athletic Training, vol. 36, no. 3, pp. 280–287, 2001.
- K. M. Guskiewicz, S. E. Ross, and S. W. Marshall, “Postural stability and neuropsychological deficits after concussion in collegiate athletes,” Journal of Athletic Training, vol. 36, no. 3, pp. 263–273, 2001.
- S. N. Macciocchi, J. T. Barth, W. Alves, R. W. Rimel, and J. A. Jane, “Neuropsychological functioning and recovery after mild head injury in collegiate athletes,” Neurosurgery, vol. 39, no. 3, pp. 510–514, 1996.
- M. Makdissi, A. Collie, P. Maruff et al., “Computerised cognitive assessment of concussed Australian rules footballers,” British Journal of Sports Medicine, vol. 35, no. 5, pp. 354–360, 2001.
- J. T. Matser, A. G. H. Kessels, M. D. Lezak, and J. Troost, “A dose-response relation of headers and concussions with cognitive impairment in professional soccer players,” Journal of Clinical and Experimental Neuropsychology, vol. 23, no. 6, pp. 770–774, 2001.
- M. McCrea, J. P. Kelly, C. Randolph, R. Cisler, and L. Berger, “Immediate neurocognitive effects of concussion,” Neurosurgery, vol. 50, no. 5, pp. 1032–1042, 2002.
- D. L. Warden, J. Bleiberg, K. L. Cameron et al., “Persistent prolongation of simple reaction time in sports concussion,” Neurology, vol. 57, no. 3, pp. 524–526, 2001.
- R. J. Echemendia, M. Putukian, R. S. Mackin, L. Julian, and N. Shoss, “Neuropsychological test performance prior to and following sports-related mild traumatic brain injury,” Clinical Journal of Sport Medicine, vol. 11, no. 1, pp. 23–31, 2001.
- J. Bleiberg, A. N. Cernich, K. Cameron et al., “Duration of cognitive impairment after sports concussion,” Neurosurgery, vol. 54, no. 5, pp. 1073–1080, 2004.
- M. R. Lovell, M. W. Collins, G. L. Iverson et al., “Recovery from mild concussion in high school athletes,” Journal of Neurosurgery, vol. 98, no. 2, pp. 296–301, 2003.
- M. R. Lovell, M. W. Collins, G. L. Iverson, K. M. Johnston, and J. P. Bradley, “Grade 1 or “ding” concussions in high school athletes,” American Journal of Sports Medicine, vol. 32, no. 1, pp. 47–54, 2004.
- M. McCrea, K. M. Guskiewicz, S. W. Marshall et al., “Acute effects and recovery time following concussion in collegiate football players: the NCAA Concussion Study,” Journal of the American Medical Association, vol. 290, no. 19, pp. 2556–2563, 2003.
- E. J. Pellman, M. R. Lovell, D. C. Viano, I. R. Casson, and A. M. Tucker, “Concussion in professional football: neuropsychological testing-part 6,” Neurosurgery, vol. 55, no. 6, pp. 1290–1305, 2004.
- M. Field, M. W. Collins, M. R. Lovell, and J. Maroon, “Does age play a role in recovery from sports-related concussion? A comparison of high school and collegiate athletes,” Journal of Pediatrics, vol. 142, no. 5, pp. 546–553, 2003.
- D. A. Lang, G. M. Teasdale, P. Macpherson, and A. Lawrence, “Diffuse brain swelling after head injury: more often malignant in adults than children?” Journal of Neurosurgery, vol. 80, no. 4, pp. 675–680, 1994.
- M. W. Collins, M. R. Lovell, G. L. Iverson, T. Ide, and J. Maroon, “Examining concussion rates and return to play in high school football players wearing newer helmet technology: a three-year prospective cohort study,” Neurosurgery, vol. 58, no. 2, pp. 275–286, 2006.
- E. J. Pellman, M. R. Lovell, D. C. Viano, and I. R. Casson, “Concussion in professional football: recovery of NFL and high school athletes assessed by computerized neuropsychological testing-part 12,” Neurosurgery, vol. 58, no. 2, pp. 263–274, 2006.
- K. M. Guskiewicz, M. McCrea, S. W. Marshall et al., “Cumulative effects associated with recurrent concussion in collegiate football players: the NCAA Concussion Study,” Journal of the American Medical Association, vol. 290, no. 19, pp. 2549–2555, 2003.
- S. G. Gerberich, J. D. Priest, J. R. Boen, C. P. Straub, and R. E. Maxwell, “Concussion incidences and severity in secondary school varsity football players,” American Journal of Public Health, vol. 73, no. 12, pp. 1370–1375, 1983.
- E. D. Zemper, “Two-year prospective study of relative risk of a second cerebral concussion,” American Journal of Physical Medicine and Rehabilitation, vol. 82, no. 9, pp. 653–659, 2003.
- J. S. Delaney, V. J. Lacroix, S. Leclerc, and K. M. Johnston, “Concussions during the 1997 Canadian Football League season,” Clinical Journal of Sport Medicine, vol. 10, no. 1, pp. 9–14, 2000.
- G. L. Iverson, M. D. Franzen, M. R. Lovell, and M. W. Collins, “Construct validity of ImPACT in athletes with concussions,” Archives of Clinical Neuropsychology, vol. 19, no. 7, pp. 961–962, 2004.
- S. P. Broglio, M. S. Ferrara, S. G. Piland, and R. B. Anderson, “Concussion history is not a predictor of computerised neurocognitive performance,” British Journal of Sports Medicine, vol. 40, no. 9, pp. 802–805, 2006.
- M. Gaetz, D. Goodman, and H. Weinberg, “Electrophysiological evidence for the cumulative effects of concussion,” Brain Injury, vol. 14, no. 12, pp. 1077–1088, 2000.
- S. N. Macciocchi, J. T. Barth, L. Littlefield, and R. C. Cantu, “Multiple concussions and neuropsychological functioning in collegiate football players,” Journal of Athletic Training, vol. 36, no. 3, pp. 303–306, 2001.
- R. S. Moser and P. Schatz, “Enduring effects of concussion in youth athletes,” Archives of Clinical Neuropsychology, vol. 17, no. 1, pp. 91–100, 2002.
- L. De Beaumont, B. Brisson, M. Lassonde, and P. Jolicoeur, “Long-term electrophysiological changes in athletes with a history of multiple concussions,” Brain Injury, vol. 21, no. 6, pp. 631–644, 2007.
- A. Collie, P. McCrory, and M. Makdissi, “Does history of concussion affect current cognitive status?” British Journal of Sports Medicine, vol. 40, no. 6, pp. 550–551, 2006.
- M. W. Collins, M. R. Lovell, G. L. Iverson, R. C. Cantu, J. C. Maroon, and M. Field, “Cumulative effects of concussion in high school athletes,” Neurosurgery, vol. 51, no. 5, pp. 1175–1181, 2002.
- G. L. Iverson, M. Gaetz, M. R. Lovell, and M. W. Collins, “Cumulative effects of concussion in amateur athletes,” Brain Injury, vol. 18, no. 5, pp. 433–443, 2004.
- G. L. Iverson, B. L. Brooks, M. R. Lovell, and M. W. Collins, “No cumulative effects for one or two previous concussions,” British Journal of Sports Medicine, vol. 40, no. 1, pp. 72–75, 2006.
- E. J. T. Matser, A. G. Kessels, M. D. Lezak, B. D. Jordan, and J. Troost, “Neuropsychological impairment in amateur soccer players,” Journal of the American Medical Association, vol. 282, no. 10, pp. 971–973, 1999.
- E. J. T. Matser, A. G. H. Kessels, B. D. Jordan, M. D. Lezak, and J. Troost, “Chronic traumatic brain injury in professional soccer players,” Neurology, vol. 51, no. 3, pp. 791–796, 1998.
- R. S. Moser, P. Schatz, and B. D. Jordan, “Prolonged effects of concussion in high school athletes,” Neurosurgery, vol. 57, no. 2, pp. 300–306, 2005.
- S. E. Wall, W. H. Williams, S. Cartwright-Hatton et al., “Neuropsychological dysfunction following repeat concussions in jockeys,” Journal of Neurology, Neurosurgery and Psychiatry, vol. 77, no. 4, pp. 518–520, 2006.
- M. Theriault, L. De Beaumont, S. Tremblay, M. Lassonde, and P. Jolicoeur, “Cumulative effects of concussions in athletes revealed by electrophysiological abnormalities on visual working memory,” Journal of Clinical and Experimental Neuropsychology, vol. 33, no. 1, pp. 30–41, 2011.
- C. Killam, R. L. Cautin, and A. C. Santucci, “Assessing the enduring residual neuropsychological effects of head trauma in college athletes who participate in contact sports,” Archives of Clinical Neuropsychology, vol. 20, no. 5, pp. 599–611, 2005.
- R. Stephens, A. Rutherford, D. Potter, and G. Fernie, “Neuropsychological consequence of soccer play in adolescent U.K. school team soccer players,” Journal of Neuropsychiatry and Clinical Neurosciences, vol. 22, no. 3, pp. 295–303, 2010.
- E. J. Pellman, D. C. Viano, I. R. Casson et al., “Concussion in professional football: repeat injuries—part 4,” Neurosurgery, vol. 55, no. 4, pp. 860–876, 2004.
- S. Slobounov, C. Cao, and W. Sebastianelli, “Differential effect of first versus second concussive episodes on wavelet information quality of EEG,” Clinical Neurophysiology, vol. 120, no. 5, pp. 862–867, 2009.
- A. E. Thornton, D. N. Cox, K. Whitfield, and R. T. Fouladi, “Cumulative concussion exposure in rugby players: neurocognitive and symptomatic outcomes,” Journal of Clinical and Experimental Neuropsychology, vol. 30, no. 4, pp. 398–409, 2008.
- J. M. Bruce and R. J. Echemendia, “History of multiple self-reported concussions is not associated with reduced cognitive abilities,” Neurosurgery, vol. 64, no. 1, pp. 100–106, 2009.
- C. Rieder and P. Jansen, “No neuropsychological consequence in male and female soccer players after a short heading training,” Archives of Clinical Neuropsychology, vol. 26, no. 7, pp. 583–591, 2011.
- S. P. Broglio, J. T. Eckner, T. Surma, and J. S. Kutcher, “Post-concussion cognitive declines and symptomatology are not related to concussion biomechanics in high school football players,” Journal of Neurotrauma, vol. 28, no. 10, pp. 2061–2068, 2011.
- G. L. Iverson, M. R. Lovell, M. W. Collins, and J. Norwig, “Tracking recovery from concussion using ImPACT: applying reliable change methodology,” Archives of Clinical Neuropsychology, vol. 17, p. 770, 2002.
- G. L. Iverson, M. R. Lovell, and M. W. Collins, “Interpreting change on ImPACT following sport concussion,” The Clinical Neuropsychologist, vol. 17, no. 4, pp. 460–467, 2003.
- S. P. Broglio, M. S. Ferrara, S. N. Macciocchi, T. A. Baumgartner, and R. Elliott, “Test-retest reliability of computerized concussion assessment programs,” Journal of Athletic Training, vol. 42, no. 4, pp. 509–514, 2007.
- P. Schatz, “Long-term test-retest reliability of baseline cognitive assessments using ImPACT,” American Journal of Sports Medicine, vol. 38, no. 1, pp. 47–53, 2010.
- G. L. Iverson, M. R. Lovell, and M. W. Collins, “Validity of ImPACT for measuring processing speed following sports-related concussion,” Journal of Clinical and Experimental Neuropsychology, vol. 27, no. 6, pp. 683–689, 2005.
- P. Schatz and B. O. Putz, “Cross-validation of measures used for computer-based assessment of concussion,” Applied Neuropsychology, vol. 13, no. 3, pp. 151–159, 2006.
- G. L. Iverson and M. Gaetz, “Practical considerations for interpreting change following concussion,” in Traumatic Brain Injury in Sports: An International Neuropsychological Perspective, M. R. Lovell, J. Barth, M. Collins, and R. Echemendia, Eds., pp. 323–356, Swets & Zeitlinger Publishers, Heereweg, Netherlands, 2004.
- M. R. Lovell, G. L. Iverson, M. W. Collins et al., “Measurement of symptoms following sports-related concussion: reliability and normative data for the post-concussion scale,” Applied Neuropsychology, vol. 13, no. 3, pp. 166–174, 2006.
- J. A. Janusz, G. A. Gioia, K. Gilstein, and G. L. Iverson, “Construct validity of the ImPACT post-concussion scale in children,” British Journal of Sports Medicine, vol. 38, p. 659, 2004.
- G. L. Iverson, M. Gaetz, M. R. Lovell, and M. W. Collins, “Relation between fogginess and outcome following concussion,” Archives of Clinical Neuropsychology, vol. 17, no. 8, pp. 769–770, 2002.
- M. W. Collins, G. L. Iverson, M. R. Lovell, D. B. McKeag, J. Norwig, and J. Maroon, “On-field predictors of neuropsychological and symptom deficit following sports-related concussion,” Clinical Journal of Sport Medicine, vol. 13, no. 4, pp. 222–229, 2003.
- P. Schatz, J. E. Pardini, M. R. Lovell, M. W. Collins, and K. Podell, “Sensitivity and specificity of the ImPACT test battery for concussion in athletes,” Archives of Clinical Neuropsychology, vol. 21, no. 1, pp. 91–99, 2006.
- S. P. Broglio, S. N. Macciocchi, and M. S. Ferrara, “Neurocognitive performance of concussed athletes when symptom free,” Journal of Athletic Training, vol. 42, no. 4, pp. 504–508, 2007.
- V. C. Fazio, M. R. Lovell, J. E. Pardini, and M. W. Collins, “The relation between post concussion symptoms and neurocognitive performance in concussed athletes,” NeuroRehabilitation, vol. 22, no. 3, pp. 207–216, 2007.
- H. G. Belanger, E. Spiegel, and R. D. Vanderploeg, “Neuropsychological performance following a history of multiple self-reported concussions: as meta-analysis,” Journal of the International Neuropsychological Society, vol. 16, no. 2, pp. 262–267, 2010.
Copyright © 2012 Grant L. Iverson et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.