Philip Schatz1. 1. Department of Psychology, Saint Joseph's University, 222 Post Hall, 5600 City Avenue, Philadelphia, PA 19131, USA. pschatz@sju.edu
Abstract
BACKGROUND: Computer-based assessment programs are commonly used to document baseline cognitive performance for comparison with postconcussion testing. There are currently no guidelines for how often baseline assessments should be updated, and no data documenting the test-retest stability of baseline measures over relevant time periods. PURPOSE: To establish long-term test-retest reliability of baseline assessments using ImPACT, and to compare various statistical methods for establishing test-retest reliability. STUDY DESIGN: Case series; Level of evidence, 4. METHODS: Participants were 95 collegiate varsity athletes completing baseline cognitive testing at 2 time periods, approximately 2 years apart. No participant sustained a concussion between assessments. All athletes completed the ImPACT test battery; dependent measures were the composite scores and total symptom scale score. RESULTS: Intraclass correlation coefficient estimates for visual memory (.65), processing speed (.74), and reaction time (.68) composite scores reflected stability over the 2-year period, with greater variability in verbal memory (.46) and symptom scale (.43) scores. Using reliable change indices and regression-based methods, only a small percentage of participants' scores showed "reliable" or "significant" change on the composite scores (0%-6%), or symptom scale scores (5%-10%). CONCLUSION: The current results suggest that college athletes' cognitive performance at baseline remains considerably stable over a 2-year period. These data help establish the effects of longer, clinically pragmatic testing intervals on test-retest reliability. CLINICAL IMPLICATIONS: The current results suggest that stretching the time between baseline assessments from 1 to 2 years may have little effect on the clinical management of concussions in collegiate athletes. These results should not be generalized to collegiate football players, who were not included in this sample. Youth athletes (high school and younger) should continue to receive annually updated baseline assessments until prospective study of the stability of baseline assessments for this younger age group can be completed.
BACKGROUND: Computer-based assessment programs are commonly used to document baseline cognitive performance for comparison with postconcussion testing. There are currently no guidelines for how often baseline assessments should be updated, and no data documenting the test-retest stability of baseline measures over relevant time periods. PURPOSE: To establish long-term test-retest reliability of baseline assessments using ImPACT, and to compare various statistical methods for establishing test-retest reliability. STUDY DESIGN: Case series; Level of evidence, 4. METHODS:Participants were 95 collegiate varsity athletes completing baseline cognitive testing at 2 time periods, approximately 2 years apart. No participant sustained a concussion between assessments. All athletes completed the ImPACT test battery; dependent measures were the composite scores and total symptom scale score. RESULTS: Intraclass correlation coefficient estimates for visual memory (.65), processing speed (.74), and reaction time (.68) composite scores reflected stability over the 2-year period, with greater variability in verbal memory (.46) and symptom scale (.43) scores. Using reliable change indices and regression-based methods, only a small percentage of participants' scores showed "reliable" or "significant" change on the composite scores (0%-6%), or symptom scale scores (5%-10%). CONCLUSION: The current results suggest that college athletes' cognitive performance at baseline remains considerably stable over a 2-year period. These data help establish the effects of longer, clinically pragmatic testing intervals on test-retest reliability. CLINICAL IMPLICATIONS: The current results suggest that stretching the time between baseline assessments from 1 to 2 years may have little effect on the clinical management of concussions in collegiate athletes. These results should not be generalized to collegiate football players, who were not included in this sample. Youth athletes (high school and younger) should continue to receive annually updated baseline assessments until prospective study of the stability of baseline assessments for this younger age group can be completed.
Authors: William T Tsushima; Andrea M Siu; Annina M Pearce; Guangxiang Zhang; Ross S Oshiro Journal: Arch Clin Neuropsychol Date: 2015-11-15 Impact factor: 2.813
Authors: Philip Schatz; Rosemarie Scolaro Moser; Gary S Solomon; Summer D Ott; Robin Karpf Journal: J Athl Train Date: 2012 May-Jun Impact factor: 2.860
Authors: K M Galetta; J Barrett; M Allen; F Madda; D Delicata; A T Tennant; C C Branas; M G Maguire; L V Messner; S Devick; S L Galetta; L J Balcer Journal: Neurology Date: 2011-02-02 Impact factor: 9.910
Authors: Jaclyn B Caccese; Ryan M DeWolf; Thomas W Kaminski; Steven P Broglio; Thomas W McAllister; Michael McCrea; Thomas A Buckley Journal: Sports Med Date: 2019-03 Impact factor: 11.136
Authors: Christopher P Tomczyk; Megan Mormile; Megan S Wittenberg; Jody L Langdon; Tamerah N Hunt Journal: J Athl Train Date: 2018-03-15 Impact factor: 2.860