Kristin Wilmoth1, Brooke E Magnus2, Michael A McCrea1, Lindsay D Nelson1. 1. Departments of Neurology and Neurosurgery, Medical College of Wisconsin, Milwaukee, Wisconsin, USA. 2. Department of Psychology and Neuroscience, Boston College, Chestnut Hill, Massachusetts, USA.
Abstract
BACKGROUND: Symptom assessment is a critical component of concussion diagnosis and management, with item selection primarily driven by clinical judgment or expert consensus. We recently demonstrated that concussion symptoms assessed by the Sport Concussion Assessment Tool (SCAT) are essentially unidimensional, implying that overall symptom severity may be accurately estimated with relatively few questions. Briefer, evidence-based forms for symptom assessment would provide clinicians flexibility. PURPOSE: To develop and validate an abbreviated assessment of general concussion symptom severity using item response theory analyses. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: Broad clinical assessments (SCAT3, Immediate Post-concussion and Cognitive Testing, Balance Error Scoring System, and Brief Symptom Inventory-18 Global Severity Index) were completed by 265 injured athletes and 235 matched teammate controls at 24 to 48 hours and 8, 15, and 45 days after concussion. Symptom checklist short forms (3-14 items from the original 22) were selected using item response theory item information curves. Internal consistency reliability (Cronbach alpha), correlation with criterion measures assessed concurrently (ie, acute neurocognitive performance, balance, and emotional symptoms), predictive validity (correlations with symptom duration), and differences between concussed and control groups (Cohen d) were examined across forms. Sensitivity and false-positive rates of the forms were estimated and compared using reliable change indices derived from controls. RESULTS: Across the 3- to 22-item forms, internal consistency was excellent (Cronbach alphas, 0.90-0.94). Clinical correlations were significant (P≤ .017) and to similar degrees for all short forms. Group difference confidence intervals overlapped across forms at 24- to 48-hour (Cohen d, 1.27-1.51) and 8-day follow-up (Cohen d, 0.31-0.44). Sensitivity remained similar across short forms, with a low false-positive rate in controls. CONCLUSION: Our findings suggest that even an ultrashort (3-item) inventory provides sufficiently reliable and valid estimates of overall concussion symptom severity 24 to 48 hours after injury. Future revisions of the SCAT could eliminate inefficient items, although replication in larger samples and extension to other postinjury time points are warranted.
BACKGROUND: Symptom assessment is a critical component of concussion diagnosis and management, with item selection primarily driven by clinical judgment or expert consensus. We recently demonstrated that concussion symptoms assessed by the Sport Concussion Assessment Tool (SCAT) are essentially unidimensional, implying that overall symptom severity may be accurately estimated with relatively few questions. Briefer, evidence-based forms for symptom assessment would provide clinicians flexibility. PURPOSE: To develop and validate an abbreviated assessment of general concussion symptom severity using item response theory analyses. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: Broad clinical assessments (SCAT3, Immediate Post-concussion and Cognitive Testing, Balance Error Scoring System, and Brief Symptom Inventory-18 Global Severity Index) were completed by 265 injured athletes and 235 matched teammate controls at 24 to 48 hours and 8, 15, and 45 days after concussion. Symptom checklist short forms (3-14 items from the original 22) were selected using item response theory item information curves. Internal consistency reliability (Cronbach alpha), correlation with criterion measures assessed concurrently (ie, acute neurocognitive performance, balance, and emotional symptoms), predictive validity (correlations with symptom duration), and differences between concussed and control groups (Cohen d) were examined across forms. Sensitivity and false-positive rates of the forms were estimated and compared using reliable change indices derived from controls. RESULTS: Across the 3- to 22-item forms, internal consistency was excellent (Cronbach alphas, 0.90-0.94). Clinical correlations were significant (P≤ .017) and to similar degrees for all short forms. Group difference confidence intervals overlapped across forms at 24- to 48-hour (Cohen d, 1.27-1.51) and 8-day follow-up (Cohen d, 0.31-0.44). Sensitivity remained similar across short forms, with a low false-positive rate in controls. CONCLUSION: Our findings suggest that even an ultrashort (3-item) inventory provides sufficiently reliable and valid estimates of overall concussion symptom severity 24 to 48 hours after injury. Future revisions of the SCAT could eliminate inefficient items, although replication in larger samples and extension to other postinjury time points are warranted.
Authors: Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde Journal: J Biomed Inform Date: 2008-09-30 Impact factor: 6.317
Authors: Aisha S Joyce; Cynthia R Labella; Rebecca L Carl; Jin-Shei Lai; Frank A Zelko Journal: Med Sci Sports Exerc Date: 2015-06 Impact factor: 5.411
Authors: Kevin M Guskiewicz; Johna Register-Mihalik; Paul McCrory; Michael McCrea; Karen Johnston; Michael Makdissi; Jirí Dvorák; Gavin Davis; Willem Meeuwisse Journal: Br J Sports Med Date: 2013-04 Impact factor: 13.800
Authors: Kristy B Arbogast; Allison E Curry; Melissa R Pfeiffer; Mark R Zonfrillo; Juliet Haarbauer-Krupa; Matthew J Breiding; Victor G Coronado; Christina L Master Journal: JAMA Pediatr Date: 2016-07-05 Impact factor: 16.193
Authors: Lindsay D Nelson; Mark D Kramer; Christopher J Patrick; Michael A McCrea Journal: J Int Neuropsychol Soc Date: 2018-08-06 Impact factor: 2.892
Authors: Kristin Wilmoth; Benjamin L Brett; Natalie A Emmert; Carolyn M Cook; Jeffrey Schaffert; Todd Caze; Thomas Kotsonis; Margaret Cusick; Gary Solomon; Jacob E Resch; C Munro Cullum; Lindsay D Nelson; Michael McCrea Journal: Neuropsychol Rev Date: 2022-08-30 Impact factor: 6.940