Lauren L Czerniak1, Spencer W Liebel2, Hannah Zhou3, Gian-Gabriel P Garcia4, Mariel S Lavieri5, Michael A McCrea6, Thomas W McAllister7, Paul F Pasquina8, Steven P Broglio9. 1. Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, USA. czernL@umich.edu. 2. Department of Neurology, University of Utah, Salt Lake City, UT, USA. 3. Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI, USA. 4. H. Milton Stewart School of Industrial and Systems Engineering, Georgia Institute of Technology, Atlanta, GA, USA. 5. Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI, USA. 6. Departments of Neurosurgery and Neurology, Medical College of Wisconsin, Milwaukee, WI, USA. 7. Department of Psychiatry, Indiana University School of Medicine, Indianapolis, IN, USA. 8. Department of Physical Medicine and Rehabilitation, Uniformed Services University of the Health Sciences, Bethesda, MD, USA. 9. Michigan Concussion Center, University of Michigan, Ann Arbor, MI, USA.
Abstract
BACKGROUND AND OBJECTIVE: Computer-based neurocognitive tests are widely used in sport-related concussion management, but the performance of these tests is not well understood in the participant population with attention-deficit/hyperactivity disorder (ADHD) and/or learning disorder (LD). This research estimates the sensitivity and specificity performance of the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) computer-based neurocognitive test in identifying concussion in this population. METHODS: Study participants consisted of collegiate university athletes and military service academy cadets from the National Collegiate Athletic Association-Department of Defense CARE Consortium who completed the ImPACT test between 2014 and 2021. Participants who self-identified as belonging to one of the subgroups of interest (ADHD with or without LD [ADHD:LD+/-], LD with or without ADHD [LD:ADHD+/-], ADHD and/or LD [ADHD a/o LD]) and completed a baseline (1874 ADHD:LD+/-, 779 LD:ADHD+/-, 2338 ADHD a/o LD) or 24-48 h post-concussion (175 ADHD:LD+/-, 77 LD:ADHD+/-, 216 ADHD a/o LD) ImPACT assessment were included. Sensitivity and specificity were calculated using a normative data method and three machine learning classification methods: logistic regression, classification and regression tree, and random forest. RESULTS: Using the four methods, participants with ADHD:LD+/- had sensitivities that ranged from 0.474 to 0.697, and specificities that ranged from 0.538 to 0.686. Participants with LD:ADHD+/- had sensitivities that ranged from 0.455 to 0.688, and specificities that ranged from 0.456 to 0.588. For participants with ADHD a/o LD, sensitivities ranged from 0.542 to 0.755, and specificities ranged from 0.451 to 0.724. CONCLUSIONS: For all subgroups and analytical methods, the results illustrate sensitivity and specificity values below typically accepted levels indicative of clinical utility. These findings support that using ImPACT alone may be insufficient to inform concussion diagnoses and encourages the use of a multi-dimensional concussion assessment.
BACKGROUND AND OBJECTIVE: Computer-based neurocognitive tests are widely used in sport-related concussion management, but the performance of these tests is not well understood in the participant population with attention-deficit/hyperactivity disorder (ADHD) and/or learning disorder (LD). This research estimates the sensitivity and specificity performance of the Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) computer-based neurocognitive test in identifying concussion in this population. METHODS: Study participants consisted of collegiate university athletes and military service academy cadets from the National Collegiate Athletic Association-Department of Defense CARE Consortium who completed the ImPACT test between 2014 and 2021. Participants who self-identified as belonging to one of the subgroups of interest (ADHD with or without LD [ADHD:LD+/-], LD with or without ADHD [LD:ADHD+/-], ADHD and/or LD [ADHD a/o LD]) and completed a baseline (1874 ADHD:LD+/-, 779 LD:ADHD+/-, 2338 ADHD a/o LD) or 24-48 h post-concussion (175 ADHD:LD+/-, 77 LD:ADHD+/-, 216 ADHD a/o LD) ImPACT assessment were included. Sensitivity and specificity were calculated using a normative data method and three machine learning classification methods: logistic regression, classification and regression tree, and random forest. RESULTS: Using the four methods, participants with ADHD:LD+/- had sensitivities that ranged from 0.474 to 0.697, and specificities that ranged from 0.538 to 0.686. Participants with LD:ADHD+/- had sensitivities that ranged from 0.455 to 0.688, and specificities that ranged from 0.456 to 0.588. For participants with ADHD a/o LD, sensitivities ranged from 0.542 to 0.755, and specificities ranged from 0.451 to 0.724. CONCLUSIONS: For all subgroups and analytical methods, the results illustrate sensitivity and specificity values below typically accepted levels indicative of clinical utility. These findings support that using ImPACT alone may be insufficient to inform concussion diagnoses and encourages the use of a multi-dimensional concussion assessment.
Authors: Steven P Broglio; Jaroslaw Harezlak; Barry Katz; Shi Zhao; Thomas McAllister; Michael McCrea Journal: Sports Med Date: 2019-12 Impact factor: 11.136
Authors: Lauren L Czerniak; Spencer W Liebel; Gian-Gabriel P Garcia; Mariel S Lavieri; Michael A McCrea; Thomas W McAllister; Steven P Broglio Journal: Sports Med Date: 2020-12-14 Impact factor: 11.136
Authors: Ruben J Echemendia; Jared M Bruce; Christopher M Bailey; James Forrest Sanders; Peter Arnett; Gray Vargas Journal: Clin Neuropsychol Date: 2012-09-25 Impact factor: 3.535
Authors: Stephen V Faraone; Philip Asherson; Tobias Banaschewski; Joseph Biederman; Jan K Buitelaar; Josep Antoni Ramos-Quiroga; Luis Augusto Rohde; Edmund J S Sonuga-Barke; Rosemary Tannock; Barbara Franke Journal: Nat Rev Dis Primers Date: 2015-08-06 Impact factor: 52.329
Authors: Esther Y Chin; Lindsay D Nelson; William B Barr; Paul McCrory; Michael A McCrea Journal: Am J Sports Med Date: 2016-06-08 Impact factor: 6.202