James L Farnsworth1, Lucas Dargo2, Brian G Ragan3, Minsoo Kang4. 1. School of Education and Exercise Science, Buena Vista University, Storm Lake, IA. 2. Eli Lilly and Company, Indianapolis, IN. 3. Deceased. 4. Middle Tennessee State University, Murfreesboro.
Abstract
OBJECTIVE: Although widely used, computerized neurocognitive tests (CNTs) have been criticized because of low reliability and poor sensitivity. A systematic review was published summarizing the reliability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) scores; however, this was limited to a single CNT. Expansion of the previous review to include additional CNTs and a meta-analysis is needed. Therefore, our purpose was to analyze reliability data for CNTs using meta-analysis and examine moderating factors that may influence reliability. DATA SOURCES: A systematic literature search (key terms: reliability, computerized neurocognitive test, concussion) of electronic databases (MEDLINE, PubMed, Google Scholar, and SPORTDiscus) was conducted to identify relevant studies. STUDY SELECTION: Studies were included if they met all of the following criteria: used a test-retest design, involved at least 1 CNT, provided sufficient statistical data to allow for effect-size calculation, and were published in English. DATA EXTRACTION: Two independent reviewers investigated each article to assess inclusion criteria. Eighteen studies involving 2674 participants were retained. Intraclass correlation coefficients were extracted to calculate effect sizes and determine overall reliability. The Fisher Z transformation adjusted for sampling error associated with averaging correlations. Moderator analyses were conducted to evaluate the effects of the length of the test-retest interval, intraclass correlation coefficient model selection, participant demographics, and study design on reliability. Heterogeneity was evaluated using the Cochran Q statistic. DATA SYNTHESIS: The proportion of acceptable outcomes was greatest for the Axon Sports CogState Test (75%) and lowest for the ImPACT (25%). Moderator analyses indicated that the type of intraclass correlation coefficient model used significantly influenced effect-size estimates, accounting for 17% of the variation in reliability. CONCLUSIONS: The Axon Sports CogState Test, which has a higher proportion of acceptable outcomes and shorter test duration relative to other CNTs, may be a reliable option; however, future studies are needed to compare the diagnostic accuracy of these instruments.
OBJECTIVE: Although widely used, computerized neurocognitive tests (CNTs) have been criticized because of low reliability and poor sensitivity. A systematic review was published summarizing the reliability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) scores; however, this was limited to a single CNT. Expansion of the previous review to include additional CNTs and a meta-analysis is needed. Therefore, our purpose was to analyze reliability data for CNTs using meta-analysis and examine moderating factors that may influence reliability. DATA SOURCES: A systematic literature search (key terms: reliability, computerized neurocognitive test, concussion) of electronic databases (MEDLINE, PubMed, Google Scholar, and SPORTDiscus) was conducted to identify relevant studies. STUDY SELECTION: Studies were included if they met all of the following criteria: used a test-retest design, involved at least 1 CNT, provided sufficient statistical data to allow for effect-size calculation, and were published in English. DATA EXTRACTION: Two independent reviewers investigated each article to assess inclusion criteria. Eighteen studies involving 2674 participants were retained. Intraclass correlation coefficients were extracted to calculate effect sizes and determine overall reliability. The Fisher Z transformation adjusted for sampling error associated with averaging correlations. Moderator analyses were conducted to evaluate the effects of the length of the test-retest interval, intraclass correlation coefficient model selection, participant demographics, and study design on reliability. Heterogeneity was evaluated using the Cochran Q statistic. DATA SYNTHESIS: The proportion of acceptable outcomes was greatest for the Axon Sports CogState Test (75%) and lowest for the ImPACT (25%). Moderator analyses indicated that the type of intraclass correlation coefficient model used significantly influenced effect-size estimates, accounting for 17% of the variation in reliability. CONCLUSIONS: The Axon Sports CogState Test, which has a higher proportion of acceptable outcomes and shorter test duration relative to other CNTs, may be a reliable option; however, future studies are needed to compare the diagnostic accuracy of these instruments.
Entities:
Keywords:
cognitive function; head injuries; test-retest design; traumatic brain injuries
Authors: Lindsay D Nelson; Ashley A LaRoche; Adam Y Pfaller; E Brooke Lerner; Thomas A Hammeke; Christopher Randolph; William B Barr; Kevin Guskiewicz; Michael A McCrea Journal: J Int Neuropsychol Soc Date: 2016-01 Impact factor: 2.892
Authors: Steven P Broglio; Michael S Ferrara; Stephen N Macciocchi; Ted A Baumgartner; Ronald Elliott Journal: J Athl Train Date: 2007 Oct-Dec Impact factor: 2.860
Authors: Kristin Wilmoth; Benjamin L Brett; Natalie A Emmert; Carolyn M Cook; Jeffrey Schaffert; Todd Caze; Thomas Kotsonis; Margaret Cusick; Gary Solomon; Jacob E Resch; C Munro Cullum; Lindsay D Nelson; Michael McCrea Journal: Neuropsychol Rev Date: 2022-08-30 Impact factor: 6.940
Authors: Alexander Lithopoulos; Mark Bayley; Dorothyann Curran; Lisa Fischer; Christopher Knee; Julia Lauzon; Margaret Nevison; Diana Velikonja; Shawn Marshall Journal: BMJ Open Date: 2022-07-14 Impact factor: 3.006
Authors: April L McPherson; Matthew B Shirley; Nathan D Schilaty; Dirk R Larson; Timothy E Hewett Journal: Sports Med Date: 2020-06 Impact factor: 11.136
Authors: Heather A Shepherd; Cody R van Rassel; Amanda M Black; Robert F Graham; Keith Owen Yeates; Carolyn A Emery; Kathryn J Schneider Journal: Int J Sports Phys Ther Date: 2022-04-01
Authors: Johna K Register-Mihalik; Kevin M Guskiewicz; Stephen W Marshall; Karen L McCulloch; Jason P Mihalik; Martin Mrazik; Ian Murphy; Dhiren Naidu; Shabbar I Ranapurwala; Kathryn Schneider; Paula Gildner; Michael McCrea Journal: Front Neurol Date: 2019-11-08 Impact factor: 4.003