G W Fuller1, S P T Kemp2, M Raftery3. 1. Emergency Medicine Research in Sheffield Group, School of Health and Related Research, University of Sheffield, UK. Electronic address: g.fuller@sheffield.ac.uk. 2. Rugby Football Union, Rugby House, Twickenham Stadium, UK. 3. World Rugby, World Rugby House, Ireland.
Abstract
OBJECTIVES: To investigate the accuracy and reliability of side-line video review of head impact events to aid identification of concussion in elite sport. DESIGN: Diagnostic accuracy and inter-rater agreement study. METHODS: Immediate care, match day and team doctors involved in the 2015 Rugby Union World Cup viewed 20 video clips showing broadcaster's footage of head impact events occurring during elite Rugby matches. Subjects subsequently recorded whether any criteria warranting permanent removal from play or medical room head injury assessment were present. The accuracy of these ratings were compared to consensus expert opinion by calculating mean sensitivity and specificity across raters. The reproducibility of doctor's decisions was additionally assessed using raw agreement and Gwets AC1 chance corrected agreement coefficient. RESULTS: Forty rugby medicine doctors were included in the study. Compared to the expert reference standard overall sensitivity and specificity of doctors decisions were 77.5% (95% CI 73.1-81.5%) and 53.3% (95% CI 48.2-58.2%) respectively. Overall there was raw agreement of 67.8% (95% CI 57.9-77.7%) between doctors across all video clips. Chance corrected Gwets AC1 agreement coefficient was 0.39 (95% CI 0.17-0.62), indicating fair agreement. CONCLUSIONS: Rugby World Cup doctors' demonstrated moderate accuracy and fair reproducibility in head injury event decision making when assessing video clips of head impact events. The use of real-time video may improve the identification, decision making and management of concussion in elite sports.
OBJECTIVES: To investigate the accuracy and reliability of side-line video review of head impact events to aid identification of concussion in elite sport. DESIGN: Diagnostic accuracy and inter-rater agreement study. METHODS: Immediate care, match day and team doctors involved in the 2015 Rugby Union World Cup viewed 20 video clips showing broadcaster's footage of head impact events occurring during elite Rugby matches. Subjects subsequently recorded whether any criteria warranting permanent removal from play or medical room head injury assessment were present. The accuracy of these ratings were compared to consensus expert opinion by calculating mean sensitivity and specificity across raters. The reproducibility of doctor's decisions was additionally assessed using raw agreement and Gwets AC1 chance corrected agreement coefficient. RESULTS: Forty rugby medicine doctors were included in the study. Compared to the expert reference standard overall sensitivity and specificity of doctors decisions were 77.5% (95% CI 73.1-81.5%) and 53.3% (95% CI 48.2-58.2%) respectively. Overall there was raw agreement of 67.8% (95% CI 57.9-77.7%) between doctors across all video clips. Chance corrected Gwets AC1 agreement coefficient was 0.39 (95% CI 0.17-0.62), indicating fair agreement. CONCLUSIONS: Rugby World Cup doctors' demonstrated moderate accuracy and fair reproducibility in head injury event decision making when assessing video clips of head impact events. The use of real-time video may improve the identification, decision making and management of concussion in elite sports.
Authors: Jon S Patricios; Clare L Ardern; Michael David Hislop; Mark Aubry; Paul Bloomfield; Carolyn Broderick; Patrick Clifton; Ruben J Echemendia; Richard G Ellenbogen; Éanna Cian Falvey; Gordon Ward Fuller; Julie Grand; Dallas Hack; Peter Rex Harcourt; David Hughes; Nathan McGuirk; Willem Meeuwisse; Jeffrey Miller; John T Parsons; Simona Richiger; Allen Sills; Kevin B Moran; Jenny Shute; Martin Raftery Journal: Br J Sports Med Date: 2018-03-02 Impact factor: 13.800
Authors: Karl A Zimmerman; Etienne Laverse; Ravjeet Samra; Maria Yanez Lopez; Amy E Jolly; Niall J Bourke; Neil S N Graham; Maneesh C Patel; John Hardy; Simon Kemp; Huw R Morris; David J Sharp Journal: Brain Commun Date: 2021-07-19