Behzad Farzin1, Robert Fahed1, Francois Guilbert1, Alexandre Y Poppe1, Nicole Daneault1, André P Durocher1, Sylvain Lanthier1, Hayet Boudjani1, Naim N Khoury1, Daniel Roy1, Alain Weill1, Jean-Christophe Gentric1, André L Batista1, Laurent Létourneau-Guillon1, François Bergeron1, Marc-Antoine Henry1, Tim E Darsaut1, Jean Raymond2. 1. From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada. 2. From the Departments of Radiology (B.F., R.F., F.G., N.N.K., D.R., A.W., J.-C.G., A.L.B., L.L.-G., F.B., M.-A.H., J.R.) and Neurosciences (A.Y.P., N.D., A.P.D., S.L., H.B.), Centre Hospitalier de l'Université de Montréal (CHUM), Notre-Dame Hospital, Montreal; and the Department of Surgery, Division of Neurosurgery (T.E.D.), University of Alberta Hospital, Mackenzie Health Sciences Centre, Edmonton, Canada. jean.raymond@umontreal.ca.
Abstract
OBJECTIVE: To systematically review the literature and assess agreement on the Alberta Stroke Program Early CT Score (ASPECTS) among clinicians involved in the management of thrombectomy candidates. METHODS: Studies assessing agreement using ASPECTS published from 2000 to 2015 were reviewed. Fifteen raters reviewed and scored the anonymized CT scans of 30 patients recruited in a local thrombectomy trial during 2 independent sessions, in order to study intrarater and interrater agreement. Agreement was measured using intraclass correlation coefficients (ICCs) and Fleiss kappa statistics for ASPECTS and dichotomized ASPECTS at various cutoff values. RESULTS: The review yielded 30 articles reporting 40 measures of agreement. Populations, methods, analyses, and results were heterogeneous (slight to excellent agreement), precluding a meta-analysis. When analyzed as a categorical variable, intrarater agreement was slight to moderate (κ = 0.042-0.469); it reached a substantial level (κ > 0.6) in 11/15 raters when the score was dichotomized (0-5 vs 6-10). The interrater ICCs varied between 0.672 and 0.811, but agreement was slight to moderate (κ = 0.129-0.315). Even in the best of cases, when ASPECTS was dichotomized as 0-5 vs 6-10, interrater agreement did not reach a substantial level (κ = 0.561), which translates into at least 5 of 15 raters not giving the same dichotomized verdict in 15% of patients. CONCLUSIONS: In patients considered for thrombectomy, there may be insufficient agreement between clinicians for ASPECTS to be reliably used as a criterion for treatment decisions.
OBJECTIVE: To systematically review the literature and assess agreement on the Alberta Stroke Program Early CT Score (ASPECTS) among clinicians involved in the management of thrombectomy candidates. METHODS: Studies assessing agreement using ASPECTS published from 2000 to 2015 were reviewed. Fifteen raters reviewed and scored the anonymized CT scans of 30 patients recruited in a local thrombectomy trial during 2 independent sessions, in order to study intrarater and interrater agreement. Agreement was measured using intraclass correlation coefficients (ICCs) and Fleiss kappa statistics for ASPECTS and dichotomized ASPECTS at various cutoff values. RESULTS: The review yielded 30 articles reporting 40 measures of agreement. Populations, methods, analyses, and results were heterogeneous (slight to excellent agreement), precluding a meta-analysis. When analyzed as a categorical variable, intrarater agreement was slight to moderate (κ = 0.042-0.469); it reached a substantial level (κ > 0.6) in 11/15 raters when the score was dichotomized (0-5 vs 6-10). The interrater ICCs varied between 0.672 and 0.811, but agreement was slight to moderate (κ = 0.129-0.315). Even in the best of cases, when ASPECTS was dichotomized as 0-5 vs 6-10, interrater agreement did not reach a substantial level (κ = 0.561), which translates into at least 5 of 15 raters not giving the same dichotomized verdict in 15% of patients. CONCLUSIONS: In patients considered for thrombectomy, there may be insufficient agreement between clinicians for ASPECTS to be reliably used as a criterion for treatment decisions.
Authors: Leanne K Casaubon; Jean-Martin Boulanger; Dylan Blacquiere; Scott Boucher; Kyla Brown; Tom Goddard; Jacqueline Gordon; Myles Horton; Jeffrey Lalonde; Christian LaRivière; Pascale Lavoie; Paul Leslie; Jeanne McNeill; Bijoy K Menon; Brian Moses; Melanie Penn; Jeff Perry; Elizabeth Snieder; Dawn Tymianski; Norine Foley; Eric E Smith; Gord Gubitz; Michael D Hill; Ev Glasser; Patrice Lindsay Journal: Int J Stroke Date: 2015-07-06 Impact factor: 5.266
Authors: Jeffrey L Saver; Mayank Goyal; Alain Bonafe; Hans-Christoph Diener; Elad I Levy; Vitor M Pereira; Gregory W Albers; Christophe Cognard; David J Cohen; Werner Hacke; Olav Jansen; Tudor G Jovin; Heinrich P Mattle; Raul G Nogueira; Adnan H Siddiqui; Dileep R Yavagal; Blaise W Baxter; Thomas G Devlin; Demetrius K Lopes; Vivek K Reddy; Richard du Mesnil de Rochemont; Oliver C Singer; Reza Jahan Journal: N Engl J Med Date: 2015-04-17 Impact factor: 91.245
Authors: Lisa D Alexander; Jacqueline A Pettersen; Julia J Hopyan; Demetrios J Sahlas; Sandra E Black Journal: J Stroke Cerebrovasc Dis Date: 2011-12-15 Impact factor: 2.136
Authors: Olvert A Berkhemer; Puck S S Fransen; Debbie Beumer; Lucie A van den Berg; Hester F Lingsma; Albert J Yoo; Wouter J Schonewille; Jan Albert Vos; Paul J Nederkoorn; Marieke J H Wermer; Marianne A A van Walderveen; Julie Staals; Jeannette Hofmeijer; Jacques A van Oostayen; Geert J Lycklama à Nijeholt; Jelis Boiten; Patrick A Brouwer; Bart J Emmer; Sebastiaan F de Bruijn; Lukas C van Dijk; L Jaap Kappelle; Rob H Lo; Ewoud J van Dijk; Joost de Vries; Paul L M de Kort; Willem Jan J van Rooij; Jan S P van den Berg; Boudewijn A A M van Hasselt; Leo A M Aerden; René J Dallinga; Marieke C Visser; Joseph C J Bot; Patrick C Vroomen; Omid Eshghi; Tobien H C M L Schreuder; Roel J J Heijboer; Koos Keizer; Alexander V Tielbeek; Heleen M den Hertog; Dick G Gerrits; Renske M van den Berg-Vos; Giorgos B Karas; Ewout W Steyerberg; H Zwenneke Flach; Henk A Marquering; Marieke E S Sprengers; Sjoerd F M Jenniskens; Ludo F M Beenen; René van den Berg; Peter J Koudstaal; Wim H van Zwam; Yvo B W E M Roos; Aad van der Lugt; Robert J van Oostenbrugge; Charles B L M Majoie; Diederik W J Dippel Journal: N Engl J Med Date: 2014-12-17 Impact factor: 91.245
Authors: Mayank Goyal; Andrew M Demchuk; Bijoy K Menon; Muneer Eesa; Jeremy L Rempel; John Thornton; Daniel Roy; Tudor G Jovin; Robert A Willinsky; Biggya L Sapkota; Dar Dowlatshahi; Donald F Frei; Noreen R Kamal; Walter J Montanera; Alexandre Y Poppe; Karla J Ryckborst; Frank L Silver; Ashfaq Shuaib; Donatella Tampieri; David Williams; Oh Young Bang; Blaise W Baxter; Paul A Burns; Hana Choe; Ji-Hoe Heo; Christine A Holmstedt; Brian Jankowitz; Michael Kelly; Guillermo Linares; Jennifer L Mandzia; Jai Shankar; Sung-Il Sohn; Richard H Swartz; Philip A Barber; Shelagh B Coutts; Eric E Smith; William F Morrish; Alain Weill; Suresh Subramaniam; Alim P Mitha; John H Wong; Mark W Lowerison; Tolulope T Sajobi; Michael D Hill Journal: N Engl J Med Date: 2015-02-11 Impact factor: 91.245
Authors: William J Powers; Colin P Derdeyn; José Biller; Christopher S Coffey; Brian L Hoh; Edward C Jauch; Karen C Johnston; S Claiborne Johnston; Alexander A Khalessi; Chelsea S Kidwell; James F Meschia; Bruce Ovbiagele; Dileep R Yavagal Journal: Stroke Date: 2015-06-29 Impact factor: 10.170
Authors: James E Siegler; Steven R Messé; Heidi Sucharew; Scott E Kasner; Tapan Mehta; Niraj Arora; Amy K Starosciak; Felipe De Los Rios La Rosa; Natasha R Barnhill; Akshitkumar M Mistry; Kishan Patel; Salman Assad; Amjad Tarboosh; Katarina Dakay; Jeff Wagner; Alicia Bennett; Bharathi Jagadeesan; Christopher Streib; Stewart A Weber; Rohan Chitale; John J Volpi; Stephan A Mayer; Shadi Yaghi; Mahesh V Jayaraman; Pooja Khatri; Eva A Mistry Journal: J Neuroimaging Date: 2019-11-24 Impact factor: 2.486
Authors: Jonathan M Parish; Jeremy B Rhoten; Dale Strong; Tanushree Prasad; Andrew Hines; Joe D Bernard; Jonathan Clemente; Rahul Karamchandani; Andrew W Asimos; William R Stetler Journal: Cureus Date: 2022-05-20
Authors: Jelle Demeestere; Lauranne Scheldeman; Sandra A Cornelissen; Sam Heye; Anke Wouters; Patrick Dupont; Sören Christensen; Michael Mlynash; Gregory W Albers; Maarten Lansberg; Robin Lemmens Journal: Stroke Date: 2018-10 Impact factor: 7.914
Authors: Rujimas Khumtong; Timo Krings; Vitor M Pereira; Aleksandra Pikula; Joanna D Schaafsma Journal: Neuroradiology Date: 2020-01-04 Impact factor: 2.804
Authors: Waleed Brinjikji; Mehdi Abbasi; Catherine Arnold; John C Benson; Sherry A Braksick; Norbert Campeau; Carrie M Carr; Petrice M Cogswell; James P Klaas; Greta B Liebo; Jason T Little; Patrick H Luetmer; Steven A Messina; Alex A Nagelschneider; Kara M Schwartz; Christopher P Wood; Deena M Nasr; David F Kallmes Journal: Interv Neuroradiol Date: 2021-04-14 Impact factor: 1.610
Authors: Luuk Dekker; Victor J Geraedts; Hajo Hund; Suzanne C Cannegieter; Raul G Nogueira; Mayank Goyal; Ido R van den Wijngaard Journal: Interv Neurol Date: 2018-01-25
Authors: Jelle Demeestere; Carlos Garcia-Esperon; Pablo Garcia-Bermejo; Fouke Ombelet; Patrick McElduff; Andrew Bivard; Mark Parsons; Christopher Levi Journal: Neurology Date: 2017-05-17 Impact factor: 9.910