BACKGROUND AND PURPOSE: The modified Rankin scale (mRS) is the most commonly used outcome measure in stroke trials. However, substantial interobserver variability in mRS scoring has been reported. These studies likely underestimate the variability present in multicenter clinical trials, because exploratory work has only been undertaken in single centers by a few observers, all of similar training. We examined mRS variability across a large cohort of international observers using data from a video training resource. METHODS: The mRS training package includes a series of "real-life" patient interviews for grading. Training data were collected centrally and analyzed for variability using kappa statistics. We examined variability against a standard of "correct" mRS grades; examined variability by country; and for UK assessors, examined variability by center and by professional background of the observer. RESULTS: To date, 2942 assessments from 30 countries have been submitted. Overall reliability for mRS grading has been moderate to good with substantial heterogeneity across countries. Native English language has had little effect on reliability. Within the United Kingdom, there was no significant variation by profession. CONCLUSIONS: Our results confirm interobserver variability in mRS assessment. The heterogeneity across countries is intriguing because it appears not to be related solely to language. These data highlight the need for novel strategies to improve reliability.
BACKGROUND AND PURPOSE: The modified Rankin scale (mRS) is the most commonly used outcome measure in stroke trials. However, substantial interobserver variability in mRS scoring has been reported. These studies likely underestimate the variability present in multicenter clinical trials, because exploratory work has only been undertaken in single centers by a few observers, all of similar training. We examined mRS variability across a large cohort of international observers using data from a video training resource. METHODS: The mRS training package includes a series of "real-life" patient interviews for grading. Training data were collected centrally and analyzed for variability using kappa statistics. We examined variability against a standard of "correct" mRS grades; examined variability by country; and for UK assessors, examined variability by center and by professional background of the observer. RESULTS: To date, 2942 assessments from 30 countries have been submitted. Overall reliability for mRS grading has been moderate to good with substantial heterogeneity across countries. Native English language has had little effect on reliability. Within the United Kingdom, there was no significant variation by profession. CONCLUSIONS: Our results confirm interobserver variability in mRS assessment. The heterogeneity across countries is intriguing because it appears not to be related solely to language. These data highlight the need for novel strategies to improve reliability.
Authors: Shouri Lahiri; Hooman Kamel; Emma E Meyers; M Cristina Falo; Fawaz Al-Mufti; J Michael Schmidt; Sachin Agarwal; Soojin Park; Jan Claassen; Stephan A Mayer Journal: Neurohospitalist Date: 2016-01
Authors: R Loch Macdonald; Randall T Higashida; Emanuela Keller; Stephan A Mayer; Andy Molyneux; Andreas Raabe; Peter Vajkoczy; Isabel Wanke; Aline Frey; Angelina Marr; Sébastien Roux; Neal F Kassell Journal: Neurocrit Care Date: 2010-12 Impact factor: 3.210
Authors: Maria-Arantzazu Ruescas-Nicolau; María Luz Sánchez-Sánchez; Sara Cortés-Amador; Sofía Pérez-Alenda; Anna Arnal-Gómez; Assumpta Climent-Toledo; Juan J Carrasco Journal: Int J Environ Res Public Health Date: 2021-04-29 Impact factor: 3.390
Authors: Christopher Carswell; Michael Rañopa; Suvankar Pal; Rebecca Macfarlane; Durre Siddique; Dafydd Thomas; Tom Webb; Steve Wroe; Sarah Walker; Janet Darbyshire; John Collinge; Simon Mead; Peter Rudge Journal: Dement Geriatr Cogn Dis Extra Date: 2012-08-08