E Bacchus1, M P Kate2, A Benomar3, B Farzin3, J Raymond4, T E Darsaut1. 1. Division of Neurosurgery, Department of Surgery, University of Alberta Hospital, Mackenzie Health Sciences Centre, 8440 112, Street NW, Edmonton, Alberta T6G 2B7, Canada. 2. Division of Neurology, Department of Medicine, University of Alberta Hospital, Mackenzie Health Sciences Centre, 8440 112, Street NW, Edmonton, Alberta T6G 2B7, Canada. 3. Department of Radiology, Centre Hospitalier de l'Université de Montréal (CHUM), 1000, St-Denis Street, room D03.5462B, Montreal H2X 0C1, Quebec, Canada. 4. Department of Radiology, Centre Hospitalier de l'Université de Montréal (CHUM), 1000, St-Denis Street, room D03.5462B, Montreal H2X 0C1, Quebec, Canada. Electronic address: jean.raymond@umontreal.ca.
Abstract
BACKGROUND: The modified Rankin scale (mRS) is commonly used as a clinical outcome measure in aneurysm trials, but inter-observer reliability in treated patients has not been tested. METHODS: We reviewed the literature on inter-observer reliability studies of the mRS. Sixty patients with ruptured (n=47) or unruptured (n=13) aneurysms treated with endovascular methods (n=34) or surgical clipping (n=26) were independently evaluated by a neurosurgeon, a stroke neurologist, and a novice research assistant, and a simplified mRS score assigned. Results were analyzed using Gwet's AC1/2 reliability coefficients (KG). RESULTS: No previous reports validating the reliability of the mRS in treated aneurysm patients were identified. Using the mRS 0-5, inter-rater agreement was almost perfect (KG=0.89 [0.86-0.93]). Agreement between raters remained almost perfect regardless of the rater's expertise. Agreement was almost perfect (KG=0.87 [0.77-0.96] when the mRS was dichotomized 0-2 vs 3-5, but fell to moderate when dichotomized 0-1 vs 2-5 (KG=0.59 (0.42-0.75). Agreement using the 0-2 vs 3-5 dichotomized mRS remained almost perfect for coiled (KG=0.90), clipped (KG=0.82), ruptured (KG=0.84), and unruptured (KG=0.95) aneurysms. Dichotomization of results at 0-1 vs 2-5 would have resulted in an (undesirable) significant difference in good outcomes between raters (P=.003), but not at 0-2 vs 3-5 (P=.52). CONCLUSION: The simplified mRS appears to be a reliable clinical outcome measure for treated cerebral aneurysm patients. When needed, dichotomization is more reliable at mRS 0-2 vs 3-5 than at 0-1 vs 2-5. The simplified mRS is a promising tool in the functional assessment of aneurysm patients recruited in pragmatic care trials.
BACKGROUND: The modified Rankin scale (mRS) is commonly used as a clinical outcome measure in aneurysm trials, but inter-observer reliability in treated patients has not been tested. METHODS: We reviewed the literature on inter-observer reliability studies of the mRS. Sixty patients with ruptured (n=47) or unruptured (n=13) aneurysms treated with endovascular methods (n=34) or surgical clipping (n=26) were independently evaluated by a neurosurgeon, a stroke neurologist, and a novice research assistant, and a simplified mRS score assigned. Results were analyzed using Gwet's AC1/2 reliability coefficients (KG). RESULTS: No previous reports validating the reliability of the mRS in treated aneurysm patients were identified. Using the mRS 0-5, inter-rater agreement was almost perfect (KG=0.89 [0.86-0.93]). Agreement between raters remained almost perfect regardless of the rater's expertise. Agreement was almost perfect (KG=0.87 [0.77-0.96] when the mRS was dichotomized 0-2 vs 3-5, but fell to moderate when dichotomized 0-1 vs 2-5 (KG=0.59 (0.42-0.75). Agreement using the 0-2 vs 3-5 dichotomized mRS remained almost perfect for coiled (KG=0.90), clipped (KG=0.82), ruptured (KG=0.84), and unruptured (KG=0.95) aneurysms. Dichotomization of results at 0-1 vs 2-5 would have resulted in an (undesirable) significant difference in good outcomes between raters (P=.003), but not at 0-2 vs 3-5 (P=.52). CONCLUSION: The simplified mRS appears to be a reliable clinical outcome measure for treated cerebral aneurysm patients. When needed, dichotomization is more reliable at mRS 0-2 vs 3-5 than at 0-1 vs 2-5. The simplified mRS is a promising tool in the functional assessment of aneurysm patients recruited in pragmatic care trials.
Authors: J Raymond; D Iancu; W Boisseau; J D B Diestro; R Klink; M Chagnon; J Zehr; B Drake; H Lesiuk; A Weill; D Roy; M W Bojanowski; C Chaalala; J L Rempel; C O'Kelly; M M Chow; S Bracard; T E Darsaut Journal: AJNR Am J Neuroradiol Date: 2022-08-04 Impact factor: 4.966