Jennifer A Watt1,2, Areti Angeliki Veroniki3,4,5, Andrea C Tricco3, Sharon E Straus3,6,7. 1. Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital- Unity Health Toronto, 209 Victoria Street, East Building, Room 723, Toronto, Ontario, M5B 1W8, Canada. jennifer.watt@utoronto.ca. 2. Division of Geriatric Medicine, Department of Medicine, University of Toronto, 190 Elizabeth Street, R. Fraser Elliott Building, 3-805, Toronto, Ontario, M5G 2C4, Canada. jennifer.watt@utoronto.ca. 3. Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital- Unity Health Toronto, 209 Victoria Street, East Building, Room 723, Toronto, Ontario, M5B 1W8, Canada. 4. Department of Primary Education, School of Education, University of Ioannina, 45110, Ioannina, Greece. 5. Department of Surgery & Cancer, Faculty of Medicine, Imperial College, Institute of Reproductive and Developmental Biology, W12 0NN, London, UK. 6. Division of Geriatric Medicine, Department of Medicine, University of Toronto, 190 Elizabeth Street, R. Fraser Elliott Building, 3-805, Toronto, Ontario, M5G 2C4, Canada. 7. Institute for Health Policy, Management and Evaluation, University of Toronto, 4th floor, 155 College St, Toronto, Ontario, M5T 3M6, Canada.
Abstract
BACKGROUND: Clinical interpretation of changes measured on a scale is dependent on knowing the minimum clinically important difference (MCID) for that scale: the threshold above which clinicians, patients, and researchers perceive an outcome difference. Until now, approaches to determining MCIDs were based upon individual studies or surveys of experts. However, the comparison of meta-analytic treatment effects to a MCID derived from a distribution of standard deviations (SDs) associated with all trial-specific outcomes in a meta-analysis could improve our clinical understanding of meta-analytic treatment effects. METHODS: We approximated MCIDs using a distribution-based approach that pooled SDs associated with baseline mean or mean change values for two scales (i.e. Mini-Mental State Exam [MMSE] and Alzheimer Disease Assessment Scale - Cognitive Subscale [ADAS-Cog]), as reported in parallel randomized trials (RCTs) that were included in a systematic review of cognitive enhancing medications for dementia (i.e. cholinesterase inhibitors and memantine). We excluded RCTs that did not report baseline or mean change SD values. We derived MCIDs at 0.4 and 0.5 SDs of the pooled SD and compared our derived MCIDs to previously published MCIDs for the MMSE and ADAS-Cog. RESULTS: We showed that MCIDs derived from a distribution-based approach approximated published MCIDs for the MMSE and ADAS-Cog. For the MMSE (51 RCTs, 12,449 patients), we derived a MCID of 1.6 at 0.4 SDs and 2 at 0.5 SDs using baseline SDs and we derived a MCID of 1.4 at 0.4 SDs and 1.8 at 0.5 SDs using mean change SDs. For the ADAS-Cog (37 RCTs, 10,006 patients), we derived a MCID of 4 at 0.4 SDs and 5 at 0.5 SDs using baseline SDs and we derived a MCID of 2.6 at 0.4 SDs and 3.2 at 0.5 SDs using mean change SDs. CONCLUSION: A distribution-based approach using data included in a systematic review approximated known MCIDs. Our approach performed better when we derived MCIDs from baseline as opposed to mean change SDs. This approach could facilitate clinical interpretation of outcome measures reported in RCTs and systematic reviews of interventions. Future research should focus on the generalizability of this method to other clinical scenarios.
BACKGROUND: Clinical interpretation of changes measured on a scale is dependent on knowing the minimum clinically important difference (MCID) for that scale: the threshold above which clinicians, patients, and researchers perceive an outcome difference. Until now, approaches to determining MCIDs were based upon individual studies or surveys of experts. However, the comparison of meta-analytic treatment effects to a MCID derived from a distribution of standard deviations (SDs) associated with all trial-specific outcomes in a meta-analysis could improve our clinical understanding of meta-analytic treatment effects. METHODS: We approximated MCIDs using a distribution-based approach that pooled SDs associated with baseline mean or mean change values for two scales (i.e. Mini-Mental State Exam [MMSE] and Alzheimer Disease Assessment Scale - Cognitive Subscale [ADAS-Cog]), as reported in parallel randomized trials (RCTs) that were included in a systematic review of cognitive enhancing medications for dementia (i.e. cholinesterase inhibitors and memantine). We excluded RCTs that did not report baseline or mean change SD values. We derived MCIDs at 0.4 and 0.5 SDs of the pooled SD and compared our derived MCIDs to previously published MCIDs for the MMSE and ADAS-Cog. RESULTS: We showed that MCIDs derived from a distribution-based approach approximated published MCIDs for the MMSE and ADAS-Cog. For the MMSE (51 RCTs, 12,449 patients), we derived a MCID of 1.6 at 0.4 SDs and 2 at 0.5 SDs using baseline SDs and we derived a MCID of 1.4 at 0.4 SDs and 1.8 at 0.5 SDs using mean change SDs. For the ADAS-Cog (37 RCTs, 10,006 patients), we derived a MCID of 4 at 0.4 SDs and 5 at 0.5 SDs using baseline SDs and we derived a MCID of 2.6 at 0.4 SDs and 3.2 at 0.5 SDs using mean change SDs. CONCLUSION: A distribution-based approach using data included in a systematic review approximated known MCIDs. Our approach performed better when we derived MCIDs from baseline as opposed to mean change SDs. This approach could facilitate clinical interpretation of outcome measures reported in RCTs and systematic reviews of interventions. Future research should focus on the generalizability of this method to other clinical scenarios.
Entities:
Keywords:
Alzheimer disease assessment scale – cognitive subscale; Back-transformation; Meta-analysis; Mini-mental state exam; Minimum clinically important difference; Systematic review
Authors: Andrea C Tricco; Huda M Ashoor; Charlene Soobiah; Patricia Rios; Areti Angeliki Veroniki; Jemila S Hamid; John D Ivory; Paul A Khan; Fatemeh Yazdi; Marco Ghassemi; Erik Blondal; Joanne M Ho; Carmen H Ng; Brenda Hemmelgarn; Sumit R Majumdar; Laure Perrier; Sharon E Straus Journal: J Am Geriatr Soc Date: 2017-09-29 Impact factor: 5.562
Authors: Robert Howard; Patrick Phillips; Tony Johnson; John O'Brien; Bart Sheehan; James Lindesay; Peter Bentham; Alistair Burns; Clive Ballard; Clive Holmes; Ian McKeith; Robert Barber; Tom Dening; Craig Ritchie; Rob Jones; Ashley Baldwin; Peter Passmore; David Findlay; Alan Hughes; Ajay Macharouthu; Sube Banerjee; Roy Jones; Martin Knapp; Richard G Brown; Robin Jacoby; Jessica Adams; Mary Griffin; Richard Gray Journal: Int J Geriatr Psychiatry Date: 2010-09-16 Impact factor: 3.485
Authors: Emma Borland; Chris Edgar; Erik Stomrud; Nicholas Cullen; Oskar Hansson; Sebastian Palmqvist Journal: Neurology Date: 2022-07-14 Impact factor: 11.800