Giacomo Frosi1, Richard D Riley2, Paula R Williamson3, Jamie J Kirkham3. 1. Department of Biostatistics, University of Liverpool, 1st Floor Duncan Building, Daulby Street, Liverpool, L69 3GA, United Kingdom. Electronic address: giacomo1@liverpool.ac.uk. 2. School of Health and Population Sciences, University of Birmingham, Edgbaston, Birmingham, B15 2TT, United Kingdom. 3. Department of Biostatistics, University of Liverpool, 1st Floor Duncan Building, Daulby Street, Liverpool, L69 3GA, United Kingdom.
Abstract
OBJECTIVES: Outcome reporting bias (ORB) is a threat to validity of systematic reviews. Multivariate meta-analysis (MVMA) can potentially reduce the impact of ORB when outcomes are correlated. The aim of this study was to assess ORB in Cochrane systematic reviews of rheumatoid arthritis and to demonstrate how MVMA may examine its impact. STUDY DESIGN AND SETTING: Reviews were assessed for ORB in relation to eight outcomes for rheumatoid arthritis using a nine-point classification system. Impact of ORB was assessed by comparing estimates from univariate meta-analysis and MVMA models. RESULTS: ORB assessment was applied in 21 included reviews, and all contained missing data on at least one of the eight outcomes. ORB was highly suspected in 247 (22%) of the 1,118 evaluable outcomes from 155 assessable trials. MVMA and univariate results sometimes differed importantly. The maximum change in treatment effect estimate between MVMA and univariate meta-analysis approach was found to be 176% for one of the outcome considered. CONCLUSION: ORB has the potential to affect the conclusions in meta-analyses. This could be avoided if trialists reported on all measured outcomes in full. If missing outcome data are unobtainable, MVMA is useful to examine the impact of missing outcomes and ORB on conclusions.
OBJECTIVES: Outcome reporting bias (ORB) is a threat to validity of systematic reviews. Multivariate meta-analysis (MVMA) can potentially reduce the impact of ORB when outcomes are correlated. The aim of this study was to assess ORB in Cochrane systematic reviews of rheumatoid arthritis and to demonstrate how MVMA may examine its impact. STUDY DESIGN AND SETTING: Reviews were assessed for ORB in relation to eight outcomes for rheumatoid arthritis using a nine-point classification system. Impact of ORB was assessed by comparing estimates from univariate meta-analysis and MVMA models. RESULTS: ORB assessment was applied in 21 included reviews, and all contained missing data on at least one of the eight outcomes. ORB was highly suspected in 247 (22%) of the 1,118 evaluable outcomes from 155 assessable trials. MVMA and univariate results sometimes differed importantly. The maximum change in treatment effect estimate between MVMA and univariate meta-analysis approach was found to be 176% for one of the outcome considered. CONCLUSION: ORB has the potential to affect the conclusions in meta-analyses. This could be avoided if trialists reported on all measured outcomes in full. If missing outcome data are unobtainable, MVMA is useful to examine the impact of missing outcomes and ORB on conclusions.
Authors: Gyanendra Pokharel; Rob Deardon; Cheryl Barnabe; Vivian Bykerk; Susan J Bartlett; Louis Bessette; Gilles Boire; Carol A Hitchon; Edward Keystone; Janet Pope; Orit Schieir; Diane Tin; Carter Thorne; Glen S Hazlewood Journal: ACR Open Rheumatol Date: 2019-08-08
Authors: Malcolm J Price; Helen A Blake; Sara Kenyon; Ian R White; Dan Jackson; Jamie J Kirkham; James P Neilson; Jonathan J Deeks; Richard D Riley Journal: Res Synth Methods Date: 2019-08-12 Impact factor: 5.273