Maria Petropoulou1, Adriani Nikolakopoulou2, Areti-Angeliki Veroniki3, Patricia Rios3, Afshin Vafaei3, Wasifa Zarin3, Myrsini Giannatsi4, Shannon Sullivan3, Andrea C Tricco5, Anna Chaimani1, Matthias Egger6, Georgia Salanti7. 1. Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, 45110 Ioannina, Greece. 2. Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, 45110 Ioannina, Greece; Institute of Social and Preventive Medicine (ISPM), University of Bern, Finkenhubelweg 11, 3012 Bern, Switzerland. 3. Li Ka Shing Knowledge Institute, St. Michael's Hospital, 209 Victoria Street, East Building, Toronto, Ontario M5B 1W8, Canada. 4. Centre for Mental Health and Safety, University of Manchester, Oxford Road, M13 9PL Manchester, UK. 5. Li Ka Shing Knowledge Institute, St. Michael's Hospital, 209 Victoria Street, East Building, Toronto, Ontario M5B 1W8, Canada; Epidemiology Division, Dalla Lana School of Public Health, University of Toronto, 6th Floor, 155 College Street, Toronto, Ontario M5T 3M7, Canada. 6. Institute of Social and Preventive Medicine (ISPM), University of Bern, Finkenhubelweg 11, 3012 Bern, Switzerland. 7. Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, 45110 Ioannina, Greece; Institute of Social and Preventive Medicine (ISPM), University of Bern, Finkenhubelweg 11, 3012 Bern, Switzerland; Bern Institute of Primary Health Care (BIHAM), University of Bern, Gesellschaftsstrasse 49, 3012 Bern, Switzerland. Electronic address: georgia.salanti@ispm.unibe.ch.
Abstract
OBJECTIVES: To assess the characteristics and core statistical methodology specific to network meta-analyses (NMAs) in clinical research articles. STUDY DESIGN AND SETTING: We searched MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews from inception until April 14, 2015, for NMAs of randomized controlled trials including at least four different interventions. Two reviewers independently screened potential studies, whereas data abstraction was performed by a single reviewer and verified by a second. RESULTS: A total of 456 NMAs, which included a median (interquartile range) of 21 (13-40) studies and 7 (5-9) treatment nodes, were assessed. A total of 125 NMAs (27%) were star networks; this proportion declined from 100% in 2005 to 19% in 2015 (P = 0.01 by test of trend). An increasing number of NMAs discussed transitivity or inconsistency (0% in 2005, 86% in 2015, P < 0.01) and 150 (45%) used appropriate methods to test for inconsistency (14% in 2006, 74% in 2015, P < 0.01). Heterogeneity was explored in 256 NMAs (56%), with no change over time (P = 0.10). All pairwise effects were reported in 234 NMAs (51%), with some increase over time (P = 0.02). The hierarchy of treatments was presented in 195 NMAs (43%), the probability of being best was most commonly reported (137 NMAs, 70%), but use of surface under the cumulative ranking curves increased steeply (0% in 2005, 33% in 2015, P < 0.01). CONCLUSION: Many NMAs published in the medical literature have significant limitations in both the conduct and reporting of the statistical analysis and numerical results. The situation has, however, improved in recent years, in particular with respect to the evaluation of the underlying assumptions, but considerable room for further improvements remains.
OBJECTIVES: To assess the characteristics and core statistical methodology specific to network meta-analyses (NMAs) in clinical research articles. STUDY DESIGN AND SETTING: We searched MEDLINE, EMBASE, and the Cochrane Database of Systematic Reviews from inception until April 14, 2015, for NMAs of randomized controlled trials including at least four different interventions. Two reviewers independently screened potential studies, whereas data abstraction was performed by a single reviewer and verified by a second. RESULTS: A total of 456 NMAs, which included a median (interquartile range) of 21 (13-40) studies and 7 (5-9) treatment nodes, were assessed. A total of 125 NMAs (27%) were star networks; this proportion declined from 100% in 2005 to 19% in 2015 (P = 0.01 by test of trend). An increasing number of NMAs discussed transitivity or inconsistency (0% in 2005, 86% in 2015, P < 0.01) and 150 (45%) used appropriate methods to test for inconsistency (14% in 2006, 74% in 2015, P < 0.01). Heterogeneity was explored in 256 NMAs (56%), with no change over time (P = 0.10). All pairwise effects were reported in 234 NMAs (51%), with some increase over time (P = 0.02). The hierarchy of treatments was presented in 195 NMAs (43%), the probability of being best was most commonly reported (137 NMAs, 70%), but use of surface under the cumulative ranking curves increased steeply (0% in 2005, 33% in 2015, P < 0.01). CONCLUSION: Many NMAs published in the medical literature have significant limitations in both the conduct and reporting of the statistical analysis and numerical results. The situation has, however, improved in recent years, in particular with respect to the evaluation of the underlying assumptions, but considerable room for further improvements remains.
Authors: Caitlin H Daly; Binod Neupane; Joseph Beyene; Lehana Thabane; Sharon E Straus; Jemila S Hamid Journal: BMJ Open Date: 2019-09-05 Impact factor: 2.692
Authors: Andrea C Tricco; Huda M Ashoor; Jesmin Antony; Zachary Bouck; Myanca Rodrigues; Ba' Pham; Paul A Khan; Vera Nincic; Nazia Darvesh; Fatemeh Yazdi; Marco Ghassemi; John D Ivory; Areti Angeliki Veroniki; Catherine H Yu; Lorenzo Moja; Sharon E Straus Journal: J Gen Intern Med Date: 2021-03-19 Impact factor: 6.473
Authors: Amalia Emily Karahalios; Georgia Salanti; Simon L Turner; G Peter Herbison; Ian R White; Areti Angeliki Veroniki; Adriani Nikolakopoulou; Joanne E Mckenzie Journal: Syst Rev Date: 2017-06-24
Authors: Adriani Nikolakopoulou; Dimitris Mavridis; Toshi A Furukawa; Andrea Cipriani; Andrea C Tricco; Sharon E Straus; George C M Siontis; Matthias Egger; Georgia Salanti Journal: BMJ Date: 2018-02-28