Taye H Hamza1, Hans C van Houwelingen, Theo Stijnen. 1. Department of Epidemiology and Biostatistics, Erasmus MC-Erasmus University Medical Center, Rotterdam, The Netherlands. t.hussienhamza@erasmusmc.nl
Abstract
OBJECTIVE: When studies report proportions such as sensitivity or specificity, it is customary to meta-analyze them using the DerSimonian and Laird random effects model. This method approximates the within-study variability of the proportion by a normal distribution, which may lead to bias for several reasons. Alternatively an exact likelihood approach based on the binomial within-study distribution can be used. This method can easily be performed in standard statistical packages. We investigate the performance of the standard method and the alternative approach. STUDY DESIGN AND SETTING: We compare the two approaches through a simulation study, in terms of bias, mean-squared error, and coverage probabilities. We varied the size of the overall sensitivity or specificity, the between-studies variance, the within-study sample sizes, and the number of studies. The methods are illustrated using a published meta-analysis data set. RESULTS: The exact likelihood approach performs always better than the approximate approach and gives unbiased estimates. The coverage probability, in particular for the profile likelihood, is also reasonably acceptable. In contrast, the approximate approach gives huge bias with very poor coverage probability in many cases. CONCLUSION: The exact likelihood approach is the method of preference and should be used whenever feasible.
OBJECTIVE: When studies report proportions such as sensitivity or specificity, it is customary to meta-analyze them using the DerSimonian and Laird random effects model. This method approximates the within-study variability of the proportion by a normal distribution, which may lead to bias for several reasons. Alternatively an exact likelihood approach based on the binomial within-study distribution can be used. This method can easily be performed in standard statistical packages. We investigate the performance of the standard method and the alternative approach. STUDY DESIGN AND SETTING: We compare the two approaches through a simulation study, in terms of bias, mean-squared error, and coverage probabilities. We varied the size of the overall sensitivity or specificity, the between-studies variance, the within-study sample sizes, and the number of studies. The methods are illustrated using a published meta-analysis data set. RESULTS: The exact likelihood approach performs always better than the approximate approach and gives unbiased estimates. The coverage probability, in particular for the profile likelihood, is also reasonably acceptable. In contrast, the approximate approach gives huge bias with very poor coverage probability in many cases. CONCLUSION: The exact likelihood approach is the method of preference and should be used whenever feasible.
Authors: Matthew K Tobin; Kianna Musaraca; Ahmed Disouky; Aashutosh Shetti; Abdullah Bheri; William G Honer; Namhee Kim; Robert J Dawe; David A Bennett; Konstantinos Arfanakis; Orly Lazarov Journal: Cell Stem Cell Date: 2019-05-23 Impact factor: 24.633
Authors: M A D Vente; M Wondergem; I van der Tweel; M A A J van den Bosch; B A Zonnenberg; M G E H Lam; A D van Het Schip; J F W Nijsen Journal: Eur Radiol Date: 2008-11-07 Impact factor: 5.315
Authors: Dick Menzies; Andrea Benedetti; Anita Paydar; Sarah Royce; Pai Madhukar; William Burman; Andrew Vernon; Christian Lienhardt Journal: PLoS Med Date: 2009-09 Impact factor: 11.069
Authors: Dick Menzies; Andrea Benedetti; Anita Paydar; Ian Martin; Sarah Royce; Madhukar Pai; Andrew Vernon; Christian Lienhardt; William Burman Journal: PLoS Med Date: 2009-09-15 Impact factor: 11.069