Literature DB >> 35664274

The misuse of funnel plots in meta-analyses of proportions: are they really useful?

Huzaifa Ahmad Cheema1, Abia Shahid1, Muhammad Ehsan1, Muhammad Ayyan1.   

Abstract

Entities:  

Year:  2022        PMID: 35664274      PMCID: PMC9155222          DOI: 10.1093/ckj/sfac035

Source DB:  PubMed          Journal:  Clin Kidney J        ISSN: 2048-8505


× No keyword cloud information.
We read with great interest the recent systematic review and meta-analysis by Pisano et al. [1], which compared ambulatory blood pressure monitoring (ABPM) and office blood pressure (OBP) methods to classify hypertension (HTN) in kidney transplant recipients. The authors reported a prevalence of uncontrolled HTN detected by ABPM of 56% [95% confidence interval (CI) 46–65%]. The pooled prevalence of uncontrolled HTN according to OBP was 47% (95% CI 36–58%). In an otherwise excellent meta-analysis, we find one methodological flaw that may have biased the results. The authors used funnel plots and Egger's regression test to assess for publication bias in their pooled proportions. While funnel plots are a widely used measure to evaluate publication bias, they have been found to give erroneous results when pooling prevalence data [2]. Hence, they are not recommended to be used when dealing with prevalence effect size due to their non-interpretability in such cases [3]. However, in this scenario, we have a robust alternative to the funnel plot, which was introduced by Furuya-Kanamori et al. [3] in their article as the ‘Doi plot’. When applied to real-life meta-analyses, the Doi plot and its associated Luis Furuya-Kanamori (LFK) index were superior to the funnel plot and Egger's test for the detection of publication bias in terms of both sensitivity and specificity [3]. Moreover, the Doi plot did not suffer from the limitations of funnel plot in meta-analyses of prevalence studies and retained its interpretability and utility in such cases. Despite these findings, the use of funnel plot remains widespread in current literature with many authors being unaware of its limitations and the availability of better alternatives, which threatens the validity of their results [4]. We urge all authors to use the Doi plot when pooling proportions and call upon Pisano and colleagues to reassess publication bias in their results using this more accurate measure. Of note, the Cochrane Handbook for Systematic Reviews of Interventions [5] mandates the search of at least two databases to provide extensive coverage and reduce publication bias, while the authors only searched one database, MEDLINE, via both PubMed and Ovid. Hence, it is even more imperative to accurately investigate publication bias in this scenario.

FUNDING

No financial support was received for this study.

CONFLICT OF INTEREST STATEMENT

None declared.
  5 in total

1.  In meta-analyses of proportion studies, funnel plots were found to be an inaccurate method of assessing publication bias.

Authors:  James P Hunter; Athanasios Saratzis; Alex J Sutton; Rebecca H Boucher; Robert D Sayers; Matthew J Bown
Journal:  J Clin Epidemiol       Date:  2014-04-29       Impact factor: 6.437

2.  A new improved graphical and quantitative method for detecting bias in meta-analysis.

Authors:  Luis Furuya-Kanamori; Jan J Barendregt; Suhail A R Doi
Journal:  Int J Evid Based Healthc       Date:  2018-12

3.  Updated guidance for trusted systematic reviews: a new edition of the Cochrane Handbook for Systematic Reviews of Interventions.

Authors:  Miranda Cumpston; Tianjing Li; Matthew J Page; Jacqueline Chandler; Vivian A Welch; Julian Pt Higgins; James Thomas
Journal:  Cochrane Database Syst Rev       Date:  2019-10-03

4.  How does under-reporting of negative and inconclusive results affect the false-positive rate in meta-analysis? A simulation study.

Authors:  Michal Kicinski
Journal:  BMJ Open       Date:  2014-08-28       Impact factor: 2.692

5.  Assessment of hypertension in kidney transplantation by ambulatory blood pressure monitoring: a systematic review and meta-analysis.

Authors:  Anna Pisano; Francesca Mallamaci; Graziella D'Arrigo; Davide Bolignano; Gregoire Wuerzner; Alberto Ortiz; Michel Burnier; Nada Kanaan; Pantelis Sarafidis; Alexandre Persu; Charles J Ferro; Charalampos Loutradis; Ioannis N Boletis; Gérard London; Jean-Michel Halimi; Bénédicte Sautenet; Patrick Rossignol; Liffert Vogt; Carmine Zoccali
Journal:  Clin Kidney J       Date:  2021-09-23
  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.