Paul H Lee1, Andy C Y Tse2. 1. School of Nursing, Hong Kong Polytechnic University, Hong kong. Electronic address: paul.h.lee@polyu.edu.hk. 2. Department of Health and Physical Education, The Education University of Hong Kong, Hong kong.
Abstract
BACKGROUND: There are limited data on the quality of reporting of information essential for replication of the calculation as well as the accuracy of the sample size calculation. We examine the current quality of reporting of the sample size calculation in randomized controlled trials (RCTs) published in PubMed and to examine the variation in reporting across study design, study characteristics, and journal impact factor. We also reviewed the targeted sample size reported in trial registries. METHODS: We reviewed and analyzed all RCTs published in December 2014 with journals indexed in PubMed. The 2014 Impact Factors for the journals were used as proxies for their quality. RESULTS: Of the 451 analyzed papers, 58.1% reported an a priori sample size calculation. Nearly all papers provided the level of significance (97.7%) and desired power (96.6%), and most of the papers reported the minimum clinically important effect size (73.3%). The median (inter-quartile range) of the percentage difference of the reported and calculated sample size calculation was 0.0% (IQR -4.6%;3.0%). The accuracy of the reported sample size was better for studies published in journals that endorsed the CONSORT statement and journals with an impact factor. A total of 98 papers had provided targeted sample size on trial registries and about two-third of these papers (n=62) reported sample size calculation, but only 25 (40.3%) had no discrepancy with the reported number in the trial registries. CONCLUSIONS: The reporting of the sample size calculation in RCTs published in PubMed-indexed journals and trial registries were poor. The CONSORT statement should be more widely endorsed.
BACKGROUND: There are limited data on the quality of reporting of information essential for replication of the calculation as well as the accuracy of the sample size calculation. We examine the current quality of reporting of the sample size calculation in randomized controlled trials (RCTs) published in PubMed and to examine the variation in reporting across study design, study characteristics, and journal impact factor. We also reviewed the targeted sample size reported in trial registries. METHODS: We reviewed and analyzed all RCTs published in December 2014 with journals indexed in PubMed. The 2014 Impact Factors for the journals were used as proxies for their quality. RESULTS: Of the 451 analyzed papers, 58.1% reported an a priori sample size calculation. Nearly all papers provided the level of significance (97.7%) and desired power (96.6%), and most of the papers reported the minimum clinically important effect size (73.3%). The median (inter-quartile range) of the percentage difference of the reported and calculated sample size calculation was 0.0% (IQR -4.6%;3.0%). The accuracy of the reported sample size was better for studies published in journals that endorsed the CONSORT statement and journals with an impact factor. A total of 98 papers had provided targeted sample size on trial registries and about two-third of these papers (n=62) reported sample size calculation, but only 25 (40.3%) had no discrepancy with the reported number in the trial registries. CONCLUSIONS: The reporting of the sample size calculation in RCTs published in PubMed-indexed journals and trial registries were poor. The CONSORT statement should be more widely endorsed.
Authors: Stuart G Nicholls; Steve McDonald; Joanne E McKenzie; Kelly Carroll; Monica Taljaard Journal: J Clin Epidemiol Date: 2022-01-23 Impact factor: 7.407
Authors: Fernanda S Tonin; Laiza M Steimbach; Antonio M Mendes; Helena H Borba; Roberto Pontarolo; Fernando Fernandez-Llimos Journal: PLoS One Date: 2018-04-30 Impact factor: 3.240
Authors: Juan Manuel Völker; Federico Gabriel Arguissain; Ole Kaeseler Andersen; José Biurrun Manresa Journal: Hum Brain Mapp Date: 2021-02-19 Impact factor: 5.038