OBJECTIVE: Several studies have shown that the quality of reports of randomized controlled trials (RCTs) in medicine is variable and often poor, whereas the quality of those in surgery is unknown. We aimed to assess the quality of reports of RCTs in coronary artery bypass grafting (CABG) surgery when comparing off- and on-pump techniques. METHODS: From electronic searches of MEDLINE, the Cochrane Library, CINAHL, HealthSTAR and EMBASE, we identified RCTs published between 2000 and 2005 comparing off- and on-pump CABG. We assessed the report quality, using 35 items from the Consolidated Standards for Reporting Trials (CONSORT) statement and 54 additional indicators relevant to CABG surgery. Some of the indicators comprised several small parts, making the maximum possible total score 105. Two authors independently reviewed and assessed the reporting quality of each RCT. The level of agreement was assessed with kappa statistics, and disagreements were resolved by consensus. We expressed descriptive analyses as median and interquartile range; we used a generalized estimating equation (GEE) for data analysis. RESULTS: We included 50 trials, for a total of 5134 patients. The kappa value was greater than 0.6 for 73 of 105 (70%) indicators. The overall report quality score varied from 35 to 93 of 105. The CONSORT score reporting quality varied from 16 to 39 of 42. The quality of reporting was poor and insufficient for the methods (particularly, the sample size, allocation and blinding subsections), results and discussion sections. With GEE modelling, the reporting quality had a strong association with trial size, publication year, trial location and funding source, but not with the results and type of primary outcome. CONCLUSION: The quality of the publications' reporting methods, results and discussion sections was suboptimal. It is critical that, in reporting surgical trials, authors follow the CONSORT guidelines as well as consider the surgical factors.
OBJECTIVE: Several studies have shown that the quality of reports of randomized controlled trials (RCTs) in medicine is variable and often poor, whereas the quality of those in surgery is unknown. We aimed to assess the quality of reports of RCTs in coronary artery bypass grafting (CABG) surgery when comparing off- and on-pump techniques. METHODS: From electronic searches of MEDLINE, the Cochrane Library, CINAHL, HealthSTAR and EMBASE, we identified RCTs published between 2000 and 2005 comparing off- and on-pump CABG. We assessed the report quality, using 35 items from the Consolidated Standards for Reporting Trials (CONSORT) statement and 54 additional indicators relevant to CABG surgery. Some of the indicators comprised several small parts, making the maximum possible total score 105. Two authors independently reviewed and assessed the reporting quality of each RCT. The level of agreement was assessed with kappa statistics, and disagreements were resolved by consensus. We expressed descriptive analyses as median and interquartile range; we used a generalized estimating equation (GEE) for data analysis. RESULTS: We included 50 trials, for a total of 5134 patients. The kappa value was greater than 0.6 for 73 of 105 (70%) indicators. The overall report quality score varied from 35 to 93 of 105. The CONSORT score reporting quality varied from 16 to 39 of 42. The quality of reporting was poor and insufficient for the methods (particularly, the sample size, allocation and blinding subsections), results and discussion sections. With GEE modelling, the reporting quality had a strong association with trial size, publication year, trial location and funding source, but not with the results and type of primary outcome. CONCLUSION: The quality of the publications' reporting methods, results and discussion sections was suboptimal. It is critical that, in reporting surgical trials, authors follow the CONSORT guidelines as well as consider the surgical factors.
Authors: Theodore Velissaris; Augustine T M Tang; Matthew Murray; Rajnikant L Mehta; Peter J Wood; David A Hett; Sunil K Ohri Journal: Ann Thorac Surg Date: 2004-08 Impact factor: 4.330
Authors: D van Dijk; A P Nierich; E W Jansen; H M Nathoe; W J Suyker; J C Diephuis; W J van Boven; C Borst; E Buskens; D E Grobbee; E O Robles De Medina; P P de Jaegere Journal: Circulation Date: 2001-10-09 Impact factor: 29.690
Authors: V Gulielmos; M Menschikowski; H Dill; M Eller; S Thiele; S M Tugtekin; W Jaross; S Schueler Journal: Eur J Cardiothorac Surg Date: 2000-11 Impact factor: 4.191
Authors: Ardawan Julian Rastan; Hartmuth Bruno Bittner; Jan Fritz Gummert; Thomas Walther; Claudia V Schewick; Evaldes Girdauskas; Friedrich Wilhelm Mohr Journal: Eur J Cardiothorac Surg Date: 2005-04-08 Impact factor: 4.191
Authors: Natasha E Khan; Anthony De Souza; Rebecca Mister; Marcus Flather; Jonathan Clague; Simon Davies; Peter Collins; Duolao Wang; Ulrich Sigwart; John Pepper Journal: N Engl J Med Date: 2004-01-01 Impact factor: 91.245
Authors: Catherine Hu; Jie Yi Wang; Zoe El Helou; Muhammad Taaha Hassan; Zheng Jing Hu; Gerhard Fusch; Lawrence Mbuagbaw; Salhab El Helou; Lehana Thabane Journal: BMJ Open Qual Date: 2021-06