Nicola Latronico1, Marta Metelli, Maddalena Turin, Simone Piva, Frank A Rasulo, Cosetta Minelli. 1. University Division of Anesthesia and Critical Care Medicine, Department of Anesthesia, Critical Care and Perioperative Medicine, University of Brescia, Spedali Civili, Piazzale Ospedali Civili, 1, 25123, Brescia, Italy. nicola.latronico@med.unibs.it
Abstract
PURPOSE: To evaluate the methodological quality of randomized controlled trials (RCTs) published in Intensive Care Medicine from 2001 to 2010, and to compare it with a previous review of RCTs published from 1975 to 2000. METHODS: We assessed the quality of reporting of randomization, blinding and participant flow, both individually and combined within the Jadad scale, and compared them with findings from our previous review. For RCTs published from 2001 to 2010, we also evaluated the frequency of distorted finding presentation (spin) and inflated predicted treatment effect (delta inflation). RESULTS: In the 221 RCTs from 2001 to 2010, the sample size was significantly larger than in the older series, and there was a higher proportion of studies with negative findings. Reporting of the rationale for sample size estimation and allocation concealment increased significantly, but reporting of other important individual methodological components did not change substantially compared with the previous period and remained low. Among RCTs from 2001 to 2010, a spin strategy was used in 69 of 111 RCTs with statistically negative results, while delta inflation was present in 7 of 11 RCTs evaluating survival as a primary outcome. Papers with higher Jadad scores were cited more often than the others. CONCLUSIONS: Quality of reporting of RCTs published in Intensive Care Medicine has only partly improved over time, and spin and delta bias are of frequent occurrence. There is a need for stronger adherence to CONSORT recommendations, with special emphasis on accurate description of randomization and blindness, and correct reporting of statistically non-significant results.
PURPOSE: To evaluate the methodological quality of randomized controlled trials (RCTs) published in Intensive Care Medicine from 2001 to 2010, and to compare it with a previous review of RCTs published from 1975 to 2000. METHODS: We assessed the quality of reporting of randomization, blinding and participant flow, both individually and combined within the Jadad scale, and compared them with findings from our previous review. For RCTs published from 2001 to 2010, we also evaluated the frequency of distorted finding presentation (spin) and inflated predicted treatment effect (delta inflation). RESULTS: In the 221 RCTs from 2001 to 2010, the sample size was significantly larger than in the older series, and there was a higher proportion of studies with negative findings. Reporting of the rationale for sample size estimation and allocation concealment increased significantly, but reporting of other important individual methodological components did not change substantially compared with the previous period and remained low. Among RCTs from 2001 to 2010, a spin strategy was used in 69 of 111 RCTs with statistically negative results, while delta inflation was present in 7 of 11 RCTs evaluating survival as a primary outcome. Papers with higher Jadad scores were cited more often than the others. CONCLUSIONS: Quality of reporting of RCTs published in Intensive Care Medicine has only partly improved over time, and spin and delta bias are of frequent occurrence. There is a need for stronger adherence to CONSORT recommendations, with special emphasis on accurate description of randomization and blindness, and correct reporting of statistically non-significant results.
Authors: Lesley Wood; Matthias Egger; Lise Lotte Gluud; Kenneth F Schulz; Peter Jüni; Douglas G Altman; Christian Gluud; Richard M Martin; Anthony J G Wood; Jonathan A C Sterne Journal: BMJ Date: 2008-03-03
Authors: Elie Azoulay; Giuseppe Citerio; Jan Bakker; Matteo Bassetti; Dominique Benoit; Maurizio Cecconi; J Randall Curtis; Glenn Hernandez; Margaret Herridge; Samir Jaber; Michael Joannidis; Laurent Papazian; Mark Peters; Pierre Singer; Martin Smith; Marcio Soares; Antoni Torres; Antoine Vieillard-Baron; Jean-François Timsit Journal: Intensive Care Med Date: 2014-01-24 Impact factor: 17.440
Authors: Michael O Harhay; Jason Wagner; Sarah J Ratcliffe; Rachel S Bronheim; Anand Gopal; Sydney Green; Elizabeth Cooney; Mark E Mikkelsen; Meeta Prasad Kerlin; Dylan S Small; Scott D Halpern Journal: Am J Respir Crit Care Med Date: 2014-06-15 Impact factor: 21.405
Authors: Michael O Harhay; Sarah J Ratcliffe; Dylan S Small; Leah H Suttner; Michael J Crowther; Scott D Halpern Journal: Med Care Date: 2019-09 Impact factor: 2.983
Authors: Romana Haneef; Amélie Yavchitz; Philippe Ravaud; Gabriel Baron; Ivan Oransky; Gary Schwitzer; Isabelle Boutron Journal: BMJ Open Date: 2017-11-17 Impact factor: 2.692