L Mariani1, E Marubini. 1. Department of Biometry, Istituto Nazionale Tumori, Milan, Italy. mariani@istitutotumori.mi.it
Abstract
PURPOSE: A number of statistical methods have been proposed for the design and analysis of phase II studies based on dichotomous outcomes. To investigate to what extent such methods are in current use, we conducted a survey of published studies. MATERIALS AND METHODS: We identified studies by conducting a computerized literature search of MEDLINE. We considered trials on systemic antineoplastic treatments described as phase II or pilot. The search was limited to articles written in English and published in 1997. RESULTS: Three hundred eight trials were identified. The majority, ie, 295 (95.8%), had been conducted as single-arm studies, with objective tumor response as the primary efficacy end point. An identifiable statistical design was reported for only 58 (19.7%) of these trials. The quality in reporting the statistical design and compliance with the design in carrying out the study or results interpretation were frequently poor. The frequency of reporting the statistical design was not shown to increase over the years of study start and was not associated with sample size or study duration. Instead, a significant association was found with trial results (which were less frequently positive among studies with a statistical design) and with the impact factor of the publishing journal. CONCLUSION: This survey shows that the quality of the statistical component of published phase II cancer trials is generally poor and raises suspicion that low quality is likely to bias study findings. Journals might improve the methodologic standard of published articles through a more vigilant reviewing policy.
PURPOSE: A number of statistical methods have been proposed for the design and analysis of phase II studies based on dichotomous outcomes. To investigate to what extent such methods are in current use, we conducted a survey of published studies. MATERIALS AND METHODS: We identified studies by conducting a computerized literature search of MEDLINE. We considered trials on systemic antineoplastic treatments described as phase II or pilot. The search was limited to articles written in English and published in 1997. RESULTS: Three hundred eight trials were identified. The majority, ie, 295 (95.8%), had been conducted as single-arm studies, with objective tumor response as the primary efficacy end point. An identifiable statistical design was reported for only 58 (19.7%) of these trials. The quality in reporting the statistical design and compliance with the design in carrying out the study or results interpretation were frequently poor. The frequency of reporting the statistical design was not shown to increase over the years of study start and was not associated with sample size or study duration. Instead, a significant association was found with trial results (which were less frequently positive among studies with a statistical design) and with the impact factor of the publishing journal. CONCLUSION: This survey shows that the quality of the statistical component of published phase II cancer trials is generally poor and raises suspicion that low quality is likely to bias study findings. Journals might improve the methodologic standard of published articles through a more vigilant reviewing policy.
Authors: Ferdinand Rombout; Leon Aarons; Mats Karlsson; Anthony Man; France Mentré; Peter Nygren; Amy Racine; Hans Schaefer; Jean-Louis Steimer; Iñaki Troconiz; Achiel van Peer Journal: J Pharmacokinet Pharmacodyn Date: 2004-12 Impact factor: 2.745
Authors: Susan M Chang; Sharon L Reynolds; Nicholas Butowski; Kathleen R Lamborn; Jan C Buckner; Richard S Kaplan; Darell D Bigner Journal: Neuro Oncol Date: 2005-10 Impact factor: 12.300
Authors: M Catherine Pietanza; Ethan M Basch; Alex Lash; Lawrence H Schwartz; Michelle S Ginsberg; Binsheng Zhao; Marwan Shouery; Mary Shaw; Lauren J Rogak; Manda Wilson; Aaron Gabow; Marcia Latif; Kai-Hsiung Lin; Qinfei Wu; Samantha L Kass; Claire P Miller; Leslie Tyson; Dyana K Sumner; Alison Berkowitz-Hergianto; Camelia S Sima; Mark G Kris Journal: J Clin Oncol Date: 2013-04-29 Impact factor: 44.544
Authors: S R Brown; W M Gregory; C J Twelves; M Buyse; F Collinson; M Parmar; M T Seymour; J M Brown Journal: Br J Cancer Date: 2011-06-28 Impact factor: 7.640
Authors: Luca G Campana; A James P Clover; Sara Valpione; Pietro Quaglino; Julie Gehl; Christian Kunte; Marko Snoj; Maja Cemazar; Carlo R Rossi; Damijan Miklavcic; Gregor Sersa Journal: Radiol Oncol Date: 2016-02-16 Impact factor: 2.991