Nicolas A Bamat1,2,3, Osayame A Ekhaguere1,4, Lingqiao Zhang5,6, Dustin D Flannery1,2,3, Sara C Handley1,3,7, Heidi M Herrick1,2,3, Susan S Ellenberg5. 1. Division of Neonatology, The Children's Hospital of Philadelphia, Philadelphia, PA, USA. 2. Center for Pediatric Clinical Effectiveness, The Children's Hospital of Philadelphia, Philadelphia, PA, USA. 3. Department of Pediatrics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. 4. Division of Neonatal-Perinatal Medicine, Department of Pediatrics, Indiana University, Indianapolis, IN, USA. 5. Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA. 6. Biosense Webster, Inc., Irvine, CA, USA. 7. Leonard Davis Institute of Health Economics, University of Pennsylvania, Philadelphia, PA, USA.
Abstract
BACKGROUND/AIMS: Noninferiority clinical trials are susceptible to false confirmation of noninferiority when the intention-to-treat principle is applied in the setting of incomplete trial protocol adherence. The risk increases as protocol adherence rates decrease. The objective of this study was to compare protocol adherence and hypothesis confirmation between superiority and noninferiority randomized clinical trials published in three high impact medical journals. We hypothesized that noninferiority trials have lower protocol adherence and greater hypothesis confirmation. METHODS: We conducted an observational study using published clinical trial data. We searched PubMed for active control, two-arm parallel group randomized clinical trials published in JAMA: The Journal of the American Medical Association, The New England Journal of Medicine, and The Lancet between 2007 and 2017. The primary exposure was trial type, superiority versus noninferiority, as determined by the hypothesis testing framework of the primary trial outcome. The primary outcome was trial protocol adherence rate, defined as the number of randomized subjects receiving the allocated intervention as described by the trial protocol and followed to primary outcome ascertainment (numerator), over the total number of subjects randomized (denominator). Hypothesis confirmation was defined as affirmation of noninferiority or the alternative hypothesis for noninferiority and superiority trials, respectively. RESULTS: Among 120 superiority and 120 noninferiority trials, median and interquartile protocol adherence rates were 91.5 [81.4-96.7] and 89.8 [83.6-95.2], respectively; P = 0.47. Hypothesis confirmation was observed in 107/120 (89.2%) of noninferiority and 64/120 (53.3%) of superiority trials, risk difference (95% confidence interval): 35.8 (25.3-46.3), P < 0.001. CONCLUSION: Protocol adherence rates are similar between superiority and noninferiority trials published in three high impact medical journals. Despite this, we observed greater hypothesis confirmation among noninferiority trials. We speculate that publication bias, lenient noninferiority margins and other sources of bias may contribute to this finding. Further study is needed to identify the reasons for this observed difference.
BACKGROUND/AIMS: Noninferiority clinical trials are susceptible to false confirmation of noninferiority when the intention-to-treat principle is applied in the setting of incomplete trial protocol adherence. The risk increases as protocol adherence rates decrease. The objective of this study was to compare protocol adherence and hypothesis confirmation between superiority and noninferiority randomized clinical trials published in three high impact medical journals. We hypothesized that noninferiority trials have lower protocol adherence and greater hypothesis confirmation. METHODS: We conducted an observational study using published clinical trial data. We searched PubMed for active control, two-arm parallel group randomized clinical trials published in JAMA: The Journal of the American Medical Association, The New England Journal of Medicine, and The Lancet between 2007 and 2017. The primary exposure was trial type, superiority versus noninferiority, as determined by the hypothesis testing framework of the primary trial outcome. The primary outcome was trial protocol adherence rate, defined as the number of randomized subjects receiving the allocated intervention as described by the trial protocol and followed to primary outcome ascertainment (numerator), over the total number of subjects randomized (denominator). Hypothesis confirmation was defined as affirmation of noninferiority or the alternative hypothesis for noninferiority and superiority trials, respectively. RESULTS: Among 120 superiority and 120 noninferiority trials, median and interquartile protocol adherence rates were 91.5 [81.4-96.7] and 89.8 [83.6-95.2], respectively; P = 0.47. Hypothesis confirmation was observed in 107/120 (89.2%) of noninferiority and 64/120 (53.3%) of superiority trials, risk difference (95% confidence interval): 35.8 (25.3-46.3), P < 0.001. CONCLUSION: Protocol adherence rates are similar between superiority and noninferiority trials published in three high impact medical journals. Despite this, we observed greater hypothesis confirmation among noninferiority trials. We speculate that publication bias, lenient noninferiority margins and other sources of bias may contribute to this finding. Further study is needed to identify the reasons for this observed difference.
Authors: Behnood Bikdeli; John W Welsh; Yasir Akram; Natdanai Punnanithinont; Ike Lee; Nihar R Desai; Sanjay Kaul; Gregg W Stone; Joseph S Ross; Harlan M Krumholz Journal: Circulation Date: 2019-06-10 Impact factor: 29.690
Authors: Grace Wangge; Olaf H Klungel; Kit C B Roes; Anthonius de Boer; Arno W Hoes; Mirjam J Knol Journal: PLoS One Date: 2010-10-27 Impact factor: 3.240
Authors: Erick H Turner; Annette M Matthews; Eftihia Linardatos; Robert A Tell; Robert Rosenthal Journal: N Engl J Med Date: 2008-01-17 Impact factor: 91.245
Authors: Tammy C Hoffmann; Paul P Glasziou; Isabelle Boutron; Ruairidh Milne; Rafael Perera; David Moher; Douglas G Altman; Virginia Barbour; Helen Macdonald; Marie Johnston; Sarah E Lamb; Mary Dixon-Woods; Peter McCulloch; Jeremy C Wyatt; An-Wen Chan; Susan Michie Journal: BMJ Date: 2014-03-07
Authors: Sameer Parpia; Jim A Julian; Lehana Thabane; Chushu Gu; Timothy J Whelan; Mark N Levine Journal: BMJ Open Date: 2014-10-24 Impact factor: 2.692