Sam Adie1, Ian A Harris1, Justine M Naylor1, Rajat Mittal1. 1. All authors are from the Whitlam Orthopaedic Research Centre, Ingham Institute for Applied Medical Research, Liverpool, New South Wales, Australia.
Abstract
BACKGROUND: The dangers of using surrogate outcomes are well documented. They may have little or no association with their patient-important correlates, leading to the approval and use of interventions that lack efficacy. We sought to assess whether primary outcomes in surgical randomized controlled trials (RCTs) are more likely to be patient-important outcomes than surrogate or laboratory-based outcomes. METHODS: We reviewed RCTs assessing an operative intervention published in 2008 and 2009 and indexed in MEDLINE, EMBASE or the Cochrane Central Register of Controlled Trials. After a pilot of the selection criteria, 1 reviewer selected trials and another reviewer checked the selection. We extracted information on outcome characteristics (patient-important, surrogate, or laboratory-based outcome) and whether they were primary or secondary outcomes. We calculated odds ratios (OR) and pooled in random-effects meta-analysis to obtain an overall estimate of the association between patient importance and primary outcome specification. RESULTS: In 350 included RCTs, a total of 8258 outcomes were reported (median 18 per trial. The mean proportion (per trial) of patient-important outcomes was 60%, and 66% of trials specified a patient-important primary outcome. The most commonly reported patient-important primary outcomes were morbid events (41%), intervention outcomes (11%), function (11%) and pain (9%). Surrogate and laboratory-based primary outcomes were reported in 33% and 8% of trials, respectively. Patient-important outcomes were not associated with primary outcome status (OR 0.82, 95% confidence interval 0.63-1.1, I2 = 21%). CONCLUSION: A substantial proportion of surgical RCTs specify primary outcomes that are not patient-important. Authors, journals and trial funders should insist that patient-important outcomes are the focus of study.
BACKGROUND: The dangers of using surrogate outcomes are well documented. They may have little or no association with their patient-important correlates, leading to the approval and use of interventions that lack efficacy. We sought to assess whether primary outcomes in surgical randomized controlled trials (RCTs) are more likely to be patient-important outcomes than surrogate or laboratory-based outcomes. METHODS: We reviewed RCTs assessing an operative intervention published in 2008 and 2009 and indexed in MEDLINE, EMBASE or the Cochrane Central Register of Controlled Trials. After a pilot of the selection criteria, 1 reviewer selected trials and another reviewer checked the selection. We extracted information on outcome characteristics (patient-important, surrogate, or laboratory-based outcome) and whether they were primary or secondary outcomes. We calculated odds ratios (OR) and pooled in random-effects meta-analysis to obtain an overall estimate of the association between patient importance and primary outcome specification. RESULTS: In 350 included RCTs, a total of 8258 outcomes were reported (median 18 per trial. The mean proportion (per trial) of patient-important outcomes was 60%, and 66% of trials specified a patient-important primary outcome. The most commonly reported patient-important primary outcomes were morbid events (41%), intervention outcomes (11%), function (11%) and pain (9%). Surrogate and laboratory-based primary outcomes were reported in 33% and 8% of trials, respectively. Patient-important outcomes were not associated with primary outcome status (OR 0.82, 95% confidence interval 0.63-1.1, I2 = 21%). CONCLUSION: A substantial proportion of surgical RCTs specify primary outcomes that are not patient-important. Authors, journals and trial funders should insist that patient-important outcomes are the focus of study.
Authors: Jeffrey S Barkun; Jeffrey K Aronson; Liane S Feldman; Guy J Maddern; Steven M Strasberg; Douglas G Altman; Jeffrey S Barkun; Jane M Blazeby; Isabell C Boutron; W Bruce Campbell; Pierre-Alain Clavien; Jonathan A Cook; Patrick L Ergina; David R Flum; Paul Glasziou; John C Marshall; Peter McCulloch; Jon Nicholl; Bournaby C Reeves; Christoph M Seiler; Jonathan L Meakins; Deborah Ashby; Nick Black; John Bunker; Martin Burton; Marion Campbell; Kalipso Chalkidou; Iain Chalmers; Marc de Leval; Jon Deeks; Adrian Grant; Muir Gray; Roger Greenhalgh; Milos Jenicek; Sean Kehoe; Richard Lilford; Peter Littlejohns; Yoon Loke; Rajan Madhock; Kim McPherson; Peter Rothwell; Bill Summerskill; David Taggart; Parris Tekkis; Matthew Thompson; Tom Treasure; Ulrich Trohler; Jan Vandenbroucke Journal: Lancet Date: 2009-09-26 Impact factor: 79.321
Authors: U A Liberman; S R Weiss; J Bröll; H W Minne; H Quan; N H Bell; J Rodriguez-Portales; R W Downs; J Dequeker; M Favus Journal: N Engl J Med Date: 1995-11-30 Impact factor: 91.245
Authors: Gunjan Y Gandhi; M Hassan Murad; Akira Fujiyoshi; Rebecca J Mullan; David N Flynn; Mohamed B Elamin; Brian A Swiglo; William L Isley; Gordon H Guyatt; Victor M Montori Journal: JAMA Date: 2008-06-04 Impact factor: 56.272
Authors: Giuseppe Giaccone; Roy S Herbst; Christian Manegold; Giorgio Scagliotti; Rafael Rosell; Vincent Miller; Ronald B Natale; Joan H Schiller; Joachim Von Pawel; Anna Pluzanska; Ulrich Gatzemeier; John Grous; Judith S Ochs; Steven D Averbuch; Michael K Wolf; Pamela Rennie; Abderrahim Fandi; David H Johnson Journal: J Clin Oncol Date: 2004-03-01 Impact factor: 44.544
Authors: Zet Wei Tan; Aidan Christopher Tan; Tom Li; Ian Harris; Justine M Naylor; Michiel Siebelt; Jasper van Tiel; Marina Pinheiro; Laura Harris; Kira Chamberlain; Sam Adie Journal: BMJ Open Date: 2020-08-26 Impact factor: 2.692