Norman R Williams 1 , Hannah Patrick 2 , Francesca Fiorentino 3 , Alexander Allen 4 , Manuj Sharma 5 , Mišel Milošević 6 , Fergus Macbeth 7 , Tom Treasure 8 . Show Affiliations »
Abstract
OBJECTIVES: The objective of this review was to assess the nature and tone of the published responses to the Pulmonary Metastasectomy in Colorectal Cancer (PulMiCC) randomized controlled trial. METHODS: Published articles that cited the PulMiCC trial were identified from Clarivate Web of Science (©. Duplicates and self-citations were excluded and relevant text was extracted. Four independent researchers rated the extracts independently using agreed scales for the representativeness of trial data and the textual tone. The ratings were aggregated and summarized. Two PulMiCC authors carried out a thematic analysis of the extracts. RESULTS: Sixty-four citations were identified and relevant text was extracted and examined. The consensus rating for data inclusion was a median of 0.25 out of 6 (range 0-5.25, interquartile range 0-1.5) and, for textual tone, the median rating was 1.87 out of 6 (range 0-5.75, interquartile range 1-3.5). The majority of citations did not provide adequate representation of the PulMiCC data and the overall textual tone was dismissive. Although some were supportive, many discounted the findings because the trial closed early and was underpowered to show non-inferiority. Two misinterpreted the authors' conclusions but there was an acceptance that 5-year survival was much higher than widely assumed. CONCLUSIONS: Published comments reveal a widespread reluctance to consider seriously the results of a carefully conducted randomized trial. This may be because the results challenge accepted practice because of 'motivated reasoning', but there is a widespread misunderstanding of the fact that though PulMiCC with 93 patients was underpowered to test non-inferiority, it still provides reliable evidence to undermine the widespread belief in a major survival benefit from metastasectomy.
OBJECTIVES: The objective of this review was to assess the nature and tone of the published responses to the Pulmonary Metastasectomy in Colorectal Cancer (PulMiCC) randomized controlled trial. METHODS: Published articles that cited the PulMiCC trial were identified from Clarivate Web of Science (©. Duplicates and self-citations were excluded and relevant text was extracted. Four independent researchers rated the extracts independently using agreed scales for the representativeness of trial data and the textual tone. The ratings were aggregated and summarized. Two PulMiCC authors carried out a thematic analysis of the extracts. RESULTS: Sixty-four citations were identified and relevant text was extracted and examined. The consensus rating for data inclusion was a median of 0.25 out of 6 (range 0-5.25, interquartile range 0-1.5) and, for textual tone, the median rating was 1.87 out of 6 (range 0-5.75, interquartile range 1-3.5). The majority of citations did not provide adequate representation of the PulMiCC data and the overall textual tone was dismissive. Although some were supportive, many discounted the findings because the trial closed early and was underpowered to show non-inferiority. Two misinterpreted the authors' conclusions but there was an acceptance that 5-year survival was much higher than widely assumed. CONCLUSIONS: Published comments reveal a widespread reluctance to consider seriously the results of a carefully conducted randomized trial. This may be because the results challenge accepted practice because of 'motivated reasoning', but there is a widespread misunderstanding of the fact that though PulMiCC with 93 patients was underpowered to test non-inferiority, it still provides reliable evidence to undermine the widespread belief in a major survival benefit from metastasectomy.
© The Author(s) 2022. Published by Oxford University Press on behalf of the European Association for Cardio-Thoracic Surgery. All rights reserved.
Entities: Chemical
Keywords:
Citation index; Colorectal cancer; Motivated reasoning; Pulmonary metastasectomy; Randomised controlled trial
Mesh: See more »
Year: 2022
PMID: 35415756 PMCID: PMC9257793 DOI: 10.1093/ejcts/ezac253
Source DB: PubMed Journal: Eur J Cardiothorac Surg ISSN: 1010-7940 Impact factor: 4.534