Richard Horton1. 1. The Lancet, 32 Jamestown Rd, London NW1 78Y, England. richard.horton@lancet.com
Abstract
CONTEXT: To determine whether the views expressed in a research paper are accurate representations of contributors' opinions about the research being reported. METHODS: Purposive sampling of 10 research articles published in The Lancet; qualitative analysis of answers to 6 questions about the meaning of the study put to contributors who were listed on the byline of these articles. Fifty-four contributors listed on the bylines of the 10 articles were evaluated, and answers to questions were compared between contributors within research groups and against the published research report. RESULTS: A total of 36 (67%) of 54 contributors replied to this survey. Important weaknesses were often admitted on direct questioning but were not included in the published article. Contributors frequently disagreed about the importance of their findings, implications, and directions for future research. I could find no effort to study systematically past evidence relating to the investigators' own findings in either survey responses or the published article. Overall, the diversity of contributor opinion was commonly excluded from the published report. I found that discussion sections were haphazardly organized and did not deal systematically with important questions about the study. CONCLUSIONS: A research paper rarely represents the opinions of those scientists whose work it reports. The findings described herein reveal evidence of (self-)censored criticism, obscured meanings, confused assessment of implications, and failures to indicate directions for future research. There is now empirical support for the introduction of structured discussion sections in research papers. Editors might also explore ways to recover the plurality of contributors' opinions.
CONTEXT: To determine whether the views expressed in a research paper are accurate representations of contributors' opinions about the research being reported. METHODS: Purposive sampling of 10 research articles published in The Lancet; qualitative analysis of answers to 6 questions about the meaning of the study put to contributors who were listed on the byline of these articles. Fifty-four contributors listed on the bylines of the 10 articles were evaluated, and answers to questions were compared between contributors within research groups and against the published research report. RESULTS: A total of 36 (67%) of 54 contributors replied to this survey. Important weaknesses were often admitted on direct questioning but were not included in the published article. Contributors frequently disagreed about the importance of their findings, implications, and directions for future research. I could find no effort to study systematically past evidence relating to the investigators' own findings in either survey responses or the published article. Overall, the diversity of contributor opinion was commonly excluded from the published report. I found that discussion sections were haphazardly organized and did not deal systematically with important questions about the study. CONCLUSIONS: A research paper rarely represents the opinions of those scientists whose work it reports. The findings described herein reveal evidence of (self-)censored criticism, obscured meanings, confused assessment of implications, and failures to indicate directions for future research. There is now empirical support for the introduction of structured discussion sections in research papers. Editors might also explore ways to recover the plurality of contributors' opinions.
Keywords:
Biomedical and Behavioral Research; Empirical Approach
Authors: Charlotte E Dean; Shazia Akhtar; Tim M Gale; Karen Irvine; Dominique Grohmann; Keith R Laws Journal: PLoS One Date: 2022-05-04 Impact factor: 3.752
Authors: Amélie Yavchitz; Isabelle Boutron; Aida Bafeta; Ibrahim Marroun; Pierre Charles; Jean Mantz; Philippe Ravaud Journal: PLoS Med Date: 2012-09-11 Impact factor: 11.069
Authors: A Cecile J W Janssens; John P A Ioannidis; Sara Bedrosian; Paolo Boffetta; Siobhan M Dolan; Nicole Dowling; Isabel Fortier; Andrew N Freedman; Jeremy M Grimshaw; Jeffrey Gulcher; Marta Gwinn; Mark A Hlatky; Holly Janes; Peter Kraft; Stephanie Melillo; Christopher J O'Donnell; Michael J Pencina; David Ransohoff; Sheri D Schully; Daniela Seminara; Deborah M Winn; Caroline F Wright; Cornelia M van Duijn; Julian Little; Muin J Khoury Journal: Eur J Epidemiol Date: 2011-04 Impact factor: 8.082
Authors: A Cecile J W Janssens; John P A Ioannidis; Sara Bedrosian; Paolo Boffetta; Siobhan M Dolan; Nicole Dowling; Isabel Fortier; Andrew N Freedman; Jeremy M Grimshaw; Jeffrey Gulcher; Marta Gwinn; Mark A Hlatky; Holly Janes; Peter Kraft; Stephanie Melillo; Christopher J O'Donnell; Michael J Pencina; David Ransohoff; Sheri D Schully; Daniela Seminara; Deborah M Winn; Caroline F Wright; Cornelia M van Duijn; Julian Little; Muin J Khoury Journal: Eur J Hum Genet Date: 2011-05 Impact factor: 4.246
Authors: Reinie G Gerrits; Tessa Jansen; Joko Mulyanto; Michael J van den Berg; Niek S Klazinga; Dionne S Kringos Journal: BMJ Open Date: 2019-05-15 Impact factor: 2.692
Authors: Jan P Vandenbroucke; Erik von Elm; Douglas G Altman; Peter C Gøtzsche; Cynthia D Mulrow; Stuart J Pocock; Charles Poole; James J Schlesselman; Matthias Egger Journal: PLoS Med Date: 2007-10-16 Impact factor: 11.069
Authors: Gerben Ter Riet; Paula Chesley; Alan G Gross; Lara Siebeling; Patrick Muggensturm; Nadine Heller; Martin Umbehr; Daniela Vollenweider; Tsung Yu; Elie A Akl; Lizzy Brewster; Olaf M Dekkers; Ingrid Mühlhauser; Bernd Richter; Sonal Singh; Steven Goodman; Milo A Puhan Journal: PLoS One Date: 2013-11-20 Impact factor: 3.240