Amélie Yavchitz1, Philippe Ravaud2, Douglas G Altman3, David Moher4, Asbjørn Hrobjartsson5, Toby Lasserson6, Isabelle Boutron7. 1. Centre de Recherche Épidémiologie et Statistique Sorbonne Paris Cité (CRESS-UMR1153), Inserm/Université Paris Descartes, 1 place du Parvis Notre Dame, Paris 75004, France; Centre d'Épidémiologie Clinique, AP-HP (Assistance Publique des Hôpitaux de Paris), Hôpital Hôtel Dieu, 1 place du Parvis Notre Dame, Paris, France; French Cochrane Center, Paris Descartes University, Sorbonne Paris Cité, Faculté de Médecine, 1 place du Parvis Notre Dame, Paris 75004, France. Electronic address: amelie.yavchitz@aphp.fr. 2. Centre de Recherche Épidémiologie et Statistique Sorbonne Paris Cité (CRESS-UMR1153), Inserm/Université Paris Descartes, 1 place du Parvis Notre Dame, Paris 75004, France; Centre d'Épidémiologie Clinique, AP-HP (Assistance Publique des Hôpitaux de Paris), Hôpital Hôtel Dieu, 1 place du Parvis Notre Dame, Paris, France; French Cochrane Center, Paris Descartes University, Sorbonne Paris Cité, Faculté de Médecine, 1 place du Parvis Notre Dame, Paris 75004, France; Department of Epidemiology, Columbia University Mailman School of Public Health, New York, NY, USA. 3. Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK. 4. Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology, Public health and Preventive Medicine, Faculty of Medicine, University of Ottawa, Canada. 5. Nordic Cochrane Centre, Rigshospitalet Department 7811, Copenhagen, Denmark; Research Unit for Evidence-Based Medicine, Odense University Hospital/University of Southern Denmark, Odense, Denmark. 6. Cochrane Editorial Unit, London, UK. 7. Centre de Recherche Épidémiologie et Statistique Sorbonne Paris Cité (CRESS-UMR1153), Inserm/Université Paris Descartes, 1 place du Parvis Notre Dame, Paris 75004, France; Centre d'Épidémiologie Clinique, AP-HP (Assistance Publique des Hôpitaux de Paris), Hôpital Hôtel Dieu, 1 place du Parvis Notre Dame, Paris, France; French Cochrane Center, Paris Descartes University, Sorbonne Paris Cité, Faculté de Médecine, 1 place du Parvis Notre Dame, Paris 75004, France.
Abstract
OBJECTIVES: We aimed to (1) identify and classify spin (i.e., a description that overstates efficacy and/or understates harm) in systematic reviews and (2) rank spin in abstracts of systematic reviews according to their severity (i.e., the likelihood of distorting readers' interpretation of the results). STUDY DESIGN: First, we used a four-phase consensus process to develop a classification of different types of spin. Second, we ranked the types of spin in abstracts according to their severity using a Q-sort survey with members of the Cochrane Collaboration. RESULTS: We identified 39 types of spin, 28 from the main text and 21 from the abstract; 13 were specific to the systematic review design. Spin was classified into three categories: (1) misleading reporting, (2) misleading interpretation, and (3) inappropriate extrapolation. Spin ranked as the most severe by the 122 people who participated in the survey were (1) recommendations for clinical practice not supported by findings in the conclusion, (2) misleading title, and (3) selective reporting. CONCLUSION: This study allowed for identifying spin that is likely to distort interpretation. Our classification could help authors, editors, and reviewers avoid spin in reports of systematic reviews.
OBJECTIVES: We aimed to (1) identify and classify spin (i.e., a description that overstates efficacy and/or understates harm) in systematic reviews and (2) rank spin in abstracts of systematic reviews according to their severity (i.e., the likelihood of distorting readers' interpretation of the results). STUDY DESIGN: First, we used a four-phase consensus process to develop a classification of different types of spin. Second, we ranked the types of spin in abstracts according to their severity using a Q-sort survey with members of the Cochrane Collaboration. RESULTS: We identified 39 types of spin, 28 from the main text and 21 from the abstract; 13 were specific to the systematic review design. Spin was classified into three categories: (1) misleading reporting, (2) misleading interpretation, and (3) inappropriate extrapolation. Spin ranked as the most severe by the 122 people who participated in the survey were (1) recommendations for clinical practice not supported by findings in the conclusion, (2) misleading title, and (3) selective reporting. CONCLUSION: This study allowed for identifying spin that is likely to distort interpretation. Our classification could help authors, editors, and reviewers avoid spin in reports of systematic reviews.
Authors: Romana Haneef; Amélie Yavchitz; Philippe Ravaud; Gabriel Baron; Ivan Oransky; Gary Schwitzer; Isabelle Boutron Journal: BMJ Open Date: 2017-11-17 Impact factor: 2.692