S J Isenberg1, E Sanchez, K C Zafran. 1. Jules Stein Eye Institute at the David Geffen School of Medicine at UCLA, Los Angeles, CA 90095-7000, USA. isenberg@ucla.edu
Abstract
BACKGROUND/AIM: To investigate the effect of masking the author's identity to peer reviewers on reviewer bias in an ophthalmic subspecialty journal. DESIGN: A retrospective study of 531 manuscripts, involving 1182 masked reviews, submitted to Journal of American Association for Pediatric Ophthalmology and Strabismus from 2000 to 2005. METHODS: Data were extracted from recommendation forms completed by each referee during review. Investigated variables consisted of reviewer's knowledge of author identity, recommendation (accept, revise, or reject publishing), eventual manuscript status (published or not), review quality, gender, country, medical practice setting (academic or private) and editorial board status. RESULTS: This study involved the largest number of manuscripts ever used to evaluate the importance of author masking. Reviewer's knowledge of the author's identity had no effect on review quality. However, proportionally fewer manuscripts were published when there was no idea of the author's identity, compared with when it was allegedly known or suspected (p<0.0001). Manuscripts had lower recommendation scores when there was no idea of the author's identity compared with when allegedly known (p = 0.0001) or suspected (p = 0.004). CONCLUSION: Reviewers were more favourable when they allegedly knew or suspected the author's identity. Double-masking may improve the quality of biomedical publishing or at least reduce reviewer bias for effectively masked manuscripts.
BACKGROUND/AIM: To investigate the effect of masking the author's identity to peer reviewers on reviewer bias in an ophthalmic subspecialty journal. DESIGN: A retrospective study of 531 manuscripts, involving 1182 masked reviews, submitted to Journal of American Association for Pediatric Ophthalmology and Strabismus from 2000 to 2005. METHODS: Data were extracted from recommendation forms completed by each referee during review. Investigated variables consisted of reviewer's knowledge of author identity, recommendation (accept, revise, or reject publishing), eventual manuscript status (published or not), review quality, gender, country, medical practice setting (academic or private) and editorial board status. RESULTS: This study involved the largest number of manuscripts ever used to evaluate the importance of author masking. Reviewer's knowledge of the author's identity had no effect on review quality. However, proportionally fewer manuscripts were published when there was no idea of the author's identity, compared with when it was allegedly known or suspected (p<0.0001). Manuscripts had lower recommendation scores when there was no idea of the author's identity compared with when allegedly known (p = 0.0001) or suspected (p = 0.004). CONCLUSION: Reviewers were more favourable when they allegedly knew or suspected the author's identity. Double-masking may improve the quality of biomedical publishing or at least reduce reviewer bias for effectively masked manuscripts.
Authors: Jonathan P Tennant; Jonathan M Dugan; Daniel Graziotin; Damien C Jacques; François Waldner; Daniel Mietchen; Yehia Elkhatib; Lauren B Collister; Christina K Pikas; Tom Crick; Paola Masuzzo; Anthony Caravaggi; Devin R Berg; Kyle E Niemeyer; Tony Ross-Hellauer; Sara Mannheimer; Lillian Rigling; Daniel S Katz; Bastian Greshake Tzovaras; Josmel Pacheco-Mendoza; Nazeefa Fatima; Marta Poblet; Marios Isaakidis; Dasapta Erwin Irawan; Sébastien Renaut; Christopher R Madan; Lisa Matthias; Jesper Nørgaard Kjær; Daniel Paul O'Donnell; Cameron Neylon; Sarah Kearns; Manojkumar Selvaraju; Julien Colomb Journal: F1000Res Date: 2017-07-20