Literature DB >> 33439120

A retrospective analysis of the peer review of more than 75,000 Marie Curie proposals between 2007 and 2018.

David G Pina1, Ivan Buljan2, Darko Hren3, Ana Marušić2.   

Abstract

Most funding agencies rely on peer review to evaluate grant applications and proposals, but research into the use of this process by funding agencies has been limited. Here we explore if two changes to the organization of peer review for proposals submitted to various funding actions by the European Union has an influence on the outcome of the peer review process. Based on an analysis of more than 75,000 applications to three actions of the Marie Curie programme over a period of 12 years, we find that the changes - a reduction in the number of evaluation criteria used by reviewers and a move from in-person to virtual meetings - had little impact on the outcome of the peer review process. Our results indicate that other factors, such as the type of grant or area of research, have a larger impact on the outcome.
© 2021, Pina et al.

Entities:  

Keywords:  Marie Skłodowska-Curie Actions; grant evaluation; meta-research; none; peer review; research funding; reviewer agreement

Mesh:

Year:  2021        PMID: 33439120      PMCID: PMC7806263          DOI: 10.7554/eLife.59338

Source DB:  PubMed          Journal:  Elife        ISSN: 2050-084X            Impact factor:   8.140


  31 in total

1.  Peering at peer review revealed high degree of chance associated with funding of grant applications.

Authors:  Nancy E Mayo; James Brophy; Mark S Goldberg; Marina B Klein; Sydney Miller; Robert W Platt; Judith Ritchie
Journal:  J Clin Epidemiol       Date:  2006-03-27       Impact factor: 6.437

2.  Improving the peer-review process for grant applications: reliability, validity, bias, and generalizability.

Authors:  Herbert W Marsh; Upali W Jayasinghe; Nigel W Bond
Journal:  Am Psychol       Date:  2008-04

Review 3.  Peer review of grant applications: what do we know?

Authors:  S Wessely
Journal:  Lancet       Date:  1998-07-25       Impact factor: 79.321

4.  Low agreement among reviewers evaluating the same NIH grant applications.

Authors:  Elizabeth L Pier; Markus Brauer; Amarette Filut; Anna Kaatz; Joshua Raclaw; Mitchell J Nathan; Cecilia E Ford; Molly Carnes
Journal:  Proc Natl Acad Sci U S A       Date:  2018-03-05       Impact factor: 11.205

5.  Substantial agreement of referee recommendations at a general medical journal--a peer review evaluation at Deutsches Ärzteblatt International.

Authors:  Christopher Baethge; Jeremy Franklin; Stephan Mertens
Journal:  PLoS One       Date:  2013-05-02       Impact factor: 3.240

6.  A reliability-generalization study of journal peer reviews: a multilevel meta-analysis of inter-rater reliability and its determinants.

Authors:  Lutz Bornmann; Rüdiger Mutz; Hans-Dieter Daniel
Journal:  PLoS One       Date:  2010-12-14       Impact factor: 3.240

7.  Sample size and precision in NIH peer review.

Authors:  David Kaplan; Nicola Lacetera; Celia Kaplan
Journal:  PLoS One       Date:  2008-07-23       Impact factor: 3.240

8.  Grant Peer Review: Improving Inter-Rater Reliability with Training.

Authors:  David N Sattler; Patrick E McKnight; Linda Naney; Randy Mathis
Journal:  PLoS One       Date:  2015-06-15       Impact factor: 3.240

9.  Examining the Predictive Validity of NIH Peer Review Scores.

Authors:  Mark D Lindner; Richard K Nakamura
Journal:  PLoS One       Date:  2015-06-03       Impact factor: 3.240

Review 10.  Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

Authors:  Jonathan Shepherd; Geoff K Frampton; Karen Pickett; Jeremy C Wyatt
Journal:  PLoS One       Date:  2018-05-11       Impact factor: 3.240

View more
  3 in total

1.  Ethics appraisal procedure in 79,670 Marie Skłodowska-Curie proposals from the entire European HORIZON 2020 research and innovation program (2014-2020): A retrospective analysis.

Authors:  Ilse De Waele; David Wizel; Livia Puljak; Zvonimir Koporc
Journal:  PLoS One       Date:  2021-11-04       Impact factor: 3.240

2.  Ten simple rules for a successful EU Marie Skłodowska-Curie Actions Postdoctoral (MSCA) fellowship application.

Authors:  Philipp Baumert; Francesco Cenni; Mikhail L Antonkine
Journal:  PLoS Comput Biol       Date:  2022-08-18       Impact factor: 4.779

3.  Zoom fatigue saps grant reviewers' attention.

Authors:  Dalmeet Singh Chawla
Journal:  Nature       Date:  2021-02       Impact factor: 49.962

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.