| Literature DB >> 31215105 |
Stephanie Meirmans1, Roger K Butlin2,3, Anne Charmantier4, Jan Engelstädter5, Astrid T Groot6, Kayla C King7, Hanna Kokko8, Jane M Reid9, Maurine Neiman10,11.
Abstract
In an ideal world, funding agencies could identify the best scientists and projects and provide them with the resources to undertake these projects. Most scientists would agree that in practice, how funding for scientific research is allocated is far from ideal and likely compromises research quality. We, nine evolutionary biologists from different countries and career stages, provide a comparative summary of our impressions on funding strategies for evolutionary biology across eleven different funding agencies. We also assess whether and how funding effectiveness might be improved. We focused this assessment on 14 elements within four broad categories: (a) topical shaping of science, (b) distribution of funds, (c) application and review procedures, and (d) incentives for mobility and diversity. These comparisons revealed striking among-country variation in those elements, including wide variation in funding rates, the effort and burden required for grant applications, and the extent of emphasis on societal relevance and individual mobility. We use these observations to provide constructive suggestions for the future and urge the need to further gather informed considerations from scientists on the effects of funding policies on science across countries and research fields.Entities:
Keywords: funding; funding rate; grant proposal; science policy; scientific quality
Year: 2019 PMID: 31215105 PMCID: PMC6771946 DOI: 10.1111/jeb.13497
Source DB: PubMed Journal: J Evol Biol ISSN: 1010-061X Impact factor: 2.411
Details of reviewed funding agencies. All details have been assessed in late 2017/early 2018; additional newer schemes indicated as well for the Netherlands. All details expressed are personal views
| Country | Statements in Tables |
|---|---|
| Australia | The Australian Research Council (ARC), the main governmental funding body for research; some of the statements are based on Discovery Projects, the ARC's main funding instrument for nonapplied research |
| Canada | Natural Sciences and Engineering Research Council of Canada (NSERC), Canada's federal funding agency; some of the statements are based on Discovery Grants |
| ERC | Mainly to the Starting, Consolidator and Advanced grant schemes of the European Research Council (ERC) |
| France | French National Research Agency (ANR), the main governmental funding body for research |
| Germany | Deutsche Forschungsgemeinschaft (DGF); more specifically, some of the statements are based on individual project grants (“Sachbeihilfe”) |
| Netherlands | ALW programme of the Netherlands Organisation for Scientific Research (NWO) until May 2018; since August 2018 new ENW programme (indicated where these programs differ) |
| Portugal | Foundation for Science and Technology (FCT) |
| Sweden | Swedish Research Council's board for Science and Engineering and the yearly announcement of project grants. |
| Switzerland | Swiss National Science Foundation (SNSF), the main governmental funding body for research. Some of the statements are based on Project Grants within Biology and Medicine |
| UK | Natural Environment Research Council, primarily to their “Discovery grants” and “individual fellowship” schemes. The Biotechnology and Biological Sciences Research Council operates a similar, but not identical system |
| United States | US National Science Foundation (NSF) and the US National Institutes of Health (NIH) |
Assessment of elements regarding the topical shaping of science across funding agencies
| Country | Emphasis on societal relevance/broader impacts? | Investment in bottom‐up blue‐sky research vs. top‐down funding programmes | Integration of funding programmes for basic and applied science/science with societal relevance? |
|---|---|---|---|
| Australia | Yes | Mostly bottom‐up | Same funding agency but different instruments; societal relevance also important for basic science projects |
| Canada | Yes | Mostly bottom‐up | Yes |
| ERC | No: Emphasis on scientific excellence but societal relevance is considered | Exclusively bottom‐up | Yes: Main schemes fund basic research but supplementary schemes are available to develop impact |
| France | Yes: Projects focusing on 9 major societal challenges (50% of funding) | Half bottom‐up/half top‐down | Yes: Same funding agency, some calls offer possibility to integrate both types of projects |
| Germany | No: Emphasis on basic research, but follow‐up “transfer” funding with nonacademic partners possible | Mostly bottom‐up; ~7% of DFG funding goes into top‐down “Priority programmes” | Same funding agency but different instruments, for example clinical trial grants |
| Netherlands | Yes: Societal relevance 20% of the total score (ALW); this has recently changed to impact and risen to 30% in some calls (ENW) | Bottom‐up; some specific calls; consortia often have specific constraints | Yes: Societal relevance and/or impact important. ENW: Some consortia require industrial or societal partners who co‐fund the project; consortia topics can be informed by societal/economic relevance (Top sectors; Dutch national research agenda) |
| Portugal | Yes: Very important | Bottom‐up | Yes: same funding agency, same scheme |
| Sweden | No: Only scientific value is considered. | All bottom‐up; but also some specific calls | No: There are other governmental funding bodies that announce grants with societal relevance |
| Switzerland | No: Emphasis on high‐quality basic research | Mostly bottom‐up | No: Basic research funded by SNF, applied science funded by KTI, which is done at technical colleges |
| UK | Yes: Societal impact is considered in all funding schemes, including “Discovery grants” (funding route for basic science) | 1/3rd bottom‐up; also some scientific community input to strategic research programmes | Yes: All schemes require some contribution to societal impact; the extent of the contribution required varies among schemes |
| United States | Yes: Broader impacts required for NSF; NIH grants relevant to human health | Mostly bottom‐up | Same funding agency, increasing emphasis on funding for broader impacts activities within basic science grants at NSF. |
Assessment of elements regarding the distribution of funds across eleven funding agencies
| Country | Allocation of money | Consortia vs. personal stipends | Long‐ vs. short‐term | Flexibility of funding schemes | Funding rates, and who can apply? |
|---|---|---|---|---|---|
| Australia | Mostly intermediate (~400 k$), but also a few large grants | Project grants predominate; teams with >1 applicants normal | 3–5 years for research projects | Flexible (budget between $30 k and $500 k per year) | Funding rate: ~18% (Discovery Projects); all employees of Australian Universities can apply, and there can be international partner investigators. Max of two grants per person |
| Canada | Small amounts (35 k$ typical), many awardees | Personal stipends | 5 years | Flexible | Funding rate: 70%–75%. Only Prof. or Adjunct Prof. can apply |
| ERC | Large (1.5–2.5 M€) | Mostly individual‐led projects; synergy grants for cross‐disciplinary teams | 5 years | Flexible, but ambitious projects expected | Funding rate: ~10%. Restrictions on working time since PhD (Starting and Consolidator). Applicants must have a base in a suitable EU institution. |
| France | Intermediate to large (200–900 k€) | Consortia grants predominate; 75% collaborative projects | 2–4 years | Flexible | Funding rate: 10%–15%. Permanent researchers at University/Research Center can apply |
| Germany | Intermediate (~230 k€); larger grants for consortia etc. | Project grants with single applicant predominate | ≦3 years for research projects | Flexible | Funding rate: 36% (Individual research projects). Researchers holding a PhD at all German research institutions can apply |
| Netherlands | ALW: intermediate; ENW: various types, from small to large (160 k€–3 M€), some even bigger grants |
ALW: Personal grant to PI | ALW: 4 years |
ALW: Quite fixed | Funding rate ~10% (data for ALW; no data yet for ENW). Permanent faculty can apply, tenure‐track PIs with declaration that the applicant will be hired for project duration |
| Portugal | Intermediate (up to 200 k€) | Both. Not clear which is preferred | 3 years | Quite fixed; budget justifications | Funding rate between 5% and 8%. Anyone with a PhD is allowed to apply |
| Sweden | Intermediate (400 k€) and many awardees | Project grants to main applicant | 4 years | Very flexible | Funding rate 20%. Staff affiliated to Swedish university at least 20% of their time can apply |
| Switzerland | Intermediate: regular grants (~500 kCHF); also some larger grants | Project grants predominate, single applicant preferred | 1–4 years for research projects | Flexible (budget of at least 50 kCHF) | Funding rate: 43% (Project grants in Biology & Medicine). Researchers ≥4 years post‐PhD. Only one application per round, up to two in total |
| UK | Intermediate: 65‐800 k£; also large grants | Project grants predominate, often teams. Fellowships also available. | 3 years for projects, 5 for fellowships | Flexible, but detailed cost justification required | Funding rate: ~20%. Only researchers with contracts extending beyond the grant period may apply. Institutional application quotas apply |
| United States | Intermediate (~100–250 k$); also some smaller and bigger grants | Project grants predominate, teams with >1 applicants are common | Typically 2–5 years | Somewhat flexible; NSF requires budget justification | Funding rate: <10%–25%. Who can apply is dependent on the grant (often PI status needed, some to post‐docs and graduate students) |
Assessment of elements regarding the application and review procedures across funding agencies
| Country | Who/what is being judged | Administrative burden/length of proposals | Who is reviewing? | Existence of interviews and rebuttals |
|---|---|---|---|---|
| Australia | Main scheme: 40% project quality, 35% investigators, 10% feasibility, 15% benefit | High burden: In total, an application >50 pages, often several investigators | Panel of experts, external reviewers | Rebuttals |
| Canada | Excellence of candidate, proposal quality, Highly Qualified Personnel Training | Intermediate burden: 5 pages or research proposal plus budget, HQP training and CV | Panel of experts, external reviewers | No rebuttal, no interview |
| ERC | Project and investigator; over‐riding criterion is scientific excellence | High burden: Round 1 (5‐page proposal + CV, track record) and Round 2 (20‐page proposal, budget proposals) submitted together | Round 1: Panel, round 2: panel and external reviewers | No rebuttals, interview at Starter or Consolidator level |
| France | Quality and originality of project, quality and expertise of consortium, adequacy of budget, impact and diffusion strategy | High burden: Round 1 = project of 4 pages and CVs. Round 2 = project of 20 pages and CVs | Panel of experts, external reviewers | Rebuttals since 2016, no interview |
| Germany | Scientific quality, applicants’ qualifications, objectives and work programme, employment opportunities, planned allocation of funding | Intermediate burden: 20 pages maximum for research proposal, plus CV | Panel of experts, external reviewers | No rebuttals/interviews for project grants |
| Netherlands | Originality of proposal, scientific quality (proposal and team), societal relevance and/or impact | ALW: Relatively low burden: total proposal 12 pages; ENW: around 8 pages for research proposal | Panel of experts, external reviewers | 2‐page rebuttal. Some schemes: interviews |
| Portugal | Project, team and investigator | High burden | Panel and external reviewers | Rebuttals; no interview |
| Sweden | Novelty and originality, scientific quality and merits of main applicant. | Low burden: Project description max 10 pages. Budget uses a template. Reuse of CV in system | Panel of experts | None |
| Switzerland | Track record, scientific quality and feasibility | Intermediate burden: Research plan 20 pages, CV = 2 pages, list of achievements = 2 pages | Panel of experts, external reviewers | None for project grants. Fellowships: Interviews |
| UK | Scientific quality of the project is main criterion; also investigator track records, risk‐reward balance and impact | Intermediate burden: 8‐page proposal plus budget, CVs, Impact statement and forms. Internal vetting before submission adds burden | Panel of experts, input from external reviewers | Rebuttals considered, interview for fellowships |
| United States | Scientific quality, applicant qualifications, diversity, impact, programme portfolio | High burden: 12‐ to 15‐page project description along with many supplementary documents | Panel + reviewers (NSF); NIH: Panel | None |
Assessment of elements regarding incentives for mobility and diversity across funding agencies
| Country | Mobility | Focus on diversity, equal opportunities |
|---|---|---|
| Australia | Not emphasized | Accounted for to some extent through “performance relative to opportunity” assessment |
| Canada | Not emphasized | Explicit focus on equal opportunities |
| ERC | Emphasized at Starting Grant level | Explicit focus on equal opportunities |
| France | Not emphasized | No specific focus on equal opportunities |
| Germany | Emphasized only for post‐docs | To some extent: Diversity and equal opportunity are recognized as important; special benefits for fellowship recipients with children |
| Netherlands | Emphasized only for post‐docs | Not focused upon in ALW‐scheme, but women prioritized in ENW scheme. For excellence schemes: extensions for eligibility period for parenthood after doctorate (18 months of standard extension per birth for women, up to 3 children; also extension for documented care‐taking time for fathers); special NWO grants for women outside of ALW/ENW |
| Portugal | Emphasized for fellowships | No focus on equal opportunities |
| Sweden | Emphasized only for post‐docs | Explicit focus on equal opportunities |
| Switzerland | Emphasized only for post‐docs | Special grant for female researchers with family‐related career interruptions; extensions of eligibility periods for excellence scheme (Ambizione) in case of maternity after doctorate (18 months per child or longer if documented) |
| UK | Emphasized for fellowships | Explicit focus on equal opportunities |
| United States | Not emphasized | Explicit focus on equal opportunities |
Recommendations for best practices with respect to maximizing scientific quality
| Element of funding | Recommended best practices |
|---|---|
| Societal relevance |
Overt emphasis should be on research approach and design rather than project outcome |
| Top‐down vs. bottom‐up |
Fund bottom‐up research that also (when applicable) integrates science in society aspects Reduce top‐down constraints |
| Applied vs. basic |
Set apart substantial explicit funding for basic science |
| Allocation of money |
Mainly small amounts to many researchers Some larger funds to interdisciplinary groups (e.g., excellence centres) |
| Consortia vs. individual‐led |
Fund both consortia and individual‐led projects, which each confer specific and unique benefits |
| Long‐term vs. short‐term |
Fund more long‐term research Provide checkpoints and follow‐ups |
| Flexibility of funding schemes |
Increase flexibility in time, budget, team size with respect to best fit to the research vs. meeting inflexible standards |
| Acceptance rates and who applies |
Provide smart demand management schemes (e.g., limit no. of applications/researcher; size and type budget/researcher; etc.) These schemes should be field/domain‐specific |
| Who/what is being judged? |
Establish different categories: e.g., quality of project for younger researchers; quality of researcher for established researchers |
| Administrative burden |
Reduce and simplify Tailor length of grant sections to evaluation type needed |
| Who is reviewing |
Panel and external experts Invest in the quality of the experts and panel; reviewers from other countries in most smaller countries |
| Interviews/rebuttals |
More rebuttals in general |
| Mobility |
Encourage mobility when reasonable Emphasize flexibility, leaving the possibility to tailor to the individual needs of project/researcher |
| Diversity |
Increase funds, and their diversity, for vulnerable groups Within projects, demands for diversity should fit the project rather than attempt to meet preset standards Within projects, take into account different hierarchy levels within an organization |