Economic returns to medical research funding.

Following the publication of the final paper in a planned series of four studies estimating the economic returns from biomedical and health research, we reflect on what we have learnt from these types of assessment. © Author(s) (or their employer(s)) 2018. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

We recently published a paper estimating the return on investment from musculoskeletal disease (MSD) research funded by the UK government and medical research charities.1 This is the final publication in a series of studies that have assessed the economic returns from medical research in the UK.1–4 These show that the rates of return measured in terms of the additional health gain that earlier UK research has provided have been in the range of 7%–10% per annum. In addition, our estimates show a further 15% rate of return in terms of broader economic benefits. Comparisons with other public sector research investments are difficult due to methodological inconsistencies but these figures are well in excess of the yields of 6%–8% that governments typically expect from public investments.5

There are a number of reasons to assess the economic returns from research, as have been reviewed elsewhere.6 7 In this communication, we are focusing on the accountability and advocacy to support future investment in research, and on the need for transparent analysis to understand where, how and when returns from research occur.

The case for investments in medical research

Science funding is under threat. Economic austerity, antiexpert sentiment and increased demands on public expenditure for schools, welfare and defence, and so on, all increase the pressure on science budgets. Last year, the National Institutes of Health escaped significant cuts, but the expectation is that these are still just around the corner. In the UK, Brexit threatens access to over £800 million of European Union research funding currently going to universities each year. Being able to speak the language of finance ministries is essential in making the case for funding, but estimating the financial returns to the investment in science proves to be devilishly difficult. You need to be able to value benefits in monetary terms; the time between investment and return is typically long; research is an international endeavour making it difficult to attribute returns to national investments; and you need lots and lots of data over long periods of time.

The first of those problems can be overcome in the case of medical research, which includes basic biomedical research through to applied clinical and health services research. The health gains arising from medical research can be measured and monetarised through quality-adjusted life years (QALY). A QALY is a measure of the health of a person or population which incorporates both length of life and the quality of that life, so one QALY is equal to 1 year of life in full health. It is widely used in healthcare prioritisation to assess the value for money of different medical interventions, as it is possible to assign a monetary value to a QALY, although the choice of value to assign raises important conceptual issues and is controversial.

Nevertheless, to date, research to assess the value of the benefits of medical research forms a relatively small and developing field.8 Early approaches looked at productivity gains from a healthy workforce, but these tended to overstate the benefits as lost labour can be replaced by unemployed people or through immigration, and ignore health gains for groups such as children and the elderly. Other research has attempted to estimate the health gains themselves and valued the overall increase in longevity using a high value of life based on the willingness of individuals to pay for small reductions in the risk of death. Academic work by a number of US economists was given prominence as the supposed basis for the now discredited claims of ‘Funding First’, a US lobby group now disbanded.9 Their claims of ‘Exceptional Returns’ went well beyond the underpinning academic papers subsequently published.10 A broadly similar approach was adopted in a series of Australian studies conducted by Access Economics,11 but expanded to allow for improvements in quality of life based on disability-adjusted life years. In the 2003 version of the Australian analysis, no allowance was made for the time between the research investment and the improvements in health. In the 2008 and 2011 iterations, this was addressed by ‘crystal ball’ projections of the potential health and well-being gains 40 years into the future. However, the main problem with all these top-down approaches is the overall gain in mortality or morbidity is not linked to specific interventions. This means that a critical assumption has to be made regarding what proportion of the total gain in life expectancy is assumed to result from the application of medical research rather than, for example, general improvements in living standards. One way of addressing this problem of attribution is by examining, in a bottom-up manner, the impacts on specific clinical areas by tracing forwards from the research to the benefits that arise.

Estimating the economic returns of medical research

This is exactly what we did. We analysed two major elements of economic returns: the monetised health gains from the UK application of relevant UK research, and the broader impact on the UK gross domestic product (GDP).

To assess the health gains, we estimated the amount of public (government and charity) money spent in three different areas— cardiovascular disease (CVD), cancer and MSD research; the elapsed time between investment and return; the amount of health gain that should be attributed to the national research investment; and the net monetary benefits (NMB) arising from the research, defined as the health benefit valued in monetary terms minus the cost of delivering that health benefit, for a list of major clinical interventions (see figure 1). We valued QALYs not in terms of a social willingness to pay but in terms of the opportunity cost based on an estimate of how much it costs the UK National Health Service to generate an extra QALY (with a base case of £25 000). Using these four key elements of data, we could then attribute a proportion of the annual NMB of the health gain as being due to UK research, and relate an equal number of years of investment to years of NMB, ‘lagged’ by an estimate of the average time between research and benefit. The return is expressed as an internal rate of return (IRR), which is effectively the discount rate that would yield a zero net present value. As summarised in table 1, for CVD research this produced a best-case estimate of 9%,2 and when this approach was applied to cancer and MSD research the respective IRR was 10%3 and 7%.1

Figure 1

Conceptual approach to assessing the economic returns of medical research funding. CVD, cardiovascular disease; MSD, musculoskeletal disease; NHS, National Health Service; QALY, quality-adjusted life year.

Table 1

Summary of key results

	MSD	Cancer	CVD
Average annual research investment (for years of data used in IRR calculation as reported in source publications, using different time period for calculating constant prices and therefore not suitable for comparisons)	£70 million (1978–1997, in constant 2013/2014 prices)	£266 million (1976–1995, in constant 2011/2012 prices)	£111 million (1975–1998, in constant 2005/2006 prices)
Average annual research investment (rebased in same constant prices for comparative purposes)	£70 million (1978–1997, in constant 2013/2014 prices)	£290 million (1976–1995, in constant 2013/2014 prices)	£133 million (1975–1998, in constant 2013/2014 prices)
Elapsed time (between spending on research and health gain)	16 years	15 years	17 years
Attribution (proportion of papers that include a UK address from the papers cited on guidelines)	30%	17%	17%
Average net monetary benefit (NMB) (for years of data used in IRR calculation as reported in source publications, but using different time period for calculating constant prices therefore not suitable for comparisons)	£801 million (1994–2013, in constant 2013/2014 prices)	£6223 million (1991–2010, in constant 2011/2012 prices)	£2949 million (1992–2005, in constant 2005/2006 prices)
Average NMB (rebased in same constant prices for comparative purposes)	£801 million (1994–2013, in constant 2013/2014 prices)	£6458 million (1991–2010, in constant 2013/2014 prices)	£3559 million (1992–2005, in constant 2013/2014 prices)
IRR (health gain)	7%	10%	9%

CVD, cardiovascular disease; IRR, internal rate of return; MSD, musculoskeletal disease.

To estimate the overall value of public medical research investments, more general returns to the economy need to be added to these ‘health’ returns. The term ‘spillover’ is used by economists to describe an investment by one organisation, public or private, that benefits other organisations in the same sector of the economy and in any other sector of the economy. For example, life sciences companies build on and interact with publicly funded research, conduct further research themselves and bring medicines and technologies into use in healthcare. In other words, public medical research spend can boost private sector research spend (and vice versa).

So, to estimate the economic benefit of medical research investments, it is important to determine the magnitude of impact that public spend has on private sector research and development (R&D) investment (in economic terms, the elasticity). The resulting elasticity can then be combined with estimates of the social rate of return to private sector R&D investment to estimate the economic rate of return (GDP gain) obtained from public medical research investment. Using an econometric model, as described in Sussex et al’s4 study, it was possible to demonstrate that every additional £1 of public spend on medical research is associated with an eventual additional £0.99 of private R&D spend in the UK. By combining the estimated elasticity with previous estimates of the social rate of return from private R&D spend of around 50%, the best estimate IRR, in terms of impact on GDP of public medical research spend, was between 15% and 18%.4 In other words, a £1 investment in UK public medical research would benefit the UK economy to an extent equivalent to receiving 15–18 pence per year in interest in return for that investment.

While technically our health return represents an average for the total CVD, cancer and MSD research in the UK, and the spillover estimates are for a marginal change in (any) health-related public research, it is not unreasonable to see them as additive.2 Thus, adding to the estimates of the NMB of health gains arising from research, this would suggest a total return to CVD, cancer and MSD research of around 25% (ie, circa 10% for the health gains plus circa 15% for the GDP gain). This means that for every £1 spent on medical research in the UK, we get back benefits, in GDP gains and health gains, equivalent to 25 pence per year.

What we learnt

These estimates are imperfect. They rely on incomplete data and surrogate measures, and necessarily involve many detailed assumptions. But they aim to be conservative, they are relatively transparent and they are open to detailed critique. They represent a challenge to other research sectors to similarly attempt to quantify returns. As previously noted in an editorial in Nature in 2010, reporting on the first of these studies, they are ‘a genuine attempt objectively to assess the economic outcomes of research.’12

They are of course also estimates of what has been the return on past research investments. They reflect past performance and are no guarantee of similar future returns. They also report the average rate of return, not the marginal rate of return from an additional investment which would indicate whether returns to investment are diminishing as some commentators fear.13

But analyses of this sort do not just provide numbers that demonstrate that the return to medical research funding is substantial, the studies also highlight core areas of uncertainty and issues that need further exploration to inform policy responses. For example, across the three studies, the average time between research and significant health gain ranges from 15 to 17 years—an estimate that is reinforced by other studies.14 This illustrates the intergenerational nature of research funding and emphasises that funding changes cannot be judged in the short term. It also supports efforts to ‘accelerate’ the research translation pathway.

The other interesting observation is the international nature of research—between 17% and 30% of the benefit to the UK population in terms of improved health is derived from UK research. Put another way round three-quarters of health gains in the UK arise from research undertaken in other countries. The differences between disease areas in these estimates need further exploration, but as we seemingly enter a period of greater national protectionism, it is more important than ever to recognise the global nature of research and the benefit that brings to both national and international populations. A country could decide to ‘free load’ on the research of others or to contribute to the collective global effort. The appropriate balance probably depends on a mix of the country’s wealth, health, the relevance of the international research effort to its particular health problems and a judgement on the relative spillover effect of this use of public funds.

Overall, it is worth stressing that this type of research is dependent on historical data series of both research investments and the cost-effectiveness of interventions. Both are hard to create. For research funding data, this is in part because archive data are not readily available, and when they are, they do not historically use the same classification systems—both over time and between funders. A key lesson—which has been picked up by funders in the UK—is to use a standard taxonomy of research funding and to apply that over time.15 Cost-effectiveness data are easier to find for pharmaceutical interventions than for non-surgical interventions (such as back pain) reflecting the focus of much health technology assessments. Nevertheless, for both types of intervention you then need to build up the annual streams of net health gain for each specific intervention by specific patient groups, for specific conditions and for different severities. And this takes time—about 18–24 months to collate and compile the necessary data to make the rate of return estimate.

The need for research on research

Previous attempts to measure the returns from research have been motivated by lobbying for science funding. Claimed returns that are not well based in firm evidence are likely, in the end, to be counterproductive for the research community. Research on research needs to be conducted to the same standards of rigour and robustness as all high-quality research, and subject to the same critical review. In the current climate towards science, researchers cannot simply rely on the view that research is, by definition, a ‘good thing’. Funders and the research community need to be able to demonstrate the value of what they do: the studies mentioned here are important first steps.