Systematic review of economic evaluations of preparedness strategies and interventions against influenza pandemics.

BACKGROUND: Although public health guidelines have implications for resource allocation, these issues were not explicitly considered in previous WHO pandemic preparedness and response guidance. In order to ensure a thorough and informed revision of this guidance following the H1N1 2009 pandemic, a systematic review of published and unpublished economic evaluations of preparedness strategies and interventions against influenza pandemics was conducted.
METHODS: The search was performed in September 2011 using 10 electronic databases, 2 internet search engines, reference list screening, cited reference searching, and direct communication with relevant authors. Full and partial economic evaluations considering both costs and outcomes were included. Conversely, reviews, editorials, and studies on economic impact or complications were excluded. Studies were selected by 2 independent reviewers.
RESULTS: 44 studies were included. Although most complied with the cost effectiveness guidelines, the quality of evidence was limited. However, the data sources used were of higher quality in economic evaluations conducted after the 2009 H1N1 pandemic. Vaccination and drug regimens were varied. Pharmaceutical plus non-pharmaceutical interventions are relatively cost effective in comparison to vaccines and/or antivirals alone. Pharmaceutical interventions vary from cost saving to high cost effectiveness ratios. According to ceiling thresholds (Gross National Income per capita), the reduction of non-essential contacts and the use of pharmaceutical prophylaxis plus the closure of schools are amongst the cost effective strategies for all countries. However, quarantine for household contacts is not cost effective even for low and middle income countries.
CONCLUSION: The available evidence is generally inconclusive regarding the cost effectiveness of preparedness strategies and interventions against influenza pandemics. Studies on their effectiveness and cost effectiveness should be readily implemented in forthcoming events that also involve the developing world. Guidelines for assessing the impact of disease and interventions should be drawn up to facilitate these studies.

Introduction

When a new subtype of influenza A virus which is infectious to humans gains human-to-human transmissibility efficiently enough to cause community level outbreaks, this virus is said to have pandemic potential. If this new subtype spreads globally causing disease and deaths, it becomes pandemic. Since the 16th century, influenza pandemics have occurred at intervals ranging between 10–50 years, creating varying levels of impact on societies. [1] In March 2009, a new subtype of influenza A H1N1 virus was identified in Mexico and the United States. It spread to all continents in less than nine weeks becoming the first pandemic of the 21st century. Children, young adults, pregnant women, and those with chronic illnesses were disproportionately affected and constituted the majority of the hospitalization cases. The estimated case fatality rate was 0.15–0.25%, with most deaths in middle-aged adults with underlying diseases. [2] Although concrete evidence on the macroeconomic consequences of the 2009 H1N1 pandemic have not yet been revealed, previous studies estimated the potential reduction of labor productivity and consumption demand, with results showing an approximately 2–5% decrease in annual gross product. [3], [4]

The World Health Organization (WHO) published pandemic preparedness and response guidance in 1999 with two revisions: the first in 2005 and the second in 2009. [1], [2] These documents summarize the recommended WHO and national actions against pandemic influenza according to recognized pandemic phases. For some recommendations, evidence is limited to observations or epidemiological models. In some cases, inferences are drawn from other respiratory infectious diseases, such as seasonal influenza or severe acute respiratory syndrome. With a view to incorporating important experience and evidence acquired during the H1N1 2009 pandemic, the WHO will revise its pandemic preparedness guidelines. Including cost effectiveness evidence in the revision process will strengthen the guidance by providing a framework to prioritize the allocation of limited resources in impending, high risk times.

The aim of this paper is to systematically review published and unpublished economic evaluations of interventions to control and prevent human influenza pandemics. Funded by the WHO, this study describes and assesses the identified studies and determines patterns in cost utility ratios. The findings are expected to contribute to the revision of the WHO guidance on pandemic influenza, potentially support policymakers to make informed decisions on allocating resources effectively, and identify gaps for future research.

Methods

Data Sources and Searches

On 22 September 2011, a systematic search was performed in MEDLINE (via PubMed, 1950–22.09.2011), as well as in the specialist databases NHS EED (via CRD, 1992–22.09.2011), HEED (via Wiley Online Library, 1992–08.2011), CEA Registry (1976–2010), EURONHEED (via INSERM, 1980–2010), HTA (via CRD, 1988–22.09.2011), Health Evidence Network (HEN) (via WHO/Europe, on 22.09.2011), EconLit (via Ovid, 1969–08.2011), and Research Papers in Economics (RePEc) (via Ideas, 1990–22.09.2011). Since it was expected that a majority of pharmaceutical interventions would be identified from the abovementioned databases, a search through the Social Science Citation Index (SSCI) (via ISI Web of Knowledge, 1970–22.09.2011), which is more focused on non-pharmaceutical issues and also covers conference proceedings, was also performed.

To retrieve additional grey literature reports and conference proceedings, the search was expanded by using the generic search engine Google (www.google.co.uk, on 06.10.2010/22.09.2011), and the science specific search engine Scirus (www.scirus.com, 2009–22.09.2011). Furthermore, reference lists of relevant publications were screened. and cited reference searching of the first economic evaluation on this topic [5] was also performed using Web of Science (via ISI Web of Knowledge, 1970–22.09.2011). Additional reports were obtained through correspondence between one reviewer (RPV) and authors of eligible studies and conference abstracts.

The search strategies used controlled vocabulary thesaurus terms, whenever available, and relevant free text terms, including ‘pandemic’, ‘H1N1’, ‘influenza’, ‘cost benefit’, ‘cost(s)’, ‘cost effective’ and ‘economic(s)’, in different combinations. Free text terms in other languages were also employed when appropriate. Search strategies applied to electronic data sources, and outputs are shown in Table S1 and S2.

Study Selection

All identified abstracts were reviewed by two independent reviewers from a review team (AM, KW, NP, RPV and SK). Discrepancies were resolved by a third reviewer (YT). The papers were included in the analysis if they met the criteria shown in Table 1.

Table 1

Inclusion and exclusion criteria employed in the abstract selection process.

Inclusion Criteria

Exclusion Criteria

•Original economic evaluations considering prevention or control of the 2009 human influenza pandemic or other potential human influenza pandemics•Partial economic evaluations if both costs and outcomes of one intervention, either pharmaceutical or non-pharmaceutical, were considered•Full economic evaluations if costs and outcomes of more than one pharmaceutical or non-pharmaceutical interventions were considered

•Reviews or editorials of original studies•Studies not including both costs and outcomes of interventions•Studies of economic impact of influenza pandemics per se•Economic evaluations of interventions related to influenza pandemic complications•No provision of English, Spanish, German, Thai and Dutch full texts (for which the review team possessed language translation ability)

Data Extraction and Quality Assessment

A standardized data extraction form was devised. The articles were grouped according to type of evaluation as follows: i) a cost minimization analysis if they compared costs of different interventions with evidence of equal effectiveness; ii) a cost benefit analysis (CBA) if they measured health outcomes in monetary units; iii) a cost effectiveness analysis (CEA) if they expressed health outcomes in natural units, e.g., cases averted, hospitalizations averted, or deaths averted; and iv) a cost utility analysis (CUA) if they presented health outcomes in common units, e.g., quality adjusted life years (QALYs) or disability adjusted life years (DALYs).

The studies were appraised in two different ways for quality assessment purposes following approaches employed by Teerawattananon et al. [6] First, they were assessed according to specific methodological and reporting practices for economic evaluation studies such as expression of perspective used, relationship between time horizon and discounting, reporting of incremental cost effectiveness ratios (ICERs), performing uncertainty analysis, and declaration of funding support. Second, studies were assessed according to the quality of evidence used, since it is widely recognized that the credibility of economic evaluations depends not only on the appropriateness of the methods employed but also on the input evidence. Several types of evidence are evaluated according to their level of quality: i) clinical effect sizes; ii) adverse events and complications; iii) baseline clinical data; iv) resource use; v) costs; and vi) utilities (only applicable to cost utility analyses). The data sources of each component are ranked from one to six in descending order. Rank 1 is given if parameters are derived from the most appropriate data sources. [6], [7] (For detailed information about ranking consult Table S3; for technical terms used in the data extraction, the definitions given by the HTA Glossary were used: http://htaglossary.net).

Data Synthesis and Analysis

This review compared the value for money of different interventions for the prevention and control of influenza pandemics in comparison with ‘no intervention’; however, the evaluations were conducted in different settings and timeframes. This study converted cost effectiveness ratios into a common currency and utility unit. Costs in international dollars (I$), at 2011 values, were calculated using national gross domestic product deflator values and implied purchasing power parity conversion rates from the International Monetary Fund (http://www.imf.org/external/ns/cs.aspx?id=28). In addition, exchange rates obtained from the OANDA website (http://www.oanda.com/currency/historical-rates) were applied when cost outcomes were reported in foreign currencies rather than in local equivalents. Because of the lack of explicit and implicit thresholds for most countries to determine which interventions are cost effective, the World Bank thresholds for classifying countries into low income, lower middle income, upper middle income, and high income countries according to 2010 Gross National Income (GNI) per capita were used as maximum ceiling thresholds. [8] In other words, the interventions that spent fewer resources than the upper bound of GNI per capita given by the World Bank in order to gain one QALY or save one DALY represent good value for money.

Results

Review profile

The search in the electronic databases identified a total of 677 records. In addition, 510 records were identified through internet search engines. There were 98 records that met the inclusion criteria and were assessed for eligibility, while 56 full texts were not included in the final analysis. These studies were excluded because they were reviews (14), were not economic evaluations (9), focused on seasonal influenza (6), focused on the impact of influenza (7), had no full text available for some conference abstracts (9), were not in the eligible languages (1), or did not report both the costs and outcomes of interventions (10). In addition, eight full text papers were identified from correspondence with authors of eligible papers, cited reference searching, and reference list screening, of which six were excluded as they studied the impact of disease (2) or were not economic evaluations (4). Finally, 44 studies were considered in our analysis (Figure 1).

Figure 1

Flow of study selection.

* Records duplicated inside an individual database or internet search results list.

Description of results

The majority of studies adopted CEA and CUA approaches: 14 CEA, 16 CUA, 2 CEA and CBA combined, and 1 CEA and CUA combined. Six studies reported CBA results and five partial economic evaluations. Figure 2 illustrates the relationships among study setting, year of study, and year of publication. More than half of the studies (n = 23) were conducted in 2009 and 2010 after the H1N1 pandemic event. 14 studies assessed the value for money of interventions in the United States, followed by Canada (n = 5), the United Kingdom and Singapore (n = 3, each), Australia, the Netherlands, and France (n = 2, each), and another five countries with one study each. There were three studies conducted for multinational settings, for example, one was conducted for three European countries [9] while another covered up to ten countries in diverse income groups. [10] The characteristics of the studies included in the analysis [11]–[51] are summarized in Table S4.

Figure 2

Study setting by year of study and year of publication.

Modified from the WHO and the World Bank's classification for the containment and mitigation of influenza pandemics, [52], [53] Table 2 depicts that vaccination (n = 22) and antiviral drugs (n = 25) were commonly evaluated for both target groups (specific groups, such as high risk or priority populations) and the general population. Notably, no economic evaluation assessed the economic value of public hygiene and disinfection measures.

Table 2

Classification of studies by types of interventions, modified from the WHO and World Bank's taxonomy [52], [53].

	Community		National				International
Interventions*			Targeted		Broad based
	Ex-ante	Ex-post	Ex-ante	Ex-post	Ex-ante	Ex-post	Ex-ante	Ex-post
Quarantine	[40]
Travel restriction					[22]		(22)
Public Communications & Advisories	[18]	[51]
Social distancing	[18]	[16], [24], [38]			[26], [45]	[11]
Public Hygiene and disinfection
Personal protective equipment	[18]	[50]
Vaccination			[14], [20], [33], [41]	[9], [21], [42], [51]	[5], [17], [20], [26], [33], [37], [39], [45]	[9], [11], [15], [21], [25], [26], [28], [30], [44], [46], [49]
Antiviral Drug			[13], [20], [27], [32], [41], [47], [48]	[12], [19], [23]–[25], [31]	[13], [20], [26], [29], [32], [35], [36], [39], [43], [45], [47]	[10], [11], [24], [34], [49] †

*Categories highlighted in grey are not relevant.

Traditional Chinese Medicine and Integrative Chinese and Western Medicine in [34]considered antiviral drugs.

Ex-ante = before the 2009 H1N1 pandemic; Ex-post = after the 2009 H1N1 pandemic.

There were considerable discrepancies among drug and vaccine regimens considered in the economic evaluations. Although the majority (n = 18) assessed oseltamivir, they used different dosages and durations for prophylaxis. For example, some authors [51] used oseltamivir 75 mg once daily for 10 days for prophylaxis in young adults in the US, whilst others [13] used the same dosage of oseltamivir for 50 days of prophylaxis among the Israeli general population. The number of vaccine doses ranged from one to three, with the vast majority of papers not clearly specifying the duration of protection (Table S5).

Table 3 shows the extent to which the 44 reviewed papers complied with standards for conducting and reporting economic evaluations. A relatively high proportion of studies described the study perspective(s), selection of comparators, using discounting for costs and/or outcomes for studies with time horizon longer than one year, and performing uncertainty analyses. However, only approximately 70% of the studies calculated and reported ICERs, and disclosed funding sources.

Table 3

Extent to which the studies included met recommendations for reporting of economic evaluations.6

Recommendations	Number of studies fulfilling recommendation*	Percentage (%)
Perspective specified	41/44	93
Description of comparator(s)	43/44	98
Used discounting for costs and/or outcomesif study period was >1 year	15/17	88
Calculated and reported ICER	30/42	71
Performed uncertainty analysis	38/44	86
Disclosed funding sources	31/44	70

*Number of studies in which the recommendation is applicable.

ICER = Incremental cost effectiveness ratio.

Twenty eight studies adopted a societal viewpoint in the analysis. Seven studies employed a healthcare provider's perspective and four studies adopted a healthcare system's perspective. Regarding financial support, 18 studies were supported by domestic public funders, 4 by the for-profit private sector, 1 by public private co-funding, 3 by not-for-profit domestic and international co-funding and 1 by an intergovernmental organization. 13 studies did not properly declare the source of funding.

All of the studies except two were model based, adopting either dynamic or static approaches, whereas one study compared both approaches. [36] Only one paper did not clearly state the approach used. [37] Time horizons (the time window during which patients were followed and their resource use and health/cost outcomes measured) varied largely across studies, ranging from one month to a lifetime. 16 studies (36.4%) did not clearly state the time horizon employed (Table S4).

Table 4 compares the quality of evidence used for economic evaluations conducted before and after the 2009 H1N1 pandemic. It illustrates the poor quality of data used for baseline clinical data, estimating adverse events and complications of interventions, resource use, and utilities for the studies conducted before 2009. More than half of this information was from non-analytic studies (e.g., case reports or case series), expert opinions, and unsourced information. A significant improvement was observed for economic evaluations conducted after the 2009 event. For these studies, a majority of baseline clinical data was obtained from case series or the analyses of reliable administrative databases from the setting of interest. Almost half of these studies employed resource use information from reliable administrative data sets from the setting of interest and also over half of the utilities were derived from direct or indirect utility assessment rather than from unknown sources or expert opinion. Nevertheless, there was not much difference in the quality of clinical effect size parameters between the before and after studies. This may be explained by the fact that the most appropriate clinical effect size source is the randomized controlled trial and a pandemic event is unrelated to the availability of this type of study.

Table 4

Quality of evidence used in the 44 economic evaluations included in the review.

	Level of information	Clinical effect size[n (%)]	Baseline clinical data[n (%)]	Adverse events & complications[n (%)]	Resourceuse[n (%)]	Costs[n (%)]	Utility[n (%)]
Before 2009 H1N1pandemic	Rank 1	2 (9)	0 (0)	0 (0)	0 (0)	1 (5)	0 (0)
	Rank 2	2 (9)	2 (9)	1 (5)	5 (23)	9 (41)	1 (13)
	Rank 3	5 (23)	1 (5)	4 (21)	1 (5)	3 (14)	1 (13)
	Rank 4	2 (9)	3 (14)	2 (11)	0 (0)	2 (9)	2 (25)
	Rank 5	0 (0)	7 (32)	5 (26)	6 (27)	0 (0)	2 (25)
	Rank 6	6 (27)	6 (27)	4 (21)	6 (27)	7 (32)	2 (25)
	Rank 9	5 (23)	3 (14)	3 (16)	4 (18)	0 (0)	0 (0)
	Total	22 (100)	22 (100)	19 (100)	22 (100)	22 (100)	8 (100)
After 2009 H1N1pandemic	Rank 1	1 (5)	1 (5)	0 (0)	3 (14)	1 (5)	1 (11)
	Rank 2	3 (14)	9 (41)	1 (6)	7 (33)	11 (52)	0 (0)
	Rank 3	4 (18)	1 (5)	0 (0)	1 (5)	2 (10)	4 (44)
	Rank 4	4 (18)	2 (9)	2 (12)	2 (10)	0 (0)	4 (44)
	Rank 5	0 (0)	3 (14)	5 (29)	3 (14)	3 (14)	0 (0)
	Rank 6	7 (32)	4 (18)	3 (18)	3 (14)	2 (10)	0 (0)
	Rank 9	3 (14)	2 (9)	6 (35)	2 (10)	2 (10)	0 (0)
	Total	22 (100)	22 (100)	17 (100)	21 (100)	21 (100)	9 (100)

Note: For explanation about the ranking of each type of parameters refer to Table S3.

Incremental cost effectiveness ratios (ICERs)

Figure 3 compares the cost per QALY of each intervention as well as before and after the 2009 H1N1 pandemic. Evidence suggests that providing interventions either to the general population or only to target groups does not yield a significant influence on ICERs.

Figure 3

Incremental Cost Effectiveness Ratios (ICERs) for influenza pandemics according to type of intervention (I$/QALY).

AVP = antiviral prophylaxis; AVT = antiviral treatment; CJ = clinical judgment; PCR = polymerase chain reaction; PoC = point of care test; HR = high risk for complications; LR = low risk for complications; VAC = vaccine; Blue = results of studies conducted before the 2009 H1N1 pandemic; Green = results of studies conducted after the 2009 H1N1 pandemic; ⧫ = average incremental cost effectiveness ratio; ??? = cost saving intervention, ICER was not clearly stated; ★ = Cost saving/less effective intervention, ICER was not clearly stated.

The combination of pharmaceutical and non-pharmaceutical interventions is relatively cost effective compared to providing vaccines and/or antiviral drugs. For pharmaceutical interventions, ICERs can vary largely, from cost saving to very high values (>I$ 1,000,000 per QALY). According to the predefined ceiling thresholds, ‘social distancing’ (a strategy in which non-school, non-work and non-household personal contacts are reduced [40]), antiviral prophylaxis for the general population plus the closure of schools, vaccination for the general population plus the closure of schools, and antiviral prophylaxis for household contacts plus the closure of schools are amongst the cost effective strategies for all low, middle and high income countries because their ICERs are well below the maximum ceiling threshold for low income countries (lowest dot line). (Of course, the interventions that are cost effective for low income countries should also be cost effective for countries with higher incomes). Quarantine for household contacts seems unlikely to be cost effective even for low and middle income countries because the ICER is well above the maximum ceiling threshold for upper middle income countries. (However, this interpretation cannot apply to high income countries because it depends on their GNI per capita). Disappointingly, our findings suggest that most economic evaluations conducted after the 2009 H1N1 pandemic focus on different interventions compared to studies carried out before the 2009 event. In a few studies that cover the same interventions, the results do not differ considerably.

There are four important types of parameters in the uncertainty analyses found in our review (Table S6). These are epidemiological parameters and those related to natural disease progression (infectivity, e.g., attack rate or reproduction number; probability of pandemic; pandemic duration; disease severity, e.g., case fatality or probability of developing complications), those related to the intervention (efficacy, coverage, stockpiling capacity, timing of the intervention), resource use and cost parameters (healthcare costs, resources consumed, value of life, cost of intervention), and others (utility and discounting rate). There was no study that systematically analyzed the relative importance of the parameters. Since all studies purposively selected parameters for uncertainty analysis, we cannot make a firm conclusion on which parameters are important for determining the value for money of pandemic influenza preparedness strategies and interventions.

Due to the importance of contact patterns in the outcomes of dynamic models, we also reviewed the mode in which populations interact. Consideration of contact patterns is especially important in modeling non-pharmaceutical interventions (e.g. social distancing), because the effectiveness of these interventions is highly dependent on how the population interacts or behaves in the initial phase of the pandemic. [35] It is noteworthy that a number of reviewed papers do not provide detailed information about contact patterns and relevant assumptions, but instead they refer to other epidemiological studies. In this regard, we reviewed the relevant sources and found that the quality of evidence used ranges from assumption [51] to data from a large study conducted in the European Union. [9], [12], [39], [48], [49] Only one study conducted after the 2009 H1N1 pandemic appears to employ real data in areas affected by the pandemic to construct a social network. [24]

In general, all epidemic models have an underlying network of mixing patterns, even though this network may not be explicit. Some compartmental models included in this review do not allow for variability (i.e., assuming that communities are homogenous or not taking account of variability derived from age, sex, behavior, and social and spatial structure) [10], [22], [25], [26], [51], although some include modifications that allow for some level of heterogeneity, such as age specific mixing patterns. [9], [12], [35], [36], [39], [48]–[50] On the other hand, almost half of the studies included are agent based models, which appear to reflect the heterogeneity in contact patterns as occurs in the real world, especially those with a social network design [11], [15], [16], [21], [24], [40], [43]–[46] (Table S7).

Discussion

The review identified a fair number of economic evaluations of preparedness strategies and interventions against influenza pandemics, especially after the 2009 H1N1 pandemic, although evidence remains generally inconclusive with regard to the cost effectiveness of interventions. This picture does not change when comparing between studies conducted before and after the pandemic. The majority of studies (34/44, 77%) focused only on pharmaceutical interventions such as using vaccines and antiviral drugs. This may be explained by the nature of non-pharmaceutical interventions, for which effectiveness and cost effectiveness are difficult to assess. For instance, it may be unethical to restrict travel or to introduce public communication and advisory measures for only specific population groups. There is a lack of standard protocols for non-pharmaceutical interventions resulting in a large variability of practice across settings. Also, most of the non-pharmaceutical interventions are complex, involving multidimensional aspects and difficulties to control confounding factors. Lastly, in the absence of a pandemic event, it is difficult to introduce radical public measures (e.g., travel restrictions, school closure, and quarantine), which hinder opportunities to generate robust and reliable evidence on effectiveness.

Despite a large number of studies of pharmaceutical interventions, existing evidence on their value for money is unconvincing. Since different vaccination and drug regimens were examined across the selected studies, the findings on both the costs and outcomes of interventions are incomparable, especially from studies conducted before the pandemic. However, we found uniform drug regimens for prophylaxis and treatment for studies conducted after the pandemic. This may be explained by the issue of some protocols and guidelines by the WHO during the pandemic.

Regarding methods for economic evaluation, the overall quality is relatively high. This may be because these studies were conducted in settings where health economics was well established. National methodological guidelines for conducting economic evaluations exist in most of these settings and, therefore, it would affect the choice of method employed by the researchers. To improve the comparability of future evaluations, it is important to introduce internationally accepted methodological guidelines. Although a WHO guide for standardisation of economic evaluations of immunization programmes [54] is publicly available, it is applicable only to vaccination, but not to antiviral drugs and non-pharmaceutical interventions.

In Figure 3, we present a novel approach to summarize cost effectiveness evidence across interventions and target populations. This is useful not only for decision makers in each country, but also for intergovernmental organizations which guide and support countries to allocate resources such as the WHO, the United Nations Children's Fund (UNICEF), and the World Bank. However, interpreting the results of Figure 3 needs to be done with caution. This synthesis is dominated by only three studies, although data from 16 out of 44 studies were used. This is because the authors of these papers [29], [40], [46] assessed a wide range of pharmaceutical and non-pharmaceutical interventions and met the eligibility criterion to be included in the figure (i.e., presenting results in terms of incremental cost utility ratios) (Table S8).

Apart from the recognized challenges of conducting systematic reviews of economic evaluations, [55] we synthesized all studies presenting cost utility ratios (shown in Figure 3) due to the paucity of data, regardless of the quality of the evidence and methodology used. However, this should not significantly affect our results, since the overall quality of both input evidence and economic evaluation methods is similar across the studies. In addition, despite our effort to provide information on cost effective interventions for developing countries by using the World Bank's thresholds, the transferability of cost outcomes across jurisdictions remains a controversial issue. [56]

In comparison to the work of Lugnér and Postma, [57] who reviewed economic evaluations of influenza pandemic interventions from MEDLINE as their sole source, our review is more comprehensive. Lugnér and Postma only provided descriptive results of the review and methodological recommendations for future economic evaluations. [57] Whilst our review does not focus on examining methodological approaches but aims to offer policy recommendations, it does not fully succeed due to the limitations of the reviewed studies. These include the paucity of effectiveness and cost effectiveness studies on non-pharmaceutical interventions, and the limited number of studies assessing value for money across interventions.

Moving forward

To strengthen the evidence base for preparedness strategies and interventions against influenza pandemics, there are four major recommendations. Firstly, research should be encouraged and facilitated for both the effectiveness and cost effectiveness of interventions against influenza pandemics, especially in developing countries. In addition, new acceptable guidelines for the economic evaluation of interventions should be developed to complement the existing guidelines.

Secondly, we recommend that future economic evaluations should apply a more transparent and systematic approach to analyze uncertainty surrounding the input parameters. This can be achieved by using the value of information approach, [58] namely ‘expected value of perfect information for parameters’, which is a technique to estimate the value of reducing the uncertainty around particular parameters in the model. This technique was very rarely used in our reviewed studies.

Finally, because a pandemic is a rare and unforeseeable event, the global community should be ready for the next event by measuring the consequences of influenza pandemics and their related interventions. Guidelines not only for the preparedness of influenza pandemics, but also for assessing their impact in a systematic and reliable manner are strongly warranted.

Searches performed on electronic sources of information.

(DOC)

Click here for additional data file.

Search strategy employed for MEDLINE (via PubMed).

(DOC)

Click here for additional data file.

Hierarchies of data sources according to quality of evidence [ (adapted [ ).

(DOC)

Click here for additional data file.

Characteristics of reviewed studies.

(DOC)

Click here for additional data file.

Antiviral drug and vaccine regimens.

(DOC)

Click here for additional data file.

Types of parameters affecting the incremental cost effectiveness ratios*.

(DOC)

Click here for additional data file.

Description of contact patterns across dynamic models included in the review.

(DOC)

Click here for additional data file.

Number of interventions by type of intervention.

(DOC)

Click here for additional data file.