Protocol for a systematic literature review and network meta-analysis of the clinical benefit of inhaled maintenance therapies in chronic obstructive pulmonary disease.

INTRODUCTION: Chronic obstructive pulmonary disease (COPD) exacerbations progress the course of disease and impair lung function. Inhaled maintenance therapy reduces exacerbations. It is not yet established which inhaled therapy combination is best to reduce exacerbations, lung function decline and symptom burden. METHODS AND ANALYSIS: MEDLINE, EMBASE and the Cochrane Library will be searched for articles between January 2011 and May 2018 using a pre-specified search strategy. Conference proceedings will be searched. Systematic reviews (with or without meta-analysis), randomised controlled trials (RCTs), cohort studies and case controlled studies comparing six interventions comprising different combinations of long-acting bronchodilators and inhaled corticosteroids in unison or on their own. The primary outcome is the reduction in moderate-to-severe exacerbations. Secondary outcomes include: lung function, quality of life, mortality and other adverse events. Titles and abstracts will screened by the primary researcher. A second reviewer will repeat this on a proportion of records. The Population, Intervention, Comparator, Outcomes and Study framework will be used for data extraction. A network meta-analyses of outcomes from RCTs and real-world evidence will be integrated if feasible. The 95% credible interval will be used to assess the statistical significance of each summary effect. Ranking of interventions will be based on their surface under cumulative ranking area. ETHICS AND DISSEMINATION: COPD exacerbations are burdensome to patients. We aim to report results that provide clinicians with a more informed choice of which inhaled therapy combinations are best to reduce exacerbations, improve disease burden and reduce lung function and exercise capacity decline, compared with the potential harms, in certain populations with COPD. PROSPERO REGISTRATION NUMBER: CRD42018088013. © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

The planned systematic literature review and network meta-analysis will evaluate both randomised controlled trials and real-world evidence in order to reflect the current best evidence-based practice and increase the application to a potentially heterogeneous group of patients with COPD.

A ranking system of all inhaled treatment comparisons will enable clinicians to judge each intervention on their evidence of clinical benefit compared with their potential harms.

It may not be possible to combine both randomised controlled trials and other study designs in a single network meta-analysis.

Background

Rationale

Chronic obstructive pulmonary disease (COPD) affects around 174 million persons worldwide.1 The most common cause is smoking, and patients exhibit airflow obstruction that is not fully reversible. The disease is progressive, with declining lung function and a worsening of symptoms. Most troublesome are acute exacerbations manifested as a sudden worsening of symptoms, for example, severe coughing, shortness of breath and chest congestion, requiring urgent treatment and possibly hospitalisation. While smoking cessation remains the most effective intervention, the rate of exacerbation can be reduced by regular medication such as combination of long-acting beta-adrenoceptor agonists (LABAs),2 and inhaled corticosteroids (ICS)3 4 or long-acting muscarinic antagonists (LAMAs).5

COPD treatment guidelines are largely informed by randomised controlled trial (RCT) results,6 but we do not know if these findings apply to large patient populations not studied in trials. While RCTs will continue to be the gold standard for assessing the efficacy of medical interventions, they are expensive to conduct, and for practical and ethical reasons usually involve testing treatments in patient populations and within contexts which are sometimes very different from real life. In particular, RCT participants with COPD usually have no comorbidities and are otherwise healthy. Whereas often the very patients who are most commonly seen in a COPD outpatient clinic are those that would be excluded from clinical trials due to their comorbidities. As patient populations with chronic diseases such as COPD become more complex, the studies used to generate clinical evidence must reflect this.

Evidence of medication effects in routine care is vital for understanding the balance of treatment risks and benefits. RCTs have unique strengths, but results from trials are not always a good guide to the effects of drugs in routine clinical practice.7 National drug licensing authorities are now demanding better real-world evidence on which to make decisions and have introduced legislation mandating studies of both effectiveness and risk to be conducted in routine clinical care rather than the narrow and optimal confines of most randomised trials.8 9 While the conduct of observational studies to investigate possible drug harms is well established, the use of these studies to estimate treatment effectiveness is in its infancy. Issues of treatment channelling and indication bias mean that measuring the intended benefit of a treatment is beset with difficulties. While others have demonstrated it can be done in certain circumstances, we need more certainty about the methodology as it is applied in each disease area, since the issues of bias are likely to vary considerably.9

There is increasing evidence that dual long-acting bronchodilator therapy (LABA+LAMA) is more clinically beneficial compared with monotherapy or placebo10; however, there is also evidence that adding an ICS to LABA and LABA as triple therapy is better at reducing exacerbations and maintaining lung function.11 Furthermore, new treatments for reducing exacerbation frequency have become more evidenced based in recent years with commonly inhaled therapies (LABAs, LAMAs, ICS and combination devices) being prescribed alongside other treatments such as mucolytics (carbocysteine, N-acetylcysteine),12 antibiotics (macrolides) and inhaled colomycin13 14 and phosodiesterase-4 inhibitors such as roflumilast.15

Until recently, dual combination therapy (LABA+ICS) was the recommended treatment for highly symptomatic COPD patients at risk of exacerbations or severe airflow limitation.16 However, in the Global Initiative for Chronic Obstructive Lung Disease (GOLD) guidelines (2017)17 triple therapy (combined LABA+LAMA+ ICS) is only recommended for patients categorised as severe. Given this changing landscape, and the future launch of combination triple therapies, it is important to identify and synthesise the available evidence from clinical trials and observational studies.

Objectives

This systematic literature review will assess clinical benefits and adverse events from maintenance treatment combinations in COPD described by RCTs and real-world evidence (RWE) studies. A network meta-analyses of outcomes from RCTs and RWE will be integrated if feasible.

The primary research question is: What are the clinical benefits of maintenance treatment combinations in COPD in terms of reducing exacerbations?

Secondary research questions include:

What is the long-term effectiveness of treatment combinations on improving lung function as measured by forced expiratory volume in 1 s (FEV1)?

What is the long-term effectiveness of treatment combinations in improving patient-reported outcomes of respiratory-related quality of life, as measured by the St Georges Respiratory Questionnaire or the COPD Assessment Test?

What are the harms of each treatment combination including mortality, cardiovascular events, pneumonia, diabetes and bone fractures?

Methods

This protocol has been prepared using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Protocols guidelines.18

Eligibility criteria

Study design/characteristics

Target studies will include RCTs, cohort studies and case–control studies comparing each intervention of interest to any of the possible comparators and looking at any of the possible outcomes (see below and table 1). We will also use summary papers, systematic reviews and other analyses to source relevant primary papers.

Table 1

Summary of participants, intervention, comparators and outcomes (PICO) criteria

Participants: Adults diagnosed with COPD defined by a fixed post-bronchodilator FEV1/FVC ratio of less than 0.70.
Interventions	Comparators	Outcomes
1. LABA	LAMA LABA+LAMA ICS LABA+ICS LABA+LAMA + ICS Placebo	Number of moderate-to-severe exacerbations FEV1 change from baseline Mortality Respiratory-related quality of life (SGRQ, CAT) Number of adverse and serious adverse events: Cardiovascular events Pneumonia Diabetes Bone fractures
2. LAMA	LABA LABA+LAMA ICS LABA+ICS LABA+LAMA + ICS Placebo
3. LABA+LAMA	LABA LAMA ICS LABA+ICS LABA+LAMA + ICS Placebo
4. ICS	LABA LAMA LABA+LAMA LABA+ICS LABA+LAMA + ICS Placebo
5. LABA+ICS	LABA LAMA LABA+LAMA ICS LABA+LAMA + ICS Placebo
6. LABA+LAMA + ICS	LABA LAMA LABA+LAMA ICS LABA+ICS Placebo

COPD, chronic obstructive pulmonary disease; CAT, COPD Assessment Tool; FEV1, forced expiratory volume in 1s; FVC, forced vital capacity; ICS, inhaled corticosteroids; LABA, long-acting beta-adrenoceptor agonist; LAMA, long-acting muscarinic antagonists; SGRQ, St Georges Respiratory Questionnaire.

Participants

Adults diagnosed with COPD defined by a fixed post-bronchodilator ratio of forced expiratory volume in 1 s to forced vital capacity (FEV1/FVC) of less than 0.70. Other measures of impaired lung function, such as lower limit of normal of FEV1/FVC ratio, will not be used to judge diagnosis in this review. The population will be clinically stable at the time of recruitment, defined as not having been treated for an exacerbation in the prior 6 weeks.

Interventions

There are six interventions of interest: (1) LABA, (2) LAMA, (3) LABA+LAMA, (4) ICS, (5) LABA+ICS and (6) LABA+LAMA +  ICS.

Comparators

Each intervention may be compared against each other intervention or a placebo (table 1).

Outcome

The primary outcome of interest is the number of moderate-to-severe exacerbations experienced by patients following intervention. Secondary outcomes include FEV1 change from baseline, mortality (all-cause and respiratory-related), respiratory-related quality of life as measured by the St Georges Respiratory Questionnaire (SGRQ) or the COPD Assessment Tool (CAT) and the number of adverse and serious adverse events following intervention including cardiovascular events, pneumonia, diabetes and bone fractures.

Information sources

MEDLINE (Ovid interface, 1980 onwards) and Embase (Ovid interface, 1980 onwards) will be searched for potentially relevant articles using pre-defined search strategies. The International Prospective Register of Systematic Reviews (PROSPERO) will be searched periodically for relevant ongoing and completed systematic reviews. A manual search of the reference lists of all included studies will be conducted to check for other possibly relevant articles.

Manual searches will also be conducted to capture data not reported in the main publications and data from recent studies not yet published. Manual searches are anticipated to include conferences of interest and proceedings published from 2015 onwards, based on the assumption that trials are usually published within 2 to 3 years following presentation to a conference. In addition, we will search agencies’ websites (National Institute for Health and Care Excellence etc) and clinical trial registry clinicaltrials.gov.

Studies will be excluded if they investigate only single short-acting inhaled therapy versus placebo. Additionally, studies will be excluded if they exclude patients on the basis of comorbidities that are unlikely to be affected by the trialled drug.

Search strategy

The list of proposed search terms (table 2) will be reviewed by the primary and secondary reviewer and research group lead. The final search strategy will be checked for accuracy by the guarantor using the Peer Review of Electronic Search Strategies (PRESS) checklist.19 The search strategy will be developed in the first instance for MEDLINE and then adapted for use with Embase. Search filters limiting to studies published in 1980 onwards, studies published in English and studies in humans will be used. The disease terms, inhaler terms and outcome searches will be combined using the Boolean logic operator AND, while different choices of terms within these categories using will be combined using OR. The literature review searches will be updated at the end of the process.

Table 2

Search terms (provisional)

Concept	Search Terms
Chronic obstructive pulmonary disease	MeSH terms: exp Pulmonary Disease, Chronic Obstructive/ Free text terms: COPD, chronic obstructive pulmonary disease
LABA	Free text terms: arformoterol, formoterol, indacaterol, olodaterol, salmeterol, foradi, vilanterol, onbrez, oxis, salmeterol, tulobuterol, vilanterol, bambuterol, bambec, atimos modulate, striverdi respimat, serevent, relvar ellipta
LAMA	Free text terms: aclidinium bromide, glycopyrronium bromide, tiotropium, umeclidinium, anoro ellipta, eklira, seebri, Spiriva, incruse, antimuscarinic bronchodilators, glycopyrrolate
ICS	Free text terms: beclomethasone, budesonide, fluticasone furoate, fluticasone propionate, fluticasone, mometasone furoate, alvesco, betamethasone, ciclesonide, flixotide, pulmicort, becloforte, becotide, relvar ellipta
Exacerbation	MeSH terms: exp respiratory tract infections/ Free text terms: exacerbation, AECOPD, lower respiratory tract infection, LRTI
FEV1	Forced expiratory volume in 1 s (FEV1)
Mortality	MeSH terms: exp Mortality/exp death/ Free text terms: mortality, death
Quality of life	MeSH terms: exp quality of life/ Free text terms: quality of life, St Georges Respiratory Questionnaire (SGRQ), COPD Assessment Test (CAT)
Myocardial Infarction	MeSH terms: exp myocardial infarction/ Free text terms: myocardial infarction (MI)
Stroke	MeSH terms: exp stroke/ Free text terms: stroke
Arrhythmias	MeSH terms: exp arrhythmias, cardiac/exp atrial fibrillation/ Free text terms: arrhythmia, atrial fibrillation
Angina	MeSH terms: exp angina, unstable/exp angina pectoris Free text terms: unstable angina, angina pectoris
Pneumonia	MeSH terms: exp pneumonia/ Free text terms: pneumonia
Type-2 Diabetes	MeSH terms: exp diabetes mellitus, type 2/ Free text terms: type 2 diabetes (T2DM)
Fractures	MeSH terms: exp osteoporotic fractures/exp fractures, bone Free text terms: osteoporotic fractures, bone fractures

ICS, inhaled corticosteroids; LABA, long-acting beta-adrenoceptor agonist; LAMA, long-acting muscarinic antagonists.

Study records

Data management

Literature search results will be uploaded and stored in EndNote (X8) and duplicates will be removed.

Selection process

The selection of studies for inclusion in the review will be conducted in two stages. First, titles and abstracts of all records identified by the database searches will screened by the primary researcher against the pre-defined eligibility criteria in order to identify a subset of potentially relevant studies. A second reviewer will repeat this exercise on a proportion of records and any discrepancies resolved by discussion. To reduce the risk of missing potentially relevant studies, a deliberately lenient approach will be adopted for this first level of screening by title and abstract.

We will obtain full reports for all titles that appear to meet our eligibility criteria, or where there is uncertainty. Full text screening will be also conducted by the primary researcher. Supplementary material will be consulted if the information provided in the main published article is insufficient to assess whether or not the inclusion criteria are met. Any discrepancies will be resolved by discussion and/or consultation with a third reviewer with specific expertise in COPD. A record will be kept of the reasons for rejection of articles during the full-text screening process.

Data extraction

Information will be extracted from all selected studies using a pre-specified data extraction form. The form will be piloted on the first six selected studies and refined as necessary. Online supplementary material will be consulted and/or authors contacted if the information provided in the original published articles is insufficient to complete the extraction.

As with screening, data extraction will be carried out in duplicate on a proportion of selected records to reduce the risk of errors and introducing bias. Similarly, any discrepancies will be resolved by discussion and/or consultation with the third reviewer.

Data items

We will use the PICOs (Population, Intervention, Comparator, Outcomes and Study characteristics) framework to systematise our data extraction. Within each of these five domains, information will be recorded on the following items:

The study characteristics including setting, design, period of study, aims and objectives.

The population including characteristics (including size, sex and age distribution, ethnicity, country), recruitment and sampling methods, inclusion/exclusion criteria.

The intervention status definition and identification, number of exposed subjects, any exclusions.

The comparators’ identification and definition of unexposed individuals, number of unexposed subjects, any exclusions.

The outcomes definitions and identification of primary (exacerbation) and secondary outcomes (FEV1 change from baseline, mortality, respiratory-related quality of life, adverse events), number of subjects, any exclusions, length of follow-up.

Outcomes and prioritisation

The following list of endpoints is anticipated; to protect against study selection bias for the length of studies, we anticipate splitting our analyses of exacerbations and lung function by length of study.

Short-term treatment (<20 weeks)

Long-term treatment (≥20 weeks)

Short-term treatment (<12 weeks)

Long-term treatment (≥12 weeks)

Number of adverse and serious adverse events including:

Risk of bias assessment

The primary reviewer will assess the risk of bias of each study included using the seven-item Cochrane Risk of Bias Tool.20 The Critical Appraisal Skills Programme21 quality assessment tools will be used to assess the quality of observational studies. Risk of bias assessment will be conducted independently by a second reviewer on a quarter of the selected studies and disagreements will be resolved in the first instance by discussion and then through consultation with a third reviewer. On completion of this process, the remaining studies will be assessed for the risk of bias by one reviewer. The Alternative Regression Test22 will be applied to evidence to test for publication bias.

Data synthesis

Three key aspects in the assessment of feasibility of network meta-analysis (NMA) (RCTs, RWE) will be examined:

The validity of an NMA of RCTs may be compromised by looking at: (1) clinical heterogeneity, defined as the extent of confounding bias due to an RCT’s similarity and consistency violations and (2) methodological heterogeneity arising from the quality of the individual RCTs that make up the evidence network. The assessment of clinical heterogeneity will be based on evaluation of the following data elements extracted from the RCTs:

The study design, including the quality of methods employed.

The admissibility criteria in terms of confounding factors (including subgroups of interest).

The measurement and reporting of outcomes (eg, definitions of progression and time points, testing assumptions for underlying distributions).

The comparators (common reference intervention) and dosages, schedules and routes of administration.

The validity of an NMA of RWE by looking at the similarity of patients populations across studies, similarity of treatments and differences in outcomes.

The use of complex statistical methods to control for confounding such as propensity score, disease risk score, and stabilised inverse probability weighting method.

Descriptive statistics will be conducted to describe the following:

The main characteristics of the study populations at baseline (eg, age, sex, proportion of smokers, disease category as determined by the GOLD standard (A,B,C,D), FEV1 status, etc.)

Study designs (eg, details specific to RCT and RWE).

Whenever possible, graphs showing the characteristics of studies by treatment or study will be developed. These findings will be used as a basis to identify potential sources of heterogeneity and to detect any potential outlier.

The problem of bias due to systematically differing entry criteria is not something we can pre-requisitely prevent; however, should there be large differences in population characteristics, we will conduct appropriate subgroup analyses.

Network meta-analysis

This NMA will incorporate the scenarios of both indirect and mixed treatment comparisons. The NMA will initially trial in feasibility design whether RCTs can be compared solely with other RCT designs of similar methodology or whether other types of study design such as observational studies can be included in direct comparison. Heterogeneity and inconsistency will be tested using the Wald test for inconsistency.

Potential differences across studies may include:

The treatment dose/schedule or outcome definitions (exacerbation description).

The distribution of each study and patient characteristics.

Baseline risks associated with each treatment.

Observed treatment effects.

In order to account for these differences, methods of meta-regression, sub-group and sensitivity analysis may be employed.

Should it not be possible to compare all study designs in a single NMA to show best-efficacy ranking of interventions, then separate NMAs will be performed for RCTs and the other study designs. The geometry of the network for each outcome measure will be presented in a network diagram of treatment nodes of variable sizes, comparison lines of variable thickness and loops to identify treatments with both direct and indirect comparisons.23

We plan to provide an overall combined ranking of interventions depending on their effect on exacerbation reduction compared with the combined weight of harm per intervention. Each harm will be weighted based on the severity of any harm reported as a result of using each intervention in each study. The study with best effect and least harm will be ranked first.

Statistical analysis

Due to the nature of this NMA, it is assumed that a random effects meta-analysis model will be chosen for the primary outcome of rate of exacerbation and continuous outcomes of health related quality of life and FEV1. To estimate patient years for exacerbations, deaths and adverse events we plan to use methods previously reported.24 For change in continuous outcomes, that is, FEV1 and SGRQ, we will either use the reported change or calculate the change from baseline based on the reported values. We will calculate the SD of change from the reported standard errors or confidence intervals. The primary outcome of risk of exacerbation will be reported as rate ratio and other continuous outcome measures will be reported as mean differences assuming normal distribution of data. The 95% CI for each summary statistics will be used to assess the statistical significance of each summary effect. The ranking of interventions will be based on their surface under cumulative ranking area, allowing clinicians to make treatment decisions based on relative effectiveness and risk of harm.25 Statistical analysis will be performed using Stata (StataCorp LP, College Station, TX, USA) and R (R Foundation for Statistical Computing, Vienna, Austria).

Confidence in cumulative evidence

The quality of evidence for our primary and secondary research questions will be assessed using those domains of the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) guidelines that are pertinent to observational studies, notably those relating to methodological flaws within the component studies and the consistency of results across different studies. Additional domains may be considered if deemed appropriate. The strength of evidence will be judged as ‘high’ (further research is unlikely to change our conclusion), ‘moderate’ (further research is likely to alter our conclusion) or ‘low’ (further studies are required to answer the research question with a high degree of confidence/increase confidence).

Patient involvement

No patients were involved in the design or analysis of this study.

Ethics and dissemination

Ethical review is not required as this study is a systematic review. It is our intention to submit the results of our review for peer-reviewed publication and to present our findings at national and international meetings and conferences.