Obtaining real-world evidence: the Salford Lung Study.

We need to assess clinical treatments in real-life settings outside of randomised controlled trials (RCTs). Pragmatic RCT (pRCT) data can supplement RCTs by providing effectiveness information to support healthcare decisions. Electronic health records can facilitate concurrent safety monitoring and data collection without direct patient contact for large randomised study populations in pRCTs. The Salford Lung Study is the world's first phase III pRCT in asthma and chronic obstructive pulmonary disease (COPD), which aims to randomise over 7000 patients. This paper describes the hurdles overcome and the enormous effort and resource required to establish this comparative effectiveness study of a prelicence intervention. GLAXOSMITHKLINE PROTOCOL: HZC115151 ASTHMA STUDY CLINICALTRIALSGOV REGISTRATION: NCT01706198 COPD STUDY CLINICALTRIALSGOV REGISTRATION: NCT01551758. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Introduction

Double-blind randomised controlled trials (RCTs) are considered the most robust form of medical evidence, and their data form the basis of regulatory approval of new therapies and their incorporation in clinical guidelines. However, additional information is needed about the risk/benefit profile of new treatments in real-world practice, and especially evidence providing relative ‘values’ on novel medications, in cash-limited health services.

We designed the Salford Lung Study, the world's first prelicence pragmatic RCT (pRCT) to compare the real-world effectiveness in routine primary care of a novel once-daily investigational treatment (vilanterol/fluticasone furoate in a new dry-powder inhaler (DPI), Ellipta) with existing therapy for chronic obstructive pulmonary disease (COPD) and asthma. Here we discuss how this pRCT differs from traditional RCTs and retrospective database analyses.

The need for better evidence

A standard RCT aims to establish efficacy—an unequivocal cause-and-effect relationship for a very limited number of predefined outcomes. The interventions are double blind, often with double dummy to maintain blinding, in an idealised setting. Well-defined and compliant patients with minimal comorbidities are closely supervised for >90% adherence and to minimise confounding factors that could compromise the primary outcome, on which a regulatory approval may critically depend. However, the proportion of patients with asthma and COPD who meet the common inclusion criteria in RCTs has been estimated to be as low as 3% and 7%, respectively.1 It is extremely difficult to extrapolate data from an RCT into real life for a number of reasons, including patient preference, lower adherence and comorbidities.

In contrast, ‘real-world’ studies assess effectiveness in large unselected populations, which include patients with comorbidities. Patients are under routine care, taking open-label treatment over a prolonged period, with no additional visits and no attempt to change adherence. Data are usually obtained using electronic health records, which provide long-term outcomes, including health economics, free from interviewer or recall bias. However, most effectiveness research is retrospective, limited by its non-randomised nature, and more robust study designs are required.2 The International Society for Pharmacoeconomics and Outcomes Research has made recommendations on prospective observational studies for clinical effectiveness research.3 Its report defines different types of clinical effectiveness research studies, including retrospective and prospective observational studies, and pRCTs.

pRCTs are large prospective clinical studies in which patients are randomised to two or more interventions, and then followed up according to the investigating physicians’ usual practice.4 pRCTs bridge the gap between RCTs and non-randomised observational studies, allowing a good approximation of real-world practice. An electronic health record can be used to identify patients and assess outcomes, and provide safety surveillance. However, pRCTs require enrolment of a broad population to maximise external validity and can be expensive and difficult to implement. One important limitation is the likelihood of treatment switching during the trial, which can reduce the value of randomisation.

The past two decades have seen an increased number of published reports of pRCTs (43 in 1990 to 252 in 2010) across a range of therapy areas, although they still represent <1% of all randomised trial reports.4 The Salford Lung Study is the first attempt to carry out a pRCT prior to registration of a new treatment.

The Salford Lung Study

The Salford Lung Study is an open-label phase III pRCT of a once-daily long-acting β agonist (LABA)/inhaled corticosteroid DPI, in asthma and COPD. Robust effectiveness evidence would be of particular value in assessing once-daily inhaled therapies for asthma and COPD, where improved outcomes may result from better adherence. Patients are randomised to receive either a continuation of their usual treatment or a novel once-daily DPI containing a combination of a new inhaled steroid and a new LABA (fluticasone furoate/vilanterol (FF/VI; GlaxoSmithKline, Stockley Park, UK)) for 12 months. The primary outcome for COPD is the rate of moderate and/or severe exacerbations, and in the asthma study, an improvement in asthma control (Asthma Control Test). A full regulatory package for FF/VI is under consideration by the European Medicines Agency, and at the time of study initiation extensive efficacy and safety data were already available for more than 6400 patients from completed RCTs.

After randomisation, patients receive ‘usual’ care for 12 months by their own general practitioner (GP), practice nurse and community pharmacist. Effectiveness and safety data are monitored and collected in near-real time using an electronic health record, minimising the number of patient visits required. GPs prescribe as usual, patients order and collect repeat prescriptions in their usual way, and collect their study medication from their usual community pharmacist.

Salford is a metropolitan borough of Greater Manchester, UK. A number of clinical and infrastructure factors contribute to making it a unique environment for conducting a pRCT of a new therapeutic agent in respiratory medicine in a pre-licensing timeframe. Salford has a relatively static population served by a single hospital (Salford Royal Hospital). An integrated electronic health record connects the hospital and surrounding primary care practices in real time. The Salford Integrated Record (SIR), established in 2001, captures linked data in real time on all people accessing primary and secondary care services in Salford. The NorthWest e-Health group (NWeH; see http://www.nweh.org.uk/), which comprises information technology specialists, clinicians, researchers, epidemiologists and project managers, has developed a methodology and governance framework using data from the SIR in effectiveness research. In a pilot study, we successfully quantified the burden of asthma and COPD, identified exacerbations and evaluated differences in disease outcomes and healthcare resource use in Salford.5 For the Salford Lung Study, additional data feeds have been added to capture access of out-of-hours services, access to health services outside of Salford and deaths. To ensure accuracy, all of the possible adverse events or study endpoints are verified blind by the study clinicians. Thus, we can accurately evaluate composite endpoints of primary and secondary care events while closely monitoring patient safety. Uniquely, the SIR links primary and secondary care with patient-level prescription information. All 55 of Salford's community pharmacies are participating in the Salford Lung Study, which allows assessment of real-world medication adherence in terms of number of prescriptions delivered to the pharmacy and the number dispensed to the patient. Salford benefits from a unified primary and secondary care COPD pathway, a common template for COPD assessment and a community-based respiratory physician working across primary and secondary care units, within an area of high need.

Study design challenges

The key objectives in designing and executing the Salford Lung Study are to enable collection of data with minimal disruption to normal care, enrol a large proportion of the local patient population, provide appropriate safety monitoring and meet all ethical and regulatory requirements. In the study planning stages, the study sponsor and partners took advice from independent experts, including the Medicines and Healthcare Products Regulatory Agency (MHRA), the National Institute for Health and Care Excellence (NICE) and the National Institute for Health Research (NIHR), as well as the National Research Ethics Service Committee North West, Greater Manchester South.

Phase III trials necessitate stringent safety monitoring. We are able to provide this in the context of usual care by remote monitoring using the SIR. Formal study visits are only required at baseline (consent and randomisation) and at study end. Telephone calls every 3 months act as a ‘safety net’ if there has been no other contact between a patient and their GP.

We have had to overcome major challenges. In order to enrol a large proportion of the population, we found that GPs and practice nurses had to become responsible for recruitment of their own patients. The amount of patient information required for phase III informed consent is a challenge to recruitment in a study like Salford Lung Study, and the concept of taking an experimental medicine may make eligible patients reluctant to participate. The majority of participating healthcare professionals had little experience of prelicence clinical research, and a change to a research culture has taken time. Extensive training in good clinical practice was delivered to more than 1000 nurses, pharmacists and GPs from 51 general practices in Salford. A public education campaign took place in parallel. Approximately 150 GlaxoSmithKline -funded healthcare workers are engaged in the study.

The first patients were enrolled into the COPD study in April 2012, and the asthma study in December 2012. By mid-October 2013, more than 2000 patients were consented and 1600 patients were randomised in the COPD study, on schedule for a target of 2800 by end March 2014, with first results due end second quarter 2015. The asthma study recruitment is now accelerating, and likely to complete 6–12 months later. The study execution has required intensive collaboration across the National Health Service, with the NIHR, MHRA, ethics committee, academia and industry. The creation of an effectiveness study environment in Salford serves as a benchmark for other initiatives, including pharmacovigilance and phase IV studies, to collate data from primary and secondary care anywhere in the UK. We anticipate that initiatives such as this will reshape the future of clinical trials and meet the demand for value-based medical evidence.