| Literature DB >> 31074503 |
K Fairhurst1, J M Blazeby1, S Potter1, C Gamble2, C Rowlands1, K N L Avery1.
Abstract
BACKGROUND: RCTs in surgery are challenging owing to well established methodological issues. Well designed pilot and feasibility studies (PFS) may help overcome such issues to inform successful main trial design and conduct. This study aimed to analyse protocols of UK-funded studies to explore current use of PFS in surgery and identify areas for practice improvement.Entities:
Mesh:
Year: 2019 PMID: 31074503 PMCID: PMC6618315 DOI: 10.1002/bjs.11167
Source DB: PubMed Journal: Br J Surg ISSN: 0007-1323 Impact factor: 6.939
Figure 1Flow diagram showing selection of articles for reviewReasons for exclusion: 1, not a surgical intervention; 2, surgical intervention, not pilot/feasibility work; 3, surgical intervention is a co‐intervention; 3a, surgical intervention is a co‐intervention and not pilot/feasibility work. NIHR, National Institute for Health Research; HTA, Health Technology Assessment; RfPB, Research for Patient Benefit.
Figure 2Data sources available for the pilot and feasibility studies included in the review*Published in peer‐reviewed journal. †Health Technology Assessment (HTA) report +/– other paper(s) in peer‐reviewed journal. RfPB, Research for Patient Benefit; CI, chief investigator; NIHR, National Institute for Health Research.
Design characteristics of the 35 pilot/feasibility studies in the review
| Randomized studies ( | Non‐randomized studies ( | |||||
|---|---|---|---|---|---|---|
| RfPB ( | HTA ( | Total ( | HTA ( | RfPB ( | Total ( | |
|
| ||||||
| Gastrointestinal | 8 | 1 | 9 | 2 | 0 | 2 |
| Urology | 3 | 2 | 5 | 0 | 0 | 0 |
| Cardiothoracic | 3 | 0 | 3 | 0 | 0 | 0 |
| Orthopaedic | 2 | 2 | 4 | 0 | 0 | 0 |
| Obstetrics/gynaecology | 2 | 0 | 2 | 0 | 1 | 1 |
| Maxillofacial/ENT | 2 | 1 | 3 | 0 | 1 | 1 |
| Plastics | 1 | 0 | 1 | 0 | 0 | 0 |
| Paediatrics | 1 | 1 | 2 | 0 | 1 | 1 |
| Breast | 0 | 0 | 0 | 1 | 0 | 1 |
|
| 3 (1–23) | 4 (2–10) | 3 (1–23) | 1 (1) | 2 (1–65) | 1 (1–65) |
| 1 | 7 | 0 | 7 | 3 | 1 | 4 |
| 2–20 | 14 | 7 | 21 | 0 | 1 | 1 |
| > 20 | 1 | 0 | 1 | 0 | 1 | 1 |
|
| 50 (30–200) | 70 (60–144) | 60 (30–200) | n.a. | n.a. | n.a. |
|
| ||||||
| Age | ||||||
| Adults | 19 | 5 | 24 | 2 | 2 | 4 |
| Children | 2 | 1 | 3 | 1 | 0 | 1 |
| Both | 1 | 1 | 2 | 0 | 1 | 1 |
| Sex | ||||||
| Male | 1 | 1 | 2 | 0 | 0 | 0 |
| Female | 3 | 0 | 3 | 1 | 1 | 2 |
| Both | 18 | 6 | 24 | 2 | 2 | 4 |
| Country | ||||||
| UK | 20 | 7 | 27 | 2 | 3 | 5 |
| Europe | 2 | 0 | 2 | 0 | 0 | 0 |
| Worldwide | 0 | 0 | 0 | 1 | 0 | 1 |
|
| 6·5 (4–19) | 9·5 (0–24) | 9 (0–24) | 1 (0–12) | 7 (2–25) | 5·5 (0–25) |
|
| 9 | 6 | 15 | 3 | 3 | 6 |
| Qualitative interviews | 8 | 6 | 14 | 2 | 2 | 4 |
| Participant/researcher survey | 1 | 1 | 2 | 2 | 3 | 5 |
| Economic modelling | 0 | 1 | 1 | 0 | 0 | 0 |
| Systematic review | 0 | 0 | 0 | 1 | 0 | 1 |
| National audit | 0 | 0 | 0 | 0 | 1 | 1 |
| Cohort study | 0 | 0 | 0 | 0 | 1 | 1 |
Values are median (range).
Some studies planned more than one type of non‐randomized work;
most studies planned more than one type of non‐randomized work. RfPB, Research for Patient Benefit; HTA, Health Technology Assessment; ENT, ear, nose and throat; n.a., not applicable.
Rationale as detailed in the protocol for the pilot and feasibility studies of surgical interventions included in the systematic analysis
| No. of studies stating each rationale in the study protocol | No. of studies stating examination of each area in the study protocol | ||||||
|---|---|---|---|---|---|---|---|
| Area examined | Rationale | RfPB ( | HTA ( | Total ( | RfPB ( | HTA ( | Total ( |
|
| |||||||
| Main trial possible /necessary | To examine and test whether a main trial is possible | 14 (2) | 8 (1) | 22 (3) | |||
| To assess whether main trial is needed | 3 (0) | 0 (2) | 3 (2) | ||||
| and/or produce a protocol |
|
|
| ||||
| To test whether the protocol can be adhered to and modify it as necessary | 2 (0) | 2 (0) | 4 (0) | ||||
| Sample size | To estimate the variability in outcomes | 15 (1) | 2 (0) | 17 (1) | |||
| to help determine a sample size for | |||||||
| the main trial |
|
|
| ||||
| To determine a sample size for the main trial | 3 (0) | 0 (0) | 3 (0) | ||||
| Costs/funding | To assess/gather information on costs of performing the trial (direct and indirect) | 2 (0) | 0 (0) | 2 (0) | |||
| To perform/prepare for a | 13 (1) | 2 (0) | 15 (1) | ||||
| cost‐effectiveness analysis of the | |||||||
| intervention(s) |
|
|
| ||||
| To provide information/evidence to funders | 1 (0) | 0 (0) | 1 (0) | ||||
| Safety and effectiveness data | Preliminary data on safety to inform a main trial | 2 (0) | 0 (0) | 2 (0) | |||
| Information on adverse events | 4 (0) | 0 (0) | 4 (0) | ||||
| Planned formal hypothesis testing of | 3 (1) | 0 (0) | 3 (1) | ||||
| safety outcomes |
|
|
| ||||
| Preliminary data on effectiveness to inform a main trial | 0 (0) | 0 (0) | 0 (0) | ||||
| Planned formal hypothesis testing of effectiveness outcomes | 7 (1) | 0 (0) | 7 (1) | ||||
|
| To test the logistics of multicentre studies | 5 (0) | 1 (0) | 6 (0) | |||
| To develop a research network as a resource for a future main trial | 1 (1) | 0 (0) | 1 (1) | ||||
| To develop/test patient information content/forms/methods of delivery | 1 (0) | 3 (0) | 4 (0) | ||||
| To develop/test data collection forms/methods | 13 (1) | 6 (1) | 19 (2) | ||||
| To develop/test questionnaires/surveys | 5 (0) | 1 (0) | 6 (0) | ||||
| To test response rates to | 0 (0) | 0 (0) | 0 (0) | ||||
| questionnaires/surveys |
|
|
| ||||
| To prepare/plan/assess monitoring procedures | 0 (0) | 1 (0) | 1 (0) | ||||
| To determine what resources are needed for a main trial (e.g. funding/staff) | 3 (0) | 0 (0) | 3 (0) | ||||
| To assess the logistics of delivering an intervention as part of a trial in the NHS | 1 (0) | 0 (0) | 1 (0) | ||||
| To test (novel) methods of blinding | 1 (0) | 1 (0) | 2 (0) | ||||
| To assess proposed data analysis techniques | 1 (0) | 1 (0) | 2 (0) | ||||
| To learn about the day‐to‐day running of a trial | 1 (0) | 0 (0) | 1 (0) | ||||
|
| To test/modify inclusion/exclusion/eligibility criteria | 2 (0) | 0 (1) | 2 (1) | |||
| To estimate the expected prevalence or rate of incident cases in the population | 1 (1) | 1 (0) | 2 (1) | ||||
| To estimate the number to be screened and proportions of eligible patients | 9 (0) | 3 (0) | 12 (0) | ||||
| To assess numbers/rates of recruitment | 17 (0) | 5 (0) | 22 (0) | ||||
| and consent |
|
|
| ||||
| To test the randomization procedure | 5 (0) | 3 (0) | 8 (0) | ||||
| To test the acceptability of randomization/trial design | 12 (1) | 5 (2) | 17 (3) | ||||
| To determine the acceptability of the intervention to clinicians and patients | 12 (1) | 4 (2) | 16 (3) | ||||
| To assess rates of retention in the study | 11 (0) | 2 (0) | 13 (0) | ||||
|
| To assess and monitor the development of an intervention and/or its stability | 2 (1) | 1 (0) | 3 (1) | |||
| To develop and test the implementation and delivery of the intervention | 1 (0) | 3 (0) | 4 (0) | ||||
| To train staff in delivery and assessment procedures | 1 (0) | 0 (0) | 1 (0) | ||||
| To monitor the surgical learning curve | 2 (1) | 0 (0) | 2 (1) |
|
|
| |
| To test rates of crossover | 0 (0) | 1 (0) | 1 (0) | ||||
| To examine reasons for non‐adherence/crossover for the main trial | 2 (0) | 0 (0) | 2 (0) | ||||
| To develop pathways and protocols for co‐interventions | 0 (0) | 0 (0) | 0 (0) | ||||
|
| To select the most appropriate primary outcome measure | 9 (1) | 0 (0) | 9 (1) | |||
| To develop and test a new outcome | 0 (0) | 0 (0) | 0 (0) | ||||
| measure |
|
|
| ||||
| To determine appropriate/important/suitability of outcome measures for patients/clinicians | 3 (0) | 4 (2) | 7 (2) | ||||
Values in parentheses are number of non‐randomized (NR) studies.
Formal hypothesis testing to demonstrate the safety and/or effectiveness of an intervention is generally not recommended for pilot and feasibility studies because of the underpowered sample size (see discussion). RfPB, Research for Patient Benefit; HTA, Health Technology Assessment; NHS, National Health Service.
Type of trial for studies that examined details of the surgical intervention and those that did not
| Studies examining the intervention ( | Studies not examining the intervention ( | Total ( | |
|---|---|---|---|
| Surgery | 6 | 9 | 15 |
| New/novel surgical technique | 4 | 6 | 10 |
| Non‐randomized pilot/feasibility work | 0 | 5 | 5 |
| Surgery | 0 | 4 | 4 |
| Surgery | 0 | 1 | 1 |