| Literature DB >> 26025450 |
Jonathan A Cook1, Andrew Elders2, Charles Boachie3, Ted Bassinga4, Cynthia Fraser5, Doug G Altman6, Isabelle Boutron7, Craig R Ramsay8, Graeme S MacLennan9.
Abstract
BACKGROUND: Under a conventional two-arm randomised trial design, participants are allocated to an intervention and participating health professionals are expected to deliver both interventions. However, health professionals often have differing levels of expertise in a skill-based interventions such as surgery or psychotherapy. An expertise-based approach to trial design, where health professionals only deliver an intervention in which they have expertise, has been proposed as an alternative. The aim of this project was to systematically review the use of an expertise-based trial design in the medical literature.Entities:
Mesh:
Year: 2015 PMID: 26025450 PMCID: PMC4468810 DOI: 10.1186/s13063-015-0739-5
Source DB: PubMed Journal: Trials ISSN: 1745-6215 Impact factor: 2.279
Fig. 1PRISMA Flow diagram. AMED, The Allied and Complementary Medicine Database; BIOSIS, BioSciences Information Service of Biological Abstracts; CENTRAL, Cochrane Central Register of Controlled Trials; CINAHL, Cumulative Index to Nursing and Allied Health Literature; CMR, Cochrane Methodology Register; EMBASE, Excerpta Medica dataBASE; MEDLINE, Medical Literature Analysis and Retrieval System Online; RCT, randomised controlled trial; SCI, Science Citation Index
General study characteristics and context (n = 43 unless otherwise stated)
| Number | Percentage | |
|---|---|---|
| Year of publication | ||
| 1980–1989 | 2 | 5 |
| 1990–1999 | 11 | 26 |
| 2000–2009 | 23 | 53 |
| 2010–2012 | 7 | 16 |
| Funding ( | ||
| Charity | 3 | 11 |
| Commercial | 1 | 4 |
| Public body | 14 | 50 |
| Mixed | 10 | 37 |
| Clinical area | ||
| Cardiology | 5 | 5 |
| Emergency care | 1 | 2 |
| Gastroenterology | 2 | 5 |
| General medicine | 4 | 9 |
| Geriatrics | 1 | 5 |
| Mental health | 11 | 26 |
| Musculoskeletal | 8 | 19 |
| Neurology | 3 | 7 |
| Obstetrics and gynaecology | 2 | 5 |
| Oncology | 1 | 2 |
| Ophthalmology | 1 | 2 |
| Substance abuse | 4 | 5 |
| Intervention 1 | ||
| Acupuncture | 1 | 2 |
| Chiropractic | 2 | 5 |
| Clinical management (various) | 1 | 2 |
| Physiotherapy | 3 | 7 |
| Procedure | 17 | 40 |
| Psychotherapy | 17 | 40 |
| Rehabilitation management (various) | 2 | 5 |
| Intervention 2 | ||
| Anaesthetic | 1 | 2 |
| Chiropractic | 1 | 2 |
| Clinical management (various) | 3 | 7 |
| Clinical management (various)/procedure | 1 | 2 |
| Physiotherapy | 3 | 7 |
| Procedure | 16 | 37 |
| Psychotherapy | 16 | 37 |
| Rehabilitation management (varied) | 2 | 5 |
| Difference between interventions | ||
| Minor | 8 | 19 |
| Substantial | 34 | 79 |
| Different type of care | 1 | 2 |
Expertise-based design methodology and related reporting (n = 43 unless otherwise stated)
| Number | Percentage | |
|---|---|---|
| Expertise-based design type | ||
| Pure | 38 | 88 |
| Hybrid | 3 | 7 |
| Unclear | 2 | 5 |
| Name used ( | ||
| Expertise-based | 2 | 8 |
| Double randomisation | 2 | 8 |
| Randomised to surgeon | 2 | 8 |
| Non-randomised surgeon design | 1 | 4 |
| Randomised-surgeon | 1 | 4 |
| Surgeon-randomised | 2 | 8 |
| None | 15 | 63 |
| Reporting of expertise-based design in abstract | ||
| Design name | 6 | 14 |
| Deliverers of interventions stated to be different | 9 | 21 |
| Details regarding health professionals delivering one intervention | 7 | 16 |
| Details regarding health professional delivering both interventions | 6 | 14 |
| No details | 15 | 35 |
| Reported advantages ( | ||
| Ensuring intervention was delivered by someone with expertise to avoid criticism of the study | 2 | 5 |
| Balance of health professionals (e.g., interest, commitment, and prior knowledge of intervention) | 4 | 9 |
| Randomisation of health professional ‘consistent with efficacy trial’ | 1 | 2 |
| Following preference will reduce non-compliance | 1 | 2 |
| Using randomisation of health professional strengthens generalisability of findings | 1 | 2 |
| Eliminates learning of the intervention | 3 | 7 |
| Eliminates ethical concerns with intervention deliverer not doing what they would do outside of the trial | 1 | 2 |
| Delivery of intervention maximised (and may reduce adverse events) | 1 | 2 |
| Ensures experience in control group | 1 | 2 |
| Reduces cross-over between group compared with conventional study | 2 | 5 |
| Avoid non-compliance with allocation because of non-familiarity | 1 | 2 |
| Health professionals delivering their preferred intervention | 1 | 2 |
| Following usual practice reduces non-compliance with allocation | 1 | 2 |
| Reported disadvantages ( | ||
| Health professionals delivering interventions may not be representative of practice | 1 | 2 |
| Health professionals delivering interventions may not be balanced (e.g., motivation and prior experience) unless selected | 4 | 9 |
| Delivery may vary in other ways between groups because of different health professionals delivering the interventions | 2 | 5 |
| Disagreement between recruiter and health professional delivering the intervention regarding eligibility led to the intervention not being performed in some cases | 1 | 2 |
| Addition of new intervention and deliverer may create expectation bias | 1 | 2 |
| Allocation of intervention deliverers | ||
| Randomised | 8 | 19 |
| Usual practice | 5 | 12 |
| Preference | 4 | 9 |
| Defined by research question | 1 | 2 |
| Not stated | 25 | 58 |
| Criteria for delivering intervention 1 | ||
| Number of prior cases | 2 | 4 |
| Number of years of experience and prior cases | 1 | 2 |
| Number of years of experience and training in intervention | 1 | 2 |
| ‘Qualified’ intervention deliverer | 1 | 2 |
| Training of therapy and group supervision | 1 | 2 |
| Profession qualification | 3 | 6 |
| Prior training and experience of intervention | 1 | 2 |
| Trained in delivering intervention | 4 | 8 |
| Recommendation by colleagues as expert | 1 | 2 |
| Experience of working with patient group | 1 | 2 |
| Willingness to learn new intervention | 1 | 2 |
| Without prior experience of intervention (training then provided) | 1 | 2 |
| None (training/supervision provided as part of the study) | 3 | 7 |
| Not stated | 22 | 51 |
| Criteria for delivering intervention 2 | ||
| Number of years of experience and specific outcome levels to be achieved | 1 | 2 |
| Years of experience | 1 | 2 |
| Number of years of experience and prior cases | 1 | 2 |
| Recommendation by colleagues as expert | 1 | 2 |
| Experience of working with patient group | 1 | 2 |
| Professional qualification | 2 | 4 |
| Preference and no training in alternative intervention | 1 | 2 |
| Willingness to learn new intervention | 1 | 2 |
| Interest in patient group | 1 | 2 |
| None (trained as part of the study) | 2 | 5 |
| None stated | 31 | 72 |
| Criteria provided for both intervention 1 and 2 deliverers | 12 | 28 |
| Number of health professionals delivering intervention 1 | ||
| Reported | 30 | 69 |
| Median (interquartile range), range | 6 (2–12), 1–58 | |
| Number of health professionals delivering intervention 2 | ||
| Fully reported | 23 | 53 |
| Median (interquartile range), range | 5 (2–19), 1–63 | |
Study methodology and conduct (n = 43 unless otherwise stated)
| Number | Percentage | |
|---|---|---|
| Intervention deliverers–randomisation sequence generation | ||
| Adequate | 1 | 10 |
| Inadequate | 0 | 0 |
| Unclear | 9 | 90 |
| Intervention deliverers–randomisation allocation concealment | ||
| Adequate | 1 | 10 |
| Inadequate | 0 | 0 |
| Unclear | 9 | 90 |
| Participants–randomisation sequence generation | ||
| Adequate | 25 | 58 |
| Inadequate | 0 | 0 |
| Unclear | 18 | 42 |
| Participants–randomisation allocation concealment | ||
| Adequate | 26 | 60 |
| Inadequate | 2 | 5 |
| Unclear | 15 | 35 |
| Blinding–primary outcome assessment | ||
| Yes | 12 | 28 |
| No | 27 | 63 |
| Unclear | 4 | 9 |
| Blinding–participants | ||
| Yes | 1 | 2 |
| No | 34 | 79 |
| Unclear | 8 | 19 |
| Number of centres | ||
| Reported | 42 | 98 |
| Median (IQR) | 1 | (1–5) |
| Study size | ||
| Reported | 42 | 98 |
| Median (IQR) | 111 | (62–226) |
| Percentage of target size recruited | ||
| Reported target size | 17 | 40 |
| Median (IQR) | 101 | (94–118) |
| Percentage received full intervention | ||
| Reported | 31 | 74 |
| Median (IQR) | 92 | (82–99) |
| Cross-over to other study intervention | ||
| Reported | 18 | 42 |
| Median (IQR) | 0 | (0–2) |
| “Third” intervention | ||
| Reported | 15 | 35 |
| Median (IQR) | 0 | (0–0) |
IQR interquartile range
Primary outcome(s) (n = 43 unless otherwise stated)
| Number | Percentage | |
|---|---|---|
| Primary outcome | ||
| Number of primary outcomes | ||
| None | 17 | 40 |
| 1 | 15 | 35 |
| 2 | 5 | 12 |
| 3 | 3 | 7 |
| 4 | 2 | 5 |
| 5 | 0 | 0 |
| 6 | 1 | 2 |
| Type of outcome ( | ||
| Pain | 4 | 8 |
| Generic quality of life | 2 | 4 |
| Disease-specific quality of life | 14 | 29 |
| Treatment success | 4 | 8 |
| Other patient-reported outcome | 8 | 17 |
| Mortality, composite including mortality | 2 | 4 |
| Process measure | 8 | 17 |
| Functional measure | 6 | 13 |
| Valid observations ( | 127 (78–435), 24–4752 | |
aFor studies with more than one primary outcome, the maximum available number of observations was used
Statistical analysis methodology (n = 43 unless otherwise stated)
| Number | Percentage | |
|---|---|---|
| Analysis groups according to randomised groups | ||
| Yes | 42 | 98 |
| No | 1 | 2 |
| Unclear | 0 | 0 |
| Analysis adjusting for non-compliance carried out | ||
| Yes | 8 | 19 |
| No | 35 | 81 |
| Unclear | 0 | 0 |
| Compliance analysis type | ||
| As treated groups | 3 | 7 |
| Intervention completer subset analysis (full compliance) | 2 | 5 |
| Intervention completer subset analysis (partial and full compliance) | 2 | 5 |
| Randomisation-based analysis (method unclear) | 1 | 2 |
| N/A | 35 | 81 |
| Analysis adjusting for clusteringa | ||
| Yes | 2b | 5 |
| No | 41 | 95 |
| Unclear | 0 | 0 |
N/A not available
aAnalyses carried out were mixed-effect models: one with two levels (intervention deliverer and) and one with three (site, intervention deliverer, and participant). bIn one study, the sample size was adjusted to account for clustering by using an intracluster correlation coefficient (ICC) of 0.02; for the other study the observed ICC of the higher level(s) was reported for the two primary outcomes (retention and engagement) under a two level (therapist and participant) and a 3 level model (site, therapist and participant) as 0.180 and 0.22 and 0.099 and 0.110 respectively