| Literature DB >> 23311722 |
Aileen Grant1, Shaun Treweek, Tobias Dreischulte, Robbie Foy, Bruce Guthrie.
Abstract
BACKGROUND: Process evaluations are recommended to open the 'black box' of complex interventions evaluated in trials, but there is limited guidance to help researchers design process evaluations. Much current literature on process evaluations of complex interventions focuses on qualitative methods, with less attention paid to quantitative methods. This discrepancy led us to develop our own framework for designing process evaluations of cluster-randomised controlled trials.Entities:
Mesh:
Year: 2013 PMID: 23311722 PMCID: PMC3600672 DOI: 10.1186/1745-6215-14-15
Source DB: PubMed Journal: Trials ISSN: 1745-6215 Impact factor: 2.279
Figure 1Framework model for designing process evaluations of cluster-randomised controlled trials.
Example research questions and methods for evaluating each process
| Recruitment of clusters | How are clusters sampled and recruited? | Documentation of recruitment process by research team. | Pre-intervention |
| Who agrees to participate? | Quantitative comparison of recruited and nonrecruited clusters. | ||
| Why do clusters agree to participate (or not) | Qualitative analysis of interviews with cluster gatekeepers or members. | ||
| Delivery to clusters | What intervention is actually delivered for each cluster? Is it the one intended by the researchers? | Qualitative analysis of observational, interview and documentary data relating to the cluster-level intervention. | Pre-intervention and early intervention |
| Response of clusters | How is the intervention adopted by clusters? | Quantitative data measuring cluster members’ perceptions of the intervention and uptake of trial components. Qualitative analysis of observational, interview and documentary data about how clusters adopt the intervention. | Pre-intervention and early intervention |
| Recruitment and reach in individuals | Who actually receives the intervention in each setting? Are they representative? | Measurement of receipt in target population. Quantitative comparison of those receiving vs. not receiving the intervention. | During intervention |
| Why do clusters achieve the pattern of reach they do? Do they introduce selection bias? | Qualitative analysis of observational, interview and documentary data about how clusters achieve reach. | ||
| Delivery to individuals | What intervention is actually delivered for each cluster? | Qualitative analysis of observational, interview and documentary data about what intervention is delivered and why. | During intervention |
| Is the delivered intervention the one intended by the researchers? | Measurement of intervention fidelity across its components. | ||
| Response of individuals | How does the target population respond? | Qualitative analysis of observational and interview data about target population’s experience of and response to the intervention. | During intervention and post-intervention |
| Maintenance | How and why are these processes sustained over time (or not)? | Any of the above, but probably focused on processes identified as critical, or as likely to be difficult to sustain. | During intervention and post-intervention |
| Unintended consequences | Are there unintended changes in processes and outcomes, both related to the trial intervention and unrelated care? | Qualitative analysis of observational and interview data for identification. Quantitative data collection for potential unintended consequences during the trial, or use of routine datasets. | Intervention and post-intervention |
| Theory | What theory has been used to develop the intervention? | Quantitative process data analysis can assess whether predicted relationships and sequences of change happened during implementation. | Post-intervention |
| Context | What is the wider context in which the trial is being conducted? | Qualitative data collection from policy documents or interviews. | Pre-intervention and early intervention |
Mapping of the reporting framework to three selected process evaluations
| Nazareth and colleagues
[ | Cluster-randomised trial of a pharmacist-led educational outreach intervention to improve GPs’ prescribing quality | Yes | ’To describe the steps leading to the final primary outcome and explore the effect of the intervention on each step of the hypothesised pathway of change in professionals’ prescribing behaviour’ | Cluster recruitment, Delivery to clusters, Adoption and Delivery to target population, Quantitative associations with effectiveness (reported in main trial paper) | Retrospective/ | Reporting of proportion of practices recruited. Association between proportion of GPs in each practice attending education outreach, the intervention and change in prescribing. Mixed-methods assessment of barriers and facilitators to adoption and delivery to target population. | Partly | Trial design, intervention, targeted outcomes and results summarised, main trial paper referenced |
| Byng and colleagues
[ | Cluster-randomised trial of a complex intervention to promote shared care for people with severe mental health problems | Yes | ’To unpick the complexity of the intervention by examining interactions between components and context and then further defining its core functions’ | Adoption, Reach and Delivery to target population, Qualitative associations with effectiveness | Retrospective data collection, unclear if planned prospectively | Realistic evaluation, qualitative case study, analysis of interview data with a purposive sample of participating mental health team-practice cases. Case study findings were used to better understand how the intervention changed practice and targeted outcomes. | Yes | Trial design, intervention and results summarised, main trial paper referenced |
| Fretheim and colleagues
[ | Cluster-randomised trial of a multifaceted intervention (educational outreach, audit and feedback, computerised reminders, patient information) to improve GPs’ prescribing quality | Yes | ’The main objective of this analysis was to identify factors that could explain variation in outcomes across practices’ | Delivery to clusters, Adoption and Quantitative associations with effectiveness | Prospective / pre-specified | Quantification of GP perceptions of the intervention and the trial, and pharmacist assessment of the quality of educational outreach. Regression analysis of associations with change in prescribing. | Partly | Trial design, intervention, targeted outcomes and results summarised, main trial paper referenced |
GP, general practitioner.