Kirsty Sprange1, Jules Beresford-Dent2, Gail Mountain2, Claire Craig3, Clare Mason2, Katherine Berry4, Jessica Wright5, Shazmin Majid6, Ben Thomas5, Cindy L Cooper5. 1. Nottingham Clinical Trials Unit, Faculty of Medicine, University of Nottingham, Building 42, Nottingham, NG7 2RD, UK. Kirsty.sprange@nottingham.ac.uk. 2. University of Bradford, Bradford, West Yorkshire, BD7 1DP, UK. 3. Sheffield Hallam University, City Campus, Sheffield, S1 1WB, UK. 4. Manchester Academic Health Science Centre, The University of Manchester, Oxford Rd, Manchester, M13 9PL, UK. 5. Sheffield Clinical Trials Research Unit, School of Health and Related Research, University of Sheffield, Sheffield, S1 4DP, UK. 6. Institute of Mental Health, Jubilee Campus, University of Nottingham Innovation Park, Triumph Road, Nottingham, NG7 2TU, UK.
Abstract
BACKGROUND: Understanding intervention delivery as intended, particularly in complex interventions, should be underpinned by good quality fidelity assessment. We present the findings from a fidelity assessment embedded as part of a trial of a complex community-based psychosocial intervention, Journeying through Dementia (JtD). The intervention was designed to equip individuals with the knowledge and skills to successfully self-manage, maintain independence, and live well with dementia and involves both group and individual sessions. The methodological challenges of developing a conceptual framework for fidelity assessment and creating and applying purposely designed measures derived from this framework are discussed to inform future studies. METHODS: A conceptual fidelity framework was created out of core components of the intervention (including the intervention manual and training for delivery), associated trial protocols and pre-defined fidelity standards and criteria against which intervention delivery and receipt could be measured. Fidelity data collection tools were designed and piloted for reliability and usability. Data collection in four selected sites (fidelity sites) was via non-participatory observations of the group aspect of the intervention, attendance registers and interventionist (facilitator and supervisor) self-report. RESULTS: Interventionists from all four fidelity sites attended intervention training. The majority of group participants at the four sites (71%) received the therapeutic dose of 10 out of 16 sessions. Weekly group meeting attendance (including at 'out of venue' sessions) was excellent at 80%. Additionally, all but one individual session was attended by the participants who completed the intervention. It proved feasible to create tools derived from the fidelity framework to assess in-venue group aspects of this complex intervention. Results of fidelity assessment of the observed groups were good with substantial inter-rater reliability between researchers KAPPA 0.68 95% CI (0.58-0.78). Self-report by interventionists concurred with researcher assessments. CONCLUSIONS: There was good fidelity to training and delivery of the group aspect of the intervention at four sites. However, the methodological challenges of assessing all aspects of this complex intervention could not be overcome due to practicalities, assessment methods and ethical considerations. Questions remain regarding how we can assess fidelity in community-based complex interventions without impacting upon intervention or trial delivery. TRIAL REGISTRATION: ISRCTN17993825 .
RCT Entities:
BACKGROUND: Understanding intervention delivery as intended, particularly in complex interventions, should be underpinned by good quality fidelity assessment. We present the findings from a fidelity assessment embedded as part of a trial of a complex community-based psychosocial intervention, Journeying through Dementia (JtD). The intervention was designed to equip individuals with the knowledge and skills to successfully self-manage, maintain independence, and live well with dementia and involves both group and individual sessions. The methodological challenges of developing a conceptual framework for fidelity assessment and creating and applying purposely designed measures derived from this framework are discussed to inform future studies. METHODS: A conceptual fidelity framework was created out of core components of the intervention (including the intervention manual and training for delivery), associated trial protocols and pre-defined fidelity standards and criteria against which intervention delivery and receipt could be measured. Fidelity data collection tools were designed and piloted for reliability and usability. Data collection in four selected sites (fidelity sites) was via non-participatory observations of the group aspect of the intervention, attendance registers and interventionist (facilitator and supervisor) self-report. RESULTS: Interventionists from all four fidelity sites attended intervention training. The majority of group participants at the four sites (71%) received the therapeutic dose of 10 out of 16 sessions. Weekly group meeting attendance (including at 'out of venue' sessions) was excellent at 80%. Additionally, all but one individual session was attended by the participants who completed the intervention. It proved feasible to create tools derived from the fidelity framework to assess in-venue group aspects of this complex intervention. Results of fidelity assessment of the observed groups were good with substantial inter-rater reliability between researchers KAPPA 0.68 95% CI (0.58-0.78). Self-report by interventionists concurred with researcher assessments. CONCLUSIONS: There was good fidelity to training and delivery of the group aspect of the intervention at four sites. However, the methodological challenges of assessing all aspects of this complex intervention could not be overcome due to practicalities, assessment methods and ethical considerations. Questions remain regarding how we can assess fidelity in community-based complex interventions without impacting upon intervention or trial delivery. TRIAL REGISTRATION: ISRCTN17993825 .
Authors: Neil Aaronson; Jordi Alonso; Audrey Burnam; Kathleen N Lohr; Donald L Patrick; Edward Perrin; Ruth E Stein Journal: Qual Life Res Date: 2002-05 Impact factor: 4.147
Authors: Linda Clare; Aleksandra Kudlicka; Jan R Oyebode; Roy W Jones; Antony Bayer; Iracema Leroi; Michael Kopelman; Ian A James; Alison Culverwell; Jackie Pool; Andrew Brand; Catherine Henderson; Zoe Hoare; Martin Knapp; Bob Woods Journal: Int J Geriatr Psychiatry Date: 2019-03-01 Impact factor: 3.485
Authors: Liane R Ginsburg; Matthias Hoben; Adam Easterbrook; Ruth A Anderson; Carole A Estabrooks; Peter G Norton Journal: Trials Date: 2021-05-29 Impact factor: 2.279