BACKGROUND: Behavioral intervention effectiveness in randomized controlled trials requires fidelity to the protocol. Fidelity assessment tools tailored to the intervention may strengthen intervention research. OBJECTIVE: The aim of this study was to describe the assessment of fidelity to the structured intervention protocol in an examination of a nurse-delivered telephone intervention designed to improve medication adherence. METHODS: Fidelity assessment included random selection and review of approximately 10% of the audiorecorded intervention sessions, stratified by interventionist and intervention session. Audiotapes were reviewed along with field notes for percentage of agreement, addressing whether key components were covered during the sessions. Visual analog scales were used to provide summary scores (0 = low to 5 = high) of interaction characteristics of the interventionists and participants with respect to engagement, demeanor, listening skills, attentiveness, and openness. RESULTS: Four nurse interventionists delivered 871 structured intervention sessions to 113 participants. Three trained graduate student researchers assessed 131 intervention sessions. The mean percentage of agreement was 92.0% (±10.5%), meeting the criteria of 90% congruence with the intervention protocol. The mean interventionist interaction summary score was 4.5 ± 0.4, and the mean participant interaction summary score was 4.5 ± 0.4. DISCUSSION: Overall, the interventionists successfully delivered the structured intervention content, with some variability in both the percentage of agreement and quality of interaction scores. Ongoing assessment aids in ensuring fidelity to study protocol and having reliable study results.
RCT Entities:
BACKGROUND: Behavioral intervention effectiveness in randomized controlled trials requires fidelity to the protocol. Fidelity assessment tools tailored to the intervention may strengthen intervention research. OBJECTIVE: The aim of this study was to describe the assessment of fidelity to the structured intervention protocol in an examination of a nurse-delivered telephone intervention designed to improve medication adherence. METHODS: Fidelity assessment included random selection and review of approximately 10% of the audiorecorded intervention sessions, stratified by interventionist and intervention session. Audiotapes were reviewed along with field notes for percentage of agreement, addressing whether key components were covered during the sessions. Visual analog scales were used to provide summary scores (0 = low to 5 = high) of interaction characteristics of the interventionists and participants with respect to engagement, demeanor, listening skills, attentiveness, and openness. RESULTS: Four nurse interventionists delivered 871 structured intervention sessions to 113 participants. Three trained graduate student researchers assessed 131 intervention sessions. The mean percentage of agreement was 92.0% (±10.5%), meeting the criteria of 90% congruence with the intervention protocol. The mean interventionist interaction summary score was 4.5 ± 0.4, and the mean participant interaction summary score was 4.5 ± 0.4. DISCUSSION: Overall, the interventionists successfully delivered the structured intervention content, with some variability in both the percentage of agreement and quality of interaction scores. Ongoing assessment aids in ensuring fidelity to study protocol and having reliable study results.
Authors: D G Altman; K F Schulz; D Moher; M Egger; F Davidoff; D Elbourne; P C Gøtzsche; T Lang Journal: Ann Intern Med Date: 2001-04-17 Impact factor: 25.391
Authors: Jennifer H Lingler; Susan M Sereika; Carolyn M Amspaugh; Janet A Arida; Mary E Happ; Martin P Houze; Robert R Kaufman; Melissa L Knox; Lisa K Tamres; Fengyan Tang; Judith A Erlen Journal: Geriatr Nurs Date: 2016-01-21 Impact factor: 2.361
Authors: Judith A Erlen; Lisa K Tamres; Nancy Reynolds; Carol E Golin; Marc I Rosen; Robert H Remien; Julie W Banderas; Neil Schneiderman; Glenn Wagner; David R Bangsberg; Honghu Liu Journal: West J Nurs Res Date: 2014-03-12 Impact factor: 1.967
Authors: Elizabeth A Schlenk; G Kelley Fitzgerald; Joan C Rogers; C Kent Kwoh; Susan M Sereika Journal: J Aging Phys Act Date: 2020-09-04 Impact factor: 1.961
Authors: Wendy Hardeman; Laura Lamming; Ian Kellar; Anna De Simoni; Jonathan Graffy; Sue Boase; Stephen Sutton; Andrew Farmer; Ann Louise Kinmonth Journal: Implement Sci Date: 2014-06-05 Impact factor: 7.327
Authors: Jamie M Jacobs; Chelsea S Rapoport; Arielle Horenstein; Madison Clay; Emily A Walsh; Jeffrey Peppercorn; Jennifer S Temel; Joseph A Greer Journal: BMJ Open Date: 2021-01-04 Impact factor: 2.692
Authors: K J Sikkema; S Rabie; A King; M H Watt; M I Mulawa; L S Andersen; P A Wilson; A Marais; E Ndwandwa; S Majokweni; C Orrell; J A Joska Journal: Trials Date: 2022-08-18 Impact factor: 2.728