Ramzi G Salloum1, Alana M Rojewski2, Megan E Piper3, Janice A Blalock4, Belinda Borrelli5, Lindsay M Boyce6, Jennifer A Minnix4, Omara Dogar7, Rachel L Tomko2, Douglas E Jorenby3, Chris Kotsen6, Jamie S Ostroff6. 1. Department of Health Outcomes and Biomedical Informatics, University of Florida, College of Medicine, Gainesville, FL, USA. 2. Department of Public Health Sciences, Medical University of South Carolina, Charleston, SC, USA. 3. Center for Tobacco Research and Intervention, University of Wisconsin-Madison, Madison, WI, USA. 4. Department of Behavioral Science, University of Texas, MD Anderson Cancer Center, Houston, TX, USA. 5. Center for Behavioral Science Research, Boston University, Henry M. Goldman School of Dental Medicine, Boston, MA, USA. 6. Department of Psychiatry and Behavioral Science, Memorial Sloan Kettering Cancer Center, New York, NY, USA. 7. Department of Health Sciences, University of York, York, United Kingdom.
Abstract
INTRODUCTION: Adoption of rigorous standards for reporting treatment fidelity is essential for advancing discovery, validation, and implementation of behavioral treatments. Whereas the NIH Behavior Change Consortium (BCC) developed an assessment tool to assess the quality of reporting and monitoring of treatment fidelity across health behavior change interventions, it has not yet been applied specifically to treatment fidelity in behavioral tobacco treatment trials. AIMS AND METHODS: We conducted a scoping review of peer-reviewed, clinical trials of behavioral adult tobacco treatment interventions published in English between 2006 and 2018. Using the BCC treatment fidelity checklist, articles were coded for the presence or absence of various treatment fidelity strategies within each of 5 domains: Design, Training, Delivery, Receipt, and Enactment. Eligible articles (N = 755) were coded by two independent coders. RESULTS: The proportion of reporting strategies varied within the fidelity domains, ranging from 5.2% to 96.3% in Design, 1.9% to 24.9% in Training, 2.6% to 32.3% in Delivery, 5.2% to 44.3% in Receipt, and 6.7% to 43.2% in Enactment. The mean proportion of adherence to treatment fidelity strategies within each domain was: Design (68%), Training (14%), Delivery (15%), Receipt (16%), and Enactment (25%). Only 11 studies achieved ≥80% reporting across >1 fidelity domain. There was no evidence for improvement in fidelity reporting across the 13-year time frame from the initial BCC publication to the present. CONCLUSIONS: These findings illustrate the lack of consistency in fidelity reporting in tobacco treatment trials and underscore the challenges faced in evaluating rigor and reproducibility, as well as interpretation and dissemination of findings. Recommendations are made for improving fidelity reporting in tobacco treatment trials. IMPLICATIONS: The SRNT Treatment Research Network sponsored a scoping review to summarize the current state of reporting treatment fidelity and make recommendations for best practices in reporting fidelity in tobacco treatment trials. The review identified a lack of consistency in fidelity reporting, illustrating the challenges faced in evaluating rigor, and reproducibility, as well as interpretation and dissemination of findings.
INTRODUCTION: Adoption of rigorous standards for reporting treatment fidelity is essential for advancing discovery, validation, and implementation of behavioral treatments. Whereas the NIH Behavior Change Consortium (BCC) developed an assessment tool to assess the quality of reporting and monitoring of treatment fidelity across health behavior change interventions, it has not yet been applied specifically to treatment fidelity in behavioral tobacco treatment trials. AIMS AND METHODS: We conducted a scoping review of peer-reviewed, clinical trials of behavioral adult tobacco treatment interventions published in English between 2006 and 2018. Using the BCC treatment fidelity checklist, articles were coded for the presence or absence of various treatment fidelity strategies within each of 5 domains: Design, Training, Delivery, Receipt, and Enactment. Eligible articles (N = 755) were coded by two independent coders. RESULTS: The proportion of reporting strategies varied within the fidelity domains, ranging from 5.2% to 96.3% in Design, 1.9% to 24.9% in Training, 2.6% to 32.3% in Delivery, 5.2% to 44.3% in Receipt, and 6.7% to 43.2% in Enactment. The mean proportion of adherence to treatment fidelity strategies within each domain was: Design (68%), Training (14%), Delivery (15%), Receipt (16%), and Enactment (25%). Only 11 studies achieved ≥80% reporting across >1 fidelity domain. There was no evidence for improvement in fidelity reporting across the 13-year time frame from the initial BCC publication to the present. CONCLUSIONS: These findings illustrate the lack of consistency in fidelity reporting in tobacco treatment trials and underscore the challenges faced in evaluating rigor and reproducibility, as well as interpretation and dissemination of findings. Recommendations are made for improving fidelity reporting in tobacco treatment trials. IMPLICATIONS: The SRNT Treatment Research Network sponsored a scoping review to summarize the current state of reporting treatment fidelity and make recommendations for best practices in reporting fidelity in tobacco treatment trials. The review identified a lack of consistency in fidelity reporting, illustrating the challenges faced in evaluating rigor, and reproducibility, as well as interpretation and dissemination of findings.
Authors: John S Baer; Samuel A Ball; Barbara K Campbell; Gloria M Miele; Eugene P Schoener; Kathlene Tracy Journal: Drug Alcohol Depend Date: 2006-10-04 Impact factor: 4.492
Authors: Kamran Siddiqi; Amir Khan; Maqsood Ahmad; Omara Dogar; Mona Kanaan; James N Newell; Heather Thomson Journal: Ann Intern Med Date: 2013-05-07 Impact factor: 25.391