Mary H Smart1, Andrea L Monteiro, Christopher D Saffore, Aleksandrina Ruseva, Todd A Lee, Michael A Fischer, Alan Simon Pickard. 1. Dr. Smart, Ms. Monteiro, Dr. Saffore, Ms. Ruseva, Dr. Lee, Dr. Pickard: Department of Pharmacy Systems, Outcomes and Policy, College of Pharmacy, University of Illinois at Chicago, Chicago, IL; and Dr. Fischer: Division of Pharmacoepidemiology and Pharmacoeconomics, National Resource Center for Academic Detailing, Brigham and Women's Hospital, Boston, MA.
Abstract
INTRODUCTION: Academic detailing (AD) is an effective, evidence-based education outreach method of promoting clinician behavior change. Detailer feedback is important for program evaluation but is rarely systematically collected. The study's objective was to develop a measure capturing the detailer's perception of the effectiveness of an AD program. METHODS: A six-item measure with a five-level scale was initially developed from the literature review and expert panel consultation. Item constructs were usefulness, acceptability, feasibility, relevance, effectiveness of communication, and readiness to change. The measure was piloted, refined, and tested during an opioid-focused AD program that included two visits. The instrument structure was evaluated using exploratory factor analysis, measure reliability was assessed using item-item correlation (rho), corrected item-total correlation, Cronbach alpha (α), and item response theory. RESULTS: The initial six-item instrument demonstrated unidimensionality. The Cronbach α for the measure was 0.74 (visit 1) and 0.79 (visit 2); one item (relevance) was redundant (α = 0.73 and 0.79 when deleted) and therefore dropped. Items related to usefulness, acceptability, and readiness to change displayed high item-item correlation (rho ≥ 0.50) and contributed the most information and seemed to operate as a single scale (ie, "likelihood to change") based on item response theory analysis. Items related to feasibility and communication were slightly different constructs and should be reported separately. DISCUSSION: The five-item detailer assessment of visit effectiveness (the "DAVE") instrument provides a standardized approach to assess AD. Further study of its validity and broader use in other programs and educational outreach activities is encouraged.
INTRODUCTION: Academic detailing (AD) is an effective, evidence-based education outreach method of promoting clinician behavior change. Detailer feedback is important for program evaluation but is rarely systematically collected. The study's objective was to develop a measure capturing the detailer's perception of the effectiveness of an AD program. METHODS: A six-item measure with a five-level scale was initially developed from the literature review and expert panel consultation. Item constructs were usefulness, acceptability, feasibility, relevance, effectiveness of communication, and readiness to change. The measure was piloted, refined, and tested during an opioid-focused AD program that included two visits. The instrument structure was evaluated using exploratory factor analysis, measure reliability was assessed using item-item correlation (rho), corrected item-total correlation, Cronbach alpha (α), and item response theory. RESULTS: The initial six-item instrument demonstrated unidimensionality. The Cronbach α for the measure was 0.74 (visit 1) and 0.79 (visit 2); one item (relevance) was redundant (α = 0.73 and 0.79 when deleted) and therefore dropped. Items related to usefulness, acceptability, and readiness to change displayed high item-item correlation (rho ≥ 0.50) and contributed the most information and seemed to operate as a single scale (ie, "likelihood to change") based on item response theory analysis. Items related to feasibility and communication were slightly different constructs and should be reported separately. DISCUSSION: The five-item detailer assessment of visit effectiveness (the "DAVE") instrument provides a standardized approach to assess AD. Further study of its validity and broader use in other programs and educational outreach activities is encouraged.
Authors: Craig E Keller; Lisham Ashrafioun; Anne M Neumann; Justin Van Klein; Chester H Fox; Richard D Blondell Journal: Subst Abus Date: 2012 Impact factor: 3.716
Authors: Elizabeth M Oliva; Melissa L D Christopher; Daina Wells; Mark Bounthavong; Michael Harvey; Julianne Himstreet; Thomas Emmendorfer; Michael Valentino; Mariano Franchi; Francine Goodman; Jodie A Trafton Journal: J Am Pharm Assoc (2003) Date: 2017 Mar - Apr
Authors: M A O'Brien; S Rogers; G Jamtvedt; A D Oxman; J Odgaard-Jensen; D T Kristoffersen; L Forsetlund; D Bainbridge; N Freemantle; D A Davis; R B Haynes; E L Harvey Journal: Cochrane Database Syst Rev Date: 2007-10-17
Authors: Andrea L Monteiro; Mary Smart; Christopher D Saffore; Todd A Lee; Sarette T Tilton; Michael A Fischer; A Simon Pickard Journal: Drugs Context Date: 2022-01-13