Torrey A Creed1, Margaret E Crane2, Amber Calloway1, Thomas M Olino2, Philip C Kendall2, Shannon Wiltsey Stirman3. 1. Perelman School of Medicine, University of Pennsylvania, 3535 Market Street Suite 3046, Philadelphia, PA, USA. 2. Department of Psychology, Temple University, Weiss Hall, 1701 N. 13th Street, Philadelphia, PA, USA. 3. National Center for PTSD and Stanford University, 795 Willow Road NC-PTSD, Menlo Park, CA, 94025, USA.
Abstract
BACKGROUND: Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training. METHODS: Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase). RESULTS: Latent change models identified significant improvement in attitudes (Ms latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms latent change ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, β≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, β=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated. CONCLUSIONS: Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.
BACKGROUND: Although the literature suggest that attitudes toward evidence-based practices (EBPs) are associated with provider use of EBPs, less is known about the association between attitudes and how competently EBPs are delivered. This study examined how initial attitudes and competence relate to improvements in attitudes and competence following EBP training. METHODS: Program evaluation data was collected during implementation of an EBP in a large community mental health network. Clinicians (N=891) received intensive training in cognitive behavioral therapy followed by six months of consultation. Attitudes were assessed using the Evidence-Based Practice Attitude Scale, and competence was assessed using the Cognitive Therapy Rating Scale. Data were analyzed by fitting three latent change score models to examine the relationship between changes in attitudes and competence across the training and within its two phases (workshop phase, consultation phase). RESULTS: Latent change models identified significant improvement in attitudes (Ms latent change≥1.03, SEs≤ 0.18, zs≥6.55, ps< .001) and competence (Ms latent change ≥14.16, SEs≤3.10, zs≥2.82, ps<.001) across the full training and in each phase. Higher pre-workshop attitudes predicted significantly greater change in competence in the workshop and across training (bs≥1.62, SEs≤0.90, z≥1.09, p<.04, β≥0.10); however, contrary to our hypothesis, post-workshop attitudes did not significantly predict change in competence in consultation (b=1.62, SE=0.86, z=1.87, p=.06, β=0.09). Change in attitudes and change in competence in the training period and within the two phases were not significantly correlated. CONCLUSIONS: Results indicate that pre-training attitudes about EBPs present a target for implementation interventions, given their relation to changes in both attitudes and competence throughout training. Following participation in in itial training workshops, other factors such as subjective norms, implementation culture, or system-level policy shifts may be more predictive of change in competence through consultation.
Authors: B F Shaw; I Elkin; J Yamaguchi; M Olmsted; T M Vallis; K S Dobson; A Lowery; S M Sotsky; J T Watkins; S D Imber Journal: J Consult Clin Psychol Date: 1999-12
Authors: Alexandra M Burgess; Jaime Chang; Brad J Nakamura; Sonia Izmirian; Kelsie H Okamura Journal: J Behav Health Serv Res Date: 2017-10 Impact factor: 1.505
Authors: Scott W Henggeler; Jason E Chapman; Melisa D Rowland; Colleen A Halliday-Boykins; Jeff Randall; Jennifer Shackelford; Sonja K Schoenwald Journal: J Consult Clin Psychol Date: 2008-08
Authors: Laura J Damschroder; David C Aron; Rosalind E Keith; Susan R Kirsh; Jeffery A Alexander; Julie C Lowery Journal: Implement Sci Date: 2009-08-07 Impact factor: 7.327
Authors: Beth Fordham; Thavapriya Sugavanam; Katherine Edwards; Paul Stallard; Robert Howard; Roshan das Nair; Bethan Copsey; Hopin Lee; Jeremy Howick; Karla Hemming; Sarah E Lamb Journal: Psychol Med Date: 2021-01-18 Impact factor: 7.723
Authors: Torrey A Creed; Patty B Kuo; Rebecca Oziel; Danielle Reich; Margaret Thomas; Sydne O'Connor; Zac E Imel; Tad Hirsch; Shrikanth Narayanan; David C Atkins Journal: Adm Policy Ment Health Date: 2021-09-18
Authors: Torrey A Creed; Leah Salama; Roisin Slevin; Michael Tanana; Zac Imel; Shrikanth Narayanan; David C Atkins Journal: BMC Health Serv Res Date: 2022-09-20 Impact factor: 2.908