Brian C Martinson1,2,3, David C Mohr4,5, Martin P Charns4, David Nelson1,3, Emily Hagel-Campbell1, Ann Bangerter1, Hanna E Bloomfield1,3, Richard Owen6, Carol R Thrush7. 1. a Center for Chronic Disease Outcomes Research , Minneapolis VA Healthcare System. 2. b HealthPartners Institute. 3. c Department of Medicine , University of Minnesota. 4. d Center for Healthcare Organization and Implementation Research , VA Boston Healthcare System. 5. e Boston University School of Public Health. 6. f Center for Mental Healthcare & Outcomes Research, Little Rock VA. 7. g University of Arkansas for Medical Sciences.
Abstract
BACKGROUND: Assessing the integrity of research climates and sharing such information with research leaders may support research best practices. We report here results of a pilot trial testing the effectiveness of a reporting and feedback intervention using the Survey of Organizational Research Climate (SOuRCe). METHODS: We randomized 41 Veterans Health Administration (VA) facilities to a phone-based intervention designed to help research leaders understand their survey results (enhanced arm) or to an intervention in which results were simply distributed to research leaders (basic arm). Primary outcomes were (1) whether leaders took action, (2) whether actions taken were consistent with the feedback received, and (3) whether responses differed by receptivity to quality improvement input. RESULTS:Research leaders from 25 of 42 (59%) VA facilities consented to participate in the study intervention and follow-up, of which 14 were at facilities randomized to the enhanced arm. We completed follow-up interviews with 21 of the 25 leaders (88%), 12 from enhanced arm facilities. While not statistically significant, the proportion of leaders reporting taking some action in response to the feedback was twice as high in the enhanced arm than in the basic arm (67% vs. 33%, p = .20). While also not statistically significant, a higher proportion of actions taken among facilities in the enhanced arm were responsive to the survey results than in the basic arm (42% vs. 22%, p = .64). CONCLUSIONS: Enhanced feedback of survey results appears to be a promising intervention that may increase the likelihood of responsive action to improve organizational climates. Due to the small sample size of this pilot study, even large percentage-point differences between study arms are not statistically distinguishable. This hypothesis should be tested in a larger trial.
RCT Entities:
BACKGROUND: Assessing the integrity of research climates and sharing such information with research leaders may support research best practices. We report here results of a pilot trial testing the effectiveness of a reporting and feedback intervention using the Survey of Organizational Research Climate (SOuRCe). METHODS: We randomized 41 Veterans Health Administration (VA) facilities to a phone-based intervention designed to help research leaders understand their survey results (enhanced arm) or to an intervention in which results were simply distributed to research leaders (basic arm). Primary outcomes were (1) whether leaders took action, (2) whether actions taken were consistent with the feedback received, and (3) whether responses differed by receptivity to quality improvement input. RESULTS: Research leaders from 25 of 42 (59%) VA facilities consented to participate in the study intervention and follow-up, of which 14 were at facilities randomized to the enhanced arm. We completed follow-up interviews with 21 of the 25 leaders (88%), 12 from enhanced arm facilities. While not statistically significant, the proportion of leaders reporting taking some action in response to the feedback was twice as high in the enhanced arm than in the basic arm (67% vs. 33%, p = .20). While also not statistically significant, a higher proportion of actions taken among facilities in the enhanced arm were responsive to the survey results than in the basic arm (42% vs. 22%, p = .64). CONCLUSIONS: Enhanced feedback of survey results appears to be a promising intervention that may increase the likelihood of responsive action to improve organizational climates. Due to the small sample size of this pilot study, even large percentage-point differences between study arms are not statistically distinguishable. This hypothesis should be tested in a larger trial.
Entities:
Keywords:
Veterans Affairs; organizational climate; randomized controlled trial; reporting and feedback; research integrity; survey
Authors: Jensen T Mecca; Vincent Giorgini; Kelsey Medeiros; Carter Gibson; Lynn Devenport; Shane Connelly; Michael Mumford Journal: Account Res Date: 2014 Impact factor: 2.622
Authors: James A Wells; Carol R Thrush; Brian C Martinson; Terry A May; Michelle Stickler; Eileen C Callahan; Karen L Klomparens Journal: J Empir Res Hum Res Ethics Date: 2014-10-02 Impact factor: 1.742
Authors: Laura J Damschroder; David C Aron; Rosalind E Keith; Susan R Kirsh; Jeffery A Alexander; Julie C Lowery Journal: Implement Sci Date: 2009-08-07 Impact factor: 7.327
Authors: Brian C Martinson; David Nelson; Emily Hagel-Campbell; David Mohr; Martin P Charns; Ann Bangerter; Carol R Thrush; Joseph R Ghilardi; Hanna Bloomfield; Richard Owen; James A Wells Journal: PLoS One Date: 2016-03-11 Impact factor: 3.240