Laura Desveaux1,2, Noah Michael Ivers3,4,5, Kim Devotta6,7, Noor Ramji5,8, Karen Weyman5,8, Tara Kiran4,5,6,8. 1. Women's College Hospital Institute for Health Systems Solutions and Virtual Care, 76 Grenville Ave Toronto, Toronto, Ontario, Canada. laura.desveaux@wchospital.ca. 2. Institute for Health Policy, Management & Evaluation, University of Toronto, 155 College St, Toronto, Ontario, Canada. laura.desveaux@wchospital.ca. 3. Women's College Hospital Institute for Health Systems Solutions and Virtual Care, 76 Grenville Ave Toronto, Toronto, Ontario, Canada. 4. Institute for Health Policy, Management & Evaluation, University of Toronto, 155 College St, Toronto, Ontario, Canada. 5. Department of Family and Community Medicine, University of Toronto, 500 University Avenue, Toronto, Ontario, Canada. 6. MAP Centre for Urban Health Solutions, Li Ka Shing Knowledge Institute of St. Michael's Hospital, 30 Bond Street, Toronto, Ontario, Canada. 7. Dalla Lana School of Public Health, University of Toronto, 155 College St, Toronto, Ontario, Canada. 8. Department of Family and Community Medicine, St. Michael's Hospital, 30 Bond Street, Toronto, Ontario, Canada.
Abstract
BACKGROUND: Audit and feedback (A&F) often successfully enhances health professionals' intentions to improve quality of care but does not consistently lead to practice changes. Recipients often cite data credibility and limited resources as barriers impeding their ability to act upon A&F, suggesting the intention-to-action gap manifests while recipients are interacting with their data. While attention has been paid to the role feedback and contextual variables play in contributing to (or impeding) success, we lack a nuanced understanding of how healthcare professionals interact with and process clinical performance data. METHODS: We used qualitative, semi-structured interviews guided by Normalization Process Theory (NPT). Questions explored the role of data in quality improvement, experiences with the A&F report, perceptions of the data, and interpretations and reflections. Interviews were audio-recorded and transcribed verbatim. Data were analyzed using a combination of inductive and deductive strategies using reflexive thematic analysis informed by a constructivist paradigm. RESULTS: Healthcare professional characteristics (individual quality improvement capabilities and beliefs about data) seem to influence engagement with A&F to a greater degree than feedback variables (i.e., delivered by peers) and observed contextual factors (i.e., strong quality improvement culture). Most participants lacked the capabilities to interpret practice-level data in an actionable way despite a motivation to engage meaningfully. Reasons for the intention-to-action gap included challenges interpreting longitudinal data, appreciating the nuances of common data sources, understanding how aggregate data provides insights into individualized care, and identifying practice-level actions to improve quality. These factors limited effective cognitive participation and collective action, as outlined in NPT. CONCLUSIONS: A well-designed A&F intervention is necessary but not sufficient to inform practice changes. A&F initiatives must include co-interventions to address recipient characteristics (i.e., beliefs and capabilities) and context to optimize impact. Effective strategies to overcome the intention-to-action gap may include modelling how to use A&F to inform practice change, providing opportunities for social interaction relating to the A&F, and circulating examples of effective actions taken in response to A&F. More broadly, undergraduate medical education and post-graduate training must ensure physicians are equipped with QI capabilities, with an emphasis on the skills required to interpret and act on practice-level data.
BACKGROUND: Audit and feedback (A&F) often successfully enhances health professionals' intentions to improve quality of care but does not consistently lead to practice changes. Recipients often cite data credibility and limited resources as barriers impeding their ability to act upon A&F, suggesting the intention-to-action gap manifests while recipients are interacting with their data. While attention has been paid to the role feedback and contextual variables play in contributing to (or impeding) success, we lack a nuanced understanding of how healthcare professionals interact with and process clinical performance data. METHODS: We used qualitative, semi-structured interviews guided by Normalization Process Theory (NPT). Questions explored the role of data in quality improvement, experiences with the A&F report, perceptions of the data, and interpretations and reflections. Interviews were audio-recorded and transcribed verbatim. Data were analyzed using a combination of inductive and deductive strategies using reflexive thematic analysis informed by a constructivist paradigm. RESULTS: Healthcare professional characteristics (individual quality improvement capabilities and beliefs about data) seem to influence engagement with A&F to a greater degree than feedback variables (i.e., delivered by peers) and observed contextual factors (i.e., strong quality improvement culture). Most participants lacked the capabilities to interpret practice-level data in an actionable way despite a motivation to engage meaningfully. Reasons for the intention-to-action gap included challenges interpreting longitudinal data, appreciating the nuances of common data sources, understanding how aggregate data provides insights into individualized care, and identifying practice-level actions to improve quality. These factors limited effective cognitive participation and collective action, as outlined in NPT. CONCLUSIONS: A well-designed A&F intervention is necessary but not sufficient to inform practice changes. A&F initiatives must include co-interventions to address recipient characteristics (i.e., beliefs and capabilities) and context to optimize impact. Effective strategies to overcome the intention-to-action gap may include modelling how to use A&F to inform practice change, providing opportunities for social interaction relating to the A&F, and circulating examples of effective actions taken in response to A&F. More broadly, undergraduate medical education and post-graduate training must ensure physicians are equipped with QI capabilities, with an emphasis on the skills required to interpret and act on practice-level data.
Entities:
Keywords:
Audit and feedback; Implementation; Physician learning; Practice improvement; Primary care