Sushant Govindan1, Vineet Chopra1,2,3, Theodore J Iwashyna1,2. 1. Department of Medicine, University of Michigan Health System, Ann Arbor, MI, USA. 2. Center for Clinical Management Research, Ann Arbor VA Healthcare System, Ann Arbor, MI, USA. 3. Patient Safety Enhancement Program, Ann Arbor VA Medical Center, Ann Arbor, Michigan, USA.
Abstract
OBJECTIVE: Despite significant efforts and cost, quality metrics do not consistently influence practice. While research has focused on improving data through statistical risk-adjustment, whether clinicians understand these data is unknown. Therefore, we assessed clinician comprehension of central line-associated blood stream infection (CLABSI) quality metric data. DESIGN: Cross-sectional survey with an 11-item test of CLABSI data comprehension. Each question assessed 1 of 3 concepts concerning CLABSI understanding: basic numeracy, risk-adjustment numeracy, and risk-adjustment interpretation. Hypothetical data were used and presented in a validated format. PARTICIPANTS: Clinicians were recruited from 6 nations via Twitter to take an online survey. Clinician eligibility was confirmed by assessing responses to a question regarding CLABSI. MAIN MEASURES: The primary outcome was percent correct of attempted questions pertaining to the presented CLABSI data. RESULTS: Ninety-seven clinicians answered at least 1 item, providing 939 responses; 72 answered all 11 items. The mean percentage of correct answers was 61% (95% confidence interval [CI], 57%-65%). Overall, doctor performance was better than performance by nurses and other respondents (68% [95% CI, 63%-73%] vs. 57% [95% CI, 52%-62%], P = 0.003). In basic numeracy, mean percent correct was 82% (95% CI, 77%-87%). For risk-adjustment numeracy, the mean percent correct was 70% (95% CI, 64%-76%). Risk-adjustment interpretation had the lowest average percent correct, 43% (95% CI, 37%-49%). All pairwise differences between concepts were statistically significant at P <0.05. CONCLUSIONS: CLABSI quality metric comprehension appears low and varies substantially among clinicians. These findings may contribute to the limited impact of quality metric reporting programs, and further research is needed. Journal of Hospital Medicine 2017;12:18-22.
OBJECTIVE: Despite significant efforts and cost, quality metrics do not consistently influence practice. While research has focused on improving data through statistical risk-adjustment, whether clinicians understand these data is unknown. Therefore, we assessed clinician comprehension of central line-associated blood stream infection (CLABSI) quality metric data. DESIGN: Cross-sectional survey with an 11-item test of CLABSI data comprehension. Each question assessed 1 of 3 concepts concerning CLABSI understanding: basic numeracy, risk-adjustment numeracy, and risk-adjustment interpretation. Hypothetical data were used and presented in a validated format. PARTICIPANTS: Clinicians were recruited from 6 nations via Twitter to take an online survey. Clinician eligibility was confirmed by assessing responses to a question regarding CLABSI. MAIN MEASURES: The primary outcome was percent correct of attempted questions pertaining to the presented CLABSI data. RESULTS: Ninety-seven clinicians answered at least 1 item, providing 939 responses; 72 answered all 11 items. The mean percentage of correct answers was 61% (95% confidence interval [CI], 57%-65%). Overall, doctor performance was better than performance by nurses and other respondents (68% [95% CI, 63%-73%] vs. 57% [95% CI, 52%-62%], P = 0.003). In basic numeracy, mean percent correct was 82% (95% CI, 77%-87%). For risk-adjustment numeracy, the mean percent correct was 70% (95% CI, 64%-76%). Risk-adjustment interpretation had the lowest average percent correct, 43% (95% CI, 37%-49%). All pairwise differences between concepts were statistically significant at P <0.05. CONCLUSIONS: CLABSI quality metric comprehension appears low and varies substantially among clinicians. These findings may contribute to the limited impact of quality metric reporting programs, and further research is needed. Journal of Hospital Medicine 2017;12:18-22.
Authors: Noah Ivers; Gro Jamtvedt; Signe Flottorp; Jane M Young; Jan Odgaard-Jensen; Simon D French; Mary Ann O'Brien; Marit Johansen; Jeremy Grimshaw; Andrew D Oxman Journal: Cochrane Database Syst Rev Date: 2012-06-13
Authors: Thomas Agoritsas; Delphine S Courvoisier; Christophe Combescure; Marie Deom; Thomas V Perneger Journal: J Gen Intern Med Date: 2010-11-04 Impact factor: 5.128
Authors: Naomi P O'Grady; Mary Alexander; Lillian A Burns; E Patchen Dellinger; Jeffrey Garland; Stephen O Heard; Pamela A Lipsett; Henry Masur; Leonard A Mermel; Michele L Pearson; Issam I Raad; Adrienne G Randolph; Mark E Rupp; Sanjay Saint Journal: Am J Infect Control Date: 2011-05 Impact factor: 2.918
Authors: Lawrence P Casalino; David Gans; Rachel Weber; Meagan Cea; Amber Tuchovsky; Tara F Bishop; Yesenia Miranda; Brittany A Frankel; Kristina B Ziehler; Meghan M Wong; Todd B Evenson Journal: Health Aff (Millwood) Date: 2016-03 Impact factor: 6.301
Authors: Michael L Rinke; David G Bundy; Allen R Chen; Aaron M Milstone; Elizabeth Colantuoni; Miriana Pehar; Cynthia Herpst; Lisa Fratino; Marlene R Miller Journal: Pediatrics Date: 2013-10-07 Impact factor: 7.124
Authors: Sarah T Hawley; Brian Zikmund-Fisher; Peter Ubel; Aleksandra Jancovic; Todd Lucas; Angela Fagerlin Journal: Patient Educ Couns Date: 2008-08-27
Authors: Noah M Ivers; Jeremy M Grimshaw; Gro Jamtvedt; Signe Flottorp; Mary Ann O'Brien; Simon D French; Jane Young; Jan Odgaard-Jensen Journal: J Gen Intern Med Date: 2014-11 Impact factor: 5.128
Authors: Brenda M McGrath; Linda Takamine; Cainnear K Hogan; Timothy P Hofer; Amy K Rosen; Jeremy B Sussman; Wyndy L Wiitala; Andrew M Ryan; Hallie C Prescott Journal: BMC Health Serv Res Date: 2022-06-03 Impact factor: 2.908