Evaluation of the quality of 'do not use' medication abbreviation audits: a key enabler to successful implementation of audit and feedback.

Background Hospital pharmacy audit and feedback of 'do not use' medication abbreviations improves patient safety. For audit and feedback systems to be effective, the data captured must be of high quality such that end-users trust the information to guide practice change. The quality of data captured during monthly standardized pharmacy 'do not use' abbreviation audits is currently unknown. Objective We aimed to assess pharmacy 'do not use' abbreviation audit data quality. Method Primary audit data quality was assessed by examining a random sample of handwritten medication prescriptions for the presence and type of 'do not use' abbreviations. This data was compared with the pharmacy monthly audit data to determine data capture agreement and consistency over time. Results There were 1132 prescriptions from July, October, and December 2019 included. Data capture agreement between the pharmacy audit and the secondary assessment using Cohen's Kappa ranged from 0.53 to 0.63. The primary audit under-reported 'do not use' abbreviation rates, however this did not vary over time (χ2 = 1.215, p = 0.545). Conclusion Pharmacy staff audits under-reported 'do not use' abbreviation rates, however this was consistent over time. The quality of pharmacy audits should be assessed and disseminated to end-users prior to implementing feedback.