OBJECTIVES: We aimed to assess whether routine data produced by an electronic prescribing system might be useful in identifying doctors at higher risk of making a serious prescribing error. DESIGN: Retrospective analysis of prescribing by junior doctors over 12 months using an electronic prescribing information and communication system. The system issues a graded series of prescribing alerts (low-level, intermediate, and high-level), and warnings and prompts to respond to abnormal test results. These may be overridden or heeded, except for high-level prescribing alerts, which are indicative of a potentially serious error and impose a 'hard stop'. SETTING: A large teaching hospital. PARTICIPANTS: All junior doctors in the study setting. MAIN OUTCOME MEASURES: Rates of prescribing alerts and laboratory warnings and doctors' responses. RESULTS: Altogether 848,678 completed prescriptions issued by 381 doctors (median 1538 prescriptions per doctor, interquartile range [IQR] 328-3275) were analysed. We identified 895,029 low-level alerts (median 1033 per 1000 prescriptions per doctor, IQR 903-1205) with a median of 34% (IQR 31-39%) heeded; 172,434 intermediate alerts (median 196 per 1000 prescriptions per doctor, IQR 159-266), with a median of 23% (IQR 16-30%) heeded; and 11,940 high-level 'hard stop' alerts. Doctors vary greatly in the extent to which they trigger and respond to alerts of different types. The rate of high-level alerts showed weak correlation with the rate of intermediate prescribing alerts (correlation coefficient, r = 0.40, P = <0.001); very weak correlation with low-level alerts (r = 0.12, P = 0.019); and showed weak (and sometimes negative) correlation with propensity to heed test-related warnings or alarms. The degree of correlation between generation of intermediate and high-level alerts is insufficient to identify doctors at high risk of making serious errors. CONCLUSIONS: Routine data from an electronic prescribing system should not be used to identify doctors who are at risk of making serious errors. Careful evaluation of the kinds of quality assurance questions for which routine data are suitable will be increasingly valuable.
OBJECTIVES: We aimed to assess whether routine data produced by an electronic prescribing system might be useful in identifying doctors at higher risk of making a serious prescribing error. DESIGN: Retrospective analysis of prescribing by junior doctors over 12 months using an electronic prescribing information and communication system. The system issues a graded series of prescribing alerts (low-level, intermediate, and high-level), and warnings and prompts to respond to abnormal test results. These may be overridden or heeded, except for high-level prescribing alerts, which are indicative of a potentially serious error and impose a 'hard stop'. SETTING: A large teaching hospital. PARTICIPANTS: All junior doctors in the study setting. MAIN OUTCOME MEASURES: Rates of prescribing alerts and laboratory warnings and doctors' responses. RESULTS: Altogether 848,678 completed prescriptions issued by 381 doctors (median 1538 prescriptions per doctor, interquartile range [IQR] 328-3275) were analysed. We identified 895,029 low-level alerts (median 1033 per 1000 prescriptions per doctor, IQR 903-1205) with a median of 34% (IQR 31-39%) heeded; 172,434 intermediate alerts (median 196 per 1000 prescriptions per doctor, IQR 159-266), with a median of 23% (IQR 16-30%) heeded; and 11,940 high-level 'hard stop' alerts. Doctors vary greatly in the extent to which they trigger and respond to alerts of different types. The rate of high-level alerts showed weak correlation with the rate of intermediate prescribing alerts (correlation coefficient, r = 0.40, P = <0.001); very weak correlation with low-level alerts (r = 0.12, P = 0.019); and showed weak (and sometimes negative) correlation with propensity to heed test-related warnings or alarms. The degree of correlation between generation of intermediate and high-level alerts is insufficient to identify doctors at high risk of making serious errors. CONCLUSIONS: Routine data from an electronic prescribing system should not be used to identify doctors who are at risk of making serious errors. Careful evaluation of the kinds of quality assurance questions for which routine data are suitable will be increasingly valuable.
Authors: L L Leape; T A Brennan; N Laird; A G Lawthers; A R Localio; B A Barnes; L Hebert; J P Newhouse; P C Weiler; H Hiatt Journal: N Engl J Med Date: 1991-02-07 Impact factor: 91.245
Authors: Ching-Ping Lin; Thomas H Payne; W Paul Nichol; Patricia J Hoey; Curtis L Anderson; John H Gennari Journal: J Am Med Inform Assoc Date: 2008-06-25 Impact factor: 4.497
Authors: Munir Pirmohamed; Sally James; Shaun Meakin; Chris Green; Andrew K Scott; Thomas J Walley; Keith Farrar; B Kevin Park; Alasdair M Breckenridge Journal: BMJ Date: 2004-07-03
Authors: Jamie J Coleman; James Hodson; Sarah K Thomas; Hannah L Brooks; Robin E Ferner Journal: J Am Med Inform Assoc Date: 2014-07-29 Impact factor: 4.497
Authors: Guiqing Lily Yao; Nicola Novielli; Semira Manaseki-Holland; Yen-Fu Chen; Marcel van der Klink; Paul Barach; Peter J Chilton; Richard J Lilford Journal: BMJ Qual Saf Date: 2012-09-13 Impact factor: 7.035
Authors: Johanna I Westbrook; Ling Li; Elin C Lehnbom; Melissa T Baysari; Jeffrey Braithwaite; Rosemary Burke; Chris Conn; Richard O Day Journal: Int J Qual Health Care Date: 2015-01-12 Impact factor: 2.038
Authors: Sabi Redwood; Nothando B Ngwenya; James Hodson; Robin E Ferner; Jamie J Coleman Journal: BMC Med Inform Decis Mak Date: 2013-06-04 Impact factor: 2.796
Authors: Richard J Lilford; Alan J Girling; Aziz Sheikh; Jamie J Coleman; Peter J Chilton; Samantha L Burn; David J Jenkinson; Laurence Blake; Karla Hemming Journal: BMC Health Serv Res Date: 2014-07-19 Impact factor: 2.655