Theodore L Tsai1, Douglas B Fridsma, Guido Gatti. 1. Center for Biomedical Informatics and Department of Medicine, University of Pittsburgh, Suite 8084 Forbes Tower, 3600 Meyran Avenue, Pittsburgh, PA 15261, USA. tsai@cbmi.upmc.edu
Abstract
OBJECTIVE: The aim of this study was to determine the effect that the computer interpretation (CI) of electrocardiograms (EKGs) has on the accuracy of resident (noncardiologist) physicians reading EKGs. DESIGN: A randomized, controlled trial was conducted in a laboratory setting from February through June 2001, using a two-period crossover design with matched pairs of subjects randomly assigned to sequencing groups. MEASUREMENTS: Subjects' interpretive accuracy of discrete, cardiologist-determined EKG findings were measured as judged by a board-certified internist. RESULTS: Without the CI, subjects interpreted 48.9% (95% confidence interval, 45.0% to 52.8%) of the findings correctly. With the CI, subjects interpreted 55.4% (51.9% to 58.9%) correctly (p < 0.0001). When the CIs that agreed with the gold standard (Correct CIs) were not included, 53.1% (47.7% to 58.5%) of the findings were interpreted correctly. When the correct CI was included, accuracy increased to 68.1% (63.2% to 72.7%; p < 0.0001). When computer advice that did not agree with the gold standard (Incorrect CI) was not provided to the subjects, 56.7% (48.5% to 64.5%) of findings were interpreted correctly. Accuracy dropped to 48.3% (40.4% to 56.4%) when the incorrect computer advice was provided (p = 0.131). Subjects erroneously agreed with the incorrect CI more often when it was presented with the EKG 67.7% (57.2% to 76.7%) than when it was not 34.6% (23.8% to 47.3%; p < 0.0001). CONCLUSIONS: Computer decision support systems can generally improve the interpretive accuracy of internal medicine residents in reading EKGs. However, subjects were influenced significantly by incorrect advice, which tempers the overall usefulness of computer-generated advice in this and perhaps other areas.
RCT Entities:
OBJECTIVE: The aim of this study was to determine the effect that the computer interpretation (CI) of electrocardiograms (EKGs) has on the accuracy of resident (noncardiologist) physicians reading EKGs. DESIGN: A randomized, controlled trial was conducted in a laboratory setting from February through June 2001, using a two-period crossover design with matched pairs of subjects randomly assigned to sequencing groups. MEASUREMENTS: Subjects' interpretive accuracy of discrete, cardiologist-determined EKG findings were measured as judged by a board-certified internist. RESULTS: Without the CI, subjects interpreted 48.9% (95% confidence interval, 45.0% to 52.8%) of the findings correctly. With the CI, subjects interpreted 55.4% (51.9% to 58.9%) correctly (p < 0.0001). When the CIs that agreed with the gold standard (Correct CIs) were not included, 53.1% (47.7% to 58.5%) of the findings were interpreted correctly. When the correct CI was included, accuracy increased to 68.1% (63.2% to 72.7%; p < 0.0001). When computer advice that did not agree with the gold standard (Incorrect CI) was not provided to the subjects, 56.7% (48.5% to 64.5%) of findings were interpreted correctly. Accuracy dropped to 48.3% (40.4% to 56.4%) when the incorrect computer advice was provided (p = 0.131). Subjects erroneously agreed with the incorrect CI more often when it was presented with the EKG 67.7% (57.2% to 76.7%) than when it was not 34.6% (23.8% to 47.3%; p < 0.0001). CONCLUSIONS: Computer decision support systems can generally improve the interpretive accuracy of internal medicine residents in reading EKGs. However, subjects were influenced significantly by incorrect advice, which tempers the overall usefulness of computer-generated advice in this and perhaps other areas.
Authors: C P Friedman; A S Elstein; F M Wolf; G C Murphy; T M Franz; P S Heckerling; P L Fine; T M Miller; V Abraham Journal: JAMA Date: 1999-11-17 Impact factor: 56.272
Authors: J L Willems; C Abreu-Lima; P Arnaud; J H van Bemmel; C Brohet; R Degani; B Denis; J Gehring; I Graham; G van Herpen Journal: N Engl J Med Date: 1991-12-19 Impact factor: 91.245
Authors: Joshua C Denny; Anderson Spickard; Randolph A Miller; Jonathan Schildcrout; Dawood Darbar; S Trent Rosenbloom; Josh F Peterson Journal: AMIA Annu Symp Proc Date: 2005
Authors: Joshua C Denny; Randolph A Miller; Lemuel Russell Waitman; Mark A Arrieta; Joshua F Peterson Journal: Int J Med Inform Date: 2008-10-19 Impact factor: 4.046