Raymund B Dantes1, Shuai Zheng2, James J Lu3, Michele G Beckman4, Asha Krishnaswamy5, Lisa C Richardson6, Sheri Chernetsky-Tejedor1,2, Fusheng Wang2. 1. Departments of Medicine, Division of Hospital Medicine. 2. Biomedical Informatics, Emory University School of Medicine. 3. Department of Mathematics and Computer Science, Emory University. 4. Division of Blood Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention. 5. Division of Heart Disease and Stroke Prevention, National Center for Chronic Disease Prevention and Health Promotion. 6. Division of Cancer Prevention and Control, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, Atlanta GA.
Abstract
INTRODUCTION: The United States federally mandated reporting of venous thromboembolism (VTE), defined by Agency for Healthcare Research & Quality Patient Safety Indicator 12 (AHRQ PSI-12), is based on administrative data, the accuracy of which has not been consistently demonstrated. We used IDEAL-X, a novel information extraction software system, to identify VTE from electronic medical records and evaluated its accuracy. METHODS: Medical records for 13,248 patients admitted to an orthopedic specialty hospital from 2009 to 2014 were reviewed. Patient encounters were defined as a hospital admission where both surgery (of the spine, hip, or knee) and a radiology diagnostic study that could detect VTE was performed. Radiology reports were both manually reviewed by a physician and analyzed by IDEAL-X. RESULTS: Among 2083 radiology reports, IDEAL-X correctly identified 176/181 VTE events, achieving a sensitivity of 97.2% [95% confidence interval (CI), 93.7%-99.1%] and specificity of 99.3% (95% CI, 98.9%-99.7%) when compared with manual review. Among 422 surgical encounters with diagnostic radiographic studies for VTE, IDEAL-X correctly identified 41 of 42 VTE events, achieving a sensitivity of 97.6% (95% CI, 87.4%-99.6%) and specificity of 99.8% (95% CI, 98.7%-100.0%). The performance surpassed that of AHRQ PSI-12, which had a sensitivity of 92.9% (95% CI, 80.5%-98.4%) and specificity of 92.9% (95% CI, 89.8%-95.3%), though only the difference in specificity was statistically significant (P<0.01). CONCLUSION: IDEAL-X, a novel information extraction software system, identified VTE from radiology reports with high accuracy, with specificity surpassing AHRQ PSI-12. IDEAL-X could potentially improve detection and surveillance of many medical conditions from free text of electronic medical records.
INTRODUCTION: The United States federally mandated reporting of venous thromboembolism (VTE), defined by Agency for Healthcare Research & Quality Patient Safety Indicator 12 (AHRQ PSI-12), is based on administrative data, the accuracy of which has not been consistently demonstrated. We used IDEAL-X, a novel information extraction software system, to identify VTE from electronic medical records and evaluated its accuracy. METHODS: Medical records for 13,248 patients admitted to an orthopedic specialty hospital from 2009 to 2014 were reviewed. Patient encounters were defined as a hospital admission where both surgery (of the spine, hip, or knee) and a radiology diagnostic study that could detect VTE was performed. Radiology reports were both manually reviewed by a physician and analyzed by IDEAL-X. RESULTS: Among 2083 radiology reports, IDEAL-X correctly identified 176/181 VTE events, achieving a sensitivity of 97.2% [95% confidence interval (CI), 93.7%-99.1%] and specificity of 99.3% (95% CI, 98.9%-99.7%) when compared with manual review. Among 422 surgical encounters with diagnostic radiographic studies for VTE, IDEAL-X correctly identified 41 of 42 VTE events, achieving a sensitivity of 97.6% (95% CI, 87.4%-99.6%) and specificity of 99.8% (95% CI, 98.7%-100.0%). The performance surpassed that of AHRQ PSI-12, which had a sensitivity of 92.9% (95% CI, 80.5%-98.4%) and specificity of 92.9% (95% CI, 89.8%-95.3%), though only the difference in specificity was statistically significant (P<0.01). CONCLUSION: IDEAL-X, a novel information extraction software system, identified VTE from radiology reports with high accuracy, with specificity surpassing AHRQ PSI-12. IDEAL-X could potentially improve detection and surveillance of many medical conditions from free text of electronic medical records.
Authors: Harvey J Murff; Fern FitzHenry; Michael E Matheny; Nancy Gentry; Kristen L Kotter; Kimberly Crimin; Robert S Dittus; Amy K Rosen; Peter L Elkin; Steven H Brown; Theodore Speroff Journal: JAMA Date: 2011-08-24 Impact factor: 56.272
Authors: Jean-Marie Januel; Guanmin Chen; Christiane Ruffieux; Hude Quan; James D Douketis; Mark A Crowther; Cyrille Colin; William A Ghali; Bernard Burnand Journal: JAMA Date: 2012-01-18 Impact factor: 56.272
Authors: William H Geerts; Graham F Pineo; John A Heit; David Bergqvist; Michael R Lassen; Clifford W Colwell; Joel G Ray Journal: Chest Date: 2004-09 Impact factor: 9.410
Authors: Richard H White; Banafsheh Sadeghi; Daniel J Tancredi; Patricia Zrelak; Joanne Cuny; Pradeep Sama; Garth H Utter; Jeffrey J Geppert; Patrick S Romano Journal: Med Care Date: 2009-12 Impact factor: 2.983
Authors: Banafsheh Sadeghi; Richard H White; Gregory Maynard; Patricia Zrelak; Amy Strater; Laurie Hensley; Julie Cerese; Patrick Romano Journal: Med Care Date: 2015-05 Impact factor: 2.983
Authors: Christian M Rochefort; Aman D Verma; Tewodros Eguale; Todd C Lee; David L Buckeridge Journal: J Am Med Inform Assoc Date: 2014-10-20 Impact factor: 4.497
Authors: Tiffany Pellathy; Melissa Saul; Gilles Clermont; Artur W Dubrawski; Michael R Pinsky; Marilyn Hravnak Journal: J Clin Monit Comput Date: 2021-02-08 Impact factor: 1.977
Authors: Ibrahim Saber; Alys Adamski; Maragatha Kuchibhatla; Karon Abe; Michele Beckman; Nimia Reyes; Ryan Schulteis; Bhavana Pendurthi Singh; Andrea Sitlinger; Elizabeth H Thames; Thomas L Ortel Journal: Res Pract Thromb Haemost Date: 2022-07-21