INTRODUCTION: Electronic quality monitoring(eQuality) from clinical narratives may advance current manual quality measurement techniques.We evaluated automated eQuality measurement tools on clinical narratives of veterans' disability examinations. METHODS: We used a general purpose indexing engine to encode clinical concepts with SNOMED CT. We developed computer usable quality assessment rules from established quality indicators and evaluated the automated approach against a gold standard of double independent human expert review. Rules were iteratively improved using a training set of 1446 indexed exam reports and evaluated on a test set of 1454 indexed exam reports. RESULTS: The eQuality system achieved 86%sensitivity (recall), 62% specificity, and 96%positive predictive value (precision) for automated quality assessment of veterans' disability exams. Summary data for each exam type and detailed data for joint exam quality assessments are presented. DISCUSSION: The current results generalize our previous results to ten exam types covering over 200 diagnostic codes. eQuality measurement from narrative clinical documents has the potential to improve healthcare quality and safety.
INTRODUCTION: Electronic quality monitoring(eQuality) from clinical narratives may advance current manual quality measurement techniques.We evaluated automated eQuality measurement tools on clinical narratives of veterans' disability examinations. METHODS: We used a general purpose indexing engine to encode clinical concepts with SNOMED CT. We developed computer usable quality assessment rules from established quality indicators and evaluated the automated approach against a gold standard of double independent human expert review. Rules were iteratively improved using a training set of 1446 indexed exam reports and evaluated on a test set of 1454 indexed exam reports. RESULTS: The eQuality system achieved 86%sensitivity (recall), 62% specificity, and 96%positive predictive value (precision) for automated quality assessment of veterans' disability exams. Summary data for each exam type and detailed data for joint exam quality assessments are presented. DISCUSSION: The current results generalize our previous results to ten exam types covering over 200 diagnostic codes. eQuality measurement from narrative clinical documents has the potential to improve healthcare quality and safety.
Authors: William Brinson Weeks; Peter Donald Mills; Julia Waldron; Steven Holloway Brown; Theodore Speroff; Lewis R Coulson Journal: J Healthc Manag Date: 2003 Jul-Aug
Authors: Peter L Elkin; Steven H Brown; Casey S Husser; Brent A Bauer; Dietlind Wahner-Roedler; S Trent Rosenbloom; Ted Speroff Journal: Mayo Clin Proc Date: 2006-06 Impact factor: 7.616
Authors: Steven H Brown; Theodore Speroff; Elliot M Fielstein; Brent A Bauer; Dietlind L Wahner-Roedler; Robert Greevy; Peter L Elkin Journal: Mayo Clin Proc Date: 2006-11 Impact factor: 7.616
Authors: S Trent Rosenbloom; Joshua C Denny; Hua Xu; Nancy Lorenzi; William W Stead; Kevin B Johnson Journal: J Am Med Inform Assoc Date: 2011-01-12 Impact factor: 4.497
Authors: Huabing Zhang; Jorge Plutzky; Stephen Skentzos; Fritha Morrison; Perry Mar; Maria Shubina; Alexander Turchin Journal: Ann Intern Med Date: 2013-04-02 Impact factor: 25.391
Authors: Brett R South; Shuying Shen; Makoto Jones; Jennifer Garvin; Matthew H Samore; Wendy W Chapman; Adi V Gundlapalli Journal: Summit Transl Bioinform Date: 2009-03-01
Authors: Stephen L Luther; Susan S Thomason; Sunil Sabharwal; Dezon K Finch; James McCart; Peter Toyinbo; Lina Bouayad; Michael E Matheny; Glenn T Gobbel; Gail Powell-Cope Journal: JMIR Res Protoc Date: 2017-01-19
Authors: Christophe Gaudet-Blavignac; Vasiliki Foufi; Mina Bjelogrlic; Christian Lovis Journal: J Med Internet Res Date: 2021-01-26 Impact factor: 5.428
Authors: Brett R South; Shuying Shen; Makoto Jones; Jennifer Garvin; Matthew H Samore; Wendy W Chapman; Adi V Gundlapalli Journal: BMC Bioinformatics Date: 2009-09-17 Impact factor: 3.169