BACKGROUND: Gastroenterology specialty societies have advocated that providers routinely assess their performance on colonoscopy quality measures. Such routine measurement has been hampered by the costs and time required to manually review colonoscopy and pathology reports. Natural language processing (NLP) is a field of computer science in which programs are trained to extract relevant information from text reports in an automated fashion. OBJECTIVE: To demonstrate the efficiency and potential of NLP-based colonoscopy quality measurement. DESIGN: In a cross-sectional study design, we used a previously validated NLP program to analyze colonoscopy reports and associated pathology notes. The resulting data were used to generate provider performance on colonoscopy quality measures. SETTING: Nine hospitals in the University of Pittsburgh Medical Center health care system. PATIENTS: Study sample consisted of the 24,157 colonoscopy reports and associated pathology reports from 2008 to 2009. MAIN OUTCOME MEASUREMENTS: Provider performance on 7 quality measures. RESULTS: Performance on the colonoscopy quality measures was generally poor, and there was a wide range of performance. For example, across hospitals, the adequacy of preparation was noted overall in only 45.7% of procedures (range 14.6%-86.1% across 9 hospitals), cecal landmarks were documented in 62.7% of procedures (range 11.6%-90.0%), and the adenoma detection rate was 25.2% (range 14.9%-33.9%). LIMITATIONS: Our quality assessment was limited to a single health care system in western Pennsylvania. CONCLUSIONS: Our study illustrates how NLP can mine free-text data in electronic records to measure and report on the quality of care. Even within a single academic hospital system, there is considerable variation in the performance on colonoscopy quality measures, demonstrating the need for better methods to regularly and efficiently assess quality.
BACKGROUND: Gastroenterology specialty societies have advocated that providers routinely assess their performance on colonoscopy quality measures. Such routine measurement has been hampered by the costs and time required to manually review colonoscopy and pathology reports. Natural language processing (NLP) is a field of computer science in which programs are trained to extract relevant information from text reports in an automated fashion. OBJECTIVE: To demonstrate the efficiency and potential of NLP-based colonoscopy quality measurement. DESIGN: In a cross-sectional study design, we used a previously validated NLP program to analyze colonoscopy reports and associated pathology notes. The resulting data were used to generate provider performance on colonoscopy quality measures. SETTING: Nine hospitals in the University of Pittsburgh Medical Center health care system. PATIENTS: Study sample consisted of the 24,157 colonoscopy reports and associated pathology reports from 2008 to 2009. MAIN OUTCOME MEASUREMENTS: Provider performance on 7 quality measures. RESULTS: Performance on the colonoscopy quality measures was generally poor, and there was a wide range of performance. For example, across hospitals, the adequacy of preparation was noted overall in only 45.7% of procedures (range 14.6%-86.1% across 9 hospitals), cecal landmarks were documented in 62.7% of procedures (range 11.6%-90.0%), and the adenoma detection rate was 25.2% (range 14.9%-33.9%). LIMITATIONS: Our quality assessment was limited to a single health care system in western Pennsylvania. CONCLUSIONS: Our study illustrates how NLP can mine free-text data in electronic records to measure and report on the quality of care. Even within a single academic hospital system, there is considerable variation in the performance on colonoscopy quality measures, demonstrating the need for better methods to regularly and efficiently assess quality.
Authors: Douglas K Rex; John H Bond; Sidney Winawer; Theodore R Levin; Randall W Burt; David A Johnson; Lynne M Kirk; Scott Litlin; David A Lieberman; Jerome D Waye; James Church; John B Marshall; Robert H Riddell Journal: Am J Gastroenterol Date: 2002-06 Impact factor: 10.864
Authors: Henk Harkema; Wendy W Chapman; Melissa Saul; Evan S Dellon; Robert E Schoen; Ateev Mehrotra Journal: J Am Med Inform Assoc Date: 2011-09-21 Impact factor: 4.497
Authors: D A Johnson; M S Gurney; R J Volpe; D M Jones; M M VanNess; S J Chobanian; J C Avalos; J L Buck; G Kooyman; E L Cattau Journal: Am J Gastroenterol Date: 1990-08 Impact factor: 10.864
Authors: Henk Harkema; Wendy W Chapman; Melissa Saul; Evan S Dellon; Robert E Schoen; Ateev Mehrotra Journal: J Am Med Inform Assoc Date: 2011-09-21 Impact factor: 4.497
Authors: Raj Mehta; Nila S Radhakrishnan; Carrie D Warring; Ankur Jain; Jorge Fuentes; Angela Dolganiuc; Laura S Lourdes; John Busigin; Robert R Leverence Journal: Appl Clin Inform Date: 2016-08-17 Impact factor: 2.342
Authors: S V Ramanan; Kedar Radhakrishna; Abijeet Waghmare; Tony Raj; Senthil P Nathan; Sai Madhukar Sreerama; Sriram Sampath Journal: J Med Syst Date: 2016-06-24 Impact factor: 4.460
Authors: Ateev Mehrotra; Michele Morris; Rebecca A Gourevitch; David S Carrell; Daniel A Leffler; Sherri Rose; Julia B Greer; Seth D Crockett; Andrew Baer; Robert E Schoen Journal: Gastrointest Endosc Date: 2017-09-01 Impact factor: 9.427
Authors: Felippe O Marcondes; Katie M Dean; Robert E Schoen; Daniel A Leffler; Sherri Rose; Michele Morris; Ateev Mehrotra Journal: Gastrointest Endosc Date: 2015-10 Impact factor: 9.427
Authors: Gottumukkala S Raju; Phillip J Lum; Rebecca S Slack; Selvi Thirumurthi; Patrick M Lynch; Ethan Miller; Brian R Weston; Marta L Davila; Manoop S Bhutani; Mehnaz A Shafi; Robert S Bresalier; Alexander A Dekovich; Jeffrey H Lee; Sushovan Guha; Mala Pande; Boris Blechacz; Asif Rashid; Mark Routbort; Gladis Shuttlesworth; Lopa Mishra; John R Stroehlein; William A Ross Journal: Gastrointest Endosc Date: 2015-04-22 Impact factor: 9.427