BACKGROUND & AIMS: Little is known about the ability of natural language processing (NLP) to extract meaningful information from free-text gastroenterology reports for secondary use. METHODS: We randomly selected 500 linked colonoscopy and pathology reports from 10,798 nonsurveillance colonoscopies to train and test the NLP system. By using annotation by gastroenterologists as the reference standard, we assessed the accuracy of an open-source NLP engine that processed and extracted clinically relevant concepts. The primary outcome was the highest level of pathology. Secondary outcomes were location of the most advanced lesion, largest size of an adenoma removed, and number of adenomas removed. RESULTS: The NLP system identified the highest level of pathology with 98% accuracy, compared with triplicate annotation by gastroenterologists (the standard). Accuracy values for location, size, and number were 97%, 96%, and 84%, respectively. CONCLUSIONS: The NLP can extract specific meaningful concepts with 98% accuracy. It might be developed as a method to further quantify specific quality metrics.
BACKGROUND & AIMS: Little is known about the ability of natural language processing (NLP) to extract meaningful information from free-text gastroenterology reports for secondary use. METHODS: We randomly selected 500 linked colonoscopy and pathology reports from 10,798 nonsurveillance colonoscopies to train and test the NLP system. By using annotation by gastroenterologists as the reference standard, we assessed the accuracy of an open-source NLP engine that processed and extracted clinically relevant concepts. The primary outcome was the highest level of pathology. Secondary outcomes were location of the most advanced lesion, largest size of an adenoma removed, and number of adenomas removed. RESULTS: The NLP system identified the highest level of pathology with 98% accuracy, compared with triplicate annotation by gastroenterologists (the standard). Accuracy values for location, size, and number were 97%, 96%, and 84%, respectively. CONCLUSIONS: The NLP can extract specific meaningful concepts with 98% accuracy. It might be developed as a method to further quantify specific quality metrics.
Authors: Henk Harkema; Wendy W Chapman; Melissa Saul; Evan S Dellon; Robert E Schoen; Ateev Mehrotra Journal: J Am Med Inform Assoc Date: 2011-09-21 Impact factor: 4.497
Authors: Laura C Seeff; Thomas B Richards; Jean A Shapiro; Marion R Nadel; Diane L Manninen; Leslie S Given; Fred B Dong; Linda D Winges; Matthew T McKenna Journal: Gastroenterology Date: 2004-12 Impact factor: 22.682
Authors: Joshua C Denny; Josh F Peterson; Neesha N Choma; Hua Xu; Randolph A Miller; Lisa Bastarache; Neeraja B Peterson Journal: J Am Med Inform Assoc Date: 2010 Jul-Aug Impact factor: 4.497
Authors: Amir Qaseem; Thomas D Denberg; Robert H Hopkins; Linda L Humphrey; Joel Levine; Donna E Sweet; Paul Shekelle Journal: Ann Intern Med Date: 2012-03-06 Impact factor: 25.391
Authors: Mohammad A Al-Haddad; Jeff Friedlin; Joe Kesterson; Joshua A Waters; Juan R Aguilar-Saavedra; C Max Schmidt Journal: HPB (Oxford) Date: 2010-12 Impact factor: 3.647
Authors: Joshua C Denny; Neesha N Choma; Josh F Peterson; Randolph A Miller; Lisa Bastarache; Ming Li; Neeraja B Peterson Journal: Med Decis Making Date: 2011-03-10 Impact factor: 2.583
Authors: Bernard Levin; David A Lieberman; Beth McFarland; Kimberly S Andrews; Durado Brooks; John Bond; Chiranjeev Dash; Francis M Giardiello; Seth Glick; David Johnson; C Daniel Johnson; Theodore R Levin; Perry J Pickhardt; Douglas K Rex; Robert A Smith; Alan Thorson; Sidney J Winawer Journal: Gastroenterology Date: 2008-02-08 Impact factor: 22.682
Authors: J Randall Curtis; Seelwan Sathitratanacheewin; Helene Starks; Robert Y Lee; Erin K Kross; Lois Downey; James Sibley; William Lober; Elizabeth T Loggers; James A Fausto; Charlotta Lindvall; Ruth A Engelberg Journal: J Palliat Med Date: 2017-11-28 Impact factor: 2.947
Authors: S V Ramanan; Kedar Radhakrishna; Abijeet Waghmare; Tony Raj; Senthil P Nathan; Sai Madhukar Sreerama; Sriram Sampath Journal: J Med Syst Date: 2016-06-24 Impact factor: 4.460
Authors: Florian R Schroeck; Olga V Patterson; Patrick R Alba; Erik A Pattison; John D Seigne; Scott L DuVall; Douglas J Robertson; Brenda Sirovich; Philip P Goodney Journal: Urology Date: 2017-09-12 Impact factor: 2.649
Authors: Timothy D Imler; Justin Morea; Charles Kahi; Eric A Sherer; Jon Cardwell; Cynthia S Johnson; Huiping Xu; Dennis Ahnen; Fadi Antaki; Christopher Ashley; Gyorgy Baffy; Ilseung Cho; Jason Dominitz; Jason Hou; Mark Korsten; Anil Nagar; Kittichai Promrat; Douglas Robertson; Sameer Saini; Amandeep Shergill; Walter Smalley; Thomas F Imperiale Journal: Am J Gastroenterol Date: 2015-03-10 Impact factor: 10.864
Authors: Timothy D Imler; Stuart Sherman; Thomas F Imperiale; Huiping Xu; Fangqian Ouyang; Christopher Beesley; Charity Hilton; Gregory A Coté Journal: Gastrointest Endosc Date: 2017-05-03 Impact factor: 9.427
Authors: Felippe O Marcondes; Katie M Dean; Robert E Schoen; Daniel A Leffler; Sherri Rose; Michele Morris; Ateev Mehrotra Journal: Gastrointest Endosc Date: 2015-10 Impact factor: 9.427
Authors: Gottumukkala S Raju; Phillip J Lum; Rebecca S Slack; Selvi Thirumurthi; Patrick M Lynch; Ethan Miller; Brian R Weston; Marta L Davila; Manoop S Bhutani; Mehnaz A Shafi; Robert S Bresalier; Alexander A Dekovich; Jeffrey H Lee; Sushovan Guha; Mala Pande; Boris Blechacz; Asif Rashid; Mark Routbort; Gladis Shuttlesworth; Lopa Mishra; John R Stroehlein; William A Ross Journal: Gastrointest Endosc Date: 2015-04-22 Impact factor: 9.427
Authors: Rebecca A Gourevitch; Sherri Rose; Seth D Crockett; Michele Morris; David S Carrell; Julia B Greer; Reetesh K Pai; Robert E Schoen; Ateev Mehrotra Journal: Am J Gastroenterol Date: 2018-01-30 Impact factor: 10.864