David S Carrell1, Robert E Schoen2, Daniel A Leffler3, Michele Morris4, Sherri Rose5, Andrew Baer1, Seth D Crockett6, Rebecca A Gourevitch5, Katie M Dean5, Ateev Mehrotra5,7. 1. Kaiser Permanente of Washington Health Research Institute (formerly Group Health Research Institute), Seattle, WA, USA. 2. Division of Gastroenterology, Hepatology, and Nutrition, Department of Medicine and Epidemiology, University of Pittsburgh, Pittsburgh, PA, USA. 3. Division of Gastroenterology, Beth Israel Deaconess Medical Center, Boston, MA, USA. 4. Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA. 5. Department of Health Care Policy, Harvard Medical School, Boston, MA, USA. 6. Division of Gastroenterology and Hepatology, University of North Carolina School of Medicine, Chapel Hill, NC, USA. 7. Division of General Internal Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA.
Abstract
OBJECTIVE: Widespread application of clinical natural language processing (NLP) systems requires taking existing NLP systems and adapting them to diverse and heterogeneous settings. We describe the challenges faced and lessons learned in adapting an existing NLP system for measuring colonoscopy quality. MATERIALS AND METHODS: Colonoscopy and pathology reports from 4 settings during 2013-2015, varying by geographic location, practice type, compensation structure, and electronic health record. RESULTS: Though successful, adaptation required considerably more time and effort than anticipated. Typical NLP challenges in assembling corpora, diverse report structures, and idiosyncratic linguistic content were greatly magnified. DISCUSSION: Strategies for addressing adaptation challenges include assessing site-specific diversity, setting realistic timelines, leveraging local electronic health record expertise, and undertaking extensive iterative development. More research is needed on how to make it easier to adapt NLP systems to new clinical settings. CONCLUSIONS: A key challenge in widespread application of NLP is adapting existing systems to new clinical settings.
OBJECTIVE: Widespread application of clinical natural language processing (NLP) systems requires taking existing NLP systems and adapting them to diverse and heterogeneous settings. We describe the challenges faced and lessons learned in adapting an existing NLP system for measuring colonoscopy quality. MATERIALS AND METHODS: Colonoscopy and pathology reports from 4 settings during 2013-2015, varying by geographic location, practice type, compensation structure, and electronic health record. RESULTS: Though successful, adaptation required considerably more time and effort than anticipated. Typical NLP challenges in assembling corpora, diverse report structures, and idiosyncratic linguistic content were greatly magnified. DISCUSSION: Strategies for addressing adaptation challenges include assessing site-specific diversity, setting realistic timelines, leveraging local electronic health record expertise, and undertaking extensive iterative development. More research is needed on how to make it easier to adapt NLP systems to new clinical settings. CONCLUSIONS: A key challenge in widespread application of NLP is adapting existing systems to new clinical settings.
Authors: Douglas K Rex; John L Petrini; Todd H Baron; Amitabh Chak; Jonathan Cohen; Stephen E Deal; Brenda Hoffman; Brian C Jacobson; Klaus Mergener; Bret T Petersen; Michael A Safdi; Douglas O Faigel; Irving M Pike Journal: Am J Gastroenterol Date: 2006-04 Impact factor: 10.864
Authors: Rosa L Figueroa; Qing Zeng-Treitler; Long H Ngo; Sergey Goryachev; Eduardo P Wiechmann Journal: J Am Med Inform Assoc Date: 2012-06-15 Impact factor: 4.497
Authors: Gottumukkala S Raju; Phillip J Lum; Rebecca S Slack; Selvi Thirumurthi; Patrick M Lynch; Ethan Miller; Brian R Weston; Marta L Davila; Manoop S Bhutani; Mehnaz A Shafi; Robert S Bresalier; Alexander A Dekovich; Jeffrey H Lee; Sushovan Guha; Mala Pande; Boris Blechacz; Asif Rashid; Mark Routbort; Gladis Shuttlesworth; Lopa Mishra; John R Stroehlein; William A Ross Journal: Gastrointest Endosc Date: 2015-04-22 Impact factor: 9.427
Authors: Andrew J Gawron; William K Thompson; Rajesh N Keswani; Luke V Rasmussen; Abel N Kho Journal: Am J Gastroenterol Date: 2014-06-17 Impact factor: 10.864
Authors: Pedro L Teixeira; Wei-Qi Wei; Robert M Cronin; Huan Mo; Jacob P VanHouten; Robert J Carroll; Eric LaRose; Lisa A Bastarache; S Trent Rosenbloom; Todd L Edwards; Dan M Roden; Thomas A Lasko; Richard A Dart; Anne M Nikolai; Peggy L Peissig; Joshua C Denny Journal: J Am Med Inform Assoc Date: 2016-08-07 Impact factor: 4.497
Authors: Selen Bozkurt; Jung In Park; Kathleen Mary Kan; Michelle Ferrari; Daniel L Rubin; James D Brooks; Tina Hernandez-Boussard Journal: AMIA Annu Symp Proc Date: 2018-12-05
Authors: Loreen Straub; Joshua J Gagne; Judith C Maro; Michael D Nguyen; Nicolas Beaulieu; Jeffrey S Brown; Adee Kennedy; Margaret Johnson; Adam Wright; Li Zhou; Shirley V Wang Journal: Drug Saf Date: 2019-09 Impact factor: 5.606
Authors: Prakash Adekkanattu; Guoqian Jiang; Yuan Luo; Paul R Kingsbury; Zhenxing Xu; Luke V Rasmussen; Jennifer A Pacheco; Richard C Kiefer; Daniel J Stone; Pascal S Brandt; Liang Yao; Yizhen Zhong; Yu Deng; Fei Wang; Jessica S Ancker; Thomas R Campion; Jyotishman Pathak Journal: AMIA Annu Symp Proc Date: 2020-03-04
Authors: Luke V Rasmussen; Pascal S Brandt; Guoqian Jiang; Richard C Kiefer; Jennifer A Pacheco; Prakash Adekkanattu; Jessica S Ancker; Fei Wang; Zhenxing Xu; Jyotishman Pathak; Yuan Luo Journal: AMIA Annu Symp Proc Date: 2020-03-04
Authors: Prakash Adekkanattu; Evan T Sholle; Joseph DeFerio; Jyotishman Pathak; Stephen B Johnson; Thomas R Campion Journal: AMIA Annu Symp Proc Date: 2018-12-05
Authors: Seth D Crockett; Rebecca A Gourevitch; Michele Morris; David S Carrell; Sherri Rose; Zhuo Shi; Julia B Greer; Robert E Schoen; Ateev Mehrotra Journal: Endoscopy Date: 2018-04-24 Impact factor: 10.093
Authors: Ateev Mehrotra; Michele Morris; Rebecca A Gourevitch; David S Carrell; Daniel A Leffler; Sherri Rose; Julia B Greer; Seth D Crockett; Andrew Baer; Robert E Schoen Journal: Gastrointest Endosc Date: 2017-09-01 Impact factor: 9.427