Elham Sagheb1, Chung-Il Wi2, Jungwon Yoon3, Hee Yun Seol4, Pragya Shrestha2, Euijung Ryu5, Miguel Park6, Barbara Yawn7, Hongfang Liu1, Jason Homme2, Young Juhn8, Sunghwan Sohn9. 1. Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minn. 2. Department of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn. 3. Department of Pediatrics, Myongji Hospital, Goyang, South Korea. 4. Pusan National University, Yangsan Hospital, Yangsan, South Korea. 5. Department of Health Sciences Research, Mayo Clinic, Rochester, Minn. 6. Division of Allergic Diseases, Mayo Clinic, Rochester, Minn. 7. Department of Family and Community Health, University of Minnesota, Minneapolis, Minn. 8. Department of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minn. Electronic address: Juhn.young@mayo.edu. 9. Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, Minn. Electronic address: sohn.sunghwan@mayo.edu.
Abstract
BACKGROUND: Clinicians' asthma guideline adherence in asthma care is suboptimal. The effort to improve adherence can be enhanced by assessing and monitoring clinicians' adherence to guidelines reflected in electronic health records (EHRs), which require costly manual chart review because many care elements cannot be identified by structured data. OBJECTIVE: This study was designed to demonstrate the feasibility of an artificial intelligence tool using natural language processing (NLP) leveraging the free text EHRs of pediatric patients to extract key components of the 2007 National Asthma Education and Prevention Program guidelines. METHODS: This is a retrospective cross-sectional study using a birth cohort with a diagnosis of asthma at Mayo Clinic between 2003 and 2016. We used 1,039 clinical notes with an asthma diagnosis from a random sample of 300 patients. Rule-based NLP algorithms were developed to identify asthma guideline-congruent elements by examining care description in EHR free text. RESULTS: Natural language processing algorithms demonstrated a sensitivity (0.82-1.0), specificity (0.95-1.0), positive predictive value (0.86-1.0), and negative predictive value (0.92-1.0) against manual chart review for asthma guideline-congruent elements. Assessing medication compliance and inhaler technique assessment were the most challenging elements to assess because of the complexity and wide variety of descriptions. CONCLUSIONS: Natural language processing technologies may enable the automated assessment of clinicians' documentation in EHRs regarding adherence to asthma guidelines and can be a useful population management and research tool to assess and monitor asthma care quality. Multisite studies with a larger sample size are needed to assess the generalizability of these NLP algorithms.
BACKGROUND: Clinicians' asthma guideline adherence in asthma care is suboptimal. The effort to improve adherence can be enhanced by assessing and monitoring clinicians' adherence to guidelines reflected in electronic health records (EHRs), which require costly manual chart review because many care elements cannot be identified by structured data. OBJECTIVE: This study was designed to demonstrate the feasibility of an artificial intelligence tool using natural language processing (NLP) leveraging the free text EHRs of pediatric patients to extract key components of the 2007 National Asthma Education and Prevention Program guidelines. METHODS: This is a retrospective cross-sectional study using a birth cohort with a diagnosis of asthma at Mayo Clinic between 2003 and 2016. We used 1,039 clinical notes with an asthma diagnosis from a random sample of 300 patients. Rule-based NLP algorithms were developed to identify asthma guideline-congruent elements by examining care description in EHR free text. RESULTS: Natural language processing algorithms demonstrated a sensitivity (0.82-1.0), specificity (0.95-1.0), positive predictive value (0.86-1.0), and negative predictive value (0.92-1.0) against manual chart review for asthma guideline-congruent elements. Assessing medication compliance and inhaler technique assessment were the most challenging elements to assess because of the complexity and wide variety of descriptions. CONCLUSIONS: Natural language processing technologies may enable the automated assessment of clinicians' documentation in EHRs regarding adherence to asthma guidelines and can be a useful population management and research tool to assess and monitor asthma care quality. Multisite studies with a larger sample size are needed to assess the generalizability of these NLP algorithms.
Keywords:
Adherence to asthma guidelines; Automated chart review; Documentation variation; National asthma education and prev4ention program; Natural language processing
Authors: Peter K Lindenauer; Denise Remus; Sheila Roman; Michael B Rothberg; Evan M Benjamin; Allen Ma; Dale W Bratzler Journal: N Engl J Med Date: 2007-01-26 Impact factor: 91.245
Authors: Chung-Il Wi; Sunghwan Sohn; Mary C Rolfes; Alicia Seabright; Euijung Ryu; Gretchen Voge; Kay A Bachman; Miguel A Park; Hirohito Kita; Ivana T Croghan; Hongfang Liu; Young J Juhn Journal: Am J Respir Crit Care Med Date: 2017-08-15 Impact factor: 21.405
Authors: Sunghwan Sohn; Kavishwar B Wagholikar; Dingcheng Li; Siddhartha R Jonnalagadda; Cui Tao; Ravikumar Komandur Elayavilli; Hongfang Liu Journal: J Am Med Inform Assoc Date: 2013-04-04 Impact factor: 4.497
Authors: Sunghwan Sohn; Cheryl Clark; Scott R Halgrim; Sean P Murphy; Christopher G Chute; Hongfang Liu Journal: J Am Med Inform Assoc Date: 2014-03-17 Impact factor: 4.497
Authors: Michelle M Cloutier; Lara J Akinbami; Paivi M Salo; Michael Schatz; Tregony Simoneau; Jesse C Wilkerson; Gregory Diette; Kurtis S Elward; Anne Fuhlbrigge; Jacek M Mazurek; Lydia Feinstein; Sonja Williams; Darryl C Zeldin Journal: J Allergy Clin Immunol Pract Date: 2020-04-25
Authors: Barbara P Yawn; Paul L Enright; Robert F Lemanske; Elliot Israel; Wilson Pace; Peter Wollan; Homer Boushey Journal: Chest Date: 2007-06-05 Impact factor: 9.410
Authors: Patrick Fox; Patricia G Porter; Sibylle H Lob; Jennifer Holloman Boer; David A Rocha; Joel W Adelson Journal: Pediatrics Date: 2007-10 Impact factor: 7.124