Chung-Il Wi1,2, Sunghwan Sohn3, Mary C Rolfes2,4, Alicia Seabright2, Euijung Ryu3, Gretchen Voge1,2,5, Kay A Bachman6, Miguel A Park6, Hirohito Kita6, Ivana T Croghan7, Hongfang Liu3, Young J Juhn1,2. 1. 1 Department of Pediatric and Adolescent Medicine. 2. 2 Asthma Epidemiology Research Unit. 3. 3 Division of Biomedical Statistics and Informatics, and. 4. 4 Mayo Medical School, Rochester, Minnesota. 5. 5 Division of Neonatology, Children's Hospitals and Clinics of Minnesota, Minneapolis, Minnesota; and. 6. 6 Division of Allergic Diseases, Mayo Clinic, Mayo Clinic, Rochester, Minnesota. 7. 7 Department of Medicine Research, Mayo Clinic, Rochester, Minnesota.
Abstract
RATIONALE: Difficulty of asthma ascertainment and its associated methodologic heterogeneity have created significant barriers to asthma care and research. OBJECTIVES: We evaluated the validity of an existing natural language processing (NLP) algorithm for asthma criteria to enable an automated chart review using electronic medical records (EMRs). METHODS: The study was designed as a retrospective birth cohort study using a random sample of 500 subjects from the 1997-2007 Mayo Birth Cohort who were born at Mayo Clinic and enrolled in primary pediatric care at Mayo Clinic Rochester. Performance of NLP-based asthma ascertainment using predetermined asthma criteria was assessed by determining both criterion validity (chart review of EMRs by abstractor as a gold standard) and construct validity (association with known risk factors for asthma, such as allergic rhinitis). MEASUREMENTS AND MAIN RESULTS: After excluding three subjects whose respiratory symptoms could be attributed to other conditions (e.g., tracheomalacia), among the remaining eligible 497 subjects, 51% were male, 77% white persons, and the median age at last follow-up date was 11.5 years. The asthma prevalence was 31% in the study cohort. Sensitivity, specificity, positive predictive value, and negative predictive value for NLP algorithm in predicting asthma status were 97%, 95%, 90%, and 98%, respectively. The risk factors for asthma (e.g., allergic rhinitis) that were identified either by NLP or the abstractor were the same. CONCLUSIONS: Asthma ascertainment through NLP should be considered in the era of EMRs because it can enable large-scale clinical studies in a more time-efficient manner and improve the recognition and care of childhood asthma in practice.
RATIONALE: Difficulty of asthma ascertainment and its associated methodologic heterogeneity have created significant barriers to asthma care and research. OBJECTIVES: We evaluated the validity of an existing natural language processing (NLP) algorithm for asthma criteria to enable an automated chart review using electronic medical records (EMRs). METHODS: The study was designed as a retrospective birth cohort study using a random sample of 500 subjects from the 1997-2007 Mayo Birth Cohort who were born at Mayo Clinic and enrolled in primary pediatric care at Mayo Clinic Rochester. Performance of NLP-based asthma ascertainment using predetermined asthma criteria was assessed by determining both criterion validity (chart review of EMRs by abstractor as a gold standard) and construct validity (association with known risk factors for asthma, such as allergic rhinitis). MEASUREMENTS AND MAIN RESULTS: After excluding three subjects whose respiratory symptoms could be attributed to other conditions (e.g., tracheomalacia), among the remaining eligible 497 subjects, 51% were male, 77% white persons, and the median age at last follow-up date was 11.5 years. The asthma prevalence was 31% in the study cohort. Sensitivity, specificity, positive predictive value, and negative predictive value for NLP algorithm in predicting asthma status were 97%, 95%, 90%, and 98%, respectively. The risk factors for asthma (e.g., allergic rhinitis) that were identified either by NLP or the abstractor were the same. CONCLUSIONS: Asthma ascertainment through NLP should be considered in the era of EMRs because it can enable large-scale clinical studies in a more time-efficient manner and improve the recognition and care of childhood asthma in practice.
Entities:
Keywords:
electronic medical records; informatics; retrospective study
Authors: Young J Juhn; Hirohito Kita; Barbara P Yawn; Thomas G Boyce; Kwang H Yoo; Michaela E McGree; Amy L Weaver; Peter Wollan; Robert M Jacobson Journal: J Allergy Clin Immunol Date: 2008-09-13 Impact factor: 10.793
Authors: Pranab Haldar; Ian D Pavord; Ruth H Green; Dominic E Shaw; Michael A Berry; Michael Thomas; Christopher E Brightling; Andrew J Wardlaw Journal: Am J Respir Crit Care Med Date: 2008-05-14 Impact factor: 21.405
Authors: Elizabeth Ford; John Carroll; Helen Smith; Kevin Davies; Rob Koeling; Irene Petersen; Greta Rait; Jackie Cassell Journal: BMJ Open Date: 2016-06-28 Impact factor: 2.692
Authors: N Lazic; G Roberts; A Custovic; D Belgrave; C M Bishop; J Winn; J A Curtin; S Hasan Arshad; A Simpson Journal: Allergy Date: 2013-04-29 Impact factor: 13.146