OBJECTIVE: Electronic medical records (EMRs) are a rich data source for discovery research but are underutilized due to the difficulty of extracting highly accurate clinical data. We assessed whether a classification algorithm incorporating narrative EMR data (typed physician notes) more accurately classifies subjects with rheumatoid arthritis (RA) compared with an algorithm using codified EMR data alone. METHODS: Subjects with > or =1 International Classification of Diseases, Ninth Revision RA code (714.xx) or who had anti-cyclic citrullinated peptide (anti-CCP) checked in the EMR of 2 large academic centers were included in an "RA Mart" (n = 29,432). For all 29,432 subjects, we extracted narrative (using natural language processing) and codified RA clinical information. In a training set of 96 RA and 404 non-RA cases from the RA Mart classified by medical record review, we used narrative and codified data to develop classification algorithms using logistic regression. These algorithms were applied to the entire RA Mart. We calculated and compared the positive predictive value (PPV) of these algorithms by reviewing the records of an additional 400 subjects classified as having RA by the algorithms. RESULTS: A complete algorithm (narrative and codified data) classified RA subjects with a significantly higher PPV of 94% than an algorithm with codified data alone (PPV of 88%). Characteristics of the RA cohort identified by the complete algorithm were comparable to existing RA cohorts (80% women, 63% anti-CCP positive, and 59% positive for erosions). CONCLUSION: We demonstrate the ability to utilize complete EMR data to define an RA cohort with a PPV of 94%, which was superior to an algorithm using codified data alone.
OBJECTIVE: Electronic medical records (EMRs) are a rich data source for discovery research but are underutilized due to the difficulty of extracting highly accurate clinical data. We assessed whether a classification algorithm incorporating narrative EMR data (typed physician notes) more accurately classifies subjects with rheumatoid arthritis (RA) compared with an algorithm using codified EMR data alone. METHODS: Subjects with > or =1 International Classification of Diseases, Ninth Revision RA code (714.xx) or who had anti-cyclic citrullinated peptide (anti-CCP) checked in the EMR of 2 large academic centers were included in an "RA Mart" (n = 29,432). For all 29,432 subjects, we extracted narrative (using natural language processing) and codified RA clinical information. In a training set of 96 RA and 404 non-RA cases from the RA Mart classified by medical record review, we used narrative and codified data to develop classification algorithms using logistic regression. These algorithms were applied to the entire RA Mart. We calculated and compared the positive predictive value (PPV) of these algorithms by reviewing the records of an additional 400 subjects classified as having RA by the algorithms. RESULTS: A complete algorithm (narrative and codified data) classified RA subjects with a significantly higher PPV of 94% than an algorithm with codified data alone (PPV of 88%). Characteristics of the RA cohort identified by the complete algorithm were comparable to existing RA cohorts (80% women, 63% anti-CCP positive, and 59% positive for erosions). CONCLUSION: We demonstrate the ability to utilize complete EMR data to define an RA cohort with a PPV of 94%, which was superior to an algorithm using codified data alone.
Authors: J N Katz; J Barrett; M H Liang; A M Bacon; H Kaplan; R I Kieval; S M Lindsey; W N Roberts; D M Sheff; R T Spencer; A L Weaver; J A Baron Journal: Arthritis Rheum Date: 1997-09
Authors: F C Arnett; S M Edworthy; D A Bloch; D J McShane; J F Fries; N S Cooper; L A Healey; S R Kaplan; M H Liang; H S Luthra Journal: Arthritis Rheum Date: 1988-03
Authors: J D Greenberg; G Reed; J M Kremer; E Tindall; A Kavanaugh; C Zheng; W Bishai; M C Hochberg Journal: Ann Rheum Dis Date: 2009-04-08 Impact factor: 19.103
Authors: Euan A Ashley; Ray E Hershberger; Colleen Caleshu; Patrick T Ellinor; Joe G N Garcia; David M Herrington; Carolyn Y Ho; Julie A Johnson; Steven J Kittner; Calum A Macrae; Gia Mudd-Martin; Daniel J Rader; Dan M Roden; Derek Scholes; Frank W Sellke; Jeffrey A Towbin; Jennifer Van Eyk; Bradford B Worrall Journal: Circulation Date: 2012-05-29 Impact factor: 29.690
Authors: Kabir O Olaniran; Shananssa G Percy; Sophia Zhao; Chantal Blais; Vicki Jackson; Mihir M Kamdar; Jeremy Goverman; Daniela Kroshinsky; Jennifer S Temel; Sagar U Nigwekar; Nwamaka D Eneanya Journal: J Pain Symptom Manage Date: 2018-11-03 Impact factor: 3.612
Authors: Ashwin N Ananthakrishnan; Andrew Cagan; Vivian S Gainer; Su-Chun Cheng; Tianxi Cai; Peter Szolovits; Stanley Y Shaw; Susanne Churchill; Elizabeth W Karlson; Shawn N Murphy; Isaac Kohane; Katherine P Liao Journal: J Crohns Colitis Date: 2014-02-19 Impact factor: 9.071
Authors: Rachel Knevel; Saskia le Cessie; Chikashi C Terao; Kamil Slowikowski; Jing Cui; Tom W J Huizinga; Karen H Costenbader; Katherine P Liao; Elizabeth W Karlson; Soumya Raychaudhuri Journal: Sci Transl Med Date: 2020-05-27 Impact factor: 17.956