Brian L Hazlehurst1, Jean M Lawrence2, William T Donahoo3, Nancy E Sherwood4, Stephen E Kurtz5, Stan Xu3, John F Steiner3. 1. Kaiser Permanente Northwest Center for Health Research, Portland, Oregon. Electronic address: brian.hazlehurst@kpchr.org. 2. Kaiser Permanente Southern California, Department of Research & Evaluation, Pasadena, California. 3. Kaiser Permanente Colorado Institute for Health Research, Denver, Colorado. 4. HealthPartners Institute for Education & Research, Minneapolis, Minnesota. 5. Kaiser Permanente Northwest Center for Health Research, Portland, Oregon.
Abstract
BACKGROUND: Numerous population-based surveys indicate that overweight and obese patients can benefit from lifestyle counseling during routine clinical care. PURPOSE: To determine if natural language processing (NLP) could be applied to information in the electronic health record (EHR) to automatically assess delivery of weight management-related counseling in clinical healthcare encounters. METHODS: The MediClass system with NLP capabilities was used to identify weight-management counseling in EHRs. Knowledge for the NLP application was derived from the 5As framework for behavior counseling: Ask (evaluate weight and related disease), Advise at-risk patients to lose weight, Assess patients' readiness to change behavior, Assist through discussion of weight-loss methods and programs, and Arrange follow-up efforts including referral. Using samples of EHR data between January 1, 2007, and March 31, 2011, from two health systems, the accuracy of the MediClass processor for identifying these counseling elements was evaluated in postpartum visits of 600 women with gestational diabetes mellitus (GDM) compared to manual chart review as the gold standard. Data were analyzed in 2013. RESULTS: Mean sensitivity and specificity for each of the 5As compared to the gold standard was at or above 85%, with the exception of sensitivity for Assist, which was 40% and 60% for each of the two health systems. The automated method identified many valid Assist cases not identified in the gold standard. CONCLUSIONS: The MediClass processor has performance capability sufficiently similar to human abstractors to permit automated assessment of counseling for weight loss in postpartum encounter records.
BACKGROUND: Numerous population-based surveys indicate that overweight and obesepatients can benefit from lifestyle counseling during routine clinical care. PURPOSE: To determine if natural language processing (NLP) could be applied to information in the electronic health record (EHR) to automatically assess delivery of weight management-related counseling in clinical healthcare encounters. METHODS: The MediClass system with NLP capabilities was used to identify weight-management counseling in EHRs. Knowledge for the NLP application was derived from the 5As framework for behavior counseling: Ask (evaluate weight and related disease), Advise at-risk patients to lose weight, Assess patients' readiness to change behavior, Assist through discussion of weight-loss methods and programs, and Arrange follow-up efforts including referral. Using samples of EHR data between January 1, 2007, and March 31, 2011, from two health systems, the accuracy of the MediClass processor for identifying these counseling elements was evaluated in postpartum visits of 600 women with gestational diabetes mellitus (GDM) compared to manual chart review as the gold standard. Data were analyzed in 2013. RESULTS: Mean sensitivity and specificity for each of the 5As compared to the gold standard was at or above 85%, with the exception of sensitivity for Assist, which was 40% and 60% for each of the two health systems. The automated method identified many valid Assist cases not identified in the gold standard. CONCLUSIONS: The MediClass processor has performance capability sufficiently similar to human abstractors to permit automated assessment of counseling for weight loss in postpartum encounter records.
Authors: William C Knowler; Elizabeth Barrett-Connor; Sarah E Fowler; Richard F Hamman; John M Lachin; Elizabeth A Walker; David M Nathan Journal: N Engl J Med Date: 2002-02-07 Impact factor: 91.245
Authors: Julie A Schmittdiel; Jay Desai; Emily B Schroeder; Andrea R Paolino; Gregory A Nichols; Jean M Lawrence; Patrick J O'Connor; Kris A Ohnsorg; Katherine M Newton; John F Steiner Journal: Healthc (Amst) Date: 2015-03-13
Authors: John Heintzman; Miguel Marino; Khaya Clark; Stuart Cowburn; Sonia Sosa; Lizdaly Cancel; David Ezekiel-Herrera; Deborah Cohen Journal: J Immigr Minor Health Date: 2020-08
Authors: Scott J Pilla; Jenny Park; Jessica L Schwartz; Michael C Albert; Patti L Ephraim; L Ebony Boulware; Nestoras N Mathioudakis; Nisa M Maruthur; Mary Catherine Beach; Raquel C Greer Journal: J Gen Intern Med Date: 2021-01-21 Impact factor: 6.473
Authors: Arika E Wieneke; Erin J A Bowles; David Cronkite; Karen J Wernli; Hongyuan Gao; David Carrell; Diana S M Buist Journal: J Pathol Inform Date: 2015-06-23