Scott A Crossley1, Renu Balyan2, Jennifer Liu3, Andrew J Karter3, Danielle McNamara2, Dean Schillinger4. 1. Department of Applied Linguistics/ESL, Georgia State University, Atlanta, GA, USA. 2. Department of Psychology, Arizona State University, Tempe, AZ, USA. 3. Kaiser Permanente Northern California, Oakland, CA, USA. 4. Division of General Internal Medicine and Health Communications Research Program, University of California San Francisco, San Francisco, CA, USA.
Abstract
BACKGROUND: Low literacy skills impact important aspects of communication, including health-related information exchanges. Unsuccessful communication on the part of physician or patient contributes to lower quality of care, is associated with poorer chronic disease control, jeopardizes patient safety and can lead to unfavorable healthcare utilization patterns. To date, very little research has focused on digital communication between physicians and patients, such as secure messages sent via electronic patient portals. METHOD: The purpose of the current study is to develop an automated readability formula to better understand what elements of physicians' digital messages make them more or less difficult to understand. The formula is developed using advanced natural language processing (NLP) to predict human ratings of physician text difficulty. RESULTS: The results indicate that NLP indices that capture a diverse set of linguistic features predict the difficulty of physician messages better than classic readability tools such as Flesch Kincaid Grade Level. Our results also provide information about the textual features that best explain text readability. CONCLUSION: Implications for how the readability formula could provide feedback to physicians to improve digital health communication by promoting linguistic concordance between physician and patient are discussed.
BACKGROUND: Low literacy skills impact important aspects of communication, including health-related information exchanges. Unsuccessful communication on the part of physician or patient contributes to lower quality of care, is associated with poorer chronic disease control, jeopardizes patient safety and can lead to unfavorable healthcare utilization patterns. To date, very little research has focused on digital communication between physicians and patients, such as secure messages sent via electronic patient portals. METHOD: The purpose of the current study is to develop an automated readability formula to better understand what elements of physicians' digital messages make them more or less difficult to understand. The formula is developed using advanced natural language processing (NLP) to predict human ratings of physician text difficulty. RESULTS: The results indicate that NLP indices that capture a diverse set of linguistic features predict the difficulty of physician messages better than classic readability tools such as Flesch Kincaid Grade Level. Our results also provide information about the textual features that best explain text readability. CONCLUSION: Implications for how the readability formula could provide feedback to physicians to improve digital health communication by promoting linguistic concordance between physician and patient are discussed.
Entities:
Keywords:
Health literacy; chronic care management; communication; diabetes; electronic health records; health care quality; linguistics; machine learning; natural language processing; secure messaging
Authors: Howard H Moffet; Nancy Adler; Dean Schillinger; Ameena T Ahmed; Barbara Laraia; Joe V Selby; Romain Neugebauer; Jennifer Y Liu; Melissa M Parker; Margaret Warton; Andrew J Karter Journal: Int J Epidemiol Date: 2008-03-07 Impact factor: 7.196
Authors: Urmimala Sarkar; Andrew J Karter; Jennifer Y Liu; Howard H Moffet; Nancy E Adler; Dean Schillinger Journal: J Gen Intern Med Date: 2010-05-18 Impact factor: 5.128
Authors: Robert M Cronin; Daniel Fabbri; Joshua C Denny; S Trent Rosenbloom; Gretchen Purcell Jackson Journal: Int J Med Inform Date: 2017-06-23 Impact factor: 4.046
Authors: Dean Schillinger; Nicholas D Duran; Danielle S McNamara; Scott A Crossley; Renu Balyan; Andrew J Karter Journal: Sci Adv Date: 2021-12-17 Impact factor: 14.136