Brock Polnaszek1, Andrea Gilmore-Bykovskyi, Melissa Hovanes, Rachel Roiland, Patrick Ferguson, Roger Brown, Amy J H Kind. 1. *Department of Medicine, Geriatrics Division, University of Wisconsin School of Medicine and Public Health†United States Department of Veterans Affairs, Geriatric Research Education and Clinical Center (GRECC), William S Middleton Hospital‡University of Wisconsin School of Nursing§Department of Population Health Sciences, University of Wisconsin, Madison, WI.
Abstract
BACKGROUND: Unstructured data encountered during retrospective electronic medical record (EMR) abstraction has routinely been identified as challenging to reliably abstract, as these data are often recorded as free text, without limitations to format or structure. There is increased interest in reliably abstracting this type of data given its prominent role in care coordination and communication, yet limited methodological guidance exists. OBJECTIVES: As standard abstraction approaches resulted in substandard data reliability for unstructured data elements collected as part of a multisite, retrospective EMR study of hospital discharge communication quality, our goal was to develop, apply and examine the utility of a phase-based approach to reliably abstract unstructured data. This approach is examined using the specific example of discharge communication for warfarin management. RESEARCH DESIGN: We adopted a "fit-for-use" framework to guide the development and evaluation of abstraction methods using a 4-step, phase-based approach including (1) team building; (2) identification of challenges; (3) adaptation of abstraction methods; and (4) systematic data quality monitoring. MEASURES: Unstructured data elements were the focus of this study, including elements communicating steps in warfarin management (eg, warfarin initiation) and medical follow-up (eg, timeframe for follow-up). RESULTS: After implementation of the phase-based approach, interrater reliability for all unstructured data elements demonstrated κ's of ≥0.89-an average increase of +0.25 for each unstructured data element. CONCLUSIONS: As compared with standard abstraction methodologies, this phase-based approach was more time intensive, but did markedly increase abstraction reliability for unstructured data elements within multisite EMR documentation.
BACKGROUND: Unstructured data encountered during retrospective electronic medical record (EMR) abstraction has routinely been identified as challenging to reliably abstract, as these data are often recorded as free text, without limitations to format or structure. There is increased interest in reliably abstracting this type of data given its prominent role in care coordination and communication, yet limited methodological guidance exists. OBJECTIVES: As standard abstraction approaches resulted in substandard data reliability for unstructured data elements collected as part of a multisite, retrospective EMR study of hospital discharge communication quality, our goal was to develop, apply and examine the utility of a phase-based approach to reliably abstract unstructured data. This approach is examined using the specific example of discharge communication for warfarin management. RESEARCH DESIGN: We adopted a "fit-for-use" framework to guide the development and evaluation of abstraction methods using a 4-step, phase-based approach including (1) team building; (2) identification of challenges; (3) adaptation of abstraction methods; and (4) systematic data quality monitoring. MEASURES: Unstructured data elements were the focus of this study, including elements communicating steps in warfarin management (eg, warfarin initiation) and medical follow-up (eg, timeframe for follow-up). RESULTS: After implementation of the phase-based approach, interrater reliability for all unstructured data elements demonstrated κ's of ≥0.89-an average increase of +0.25 for each unstructured data element. CONCLUSIONS: As compared with standard abstraction methodologies, this phase-based approach was more time intensive, but did markedly increase abstraction reliability for unstructured data elements within multisite EMR documentation.
Authors: Vaishali Patel; Eric Jamoom; Chun-Ju Hsiao; Michael F Furukawa; Melinda Buntin Journal: J Gen Intern Med Date: 2013-02-01 Impact factor: 5.128
Authors: Jenna Howard; Elizabeth C Clark; Asia Friedman; Jesse C Crosson; Maria Pellerano; Benjamin F Crabtree; Ben-Tzion Karsh; Carlos R Jaen; Douglas S Bell; Deborah J Cohen Journal: J Gen Intern Med Date: 2012-08-28 Impact factor: 5.128
Authors: Andrea L Gilmore-Bykovskyi; Laura M Block; Lily Walljasper; Nikki Hill; Carey Gleason; Manish N Shah Journal: J Am Med Inform Assoc Date: 2018-09-01 Impact factor: 4.497
Authors: Carol P Roth; Ian D Coulter; Lisa S Kraus; Gery W Ryan; Gary Jacob; Joyce S Marks; Eric L Hurwitz; Howard Vernon; Paul G Shekelle; Patricia M Herman Journal: J Manipulative Physiol Ther Date: 2019-06-27 Impact factor: 1.437
Authors: Andrea L Gilmore-Bykovskyi; Laura Block; Melissa Hovanes; Jacquelyn Mirr; Ann Kolanowski Journal: Res Gerontol Nurs Date: 2019-01-31 Impact factor: 1.571
Authors: Michael A Puskarich; Clif Callaway; Robert Silbergleit; Jesse M Pines; Ziad Obermeyer; David W Wright; Renee Y Hsia; Manish N Shah; Andrew A Monte; Alexander T Limkakeng; Zachary F Meisel; Phillip D Levy Journal: Acad Emerg Med Date: 2018-08-16 Impact factor: 3.451
Authors: David A Hanauer; Jill S Barnholtz-Sloan; Mark F Beno; Guilherme Del Fiol; Eric B Durbin; Oksana Gologorskaya; Daniel Harris; Brett Harnett; Kensaku Kawamoto; Benjamin May; Eric Meeks; Emily Pfaff; Janie Weiss; Kai Zheng Journal: JCO Clin Cancer Inform Date: 2020-05