Cheng Ye1, Daniel Fabbri2. 1. Department of Computer Science, Vanderbilt University, Nashville, TN, USA. Electronic address: cheng.ye@vanderbilt.edu. 2. Department of Computer Science, Vanderbilt University, Nashville, TN, USA; Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, USA.
Abstract
OBJECTIVE: Word embeddings project semantically similar terms into nearby points in a vector space. When trained on clinical text, these embeddings can be leveraged to improve keyword search and text highlighting. In this paper, we present methods to refine the selection process of similar terms from multiple EMR-based word embeddings, and evaluate their performance quantitatively and qualitatively across multiple chart review tasks. MATERIALS AND METHODS: Word embeddings were trained on each clinical note type in an EMR. These embeddings were then combined, weighted, and truncated to select a refined set of similar terms to be used in keyword search and text highlighting. To evaluate their quality, we measured the similar terms' information retrieval (IR) performance using precision-at-K (P@5, P@10). Additionally a user study evaluated users' search term preferences, while a timing study measured the time to answer a question from a clinical chart. RESULTS: The refined terms outperformed the baseline method's information retrieval performance (e.g., increasing the average P@5 from 0.48 to 0.60). Additionally, the refined terms were preferred by most users, and reduced the average time to answer a question. CONCLUSIONS: Clinical information can be more quickly retrieved and synthesized when using semantically similar term from multiple embeddings.
OBJECTIVE:Word embeddings project semantically similar terms into nearby points in a vector space. When trained on clinical text, these embeddings can be leveraged to improve keyword search and text highlighting. In this paper, we present methods to refine the selection process of similar terms from multiple EMR-based word embeddings, and evaluate their performance quantitatively and qualitatively across multiple chart review tasks. MATERIALS AND METHODS:Word embeddings were trained on each clinical note type in an EMR. These embeddings were then combined, weighted, and truncated to select a refined set of similar terms to be used in keyword search and text highlighting. To evaluate their quality, we measured the similar terms' information retrieval (IR) performance using precision-at-K (P@5, P@10). Additionally a user study evaluated users' search term preferences, while a timing study measured the time to answer a question from a clinical chart. RESULTS: The refined terms outperformed the baseline method's information retrieval performance (e.g., increasing the average P@5 from 0.48 to 0.60). Additionally, the refined terms were preferred by most users, and reduced the average time to answer a question. CONCLUSIONS: Clinical information can be more quickly retrieved and synthesized when using semantically similar term from multiple embeddings.
Authors: David A Hanauer; Danny T Y Wu; Lei Yang; Qiaozhu Mei; Katherine B Murkowski-Steffy; V G Vinod Vydiswaran; Kai Zheng Journal: J Biomed Inform Date: 2017-01-25 Impact factor: 6.317
Authors: Lu Chen; Uta Guo; Lijo C Illipparambil; Matt D Netherton; Bhairavi Sheshadri; Eric Karu; Stephen J Peterson; Parag H Mehta Journal: J Grad Med Educ Date: 2016-02
Authors: Pilar López-Úbeda; Alexandra Pomares-Quimbaya; Manuel Carlos Díaz-Galiano; Stefan Schulz Journal: BMC Med Inform Decis Mak Date: 2021-05-04 Impact factor: 2.796