Stéphane M Meystre1, Paul M Heider2, Youngjun Kim2, Daniel B Aruch3, Carolyn D Britten3. 1. Biomedical Informatics Center, Medical University of South Carolina, Charleston, SC, United States; Division of Hematology/Oncology, Medical University of South Carolina, Charleston, SC, United States. Electronic address: meystre@musc.edu. 2. Biomedical Informatics Center, Medical University of South Carolina, Charleston, SC, United States. 3. Division of Hematology/Oncology, Medical University of South Carolina, Charleston, SC, United States.
Abstract
INTRODUCTION: Insufficient patient enrollment in clinical trials remains a serious and costly problem and is often considered the most critical issue to solve for the clinical trials community. In this project, we assessed the feasibility of automatically detecting a patient's eligibility for a sample of breast cancer clinical trials by mapping coded clinical trial eligibility criteria to the corresponding clinical information automatically extracted from text in the EHR. METHODS: Three open breast cancer clinical trials were selected by oncologists. Their eligibility criteria were manually abstracted from trial descriptions using the OHDSI ATLAS web application. Patients enrolled or screened for these trials were selected as 'positive' or 'possible' cases. Other patients diagnosed with breast cancer were selected as 'negative' cases. A selection of the clinical data and all clinical notes of these 229 selected patients was extracted from the MUSC clinical data warehouse and stored in a database implementing the OMOP common data model. Eligibility criteria were extracted from clinical notes using either manually crafted pattern matching (regular expressions) or a new natural language processing (NLP) application. These extracted criteria were then compared with reference criteria from trial descriptions. This comparison was realized with three different versions of a new application: rule-based, cosine similarity-based, and machine learning-based. RESULTS: For eligibility criteria extraction from clinical notes, the machine learning-based NLP application allowed for the highest accuracy with a micro-averaged recall of 90.9% and precision of 89.7%. For trial eligibility determination, the highest accuracy was reached by the machine learning-based approach with a per-trial AUC between 75.5% and 89.8%. CONCLUSION: NLP can be used to extract eligibility criteria from EHR clinical notes and automatically discover patients possibly eligible for a clinical trial with good accuracy, which could be leveraged to reduce the workload of humans screening patients for trials.
INTRODUCTION: Insufficient patient enrollment in clinical trials remains a serious and costly problem and is often considered the most critical issue to solve for the clinical trials community. In this project, we assessed the feasibility of automatically detecting a patient's eligibility for a sample of breast cancer clinical trials by mapping coded clinical trial eligibility criteria to the corresponding clinical information automatically extracted from text in the EHR. METHODS: Three open breast cancer clinical trials were selected by oncologists. Their eligibility criteria were manually abstracted from trial descriptions using the OHDSI ATLAS web application. Patients enrolled or screened for these trials were selected as 'positive' or 'possible' cases. Other patients diagnosed with breast cancer were selected as 'negative' cases. A selection of the clinical data and all clinical notes of these 229 selected patients was extracted from the MUSC clinical data warehouse and stored in a database implementing the OMOP common data model. Eligibility criteria were extracted from clinical notes using either manually crafted pattern matching (regular expressions) or a new natural language processing (NLP) application. These extracted criteria were then compared with reference criteria from trial descriptions. This comparison was realized with three different versions of a new application: rule-based, cosine similarity-based, and machine learning-based. RESULTS: For eligibility criteria extraction from clinical notes, the machine learning-based NLP application allowed for the highest accuracy with a micro-averaged recall of 90.9% and precision of 89.7%. For trial eligibility determination, the highest accuracy was reached by the machine learning-based approach with a per-trial AUC between 75.5% and 89.8%. CONCLUSION: NLP can be used to extract eligibility criteria from EHR clinical notes and automatically discover patients possibly eligible for a clinical trial with good accuracy, which could be leveraged to reduce the workload of humans screening patients for trials.
Authors: Chunhua Weng; Xiaoying Wu; Zhihui Luo; Mary Regina Boland; Dimitri Theodoratos; Stephen B Johnson Journal: J Am Med Inform Assoc Date: 2011-07-31 Impact factor: 4.497
Authors: P N Lara; R Higdon; N Lim; K Kwan; M Tanaka; D H Lau; T Wun; J Welborn; F J Meyers; S Christensen; R O'Donnell; C Richman; S A Scudder; J Tuscano; D R Gandara; K S Lam Journal: J Clin Oncol Date: 2001-03-15 Impact factor: 44.544
Authors: Samir R Thadani; Chunhua Weng; J Thomas Bigger; John F Ennever; David Wajngurt Journal: J Am Med Inform Assoc Date: 2009-08-28 Impact factor: 4.497
Authors: Yizhao Ni; Jordan Wright; John Perentesis; Todd Lingren; Louise Deleger; Megan Kaiser; Isaac Kohane; Imre Solti Journal: BMC Med Inform Decis Mak Date: 2015-04-14 Impact factor: 2.796
Authors: Ahmed Rafee; Sarah Riepenhausen; Philipp Neuhaus; Alexandra Meidt; Martin Dugas; Julian Varghese Journal: BMC Med Res Methodol Date: 2022-05-14 Impact factor: 4.612
Authors: Peijin Han; Sunyang Fu; Julie Kolis; Richard Hughes; Brian R Hallstrom; Martha Carvour; Hilal Maradit-Kremers; Sunghwan Sohn; V G Vinod Vydiswaran Journal: JMIR Med Inform Date: 2022-08-31