Tianyong Hao1, Alexander Rusanov2, Mary Regina Boland1, Chunhua Weng3. 1. Department of Biomedical Informatics, Columbia University, New York, NY, United States. 2. Department of Anesthesiology, Columbia University, New York, NY, United States. 3. Department of Biomedical Informatics, Columbia University, New York, NY, United States. Electronic address: cw2384@columbia.edu.
Abstract
OBJECTIVES: To automatically identify and cluster clinical trials with similar eligibility features. METHODS: Using the public repository ClinicalTrials.gov as the data source, we extracted semantic features from the eligibility criteria text of all clinical trials and constructed a trial-feature matrix. We calculated the pairwise similarities for all clinical trials based on their eligibility features. For all trials, by selecting one trial as the center each time, we identified trials whose similarities to the central trial were greater than or equal to a predefined threshold and constructed center-based clusters. Then we identified unique trial sets with distinctive trial membership compositions from center-based clusters by disregarding their structural information. RESULTS: From the 145,745 clinical trials on ClinicalTrials.gov, we extracted 5,508,491 semantic features. Of these, 459,936 were unique and 160,951 were shared by at least one pair of trials. Crowdsourcing the cluster evaluation using Amazon Mechanical Turk (MTurk), we identified the optimal similarity threshold, 0.9. Using this threshold, we generated 8806 center-based clusters. Evaluation of a sample of the clusters by MTurk resulted in a mean score 4.331±0.796 on a scale of 1-5 (5 indicating "strongly agree that the trials in the cluster are similar"). CONCLUSIONS: We contribute an automated approach to clustering clinical trials with similar eligibility features. This approach can be potentially useful for investigating knowledge reuse patterns in clinical trial eligibility criteria designs and for improving clinical trial recruitment. We also contribute an effective crowdsourcing method for evaluating informatics interventions.
OBJECTIVES: To automatically identify and cluster clinical trials with similar eligibility features. METHODS: Using the public repository ClinicalTrials.gov as the data source, we extracted semantic features from the eligibility criteria text of all clinical trials and constructed a trial-feature matrix. We calculated the pairwise similarities for all clinical trials based on their eligibility features. For all trials, by selecting one trial as the center each time, we identified trials whose similarities to the central trial were greater than or equal to a predefined threshold and constructed center-based clusters. Then we identified unique trial sets with distinctive trial membership compositions from center-based clusters by disregarding their structural information. RESULTS: From the 145,745 clinical trials on ClinicalTrials.gov, we extracted 5,508,491 semantic features. Of these, 459,936 were unique and 160,951 were shared by at least one pair of trials. Crowdsourcing the cluster evaluation using Amazon Mechanical Turk (MTurk), we identified the optimal similarity threshold, 0.9. Using this threshold, we generated 8806 center-based clusters. Evaluation of a sample of the clusters by MTurk resulted in a mean score 4.331±0.796 on a scale of 1-5 (5 indicating "strongly agree that the trials in the cluster are similar"). CONCLUSIONS: We contribute an automated approach to clustering clinical trials with similar eligibility features. This approach can be potentially useful for investigating knowledge reuse patterns in clinical trial eligibility criteria designs and for improving clinical trial recruitment. We also contribute an effective crowdsourcing method for evaluating informatics interventions.
Authors: Samson W Tu; Mor Peleg; Simona Carini; Michael Bobak; Jessica Ross; Daniel Rubin; Ida Sim Journal: J Biomed Inform Date: 2010-09-17 Impact factor: 6.317
Authors: M K Campbell; C Snowdon; D Francis; D Elbourne; A M McDonald; R Knight; V Entwistle; J Garcia; I Roberts; A Grant; A Grant Journal: Health Technol Assess Date: 2007-11 Impact factor: 4.014
Authors: Anando Sen; Patrick B Ryan; Andrew Goldstein; Shreya Chakrabarti; Shuang Wang; Eileen Koski; Chunhua Weng Journal: Ann N Y Acad Sci Date: 2016-09-06 Impact factor: 5.691