Guilherme Del Fiol1, Javed Mostafa2, Dongqiuye Pu2, Richard Medlin2, Stacey Slager3, Siddhartha R Jonnalagadda4, Charlene R Weir5. 1. Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA. Electronic address: guilherme.delfiol@utah.edu. 2. School of Information and Library Science (SILS), University of North Carolina, Chapel Hill, NC, USA. 3. Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA. 4. Division of Health and Biomedical Informatics, Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA. 5. Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA; Department of Veterans Affairs Medical Center, Salt Lake City, UT, USA.
Abstract
OBJECTIVE: To iteratively design a prototype of a computerized clinical knowledge summarization (CKS) tool aimed at helping clinicians finding answers to their clinical questions; and to conduct a formative assessment of the usability, usefulness, efficiency, and impact of the CKS prototype on physicians' perceived decision quality compared with standard search of UpToDate and PubMed. MATERIALS AND METHODS: Mixed-methods observations of the interactions of 10 physicians with the CKS prototype vs. standard search in an effort to solve clinical problems posed as case vignettes. RESULTS: The CKS tool automatically summarizes patient-specific and actionable clinical recommendations from PubMed (high quality randomized controlled trials and systematic reviews) and UpToDate. Two thirds of the study participants completed 15 out of 17 usability tasks. The median time to task completion was less than 10s for 12 of the 17 tasks. The difference in search time between the CKS and standard search was not significant (median=4.9 vs. 4.5m in). Physician's perceived decision quality was significantly higher with the CKS than with manual search (mean=16.6 vs. 14.4; p=0.036). CONCLUSIONS: The CKS prototype was well-accepted by physicians both in terms of usability and usefulness. Physicians perceived better decision quality with the CKS prototype compared to standard search of PubMed and UpToDate within a similar search time. Due to the formative nature of this study and a small sample size, conclusions regarding efficiency and efficacy are exploratory. Published by Elsevier Ireland Ltd.
OBJECTIVE: To iteratively design a prototype of a computerized clinical knowledge summarization (CKS) tool aimed at helping clinicians finding answers to their clinical questions; and to conduct a formative assessment of the usability, usefulness, efficiency, and impact of the CKS prototype on physicians' perceived decision quality compared with standard search of UpToDate and PubMed. MATERIALS AND METHODS: Mixed-methods observations of the interactions of 10 physicians with the CKS prototype vs. standard search in an effort to solve clinical problems posed as case vignettes. RESULTS: The CKS tool automatically summarizes patient-specific and actionable clinical recommendations from PubMed (high quality randomized controlled trials and systematic reviews) and UpToDate. Two thirds of the study participants completed 15 out of 17 usability tasks. The median time to task completion was less than 10s for 12 of the 17 tasks. The difference in search time between the CKS and standard search was not significant (median=4.9 vs. 4.5m in). Physician's perceived decision quality was significantly higher with the CKS than with manual search (mean=16.6 vs. 14.4; p=0.036). CONCLUSIONS: The CKS prototype was well-accepted by physicians both in terms of usability and usefulness. Physicians perceived better decision quality with the CKS prototype compared to standard search of PubMed and UpToDate within a similar search time. Due to the formative nature of this study and a small sample size, conclusions regarding efficiency and efficacy are exploratory. Published by Elsevier Ireland Ltd.
Entities:
Keywords:
Clinical decision support; Information needs; Information seeking and retrieval; Online information resources
Authors: Halil Kilicoglu; Dina Demner-Fushman; Thomas C Rindflesch; Nancy L Wilczynski; R Brian Haynes Journal: J Am Med Inform Assoc Date: 2008-10-24 Impact factor: 4.497
Authors: Farah Magrabi; Enrico W Coiera; Johanna I Westbrook; A Sophie Gosling; Victor Vickland Journal: Int J Med Inform Date: 2005-01 Impact factor: 4.046
Authors: Steven D Crowley; Thomas A Owens; Connie M Schardt; Sarah I Wardell; Josh Peterson; Scott Garrison; Sheri A Keitz Journal: Acad Med Date: 2003-03 Impact factor: 6.893
Authors: Brian C Stagg; Joshua D Stein; Felipe A Medeiros; Barbara Wirostko; Alan Crandall; M Elizabeth Hartnett; Mollie Cummins; Alan Morris; Rachel Hess; Kensaku Kawamoto Journal: Ophthalmol Glaucoma Date: 2020-08-15
Authors: Bret S E Heale; Aly Khalifa; Bryan L Stone; Scott Nelson; Guilherme Del Fiol Journal: BMC Med Inform Decis Mak Date: 2017-08-01 Impact factor: 2.796