INTRODUCTION: In individuals with nonvalvular atrial fibrillation, anticoagulant therapy with warfarin reduces the rate of thromboembolic events but increases the risk of bleeding. Treatment decisions frequently are inconsistent with guidelines. A new web-based atrial fibrillation decision-support tool (AF-DST) provides patient-specific information on the risk-benefit tradeoff of anticoagulation. METHODS: The authors performed a pilot usability testing study of the AF-DST with 4 medical house officers and 4 attending physicians by simulating 9 outpatient clinical encounters involving tradeoffs between risks and benefits of anticoagulation. They recorded positive and negative critical incidents in the simulations and assessed satisfaction with use of the AF-DST by the Computer System Usability Questionnaire (CSUQ; score range on each item: 1 = strongly disagree to 7 = strongly agree). RESULTS: Users found the AF-DST to be helpful and had high CSUQ scores (mean item score, 6.3). Usability testing identified 6 positive and 14 negative critical incidents. Participants felt that the AF-DST guided them toward the correct decision. Nevertheless, they desired more information on the "black box" calculations and ignored alerts. Training level appeared to affect how the AF-DST was used, in particular, how users interacted with the AF-DST. CONCLUSIONS: Overall satisfaction with the AF-DST was high and the tool effectively communicated recommendations and uncertainty. Usability testing identified design issues and potential errors caused by decision-support tool use; these gaps should be addressed prior to clinical implementation.
INTRODUCTION: In individuals with nonvalvular atrial fibrillation, anticoagulant therapy with warfarin reduces the rate of thromboembolic events but increases the risk of bleeding. Treatment decisions frequently are inconsistent with guidelines. A new web-based atrial fibrillation decision-support tool (AF-DST) provides patient-specific information on the risk-benefit tradeoff of anticoagulation. METHODS: The authors performed a pilot usability testing study of the AF-DST with 4 medical house officers and 4 attending physicians by simulating 9 outpatient clinical encounters involving tradeoffs between risks and benefits of anticoagulation. They recorded positive and negative critical incidents in the simulations and assessed satisfaction with use of the AF-DST by the Computer System Usability Questionnaire (CSUQ; score range on each item: 1 = strongly disagree to 7 = strongly agree). RESULTS: Users found the AF-DST to be helpful and had high CSUQ scores (mean item score, 6.3). Usability testing identified 6 positive and 14 negative critical incidents. Participants felt that the AF-DST guided them toward the correct decision. Nevertheless, they desired more information on the "black box" calculations and ignored alerts. Training level appeared to affect how the AF-DST was used, in particular, how users interacted with the AF-DST. CONCLUSIONS: Overall satisfaction with the AF-DST was high and the tool effectively communicated recommendations and uncertainty. Usability testing identified design issues and potential errors caused by decision-support tool use; these gaps should be addressed prior to clinical implementation.
Authors: Victor D Torres Roldan; Sarah R Brand-McCarthy; Oscar J Ponce; Tereza Belluzzo; Meritxell Urtecho; Nataly R Espinoza Suarez; Freddy J K Toloza; Anjali D Thota; Paige W Organick; Francisco Barrera; Carolina Liu-Sanchez; Soumya Jaladi; Larry Prokop; Elissa M Ozanne; Angela Fagerlin; Ian G Hargraves; Peter A Noseworthy; Victor M Montori; Juan P Brito Journal: Med Decis Making Date: 2021-04-24 Impact factor: 2.583