Rohan Deraniyagala1, Robert J Amdur2, Arthur L Boyer3, Scott Kaylor3. 1. Department of Radiation Oncology, University of Florida College of Medicine, Gainesville, Florida. 2. Department of Radiation Oncology, University of Florida College of Medicine, Gainesville, Florida. Electronic address: amdurr@shands.ufl.edu. 3. Radiation Oncology eLearning Center, Inc, Fremont, California.
Abstract
PURPOSE: A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. METHODS AND MATERIALS: This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. RESULTS: In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. CONCLUSIONS: This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills.
PURPOSE: A major strategy for improving radiation oncology education and competence evaluation is to develop eLearning programs that reproduce the real work environment. A valuable measure of the quality of an eLearning program is "usability," which is a multidimensional endpoint defined from the end user's perspective. The gold standard for measuring usability is the Software Usability Measurement Inventory (SUMI). The purpose of this study is to use the SUMI to measure usability of an eLearning course that uses innovative software to teach and test contouring of nodal stations of the head and neck. METHODS AND MATERIALS: This is a prospective institutional review board-approved study in which all participants gave written informed consent. The study population was radiation oncology residents from 8 different programs across the United States. The subjects had to pass all sections of the same 2 eLearning modules and then complete the SUMI usability evaluation instrument. We reached the accrual goal of 25 participants. Usability results for the EduMod eLearning course, "Nodal Stations of the Head and Neck," were compared with a large database of scores of other major software programs. Results were evaluated in 5 domains: Affect, Helpfulness, Control, Learnability, and Global Usability. RESULTS: In all 5 domains, usability scores for the study modules were higher than the database mean and statistically superior in 4 domains. CONCLUSIONS: This is the first study to evaluate usability of an eLearning program related to radiation oncology. Usability of 2 representative modules related to contouring nodal stations of the head and neck was highly favorable, with scores that were superior to the industry standard in multiple domains. These results support the continued development of this type of eLearning program for teaching and testing radiation oncology technical skills.
Authors: Michael K Rooney; Fan Zhu; Erin F Gillespie; Jillian R Gunther; Ryan P McKillip; Matthew Lineberry; Ara Tekian; Daniel W Golden Journal: Int J Radiat Oncol Biol Phys Date: 2018-06-06 Impact factor: 7.038
Authors: Michael V Sherer; Diana Lin; Kartikeya Puri; Neil Panjwani; Zhigang Zhang; James D Murphy; Erin F Gillespie Journal: JCO Clin Cancer Inform Date: 2019-10
Authors: Jillian R Gunther; Stanley L Liauw; Seungtaek Choi; Abdallah S R Mohamed; Nikhil G Thaker; Clifton D Fuller; Christopher J Stepaniak; Prajnan Das; Daniel W Golden Journal: J Am Coll Radiol Date: 2016-05-18 Impact factor: 5.532
Authors: Heather L Keenan; Simon L Duke; Heather J Wharrad; Gillian A Doody; Rakesh S Patel Journal: Tech Innov Patient Support Radiat Oncol Date: 2022-09-17