Aditya Borakati1. 1. University Department of Surgery, Royal Free Hospital, Pond Street, London, NW3 2QG, UK. a.borakati@doctors.org.uk.
Abstract
BACKGROUND: In the context of the ongoing pandemic, e-learning has become essential to maintain existing medical educational programmes. Evaluation of such courses has thus far been on a small scale at single institutions. Further, systematic appraisal of the large volume of qualitative feedback generated by massive online e-learning courses manually is time consuming. This study aimed to evaluate the impact of an e-learning course targeting medical students collaborating in an international cohort study, with semi-automated analysis of feedback using text mining and machine learning methods. METHOD: This study was based on a multi-centre cohort study exploring gastrointestinal recovery following elective colorectal surgery. Collaborators were invited to complete a series of e-learning modules on key aspects of the study and complete a feedback questionnaire on the modules. Quantitative data were analysed using simple descriptive statistics. Qualitative data were analysed using text mining with most frequent words, sentiment analysis with the AFINN-111 and syuzhet lexicons and topic modelling using the Latent Dirichlet Allocation (LDA). RESULTS: One thousand six hundred and eleventh collaborators from 24 countries completed the e-learning course; 1396 (86.7%) were medical students; 1067 (66.2%) entered feedback. 1031 (96.6%) rated the quality of the course a 4/5 or higher (mean 4.56; SD 0.58). The mean sentiment score using the AFINN was + 1.54/5 (5: most positive; SD 1.19) and + 0.287/1 (1: most positive; SD 0.390) using syuzhet. LDA generated topics consolidated into the themes: (1) ease of use, (2) conciseness and (3) interactivity. CONCLUSIONS: E-learning can have high user satisfaction for training investigators of clinical studies and medical students. Natural language processing may be beneficial in analysis of large scale educational courses.
BACKGROUND: In the context of the ongoing pandemic, e-learning has become essential to maintain existing medical educational programmes. Evaluation of such courses has thus far been on a small scale at single institutions. Further, systematic appraisal of the large volume of qualitative feedback generated by massive online e-learning courses manually is time consuming. This study aimed to evaluate the impact of an e-learning course targeting medical students collaborating in an international cohort study, with semi-automated analysis of feedback using text mining and machine learning methods. METHOD: This study was based on a multi-centre cohort study exploring gastrointestinal recovery following elective colorectal surgery. Collaborators were invited to complete a series of e-learning modules on key aspects of the study and complete a feedback questionnaire on the modules. Quantitative data were analysed using simple descriptive statistics. Qualitative data were analysed using text mining with most frequent words, sentiment analysis with the AFINN-111 and syuzhet lexicons and topic modelling using the Latent Dirichlet Allocation (LDA). RESULTS: One thousand six hundred and eleventh collaborators from 24 countries completed the e-learning course; 1396 (86.7%) were medical students; 1067 (66.2%) entered feedback. 1031 (96.6%) rated the quality of the course a 4/5 or higher (mean 4.56; SD 0.58). The mean sentiment score using the AFINN was + 1.54/5 (5: most positive; SD 1.19) and + 0.287/1 (1: most positive; SD 0.390) using syuzhet. LDA generated topics consolidated into the themes: (1) ease of use, (2) conciseness and (3) interactivity. CONCLUSIONS: E-learning can have high user satisfaction for training investigators of clinical studies and medical students. Natural language processing may be beneficial in analysis of large scale educational courses.
Entities:
Keywords:
Computer-assisted instruction; Education; Machine learning; Methods; Research design
Authors: S E O Khogali; D A Davies; P T Donnan; A Gray; R M Harden; J McDonald; M J Pippard; S D Pringle; N Yu Journal: Med Teach Date: 2011 Impact factor: 3.650
Authors: Christopher M Wittich; Anoop Agrawal; David A Cook; Andrew J Halvorsen; Jayawant N Mandrekar; Saima Chaudhry; Denise M Dupras; Amy S Oxentenko; Thomas J Beckman Journal: BMC Med Educ Date: 2017-07-11 Impact factor: 2.463
Authors: Regina Kulier; Sjors F P J Coppus; Javier Zamora; Julie Hadley; Sadia Malick; Kausik Das; Susanne Weinbrenner; Berrit Meyerrose; Tamas Decsi; Andrea R Horvath; Eva Nagy; Jose I Emparanza; Theodoros N Arvanitis; Amanda Burls; Juan B Cabello; Marcin Kaczor; Gianni Zanrei; Karen Pierer; Katarzyna Stawiarz; Regina Kunz; Ben W J Mol; Khalid S Khan Journal: BMC Med Educ Date: 2009-05-12 Impact factor: 2.463