Hao Tian1, Jin-Mann S Lin, William C Reeves. 1. Chronic Viral Diseases Branch, Division of High-Consequence Pathogens and Pathology, Centers for Disease Control and Prevention, Atlanta, Georgia 30333, USA. ejq7@cdc.gov
Abstract
OBJECTIVES: To evaluate the web structure of two web-based continuing education courses, identify problems and assess the effects of web site modifications. DESIGN: Markov chain models were built from 2008 web usage data to evaluate the courses' web structure and navigation patterns. The web site was then modified to resolve identified design issues and the improvement in user activity over the subsequent 12 months was quantitatively evaluated. MEASUREMENTS: Web navigation paths were collected between 2008 and 2010. The probability of navigating from one web page to another was analyzed. RESULTS: The continuing education courses' sequential structure design was clearly reflected in the resulting actual web usage models, and none of the skip transitions provided was heavily used. The web navigation patterns of the two different continuing education courses were similar. Two possible design flaws were identified and fixed in only one of the two courses. Over the following 12 months, the drop-out rate in the modified course significantly decreased from 41% to 35%, but remained unchanged in the unmodified course. The web improvement effects were further verified via a second-order Markov chain model. CONCLUSIONS: The results imply that differences in web content have less impact than web structure design on how learners navigate through continuing education courses. Evaluation of user navigation can help identify web design flaws and guide modifications. This study showed that Markov chain models provide a valuable tool to evaluate web-based education courses. Both the results and techniques in this study would be very useful for public health education and research specialists.
OBJECTIVES: To evaluate the web structure of two web-based continuing education courses, identify problems and assess the effects of web site modifications. DESIGN: Markov chain models were built from 2008 web usage data to evaluate the courses' web structure and navigation patterns. The web site was then modified to resolve identified design issues and the improvement in user activity over the subsequent 12 months was quantitatively evaluated. MEASUREMENTS: Web navigation paths were collected between 2008 and 2010. The probability of navigating from one web page to another was analyzed. RESULTS: The continuing education courses' sequential structure design was clearly reflected in the resulting actual web usage models, and none of the skip transitions provided was heavily used. The web navigation patterns of the two different continuing education courses were similar. Two possible design flaws were identified and fixed in only one of the two courses. Over the following 12 months, the drop-out rate in the modified course significantly decreased from 41% to 35%, but remained unchanged in the unmodified course. The web improvement effects were further verified via a second-order Markov chain model. CONCLUSIONS: The results imply that differences in web content have less impact than web structure design on how learners navigate through continuing education courses. Evaluation of user navigation can help identify web design flaws and guide modifications. This study showed that Markov chain models provide a valuable tool to evaluate web-based education courses. Both the results and techniques in this study would be very useful for public health education and research specialists.
Authors: Michael Fordis; Jason E King; Christie M Ballantyne; Peter H Jones; Katharine H Schneider; Stephen J Spann; Stephen B Greenberg; Anthony J Greisinger Journal: JAMA Date: 2005-09-07 Impact factor: 56.272
Authors: Hao Tian; Dana J Brimmer; Jin-Mann S Lin; Abbigail J Tumpey; William C Reeves Journal: J Med Internet Res Date: 2009-12-21 Impact factor: 5.428