AIM: To examine how students' evaluations of the environment, process and outcome of clinical learning interrelated and correlated with assessment results. METHOD: A post hoc study in the 3rd of 5 years in a student-centred, horizontally integrated, objective-based medical curriculum. In the last week of each module, students evaluated what they had learned and how they had learned it using a previously validated, web-based scale. The interrelationships between scale variables and their relationships with summative assessment results were tested using factor analysis, correlation analysis and stepwise multiple regression analysis. RESULTS: Student evaluation yielded 4 summary measures: 2 reflected learning outcomes ('real patient learning' and 'curriculum coverage'), 1 reflected process ('quality of instruction') and 1 reflected environment ('conditions for learning'). They fitted a causal model according to which instruction, conditions for learning and curriculum coverage favoured real patient learning. Real patient learning was rated higher in women than men, and the measures were associated more strongly in women. Performance in end-of-year summative assessments was predicted strongly by mid-year performance but by no other measure. CONCLUSIONS: Students' evaluations of their learning environment and instructional processes correlated with their assessments of 2 outcomes of the curriculum in action: curriculum coverage and real patient learning. There was little shared variance between those measures and students' performance in summative assessments. Given its formative potential, students' evaluation of their curriculum in action could play a useful part in learner-centred clinical education. There is a possibility, which needs further research, that women's evaluations have greater predictive validity than men's. Assessment performance should be regarded not as a solitary gold standard but as just 1 measure of educational outcome.
AIM: To examine how students' evaluations of the environment, process and outcome of clinical learning interrelated and correlated with assessment results. METHOD: A post hoc study in the 3rd of 5 years in a student-centred, horizontally integrated, objective-based medical curriculum. In the last week of each module, students evaluated what they had learned and how they had learned it using a previously validated, web-based scale. The interrelationships between scale variables and their relationships with summative assessment results were tested using factor analysis, correlation analysis and stepwise multiple regression analysis. RESULTS: Student evaluation yielded 4 summary measures: 2 reflected learning outcomes ('real patient learning' and 'curriculum coverage'), 1 reflected process ('quality of instruction') and 1 reflected environment ('conditions for learning'). They fitted a causal model according to which instruction, conditions for learning and curriculum coverage favoured real patient learning. Real patient learning was rated higher in women than men, and the measures were associated more strongly in women. Performance in end-of-year summative assessments was predicted strongly by mid-year performance but by no other measure. CONCLUSIONS: Students' evaluations of their learning environment and instructional processes correlated with their assessments of 2 outcomes of the curriculum in action: curriculum coverage and real patient learning. There was little shared variance between those measures and students' performance in summative assessments. Given its formative potential, students' evaluation of their curriculum in action could play a useful part in learner-centred clinical education. There is a possibility, which needs further research, that women's evaluations have greater predictive validity than men's. Assessment performance should be regarded not as a solitary gold standard but as just 1 measure of educational outcome.
Authors: Tim Dornan; Arno Muijtjens; Jennifer Graham; Albert Scherpbier; Henny Boshuizen Journal: Adv Health Sci Educ Theory Pract Date: 2012-01-11 Impact factor: 3.853