Sebastian Schubert1, Kai P Schnabel, Andreas Winkelmann. 1. Assessment Division and Reformed Medical Curriculum, Working Group, Deanery of Student Affairs, Charité Universitatsmedizin Berlin, Berlin, Germany. sebastian.schubert@charite.de
Abstract
BACKGROUND: Text only multiple choice questions (MCQs) are often inadequate to assess anatomical and histological knowledge and may encourage students to memorize abstract textbook knowledge. An alternative are the "spotters" or "tag tests" well-known in North American and British anatomy. However, the psychometric properties of this assessment have only been reported in one study for a format using short answer questions. AIMS: To describe the implementation and feasibility of a multiple choice "tag test" (3D-MC) using prosected specimens, histological slides, models and radiographs; to report the psychometric properties and students' acceptance of the 3D-MC; to compare it with a traditional multiple choice format. RESULTS: The administration of the 3D-MC did not pose any major problems. The 3D-MC was significantly easier (mean scores 75% vs. 64%) than traditional MCQs. The estimated correlation (corrected for attenuation) between the two MCQ formats was r = 0.814. Reliability for the 3D-MC was. 665 for 30 items. Student acceptance was very high. CONCLUSIONS: The 3D-MC is a feasible, reliable and well-accepted test of anatomical knowledge. Further research should investigate if the higher cost as compared to MCQs using photographs is justified by the assessment of different knowledge and abilities as compared to MCQs using photographs.
BACKGROUND: Text only multiple choice questions (MCQs) are often inadequate to assess anatomical and histological knowledge and may encourage students to memorize abstract textbook knowledge. An alternative are the "spotters" or "tag tests" well-known in North American and British anatomy. However, the psychometric properties of this assessment have only been reported in one study for a format using short answer questions. AIMS: To describe the implementation and feasibility of a multiple choice "tag test" (3D-MC) using prosected specimens, histological slides, models and radiographs; to report the psychometric properties and students' acceptance of the 3D-MC; to compare it with a traditional multiple choice format. RESULTS: The administration of the 3D-MC did not pose any major problems. The 3D-MC was significantly easier (mean scores 75% vs. 64%) than traditional MCQs. The estimated correlation (corrected for attenuation) between the two MCQ formats was r = 0.814. Reliability for the 3D-MC was. 665 for 30 items. Student acceptance was very high. CONCLUSIONS: The 3D-MC is a feasible, reliable and well-accepted test of anatomical knowledge. Further research should investigate if the higher cost as compared to MCQs using photographs is justified by the assessment of different knowledge and abilities as compared to MCQs using photographs.
Authors: Georga J Longhurst; Danya M Stone; Kate Dulohery; Deirdre Scully; Thomas Campbell; Claire F Smith Journal: Anat Sci Educ Date: 2020-05-09 Impact factor: 5.958
Authors: Andreas Winkelmann; Julia Schendzielorz; Dagmar Maske; Peter Arends; Christoph Bohne; Henrike Hölzer; Karin Harre; Jonathan Nübel; Bertram Otto; Stefanie Oess Journal: GMS J Med Educ Date: 2019-10-15
Authors: Kevin G Byrnes; Patrick A Kiely; Colum P Dunne; Kieran W McDermott; John Calvin Coffey Journal: Clin Anat Date: 2020-08-05 Impact factor: 2.409