PURPOSE: To compare four standard-setting procedures for an objective structure clinical examination (OSCE). METHODS: A 12-station OSCE was administered to 84 students in each of the final (fourth-) year medical classes of 1996 and 1997 at Dalhousie University Faculty of Medicine. Four standard-setting procedures (Angoff, borderline, relative, and holistic) were applied to the data to establish a cutoff score for a pass/fail decision. RESULTS: The procedures yielded highly inconsistent results. The Angoff and borderline procedures gave similar results; however, the relative and holistic methods gave widely divergent results. The Angoff procedure yielded results reliable enough to use in decision making for a high-stakes examination, but would have required more judges or more stations. CONCLUSIONS: The Angoff and borderline procedures provide reasonable and defensible approaches to standard setting and are practical to apply by non-psychometricians in medical schools. Further investigation of the other procedures is needed.
PURPOSE: To compare four standard-setting procedures for an objective structure clinical examination (OSCE). METHODS: A 12-station OSCE was administered to 84 students in each of the final (fourth-) year medical classes of 1996 and 1997 at Dalhousie University Faculty of Medicine. Four standard-setting procedures (Angoff, borderline, relative, and holistic) were applied to the data to establish a cutoff score for a pass/fail decision. RESULTS: The procedures yielded highly inconsistent results. The Angoff and borderline procedures gave similar results; however, the relative and holistic methods gave widely divergent results. The Angoff procedure yielded results reliable enough to use in decision making for a high-stakes examination, but would have required more judges or more stations. CONCLUSIONS: The Angoff and borderline procedures provide reasonable and defensible approaches to standard setting and are practical to apply by non-psychometricians in medical schools. Further investigation of the other procedures is needed.
Authors: Folarin Odusola; Jennifer L Smith; Eva Turrigiano; Matisyahu Shulman; John T Grbic; James B Fine; Mei-Chen Hu; Edward V Nunes; Adam Bisaga; Frances R Levin Journal: Eur J Dent Educ Date: 2021-01-20 Impact factor: 2.355
Authors: Tim Dwyer; Sarah Wright; Kulamakan Mahan Kulasegaram; John Theodoropoulos; Jaskarndip Chahal; David Wasserstein; Charlotte Ringsted; Brian Hodges; Darrell Ogilvie-Harris Journal: BMC Med Educ Date: 2016-01-04 Impact factor: 2.463
Authors: Jostein Rødseth Brede; Thomas Lafrenz; Andreas J Krüger; Edmund Søvik; Torjus Steffensen; Carlo Kriesi; Martin Steinert; Pål Klepstad Journal: BMJ Open Date: 2019-05-09 Impact factor: 2.692