Steven M Downing1, Ara Tekian, Rachel Yudkowsky. 1. Department of Medical Education, University of Illinois at Chicago, Chicago, Illinois 60612-7309, USA. sdowning@uic.edu
Abstract
BACKGROUND: Establishing credible, defensible, and acceptable passing scores for performance-type examinations in real-world settings is a challenge for health professions educators. Our purpose in this article is to provide step-by-step instructions with worked examples for 5 absolute standard-setting methods that can be used to establish acceptable passing scores for performance examinations such as Objective Structured Clinical Examinations or standardized patient encounters. SUMMARY: All standards reflect the subjective opinions of experts. In this "how-to" article, we demonstrate procedures for systematically capturing these expert opinions using 5 research-based methods (Angoff, Ebel, Hofstee, Borderline Group, and Contrasting Groups). We discuss issues relating to selection of judges, use of performance data, and decision-making processes. CONCLUSIONS: Different standard-setting methods produce different passing scores; there is no "gold standard." The key to defensible standards lies in the choice of credible judges and in the use of a systematic approach to collecting their judgments. Ultimately, all standards are policy decisions.
BACKGROUND: Establishing credible, defensible, and acceptable passing scores for performance-type examinations in real-world settings is a challenge for health professions educators. Our purpose in this article is to provide step-by-step instructions with worked examples for 5 absolute standard-setting methods that can be used to establish acceptable passing scores for performance examinations such as Objective Structured Clinical Examinations or standardized patient encounters. SUMMARY: All standards reflect the subjective opinions of experts. In this "how-to" article, we demonstrate procedures for systematically capturing these expert opinions using 5 research-based methods (Angoff, Ebel, Hofstee, Borderline Group, and Contrasting Groups). We discuss issues relating to selection of judges, use of performance data, and decision-making processes. CONCLUSIONS: Different standard-setting methods produce different passing scores; there is no "gold standard." The key to defensible standards lies in the choice of credible judges and in the use of a systematic approach to collecting their judgments. Ultimately, all standards are policy decisions.
Authors: Jeffrey H Barsuk; Elaine R Cohen; Timothy Caprio; William C McGaghie; Tanya Simuni; Diane B Wayne Journal: Neurology Date: 2012-06-06 Impact factor: 9.910
Authors: Stuart F Quan; Richard B Berry; Daniel Buysse; Nancy A Collop; Madeleine Grigg-Damberger; Susan M Harding; Conrad Iber; W Vaughn McCall; Michael J Sateia; Stephen H Sheldon; Michael H Silber; Adam Sorscher; Sally L Davidson Ward; Sigrid Veasey; B Tucker Woodson; Brian Hess; Roberta Kangilaski Journal: J Clin Sleep Med Date: 2008-10-15 Impact factor: 4.062
Authors: H Glenn Anderson; Lisa Frazier; Stephanie L Anderson; Robert Stanton; Chris Gillette; Kim Broedel-Zaugg; Kevin Yingling Journal: Am J Pharm Educ Date: 2017-05 Impact factor: 2.047
Authors: Farzad Moazed; Elaine R Cohen; Nicholas Furiasse; Benjamin Singer; Thomas C Corbridge; William C McGaghie; Diane B Wayne Journal: J Grad Med Educ Date: 2013-09