BACKGROUND: This study used the Angoff and Hofstee standard-setting methods to derive minimum passing scores for six advanced cardiac life support (ACLS) procedures. METHOD: An expert panel provided item-based (Angoff) and group-based (Hofstee) judgments about six ACLS performance checklists on two occasions separated by ten weeks. Interrater reliabilities and test-retest reliability (stability) of the judgments were calculated. Derived ACLS passing standards are compared to historical ACLS performance data from two groups of ACLS-trained internal medicine residents. RESULTS: Both the Angoff and Hofstee standard-setting methods produced reliable and stable data. Hofstee minimum passing scores (MPSs) were uniformly more stringent than Angoff MPSs. Interpretation of historical ACLS performance data from medical residents shows the MPSs derived in this study would yield higher-than-expected failure rates. CONCLUSION: Systematic standard setting for ACLS procedures is a necessary step toward the creation of mastery learning educational programs.
BACKGROUND: This study used the Angoff and Hofstee standard-setting methods to derive minimum passing scores for six advanced cardiac life support (ACLS) procedures. METHOD: An expert panel provided item-based (Angoff) and group-based (Hofstee) judgments about six ACLS performance checklists on two occasions separated by ten weeks. Interrater reliabilities and test-retest reliability (stability) of the judgments were calculated. Derived ACLS passing standards are compared to historical ACLS performance data from two groups of ACLS-trained internal medicine residents. RESULTS: Both the Angoff and Hofstee standard-setting methods produced reliable and stable data. Hofstee minimum passing scores (MPSs) were uniformly more stringent than Angoff MPSs. Interpretation of historical ACLS performance data from medical residents shows the MPSs derived in this study would yield higher-than-expected failure rates. CONCLUSION: Systematic standard setting for ACLS procedures is a necessary step toward the creation of mastery learning educational programs.
Authors: Diane B Wayne; John Butter; Viva J Siddall; Monica J Fudala; Leonard D Wade; Joe Feinglass; William C McGaghie Journal: J Gen Intern Med Date: 2006-03 Impact factor: 5.128
Authors: Jeffrey H Barsuk; Elaine R Cohen; John A Vozenilek; Lanty M O'Connor; William C McGaghie; Diane B Wayne Journal: J Grad Med Educ Date: 2012-03
Authors: Jesse M Ehrenfeld; Matthew D McEvoy; William R Furman; Dylan Snyder; Warren S Sandberg Journal: Anesthesiology Date: 2014-01 Impact factor: 7.892
Authors: Aashish Didwania; William C McGaghie; Elaine R Cohen; John Butter; Jeffrey H Barsuk; Leonard D Wade; Rozanna Chester; Diane B Wayne Journal: J Grad Med Educ Date: 2011-06
Authors: Scott C Watkins; Paul J Nietert; Elisabeth Hughes; Eric T Stickles; Tracy E Wester; Matthew D McEvoy Journal: Am J Med Sci Date: 2016-10-03 Impact factor: 2.378
Authors: Matthew D McEvoy; Larry C Field; Haley E Moore; Jeremy C Smalley; Paul J Nietert; Sheila H Scarbrough Journal: Resuscitation Date: 2013-10-05 Impact factor: 5.262
Authors: Matthew D McEvoy; Jeremy C Smalley; Paul J Nietert; Larry C Field; Cory M Furse; John W Blenko; Benjamin G Cobb; Jenna L Walters; Allen Pendarvis; Nishita S Dalal; John J Schaefer Journal: Simul Healthc Date: 2012-08 Impact factor: 1.929
Authors: David H Salzman; Kristin L Rising; Kenzie A Cameron; Rhea E Powell; Dimitri Papanagnou; Amanda Doty; Katherine Piserchia; Lori Latimer; William C McGaghie; Danielle M McCarthy Journal: J Grad Med Educ Date: 2020-02