Kathleen Z Holtzman1, David B Swanson, Wenli Ouyang, Gerard F Dillon, John R Boulet. 1. Ms. Holtzman is director, Assessment and International Operations, American Board of Medical Specialties, Chicago, Illinois. Dr. Swanson is vice president, Assessment Programs Unit, National Board of Medical Examiners, Philadelphia, Pennsylvania. Ms. Ouyang is measurement analyst, Measurement Consulting Services Unit, National Board of Medical Examiners, Philadelphia, Pennsylvania. Dr. Dillon is vice president, Assessment Programs Unit, National Board of Medical Examiners, Philadelphia, Pennsylvania. Dr. Boulet is associate vice president, Research and Data Resources, Foundation for Advancement of International Medical Education and Research, Philadelphia, Pennsylvania.
Abstract
PURPOSE: To investigate country-to-country variation in performance across clinical science disciplines and tasks for examinees taking the Step 2 Clinical Knowledge (CK) component of the United States Medical Licensing Examination. METHOD: In 2012 the authors analyzed demographic characteristics, total scores, and percent-correct clinical science discipline and task scores for more than 88,500 examinees taking Step 2 CK for the first time during the 2008-2010 academic years. For each examinee and score, differences between the score and the mean performance of examinees at U.S. MD-granting medical schools were calculated, and mean differences by country of medical school were tabulated for analysis of country-to-country variation in performance by clinical discipline and task. RESULTS: Controlling for overall performance relative to U.S. examinees, results showed that international medical graduates (IMGs) performed best in Surgery and worst in Psychiatry for clinical discipline scores; for clinical tasks, IMGs performed best in Understanding Mechanisms of Disease and worst in Promoting Preventive Medicine and Health Maintenance. The pattern of results was strongest for IMGs attending schools in the Middle East and Australasia, present to a lesser degree for IMGs attending schools in Europe, and absent for IMGs attending Caribbean medical schools. CONCLUSIONS: Country-to-country differences in relative performance were present for both clinical discipline and task scores. Possible explanations include differences in learning outcomes, curriculum emphasis and clinical experience, standards of care, and culture, as well as the effects of English as a second language and relative emphasis on preparing students to take the Step 2 CK exam.
PURPOSE: To investigate country-to-country variation in performance across clinical science disciplines and tasks for examinees taking the Step 2 Clinical Knowledge (CK) component of the United States Medical Licensing Examination. METHOD: In 2012 the authors analyzed demographic characteristics, total scores, and percent-correct clinical science discipline and task scores for more than 88,500 examinees taking Step 2 CK for the first time during the 2008-2010 academic years. For each examinee and score, differences between the score and the mean performance of examinees at U.S. MD-granting medical schools were calculated, and mean differences by country of medical school were tabulated for analysis of country-to-country variation in performance by clinical discipline and task. RESULTS: Controlling for overall performance relative to U.S. examinees, results showed that international medical graduates (IMGs) performed best in Surgery and worst in Psychiatry for clinical discipline scores; for clinical tasks, IMGs performed best in Understanding Mechanisms of Disease and worst in Promoting Preventive Medicine and Health Maintenance. The pattern of results was strongest for IMGs attending schools in the Middle East and Australasia, present to a lesser degree for IMGs attending schools in Europe, and absent for IMGs attending Caribbean medical schools. CONCLUSIONS: Country-to-country differences in relative performance were present for both clinical discipline and task scores. Possible explanations include differences in learning outcomes, curriculum emphasis and clinical experience, standards of care, and culture, as well as the effects of English as a second language and relative emphasis on preparing students to take the Step 2 CK exam.
Authors: Smita Ghosh; Bruce B Struminger; Neeta Singla; Brenna M Roth; Anil Kumar; Sunil Anand; Emmanuel Mtete; Jacob Lusekelo; Irene Massawe; Elizabeth Jarpe-Ratner; Steven M Seweryn; Kris Risley; Patrick K Moonan; Eve Pinsker Journal: Eval Program Plann Date: 2022-03-10
Authors: Tristan Price; Nick Lynn; Lee Coombes; Martin Roberts; Tom Gale; Sam Regan de Bere; Julian Archer Journal: Int J Health Policy Manag Date: 2018-09-01
Authors: Julian Archer; Nick Lynn; Lee Coombes; Martin Roberts; Tom Gale; Tristan Price; Sam Regan de Bere Journal: BMC Med Educ Date: 2016-08-19 Impact factor: 2.463