Monica M Cuddy1, Aaron Young, Andrew Gelman, David B Swanson, David A Johnson, Gerard F Dillon, Brian E Clauser. 1. M.M. Cuddy is measurement scientist, Center for Advanced Assessment, National Board of Medical Examiners, Philadelphia, Pennsylvania. A. Young is assistant vice president, Research and Data Integration, Federation of State Medical Boards, Euless, Texas. A. Gelman is professor, Departments of Statistics and Political Science, Columbia University, New York, New York. D.B. Swanson is vice president, Academic Programs and Services, American Board of Medical Specialties, Chicago, Illinois, and professor (honorary appointment), Department of Medical Education, University of Melbourne Medical School, Melbourne, Australia. D.A. Johnson is senior vice president, Assessment Services, Federation of State Medical Boards, Euless, Texas. G.F. Dillon is vice president, Licensure, National Board of Medical Examiners, Philadelphia, Pennsylvania. B.E. Clauser is vice president, Center for Advanced Assessment, National Board of Medical Examiners, Philadelphia, Pennsylvania.
Abstract
PURPOSE: Physicians must pass the United States Medical Licensing Examination (USMLE) to obtain an unrestricted license to practice allopathic medicine in the United States. Little is known, however, about how well USMLE performance relates to physician behavior in practice, particularly conduct inconsistent with safe, effective patient care. The authors examined the extent to which USMLE scores relate to the odds of receiving a disciplinary action from a U.S. state medical board. METHOD: Controlling for multiple factors, the authors used non-nested multilevel logistic regression analyses to estimate the relationships between scores and receiving an action. The sample included 164,725 physicians who graduated from U.S. MD-granting medical schools between 1994 and 2006. RESULTS: Physicians had a mean Step 1 score of 214 (standard deviation [SD] = 21) and a mean Step 2 Clinical Knowledge (CK) score of 213 (SD = 23). Of the physicians, 2,205 (1.3%) received at least one action. Physicians with higher Step 2 CK scores had lower odds of receiving an action. A 1-SD increase in Step 2 CK scores corresponded to a decrease in the chance of disciplinary action by roughly 25% (odds ratio = 0.75; 95% CI = 0.70-0.80). After accounting for Step 2 CK scores, Step 1 scores were unrelated to the odds of receiving an action. CONCLUSIONS: USMLE Step 2 CK scores provide useful information about the odds a physician will receive an official sanction for problematic practice behavior. These results provide validity evidence supporting current interpretation and use of Step 2 CK scores.
PURPOSE: Physicians must pass the United States Medical Licensing Examination (USMLE) to obtain an unrestricted license to practice allopathic medicine in the United States. Little is known, however, about how well USMLE performance relates to physician behavior in practice, particularly conduct inconsistent with safe, effective patient care. The authors examined the extent to which USMLE scores relate to the odds of receiving a disciplinary action from a U.S. state medical board. METHOD: Controlling for multiple factors, the authors used non-nested multilevel logistic regression analyses to estimate the relationships between scores and receiving an action. The sample included 164,725 physicians who graduated from U.S. MD-granting medical schools between 1994 and 2006. RESULTS: Physicians had a mean Step 1 score of 214 (standard deviation [SD] = 21) and a mean Step 2 Clinical Knowledge (CK) score of 213 (SD = 23). Of the physicians, 2,205 (1.3%) received at least one action. Physicians with higher Step 2 CK scores had lower odds of receiving an action. A 1-SD increase in Step 2 CK scores corresponded to a decrease in the chance of disciplinary action by roughly 25% (odds ratio = 0.75; 95% CI = 0.70-0.80). After accounting for Step 2 CK scores, Step 1 scores were unrelated to the odds of receiving an action. CONCLUSIONS: USMLE Step 2 CK scores provide useful information about the odds a physician will receive an official sanction for problematic practice behavior. These results provide validity evidence supporting current interpretation and use of Step 2 CK scores.
Authors: Daniel Jurich; Sally A Santen; Miguel Paniagua; Amy Fleming; Victoria Harnik; Arnyce Pock; Aubrie Swan-Sein; Michael A Barone; Michelle Daniel Journal: Acad Med Date: 2020-01 Impact factor: 6.893
Authors: Furman S McDonald; Lauren M Duhigg; Gerald K Arnold; Ruth M Hafer; Rebecca S Lipner Journal: J Gen Intern Med Date: 2018-03-07 Impact factor: 5.128
Authors: Jason P Kopp; Beatriz Ibáñez; Andrew T Jones; Xiaomei Pei; Aaron Young; Katie Arnhart; Anne G Rizzo; Jo Buyske Journal: JAMA Surg Date: 2020-05-20 Impact factor: 14.766
Authors: Adam M Garber; Brian Kwan; Christopher M Williams; Steven V Angus; T Robert Vu; Matthew Hollon; Marty Muntz; Arlene Weissman; Anne Pereira Journal: J Grad Med Educ Date: 2019-12
Authors: Frederick Mun; Alyssa R Scott; David Cui; Alia Chisty; William L Hennrikus; Eileen F Hennrikus Journal: Medicine (Baltimore) Date: 2021-04-16 Impact factor: 1.889
Authors: Stanley J Hamstra; Monica M Cuddy; Daniel Jurich; Kenji Yamazaki; John Burkhardt; Eric S Holmboe; Michael A Barone; Sally A Santen Journal: Acad Med Date: 2021-09-01 Impact factor: 7.840
Authors: Ali Rahil; Tahseen Hamamyh; Ahmed Al-Mohammed; Antoun Kamel; Ibrahim Abubeker; Laith Abu-Raddad; Soha Dargham; Shireen Suliman; Dabia Al Mohanadi; Abdulatif Al Khal Journal: Qatar Med J Date: 2021-06-21