BACKGROUND: Clinical performance examinations (CPX) with standardized patients (SPs) have become a preferred method to assess communication skills in US medical schools. Little is known about how trainees' backgrounds impact CPX performance. OBJECTIVE: The objective of this paper is to examine the impact of student ethnicity, primary childhood language, and experience of diversity on the communication scores of a high-stakes CPX using SPs. DESIGN: This research was designed as an observational study. PARTICIPANTS: The participants of this study were third-year medical students at one US medical school. MEASUREMENTS AND MAIN RESULTS: The measurements used in this study were CPX scores from mandatory exam, student demographics and experience with diversity measured by self-report on a survey, and Medical College Admission Test (MCAT) and United States Medical Licensing Examination (USMLE) scores. A total of 135 students participated. Asian and black students scored lower than white students on the communication portion of the CPX by approximately half a standard deviation (Asian, 67.4%; black, 64.4%; white, 69.4%, p < .05). There were no differences by ethnicity on history/physical exam scores. Multivariate analysis controlling for MCAT verbal scores reduced ethnic differences in communication scores (Asian-white mean differences = 1.95, p = 0.02), but Asian-white differences were eliminated only after sequential models included primary childhood language (difference = 0.57, p = 0.6). CONCLUSIONS: Even after controlling for English language knowledge as measured in MCAT verbal scores, speaking a primary childhood language other than English is associated with lower CPX communication scores for Asian students. While poorer communication skills cannot be ruled out, SP exams may contain measurement bias associated with differences in childhood language or culture. Caution is indicated when interpreting CPX communication scores among diverse examinees.
BACKGROUND: Clinical performance examinations (CPX) with standardized patients (SPs) have become a preferred method to assess communication skills in US medical schools. Little is known about how trainees' backgrounds impact CPX performance. OBJECTIVE: The objective of this paper is to examine the impact of student ethnicity, primary childhood language, and experience of diversity on the communication scores of a high-stakes CPX using SPs. DESIGN: This research was designed as an observational study. PARTICIPANTS: The participants of this study were third-year medical students at one US medical school. MEASUREMENTS AND MAIN RESULTS: The measurements used in this study were CPX scores from mandatory exam, student demographics and experience with diversity measured by self-report on a survey, and Medical College Admission Test (MCAT) and United States Medical Licensing Examination (USMLE) scores. A total of 135 students participated. Asian and black students scored lower than white students on the communication portion of the CPX by approximately half a standard deviation (Asian, 67.4%; black, 64.4%; white, 69.4%, p < .05). There were no differences by ethnicity on history/physical exam scores. Multivariate analysis controlling for MCAT verbal scores reduced ethnic differences in communication scores (Asian-white mean differences = 1.95, p = 0.02), but Asian-white differences were eliminated only after sequential models included primary childhood language (difference = 0.57, p = 0.6). CONCLUSIONS: Even after controlling for English language knowledge as measured in MCAT verbal scores, speaking a primary childhood language other than English is associated with lower CPX communication scores for Asian students. While poorer communication skills cannot be ruled out, SP exams may contain measurement bias associated with differences in childhood language or culture. Caution is indicated when interpreting CPX communication scores among diverse examinees.
Authors: George W Saba; Sabrina T Wong; Dean Schillinger; Alicia Fernandez; Carol P Somkin; Clifford C Wilson; Kevin Grumbach Journal: Ann Fam Med Date: 2006 Jan-Feb Impact factor: 5.166
Authors: Lisa A Cooper; Debra L Roter; Rachel L Johnson; Daniel E Ford; Donald M Steinwachs; Neil R Powe Journal: Ann Intern Med Date: 2003-12-02 Impact factor: 25.391
Authors: Adam L Wendling; Shivashankar Halan; Patrick Tighe; Linda Le; Tammy Euliano; Benjamin Lok Journal: Acad Med Date: 2011-03 Impact factor: 6.893
Authors: C Anthony Ryan; Nuala Walshe; Robert Gaffney; Andrew Shanks; Louise Burgoyne; Connie M Wiskin Journal: BMC Med Educ Date: 2010-03-17 Impact factor: 2.463
Authors: Paul L Simpson; Helen A Scicluna; Philip D Jones; Andrew M D Cole; Anthony J O'Sullivan; Peter G Harris; Gary Velan; H Patrick McNeil Journal: BMC Med Educ Date: 2014-04-23 Impact factor: 2.463
Authors: Desiree Lie; John Boker; Sylvia Bereknyei; Susan Ahearn; Charlotte Fesko; Patricia Lenahan Journal: J Gen Intern Med Date: 2007-11 Impact factor: 5.128