Kathleen Hanley1, Colleen Gillespie2, Sondra Zabar1, Jennifer Adams1, Adina Kalet3. 1. Department of Medicine, New York University School of Medicine, New York, USA. 2. Department of Medicine, New York University School of Medicine, New York, USA; Institute for Innovations in Medical Education, New York University School of Medicine, New York, USA. 3. Department of Medicine, New York University School of Medicine, New York, USA. Electronic address: Adina.Kalet@nyumc.org.
Abstract
OBJECTIVE: To provide evidence for the validity of an Introductory Clinical Experience (ICE) that was implemented as a baseline assessment of medical students' clinical communication skills to support progression of skills over time. METHODS: In this longitudinal study of communication skills, medical students completed the ICE, then a Practice of Medicine (POM) Objective Structured Clinical Exam 8 months later, and the Comprehensive Clinical Skills Exam (CCSE) 25 months later. At each experience, trained Standardized Patients assessed students, using the same behaviorally anchored checklist in 3 domains: Information Gathering, Relationship Development, and Patient Education and Counseling (PEC) with good internal reliability (.70-.87). Skills development patterns were described. ICE as a predictor of later performance was explored. Students' perspectives were elicited. RESULTS: 140 (80%) medical students consented to include their data in this study. Overall communication scores increased over time (eta2 = .17, medium effect) mostly attributable to increase in PEC skills (eta2 = .48, large effect), in 4 patterns. ICE and POM scores predicted future communication skills. Most students recognized the educational value of ICE. CONCLUSION: Entering medical students' clinical communication skills increase over time on average and may predict future performance. PRACTICE IMPLICATIONS: Implementing an ICE is likely a valid strategy for monitoring progress and facilitating communication skills development.
OBJECTIVE: To provide evidence for the validity of an Introductory Clinical Experience (ICE) that was implemented as a baseline assessment of medical students' clinical communication skills to support progression of skills over time. METHODS: In this longitudinal study of communication skills, medical students completed the ICE, then a Practice of Medicine (POM) Objective Structured Clinical Exam 8 months later, and the Comprehensive Clinical Skills Exam (CCSE) 25 months later. At each experience, trained Standardized Patients assessed students, using the same behaviorally anchored checklist in 3 domains: Information Gathering, Relationship Development, and Patient Education and Counseling (PEC) with good internal reliability (.70-.87). Skills development patterns were described. ICE as a predictor of later performance was explored. Students' perspectives were elicited. RESULTS: 140 (80%) medical students consented to include their data in this study. Overall communication scores increased over time (eta2 = .17, medium effect) mostly attributable to increase in PEC skills (eta2 = .48, large effect), in 4 patterns. ICE and POM scores predicted future communication skills. Most students recognized the educational value of ICE. CONCLUSION: Entering medical students' clinical communication skills increase over time on average and may predict future performance. PRACTICE IMPLICATIONS: Implementing an ICE is likely a valid strategy for monitoring progress and facilitating communication skills development.
Keywords:
Communication skills; Competency based medical education; Medical students; Progress testing; Progressive mastery; Remediation; Validity evidence