Clinical competence assessment in radiology: introduction of an objective structured clinical examination in the medical school curriculum.

RATIONALE AND
OBJECTIVES: Traditional oral and written examinations can be limited in predicting future clinical performance. Therefore Objective Structured Clinical Examinations (OSCEs) have been introduced in other specialties. The authors assessed their value in radiology.
MATERIALS AND METHODS: The study includes 122 Harvard medical students who undertook 1-month compulsory clerkships at one of three hospitals (A, B, or C) in their 3rd and 4th year and a compulsory OSCE in their 4th year. The OSCE was constructed from five cases. Each had eight or nine standardized questions designed to test, within a set time, the perception of essential findings, their interpretation, and clinical judgment (maximum possible score, 100). Clerkship grades were high honors (score of 3), honors (score of 2), satisfactory (score of 1), and fail (score of 0). Predictors of OSCE scores-clerkship grade and affiliated hospital-were modeled as linear functions. Time elapsed between clerkship and OSCE was modeled as a nonlinear function.
RESULTS: Although there was a positive relation between clerkship grade and OSCE grade, it accounted for an increase of only 5.7% in OSCE score per clerkship grade and did not predict performance of individual students. Students who trained in hospital B showed significantly higher OSCE grades. OSCE scores were highest when the examination was taken 8 months after the clerkship.
CONCLUSION: The OSCE may be useful to uncover deficits in individuals and groups beyond the ones detected with traditional clerkship evaluations and provide guidance for remediation. The improved performance after additional clinical exposure suggests that the OSCE may be well suited to test the integration of radiologic and clinical knowledge.