INTRODUCTION: Mastery of history taking and physical exam skills is a key competence of medical students. Objective Structured Clinical Examinations are the gold standard to assess these competencies, but their implementation in Portugal is poorly documented. We describe the implementation and our seven years experience with a high-stakes Objective Structured Clinical Examination to assess these skills in the School of Medicine, University of Minho. MATERIAL AND METHODS: Our Objective Structured Clinical Examination is in place since 2010 and has been subject to continuous improvements, including the adoption of a standard setting procedure and an increase in the number of stations. RESULTS: Grades in our exam are well distributed and discriminate among students. History taking grades are lower and have remained stable throughout the years while physical examination scores have risen. The exam is reliable, with internal consistency above 0.45 and a G-coefficient of 0.74. It is also feasible, with a total testing time of approximately 20 hours for 140 students, and the involvement of 18 standardized patients and 18 faculty assessors. More importantly, it was able to engage the students, who recognize its importance. DISCUSSION: The most important validity criterion of our, and any Objective Structured Clinical Examination, would be predictive validity,the ability to predict the performance of students in the clinical context. CONCLUSION: Our approach to a high-stakes Objective Structured Clinical Examination shows that it is feasible, reliable, valid and fair and can be implemented with success in the Portuguese setting.
INTRODUCTION: Mastery of history taking and physical exam skills is a key competence of medical students. Objective Structured Clinical Examinations are the gold standard to assess these competencies, but their implementation in Portugal is poorly documented. We describe the implementation and our seven years experience with a high-stakes Objective Structured Clinical Examination to assess these skills in the School of Medicine, University of Minho. MATERIAL AND METHODS: Our Objective Structured Clinical Examination is in place since 2010 and has been subject to continuous improvements, including the adoption of a standard setting procedure and an increase in the number of stations. RESULTS: Grades in our exam are well distributed and discriminate among students. History taking grades are lower and have remained stable throughout the years while physical examination scores have risen. The exam is reliable, with internal consistency above 0.45 and a G-coefficient of 0.74. It is also feasible, with a total testing time of approximately 20 hours for 140 students, and the involvement of 18 standardized patients and 18 faculty assessors. More importantly, it was able to engage the students, who recognize its importance. DISCUSSION: The most important validity criterion of our, and any Objective Structured Clinical Examination, would be predictive validity,the ability to predict the performance of students in the clinical context. CONCLUSION: Our approach to a high-stakes Objective Structured Clinical Examination shows that it is feasible, reliable, valid and fair and can be implemented with success in the Portuguese setting.
Entities:
Keywords:
Education, Medical, Undergraduate; Educational Measurement; Medical History Taking; Physical Examination; Portugal; Reproducibility of Results
Authors: Ana Margarida Oliveira; Daniel Machado; João B Fonseca; Filipa Palha; Pedro Silva Moreira; Nuno Sousa; João J Cerqueira; Pedro Morgado Journal: Front Psychiatry Date: 2020-04-30 Impact factor: 4.157