Benjamin D Gallagher1, Saman Nematollahi2, Henry Park3, Salila Kurra4. 1. Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA. benjamin.gallagher@yale.edu. 2. Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA. 3. Center for Education Research and Evaluation, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA. 4. Department of Medicine, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA.
Abstract
BACKGROUND: Few assessments capture the diagnostic impressions medical students form immediately following patient encounters. However, notes written for objective structured clinical examinations (OSCEs) allow learners to document their clinical reasoning in real time. The University of Illinois at Chicago College of Medicine (UIC-COM) has developed a rubric for scoring patient notes (PNs) in their OSCE for senior students. OBJECTIVE: To validate the UIC-COM PN Scoring Rubric as a measure of clinical reasoning by comparing PN scores from a similar exam at the Columbia University Vagelos College of Physicians and Surgeons (VP&S) to clinical rotation performance. DESIGN: Cross-sectional analysis. PARTICIPANTS: From a total of 146 third-year medical students who completed the OSCE at VP&S in spring 2017, we selected 60 at random, 20 from each tertile of clinical rotation performance. MAIN MEASURES: We scored these students' PNs using the rubric's four sections-Documentation, Differential Diagnosis, Justification, and Workup, each scored from 1 to 4-and calculated a composite score (maximum 100). We used one-way ANOVA to examine differences in scores between clinical rotation performance tertiles. KEY RESULTS: Students in the bottom, middle, and top clinical rotation performance tertiles had mean Documentation scores of 2.54, 2.63, and 2.88, respectively (p = 0.02, bottom vs. top tertile). Mean composite scores were 61.98, 64.05, and 67.86, respectively (p = 0.02, bottom vs. top tertile). CONCLUSIONS: We showed an association between PN scores and clinical rotation performance. Since clinical rotation grades incorporate multiple types of assessments of students' clinical reasoning skills, we believe that this correlation lends validity evidence to using the note-writing task as a measure of clinical reasoning. Future directions include expanding the task to different stages of learners, to real life patient encounters, and to formative rather than summative assessments of note-writing skills.
BACKGROUND: Few assessments capture the diagnostic impressions medical students form immediately following patient encounters. However, notes written for objective structured clinical examinations (OSCEs) allow learners to document their clinical reasoning in real time. The University of Illinois at Chicago College of Medicine (UIC-COM) has developed a rubric for scoring patient notes (PNs) in their OSCE for senior students. OBJECTIVE: To validate the UIC-COM PN Scoring Rubric as a measure of clinical reasoning by comparing PN scores from a similar exam at the Columbia University Vagelos College of Physicians and Surgeons (VP&S) to clinical rotation performance. DESIGN: Cross-sectional analysis. PARTICIPANTS: From a total of 146 third-year medical students who completed the OSCE at VP&S in spring 2017, we selected 60 at random, 20 from each tertile of clinical rotation performance. MAIN MEASURES: We scored these students' PNs using the rubric's four sections-Documentation, Differential Diagnosis, Justification, and Workup, each scored from 1 to 4-and calculated a composite score (maximum 100). We used one-way ANOVA to examine differences in scores between clinical rotation performance tertiles. KEY RESULTS: Students in the bottom, middle, and top clinical rotation performance tertiles had mean Documentation scores of 2.54, 2.63, and 2.88, respectively (p = 0.02, bottom vs. top tertile). Mean composite scores were 61.98, 64.05, and 67.86, respectively (p = 0.02, bottom vs. top tertile). CONCLUSIONS: We showed an association between PN scores and clinical rotation performance. Since clinical rotation grades incorporate multiple types of assessments of students' clinical reasoning skills, we believe that this correlation lends validity evidence to using the note-writing task as a measure of clinical reasoning. Future directions include expanding the task to different stages of learners, to real life patient encounters, and to formative rather than summative assessments of note-writing skills.
Entities:
Keywords:
OSCE; clinical assessment; clinical reasoning; simulation; undergraduate medical education
Authors: Yoon Soo Park; Abbas Hyderi; Georges Bordage; Kuan Xing; Rachel Yudkowsky Journal: Adv Health Sci Educ Theory Pract Date: 2016-01-12 Impact factor: 3.853
Authors: Yoon Soo Park; Abbas Hyderi; Nancy Heine; Win May; Andrew Nevins; Ming Lee; Georges Bordage; Rachel Yudkowsky Journal: Acad Med Date: 2017-11 Impact factor: 6.893
Authors: Yoon Soo Park; Matthew Lineberry; Abbas Hyderi; Georges Bordage; Janet Riddle; Rachel Yudkowsky Journal: Acad Med Date: 2013-10 Impact factor: 6.893