Gerald A Isenberg1, Vibin Roy2, Jon Veloski3, Katherine Berg4, Charles J Yeo5. 1. Department of Surgery, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania. Electronic address: Gerald.Isenberg@jefferson.edu. 2. Department of Family and Community Medicine, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania. 3. Department of Psychiatry and Human Behavior, and the Center for Research in Medical Education and Health Care, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania. 4. Department of Medicine, and the University Clinical Skills and Simulation Center, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania. 5. Department of Surgery, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, Pennsylvania.
Abstract
BACKGROUND: The accuracy of self-assessments has not been well supported in the literature. This study was undertaken to examine the validity of medical students' ratings of their proficiency during encounters with simulated patients and simulation devices. METHODS: Confidential self-assessments for 10 skills were collected from 195 students during a formal clinical skills assessment related to 3 cases at the end of a surgery clerkship. The cases required students to gather data from simulated patients and perform procedures such as rectal examinations, nasogastric tube insertions, and suturing on bench simulation models. The patients were trained to assess student performance. RESULTS: There were significant differences between student self-assessments and simulated patient scores for general clinical skills as opposed to procedural skills. Students' mean self-assessments in the data gathering and interpersonal skills were 2-6 % points higher than ratings of their proficiency by simulated patients. However, self-assessments on procedures were 5-8 points lower than patient ratings. The median correlation between self-assessments and patient ratings for general clinical skills such as data gathering and interpersonal skills was 0.08 (not significant), whereas the median correlation between student and patient ratings in procedures was 0.22 (P < 0.01). CONCLUSIONS: Third-year medical students' self-assessments for specific procedures are more valid than self-assessments of general clinical skills. Students are less confident in their procedural skills compared with general clinical skills. Although self-assessments should not be used as the sole measure of performance in clinical simulations, self-assessments for specific procedures can provide supplemental information on proficiency.
BACKGROUND: The accuracy of self-assessments has not been well supported in the literature. This study was undertaken to examine the validity of medical students' ratings of their proficiency during encounters with simulated patients and simulation devices. METHODS: Confidential self-assessments for 10 skills were collected from 195 students during a formal clinical skills assessment related to 3 cases at the end of a surgery clerkship. The cases required students to gather data from simulated patients and perform procedures such as rectal examinations, nasogastric tube insertions, and suturing on bench simulation models. The patients were trained to assess student performance. RESULTS: There were significant differences between student self-assessments and simulated patient scores for general clinical skills as opposed to procedural skills. Students' mean self-assessments in the data gathering and interpersonal skills were 2-6 % points higher than ratings of their proficiency by simulated patients. However, self-assessments on procedures were 5-8 points lower than patient ratings. The median correlation between self-assessments and patient ratings for general clinical skills such as data gathering and interpersonal skills was 0.08 (not significant), whereas the median correlation between student and patient ratings in procedures was 0.22 (P < 0.01). CONCLUSIONS: Third-year medical students' self-assessments for specific procedures are more valid than self-assessments of general clinical skills. Students are less confident in their procedural skills compared with general clinical skills. Although self-assessments should not be used as the sole measure of performance in clinical simulations, self-assessments for specific procedures can provide supplemental information on proficiency.
Authors: Muhammed Elhadi; Hazem Ahmed; Ala Khaled; Wejdan K Almahmoudi; Samah S Atllah; Ahmed Elhadi; Hamida Esahli Journal: BMC Med Educ Date: 2020-09-21 Impact factor: 2.463