Travis P Webb1, Taylor R Merkley. 1. Department of Surgery, Medical College of Wisconsin, Milwaukee, Wisconsin 53226, USA. trwebb@mcw.edu
Abstract
BACKGROUND: Learning portfolios have gained modest acceptance in graduate medical education because of challenges related to user satisfaction, time and resource commitment, and quality assessment. In 2001, the Department of Surgery implemented the Surgical Learning and Instructional Portfolio (SLIP) to help residents develop a case-based portfolio demonstrating practice-based learning. In 2008, the format was changed to a Web-based platform with open viewing of portfolios for all learners. This study was performed to evaluate the SLIP program using resident and faculty perspectives in the domains of satisfaction, compliance, and educational value. METHODS: Likert scale surveys were distributed to residents to assess satisfaction. Using a semistructured format with subsequent qualitative analysis of the meeting transcript, a focus group discussion was held with the SLIP director, SLIP facilitator, and program coordinator. An analysis of the program compliance was performed by review of SLIP entry dates. Finally, the quality of the SLIP entries (n = 420) was analyzed in a blinded manner using a locally developed standardized SLIP assessment tool. Data analysis was performed using Pearson's correlation and Cronbach's alpha. RESULTS: Residents were satisfied with the program and felt the Web-based format promoted self-reflection. They perceived that time spent was appropriate. Residents also believed they gained medical knowledge of their own specific entry topics but did not learn routinely from others' entries. Faculty asserted that the Web-based platform eased the administrative burden but did not necessarily alter the quality of the SLIP entries. Compliance with the assignment was 100%. SLIP entry analysis demonstrated the reflection and understanding of the topics chosen. However, the overall quality assessment of entries was hindered by suboptimal interrater reliability (inter-rater reliability (IR) = 0.636). CONCLUSIONS: The SLIP program allows residents to demonstrate practice-based learning and improvement of medical knowledge. The Web-based format provides transparency and ease of administration. Quality assessment of individual portfolio entries remains a challenge to the widespread adoption of portfolios.
BACKGROUND: Learning portfolios have gained modest acceptance in graduate medical education because of challenges related to user satisfaction, time and resource commitment, and quality assessment. In 2001, the Department of Surgery implemented the Surgical Learning and Instructional Portfolio (SLIP) to help residents develop a case-based portfolio demonstrating practice-based learning. In 2008, the format was changed to a Web-based platform with open viewing of portfolios for all learners. This study was performed to evaluate the SLIP program using resident and faculty perspectives in the domains of satisfaction, compliance, and educational value. METHODS: Likert scale surveys were distributed to residents to assess satisfaction. Using a semistructured format with subsequent qualitative analysis of the meeting transcript, a focus group discussion was held with the SLIP director, SLIP facilitator, and program coordinator. An analysis of the program compliance was performed by review of SLIP entry dates. Finally, the quality of the SLIP entries (n = 420) was analyzed in a blinded manner using a locally developed standardized SLIP assessment tool. Data analysis was performed using Pearson's correlation and Cronbach's alpha. RESULTS: Residents were satisfied with the program and felt the Web-based format promoted self-reflection. They perceived that time spent was appropriate. Residents also believed they gained medical knowledge of their own specific entry topics but did not learn routinely from others' entries. Faculty asserted that the Web-based platform eased the administrative burden but did not necessarily alter the quality of the SLIP entries. Compliance with the assignment was 100%. SLIP entry analysis demonstrated the reflection and understanding of the topics chosen. However, the overall quality assessment of entries was hindered by suboptimal interrater reliability (inter-rater reliability (IR) = 0.636). CONCLUSIONS: The SLIP program allows residents to demonstrate practice-based learning and improvement of medical knowledge. The Web-based format provides transparency and ease of administration. Quality assessment of individual portfolio entries remains a challenge to the widespread adoption of portfolios.
Authors: Rozemarijn van der Gulden; Angelique Timmerman; Jean W M Muris; Bart P A Thoonen; Sylvia Heeneman; Nynke D Scherpbier-de Haan Journal: Perspect Med Educ Date: 2022-09-22
Authors: R van der Gulden; S Heeneman; A W M Kramer; R F J M Laan; N D Scherpbier-de Haan; B P A Thoonen Journal: BMC Med Educ Date: 2020-06-26 Impact factor: 2.463
Authors: Andrew Chu; Dea Biancarelli; Mari-Lynn Drainoni; James H Liu; Jeffrey I Schneider; Ryan Sullivan; Alexander Y Sheng Journal: West J Emerg Med Date: 2019-12-09
Authors: Marloes van Onna; Sofia Ramiro; Catherine Haines; Mette Holland-Fischer; Jose Antonio Pereira da Silva; Jean Dudler; Chris Edwards; Alessia Alunno; Elena Nikiphorou; Louise Falzon; Francisca Sivera Journal: RMD Open Date: 2021-06