Olivia H Chang1, Louise P King1, Anna M Modest2, Hye-Chun Hur3. 1. Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, Boston, Massachusetts; Departmentof Obstetrics, Gynecology, and Reproductive Biology, Harvard Medical School, Boston, Massachusetts. 2. Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, Boston, Massachusetts. 3. Department of Obstetrics and Gynecology, Beth Israel Deaconess Medical Center, Boston, Massachusetts; Departmentof Obstetrics, Gynecology, and Reproductive Biology, Harvard Medical School, Boston, Massachusetts. Electronic address: hhur@bidmc.harvard.edu.
Abstract
OBJECTIVE: To develop a teaching and assessment tool for laparoscopic suturing and intracorporeal knot tying. DESIGN AND SETTING: We designed an Objective Structured Assessment of Technical Skills (OSATS) tool that includes a procedure-specific checklist (PSC) and global rating scale (GRS) to assess laparoscopic suturing and intracorporeal knot-tying performance. Obstetrics and Gynecology residents at our institution were videotaped while performing a laparoscopic suturing and intracorporeal knot-tying task at a surgical simulation workshop. A total of 2 expert reviewers assessed resident performance using the OSATS tool during live performance and 1 month later using the videotaped recordings. OSATS scores were analyzed using the Wilcoxon rank-sum test. Data are presented as median scores (interquartile range [IQR]). Intrarater and interrater reliabilities were assessed using a Spearman correlation and are presented as an r correlation coefficient and p value. An r ≥ 0.8 was considered as a high correlation. After testing, we received feedback from residents and faculty to improve the OSATS tool as part of an iterative design process. PARTICIPANTS: In all, 14 of 21 residents (66.7%) completed the study, with 9 junior residents and 5 senior residents. RESULTS: Junior residents had a lower score on the PSC than senior residents did; however, this was not statistically significant (median = 6.0 [IQR: 4.0-10.0] and median = 13.0 [IQR: 10.0-13.0]; p = 0.09). There was excellent intrarater reliability with our OSATS tool (for PSC component, r = 0.88 for Rater 1 and 0.93 for Rater 2, both p < 0.0001; for GRS component, r = 0.85 for Rater 1 and 0.88 for Rater 2, both p ≤ 0.0002). The PSC also has high interrater reliability during live evaluation (r = 0.92; p < 0.0001), and during the videotape scoring with r = 0.77 (p = 0.001). CONCLUSIONS: Our OSATS tool may be a useful assessment and teaching tool for laparoscopic suturing and intracorporeal knot-tying skills. Overall, good intrarater reliability was demonstrated, suggesting that this tool may be useful for longitudinal assessment of surgical skills.
OBJECTIVE: To develop a teaching and assessment tool for laparoscopic suturing and intracorporeal knot tying. DESIGN AND SETTING: We designed an Objective Structured Assessment of Technical Skills (OSATS) tool that includes a procedure-specific checklist (PSC) and global rating scale (GRS) to assess laparoscopic suturing and intracorporeal knot-tying performance. Obstetrics and Gynecology residents at our institution were videotaped while performing a laparoscopic suturing and intracorporeal knot-tying task at a surgical simulation workshop. A total of 2 expert reviewers assessed resident performance using the OSATS tool during live performance and 1 month later using the videotaped recordings. OSATS scores were analyzed using the Wilcoxon rank-sum test. Data are presented as median scores (interquartile range [IQR]). Intrarater and interrater reliabilities were assessed using a Spearman correlation and are presented as an r correlation coefficient and p value. An r ≥ 0.8 was considered as a high correlation. After testing, we received feedback from residents and faculty to improve the OSATS tool as part of an iterative design process. PARTICIPANTS: In all, 14 of 21 residents (66.7%) completed the study, with 9 junior residents and 5 senior residents. RESULTS: Junior residents had a lower score on the PSC than senior residents did; however, this was not statistically significant (median = 6.0 [IQR: 4.0-10.0] and median = 13.0 [IQR: 10.0-13.0]; p = 0.09). There was excellent intrarater reliability with our OSATS tool (for PSC component, r = 0.88 for Rater 1 and 0.93 for Rater 2, both p < 0.0001; for GRS component, r = 0.85 for Rater 1 and 0.88 for Rater 2, both p ≤ 0.0002). The PSC also has high interrater reliability during live evaluation (r = 0.92; p < 0.0001), and during the videotape scoring with r = 0.77 (p = 0.001). CONCLUSIONS: Our OSATS tool may be a useful assessment and teaching tool for laparoscopic suturing and intracorporeal knot-tying skills. Overall, good intrarater reliability was demonstrated, suggesting that this tool may be useful for longitudinal assessment of surgical skills.
Authors: Mona W Schmidt; Karl-Friedrich Kowalewski; Sarah M Trent; Laura Benner; Beat P Müller-Stich; Felix Nickel Journal: Surg Endosc Date: 2019-05-28 Impact factor: 4.584
Authors: Javier R De La Garza; Mona W Schmidt; Karl-Friedrich Kowalewski; Laura Benner; Philip C Müller; Hannes G Kenngott; Lars Fischer; Beat P Müller-Stich; Felix Nickel Journal: Surg Endosc Date: 2018-09-12 Impact factor: 4.584
Authors: Karl-Friedrich Kowalewski; Jonathan D Hendrie; Mona W Schmidt; Carly R Garrow; Thomas Bruckner; Tanja Proctor; Sai Paul; Davud Adigüzel; Sebastian Bodenstedt; Andreas Erben; Hannes Kenngott; Young Erben; Stefanie Speidel; Beat P Müller-Stich; Felix Nickel Journal: Surg Endosc Date: 2016-09-07 Impact factor: 4.584
Authors: Karl-Friedrich Kowalewski; Carly R Garrow; Mona W Schmidt; Laura Benner; Beat P Müller-Stich; Felix Nickel Journal: Surg Endosc Date: 2019-02-21 Impact factor: 4.584