Elena Tunitsky-Bitton1, Katie Propst2, Tyler Muffly3. 1. Division of Female Pelvic Medicine and Reconstructive Surgery, Department of Obstetrics and Gynecology, Hartford Hospital, Hartford, CT. 2. Division of Female Pelvic Medicine and Reconstructive Surgery, Department of Obstetrics and Gynecology, Hartford Hospital, Hartford, CT. Electronic address: katie.propst@hhchealth.org. 3. Division of Female Pelvic Medicine and Reconstructive Surgery, Department of Obstetrics and Gynecology, University of Colorado Anschutz Medical Campus, Aurora, CO.
Abstract
BACKGROUND: The number of robotically assisted hysterectomies is increasing, and therefore, the opportunities for trainees to become competent in performing traditional laparoscopic hysterectomy are decreasing. Simulation-based training is ideal for filling this gap in training. OBJECTIVE: The objective of the study was to design a surgical model for training in laparoscopic vaginal cuff closure and to present evidence of its validity and reliability as an assessment and training tool. STUDY DESIGN: Participants included gynecology staff and trainees at 2 tertiary care centers. Experienced surgeons were also recruited at the combined International Urogynecologic Association and American Urogynecologic Society scientific meeting. Participants included 19 experts and 21 trainees. All participants were recorded using the laparoscopic hysterectomy cuff closure simulation model. The model was constructed using the an advanced uterine manipulation system with a sacrocolopexy tip/vaginal stent, a vaginal cuff constructed from neoprene material and lined with a swimsuit material (nylon and spandex) secured to the vaginal stent with a plastic cable tie. The uterine manipulation system was attached to the fundamentals of laparoscopic surgery laparoscopic training box trainer using a metal bracket. Performance was evaluated using the Global Operative Assessment of Laparoscopic Skills scale. In addition, needle handling, knot tying, and incorporation of epithelial edge were also evaluated. The Student t test was used to compare the scores and the operating times between the groups. Intrarater reliability between the scores by the 2 masked experts was measured using the interclass correlation coefficient. RESULTS: Total and annual experience with laparoscopic suturing and specifically vaginal cuff closure varied greatly among the participants. For the construct validity, the participants in the expert group received significantly higher scores in each of the domains of the Global Operative Assessment of Laparoscopic Skills Scale and for each of the 3 added items than did the trainees. The median total Global Operative Assessment of Laparoscopic Skills Scale score (maximum 20) for the experts was 18.8 (range, 11-20), whereas the median total Global Operative Assessment of Laparoscopic Skills Scale score for the trainees was 10 (range, 8-18) (P = .001). The overall score that included the 3 new domains (maximum 35) was 33 (range, 18-35) for the experts and 17.5 (range, 14-31.5) for trainees (P = .001). For the face validity testing, the majority of the study participants (32 [85%]) agreed or strongly agreed that the model is realistic and all participants agreed or strongly agreed that the model appears to be useful for improving technique required for this task. For the interrater reliability, the scores assigned by each observer had an interclass correlation coefficient of 0.8 (95% confidence interval, 0.7-0.93). CONCLUSION: This model is easily constructed and has an acceptable cost. We have demonstrated evidence of construct validity. This is a valuable education tool that can serve to improve skills, which are essential to the gynecological surgeon but are often lacking in residency training because of national changes in practice patterns.
BACKGROUND: The number of robotically assisted hysterectomies is increasing, and therefore, the opportunities for trainees to become competent in performing traditional laparoscopic hysterectomy are decreasing. Simulation-based training is ideal for filling this gap in training. OBJECTIVE: The objective of the study was to design a surgical model for training in laparoscopic vaginal cuff closure and to present evidence of its validity and reliability as an assessment and training tool. STUDY DESIGN:Participants included gynecology staff and trainees at 2 tertiary care centers. Experienced surgeons were also recruited at the combined International Urogynecologic Association and American Urogynecologic Society scientific meeting. Participants included 19 experts and 21 trainees. All participants were recorded using the laparoscopic hysterectomy cuff closure simulation model. The model was constructed using the an advanced uterine manipulation system with a sacrocolopexy tip/vaginal stent, a vaginal cuff constructed from neoprene material and lined with a swimsuit material (nylon and spandex) secured to the vaginal stent with a plastic cable tie. The uterine manipulation system was attached to the fundamentals of laparoscopic surgery laparoscopic training box trainer using a metal bracket. Performance was evaluated using the Global Operative Assessment of Laparoscopic Skills scale. In addition, needle handling, knot tying, and incorporation of epithelial edge were also evaluated. The Student t test was used to compare the scores and the operating times between the groups. Intrarater reliability between the scores by the 2 masked experts was measured using the interclass correlation coefficient. RESULTS: Total and annual experience with laparoscopic suturing and specifically vaginal cuff closure varied greatly among the participants. For the construct validity, the participants in the expert group received significantly higher scores in each of the domains of the Global Operative Assessment of Laparoscopic Skills Scale and for each of the 3 added items than did the trainees. The median total Global Operative Assessment of Laparoscopic Skills Scale score (maximum 20) for the experts was 18.8 (range, 11-20), whereas the median total Global Operative Assessment of Laparoscopic Skills Scale score for the trainees was 10 (range, 8-18) (P = .001). The overall score that included the 3 new domains (maximum 35) was 33 (range, 18-35) for the experts and 17.5 (range, 14-31.5) for trainees (P = .001). For the face validity testing, the majority of the study participants (32 [85%]) agreed or strongly agreed that the model is realistic and all participants agreed or strongly agreed that the model appears to be useful for improving technique required for this task. For the interrater reliability, the scores assigned by each observer had an interclass correlation coefficient of 0.8 (95% confidence interval, 0.7-0.93). CONCLUSION: This model is easily constructed and has an acceptable cost. We have demonstrated evidence of construct validity. This is a valuable education tool that can serve to improve skills, which are essential to the gynecological surgeon but are often lacking in residency training because of national changes in practice patterns.