Mona M Savran1, Anders Bo Nielsen2, Bente Baekholm Poulsen3, Poul Bak Thorsen4, Lars Konge2,5. 1. Department of Obstetrics and Gynecology, Copenhagen University Hospital Amager and Hvidovre, Kettegård Alle 30, 2650, Hvidovre, Capital Region of Denmark, Denmark. monasavran@gmail.com. 2. SimC, Odense University Hospital, Odense, Region of Southern Denmark, Denmark. 3. Department of Obstetrics and Gynecology, Odense University Hospital, Odense, Region of Southern Denmark, Denmark. 4. Research Unit for Gynecology and Obstetrics, Department of Clinical Research, University of Southern Denmark, Odense, Denmark. 5. Center for HR, Copenhagen Academy for Medical Education and Simulation (CAMES), Copenhagen, Capital Region of Denmark, Denmark.
Abstract
BACKGROUND: Hysteroscopy is a technically challenging procedure. Specialty curricula of obstetrics and gynaecology appraise hysteroscopy for trainees but there is no present evidence-based training program that certifies the fundamental technical skills before performance on patients. The objectives of this study were to develop and gather validity evidence for a simulation-based test that can ensure basic competence in hysteroscopy. METHODS: We used the virtual-reality simulator HystMentor™. Six experts evaluated the feasibility and clinical relevance of the simulator modules. Six modules were selected for the test and a pilot study was carried out. Subsequently, medical students, residents, and experienced gynaecologists were enrolled for testing. Outcomes were based on generated simulator metrics. Validity evidence was explored for all five sources of evidence (content, response process, internal structure, relations to other variables, consequences of testing). RESULTS: Inter-case reliability was high for four out of five metrics (Cronbach's alpha ≥ 0.80). Significant differences were identified when comparing the three groups' performances (p values < 0.05). Participants' clinical experience was significantly correlated to their simulator test score (Pearson's r = 0.49, p < 0.001). A single medical student managed to achieve the established pass/fail score (6.7% false positive) and three experienced gynaecologists failed the test (27.3% false negative). CONCLUSIONS: We developed a virtual-reality simulation-based test in hysteroscopy with supporting validity evidence. The test is intended to ensure competency in a mastery learning program where trainees practise on the simulator until they are able to pass before they proceed to supervised training on patients.
BACKGROUND: Hysteroscopy is a technically challenging procedure. Specialty curricula of obstetrics and gynaecology appraise hysteroscopy for trainees but there is no present evidence-based training program that certifies the fundamental technical skills before performance on patients. The objectives of this study were to develop and gather validity evidence for a simulation-based test that can ensure basic competence in hysteroscopy. METHODS: We used the virtual-reality simulator HystMentor™. Six experts evaluated the feasibility and clinical relevance of the simulator modules. Six modules were selected for the test and a pilot study was carried out. Subsequently, medical students, residents, and experienced gynaecologists were enrolled for testing. Outcomes were based on generated simulator metrics. Validity evidence was explored for all five sources of evidence (content, response process, internal structure, relations to other variables, consequences of testing). RESULTS: Inter-case reliability was high for four out of five metrics (Cronbach's alpha ≥ 0.80). Significant differences were identified when comparing the three groups' performances (p values < 0.05). Participants' clinical experience was significantly correlated to their simulator test score (Pearson's r = 0.49, p < 0.001). A single medical student managed to achieve the established pass/fail score (6.7% false positive) and three experienced gynaecologists failed the test (27.3% false negative). CONCLUSIONS: We developed a virtual-reality simulation-based test in hysteroscopy with supporting validity evidence. The test is intended to ensure competency in a mastery learning program where trainees practise on the simulator until they are able to pass before they proceed to supervised training on patients.
Authors: Elaine R Cohen; William C McGaghie; Diane B Wayne; Matthew Lineberry; Rachel Yudkowsky; Jeffrey H Barsuk Journal: Acad Med Date: 2015-11 Impact factor: 6.893
Authors: Nanna Jo Borgersen; Therese M H Naur; Stine M D Sørensen; Flemming Bjerrum; Lars Konge; Yousif Subhi; Ann Sofia S Thomsen Journal: Ann Surg Date: 2018-06 Impact factor: 12.969
Authors: David A Cook; Rose Hatala; Ryan Brydges; Benjamin Zendejas; Jason H Szostek; Amy T Wang; Patricia J Erwin; Stanley J Hamstra Journal: JAMA Date: 2011-09-07 Impact factor: 56.272
Authors: Malcolm G Munro; Arnold P Advincula; Erika H Banks; Tamika C Auguste; E Britton Chahine; Chi Chiung Grace Chen; Howard L Curlin; Elisa M Jorgensen; Jin Hee Kim; Cara R King; Joelle Lucas; Magdy P Milad; Jamal Mourad; Matthew T Siedhoff; M Jonathon Solnik; Christopher C Destephano; Kim Thayn Journal: Obstet Gynecol Date: 2020-07 Impact factor: 7.623