BACKGROUND: The aims of this study are to determine construct validity for the HystSim virtual-reality (VR) training simulator for hysteroscopy via a new multimetric scoring system (MMSS) and to explore learning curves for both novices and experienced surgeons. METHODS: Fifteen relevant metrics had been identified for diagnostic hysteroscopy by means of hierarchical task decomposition. They were grouped into four modules (visualization, ergonomics, safety, and fluid handling) and individually weighted, building the MMSS for this study. In a first step, 24 novice medical students and 12 experienced gynecologists went through a self-paced teaching tutorial, in which all participants received clearly stated goals and instructions on how to carry out hysteroscopic procedures properly for this study. All subjects performed five repeated trials on two different exercises on HystSim (exploration and diagnosis exercises). After each trial the results were presented to the participants in the form of an automated objective feedback report (AOFR). Construct validity for the MMSS and learning curves were investigated by comparing the performance between novices and experienced surgeons and in between the repeated trials. To study the effect of repeated practice, 23 of the novices returned 2 weeks later for a second training session. RESULTS: Comparing novices with the experienced group, the ergonomics and fluid handling modules resulted in construct validity, while the visualization module did not, and for the safety module the experienced group even scored significantly lower than novices in both exercises. The overall score showed only construct validity when the safety module was excluded. Concerning learning curves, all subjects improved significantly during the training on HystSim, with clear indication that the second training session was beneficial for novice surgeons. CONCLUSIONS: Construct validity for HystSim has been established for different modules of VR metrics on a new MMSS developed for diagnostic hysteroscopy. Careful refinement and further testing of metrics and scores is required before using them as assessment tools for operative skills.
BACKGROUND: The aims of this study are to determine construct validity for the HystSim virtual-reality (VR) training simulator for hysteroscopy via a new multimetric scoring system (MMSS) and to explore learning curves for both novices and experienced surgeons. METHODS: Fifteen relevant metrics had been identified for diagnostic hysteroscopy by means of hierarchical task decomposition. They were grouped into four modules (visualization, ergonomics, safety, and fluid handling) and individually weighted, building the MMSS for this study. In a first step, 24 novice medical students and 12 experienced gynecologists went through a self-paced teaching tutorial, in which all participants received clearly stated goals and instructions on how to carry out hysteroscopic procedures properly for this study. All subjects performed five repeated trials on two different exercises on HystSim (exploration and diagnosis exercises). After each trial the results were presented to the participants in the form of an automated objective feedback report (AOFR). Construct validity for the MMSS and learning curves were investigated by comparing the performance between novices and experienced surgeons and in between the repeated trials. To study the effect of repeated practice, 23 of the novices returned 2 weeks later for a second training session. RESULTS: Comparing novices with the experienced group, the ergonomics and fluid handling modules resulted in construct validity, while the visualization module did not, and for the safety module the experienced group even scored significantly lower than novices in both exercises. The overall score showed only construct validity when the safety module was excluded. Concerning learning curves, all subjects improved significantly during the training on HystSim, with clear indication that the second training session was beneficial for novice surgeons. CONCLUSIONS: Construct validity for HystSim has been established for different modules of VR metrics on a new MMSS developed for diagnostic hysteroscopy. Careful refinement and further testing of metrics and scores is required before using them as assessment tools for operative skills.
Authors: Neal E Seymour; Anthony G Gallagher; Sanziana A Roman; Michael K O'Brien; Vipin K Bansal; Dana K Andersen; Richard M Satava Journal: Ann Surg Date: 2002-10 Impact factor: 12.969
Authors: F J Carter; M P Schijven; R Aggarwal; T Grantcharov; N K Francis; G B Hanna; J J Jakimowicz Journal: Surg Endosc Date: 2005-10-26 Impact factor: 4.584
Authors: Rajesh Aggarwal; Teodor P Grantcharov; Jens R Eriksen; Dorthe Blirup; Viggo B Kristiansen; Peter Funch-Jensen; Ara Darzi Journal: Ann Surg Date: 2006-08 Impact factor: 12.969
Authors: Geoffrey R Wignall; John D Denstedt; Glenn M Preminger; Jeffrey A Cadeddu; Margaret S Pearle; Robert M Sweet; Elspeth M McDougall Journal: J Urol Date: 2008-03-17 Impact factor: 7.450
Authors: Jason Park; Helen MacRae; Laura J Musselman; Peter Rossos; Stanley J Hamstra; Stephen Wolman; Richard K Reznick Journal: Am J Surg Date: 2007-08 Impact factor: 2.565
Authors: Pierre Panel; Michael Bajka; Arnaud Le Tohic; Alaa El Ghoneimi; Carmen Chis; Stéphane Cotin Journal: Surg Endosc Date: 2012-01-11 Impact factor: 4.584
Authors: Stefan Rahm; Marco Germann; Andreas Hingsammer; Karl Wieser; Christian Gerber Journal: Knee Surg Sports Traumatol Arthrosc Date: 2016-02-09 Impact factor: 4.342
Authors: Jonathan R Kusins; Jason A Strelzow; Marie-Eve LeBel; Louis M Ferreira Journal: Int J Comput Assist Radiol Surg Date: 2018-03-17 Impact factor: 2.924
Authors: Felix Neis; Sara Brucker; Melanie Henes; F Andrei Taran; Sascha Hoffmann; Markus Wallwiener; Birgitt Schönfisch; Nicole Ziegler; Angelika Larbig; Rudy Leon De Wilde Journal: Surg Endosc Date: 2016-03-09 Impact factor: 4.584
Authors: Sandro F Fucentese; Stefan Rahm; Karl Wieser; Jonas Spillmann; Matthias Harders; Peter P Koch Journal: Knee Surg Sports Traumatol Arthrosc Date: 2014-02-12 Impact factor: 4.342
Authors: Nicholas Gélinas-Phaneuf; Nusrat Choudhury; Ahmed R Al-Habib; Anne Cabral; Etienne Nadeau; Vincent Mora; Valerie Pazos; Patricia Debergue; Robert DiRaddo; Rolando F Del Maestro Journal: Int J Comput Assist Radiol Surg Date: 2013-06-20 Impact factor: 2.924