Nergiz Ercil Cagiltay1, Erol Ozcelik2, Gokhan Sengul3, Mustafa Berker4. 1. Department of Software Engineering, Faculty of Engineering, Atilim University, Ankara, Turkey. necagiltay@gmail.com. 2. Department of Psychology, Faculty of Arts and Sciences, Çankaya University, Ankara, Turkey. 3. Department of Computer Engineering, Faculty of Engineering, Atilim University, Ankara, Turkey. 4. Department of Neurosurgery, Faculty of Medicine, Hacettepe University, Ankara, Turkey.
Abstract
BACKGROUND: In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. METHODS: A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. RESULTS: The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.
BACKGROUND: In neurosurgery education, there is a paradigm shift from time-based training to criterion-based model for which competency and assessment becomes very critical. Even virtual reality simulators provide alternatives to improve education and assessment in neurosurgery programs and allow for several objective assessment measures, there are not many tools for assessing the overall performance of trainees. This study aims to develop and validate a tool for assessing the overall performance of participants in a simulation-based endoneurosurgery training environment. METHODS: A training program was developed in two levels: endoscopy practice and beginning surgical practice based on four scenarios. Then, three experiments were conducted with three corresponding groups of participants (Experiment 1, 45 (32 beginners, 13 experienced), Experiment 2, 53 (40 beginners, 13 experienced), and Experiment 3, 26 (14 novices, 12 intermediate) participants). The results analyzed to understand the common factors among the performance measurements of these experiments. Then, a factor capable of assessing the overall skill levels of surgical residents was extracted. Afterwards, the proposed measure was tested to estimate the experience levels of the participants. Finally, the level of realism of these educational scenarios was assessed. RESULTS: The factor formed by time, distance, and accuracy on simulated tasks provided an overall performance indicator. The prediction correctness was very high for the beginners than the one for experienced surgeons in Experiments 1 and 2. When non-dominant hand is used in a surgical procedure-based scenario, skill levels of surgeons can be better predicted. The results indicate that the scenarios in Experiments 1 and 2 can be used as an assessment tool for the beginners, and scenario-2 in Experiment 3 can be used as an assessment tool for intermediate and novice levels. It can be concluded that forming the balance between perceived action capacities and skills is critical for better designing and developing skill assessment surgical simulation tools.
Authors: Iman Ghaderi; Farouq Manji; Yoon Soo Park; Dorthea Juul; Michael Ott; Ilene Harris; Timothy M Farrell Journal: Ann Surg Date: 2015-02 Impact factor: 12.969
Authors: Justin D Rivard; Ashley S Vergis; Bertram J Unger; Krista M Hardy; Chris G Andrew; Lawrence M Gillman; Jason Park Journal: Surg Endosc Date: 2014-01-18 Impact factor: 4.584
Authors: Matthew A Kirkman; Maria Ahmed; Angelique F Albert; Mark H Wilson; Dipankar Nandi; Nick Sevdalis Journal: J Neurosurg Date: 2014-06-20 Impact factor: 5.115