Marianne Hollensteiner1, Michael Malek2, Peter Augat3, David Fürst4, Falk Schrödl5, Stefan Hunger2, Benjamin Esterer6, Stefan Gabauer4, Andreas Schrempf4. 1. Research Group for Surgical Simulators Linz, Upper Austria University of Applied Sciences, Garnisonstr. 21, 4020 Linz, Austria; Institute of Biomechanics, BGU Trauma Clinic Murnau and Paracelsus Medical University Salzburg, Murnau, Prof. Küntscher-Str.8, 82418 Murnau am Staffelsee, Germany. Electronic address: marianne.hollensteiner@jh-linz.at. 2. Department of Crania-Maxillofacial Surgery, Kepler University Clinic, Krankenhausstr.2, 4020 Linz, Austria. 3. Institute of Biomechanics, BGU Trauma Clinic Murnau and Paracelsus Medical University Salzburg, Murnau, Prof. Küntscher-Str.8, 82418 Murnau am Staffelsee, Germany. 4. Research Group for Surgical Simulators Linz, Upper Austria University of Applied Sciences, Garnisonstr. 21, 4020 Linz, Austria. 5. Institute of Anatomy, Paracelsus Medical University Salzburg, Strubergasse 21, 5020 Salzburg, Austria. 6. Research Group for Surgical Simulators Linz, Upper Austria University of Applied Sciences, Garnisonstr. 21, 4020 Linz, Austria; Institute of Biomechanics, BGU Trauma Clinic Murnau and Paracelsus Medical University Salzburg, Murnau, Prof. Küntscher-Str.8, 82418 Murnau am Staffelsee, Germany.
Abstract
PURPOSE: Surgical skills can be improved through practical exercise. The use of specimens, human as well as animal, or live animals for surgical training is limited due to ethical concerns. Drawbacks of simulators are costs, fidelity and creditibility. Thus, simulators must be evaluated objectively to determine their validity before they can be used as teaching modalities. The aim of this study was to verify the face content and construct validity of a novel model-based simulator for lifting tabula externa transplants from the parietal skull. MATERIALS AND METHODS: Participants were invited to perform a tabula externa graft lift during a training session on the simulator. Task performance was analyzed with a standardized assessment tool evaluating realism and appropriateness. Specialist ratings were used to evaluate the performance of the participants. This was an exploratory study using a questionnaire, at Kepler University Hospital, Linz, Austria, a university hospital. According to their expertise in craniomaxillofacial surgery, 17 participants were subdivided into 3 groups: 8 novices, 7 experts and 2 raters. RESULTS: The face validity (realism) obtained an average score of 4.2 of a maximum of 5 points. Likewise, the content validity (appropriateness as a teaching modality) obtained an average score of 4.8 of maximum 5 points. No differences were found between experts and novices concerning the recorded surgery completion times (p = 0.418) or the sizes of the lifted grafts (p = 0.110). During the evaluation of task performance, the expert surgeons (46.9 ± 3.7) were graded significantly better than the novices (36.4 ± 8.5), which proved the construct validity of the simulator (p = 0.001). CONCLUSION: All investigated validities were confirmed and approved the simulator as a valid training tool for parietal graft lift.
PURPOSE: Surgical skills can be improved through practical exercise. The use of specimens, human as well as animal, or live animals for surgical training is limited due to ethical concerns. Drawbacks of simulators are costs, fidelity and creditibility. Thus, simulators must be evaluated objectively to determine their validity before they can be used as teaching modalities. The aim of this study was to verify the face content and construct validity of a novel model-based simulator for lifting tabula externa transplants from the parietal skull. MATERIALS AND METHODS:Participants were invited to perform a tabula externa graft lift during a training session on the simulator. Task performance was analyzed with a standardized assessment tool evaluating realism and appropriateness. Specialist ratings were used to evaluate the performance of the participants. This was an exploratory study using a questionnaire, at Kepler University Hospital, Linz, Austria, a university hospital. According to their expertise in craniomaxillofacial surgery, 17 participants were subdivided into 3 groups: 8 novices, 7 experts and 2 raters. RESULTS: The face validity (realism) obtained an average score of 4.2 of a maximum of 5 points. Likewise, the content validity (appropriateness as a teaching modality) obtained an average score of 4.8 of maximum 5 points. No differences were found between experts and novices concerning the recorded surgery completion times (p = 0.418) or the sizes of the lifted grafts (p = 0.110). During the evaluation of task performance, the expert surgeons (46.9 ± 3.7) were graded significantly better than the novices (36.4 ± 8.5), which proved the construct validity of the simulator (p = 0.001). CONCLUSION: All investigated validities were confirmed and approved the simulator as a valid training tool for parietal graft lift.