Andrew R Pines1, Mohammed S Alghoul2, Youssef J Hamade1, Mithun G Sattur1, Rami James N Aoun1, Tariq K Halasa1, Chandan Krishna1, Samer G Zammar3, Najib E El Tecle4, Tarek Y El Ahmadieh5, Salah G Aoun5, Richard W Byrne6, James S Harrop7, Brian T Ragel8, Daniel K Resnick9, Russell R Lonser10, Nathan R Selden8, Bernard R Bendok1. 1. Department of Neurological Surgery, Mayo Clinic, Phoenix, Arizona. 2. Departm-ent of Plastic and Reconstructive Surgery, Northwestern University Feinberg School of Medicine, Chicago, Illinois. 3. Departm-ent of Surgery, Mayo Clinic, Phoenix, Arizona. 4. Department of Neurological Surgery, St. Louis University Hospital, St. Louis, Missouri. 5. Department of Neurological Surgery, University of Texas Southwestern, Dallas, Texas. 6. Departm-ent of Neurological Surgery, Rush Univ-ersity Medical Center, Chicago, Illinois. 7. Department of Neurological Surgery, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania. 8. Departm-ent of Neurological Surgery, Oregon Health & Science University, Portland, Oregon. 9. Department of Neurological Surgery, University of Wisconsin School of Medicine and Public Health, Madison, Wisconsin. 10. Department of Neurological Surgery, Ohio State University, Columbus, Ohio.
Abstract
BACKGROUND: The potential for simulation-based learning in neurosurgical training has led the Congress of Neurosurgical Surgeons to develop a series of simulation modules. The Northwestern Objective Microanastomosis Assessment Tool (NOMAT) was created as the corresponding assessment tool for the Congress of Neurosurgical Surgeons Microanastomosis Module. The face and construct validity of the NOMAT have been previously established. OBJECTIVE: To further validate the NOMAT by determining its interrater reliability (IRR) between raters of varying levels of microsurgical expertise. METHODS: The NOMAT was used to assess residents' performance in a microanastomosis simulation module in 2 settings: Northwestern University and the Society of Neurological Surgeons 2014 Boot Camp at the University of Indiana. At Northwestern University, participants were scored by 2 experienced microsurgeons. At the University of Indiana, participants were scored by 2 postdoctoral fellows and an experienced microsurgeon. The IRR of NOMAT was estimated by computing the intraclass correlation coefficient using SPSS v22.0 (IBM, Armonk, New York). RESULTS: A total of 75 residents were assessed. At Northwestern University, 21 residents each performed microanastomosis on 2 model vessels of different sizes, one 3 mm and one 1 mm. At the University of Indiana, 54 residents performed a single microanastomosis procedure on 3-mm vessels. The intraclass correlation coefficient of the total NOMAT scores was 0.88 at Northwestern University and 0.78 at the University of Indiana. CONCLUSION: This study indicates high IRR for the NOMAT. These results suggest that the use of raters with varying levels of expertise does not compromise the precision or validity of the scale. This allows for a wider adoption of the scale and, hence, a greater potential educational impact.
BACKGROUND: The potential for simulation-based learning in neurosurgical training has led the Congress of Neurosurgical Surgeons to develop a series of simulation modules. The Northwestern Objective Microanastomosis Assessment Tool (NOMAT) was created as the corresponding assessment tool for the Congress of Neurosurgical Surgeons Microanastomosis Module. The face and construct validity of the NOMAT have been previously established. OBJECTIVE: To further validate the NOMAT by determining its interrater reliability (IRR) between raters of varying levels of microsurgical expertise. METHODS: The NOMAT was used to assess residents' performance in a microanastomosis simulation module in 2 settings: Northwestern University and the Society of Neurological Surgeons 2014 Boot Camp at the University of Indiana. At Northwestern University, participants were scored by 2 experienced microsurgeons. At the University of Indiana, participants were scored by 2 postdoctoral fellows and an experienced microsurgeon. The IRR of NOMAT was estimated by computing the intraclass correlation coefficient using SPSS v22.0 (IBM, Armonk, New York). RESULTS: A total of 75 residents were assessed. At Northwestern University, 21 residents each performed microanastomosis on 2 model vessels of different sizes, one 3 mm and one 1 mm. At the University of Indiana, 54 residents performed a single microanastomosis procedure on 3-mm vessels. The intraclass correlation coefficient of the total NOMAT scores was 0.88 at Northwestern University and 0.78 at the University of Indiana. CONCLUSION: This study indicates high IRR for the NOMAT. These results suggest that the use of raters with varying levels of expertise does not compromise the precision or validity of the scale. This allows for a wider adoption of the scale and, hence, a greater potential educational impact.
Authors: Rory B McGoldrick; Christopher R Davis; Jon Paro; Kenneth Hui; Dung Nguyen; Gordon K Lee Journal: Plast Reconstr Surg Date: 2015-08 Impact factor: 4.730
Authors: Samer G Zammar; Najib E El Tecle; Tarek Y El Ahmadieh; P David Adelson; Erol Veznedaroglu; Daniel L Surdell; James S Harrop; Vladimir Benes; Ali R Rezai; Daniel K Resnick; Bernard R Bendok Journal: World Neurosurg Date: 2014-12-09 Impact factor: 2.104
Authors: Salah G Aoun; Tarek Y El Ahmadieh; Najib E El Tecle; Marc R Daou; Joseph G Adel; Christine S Park; H Hunt Batjer; Bernard R Bendok Journal: J Neurosurg Date: 2015-02-06 Impact factor: 5.115
Authors: Tarek Y El Ahmadieh; Najib E El Tecle; Salah G Aoun; Byron K Yip; Aruna Ganju; Bernard R Bendok Journal: Neurosurgery Date: 2012-12 Impact factor: 4.654