Étienne Léger1, Jonatan Reyes2, Simon Drouin3, Tiberiu Popa2,4, Jeffery A Hall5, D Louis Collins6, Marta Kersten-Oertel2,4. 1. Department of Computer Science and Software Engineering, Concordia University, 1455 Boul. de Maisonneuve O., Montreal, QC H3G 1M8, Canada. etienne.leger@mail.concordia.ca. 2. Department of Computer Science and Software Engineering, Concordia University, 1455 Boul. de Maisonneuve O., Montreal, QC H3G 1M8, Canada. 3. Department of Software Engineering and Information Technology, École des Technologies Supérieures, 1100 Notre-Dame St. W., Montreal, QC H3G 1K3, Canada. 4. PERFORM Center, Concordia University, 1455 Boul. de Maisonneuve O., Montreal, QC H3G 1M8, Canada. 5. Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, 3801 University St., Montreal, QC H3A 2B4, Canada. 6. McConnell Brain Imaging Center at the Montreal Neurological Institute, McGill University, 3801 University St., Montreal, QC H3A 2B4, Canada.
Abstract
PURPOSE: Neuronavigation systems making use of augmented reality (AR) have been the focus of much research in the last couple of decades. In recent years, there has been considerable interest in using mobile devices for AR in the operating room (OR). We propose a complete system that performs real-time AR video augmentation on a mobile device in the context of image-guided neurosurgery. METHODS: MARIN (mobile augmented reality interactive neuronavigation system) improves upon the state of the art in terms of performance, allowing real-time augmentation, and interactivity by allowing users to interact with the displayed data. The system was tested in a user study with 17 subjects for qualitative and quantitative evaluation in the context of target localization and brought into the OR for preliminary feasibility tests, where qualitative feedback from surgeons was obtained. RESULTS: The results of the user study showed that MARIN performs significantly better in terms of both time ([Formula: see text]) and accuracy ([Formula: see text]) for the task of target localization in comparison with a traditional image-guided neurosurgery (IGNS) navigation system. Further, MARIN AR visualization was found to be more intuitive and allowed users to estimate target depth more easily. CONCLUSION: MARIN improves upon previously proposed mobile AR neuronavigation systems with its real-time performance, higher accuracy, full integration in the normal workflow and greater interactivity and customizability of the displayed information. The improvement in efficiency and usability over previous systems will facilitate bringing AR into the OR.
PURPOSE: Neuronavigation systems making use of augmented reality (AR) have been the focus of much research in the last couple of decades. In recent years, there has been considerable interest in using mobile devices for AR in the operating room (OR). We propose a complete system that performs real-time AR video augmentation on a mobile device in the context of image-guided neurosurgery. METHODS: MARIN (mobile augmented reality interactive neuronavigation system) improves upon the state of the art in terms of performance, allowing real-time augmentation, and interactivity by allowing users to interact with the displayed data. The system was tested in a user study with 17 subjects for qualitative and quantitative evaluation in the context of target localization and brought into the OR for preliminary feasibility tests, where qualitative feedback from surgeons was obtained. RESULTS: The results of the user study showed that MARIN performs significantly better in terms of both time ([Formula: see text]) and accuracy ([Formula: see text]) for the task of target localization in comparison with a traditional image-guided neurosurgery (IGNS) navigation system. Further, MARIN AR visualization was found to be more intuitive and allowed users to estimate target depth more easily. CONCLUSION: MARIN improves upon previously proposed mobile AR neuronavigation systems with its real-time performance, higher accuracy, full integration in the normal workflow and greater interactivity and customizability of the displayed information. The improvement in efficiency and usability over previous systems will facilitate bringing AR into the OR.
Authors: Bruno Fernandes de Oliveira Santos; Daniel de Araujo Paz; Victor Miranda Fernandes; José Calasans Dos Santos; Feres Eduardo Aparecido Chaddad-Neto; Antonio Carlos Sobral Sousa; Joselina Luzia Menezes Oliveira Journal: Sci Rep Date: 2021-03-24 Impact factor: 4.379