Mehran Mahvash1, Leila Besharati Tabrizi. 1. Department of Neurosurgery, Clinic of Cologne-Merheim, University of Witten-Herdecke, Ostmerheimer Strasse 200, 51109, Köln, Germany. mmahvash@yahoo.de
Abstract
BACKGROUND: Augmented reality systems combine virtual images with a real environment. OBJECTIVE: To design and develop an augmented reality system for image-guided surgery of brain tumors using image projection. METHODS: A virtual image was created in two ways: (1) MRI-based 3D model of the head matched with the segmented lesion of a patient using MRIcro software (version 1.4, freeware, Chris Rorden) and (2) Digital photograph based model in which the tumor region was drawn using image-editing software. The real environment was simulated with a head phantom. For direct projection of the virtual image to the head phantom, a commercially available video projector (PicoPix 1020, Philips) was used. The position and size of the virtual image was adjusted manually for registration, which was performed using anatomical landmarks and fiducial markers position. RESULTS: An augmented reality system for image-guided neurosurgery using direct image projection has been designed successfully and implemented in first evaluation with promising results. The virtual image could be projected to the head phantom and was registered manually. Accurate registration (mean projection error: 0.3 mm) was performed using anatomical landmarks and fiducial markers position. CONCLUSIONS: The direct projection of a virtual image to the patients head, skull, or brain surface in real time is an augmented reality system that can be used for image-guided neurosurgery. In this paper, the first evaluation of the system is presented. The encouraging first visualization results indicate that the presented augmented reality system might be an important enhancement of image-guided neurosurgery.
BACKGROUND: Augmented reality systems combine virtual images with a real environment. OBJECTIVE: To design and develop an augmented reality system for image-guided surgery of brain tumors using image projection. METHODS: A virtual image was created in two ways: (1) MRI-based 3D model of the head matched with the segmented lesion of a patient using MRIcro software (version 1.4, freeware, Chris Rorden) and (2) Digital photograph based model in which the tumor region was drawn using image-editing software. The real environment was simulated with a head phantom. For direct projection of the virtual image to the head phantom, a commercially available video projector (PicoPix 1020, Philips) was used. The position and size of the virtual image was adjusted manually for registration, which was performed using anatomical landmarks and fiducial markers position. RESULTS: An augmented reality system for image-guided neurosurgery using direct image projection has been designed successfully and implemented in first evaluation with promising results. The virtual image could be projected to the head phantom and was registered manually. Accurate registration (mean projection error: 0.3 mm) was performed using anatomical landmarks and fiducial markers position. CONCLUSIONS: The direct projection of a virtual image to the patients head, skull, or brain surface in real time is an augmented reality system that can be used for image-guided neurosurgery. In this paper, the first evaluation of the system is presented. The encouraging first visualization results indicate that the presented augmented reality system might be an important enhancement of image-guided neurosurgery.
Authors: Jin San Lee; Seongbeom Park; Hee Jin Kim; Yeshin Kim; Hyemin Jang; Ko Woon Kim; Hak Young Rhee; Sung Sang Yoon; Kyoung Jin Hwang; Key-Chung Park; Seung Hwan Moon; Sung Tae Kim; Samuel N Lockhart; Duk L Na; Sang Won Seo Journal: Sci Rep Date: 2017-10-17 Impact factor: 4.379