OBJECTIVES: A mixed reality (MR) headset that enables three-dimensional (3D) visualization of interactive holograms anchored to specific points in physical space was developed for use with lateral skull base anatomy. The objectives of this study are to: 1) develop an augmented reality platform using the headset for visualization of temporal bone structures, and 2) measure the accuracy of the platform as an image guidance system. METHODS: A combination of semiautomatic and manual segmentation was used to generate 3D reconstructions of soft tissue and bony anatomy of cadaver heads and temporal bones from 2D computed tomography images. A Mixed-Reality platform was developed using C# programming to generate interactive 3D holograms that could be displayed in the HoloLens headset. Accuracy of visual surface registration was determined by target registration error between seven predefined points on a 3D holographic skull and 3D printed model. RESULTS: Interactive 3D holograms of soft tissue, bony anatomy, and internal ear structures of cadaveric models were generated and visualized in the MR headset. Software user interface was developed to allow for user control of the virtual images through gaze, voice, and gesture commands. Visual surface point matching registration was used to align and anchor holograms to physical objects. The average target registration error of our system was 5.76 mm ± 0.54. CONCLUSION: In this article, we demonstrate that an MR headset can be applied to display interactive 3D anatomic structures of the temporal bone that can be overlaid on physical models. This technology has the potential to be used as an image guidance tool during anatomic dissection and lateral skull base surgery.
OBJECTIVES: A mixed reality (MR) headset that enables three-dimensional (3D) visualization of interactive holograms anchored to specific points in physical space was developed for use with lateral skull base anatomy. The objectives of this study are to: 1) develop an augmented reality platform using the headset for visualization of temporal bone structures, and 2) measure the accuracy of the platform as an image guidance system. METHODS: A combination of semiautomatic and manual segmentation was used to generate 3D reconstructions of soft tissue and bony anatomy of cadaver heads and temporal bones from 2D computed tomography images. A Mixed-Reality platform was developed using C# programming to generate interactive 3D holograms that could be displayed in the HoloLens headset. Accuracy of visual surface registration was determined by target registration error between seven predefined points on a 3D holographic skull and 3D printed model. RESULTS: Interactive 3D holograms of soft tissue, bony anatomy, and internal ear structures of cadaveric models were generated and visualized in the MR headset. Software user interface was developed to allow for user control of the virtual images through gaze, voice, and gesture commands. Visual surface point matching registration was used to align and anchor holograms to physical objects. The average target registration error of our system was 5.76 mm ± 0.54. CONCLUSION: In this article, we demonstrate that an MR headset can be applied to display interactive 3D anatomic structures of the temporal bone that can be overlaid on physical models. This technology has the potential to be used as an image guidance tool during anatomic dissection and lateral skull base surgery.
Authors: Wolfgang Birkfellner; Michael Figl; Christian Matula; Johann Hummel; Rudolf Hanel; Herwig Imhof; Felix Wanschitz; Arne Wagner; Franz Watzinger; Helmar Bergmann Journal: Phys Med Biol Date: 2003-02-07 Impact factor: 3.609
Authors: Paul A Yushkevich; Joseph Piven; Heather Cody Hazlett; Rachel Gimpel Smith; Sean Ho; James C Gee; Guido Gerig Journal: Neuroimage Date: 2006-03-20 Impact factor: 6.556
Authors: Wen P Liu; Mahdi Azizian; Jonathan Sorger; Russell H Taylor; Brian K Reilly; Kevin Cleary; Diego Preciado Journal: JAMA Otolaryngol Head Neck Surg Date: 2014-03 Impact factor: 6.223
Authors: Christoph Leuze; Caio A Neves; Alejandro M Gomez; Nassir Navab; Nikolas Blevins; Yona Vaisbuch; Jennifer A McNab Journal: J Neurol Surg B Skull Base Date: 2021-09-10
Authors: Jennifer N Avari Silva; Mary Beth Privitera; Michael K Southworth; Jonathan R Silva Journal: Virtual Augment Mixed Real (2020) Date: 2020-07-10
Authors: Christopher M Andrews; Alexander B Henry; Ignacio M Soriano; Michael K Southworth; Jonathan R Silva Journal: IEEE J Transl Eng Health Med Date: 2020-12-17 Impact factor: 3.316
Authors: Jun Liu; Subhi J Al'Aref; Gurpreet Singh; Alexandre Caprio; Amir Ali Amiri Moghadam; Sun-Joo Jang; S Chiu Wong; James K Min; Simon Dunham; Bobak Mosadegh Journal: PLoS One Date: 2019-07-01 Impact factor: 3.240