Junchen Wang1,2, Yu Shen1,2, Shuo Yang3. 1. School of Mechanical Engineering and Automation, Beihang University, Beijing, 100191, China. 2. Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100086, China. 3. Stomatological Hospital, Southern Medical University, Guangzhou, China. alex2005191007@163.com.
Abstract
BACKGROUND: Image registration lies in the core of augmented reality (AR), which aligns the virtual scene with the reality. In AR surgical navigation, the performance of image registration is vital to the surgical outcome. METHODS: This paper presents a practical marker-less image registration method for AR-guided oral and maxillofacial surgery where a virtual scene is generated and mixed with reality to guide surgical operation or provide surgical outcome visualization in the manner of video see-through overlay. An intraoral 3D scanner is employed to acquire the patient's teeth shape model intraoperatively. The shape model is then registered with a custom-made stereo camera system using a novel 3D stereo matching algorithm and with the patient's CT-derived 3D model using an iterative closest point scheme, respectively. By leveraging the intraoral 3D scanner, the CT space and the stereo camera space are associated so that surrounding anatomical models and virtual implants could be overlaid on the camera's view to achieve AR surgical navigation. RESULTS: Jaw phantom experiments were performed to evaluate the target registration error of the overlay, which yielded an average error of less than 0.50 mm with the time cost less than 0.5 s. Volunteer trial was also conducted to show the clinical feasibility. CONCLUSIONS: The proposed registration method does not rely on any external fiducial markers attached to the patient. It performs automatically so as to maintain a correct AR scene, overcoming the misalignment difficulty caused by patient's movement. Therefore, it is noninvasive and practical in oral and maxillofacial surgery.
BACKGROUND: Image registration lies in the core of augmented reality (AR), which aligns the virtual scene with the reality. In AR surgical navigation, the performance of image registration is vital to the surgical outcome. METHODS: This paper presents a practical marker-less image registration method for AR-guided oral and maxillofacial surgery where a virtual scene is generated and mixed with reality to guide surgical operation or provide surgical outcome visualization in the manner of video see-through overlay. An intraoral 3D scanner is employed to acquire the patient's teeth shape model intraoperatively. The shape model is then registered with a custom-made stereo camera system using a novel 3D stereo matching algorithm and with the patient's CT-derived 3D model using an iterative closest point scheme, respectively. By leveraging the intraoral 3D scanner, the CT space and the stereo camera space are associated so that surrounding anatomical models and virtual implants could be overlaid on the camera's view to achieve AR surgical navigation. RESULTS: Jaw phantom experiments were performed to evaluate the target registration error of the overlay, which yielded an average error of less than 0.50 mm with the time cost less than 0.5 s. Volunteer trial was also conducted to show the clinical feasibility. CONCLUSIONS: The proposed registration method does not rely on any external fiducial markers attached to the patient. It performs automatically so as to maintain a correct AR scene, overcoming the misalignment difficulty caused by patient's movement. Therefore, it is noninvasive and practical in oral and maxillofacial surgery.
Entities:
Keywords:
Augmented reality; Image registration; Oral and maxillofacial surgery; Video see-through
Authors: Santiago Ochandiano; David García-Mato; Alba Gonzalez-Alvarez; Rafael Moreta-Martinez; Manuel Tousidonis; Carlos Navarro-Cuellar; Ignacio Navarro-Cuellar; José Ignacio Salmerón; Javier Pascau Journal: Front Oncol Date: 2022-01-28 Impact factor: 6.244
Authors: R Schreurs; F Baan; C Klop; L Dubois; L F M Beenen; P E M H Habets; A G Becking; T J J Maal Journal: Sci Rep Date: 2021-09-10 Impact factor: 4.379