Qichang Sun1, Yongfeng Mai1, Rong Yang2, Tong Ji2, Xiaoyi Jiang3, Xiaojun Chen4. 1. Institute of Biomedical Manufacturing and Life Quality Engineering, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China. 2. Department of Oral Maxillofacial - Headneck Oncology, Shanghai Ninth People's Hospital, College of Stomatology, Shanghai Jiao Tong University School of Medicine, Shanghai, China. 3. Faculty of Mathematics and Computer Science, University of Münster, Einsteinstrasse 62, 48149, Münster, Germany. 4. Institute of Biomedical Manufacturing and Life Quality Engineering, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai, China. xiaojunchen@sjtu.edu.cn.
Abstract
PURPOSE: The use of an optical see-through head-mounted display (OST-HMD) in augmented reality (AR) has significantly increased in recent years, but the alignment between the virtual scene and physical reality is still a challenge. A fast and accurate calibration method of OST-HMD is important for augmented reality in the medical field. METHODS: We proposed a fast online calibration procedure for OST-HMD with the aid of an optical tracking system. Two 3D datasets are collected in this procedure: the virtual points rendered in front of the observer's eyes and the corresponding points in optical tracking space. The transformation between these two 3D coordinates is solved to build the connection between virtual and real space. An AR-based surgical navigation system is developed with the help of this procedure, which is used for experiment verification and clinical trial. RESULTS: Phantom experiment based on the 3D-printed skull is performed, and the average root-mean-square error of control points between rendered object and skull model is [Formula: see text] mm, and the time consumption of the calibration procedure can be less than 30 s. A clinical trial is also conducted to show the feasibility in real surgery theatre. CONCLUSIONS: The proposed calibration method does not rely on the camera of the OST-HMD and is very easy to operate. Phantom experiment and clinical case demonstrated the feasibility of our AR-based surgical navigation system and indicated it has the potential in clinical application.
PURPOSE: The use of an optical see-through head-mounted display (OST-HMD) in augmented reality (AR) has significantly increased in recent years, but the alignment between the virtual scene and physical reality is still a challenge. A fast and accurate calibration method of OST-HMD is important for augmented reality in the medical field. METHODS: We proposed a fast online calibration procedure for OST-HMD with the aid of an optical tracking system. Two 3D datasets are collected in this procedure: the virtual points rendered in front of the observer's eyes and the corresponding points in optical tracking space. The transformation between these two 3D coordinates is solved to build the connection between virtual and real space. An AR-based surgical navigation system is developed with the help of this procedure, which is used for experiment verification and clinical trial. RESULTS: Phantom experiment based on the 3D-printed skull is performed, and the average root-mean-square error of control points between rendered object and skull model is [Formula: see text] mm, and the time consumption of the calibration procedure can be less than 30 s. A clinical trial is also conducted to show the feasibility in real surgery theatre. CONCLUSIONS: The proposed calibration method does not rely on the camera of the OST-HMD and is very easy to operate. Phantom experiment and clinical case demonstrated the feasibility of our AR-based surgical navigation system and indicated it has the potential in clinical application.
Entities:
Keywords:
Augmented reality; Calibration; Microsoft HoloLens; Surgical navigation
Authors: Jacob T Gibby; Samuel A Swenson; Steve Cvetko; Raj Rao; Ramin Javan Journal: Int J Comput Assist Radiol Surg Date: 2018-06-22 Impact factor: 2.924
Authors: Long Qian; Alexander Barthel; Alex Johnson; Greg Osgood; Peter Kazanzides; Nassir Navab; Bernhard Fuerst Journal: Int J Comput Assist Radiol Surg Date: 2017-03-25 Impact factor: 2.924
Authors: F Hölzle; M R Kesting; G Hölzle; A Watola; D J Loeffelbein; J Ervens; K-D Wolff Journal: Int J Oral Maxillofac Surg Date: 2007-07-05 Impact factor: 2.789
Authors: Carolina Blanco-Angulo; Andrea Martínez-Lozano; Carlos G Juan; Roberto Gutiérrez-Mazón; Julia Arias-Rodríguez; Ernesto Ávila-Navarro; José M Sabater-Navarro Journal: Sensors (Basel) Date: 2022-05-19 Impact factor: 3.847