Nader Mahmoud1,2, Óscar G Grasa3, Stéphane A Nicolau3, Christophe Doignon4, Luc Soler3, Jacques Marescaux3, J M M Montiel5. 1. IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), Strasbourg, France. nader-mahmoud.ali@etu.unistra.fr. 2. ICube (UMR 7357 CNRS), Université de Strasbourg, Strasbourg, France. nader-mahmoud.ali@etu.unistra.fr. 3. IRCAD (Institut de Recherche contre les Cancers de l'Appareil Digestif), Strasbourg, France. 4. ICube (UMR 7357 CNRS), Université de Strasbourg, Strasbourg, France. 5. Instituto de Investigación en Ingeniería de Aragón (I3A), Universidad de Zaragoza, Saragossa, Spain.
Abstract
PURPOSE: An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS: We resort to visual SLAM to provide markerless real-time tablet-PC camera location with respect to the patient. The preoperative model is registered with respect to the patient through 4-6 anchor points. The anchors correspond to anatomical references selected on the tablet-PC screen at the beginning of the procedure. RESULTS: Accurate and real-time preoperative model alignment (approximately 5-mm mean FRE and TRE) was achieved, even when anchors were not visible in the current field of view. The system has been experimentally validated on human volunteers, in vivo pigs and a phantom. CONCLUSIONS: The proposed system can be smoothly integrated into the surgical workflow because it: (1) operates in real time, (2) requires minimal additional hardware only a tablet-PC with camera, (3) is robust to occlusion, (4) requires minimal interaction from the medical staff.
PURPOSE: An augmented reality system to visualize a 3D preoperative anatomical model on intra-operative patient is proposed. The hardware requirement is commercial tablet-PC equipped with a camera. Thus, no external tracking device nor artificial landmarks on the patient are required. METHODS: We resort to visual SLAM to provide markerless real-time tablet-PC camera location with respect to the patient. The preoperative model is registered with respect to the patient through 4-6 anchor points. The anchors correspond to anatomical references selected on the tablet-PC screen at the beginning of the procedure. RESULTS: Accurate and real-time preoperative model alignment (approximately 5-mm mean FRE and TRE) was achieved, even when anchors were not visible in the current field of view. The system has been experimentally validated on human volunteers, in vivo pigs and a phantom. CONCLUSIONS: The proposed system can be smoothly integrated into the surgical workflow because it: (1) operates in real time, (2) requires minimal additional hardware only a tablet-PC with camera, (3) is robust to occlusion, (4) requires minimal interaction from the medical staff.
Entities:
Keywords:
Augmented reality; Operating room; Registration; Surface meshes; Visual SLAM
Authors: Jens J Rassweiler; Michael Müller; Markus Fangerau; Jan Klein; Ali S Goezen; Philippe Pereira; Hans-Peter Meinzer; Dogu Teber Journal: Eur Urol Date: 2011-12-21 Impact factor: 20.096
Authors: Julie Hallet; Luc Soler; Michele Diana; Didier Mutter; Thomas F Baumert; François Habersetzer; Jacques Marescaux; Patrick Pessaux Journal: J Am Coll Surg Date: 2015-01-26 Impact factor: 6.113
Authors: Thiago Ramos dos Santos; Alexander Seitel; Thomas Kilgus; Stefan Suwelack; Anna-Laura Wekerle; Hannes Kenngott; Stefanie Speidel; Heinz-Peter Schlemmer; Hans-Peter Meinzer; Tobias Heimann; Lena Maier-Hein Journal: Med Image Anal Date: 2014-07-02 Impact factor: 8.545
Authors: Thomas Kilgus; Eric Heim; Sven Haase; Sabine Prüfer; Michael Müller; Alexander Seitel; Markus Fangerau; Tamara Wiebe; Justin Iszatt; Heinz-Peter Schlemmer; Joachim Hornegger; Kathrin Yen; Lena Maier-Hein Journal: Int J Comput Assist Radiol Surg Date: 2014-08-23 Impact factor: 2.924
Authors: Óscar G Grasa; Ernesto Bernal; Santiago Casado; Ismael Gil; J M M Montiel Journal: IEEE Trans Med Imaging Date: 2013-09-20 Impact factor: 10.048
Authors: Leah A Groves; Patrick Carnahan; Daniel R Allen; Rankin Adam; Terry M Peters; Elvis C S Chen Journal: Int J Comput Assist Radiol Surg Date: 2019-05-08 Impact factor: 2.924