Erol Özgür1, Bongjin Koo2, Bertrand Le Roy2, Emmanuel Buc2, Adrien Bartoli2. 1. EnCoV, IP, UMR 6602 CNRS, Universitè Clermont Auvergne, SIGMA, Aubière, France. erol.ozgur@uca.fr. 2. EnCoV, IP, UMR 6602 CNRS, Universitè Clermont Auvergne, SIGMA, Aubière, France.
Abstract
PURPOSE: Augmented reality for monocular laparoscopy from a preoperative volume such as CT is achieved in two steps. The first step is to segment the organ in the preoperative volume and reconstruct its 3D model. The second step is to register the preoperative 3D model to an initial intraoperative laparoscopy image. To date, there does not exist an automatic initial registration method to solve the second step for the liver in the de facto operating room conditions of monocular laparoscopy. Existing methods attempt to solve for both deformation and pose simultaneously, leading to nonconvex problems with no optimal solution algorithms. METHODS: We propose in contrast to break the problem down into two parts, solving for (i) deformation and (ii) pose. Part (i) simulates biomechanical deformations from the preoperative to the intraoperative state to predict the liver's unknown intraoperative shape by modeling gravity, the abdominopelvic cavity's pressure and boundary conditions. Part (ii) rigidly registers the simulated shape to the laparoscopy image using contour cues. RESULTS: Our formulation leads to a well-posed problem, contrary to existing methods. This is because it exploits strong environment priors to complement the weak laparoscopic visual cues. CONCLUSION: Quantitative results with in silico and phantom experiments and qualitative results with laparosurgery images for two patients show that our method outperforms the state-of-the-art in accuracy and registration time.
PURPOSE: Augmented reality for monocular laparoscopy from a preoperative volume such as CT is achieved in two steps. The first step is to segment the organ in the preoperative volume and reconstruct its 3D model. The second step is to register the preoperative 3D model to an initial intraoperative laparoscopy image. To date, there does not exist an automatic initial registration method to solve the second step for the liver in the de facto operating room conditions of monocular laparoscopy. Existing methods attempt to solve for both deformation and pose simultaneously, leading to nonconvex problems with no optimal solution algorithms. METHODS: We propose in contrast to break the problem down into two parts, solving for (i) deformation and (ii) pose. Part (i) simulates biomechanical deformations from the preoperative to the intraoperative state to predict the liver's unknown intraoperative shape by modeling gravity, the abdominopelvic cavity's pressure and boundary conditions. Part (ii) rigidly registers the simulated shape to the laparoscopy image using contour cues. RESULTS: Our formulation leads to a well-posed problem, contrary to existing methods. This is because it exploits strong environment priors to complement the weak laparoscopic visual cues. CONCLUSION: Quantitative results with in silico and phantom experiments and qualitative results with laparosurgery images for two patients show that our method outperforms the state-of-the-art in accuracy and registration time.
Authors: Ivo Wolf; Marcus Vetter; Ingmar Wegner; Thomas Böttger; Marco Nolden; Max Schöbinger; Mark Hastenteufel; Tobias Kunert; Hans-Peter Meinzer Journal: Med Image Anal Date: 2005-12 Impact factor: 8.545
Authors: Timothy Carter; Christine Tanner; Nicolas Beechey-Newman; Dean Barratt; David Hawkes Journal: Med Image Comput Comput Assist Interv Date: 2008
Authors: J Bano; A Hostettler; S A Nicolau; S Cotin; C Doignon; H S Wu; M H Huang; L Soler; J Marescaux Journal: Med Image Comput Comput Assist Interv Date: 2012
Authors: Stefan Suwelack; Sebastian Röhl; Sebastian Bodenstedt; Daniel Reichard; Rüdiger Dillmann; Thiago dos Santos; Lena Maier-Hein; Martin Wagner; Josephine Wünscher; Hannes Kenngott; Beat P Müller; Stefanie Speidel Journal: Med Phys Date: 2014-11 Impact factor: 4.071
Authors: Andrew A Gumbs; Vincent Grasso; Nicolas Bourdel; Roland Croner; Gaya Spolverato; Isabella Frigerio; Alfredo Illanes; Mohammad Abu Hilal; Adrian Park; Eyad Elyan Journal: Sensors (Basel) Date: 2022-06-29 Impact factor: 3.847
Authors: Andrea Teatini; Egidijus Pelanis; Davit L Aghayan; Rahul Prasanna Kumar; Rafael Palomar; Åsmund Avdem Fretland; Bjørn Edwin; Ole Jakob Elle Journal: Sci Rep Date: 2019-12-10 Impact factor: 4.379