Yuta Koreeda1,2, Yo Kobayashi3, Satoshi Ieiri4, Yuya Nishio5, Kazuya Kawamura6, Satoshi Obata4, Ryota Souzaki4, Makoto Hashizume4, Masakatsu G Fujie3. 1. Graduate School of Science and Engineering, Waseda University, 59-309, 3-4-1, Okubo, Shinjuku Ward, Tokyo, Japan. yuta-is-here@ruri.waseda.jp. 2. Center for Exploratory Research, Hitachi, Ltd., Tokyo, Japan. yuta-is-here@ruri.waseda.jp. 3. Faculty of Science and Engineering in the Graduate School of Science and Engineering, Waseda University, Tokyo, Japan. 4. Center for the Integration of Advanced Medicine and Innovative Technology, Kyushu University, Fukuoka, Japan. 5. Graduate School of Science and Engineering, Waseda University, 59-309, 3-4-1, Okubo, Shinjuku Ward, Tokyo, Japan. 6. Center for Frontier Medical Engineering, Chiba University, Chiba, Japan.
Abstract
PURPOSE: We developed and evaluated a visual compensation system that allows surgeons to visualize obscured regions in real time, such that the surgical instrument appears virtually transparent. METHODS: The system consists of two endoscopes: a main endoscope to observe the surgical environment, and a supporting endoscope to render the region hidden from view by surgical instruments. The view captured by the supporting endoscope is transformed to simulate the view from the main endoscope, segmented to the shape of the hidden regions, and superimposed to the main endoscope image so that the surgical instruments look transparent. A prototype device was benchmarked for processing time and superimposition rendering error. Then, it was evaluated in a training environment with 22 participants performing a backhand needle driving task with needle exit point error as the criterion. Lastly, we conducted an in vivo study. RESULTS: In the benchmark, the mean processing time was 62.4 ms, which was lower than the processing time accepted in remote surgeries. The mean superimposition error of the superimposed image was 1.4 mm. In the training environment, needle exit point error with the system decreased significantly for experts compared with the condition without the system. This change was not significant for novices. In the in vivo study, our prototype enabled visualization of needle exit points during anastomosis. CONCLUSION: The benchmark suggests that the implemented system had an acceptable performance, and evaluation in the training environment demonstrated improved surgical task outcomes in expert surgeons. We will conduct a more comprehensive in vivo study in the future.
PURPOSE: We developed and evaluated a visual compensation system that allows surgeons to visualize obscured regions in real time, such that the surgical instrument appears virtually transparent. METHODS: The system consists of two endoscopes: a main endoscope to observe the surgical environment, and a supporting endoscope to render the region hidden from view by surgical instruments. The view captured by the supporting endoscope is transformed to simulate the view from the main endoscope, segmented to the shape of the hidden regions, and superimposed to the main endoscope image so that the surgical instruments look transparent. A prototype device was benchmarked for processing time and superimposition rendering error. Then, it was evaluated in a training environment with 22 participants performing a backhand needle driving task with needle exit point error as the criterion. Lastly, we conducted an in vivo study. RESULTS: In the benchmark, the mean processing time was 62.4 ms, which was lower than the processing time accepted in remote surgeries. The mean superimposition error of the superimposed image was 1.4 mm. In the training environment, needle exit point error with the system decreased significantly for experts compared with the condition without the system. This change was not significant for novices. In the in vivo study, our prototype enabled visualization of needle exit points during anastomosis. CONCLUSION: The benchmark suggests that the implemented system had an acceptable performance, and evaluation in the training environment demonstrated improved surgical task outcomes in expert surgeons. We will conduct a more comprehensive in vivo study in the future.
Authors: R Rayman; K Croome; N Galbraith; R McClure; R Morady; S Peterson; S Smith; V Subotic; A Van Wynsberghe; S Primak Journal: Int J Med Robot Date: 2006-09 Impact factor: 2.547
Authors: L Maier-Hein; P Mountney; A Bartoli; H Elhawary; D Elson; A Groch; A Kolb; M Rodrigues; J Sorger; S Speidel; D Stoyanov Journal: Med Image Anal Date: 2013-05-03 Impact factor: 8.545
Authors: Jacques Marescaux; Joel Leroy; Francesco Rubino; Michelle Smith; Michel Vix; Michele Simone; Didier Mutter Journal: Ann Surg Date: 2002-04 Impact factor: 12.969