Jianyu Lin1,2, Neil T Clancy3,4, Daniel S Elson3,4. 1. Hamlyn Centre for Robotic Surgery, Institute of Global Health Innovation, Imperial College London, London, SW7 2AZ, UK. xjtuljy@gmail.com. 2. Department of Computing, Imperial College London, London, SW7 2AZ, UK. xjtuljy@gmail.com. 3. Hamlyn Centre for Robotic Surgery, Institute of Global Health Innovation, Imperial College London, London, SW7 2AZ, UK. 4. Department of Surgery and Cancer, Imperial College London, London, SW7 2AZ, UK.
Abstract
PURPOSE: In clinical examinations, the tissue surface topology is an important feature for detecting the tissue pathology and implementing augmented reality. We have previously presented a miniaturised structured light (SL) system for recovery of tissue surface shape in minimally invasive surgery (MIS), based on a flexible multispectral structured illumination probe (1.9 mm diameter) (Clancy et al. in Biomed Opt Express 2(11):3119-3128, 2011. doi: 10.1364/BOE.2.003119 ). This paper reports further hardware and analytical developments to improve the light pattern decoding result and increase the reconstruction accuracy. METHODS: The feasibility of using an 8-band multispectral camera with higher pattern-colour discrimination ability than normal RGB camera in this system was studied. Additionally, the "normalised cut" algorithm was investigated to improve pattern segmentation. RESULTS: The whole SL system was evaluated by phantom and in vivo experiments. Higher pattern identification performance than that of an RGB camera was recorded by using the multispectral camera (average precision >97%, average sensitivity >62%). An average of [Formula: see text] reconstruction error was achieved using the proposed pattern decoding method on a heart phantom at a working distance of approximately 10 cm. CONCLUSIONS: The experiment showed the superiority of the multispectral camera over the RGB camera in the spot identification step. The proposed pattern decoding algorithm underwent evaluations using different experiments, showing that it provided promising reconstruction results. The potential of using this system in MIS environments has been demonstrated.
PURPOSE: In clinical examinations, the tissue surface topology is an important feature for detecting the tissue pathology and implementing augmented reality. We have previously presented a miniaturised structured light (SL) system for recovery of tissue surface shape in minimally invasive surgery (MIS), based on a flexible multispectral structured illumination probe (1.9 mm diameter) (Clancy et al. in Biomed Opt Express 2(11):3119-3128, 2011. doi: 10.1364/BOE.2.003119 ). This paper reports further hardware and analytical developments to improve the light pattern decoding result and increase the reconstruction accuracy. METHODS: The feasibility of using an 8-band multispectral camera with higher pattern-colour discrimination ability than normal RGB camera in this system was studied. Additionally, the "normalised cut" algorithm was investigated to improve pattern segmentation. RESULTS: The whole SL system was evaluated by phantom and in vivo experiments. Higher pattern identification performance than that of an RGB camera was recorded by using the multispectral camera (average precision >97%, average sensitivity >62%). An average of [Formula: see text] reconstruction error was achieved using the proposed pattern decoding method on a heart phantom at a working distance of approximately 10 cm. CONCLUSIONS: The experiment showed the superiority of the multispectral camera over the RGB camera in the spot identification step. The proposed pattern decoding algorithm underwent evaluations using different experiments, showing that it provided promising reconstruction results. The potential of using this system in MIS environments has been demonstrated.
Authors: L Maier-Hein; P Mountney; A Bartoli; H Elhawary; D Elson; A Groch; A Kolb; M Rodrigues; J Sorger; S Speidel; D Stoyanov Journal: Med Image Anal Date: 2013-05-03 Impact factor: 8.545
Authors: Chad R Tracy; John D Terrell; Robert P Francis; Eleanor F Wehner; Jack Smith; Maritoni Litorja; Doyle L Hawkins; Margaret S Pearle; Jeffrey A Cadeddu; Karel J Zuzak Journal: J Endourol Date: 2010-03 Impact factor: 2.942
Authors: Neil T Clancy; Danail Stoyanov; Lena Maier-Hein; Anja Groch; Guang-Zhong Yang; Daniel S Elson Journal: Biomed Opt Express Date: 2011-10-25 Impact factor: 3.732