Constantinos Loukas1,2, Nikolaos Nikiteas3, Dimitrios Schizas4, Evangelos Georgiou3. 1. Simulation Center, Laboratory of Medical Physics, Medical School, National and Kapodistrian University of Athens, Athens, Greece. cloukas@med.uoa.gr. 2. Medical Physics Lab-Simulation Center, School of Medicine, University of Athens, Mikras Asias 75 str., 11527, Athens, Greece. cloukas@med.uoa.gr. 3. Simulation Center, Laboratory of Medical Physics, Medical School, National and Kapodistrian University of Athens, Athens, Greece. 4. 1st Department of Surgery, Laiko General Hospital, University of Athens, Athens, Greece.
Abstract
PURPOSE: Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscopic surgery videos, a fundamental step in content-based video analysis. METHODS: The video is first decomposed into short clips that are processed sequentially. After feature extraction, we employ spatiotemporal Gaussian mixture models (GMM) for each clip and apply a variational Bayesian (VB) algorithm to approximate the posterior distribution of the model parameters. The proper number of components is handled automatically by the VBGMM algorithm. The estimated components are matched along the video sequence via their Kullback-Leibler divergence. Shot borders are defined when component tracking fails, signifying a different visual appearance of the surgical scene. RESULTS: Experimental evaluation was performed on laparoscopic videos containing a variable number of shots. Performance was measured via precision, recall, coverage and overflow metrics. The proposed method was compared with GMM and a shot detection method based on spatiotemporal motion differences (MotionDiff). The results demonstrate that VBGMM has higher performance than all other methods for most assessment metrics: precision and recall >80 %, coverage: 84 %. Overflow for VBGMM was worse than MotionDiff (37 vs. 27 %). CONCLUSIONS: The proposed method generated promising results for shot border detection. Spatiotemporal modeling via VBGMMs provides a means to explore additional applications such as component tracking.
PURPOSE: Over the last decade, the demand for content management of video recordings of surgical procedures has greatly increased. Although a few research methods have been published toward this direction, the related literature is still in its infancy. In this paper, we address the problem of shot detection in endoscopic surgery videos, a fundamental step in content-based video analysis. METHODS: The video is first decomposed into short clips that are processed sequentially. After feature extraction, we employ spatiotemporal Gaussian mixture models (GMM) for each clip and apply a variational Bayesian (VB) algorithm to approximate the posterior distribution of the model parameters. The proper number of components is handled automatically by the VBGMM algorithm. The estimated components are matched along the video sequence via their Kullback-Leibler divergence. Shot borders are defined when component tracking fails, signifying a different visual appearance of the surgical scene. RESULTS: Experimental evaluation was performed on laparoscopic videos containing a variable number of shots. Performance was measured via precision, recall, coverage and overflow metrics. The proposed method was compared with GMM and a shot detection method based on spatiotemporal motion differences (MotionDiff). The results demonstrate that VBGMM has higher performance than all other methods for most assessment metrics: precision and recall >80 %, coverage: 84 %. Overflow for VBGMM was worse than MotionDiff (37 vs. 27 %). CONCLUSIONS: The proposed method generated promising results for shot border detection. Spatiotemporal modeling via VBGMMs provides a means to explore additional applications such as component tracking.
Authors: Andru Putra Twinanda; Jacques Marescaux; Michel de Mathelin; Nicolas Padoy Journal: Int J Comput Assist Radiol Surg Date: 2015-04-07 Impact factor: 2.924
Authors: Jad M Abdelsattar; T K Pandian; Eric J Finnesgard; Moustafa M El Khatib; Phillip G Rowse; EeeL N H Buckarma; Becca L Gas; Stephanie F Heller; David R Farley Journal: J Surg Educ Date: 2015-10-09 Impact factor: 2.891