Xinyang Liu1, William Plishker2, Timothy D Kane1, David A Geller3, Lung W Lau1, Jun Tashiro1, Karun Sharma1, Raj Shekhar4,5. 1. Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA. 2. IGI Technologies, Inc., College Park, MD, USA. 3. Department of Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA, USA. 4. Sheikh Zayed Institute for Pediatric Surgical Innovation, Children's National Hospital, Washington, DC, USA. rshekhar@childrensnational.org. 5. IGI Technologies, Inc., College Park, MD, USA. rshekhar@childrensnational.org.
Abstract
PURPOSE: For laparoscopic ablation to be successful, accurate placement of the needle to the tumor is essential. Laparoscopic ultrasound is an essential tool to guide needle placement, but the ultrasound image is generally presented separately from the laparoscopic image. We aim to evaluate an augmented reality (AR) system which combines laparoscopic ultrasound image, laparoscope video, and the needle trajectory in a unified view. METHODS: We created a tissue phantom made of gelatin. Artificial tumors represented by plastic spheres were secured in the gelatin at various depths. The top point of the sphere surface was our target, and its 3D coordinates were known. The participants were invited to perform needle placement with and without AR guidance. Once the participant reported that the needle tip had reached the target, the needle tip location was recorded and compared to the ground truth location of the target, and the difference was the target localization error (TLE). The time of the needle placement was also recorded. We further tested the technical feasibility of the AR system in vivo on a 40-kg swine. RESULTS: The AR guidance system was evaluated by two experienced surgeons and two surgical fellows. The users performed needle placement on a total of 26 targets, 13 with AR and 13 without (i.e., the conventional approach). The average TLE for the conventional and the AR approaches was 14.9 mm and 11.1 mm, respectively. The average needle placement time needed for the conventional and AR approaches was 59.4 s and 22.9 s, respectively. For the animal study, ultrasound image and needle trajectory were successfully fused with the laparoscopic video in real time and presented on a single screen for the surgeons. CONCLUSION: By providing projected needle trajectory, we believe our AR system can assist the surgeon with more efficient and precise needle placement.
PURPOSE: For laparoscopic ablation to be successful, accurate placement of the needle to the tumor is essential. Laparoscopic ultrasound is an essential tool to guide needle placement, but the ultrasound image is generally presented separately from the laparoscopic image. We aim to evaluate an augmented reality (AR) system which combines laparoscopic ultrasound image, laparoscope video, and the needle trajectory in a unified view. METHODS: We created a tissue phantom made of gelatin. Artificial tumors represented by plastic spheres were secured in the gelatin at various depths. The top point of the sphere surface was our target, and its 3D coordinates were known. The participants were invited to perform needle placement with and without AR guidance. Once the participant reported that the needle tip had reached the target, the needle tip location was recorded and compared to the ground truth location of the target, and the difference was the target localization error (TLE). The time of the needle placement was also recorded. We further tested the technical feasibility of the AR system in vivo on a 40-kg swine. RESULTS: The AR guidance system was evaluated by two experienced surgeons and two surgical fellows. The users performed needle placement on a total of 26 targets, 13 with AR and 13 without (i.e., the conventional approach). The average TLE for the conventional and the AR approaches was 14.9 mm and 11.1 mm, respectively. The average needle placement time needed for the conventional and AR approaches was 59.4 s and 22.9 s, respectively. For the animal study, ultrasound image and needle trajectory were successfully fused with the laparoscopic video in real time and presented on a single screen for the surgeons. CONCLUSION: By providing projected needle trajectory, we believe our AR system can assist the surgeon with more efficient and precise needle placement.
Authors: Alfred M Franz; Tamás Haidegger; Wolfgang Birkfellner; Kevin Cleary; Terry M Peters; Lena Maier-Hein Journal: IEEE Trans Med Imaging Date: 2014-05-05 Impact factor: 10.048
Authors: Iswanto Sucandy; Susannah Cheek; Benjamin J Golas; Allan Tsung; David A Geller; James W Marsh Journal: HPB (Oxford) Date: 2016-07-09 Impact factor: 3.647
Authors: David Sindram; Kerri A Simo; Ryan Z Swan; Sharif Razzaque; David J Niemeyer; Ramanathan M Seshadri; Erin Hanna; Iain H McKillop; David A Iannitti; John B Martinie Journal: HPB (Oxford) Date: 2014-09-17 Impact factor: 3.647
Authors: Philip Pratt; Alexander Jaeger; Archie Hughes-Hallett; Erik Mayer; Justin Vale; Ara Darzi; Terry Peters; Guang-Zhong Yang Journal: Int J Comput Assist Radiol Surg Date: 2015-08-25 Impact factor: 2.924