Risto Kojcev1,2, Bernhard Fuerst3,4, Oliver Zettinig4, Javad Fotouhi3, Sing Chun Lee3, Benjamin Frisch4, Russell Taylor5, Edoardo Sinibaldi6, Nassir Navab3,4. 1. Computer Aided Medical Procedures, Johns Hopkins University, Baltimore, MD, USA. risto.kojcev@iit.it. 2. Center for Micro-BioRobotics, Istituto Italiano di Tecnologia, Pontedera, PI, Italy. risto.kojcev@iit.it. 3. Computer Aided Medical Procedures, Johns Hopkins University, Baltimore, MD, USA. 4. Computer Aided Medical Procedures, Technische Universität München, Munich, Germany. 5. Laboratory of Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA. 6. Center for Micro-BioRobotics, Istituto Italiano di Tecnologia, Pontedera, PI, Italy.
Abstract
PURPOSE: Precise needle placement is an important task during several medical procedures. Ultrasound imaging is often used to guide the needle toward the target region in soft tissue. This task remains challenging due to the user's dependence on image quality, limited field of view, moving target, and moving needle. In this paper, we present a novel dual-robot framework for robotic needle insertions under robotic ultrasound guidance. METHOD: We integrated force-controlled ultrasound image acquisition, registration of preoperative and intraoperative images, vision-based robot control, and target localization, in combination with a novel needle tracking algorithm. The framework allows robotic needle insertion to target a preoperatively defined region of interest while enabling real-time visualization and adaptive trajectory planning to provide safe and quick interactions. We assessed the framework by considering both static and moving targets embedded in water and tissue-mimicking gelatin. RESULTS: The presented dual-robot tracking algorithms allow for accurate needle placement, namely to target the region of interest with an error around 1 mm. CONCLUSION: To the best of our knowledge, we show the first use of two independent robots, one for imaging, the other for needle insertion, that are simultaneously controlled using image processing algorithms. Experimental results show the feasibility and demonstrate the accuracy and robustness of the process.
PURPOSE: Precise needle placement is an important task during several medical procedures. Ultrasound imaging is often used to guide the needle toward the target region in soft tissue. This task remains challenging due to the user's dependence on image quality, limited field of view, moving target, and moving needle. In this paper, we present a novel dual-robot framework for robotic needle insertions under robotic ultrasound guidance. METHOD: We integrated force-controlled ultrasound image acquisition, registration of preoperative and intraoperative images, vision-based robot control, and target localization, in combination with a novel needle tracking algorithm. The framework allows robotic needle insertion to target a preoperatively defined region of interest while enabling real-time visualization and adaptive trajectory planning to provide safe and quick interactions. We assessed the framework by considering both static and moving targets embedded in water and tissue-mimicking gelatin. RESULTS: The presented dual-robot tracking algorithms allow for accurate needle placement, namely to target the region of interest with an error around 1 mm. CONCLUSION: To the best of our knowledge, we show the first use of two independent robots, one for imaging, the other for needle insertion, that are simultaneously controlled using image processing algorithms. Experimental results show the feasibility and demonstrate the accuracy and robustness of the process.
Entities:
Keywords:
Instrument and patient localization and tracking; Robotic architecture and devices; Robotic system and software; Robotics; Software architecture; Ultrasound
Authors: S A Curley; F Izzo; P Delrio; L M Ellis; J Granchi; P Vallone; F Fiore; S Pignata; B Daniele; F Cremona Journal: Ann Surg Date: 1999-07 Impact factor: 12.969
Authors: Sasha N Bhan; Stephen E Pautler; Bobby Shayegan; Maurice D Voss; Ron A Goeree; John J You Journal: Ann Surg Oncol Date: 2013-05-30 Impact factor: 5.344
Authors: Risto Kojcev; Ashkan Khakzar; Bernhard Fuerst; Oliver Zettinig; Carole Fahkry; Robert DeJong; Jeremy Richmon; Russell Taylor; Edoardo Sinibaldi; Nassir Navab Journal: Int J Comput Assist Radiol Surg Date: 2017-03-20 Impact factor: 2.924
Authors: Lukas Lindenroth; Richard James Housden; Shuangyi Wang; Junghwan Back; Kawal Rhode; Hongbin Liu Journal: IEEE Trans Biomed Eng Date: 2019-12-04 Impact factor: 4.538