Tobias Frank1, Axel Krieger2, Simon Leonard3, Niravkumar A Patel4, Junichi Tokuda5. 1. Institute of Mechatronic Systems, Gottfried Wilhelm Leibniz Universität Hannover, Appelstrasse 11 a, 30167, Hannover, Germany. tobifr@freenet.de. 2. Sheikh Zayed Institute for Pediatric Surgical Innovation, Childrens National Health System, 111 Michigan Avenue Northwest, Washington, DC, 20010, USA. 3. Department of Computer Science, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD, 21218, USA. 4. Automation and Interventional Medicine (AIM) Laboratory, Worcester Polytechnic Institute, 100 Institute Road, Worcester, MA, 01609, USA. 5. Department of Radiology, Brigham and Womens Hospital and Harvard Medical School, 75 Francis Street, Boston, MA, 02115, USA.
Abstract
PURPOSE: With the growing interest in advanced image-guidance for surgical robot systems, rapid integration and testing of robotic devices and medical image computing software are becoming essential in the research and development. Maximizing the use of existing engineering resources built on widely accepted platforms in different fields, such as robot operating system (ROS) in robotics and 3D Slicer in medical image computing could simplify these tasks. We propose a new open network bridge interface integrated in ROS to ensure seamless cross-platform data sharing. METHODS: A ROS node named ROS-IGTL-Bridge was implemented. It establishes a TCP/IP network connection between the ROS environment and external medical image computing software using the OpenIGTLink protocol. The node exports ROS messages to the external software over the network and vice versa simultaneously, allowing seamless and transparent data sharing between the ROS-based devices and the medical image computing platforms. RESULTS: Performance tests demonstrated that the bridge could stream transforms, strings, points, and images at 30 fps in both directions successfully. The data transfer latency was <1.2 ms for transforms, strings and points, and 25.2 ms for color VGA images. A separate test also demonstrated that the bridge could achieve 900 fps for transforms. Additionally, the bridge was demonstrated in two representative systems: a mock image-guided surgical robot setup consisting of 3D slicer, and Lego Mindstorms with ROS as a prototyping and educational platform for IGT research; and the smart tissue autonomous robot surgical setup with 3D Slicer. CONCLUSION: The study demonstrated that the bridge enabled cross-platform data sharing between ROS and medical image computing software. This will allow rapid and seamless integration of advanced image-based planning/navigation offered by the medical image computing software such as 3D Slicer into ROS-based surgical robot systems.
PURPOSE: With the growing interest in advanced image-guidance for surgical robot systems, rapid integration and testing of robotic devices and medical image computing software are becoming essential in the research and development. Maximizing the use of existing engineering resources built on widely accepted platforms in different fields, such as robot operating system (ROS) in robotics and 3D Slicer in medical image computing could simplify these tasks. We propose a new open network bridge interface integrated in ROS to ensure seamless cross-platform data sharing. METHODS: A ROS node named ROS-IGTL-Bridge was implemented. It establishes a TCP/IP network connection between the ROS environment and external medical image computing software using the OpenIGTLink protocol. The node exports ROS messages to the external software over the network and vice versa simultaneously, allowing seamless and transparent data sharing between the ROS-based devices and the medical image computing platforms. RESULTS: Performance tests demonstrated that the bridge could stream transforms, strings, points, and images at 30 fps in both directions successfully. The data transfer latency was <1.2 ms for transforms, strings and points, and 25.2 ms for color VGA images. A separate test also demonstrated that the bridge could achieve 900 fps for transforms. Additionally, the bridge was demonstrated in two representative systems: a mock image-guided surgical robot setup consisting of 3D slicer, and Lego Mindstorms with ROS as a prototyping and educational platform for IGT research; and the smart tissue autonomous robot surgical setup with 3D Slicer. CONCLUSION: The study demonstrated that the bridge enabled cross-platform data sharing between ROS and medical image computing software. This will allow rapid and seamless integration of advanced image-based planning/navigation offered by the medical image computing software such as 3D Slicer into ROS-based surgical robot systems.
Authors: Jan Egger; Junichi Tokuda; Laurent Chauvin; Bernd Freisleben; Christopher Nimsky; Tina Kapur; William Wells Journal: Int J Med Robot Date: 2012-02-28 Impact factor: 2.547
Authors: Azad Shademan; Ryan S Decker; Justin D Opfermann; Simon Leonard; Axel Krieger; Peter C W Kim Journal: Sci Transl Med Date: 2016-05-04 Impact factor: 17.956
Authors: Simon Drouin; Anna Kochanowska; Marta Kersten-Oertel; Ian J Gerard; Rina Zelmann; Dante De Nigris; Silvain Bériault; Tal Arbel; Denis Sirhan; Abbas F Sadikot; Jeffery A Hall; David S Sinclair; Kevin Petrecca; Rolando F DelMaestro; D Louis Collins Journal: Int J Comput Assist Radiol Surg Date: 2016-08-31 Impact factor: 2.924
Authors: Quoc-Dien Trinh; Jesse Sammon; Maxine Sun; Praful Ravi; Khurshid R Ghani; Marco Bianchi; Wooju Jeong; Shahrokh F Shariat; Jens Hansen; Jan Schmitges; Claudio Jeldres; Craig G Rogers; James O Peabody; Francesco Montorsi; Mani Menon; Pierre I Karakiewicz Journal: Eur Urol Date: 2011-12-22 Impact factor: 20.096
Authors: Andinet Enquobahrie; Patrick Cheng; Kevin Gary; Luis Ibanez; David Gobbi; Frank Lindseth; Ziv Yaniv; Stephen Aylward; Julien Jomier; Kevin Cleary Journal: J Digit Imaging Date: 2007-08-17 Impact factor: 4.056
Authors: Christian Askeland; Ole Vegard Solberg; Janne Beate Lervik Bakeng; Ingerid Reinertsen; Geir Arne Tangen; Erlend Fagertun Hofstad; Daniel Høyer Iversen; Cecilie Våpenstad; Tormod Selbekk; Thomas Langø; Toril A Nagelhus Hernes; Håkon Olav Leira; Geirmund Unsgård; Frank Lindseth Journal: Int J Comput Assist Radiol Surg Date: 2015-09-26 Impact factor: 2.924
Authors: Pedro Moreira; John Grimble; Nicusor Iftimia; Camden P Bay; Kemal Tuncali; Jesung Park; Junichi Tokuda Journal: Med Phys Date: 2021-03-24 Impact factor: 4.071
Authors: Laura Connolly; Anton Deguet; Simon Leonard; Junichi Tokuda; Tamas Ungi; Axel Krieger; Peter Kazanzides; Parvin Mousavi; Gabor Fichtinger; Russell H Taylor Journal: Sensors (Basel) Date: 2022-07-17 Impact factor: 3.847