Trong Nguyen1, William Plishker2, Andrew Matisoff1, Karun Sharma1, Raj Shekhar3. 1. Children's National Hospital, Washington, DC, USA. 2. IGI Technologies, Inc., Silver Spring, MD, USA. 3. Children's National Hospital, Washington, DC, USA. rshekhar@childrensnational.org.
Abstract
PURPOSE: Microsoft HoloLens is a pair of augmented reality (AR) smart glasses that could improve the intraprocedural visualization of ultrasound-guided procedures. With the wearable HoloLens headset, an ultrasound image can be virtually rendered and registered with the ultrasound transducer and placed directly in the practitioner's field of view. METHODS: A custom application, called HoloUS, was developed using the HoloLens and a portable ultrasound machine connected through a wireless network. A custom 3D-printed case with an AR-pattern for the ultrasound transducer permitted ultrasound image tracking and registration. Voice controls on the HoloLens supported the scaling and movement of the ultrasound image as desired. The ultrasound images were streamed and displayed in real-time. A user study was performed to assess the effectiveness of the HoloLens as an alternative display platform. Novices and experts were timed on tasks involving targeting simulated vessels using a needle in a custom phantom. RESULTS: Technical characterization of the HoloUS app was conducted using frame rate, tracking accuracy, and latency as performance metrics. The app ran at 25 frames/s, had an 80-ms latency, and could track the transducer with an average reprojection error of 0.0435 pixels. With AR visualization, the novices' times improved by 17% but the experts' times decreased slightly by 5%, which may reflect the experts' training and experience bias. CONCLUSION: The HoloUS application was found to enhance user experience and simplify hand-eye coordination. By eliminating the need to alternately observe the patient and the ultrasound images presented on a separate monitor, the proposed AR application has the potential to improve efficiency and effectiveness of ultrasound-guided procedures.
PURPOSE: Microsoft HoloLens is a pair of augmented reality (AR) smart glasses that could improve the intraprocedural visualization of ultrasound-guided procedures. With the wearable HoloLens headset, an ultrasound image can be virtually rendered and registered with the ultrasound transducer and placed directly in the practitioner's field of view. METHODS: A custom application, called HoloUS, was developed using the HoloLens and a portable ultrasound machine connected through a wireless network. A custom 3D-printed case with an AR-pattern for the ultrasound transducer permitted ultrasound image tracking and registration. Voice controls on the HoloLens supported the scaling and movement of the ultrasound image as desired. The ultrasound images were streamed and displayed in real-time. A user study was performed to assess the effectiveness of the HoloLens as an alternative display platform. Novices and experts were timed on tasks involving targeting simulated vessels using a needle in a custom phantom. RESULTS: Technical characterization of the HoloUS app was conducted using frame rate, tracking accuracy, and latency as performance metrics. The app ran at 25 frames/s, had an 80-ms latency, and could track the transducer with an average reprojection error of 0.0435 pixels. With AR visualization, the novices' times improved by 17% but the experts' times decreased slightly by 5%, which may reflect the experts' training and experience bias. CONCLUSION: The HoloUS application was found to enhance user experience and simplify hand-eye coordination. By eliminating the need to alternately observe the patient and the ultrasound images presented on a separate monitor, the proposed AR application has the potential to improve efficiency and effectiveness of ultrasound-guided procedures.
Authors: Michael Rosenthal; Andrei State; Joohi Lee; Gentaro Hirota; Jeremy Ackerman; Kurtis Keller; Etta Pisano; Michael Jiroutek; Keith Muller; Henry Fuchs Journal: Med Image Anal Date: 2002-09 Impact factor: 8.545
Authors: Atif Shafqat; Eamonn Ferguson; Vishal Thanawala; Nigel M Bedforth; Jonathan G Hardman; Robert A McCahon Journal: Anesthesiology Date: 2015-11 Impact factor: 7.892
Authors: Verónica García-Vázquez; Felix von Haxthausen; Sonja Jäckle; Christian Schumann; Ivo Kuhlemann; Juljan Bouchagiar; Anna-Catharina Höfer; Florian Matysiak; Gereon Hüttmann; Jan Peter Goltz; Markus Kleemann; Floris Ernst; Marco Horn Journal: Innov Surg Sci Date: 2018-10-04
Authors: Christoph Rüger; Markus A Feufel; Simon Moosburner; Christopher Özbek; Johann Pratschke; Igor M Sauer Journal: Int J Comput Assist Radiol Surg Date: 2020-07-28 Impact factor: 2.924
Authors: Felix von Haxthausen; Rafael Moreta-Martinez; Alicia Pose Díez de la Lastra; Javier Pascau; Floris Ernst Journal: Int J Comput Assist Radiol Surg Date: 2022-07-01 Impact factor: 3.421