Long Qian1,2, Alexander Barthel3,4, Alex Johnson5, Greg Osgood5, Peter Kazanzides6, Nassir Navab3,4, Bernhard Fuerst3. 1. Computer Aided Medical Procedures, Johns Hopkins University, Baltimore, MD, USA. camp@jhu.edu. 2. Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA. camp@jhu.edu. 3. Computer Aided Medical Procedures, Johns Hopkins University, Baltimore, MD, USA. 4. Computer Aided Medical Procedures, Technische Universität München, Munich, Germany. 5. Department of Orthopaedic Surgery, Johns Hopkins Hospital, Baltimore, MD, USA. 6. Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA.
Abstract
PURPOSE: Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information. METHODS: Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance. RESULTS: Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario. CONCLUSIONS: With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.
PURPOSE: Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information. METHODS: Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance. RESULTS: Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario. CONCLUSIONS: With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.
Entities:
Keywords:
Intervention; Mixed reality; Optical see-through head-mounted display; User study
Authors: Leanne Coyne; Thayer A Merritt; Brittany L Parmentier; Rachel A Sharpton; Jody K Takemoto Journal: Am J Pharm Educ Date: 2019-04 Impact factor: 2.047
Authors: Jacob T Gibby; Samuel A Swenson; Steve Cvetko; Raj Rao; Ramin Javan Journal: Int J Comput Assist Radiol Surg Date: 2018-06-22 Impact factor: 2.924
Authors: Sebastian Andress; Alex Johnson; Mathias Unberath; Alexander Felix Winkler; Kevin Yu; Javad Fotouhi; Simon Weidert; Greg Osgood; Nassir Navab Journal: J Med Imaging (Bellingham) Date: 2018-01-26
Authors: Cristina M Morales Mojica; Jose D Velazco-Garcia; Eleftherios P Pappas; Theodosios A Birbilis; Aaron Becker; Ernst L Leiss; Andrew Webb; Ioannis Seimenis; Nikolaos V Tsekos Journal: J Digit Imaging Date: 2021-05-23 Impact factor: 4.903
Authors: Sara Condino; Giuseppe Turini; Paolo D Parchi; Rosanna M Viglialoro; Nicola Piolanti; Marco Gesi; Mauro Ferrari; Vincenzo Ferrari Journal: J Healthc Eng Date: 2018-11-01 Impact factor: 2.682