Literature DB >> 36269364

Augmented reality during parotid surgery: real-life evaluation of voice control of a head mounted display.

Claudia Scherl1, David Männle2, Nicole Rotter2, Jürgen Hesser3, Jan Stallkamp3, Tobias Balkenhol2, Lena Huber2, Benedikt Kramer2, Anne Lammert2, Annette Affolter2.   

Abstract

PURPOSE: Augmented Reality can improve surgical planning and performance in parotid surgery. For easier application we implemented a voice control manual for our augmented reality system. The aim of the study was to evaluate the feasibility of the voice control in real-life situations.
METHODS: We used the HoloLens 1® (Microsoft Corporation) with a special speech recognition software for parotid surgery. The evaluation took place in a audiometry cubicle and during real surgical procedures. Voice commands were used to display various 3D structures of the patient with the HoloLens 1®. Commands had different variations (male/female, 65 dB SPL)/louder, various structures).
RESULTS: In silence, 100% of commands were recognized. If the volume of the operation room (OR) background noise exceeds 42 dB, the recognition rate decreases significantly, and it drops below 40% at > 60 dB SPL. With constant speech volume at 65 dB SPL male speakers had a significant better recognition rate than female speakers (p = 0.046). Higher speech volumes can compensate this effect. The recognition rate depends on the type of background noise. Mixed OR noise (52 dB(A)) reduced the detection rate significantly compared to single suction noise at 52 dB(A) (p ≤ 0.00001). The recognition rate was significantly better in the OR than in the audio cubicle (p = 0.00013 both genders, 0.0086 female, and 0.0036 male).
CONCLUSIONS: The recognition rate of voice commands can be enhanced by increasing the speech volume and by singularizing ambient noises. The detection rate depends on the loudness of the OR noise. Male voices are understood significantly better than female voices.
© 2022. The Author(s).

Entities:  

Keywords:  Augmented reality; Head mounted display; HoloLens; Parotid surgery; Salivary glands; Voice control

Year:  2022        PMID: 36269364     DOI: 10.1007/s00405-022-07699-8

Source DB:  PubMed          Journal:  Eur Arch Otorhinolaryngol        ISSN: 0937-4477            Impact factor:   3.236


  16 in total

1.  Stereoscopic head-mounted display incorporated into microsurgical procedures: technical note.

Authors:  M L Levy; J C Chen; K Moffitt; Z Corber; J G McComb
Journal:  Neurosurgery       Date:  1998-08       Impact factor: 4.654

2.  Augmented Reality Robot-assisted Radical Prostatectomy: Preliminary Experience.

Authors:  Francesco Porpiglia; Cristian Fiori; Enrico Checcucci; Daniele Amparore; Riccardo Bertolo
Journal:  Urology       Date:  2018-03-13       Impact factor: 2.649

3.  Large-scale Exploration of Neuronal Morphologies Using Deep Learning and Augmented Reality.

Authors:  Zhongyu Li; Erik Butler; Kang Li; Aidong Lu; Shuiwang Ji; Shaoting Zhang
Journal:  Neuroinformatics       Date:  2018-10

4.  Endoscopic navigation system with extended field of view using augmented reality technology.

Authors:  Jae Hwan Bong; Hyun-Jong Song; Yoojin Oh; Namji Park; Hyungmin Kim; Shinsuk Park
Journal:  Int J Med Robot       Date:  2017-12-28       Impact factor: 2.547

5.  Augmented Reality with HoloLens® in Parotid Tumor Surgery: A Prospective Feasibility Study.

Authors:  Claudia Scherl; Johanna Stratemeier; Nicole Rotter; Jürgen Hesser; Stefan O Schönberg; Jérôme J Servais; David Männle; Anne Lammert
Journal:  ORL J Otorhinolaryngol Relat Spec       Date:  2021-03-30       Impact factor: 1.538

6.  HoloUS: Augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures.

Authors:  Trong Nguyen; William Plishker; Andrew Matisoff; Karun Sharma; Raj Shekhar
Journal:  Int J Comput Assist Radiol Surg       Date:  2021-11-24       Impact factor: 2.924

7.  Augmented reality with HoloLens in parotid surgery: how to assess and to improve accuracy.

Authors:  Claudia Scherl; Johanna Stratemeier; Celine Karle; Nicole Rotter; Jürgen Hesser; Lena Huber; Andre Dias; Oliver Hoffmann; Philipp Riffel; Stefan O Schoenberg; Angela Schell; Anne Lammert; Annette Affolter; David Männle
Journal:  Eur Arch Otorhinolaryngol       Date:  2020-09-10       Impact factor: 2.503

8.  A Holographic Augmented Reality Interface for Visualizing of MRI Data and Planning of Neurosurgical Procedures.

Authors:  Cristina M Morales Mojica; Jose D Velazco-Garcia; Eleftherios P Pappas; Theodosios A Birbilis; Aaron Becker; Ernst L Leiss; Andrew Webb; Ioannis Seimenis; Nikolaos V Tsekos
Journal:  J Digit Imaging       Date:  2021-05-23       Impact factor: 4.903

9.  An augmented reality system for image guidance of transcatheter procedures for structural heart disease.

Authors:  Jun Liu; Subhi J Al'Aref; Gurpreet Singh; Alexandre Caprio; Amir Ali Amiri Moghadam; Sun-Joo Jang; S Chiu Wong; James K Min; Simon Dunham; Bobak Mosadegh
Journal:  PLoS One       Date:  2019-07-01       Impact factor: 3.240

10.  Augmented Reality in Medical Practice: From Spine Surgery to Remote Assistance.

Authors:  Fabio Cofano; Giuseppe Di Perna; Marco Bozzaro; Alessandro Longo; Nicola Marengo; Francesco Zenga; Nicola Zullo; Matteo Cavalieri; Luca Damiani; Daniya J Boges; Marco Agus; Diego Garbossa; Corrado Calì
Journal:  Front Surg       Date:  2021-03-30
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.