Heather L Evans1, Dylan J O'Shea2, Amy E Morris3, Kari A Keys2, Andrew S Wright2, Douglas C Schaad4, Jonathan S Ilgen5. 1. Department of Surgery, Harborview Medical Center, University of Washington, 325 Ninth Avenue, Box 359796, Seattle, WA, 98104, USA. Electronic address: hlevans@uw.edu. 2. Department of Surgery, Harborview Medical Center, University of Washington, 325 Ninth Avenue, Box 359796, Seattle, WA, 98104, USA. 3. Department of Medicine, University of Washington, Seattle, WA, USA. 4. Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, WA, USA. 5. Department of Medicine, University of Washington, Seattle, WA, USA; Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, WA, USA.
Abstract
BACKGROUND: This pilot study assessed the feasibility of using first person (1P) video recording with Google Glass (GG) to assess procedural skills, as compared with traditional third person (3P) video. We hypothesized that raters reviewing 1P videos would visualize more procedural steps with greater inter-rater reliability than 3P rating vantages. METHODS: Seven subjects performed simulated internal jugular catheter insertions. Procedures were recorded by both Google Glass and an observer's head-mounted camera. Videos were assessed by 3 expert raters using a task-specific checklist (CL) and both an additive- and summative-global rating scale (GRS). Mean scores were compared by t-tests. Inter-rater reliabilities were calculated using intraclass correlation coefficients. RESULTS: The 1P vantage was associated with a significantly higher mean CL score than the 3P vantage (7.9 vs 6.9, P = .02). Mean GRS scores were not significantly different. Mean inter-rater reliabilities for the CL, additive-GRS, and summative-GRS were similar between vantages. CONCLUSIONS: 1P vantage recordings may improve visualization of tasks for behaviorally anchored instruments (eg, CLs), whereas maintaining similar global ratings and inter-rater reliability when compared with conventional 3P vantage recordings.
BACKGROUND: This pilot study assessed the feasibility of using first person (1P) video recording with Google Glass (GG) to assess procedural skills, as compared with traditional third person (3P) video. We hypothesized that raters reviewing 1P videos would visualize more procedural steps with greater inter-rater reliability than 3P rating vantages. METHODS: Seven subjects performed simulated internal jugular catheter insertions. Procedures were recorded by both Google Glass and an observer's head-mounted camera. Videos were assessed by 3 expert raters using a task-specific checklist (CL) and both an additive- and summative-global rating scale (GRS). Mean scores were compared by t-tests. Inter-rater reliabilities were calculated using intraclass correlation coefficients. RESULTS: The 1P vantage was associated with a significantly higher mean CL score than the 3P vantage (7.9 vs 6.9, P = .02). Mean GRS scores were not significantly different. Mean inter-rater reliabilities for the CL, additive-GRS, and summative-GRS were similar between vantages. CONCLUSIONS: 1P vantage recordings may improve visualization of tasks for behaviorally anchored instruments (eg, CLs), whereas maintaining similar global ratings and inter-rater reliability when compared with conventional 3P vantage recordings.
Authors: H Borgmann; M Rodríguez Socarrás; J Salem; I Tsaur; J Gomez Rivas; E Barret; L Tortolero Journal: World J Urol Date: 2016-10-19 Impact factor: 4.226
Authors: Effie Singas; Luis D Quintero; Sean Dhar; Adey Tsegaye; Kayla Finuf; Renee Pekmezaris; Maya S Weitzen; Paul H Mayo Journal: ATS Sch Date: 2021-10-29