OBJECTIVES: Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. METHODS: Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. RESULTS: There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p < 0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. CONCLUSIONS: Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.
OBJECTIVES: Traditionally, technical skills proficiency has been assessed by direct observation. While direct observation and feedback are essential components in technical skills learning, they demand considerable investment of faculty time, and as an assessment tool, direct observation is inherently subjective and has been criticized as unreliable. The purpose of this study was to determine if quantitative electromagnetic motion tracking is feasible and can discriminate between experts and nonexperts during simulated ultrasound (US)-guided insertion of a central venous catheter (CVC) guidewire. METHODS: Ten nonexperts (junior emergency medicine residents) and 10 experts (critical care fellows or attending physicians) were recruited. Electromagnetic sensor probes were used to capture hand motion during an US-guided internal jugular cannulation on a standardized manikin. Hand, US, and needle motion were analyzed for the following metrics: total path length, total time, translational movements, and rotational movements. Subjects were also videotaped and evaluated using a modified, validated global rating scale (GRS) by a blinded expert. RESULTS: There was a significant difference in almost all examined motion parameters between experts and nonexperts. Experts took 66% less time (50.2 seconds vs. 148.7 seconds, p < 0.001) and had significantly less right-hand and US motion (total path length and translational and rotational movements). Left-hand total path length was the only parameter that was not significantly different between groups. Concurrent validity of motion parameters was established by strong correlations (r2 > 0.74) to a previously published, modified GRS. CONCLUSIONS: Electromagnetic hand and instrument motion analysis is technically feasible for assessing competence in US-guided insertion of a CVC guidewire in a simulation setting. In showing that it discriminates between the performances of nonexperts and experts, this study has provided evidence for construct validity. It also shows excellent correlation with a modified version of a previously validated GRS, providing evidence of concurrent validity.
Authors: Hong-En Chen; Mary A Yovanoff; David F Pepley; Rohan S Prabhu; Cheyenne C Sonntag; David C Han; Jason Z Moore; Scarlett R Miller Journal: J Surg Res Date: 2018-09-08 Impact factor: 2.192
Authors: Ross Prager; Paul Pageau; Timothy Hodges; Christina Yan; Michael Woo; Marie-Joe Nemnom; Scott Millington; Matthew Holden; Raphael St-Gelais; Warren J Cheung Journal: AEM Educ Train Date: 2022-04-01
Authors: Daniel J Ackil; Amanda Toney; Ryan Good; David Ross; Rocco Germano; Linda Sabbadini; Molly Thiessen; Colin Bell; John L Kendall Journal: AEM Educ Train Date: 2020-12-15
Authors: Kivanc Atesok; Peter MacDonald; Jeff Leiter; James Dubberley; Richard Satava; Ann VanHeest; Shepard Hurwitz; J Lawrence Marsh Journal: World J Orthop Date: 2017-04-18
Authors: Viviana M Serra López; Rikesh A Gandhi; David P Falk; Josh R Baxter; John R Lien; Benjamin L Gray Journal: J Hand Surg Glob Online Date: 2021-06-04
Authors: Marcia A Corvetto; Carlos Fuentes; Andrea Araneda; Pablo Achurra; Pablo Miranda; Paola Viviani; Fernando R Altermatt Journal: BMC Anesthesiol Date: 2017-09-29 Impact factor: 2.217