OBJECTIVES: The aim of this article was to identify and prospectively investigate simulated ultrasound-guided targeted liver biopsy performance metrics as differentiators between levels of expertise in interventional radiology. METHODS: Task analysis produced detailed procedural step documentation allowing identification of critical procedure steps and performance metrics for use in a virtual reality ultrasound-guided targeted liver biopsy procedure. Consultant (n=14; male=11, female=3) and trainee (n=26; male=19, female=7) scores on the performance metrics were compared. Ethical approval was granted by the Liverpool Research Ethics Committee (UK). Independent t-tests and analysis of variance (ANOVA) investigated differences between groups. RESULTS: Independent t-tests revealed significant differences between trainees and consultants on three performance metrics: targeting, p=0.018, t=-2.487 (-2.040 to -0.207); probe usage time, p = 0.040, t=2.132 (11.064 to 427.983); mean needle length in beam, p=0.029, t=-2.272 (-0.028 to -0.002). ANOVA reported significant differences across years of experience (0-1, 1-2, 3+ years) on seven performance metrics: no-go area touched, p=0.012; targeting, p=0.025; length of session, p=0.024; probe usage time, p=0.025; total needle distance moved, p=0.038; number of skin contacts, p<0.001; total time in no-go area, p=0.008. More experienced participants consistently received better performance scores on all 19 performance metrics. CONCLUSION: It is possible to measure and monitor performance using simulation, with performance metrics providing feedback on skill level and differentiating levels of expertise. However, a transfer of training study is required.
OBJECTIVES: The aim of this article was to identify and prospectively investigate simulated ultrasound-guided targeted liver biopsy performance metrics as differentiators between levels of expertise in interventional radiology. METHODS: Task analysis produced detailed procedural step documentation allowing identification of critical procedure steps and performance metrics for use in a virtual reality ultrasound-guided targeted liver biopsy procedure. Consultant (n=14; male=11, female=3) and trainee (n=26; male=19, female=7) scores on the performance metrics were compared. Ethical approval was granted by the Liverpool Research Ethics Committee (UK). Independent t-tests and analysis of variance (ANOVA) investigated differences between groups. RESULTS: Independent t-tests revealed significant differences between trainees and consultants on three performance metrics: targeting, p=0.018, t=-2.487 (-2.040 to -0.207); probe usage time, p = 0.040, t=2.132 (11.064 to 427.983); mean needle length in beam, p=0.029, t=-2.272 (-0.028 to -0.002). ANOVA reported significant differences across years of experience (0-1, 1-2, 3+ years) on seven performance metrics: no-go area touched, p=0.012; targeting, p=0.025; length of session, p=0.024; probe usage time, p=0.025; total needle distance moved, p=0.038; number of skin contacts, p<0.001; total time in no-go area, p=0.008. More experienced participants consistently received better performance scores on all 19 performance metrics. CONCLUSION: It is possible to measure and monitor performance using simulation, with performance metrics providing feedback on skill level and differentiating levels of expertise. However, a transfer of training study is required.
Authors: Tiffany Grunwald; Dick Clark; Scott S Fisher; Margaret McLaughlin; Shrikanth Narayanan; Diane Piepol Journal: Stud Health Technol Inform Date: 2004
Authors: Derek A Gould; Jim A Reekers; David O Kessel; Nick C Chalmers; Marc Sapoval; Aalpen A Patel; Gary J Becker; Mick J Lee; Luc Stockx Journal: J Vasc Interv Radiol Date: 2006-02 Impact factor: 3.464
Authors: Isabelle Van Herzeele; Rajesh Aggarwal; Andrew Choong; Robert Brightwell; Frank E Vermassen; Nicholas J Cheshire Journal: J Vasc Surg Date: 2007-11 Impact factor: 4.268
Authors: George C Velmahos; Konstantinos G Toutouzas; Lelan F Sillin; Linda Chan; Richard E Clark; Demetrios Theodorou; Fredric Maupin Journal: Am J Surg Date: 2004-01 Impact factor: 2.565
Authors: P F Villard; F P Vidal; L ap Cenydd; R Holbrey; S Pisharody; S Johnson; A Bulpitt; N W John; F Bello; D Gould Journal: Int J Comput Assist Radiol Surg Date: 2013-07-24 Impact factor: 2.924