BACKGROUND: Central venous catheterization (CVC) is associated with patient risks known to be inversely related to clinician experience. We developed and evaluated a performance assessment tool for use in a simulation-based central line workshop. We hypothesized that instrument scores would discriminate between less experienced and more experienced clinicians. METHODS: Participants included trainees enrolled in an institutionally mandated CVC workshop and a convenience sample of faculty attending physicians. The workshop integrated several experiential learning techniques, including practice on cadavers and part-task trainers. A group of clinical and education experts developed a 15-point CVC Proficiency Scale using national and institutional guidelines. After the workshop, participants completed a certification exercise in which they independently performed a CVC in a part-task trainer. Two authors reviewed videotapes of the certification exercise to rate performance using the CVC Proficiency Scale. Participants were grouped by self-reported CVC experience. RESULTS: One hundred and five participants (92 trainees and 13 attending physicians) participated. Interrater reliability on a subset of 40 videos was 0.71, and Cronbach a was 0.81. The CVC Proficiency Scale Composite score varied significantly by experience: mean of 85%, median of 87% (range 47%-100%) for low experience (0-1 CVCs in the last 2 years, n = 27); mean of 88%, median of 87% (range 60%-100%) for moderate experience (2-49 CVCs, n = 62); and mean of 94%, median of 93% (range 73%-100%) for high experience (> 49 CVCs, n = 16) (P = .02, comparing low and high experience). CONCLUSIONS: Evidence from multiple sources, including appropriate content, high interrater and internal consistency reliability, and confirmation of hypothesized relations to other variables, supports the validity of using scores from this 15-item scale for assessing trainee proficiency following a central line workshop.
BACKGROUND: Central venous catheterization (CVC) is associated with patient risks known to be inversely related to clinician experience. We developed and evaluated a performance assessment tool for use in a simulation-based central line workshop. We hypothesized that instrument scores would discriminate between less experienced and more experienced clinicians. METHODS:Participants included trainees enrolled in an institutionally mandated CVC workshop and a convenience sample of faculty attending physicians. The workshop integrated several experiential learning techniques, including practice on cadavers and part-task trainers. A group of clinical and education experts developed a 15-point CVC Proficiency Scale using national and institutional guidelines. After the workshop, participants completed a certification exercise in which they independently performed a CVC in a part-task trainer. Two authors reviewed videotapes of the certification exercise to rate performance using the CVC Proficiency Scale. Participants were grouped by self-reported CVC experience. RESULTS: One hundred and five participants (92 trainees and 13 attending physicians) participated. Interrater reliability on a subset of 40 videos was 0.71, and Cronbach a was 0.81. The CVC Proficiency Scale Composite score varied significantly by experience: mean of 85%, median of 87% (range 47%-100%) for low experience (0-1 CVCs in the last 2 years, n = 27); mean of 88%, median of 87% (range 60%-100%) for moderate experience (2-49 CVCs, n = 62); and mean of 94%, median of 93% (range 73%-100%) for high experience (> 49 CVCs, n = 16) (P = .02, comparing low and high experience). CONCLUSIONS: Evidence from multiple sources, including appropriate content, high interrater and internal consistency reliability, and confirmation of hypothesized relations to other variables, supports the validity of using scores from this 15-item scale for assessing trainee proficiency following a central line workshop.
Authors: Hong-En Chen; Mary A Yovanoff; David F Pepley; Rohan S Prabhu; Cheyenne C Sonntag; David C Han; Jason Z Moore; Scarlett R Miller Journal: J Surg Res Date: 2018-09-08 Impact factor: 2.192
Authors: David Ryan Stather; Alex Chee; Paul Maceachern; Elaine Dumoulin; Christopher A Hergott; Jacob Gelberg; Sandra D Scott; Sylvia De Guzman; Alain Tremblay Journal: Can Respir J Date: 2013-05-28 Impact factor: 2.409
Authors: Joshua D Lenchus; Cristiane Mocelin Carvalho; Kaitlyn Ferreri; Jill Steiner Sanko; Kristopher L Arheart; Maureen Fitzpatrick; S Barry Issenberg Journal: J Grad Med Educ Date: 2013-12
Authors: Mary Yovanoff; David Pepley; Katelin Mirkin; Jason Moore; David Han; Scarlett Miller Journal: Proc Hum Factors Ergon Soc Annu Meet Date: 2017-09-28
Authors: William C McGaghie; Timothy J Draycott; William F Dunn; Connie M Lopez; Dimitrios Stefanidis Journal: Simul Healthc Date: 2011-08 Impact factor: 1.929