BACKGROUND: The objective of this study was to investigate whether previous experiences within an anesthesiology-based Objective Structured Clinical Examination (OSCE) assessing communication and professionalism skills was associated with improved performance in a subsequent anesthesiology-based OSCE scenario. METHODS: This retrospective multi-center study used the performance data of 44 Post Graduate Year 4 clinical anesthesia residents from 3 US anesthesiology residency programs on an OSCE scenario that assessed the residents' effectiveness of discussing anesthesiology-specific treatment options with a high-risk patient. Residents from 2 of the programs had no prior anesthesiology-based OSCE experience. Residents from the third program had previously participated in 4 separate multi-scenario anesthesiology-based OSCE sessions in the 2 years prior to this study. Participating residents completed the same scenario at their respective institutions' simulation center. Ten performances were randomly selected for double rating to assess the interrater reliability of the assessments. Interrater reliability was good for the scenario (intraclass correlation coefficient = 0.66, 95% confidence interval = 0.12-0.90). Performance difference between groups with different OSCE experience status were examined using an independent sample t test, with a Wilcoxon-Mann-Whitney test as a sensitivity analysis. RESULTS: Independent sample t test found prior OSCE experience was significantly associated with higher performance scores (t = 2.53, P = .02). The Wilcoxon-Mann-Whitney test result confirmed this finding (z = 3.28, P = .001). CONCLUSIONS: Findings from this study provide preliminary evidence that anesthesiology-based OSCE experience is associated with improved performance in an OSCE scenario, specifically regarding discussions of treatment options with high-risk patients.
BACKGROUND: The objective of this study was to investigate whether previous experiences within an anesthesiology-based Objective Structured Clinical Examination (OSCE) assessing communication and professionalism skills was associated with improved performance in a subsequent anesthesiology-based OSCE scenario. METHODS: This retrospective multi-center study used the performance data of 44 Post Graduate Year 4 clinical anesthesia residents from 3 US anesthesiology residency programs on an OSCE scenario that assessed the residents' effectiveness of discussing anesthesiology-specific treatment options with a high-risk patient. Residents from 2 of the programs had no prior anesthesiology-based OSCE experience. Residents from the third program had previously participated in 4 separate multi-scenario anesthesiology-based OSCE sessions in the 2 years prior to this study. Participating residents completed the same scenario at their respective institutions' simulation center. Ten performances were randomly selected for double rating to assess the interrater reliability of the assessments. Interrater reliability was good for the scenario (intraclass correlation coefficient = 0.66, 95% confidence interval = 0.12-0.90). Performance difference between groups with different OSCE experience status were examined using an independent sample t test, with a Wilcoxon-Mann-Whitney test as a sensitivity analysis. RESULTS: Independent sample t test found prior OSCE experience was significantly associated with higher performance scores (t = 2.53, P = .02). The Wilcoxon-Mann-Whitney test result confirmed this finding (z = 3.28, P = .001). CONCLUSIONS: Findings from this study provide preliminary evidence that anesthesiology-based OSCE experience is associated with improved performance in an OSCE scenario, specifically regarding discussions of treatment options with high-risk patients.
Authors: Robert S Isaak; Fei Chen; Harendra Arora; Susan M Martinelli; David A Zvara; Marjorie P Stiegler Journal: Anesth Analg Date: 2017-09 Impact factor: 5.108
Authors: Robert S Isaak; Fei Chen; Susan M Martinelli; Harendra Arora; David A Zvara; Gene Hobbs; Marjorie P Stiegler Journal: Simul Healthc Date: 2018-06 Impact factor: 1.929
Authors: Musa Cömert; Jördis Maria Zill; Eva Christalle; Jörg Dirmaier; Martin Härter; Isabelle Scholl Journal: PLoS One Date: 2016-03-31 Impact factor: 3.240