OBJECTIVE: While standardized patients (SPs) remain the gold standard for assessing clinical competence in a standardized setting, clinical case vignettes that allow free-text, open-ended written responses are more resource- and time-efficient assessment tools. It remains unknown, however, whether this is a valid method for assessing competence in the management of agitation. METHODS:Twenty-six psychiatry residents partook in a randomized controlled study evaluating a simulation-based teaching intervention on the management of agitated patients. Competence in the management of agitation was assessed using three separate modalities: simulation with SPs, open-ended clinical vignettes, and self-report questionnaires. RESULTS: Performance on clinical vignettes correlated significantly with SP-based assessments (r = 0.59, p = 0.002); self-report questionnaires that assessed one's own ability to manage agitation did not correlate with SP-based assessments (r = -0.06, p = 0.77). CONCLUSIONS: Standardized clinical vignettes may be a simple, time-efficient, and valid tool for assessing residents' competence in the management of agitation.
RCT Entities:
OBJECTIVE: While standardized patients (SPs) remain the gold standard for assessing clinical competence in a standardized setting, clinical case vignettes that allow free-text, open-ended written responses are more resource- and time-efficient assessment tools. It remains unknown, however, whether this is a valid method for assessing competence in the management of agitation. METHODS: Twenty-six psychiatry residents partook in a randomized controlled study evaluating a simulation-based teaching intervention on the management of agitated patients. Competence in the management of agitation was assessed using three separate modalities: simulation with SPs, open-ended clinical vignettes, and self-report questionnaires. RESULTS: Performance on clinical vignettes correlated significantly with SP-based assessments (r = 0.59, p = 0.002); self-report questionnaires that assessed one's own ability to manage agitation did not correlate with SP-based assessments (r = -0.06, p = 0.77). CONCLUSIONS: Standardized clinical vignettes may be a simple, time-efficient, and valid tool for assessing residents' competence in the management of agitation.