John Q Young1, Caitlin Hasser, Erick K Hung, Martin Kusz, Patricia S O'Sullivan, Colin Stewart, Andrea Weiss, Nancy Williams. 1. J.Q. Young is professor, Department of Psychiatry, Zucker School of Medicine at Hofstra/Northwell, New York, New York. C. Hasser is assistant professor, Department of Psychiatry, UCSF School of Medicine, San Francisco, California. E.K. Hung is associate professor, Department of Psychiatry, UCSF School of Medicine, San Francisco, California. M. Kusz is research assistant, Department of Psychiatry, Hofstra Northwell School of Medicine, New York, New York. P.S. O'Sullivan is professor, Department of Medicine and Surgery, UCSF School of Medicine, San Francisco, California. C. Stewart is assistant professor, Department of Psychiatry, Georgetown School of Medicine, Washington, DC. A. Weiss is associate professor, Department of Psychiatry and Behavioral Sciences, Albert Einstein School of Medicine, New York, New York. N. Williams is professor, Department of Psychiatry, University of Iowa Carver College of Medicine, Iowa City, Iowa.
Abstract
PURPOSE: To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. METHOD: A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. RESULTS: Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. CONCLUSIONS: The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.
PURPOSE: To develop entrustable professional activities (EPAs) for psychiatry and to demonstrate an innovative, validity-enhancing methodology that may be relevant to other specialties. METHOD: A national task force employed a three-stage process from May 2014 to February 2017 to develop EPAs for psychiatry. In stage 1, the task force used an iterative consensus-driven process to construct proposed EPAs. Each included a title, full description, and relevant competencies. In stage 2, the task force interviewed four nonpsychiatric experts in EPAs and further revised the EPAs. In stage 3, the task force performed a Delphi study of national experts in psychiatric education and assessment. All survey participants completed a brief training program on EPAs. Quantitative and qualitative analysis led to further modifications. Essentialness was measured on a five-point scale. EPAs were included if the content validity index was at least 0.8 and the lower end of the asymmetric confidence interval was not lower than 4.0. RESULTS: Stages 1 and 2 yielded 24 and 14 EPAs, respectively. In stage 3, 31 of the 39 invited experts participated in both rounds of the Delphi study. Round 1 reduced the proposed EPAs to 13. Ten EPAs met the inclusion criteria in Round 2. CONCLUSIONS: The final EPAs provide a strong foundation for competency-based assessment in psychiatry. Methodological features such as critique by nonpsychiatry experts, a national Delphi study with frame-of-reference training, and stringent inclusion criteria strengthen the content validity of the findings and may serve as a model for future efforts in other specialties.
Authors: Marije P Hennus; Anneliese Nusmeier; Gwen G M van Heesch; Maaike A Riedijk; Nikki J Schoenmaker; Marijn Soeteman; Enno D Wildschut; Tim Fawns; Olle Ten Cate Journal: PLoS One Date: 2021-03-18 Impact factor: 3.240
Authors: Daniel J Schumacher; Daniel C West; Alan Schwartz; Su-Ting Li; Leah Millstein; Elena C Griego; Teri Turner; Bruce E Herman; Robert Englander; Joni Hemond; Valera Hudson; Lauren Newhall; Kenya McNeal Trice; Julie Baughn; Erin Giudice; Hannah Famiglietti; Jonathan Tolentino; Kimberly Gifford; Carol Carraccio Journal: JAMA Netw Open Date: 2020-01-03