Chris Roberts1, Priya Khanna2, Louise Rigby3, Emma Bartle4, Anthony Llewellyn5,6, Julie Gustavs2, Libby Newton2, James P Newcombe7, Mark Davies8, Jill Thistlethwaite9, James Lynam10. 1. a Primary Care and Medical Education, Sydney Medical School , University of Sydney , New South Wales , Australia. 2. b The Royal Australasian College of Physicians , New South Wales , Australia. 3. c Health Education and Training Institute , New South Wales , Australia. 4. d School of Dentistry , University of Queensland , Queensland , Australia. 5. e Hunter New England Local Health District , New Lambton , Australia. 6. f Health Education and Training Institute, University of Newcastle , Newcastle Australia. 7. g Royal North Shore Hospital , New South Wales , Australia. 8. h Royal Brisbane and Women's Hospital , Queensland , Australia. 9. i School of Communication , University of Technology Sydney , New South Wales , Australia. 10. j Calvary Mater Newcastle, University of Newcastle , New South Wales , Australia.
Abstract
BACKGROUND: Selection into specialty training is a high-stakes and resource-intensive process. While substantial literature exists on selection into medical schools, and there are individual studies in postgraduate settings, there seems to be paucity of evidence concerning selection systems and the utility of selection tools in postgraduate training environments. AIM: To explore, analyze and synthesize the evidence related to selection into postgraduate medical specialty training. METHOD: Core bibliographic databases including PubMed; Ovid Medline; Embase, CINAHL; ERIC and PsycINFO were searched, and a total of 2640 abstracts were retrieved. After removing duplicates and screening against the inclusion criteria, 202 full papers were coded, of which 116 were included. RESULTS: Gaps in underlying selection frameworks were illuminated. Frameworks defined by locally derived selection criteria, and heavily weighed on academic parameters seem to be giving way to the evidencing of competency-based selection approaches in some settings. Regarding selection tools, we found favorable psychometric evidence for multiple mini-interviews, situational judgment tests and clinical problem-solving tests, although the bulk of evidence was mostly limited to the United Kingdom. The evidence around the robustness of curriculum vitae, letters of recommendation and personal statements was equivocal. The findings on the predictors of past performance were limited to academic criteria with paucity of long-term evaluations. The evidence around nonacademic criteria was inadequate to make an informed judgment. CONCLUSIONS: While much has been gained in understanding the utility of individual selection methods, though the evidence around many of them is equivocal, the underlying theoretical and conceptual frameworks for designing holistic and equitable selection systems are yet to be developed.
BACKGROUND: Selection into specialty training is a high-stakes and resource-intensive process. While substantial literature exists on selection into medical schools, and there are individual studies in postgraduate settings, there seems to be paucity of evidence concerning selection systems and the utility of selection tools in postgraduate training environments. AIM: To explore, analyze and synthesize the evidence related to selection into postgraduate medical specialty training. METHOD: Core bibliographic databases including PubMed; Ovid Medline; Embase, CINAHL; ERIC and PsycINFO were searched, and a total of 2640 abstracts were retrieved. After removing duplicates and screening against the inclusion criteria, 202 full papers were coded, of which 116 were included. RESULTS: Gaps in underlying selection frameworks were illuminated. Frameworks defined by locally derived selection criteria, and heavily weighed on academic parameters seem to be giving way to the evidencing of competency-based selection approaches in some settings. Regarding selection tools, we found favorable psychometric evidence for multiple mini-interviews, situational judgment tests and clinical problem-solving tests, although the bulk of evidence was mostly limited to the United Kingdom. The evidence around the robustness of curriculum vitae, letters of recommendation and personal statements was equivocal. The findings on the predictors of past performance were limited to academic criteria with paucity of long-term evaluations. The evidence around nonacademic criteria was inadequate to make an informed judgment. CONCLUSIONS: While much has been gained in understanding the utility of individual selection methods, though the evidence around many of them is equivocal, the underlying theoretical and conceptual frameworks for designing holistic and equitable selection systems are yet to be developed.
Authors: Matthew J Pacana; Zachary T Thier; J Benjamin Jackson; David E Koon; Gregory Grabowski Journal: Clin Orthop Relat Res Date: 2021-08-01 Impact factor: 4.755
Authors: Anne de la Croix; Karen Stegers-Jager; Lokke Gennissen; Jacqueline de Graaf; Cornelia R M G Fluit; Matthijs de Hoog Journal: BMJ Open Date: 2019-12-03 Impact factor: 2.692