Rebecca Stewart1, Nick Cooling2, Graham Emblen3, Allison Turnock2,4, Amanda Tapley5,6, Elizabeth Holliday5,7, Jean Ball7, Jennifer Juckel3, Parker Magin5,6. 1. a Medical Education Experts , Townsville , Australia. 2. b School of Medicine, University of Tasmania , Hobart , Australia. 3. c General Practice Training Queensland , Brisbane , Australia. 4. d Department of Health & Human Services Tasmania , Hobart , Australia. 5. e School of Medicine and Public Health, University of Newcastle , Newcastle , Australia. 6. f General Practice Synergy , Newcastle , Australia. 7. g Hunter Medical Research Institute , New Lambton , Australia.
Abstract
BACKGROUND: Success in summative general practice (GP) training assessments is one indicator of competence for practice. Early-training factors predictive of outcomes would facilitate targeted interventions aimed at preventing candidate failures. METHODS: We undertook a retrospective cohort study of Australian GP trainees in two training organizations over five years. Associations of pre-training and early-training predictors with summative examination scores in an Applied Knowledge Test (AKT), Key Features Paper (KFP), and Objective Structured Clinical Examination (OSCE), plus failure on any one of these, were tested via univariate and multivariable regression. Predictors were program-entry selection-score decile, pre-training-commencement multiple choice assessment (MCQA), direct observation of practice performance, and clinical supervisor reports. RESULTS: On univariate analyses, selection decile and MCQA were associated with all outcomes except AKT. There were no associations of other predictors with any outcomes. On multivariable analysis, selection decile and MCQA performance were predictive of OSCE performance. MCQA performance was also predictive of KFP performance. On multivariable analysis, no predictors were associated with AKT performance or failing any examination. CONCLUSIONS: Selection decile and pre-commencement MCQA performance were predictive of performance in some summative assessments. These findings could inform selection policies and targeted early interventions for trainees at most risk for exam failure.
BACKGROUND: Success in summative general practice (GP) training assessments is one indicator of competence for practice. Early-training factors predictive of outcomes would facilitate targeted interventions aimed at preventing candidate failures. METHODS: We undertook a retrospective cohort study of Australian GP trainees in two training organizations over five years. Associations of pre-training and early-training predictors with summative examination scores in an Applied Knowledge Test (AKT), Key Features Paper (KFP), and Objective Structured Clinical Examination (OSCE), plus failure on any one of these, were tested via univariate and multivariable regression. Predictors were program-entry selection-score decile, pre-training-commencement multiple choice assessment (MCQA), direct observation of practice performance, and clinical supervisor reports. RESULTS: On univariate analyses, selection decile and MCQA were associated with all outcomes except AKT. There were no associations of other predictors with any outcomes. On multivariable analysis, selection decile and MCQA performance were predictive of OSCE performance. MCQA performance was also predictive of KFP performance. On multivariable analysis, no predictors were associated with AKT performance or failing any examination. CONCLUSIONS: Selection decile and pre-commencement MCQA performance were predictive of performance in some summative assessments. These findings could inform selection policies and targeted early interventions for trainees at most risk for exam failure.
Authors: Caitlin Vayro; Ajit Narayanan; Michael Greco; Neil Spike; Jan Hanson; Ben Mitchell; Dale Hanson; Rebecca Stewart Journal: BMC Med Educ Date: 2022-06-24 Impact factor: 3.263