BACKGROUND: In 2007 all medical specialty training curricula in the uK changed to become competence based, and Annual Review of Competence Progression (ARCP) panels became the mechanism for progression through training. The RCGP also developed an internet-based electronic portfolio to record trainees' learning and development. The operational instructions for the new specialty training curricula included the requirement for quality management of the decisions made by the ARCP panels. METHODS: The Royal College of General Practitioners (RCGP) developed criteria to measure the quality of the decisions made by Deanery ARCP panels and the educational and clinical supervisors' reports that informed them. A team of external advisors (EAs) was appointed and trained to undertake this external scrutiny work. RESULTS: For the past four years there has been a consistency in agreement between the decisions made by the Deanery ARCP teams and the EAs. The quality of both the educational and clinical supervisor reports has improved over the same time period. CONCLUSION: An internet-based electronic portfolio is an essential component of competency-based curricula using programmes of assessment. Quality management is an effective strategy to ensure the dependability of high-stakes decisions. Feedback from the RCGP quality management process has provided a stimulus to promote change within deaneries.
BACKGROUND: In 2007 all medical specialty training curricula in the uK changed to become competence based, and Annual Review of Competence Progression (ARCP) panels became the mechanism for progression through training. The RCGP also developed an internet-based electronic portfolio to record trainees' learning and development. The operational instructions for the new specialty training curricula included the requirement for quality management of the decisions made by the ARCP panels. METHODS: The Royal College of General Practitioners (RCGP) developed criteria to measure the quality of the decisions made by Deanery ARCP panels and the educational and clinical supervisors' reports that informed them. A team of external advisors (EAs) was appointed and trained to undertake this external scrutiny work. RESULTS: For the past four years there has been a consistency in agreement between the decisions made by the Deanery ARCP teams and the EAs. The quality of both the educational and clinical supervisor reports has improved over the same time period. CONCLUSION: An internet-based electronic portfolio is an essential component of competency-based curricula using programmes of assessment. Quality management is an effective strategy to ensure the dependability of high-stakes decisions. Feedback from the RCGP quality management process has provided a stimulus to promote change within deaneries.