BACKGROUND: Progress testing is well established as a longitudinal form of assessment in undergraduate medical programmes to measure growth in knowledge. Peninsula Dental School is the first school to use progress testing and remains the only one to do so. AIMS: To share the experience of developing progress testing in an undergraduate dental programme as a major summative assessment tool at a newly established dental school in the United Kingdom. METHODS: Data were collected for progress tests conducted from 2007 to 14. The tests were formative in the first 2 years of the programme and summative in subsequent years. Each test was based on 100 single best answer multiple-choice items with an appropriate vignette. The students chose their answer from 5 options. A score 1 mark is awarded for each correct answer, minus 0.25 for an incorrect answer and 0 for 'don't know' (DK). The standard setting for each sitting was carried out using Angoff and Hofstee methods. RESULTS: There were two tests per year with each cohort undertaking eight tests in their 4 years of study providing a total 14 test occasions. The reliability of each test for each student cohort tests was measured using Cronbach's alpha. The average reliability over 42 test/cohort combinations was 0.753 (±SD 0.08). Data analyses show growth in knowledge of dental students across successive years with the largest increase in knowledge observed between tests 1 and 5 and concomitant reduction in DK responses. CONCLUSION: This is the first study to report the establishment and use of progress testing as the principle form of written summative testing in an undergraduate dental curriculum. Progress testing is a valid and reliable tool to assess growth in knowledge longitudinally over the duration of a dental programme. Although a labour-intensive process, progress testing merits more widespread use in dental programmes.
BACKGROUND: Progress testing is well established as a longitudinal form of assessment in undergraduate medical programmes to measure growth in knowledge. Peninsula Dental School is the first school to use progress testing and remains the only one to do so. AIMS: To share the experience of developing progress testing in an undergraduate dental programme as a major summative assessment tool at a newly established dental school in the United Kingdom. METHODS: Data were collected for progress tests conducted from 2007 to 14. The tests were formative in the first 2 years of the programme and summative in subsequent years. Each test was based on 100 single best answer multiple-choice items with an appropriate vignette. The students chose their answer from 5 options. A score 1 mark is awarded for each correct answer, minus 0.25 for an incorrect answer and 0 for 'don't know' (DK). The standard setting for each sitting was carried out using Angoff and Hofstee methods. RESULTS: There were two tests per year with each cohort undertaking eight tests in their 4 years of study providing a total 14 test occasions. The reliability of each test for each student cohort tests was measured using Cronbach's alpha. The average reliability over 42 test/cohort combinations was 0.753 (±SD 0.08). Data analyses show growth in knowledge of dental students across successive years with the largest increase in knowledge observed between tests 1 and 5 and concomitant reduction in DK responses. CONCLUSION: This is the first study to report the establishment and use of progress testing as the principle form of written summative testing in an undergraduate dental curriculum. Progress testing is a valid and reliable tool to assess growth in knowledge longitudinally over the duration of a dental programme. Although a labour-intensive process, progress testing merits more widespread use in dental programmes.
Authors: D R Rutgers; J P J van Schaik; C L J J Kruitwagen; C Haaring; W van Lankeren; A F van Raamt; O Ten Cate Journal: Med Sci Educ Date: 2020-05-13
Authors: Kamran Ali; Josephine Cockerill; Daniel Zahra; Christopher Tredwin; Colin Ferguson Journal: BMC Med Educ Date: 2018-11-09 Impact factor: 2.463