| Literature DB >> 33123198 |
Mohamed El-Kishawi1, Khaled Khalaf1, Dana Al-Najjar1, Zahra Seraj1, Sausan Al Kawas1.
Abstract
INTRODUCTION: Dental education involves teaching and assessing the acquisition of verifiable domains that require superior psychomotor, communication, and cognitive skills. Evolving technologies and methods of assessment could enhance student's learning environment and improve tutor assessment experience. The aim of this study was to review the current body of research and evaluate the effectiveness of various methods of assessments in improving learning and performance in preclinical and clinical dental practice.Entities:
Year: 2020 PMID: 33123198 PMCID: PMC7584943 DOI: 10.1155/2020/8672303
Source DB: PubMed Journal: Int J Dent ISSN: 1687-8728
Figure 1Flow diagram of the process of study selection.
Summary of the studies included in the review.
| Author, date | Sample size | Students | Preclinical assessment | Clinical assessment | Correlated faculty assessment |
|---|---|---|---|---|---|
| Furness 2018 et al. [ | 1 | N/A | Planmeca compare software (crown preparations) | N/A | Yes |
| Lee 2018 et al. [ | 69 | Third year | Self-assessment and faculty assessment; conventional vs. digital software (operative) | N/A | Yes |
| Sadid-Zadeh 2018 et al. [ | 9 | Second year | Compare software (crown preparation) | N/A | Yes |
| Sadid-Zadeh 2018 et al. [ | 9 | Second year | Compare software (crown preparations) | N/A | Yes |
| Sadid-zadeh 2018 et al. [ | 505 | Second year | Compare software (crown preparations) | N/A | Yes |
| Shahriari-Rad 2017 et al. [ | 140 | First/second year | Virtual haptic simulator (operative) | N/A | Yes |
| Lee 2017 et al. [ | 71 | Third year | Self-assessment (operative) | N/A | Yes |
| Sly 2017 et al. [ | 98 | First year | Compare software (operative) | N/A | Yes |
| Gottlieb 2017 et al. [ | 282 | First/second year | Advanced simulation training | N/A | Yes |
| De Peralta 2017 et al. [ | 104 | First year | Multisource assessment (operative) | N/A | Yes |
| Gratton 2017 et al. [ | 79 | Second year | Compare and prepCheck software (crown preparation) | N/A | Yes |
| Gratton 2016 et al. [ | 80 | Second year | E4D compare and sirona prepCheck software (crown preparation) | N/A | Yes |
| Zou 2016 et al. [ | 38 | First year | Computerized cavity preparation evaluation system (operative) | N/A | Yes |
| Garrett 2015 et al. [ | 57 | First year | Digital evaluation tool (dental anatomy wax-up) | N/A | Yes |
| McPherson 2015 et al. [ | 66 | Not mentioned | Self-assessment software | N/A | Yes |
| Callan 2015 et al. [ | 10 | Not mentioned | E4D compare software (crown preparation) | N/A | Yes |
| Callan 2014 et al. [ | 6 methods | N/A | CAD CAM assessment software (crown preparation) | N/A | N/A |
| Velayo 2014 et al. [ | 301 | First to fourth year (cohort) | Preclinical performance | Preclinical performance as an indicator (operative and fixed prosthodontics) | Not mentioned |
| Mays 2014 and Levine [ | 25 | First year | Using CAD CAM for self-assessment (operative) | N/A | Yes |
| Graham 2013 et al. [ | 145 | Not mentioned | Comprehensive preclinical OSCE | Preclinical OSCE as a predictor for clinical performance. | Yes |
| Renne 2013 et al. [ | 50 | Second year | E4D compare software (crown preparation) | N/A | Yes |
| Nunez 2012 et al. [ | 86 | Fourth year | Preclinical typodont score as a predictor for clinical performance (fixed prosthodontics). | Preclinical typodont score as a predictor for clinical performance (fixed prosthodontics). | Yes |
| Urbankova and and Engebretson 2011 [ | 38 | First year | Computer-assisted dental simulation (operative) | N/A | No |
| Boushell 2011 et al. [ | 81 | First year | Learn-A-Prep II (operative) | N/A | Yes |
Assessment process of the studies included in the review.
| Author, date | Assessment training | Predictive value | Faculty calibration | Grading rubric | Risk of bias |
|---|---|---|---|---|---|
| Furness 2018 et al. [ | N/A | Software was not successful in identifying consistently common critical errors. | N/A | Yes, a well-defined grading rubric with criteria. | High |
| Lee 2018 et al. [ | Yes | Lower performing students benefitted the most in improving their ability to self-assess. | Yes | Yes, a well-defined grading rubric with criteria. | Unclear |
| Sadid-zadeh 2018 et al. [ | Yes | Compare software can be used to evaluate complete coverage crown preparations as interrater agreement between virtual software and faculty was almost perfect. | Yes | Yes, a well-defined grading rubric with criteria. | Low |
| Sadid-zadeh 2018 [ | Yes | Compare software can be as effective in providing immediate feedback as faculty feedback. | Yes | Yes, a well-defined grading rubric with criteria. | Low |
| Sadid-zadeh 2018 et al. [ | Yes | Compare software can be as effective in providing immediate feedback as faculty feedback. | Yes | Yes, a well-defined grading rubric with criteria. | Low |
| Shahriari-Rad 2017 et al. [ | Yes | Haptic virtual reality software in combination with traditional phantom head mannequin is very effective in developing and assessing psychomotor skills. | N/A | Yes, a well-defined grading rubric with criteria. | High |
| Lee 2017 et al. [ | Not mentioned | Low performing students overestimated their self-assessment and vice versa. | Yes | Yes, a well-defined grading rubric with criteria. | Unclear |
| Sly 2017 et al. [ | Yes | Compare software was not comprehensive in grading intracoronal preparations. | Yes | Yes, a well-defined grading rubric with criteria. | Unclear |
| Gottlieb 2017 et al. [ | Yes | Advanced simulator exam scores can be used as performance predictors in preclinical operative and fixed prosthodontics. | Not mentioned | Yes, a well-defined grading rubric with criteria. | Unclear |
| De Peralta 2017 et al. [ | Yes | Use of multisource assessment improved student's ability to self-assess and interrater agreement with faculty. | Yes | Yes, a well-defined grading rubric with criteria. | High |
| Gratton 2017 et al. [ | Yes | There was no significant difference between the use of compare software vs. prepcheck in students' performance. | Yes | Yes, a well-defined grading rubric with criteria. | Low |
| Gratton 2016 et al. [ | Yes | Use of evaluation software had no effect on student's prosthodontics technical and self-evaluation abilities. | No | Yes, a well-defined grading rubric with criteria. | Low |
| Zou 2016 et al. [ | Yes | Computerized cavity preparation evaluation system was a valuable tool for self-learning. | Yes | Yes, a well-defined grading rubric with criteria. | Unclear |
| Garrett 2015 et al. [ | Yes | Conventional self-reflection and faculty guidance in conjunction with a digital evaluation tool can be used to teach students on how to perform self-assessments. | Yes | Yes, a well-defined grading rubric with criteria. | Low |
| McPherson 2015 et al. [ | Yes | Software can be used for self-assessment and grading by faculty. | Yes | Yes, but not clear. | Unclear |
| Callan 2015 et al. [ | N/A | Interchangeability of typodonts of the same make and model do not affect the accuracy of assessment. | Not mentioned | Yes, a well-defined grading rubric with criteria. | Unclear |
| Callan 2014 et al. [ | N/A | “Small dots diagonal” on the gingiva was the best option. | No | Yes, but not clear. | Low |
| Velayo 2014 et al. [ | N/A | Positive significant correlation between student's preclinical and clinical performance. | Not mentioned | Yes, a well-defined grading rubric with criteria. | Unclear |
| Mays and Levine [ | Yes | Using CAD CAM did not improve student's self-assessment ability and poor agreement with faculty assessment was observed. | Yes | Yes, a well-defined grading rubric with criteria. | High |
| Graham 2013 et al. [ | N/A | Preclinical OSCE was a reliable predictor of clinical performance. | N/A | Yes, a well-defined grading rubric with criteria. | High |
| Renne 2013 et al. [ | N/A | E4D compare software was a reliable assessment tool. | Yes | Yes, a well-defined grading rubric with criteria. | Unclear |
| Nunez 2012 et al. [ | N/A | Preclinical performance on typodonts was a poor predictor of clinical performance on live patients. | Yes | Yes, a well-defined grading rubric with criteria. | High |
| Urbankova and Engebretson 2011 [ | Yes | Computer-assisted dental simulation test can identify students needing early instructional intervention | Yes | Yes, but not clear. | Unclear |
| Boushell 2011 et al. [ | No | Learn-A-Prep II can be a good tool to identify students that may need early instructional intervention. | Not mentioned | Yes, a well-defined grading rubric with criteria. | Unclear |