Review Article

Rethinking Assessment Concepts in Dental Education

Table 2

Assessment process of the studies included in the review.

Author, dateAssessment trainingPredictive valueFaculty calibrationGrading rubricRisk of bias

Furness 2018 et al. [12]N/ASoftware was not successful in identifying consistently common critical errors.N/AYes, a well-defined grading rubric with criteria.High
Lee 2018 et al. [13]YesLower performing students benefitted the most in improving their ability to self-assess.YesYes, a well-defined grading rubric with criteria.Unclear
Sadid-zadeh 2018 et al. [10]YesCompare software can be used to evaluate complete coverage crown preparations as interrater agreement between virtual software and faculty was almost perfect.YesYes, a well-defined grading rubric with criteria.Low
Sadid-zadeh 2018 [14]YesCompare software can be as effective in providing immediate feedback as faculty feedback.YesYes, a well-defined grading rubric with criteria.Low
Sadid-zadeh 2018 et al. [15]YesCompare software can be as effective in providing immediate feedback as faculty feedback.YesYes, a well-defined grading rubric with criteria.Low
Shahriari-Rad 2017 et al. [16]YesHaptic virtual reality software in combination with traditional phantom head mannequin is very effective in developing and assessing psychomotor skills.N/AYes, a well-defined grading rubric with criteria.High
Lee 2017 et al. [17]Not mentionedLow performing students overestimated their self-assessment and vice versa.YesYes, a well-defined grading rubric with criteria.Unclear
Sly 2017 et al. [18]YesCompare software was not comprehensive in grading intracoronal preparations.YesYes, a well-defined grading rubric with criteria.Unclear
Gottlieb 2017 et al. [19]YesAdvanced simulator exam scores can be used as performance predictors in preclinical operative and fixed prosthodontics.Not mentionedYes, a well-defined grading rubric with criteria.Unclear
De Peralta 2017 et al. [20]YesUse of multisource assessment improved student’s ability to self-assess and interrater agreement with faculty.YesYes, a well-defined grading rubric with criteria.High
Gratton 2017 et al. [21]YesThere was no significant difference between the use of compare software vs. prepcheck in students’ performance.YesYes, a well-defined grading rubric with criteria.Low
Gratton 2016 et al. [22]YesUse of evaluation software had no effect on student’s prosthodontics technical and self-evaluation abilities.NoYes, a well-defined grading rubric with criteria.Low
Zou 2016 et al. [23]YesComputerized cavity preparation evaluation system was a valuable tool for self-learning.YesYes, a well-defined grading rubric with criteria.Unclear
Garrett 2015 et al. [24]YesConventional self-reflection and faculty guidance in conjunction with a digital evaluation tool can be used to teach students on how to perform self-assessments.YesYes, a well-defined grading rubric with criteria.Low
McPherson 2015 et al. [25]YesSoftware can be used for self-assessment and grading by faculty.YesYes, but not clear.Unclear
Callan 2015 et al. [26]N/AInterchangeability of typodonts of the same make and model do not affect the accuracy of assessment.Not mentionedYes, a well-defined grading rubric with criteria.Unclear
Callan 2014 et al. [27]N/A“Small dots diagonal” on the gingiva was the best option.NoYes, but not clear.Low
Velayo 2014 et al. [28]N/APositive significant correlation between student’s preclinical and clinical performance.Not mentionedYes, a well-defined grading rubric with criteria.Unclear
Mays and Levine [29]YesUsing CAD CAM did not improve student’s self-assessment ability and poor agreement with faculty assessment was observed.YesYes, a well-defined grading rubric with criteria.High
Graham 2013 et al. [30]N/APreclinical OSCE was a reliable predictor of clinical performance.N/AYes, a well-defined grading rubric with criteria.High
Renne 2013 et al. [31]N/AE4D compare software was a reliable assessment tool.YesYes, a well-defined grading rubric with criteria.Unclear
Nunez 2012 et al. [32]N/APreclinical performance on typodonts was a poor predictor of clinical performance on live patients.YesYes, a well-defined grading rubric with criteria.High
Urbankova and Engebretson 2011 [33]YesComputer-assisted dental simulation test can identify students needing early instructional interventionYesYes, but not clear.Unclear
Boushell 2011 et al. [34]NoLearn-A-Prep II can be a good tool to identify students that may need early instructional intervention.Not mentionedYes, a well-defined grading rubric with criteria.Unclear