| Literature DB >> 30142048 |
Mallory A Jackson1, Alina Tran1, Mary Pat Wenderoth1, Jennifer H Doherty1.
Abstract
Practice exams are a type of deliberate practice that have been shown to improve student course performance. Deliberate practice differs from other types of practice, because it is targeted, mentally challenging, can be repeated, and requires feedback. Providing frequent instructor feedback to students, particularly in large classes, can be prohibitive. A possible solution is to have students grade practice exams using an instructor-generated rubric, receiving points only for completion. Students can either grade their own or a peer's work. We investigated whether peer or self-grading had a differential impact on completion of practice exam assignments, performance on practice exams or course exams, or student grading accuracy. We also investigated whether student characteristics mattered. We found that 90% of students took all practice exams or only missed one and that there was no difference on practice or course exam performance between the peer and self-graders. However, in the peer-grading treatment, students with lower incoming grade point averages and students identified as economically or educationally disadvantaged were less accurate and more lenient graders than other students. As there is no clear benefit of peer grading over self-grading, we suggest that either format can solve the challenge instructors face in giving frequent personalized feedback to many students.Entities:
Mesh:
Year: 2018 PMID: 30142048 PMCID: PMC6234814 DOI: 10.1187/cbe.18-04-0052
Source DB: PubMed Journal: CBE Life Sci Educ ISSN: 1931-7913 Impact factor: 3.325
Parameter estimates and SEs (in parentheses) for analysis models
| Outcomea | Treatment (ref: peer) | EOP (ref: non-EOP) | GPA | Gender (ref: male) | PE score (in percent) | EOP:Trt | GPA:Trt | ∆AICcb |
|---|---|---|---|---|---|---|---|---|
| Number of PEs taken | — | — | — | — | — | — | — | 0 |
| PE performance | — | — | 22.4 (1.55) | — | — | — | — | 172.2 |
| Course exam performancec | — | — | 79.3 (4.97) | −3.9 (1.52) | 1.2 (0.12) | — | — | 485.4 |
| Grading accuracy | 2.5 (0.96) | −0.8 (0.96) | −16.9 (1.90) | — | — | −3.5 (0.95) | −10 (1.9) | 91 |
ref, reference level; Trt, treatment.
aAll models included TA as a random effect. PE, practice exam.
b∆AICc is the difference between the best-fit model and the null model, the intercept-only model that included TA as a random effect.
cCourse exam performance is based on total exam points for all course exams, with a maximum of 550 points.
FIGURE 1.Histogram of course exam scores (in percent of total) for students in peer- and self-grading treatment groups. Raw scores are plotted, not model output. There was no overall effect of treatment on course exam performance when controlling for GPA.
FIGURE 2.Interaction between EOP status and grading treatment on grading accuracy. Model output is graphed. See Eq. 1 in Methods for grading accuracy calculation. Line at zero designates complete accuracy compared with expert. Values greater than zero indicate more lenient grading; below zero is harsher grading than experts. EOP students who grade their own practice exams grade more similarly to experts than EOP students who grade peers’ work.
FIGURE 3.Interaction between incoming GPA and grading treatment group predicts accuracy of grading practice exams. See Eq. 1 in Methods for grading accuracy calculation. Line at zero designates complete accuracy compared with expert. Lines are best fit of the raw data. Most students fall above the zero line, indicating overestimation of practice exam grades. Students below the zero line are harsher graders than experts. There is less discrepancy in grading accuracy across GPA in the self-condition vs. the peer condition.