| Literature DB >> 32274609 |
Jonathan G Tullis1, Robert L Goldstone2.
Abstract
In peer instruction, instructors pose a challenging question to students, students answer the question individually, students work with a partner in the class to discuss their answers, and finally students answer the question again. A large body of evidence shows that peer instruction benefits student learning. To determine the mechanism for these benefits, we collected semester-long data from six classes, involving a total of 208 undergraduate students being asked a total of 86 different questions related to their course content. For each question, students chose their answer individually, reported their confidence, discussed their answers with their partner, and then indicated their possibly revised answer and confidence again. Overall, students were more accurate and confident after discussion than before. Initially correct students were more likely to keep their answers than initially incorrect students, and this tendency was partially but not completely attributable to differences in confidence. We discuss the benefits of peer instruction in terms of differences in the coherence of explanations, social learning, and the contextual factors that influence confidence and accuracy.Entities:
Keywords: Confidence; Decision making; Group decisions; Metacognition; Peer instruction
Mesh:
Year: 2020 PMID: 32274609 PMCID: PMC7145884 DOI: 10.1186/s41235-020-00218-5
Source DB: PubMed Journal: Cogn Res Princ Implic ISSN: 2365-7464
Descriptions of classes used
| Class | Year | Level | Number of Students | Number of Questions | Location |
|---|---|---|---|---|---|
| Cognitive Psych (Psych) | 2015 | Middle level undergrad | 61 | 4 | Indiana University |
| Cognitive Psych (Psych) | 2017 | Middle level undergrad | 60 | 4 | Indiana University |
| Decision Making (Ed Psych) | 2016 | Upper level undergrad | 24 | 15 | University of Arizona |
| Decision Making (Ed Psych) | 2017 | Upper level undergrad | 37 | 16 | University of Arizona |
| Learning Theories (Ed Psych) | 2016 | Intro Master’s level | 12 | 26 | University of Arizona |
| Learning Theories (Ed Psych) | 2018 | Intro Master’s level | 14 | 21 | University of Arizona |
The effect of time point (pre-discussion to post-discussion) on accuracy using a mixed effect logit model
| Fixed Effect | SE | Wald z | ||
|---|---|---|---|---|
| Intercept | 0.68 | 0.19 | 3.515 | .0004 |
| Time point (pre to post) | 0.45 | 0.09 | 5.102 | < .0001 |
Accuracy before and after discussion by class
| Class | Pre-correct (mean) | Post-correct (mean) | SD of difference | Paired | Cohen’s |
|---|---|---|---|---|---|
| Cognitive Psych (Psych) 2015 | 0.67 | 0.76 | 0.27 | 0.31 | |
| Cognitive Psych (Psych) 2017 | 0.65 | 0.73 | 0.21 | 0.36 | |
| Decision Making (Ed Psych) 2016 | 0.57 | .66 | 0.13 | 0.69 | |
| Decision Making (Ed Psych) 2017 | 0.71 | 0.75 | 0.13 | 0.32 | |
| Learning Theories (Ed Psych) 2016 | 0.58 | 0.69 | 0.06 | 1.74 | |
| Learning Theories (Ed Psych) 2018 | 0.57 | 0.61 | 0.09 | 0.56 | |
| Overall | 0.65 | 0.72 | 0.20 | 0.37 |
Fig. 1The relationship between pre-discussion accuracy (x axis) and post-discussion accuracy (y axis). Each point represents a single question. The solid diagonal line represents equal pre-discussion and post-discussion accuracy; points above the line indicate improvements in accuracy and points below represent decrements in accuracy. The dashed line indicates the line of best fit for the observed data
Fig. 2The pathways of answers from pre-discussion (top row) to post-discussion (bottom row). Percentages indicate the portion of items from the category immediately above in that category, the numbers in brackets indicate the raw numbers of items, and the numbers at the bottom of each entry indicate the confidence associated with those items. In the middle, white row, confidence values show the peer’s confidence. Turquoise indicates incorrect answers and yellow indicates correct answers
The gamma correlation between accuracy and confidence before and after discussion for each class
| Class | Pre-gamma | Post-gamma | SD of difference | Paired | Cohen’s |
|---|---|---|---|---|---|
| Cognitive Psych (Psych) 2015 | 0.60 | 0.79 | 0.52 | 0.29 | |
| Cognitive Psych (Psych) 2017 | 0.27 | 0.40 | 0.74 | 0.38 | |
| Decision Making (Ed Psych) 2016 | 0.36 | 0.56 | 0.46 | 0.47 | |
| Decision Making (Ed Psych) 2017 | 0.47 | 0.44 | 0.46 | − 0.04 | |
| Learning Theories (Ed Psych) 2016 | 0.18 | 0.28 | 0.45 | 0.23 | |
| Learning Theories (Ed Psych) 2018 | 0.43 | 0.37 | 0.37 | − 0.16 | |
| Overall | 0.40 | 0.48 | 0.55 | 0.24 |
aGamma correlation requires that learners have variance in both confidence and correctness before and after discussion. Degrees of freedom are reduced because many students did not have requisite variation
Logit mixed-level regression analysis
| Fixed effect | SE | Wald z | ||
|---|---|---|---|---|
| Intercept | − 0.18 | 0.13 | 1.36 | .17 |
| Own confidence (mean-centered) | 0.22 | 0.05 | 4.16 | < .0001 |
| Partner confidence (mean-centered) | −0.18 | 0.05 | 3.51 | .0005 |
| Own correct | 1.50 | 0.22 | 6.73 | < .0001 |
The results of a logit mixed level regression predicting keeping one's answer from one's own confidence, the peer's confidence, and the correctness of one's initial answer for situations in which peers initially disagreed
Fig. 3The probability of keeping one’s answer in situations where one’s partner initially disagreed as a function of the difference between partners’ levels of confidence. Error bars indicate the standard error of the proportion and are not shown when the data are based upon a single data point
Mixed-level regression analysis of predicting confidence
| Fixed effect | SE | |||
|---|---|---|---|---|
| Intercept | 5.63 | 0.21 | 26.66 | |
| Time point (pre vs post) | 1.08 | 0.14 | 7.98 | < .0001 |
| Initial correct | 0.78 | 0.13 | 6.05 | < .0001 |
| Time Point*Initial correct | 0.33 | 0.15 | 2.14 | .03 |
The results of the mixed level regression predicting confidence in one's answer from the time point (pre- or post- discussion), the correctness of one's answer, and their interaction for situations in which peers initially agreed
Fig. 4The relationship between pre-discussion and post-discussion confidence as a function of the accuracy of an answer when partners agreed. Each dot represents a student