| Literature DB >> 33805530 |
Jihoon Kim1, Darla M Castelli2.
Abstract
BACKGROUND: Gamified reward systems, such as providing digital badges earned for specific accomplishments, are related to student engagement in educational settings. The purpose of this study was to conduct a meta-analytic review to quantify the effects of gamified interventions on student behavioral change.Entities:
Keywords: badges; behavior change; education; gamification; leaderboard; meta-analysis; motivation
Year: 2021 PMID: 33805530 PMCID: PMC8037535 DOI: 10.3390/ijerph18073550
Source DB: PubMed Journal: Int J Environ Res Public Health ISSN: 1660-4601 Impact factor: 3.390
Figure 1Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow chart.
Characteristics of gamification intervention studies included in the meta-analysis.
| Study (Year) | Treatment | Control | Age Group | Intervention Length | Measurement Outcome | Gamification Affordance | Education Field |
|---|---|---|---|---|---|---|---|
| Allam et al. (2015) | 28 | 40 | Adult | Weeks | Test score | Badges, leaderboard, points | Medical education |
| Auvien et al. (2015) | 215 | 215 | CS | Weeks | Test score | Badges, points | Computer science |
| 254 | 254 | CS | Weeks | Test score | |||
| De Marcos et al. (2017) | 175 | 139 | CS | Weeks | Test score | Badges, leaderboard, points, challenge, goals, levels, peer assessment | Computer science |
| 177 | 139 | CS | Weeks | PL | |||
| De Marcos et al. (2014) | 106 | 72 | CS | Years | Test score | Badges, leaderboard, points, progress bar | Computer science |
| 112 | 72 | CS | Years | PL | |||
| Denny et al. (2018) | 702 | 702 | CS | Weeks | Test score | Badges, points | Online education |
| 521 | 180 | CS | Weeks | Test score | |||
| Hakulinen et al. (2015) | 86 | 195 | CS | Weeks | PL | Badges, leaderboard, points | Computer science |
| 86 | 195 | CS | Weeks | PL | |||
| Hamari (2017) | 1579 | 1401 | Adult | Years | PL | Badges | Online trading activity |
| 1579 | 1401 | Adult | Years | PL | |||
| 1579 | 1401 | Adult | Years | PL | |||
| 1579 | 1401 | Adult | Years | PL | |||
| Hanus & Fox (2015) | 71 | 71 | CS | Weeks | PL | Badges, leaderboard | Communication |
| Harms et al. (2017) | 21 | 19 | Adult | Hours | PL | Badges, avatar, progress bar | Physical activity |
| 21 | 19 | Adult | Hours | Test score | |||
| Huang and Hew (2015) | 21 | 19 | CS | Weeks | PL | Badges, leaderboard, points, progress bar | General Education |
| 21 | 19 | CS | Weeks | PL | |||
| 19 | 16 | CS | Weeks | Test score | |||
| Kim et al. (2016) | 448 | 299 | CS | Weeks | PL | Badges, leaderboard | Engineering |
| 448 | 299 | CS | Weeks | PL | |||
| 51 | 47 | CS | Weeks | PL | |||
| Lam et al. (2018) | 22 | 30 | K-12 | Weeks | PL | Leaderboard, points, | ESL writing |
| Landers et al. (2015) | 33 | 49 | Adult | Hours | Test score | Leaderboard, points, | Brainstorming |
| Lombriser et al. (2016) | 51 | 21 | Adult | Hours | PL | Badges, leaderboard, points, level, challenges, avatar, progress bar, storytelling, prize | Engineering |
| 51 | 21 | Adult | Hours | Test score | |||
| 51 | 21 | Adult | Hours | PL | |||
| Ortiz-Rojas et al. (2019) | 55 | 34 | Adult | Hours | Test score | Leaderboard | Computer programing |
| Poondej et al. (2016) | 273 | 273 | CS | Weeks | PL | Badges, leaderboard, point, progress bar | Information literacy skills |
| Silpasuwanchai et al. | 19 | 6 | CS | Hours | PL | Badges, leaderboard, points | Memory |
| Turan et al. (2016) | 46 | 48 | K-12 | Weeks | Test score | Badges, leaderboard, points | Technology software |
CS = college students; K-12 = kindergarten through 12th grade; ESL = English as a Second language; PL = participation level; Hours = less than 1 h; Weeks = 2–16 weeks; Years = 1–2 years.
Figure 2Standardized mean difference effect sizes, 95% CI and a forest plot.
Effect sizes by moderator variables in the meta-analysis.
| Moderator Variables |
| ES | 95% CI | Qb | ||
|---|---|---|---|---|---|---|
| Lower | Upper | |||||
| Age | K-12 | 146 | 0.92 | 0.29 | 1.55 | |
| College students | 5780 | 0.15 | −0.04 | 0.35 | 26.27 ** | |
| Adults | 12,455 | 0.95 | 0.70 | 1.12 | ||
| Intervention length | Days | 492 | 1.57 | 1.25 | 1.90 | |
| Weeks | 12,282 | 0.39 | 0.21 | 0.57 | 67.20 ** | |
| Years | 18,381 | −0.20 | −0.47 | 0.09 | ||
| Measurement | Test score | 3059 | 0.30 | 0.03 | 0.18 | 3.38 |
| Participation level | 15,322 | 0.60 | 0.40 | 0.77 | ||
** p < 0.01.
Figure 3Funnel plot of all 32 effects from treatment and control samples.