| Literature DB >> 30017006 |
Tamsin Ford1, Rachel Hayes1, Sarah Byford2, Vanessa Edwards1, Malcolm Fletcher1, Stuart Logan1, Brahm Norwich3, Will Pritchard4, Kate Allen1, Matthew Allwood1, Poushali Ganguli2, Katie Grimes5, Lorraine Hansford1, Bryony Longdon1, Shelley Norman6, Anna Price1, Obioha C Ukoumunne7.
Abstract
BACKGROUND: We evaluated the effectiveness and cost-effectiveness of the Incredible Years® Teacher Classroom Management (TCM) programme as a universal intervention, given schools' important influence on child mental health.Entities:
Mesh:
Year: 2018 PMID: 30017006 PMCID: PMC6425365 DOI: 10.1017/S0033291718001484
Source DB: PubMed Journal: Psychol Med ISSN: 0033-2917 Impact factor: 7.723
Fig. 1.CONSORT diagram to illustrate data completeness related to the primary outcome.
Baseline characteristics by trial arm status
| Variable | Intervention (TCM) | Control (TAU) |
|---|---|---|
| School (cluster) characteristics | ||
| Rural | ||
| Rural, | 18 (45.0) | 19 (47.5) |
| Urban, | 22 (55.0) | 21 (52.5) |
| Education Key Stage | ||
| Key stage 1, | 20 (50.0) | 21 (52.5) |
| Key stage 2, | 20 (50.0) | 19 (47.5) |
| % eligible for free school meals, median (IQR) | 12 (8–24) | 14 (10–23) |
| Index of multiple deprivation score, median (IQR) | 0.17 (0.08–0.24) | 0.16 (0.10–0.27) |
| Teacher (cluster) characteristics | ||
| More than 5 years of teaching, | 20 (50.0) | 27 (67.5) |
| Age in years, mean ( | 34.5 (9.0) | 31.4 (8.7) |
| Female, | 32 (80.0) | 33 (82.5) |
| Newly qualified, | 2 (5) | 0 (0) |
| Has management position, | 4 (10) | 2 (5) |
| Teacher Self-efficacy Questionnaire | ||
| Student Engagement subscale, mean ( | 6.8 (1.0) | 7.1 (1.0) |
| Instructional Practice subscale, mean ( | 6.9 (1.0) | 7.2 (0.9) |
| Classroom Management subscale, mean ( | 7.3 (0.9) | 7.5 (0.9) |
| Maslach Burn-Out Inventory | ||
| Exhaustion, mean ( | 2.9 (1.4) | 2.5 (1.4) |
| Cynicism, mean ( | 1.2 (1.0) | 1.1 (1.0) |
| Professional Efficacy, mean ( | 4.2 (1.0) | 4.6 (0.8) |
| Everyday Feelings Questionnaire (teacher well-being), mean ( | 17.2 (6.9) | 13.9 (6.6) |
| Pupil characteristics | ||
| Female, | 483 (46.6) | 491 (47.3) |
| Age in years at last birthday, mean ( | 6.2 (1.4; 4–9) | 6.4 (1.3; 4–8) |
| Year group | ||
| Reception | 182 (17.6) | 88 (8.5) |
| Year 1 | 176 (17.0) | 192 (18.5) |
| Year 2 | 135 (13.0) | 275 (26.5) |
| Year 3 | 389 (37.5) | 220 (21.2) |
| Year 4 | 155 (14.9) | 263 (25.3) |
| Ethnicity | ||
| White, | 689 (95.6) | 663 (94.6) |
| Black, | 4 (0.6) | 4 (0.6) |
| Asian, | 5 (0.7) | 11 (1.6) |
| Mixed, | 20 (2.8) | 18 (2.6) |
| Other, | 3 (0.4) | 5 (0.7) |
| Eligible for free school meals, | 70 (11.8) | 64 (12.7) |
| Index of multiple deprivation score, median (IQR) | 0.16 (0.08–0.64) | 0.15 (0.09–0.25) |
| Number of children in household | ||
| 1, | 125 (16.2) | 122 (16.3) |
| 2, | 403 (52.3) | 389 (52.1) |
| 3, | 175 (22.7) | 158 (21.2) |
| 4, | 45 (5.8) | 49 (6.6) |
| 5 or more, | 22 (2.9) | 29 (3.9) |
| Lives in rented housing, | 475 (62.0) | 423 (56.9) |
| Parent's highest qualification | ||
| None, | 29 (3.8) | 46 (6.3) |
| GSCE or equivalent/A Level or equivalent, | 377 (49.7) | 377 (51.4) |
| University Degree or equivalent and above, | 352 (46.4) | 311 (42.4) |
| SDQ Total Difficulties score (teacher report), mean ( | 6.8 (5.6) | 6.6 (6.1) |
| SDQ Total Difficulties score in struggling range | 206 (19.9) | 200 (19.3) |
| SDQ Behaviour score (teacher report), mean ( | 0.8 (1.5) | 0.9 (1.6) |
| SDQ Emotions score (teacher report), mean ( | 1.5 (2.0) | 1.4 (2.1) |
| SDQ Overactivity score (teacher report), mean ( | 3.3 (3.0) | 3.1 (3.2) |
| SDQ Peer Relationships score (teacher report), mean ( | 1.2 (1.5) | 1.1 (1.7) |
| SDQ Pro-social score (teacher report), mean ( | 7.3 (2.5) | 7.6 (2.4) |
| SDQ Impact score > 0 (teacher report), | 395 (38.1) | 373 (35.9) |
| SDQ Total Difficulties score (parent report), mean ( | 7.8 (6.0) | 7.8 (5.9) |
| SDQ Total Difficulties score in struggling range | 124 (16.5) | 111 (15.5) |
| SDQ Behaviour score (parent report), mean ( | 1.5 (1.6) | 1.4 (1.6) |
| SDQ Emotions score (parent report), mean ( | 1.8 (2.0) | 1.8 (2.0) |
| SDQ Overactivity score (parent report), mean ( | 3.3 (2.6) | 3.3 (2.6) |
| SDQ Peer Relationships score (parent report), mean ( | 1.2 (1.6) | 1.3 (1.6) |
| SDQ Pro-social score (parent report), mean ( | 8.4 (1.7) | 8.5 (1.7) |
| SDQ Impact score > 0 (parent report), | 244 (33.3) | 209 (29.6) |
| Pupil Behaviour Questionnaire, mean ( | 2.0 (2.4) | 1.9 (2.4) |
| How I Feel About My School, mean ( | 10.9 (2.5) | 11.1 (2.3) |
| Assessment of Pupil Reading Level (parent report) | ||
| Fluent Reader, | 320 (42.9) | 349 (48.9) |
| Assessment of Pupil's Relationship with Teacher (parent report) | ||
| Good Relationship, | 632 (83.9) | 622 (87.2) |
| Assessment of Parent's Relationship with Teacher (parent report) | ||
| Good Relationship, | 465 (63.6) | 485 (69.0) |
Education Key Stage 1 covers Reception to Year 2 for children aged 4–7; Key Stage 2 covers Years 3–6 for children aged 7–8.
Struggling defined as scoring 12 or more out of 40.
Struggling defined as scoring 14 or more out of 40.
SDQ norms from www.sdqinfo.com.
NS – number of schools in denominator.
NT – number of teachers in denominator.
NP – number of pupils in denominator.
Main comparison on teacher-reported SDQ total difficulties score (primary outcome) using different approaches for handling missing data
| Follow-up | Intervention | Control | CC1 – primary analysis | CC2 – sensitivity analysis | MI –sensitivity analysis | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean ( | Mean ( | Adjusted mean diff. (I – C) | Adjusted mean diff. (I – C) | Adjusted mean diff. (I – C) | |||||||||||
| Est. | 95% CI | ICC | Est. | 95% CI | Est. | 95% CI | |||||||||
| 9-months | 5.5 (5.4) | 6.2 (6.2) | 2001 | −1.0 | −1.9 to −0.1 | 0.03 | 0.180 | 1467 | −0.8 | −1.6 to 0.1 | 0.09 | 2075 | −1.0 | −1.9 to −0.2 | 0.02 |
| 18-months | 6.7 (6.9) | 6.5 (6.3) | 1848 | −0.1 | −1.5 to 1.2 | 0.85 | 0.179 | 1371 | −0.2 | −1.5 to 1.1 | 0.75 | 2075 | −0.1 | −1.4 to 1.1 | 0.82 |
| 30-months | 6.1 (6.0) | 6.5 (6.6) | 1756 | −0.7 | −1.9 to 0.4 | 0.23 | 0.121 | 1318 | −0.6 | −1.8 to 0.5 | 0.30 | 2075 | −0.8 | −1.9 to 0.3 | 0.14 |
CC1 – partially-adjusted complete case analysis (primary analysis); CC2 – fully-adjusted complete case analysis; MI – fully-adjusted analysis of imputed data.
ICC – Intra-cluster (intra-school) correlation coefficient from crude (unadjusted) analysis.
Comparison of teacher-reported secondary outcomes
| Outcome | Intervention arm (I) | Control arm (C) | Adjusted mean difference/odds ratio | |||
|---|---|---|---|---|---|---|
| Mean ( | Mean ( | Estimate | 95% CI | ICC | ||
| SDQ Total difficulties score in struggling range | ||||||
| 9–30-months | 16.7% | 19.2% | 0.70 | 0.48–0.99 | 0.05 | 0.062 |
| SDQ Behaviour score | ||||||
| 9-months | 0.7 (1.5) | 0.9 (1.6) | −0.1 | −0.3 to 0.1 | 0.27 | 0.092 |
| 18-months | 1.0 (1.8) | 0.9 (1.7) | −0.03 | −0.3 to 0.3 | 0.86 | 0.117 |
| 30-months | 0.9 (1.5) | 1.0 (1.8) | −0.2 | −0.5 to 0.1 | 0.18 | 0.104 |
| SDQ Emotions score | ||||||
| 9-months | 1.3 (1.9) | 1.5 (2.2) | −0.3 | −0.6 to 0.1 | 0.14 | 0.202 |
| 18-months | 1.7 (2.2) | 1.6 (2.1) | 0.1 | −0.3 to 0.6 | 0.63 | 0.179 |
| 30-months | 1.6 (2.1) | 1.6 (2.1) | −0.005 | −0.4 to 0.3 | 0.98 | 0.090 |
| SDQ Overactivity score | ||||||
| 9–30-months | 2.7 (2.9) | 2.8 (3.0) | −0.4 | −0.7 to −0.1 | 0.02 | 0.079 |
| SDQ Peer relationships score | ||||||
| 9-months | 0.8 (1.4) | 1.0 (1.7) | −0.2 | −0.4 to −0.03 | 0.02 | 0.119 |
| 18-months | 1.1 (1.7) | 1.0 (1.6) | 0.1 | −0.2 to 0.4 | 0.62 | 0.131 |
| 30-months | 1.1 (1.6) | 1.1 (1.7) | −0.07 | −0.4 to 0.2 | 0.60 | 0.098 |
| SDQ Pro-social score | ||||||
| 9-months | 8.2 (2.3) | 8.0 (2.3) | 0.4 | 0.1– 0.8 | 0.02 | 0.251 |
| 18-months | 7.8 (2.4) | 8.0 (2.3) | −0.1 | −0.6 to 0.4 | 0.67 | 0.204 |
| 30-months | 8.1 (2.2) | 7.6 (2.3) | 0.5 | −0.03 to 1.0 | 0.06 | 0.164 |
| SDQ Impact score >0 | ||||||
| 9–30-months | 34.5% | 37.3% | 0.80 | 0.61–1.05 | 0.11 | 0.048 |
| Pupil behaviour questionnaire | ||||||
| 9–30-months | 1.8 (2.4) | 1.9 (2.6) | −0.3 | −0.5 to −0.01 | 0.04 | 0.042 |
Mean difference reported for quantitative outcomes and odds ratios reported for binary outcomes.
Struggling scoring 12 or more out of 40.
The sample size for 9-month assessments is 981 in the intervention arm and 1020 in the control arm.
The sample size for 18-month assessment is 894 in the intervention arm and 954 in the control arm.
The sample size for 30-month assessment is 856 in the intervention arm and 900 in the control arm.
ICC – Intra-cluster (intra-school) correlation coefficient from crude (unadjusted) analysis.
Comparison of parent- and child-reported secondary outcomes
| Outcome | Intervention arm (I) | Control arm (C) | Adjusted mean difference/odds ratio | |||
|---|---|---|---|---|---|---|
| Mean ( | Mean ( | Estimate | 95% CI | ICC | ||
| Parent-reported outcomes | ||||||
| SDQ Total difficulties score | ||||||
| 9–30-months | 7.7 (6.5) | 7.6 (6.4) | 0.1 | −0.3 to 0.5 | 0.64 | 0.008 |
| SDQ Total difficulties score in struggling range | ||||||
| 9–30-months | 17.5% | 15.4% | 1.24 | 0.92–1.67 | 0.16 | 0.030 |
| SDQ Behaviour score | ||||||
| 9–30-months | 1.4 (1.7) | 1.3 (1.6) | 0.03 | −0.1 to 0.1 | 0.63 | 0.025 |
| SDQ Emotions score | ||||||
| 9–30-months | 2.1 (2.3) | 2.0 (2.3) | 0.02 | −0.2 to 0.2 | 0.86 | 0.017 |
| SDQ Overactivity score | ||||||
| 9–30-months | 3.0 (2.7) | 3.0 (2.6) | 0.1 | −0.1 to 0.3 | 0.30 | 0.004 |
| SDQ Peer relationships score | ||||||
| 9–30-months | 1.3 (1.7) | 1.3 (1.8) | −0.03 | −0.2 to 0.1 | 0.66 | 0.034 |
| SDQ Pro-social score | ||||||
| 9–30-months | 8.6 (1.7) | 8.7 (1.7) | −0.04 | −0.2 to 0.1 | 0.54 | 0.002 |
| SDQ Impact score >0 | ||||||
| 9–30-months | 33.3% | 30.8% | 0.94 | 0.71–1.25 | 0.69 | 0.035 |
| Assessment of pupil reading level | ||||||
| Fluent reader | ||||||
| 9–30-months | 64.3% | 67.5% | 0.96 | 0.75–1.23 | 0.75 | 0.081 |
| Assessment of pupil's relationship with teacher | ||||||
| Good relationship | ||||||
| 9–30-months | 85.6% | 84.4% | 1.20 | 0.93–1.54 | 0.16 | 0.028 |
| Assessment of parent's relationship with teacher | ||||||
| Good relationship | ||||||
| 9– 30-months | 73.1% | 73.3% | 1.12 | 0.87–1.45 | 0.39 | 0.039 |
| Child-reported outcomes | ||||||
| How I feel about my school | ||||||
| 9-months | 10.8 (2.5) | 10.9 (2.4) | 0.02 | −0.3 to 0.3 | 0.89 | 0.077 |
| 18-months | 10.5 (2.5) | 10.4 (2.8) | 0.3 | −0.1 to 0.7 | 0.17 | 0.106 |
| 30-months | 10.4 (2.8) | 10.3 (2.8) | 0.2 | −0.2 to 0.7 | 0.35 | 0.111 |
Mean difference reported for quantitative outcomes and odds ratios reported for binary outcomes.
Struggling scoring 14 or more out of 40.
The sample size for 9-month parent-reported assessments ranges from 624 to 646 in the intervention arm and 637–642 in the control arm.
The sample size for 18-month parent-reported assessments ranges from 600 to 611 in the intervention arm and 606–617 in the control arm.
The sample size for 30-month parent-reported assessments ranges from 550 to 558 in the intervention arm and 557–569 in the control arm.
The sample size for 9-month child-reported assessment is 991 in the intervention arm and 995 in the control arm.
The sample size for 18-month child-reported assessment is 943 in the intervention arm and 943 in the control arm.
The sample size for 30-month child-reported assessment is 864 in the intervention arm and 896 in the control arm.
ICC – Intra-cluster (intra-school) correlation coefficient.
Mean costs (£) and outcome per participant over the 30-months follow-up period (CC1)*
| Intervention arm (I) ( | Control arm (C) ( | Unadjusted mean difference (I-C) | Adjusted mean difference (I-C)* | |||
|---|---|---|---|---|---|---|
| Mean ( | Mean ( | Estimate | 95% CI | |||
| Costs (£) | ||||||
| Baseline | 119.82 (15.20) | 115.99 (10.87) | 3.83 | −11.67 | −49.90 to 26.55 | 0.55 |
| Intervention | 11.52 (0.00) | 0.00 (0.00) | 11.52 | . | . | . |
| Hospital | 373.49 (0.70) | 354.59 (36.80) | 18.90 | 21.60 | −70.13 to 113.33 | 0.64 |
| Community | 60.24 (0.70) | 74.91 (8.26) | −14.67 | −12.42 | −24.12 to 9.28 | 0.26 |
| Medication | 2.93 (0.70) | 19.08 (7.06) | −16.16 | −9.11 | −25.93 to 7.71 | 0.29 |
| Accommodation | 0.00 (0.00) | 49.36 (27.66) | −49.63 | −49.70 | −127.21 to 27.80 | 0.21 |
| Productivity loss | 76.60 (57.18) | 27.67 (40.58) | 48.93 | −70.41 | −42.51 to 183.33 | 0.22 |
| Total | 524.16 (90.60) | 528.14 (64.31) | −3.98 | 30.24 | −140.98 to 201.47 | 0.73 |
| Outcome | ||||||
| SDQ total difficulties | 5.17 (5.49) | 5.39 (6.05) | −0.22 | −0.54 | −1.68 to 0.61 | 0.36 |
*CC1 – partially adjusted complete case analysis (primary analysis).
Fig. 2.Cost-effectiveness acceptability curve showing the probability that TCM is cost-effective compared to TAU for different values of willingness to pay thresholds (CC1)*. *CC1 – partially adjusted complete case analysis (primary analysis).