| Literature DB >> 34068195 |
Astrid A M Poelman1, Maeva Cochet-Broch1, Janne Beelen1, Bonnie Wiggins2, Jessica E Heffernan1, David N Cox2.
Abstract
The teacher-led implementation of healthy eating programs in schools is cost-effective and potentially impactful. Teacher acceptability is important for uptake; however, process evaluations are scarce. This study evaluated the effect of two intensities of teacher training on the evaluation of a vegetable education program for Australian primary schools by teachers. The teachers (n = 65) who implemented the program as part of a cluster RCT (25 schools in two states, New South Wales and South Australia) received either low- (provision with materials and online training) or high (additional face-to-face (F2F) training)-intensity training prior to implementing a 5-week vegetable education program. They evaluated the acceptability of a digital training module and program by indicating the level of agreement with 15 and 18 statements, respectively, using 5-point Likert scales. The average item scores ranged from 3.0 to 4.2. All but one item, including student engagement, alignment to the curriculum and intent for reuse of the program, had a rounded average or median score of 4. The level of training intensity did not impact the teacher acceptability ratings. In conclusion, the teacher acceptability was good, and additional F2F training does not add value above the solely digital training of the teachers.Entities:
Keywords: acceptance; child health; cluster RCT; implementation science; primary school; process evaluation; schoolteacher; vegetable
Year: 2021 PMID: 34068195 PMCID: PMC8152987 DOI: 10.3390/nu13051648
Source DB: PubMed Journal: Nutrients ISSN: 2072-6643 Impact factor: 5.717
Statements 1 used in the evaluation of the online training module and their classification according to the dimensions from the LORI framework [28].
| Dimension | Statement |
|---|---|
| Content quality | 1. The content of the online training module was relevant to teaching the vegetable education program |
| 2. The level of detail in the module was appropriate | |
| Learning goals | 3. The module enhanced my knowledge about how to teach enjoyment of vegetables |
| 4. The module enhanced my knowledge to teach students about the senses and how to verbalise their sensations when eating vegetables | |
| 5. The module helped me with the practical implementation of the lessons | |
| Motivation | 6. The information provided prepared me well to teach the program to my students |
| 7. I found the module interesting | |
| 8. The module motivated me to teach the program to my students | |
| Interaction usability | 9. The training module was easy to navigate |
| 10. It was easy to download the resources (lesson plans, shopping lists) from the module | |
| Presentation design | 11. The training module was appealing (visually and auditory) |
| 12. The presentation design (graphics, text, voice-over etc.) supported the content well | |
| Re-usability | 13. The online training module is suitable for teachers at different levels |
| 14. The online training module is suitable for teachers working in different school environments | |
| Other | 15. The duration of the module was appropriate |
1 Rated 1 to 5: 1 = strongly disagree to 5 = strongly agree.
Statements 1 used in the evaluation of the vegetable education program and their classification according to the dimensions from the LORI framework 2 [28].
| Dimension | Statement 3 |
|---|---|
| Content quality |
|
| (0.70) |
|
| Learning goals (0.80) |
|
|
| |
|
| |
| Motivation |
|
| (0.84) |
|
| Feedback and adaptation | 8. The program contained activities that allowed to gauge how much students had learned |
| Accessibility | 9. The program was suitable for students from various backgrounds |
| (0.85) | 10. The program was suitable for students of all abilities |
| Presentation design | 11. There was a good mix of pictorial, text and audio materials in the teaching package |
| Re-usability |
|
| (0.98) |
|
| Standards |
|
| Feasibility |
|
| (0.68) | 16. The number of lessons was appropriate |
| 17. The duration of the lessons was appropriate | |
| Other | 18. I used the vegetables that were suggested for the lessons |
1 Rated 1 to 5: 1 = strongly disagree to 5 = strongly agree. 2 Feasibility was not an original construct of the LORI framework. 3 Items in bold were also used in the pilot evaluation [16].
Average (standard deviation (SD)) (for constructs) and median (interquartile range (IQR) (for single items) levels of agreement for various dimensions (Cronbach’s alpha) and statements by the teachers (n = 51) evaluating the online training module and statistical significance as a factor of intervention (high- vs. low-intensity training) and state (New South Wales vs. South Australia). The ratings ranged from 1–5.
| Dimension (Cronbach’s Alpha)/Statement | Average/Median | SD/IQR | Intervention | State | ||
|---|---|---|---|---|---|---|
| F Value/U Value | F Value/U Value | |||||
| Constructs | ||||||
| Content quality (0.89) | 4.11 | 0.55 | 0.40 | 0.40 | 2.74 | 0.11 |
| Learning goals (0.89) | 3.88 | 0.69 | 0.42 | 0.41 | 1.38 | 0.25 |
| Motivation (0.84) | 3.86 | 0.71 | 0.20 | 0.89 | 0.67 | 0.42 |
| Re-usability (0.83) | 3.95 | 0.49 | 0.72 | 0.40 | 3.65 | 0.06 |
| Presentation design (0.82) | 3.95 | 0.49 | 0.01 | 0.99 | 0.52 | 0.47 |
| Single items | ||||||
| The training module was easy to navigate | 4 | (4;4) | 0.37 | 0.54 | 0.61 | 0.54 |
| It was easy to download the resources from the module | 4 | (3;4) | 0.47 | 0.50 | 1.65 | 0.10 |
| The duration of the module was appropriate | 4 | (4;4) | 0.24 | 0.63 | 1.49 | 0.14 |
Average (standard deviation (SD)) (for constructs) and median (interquartile range (IQR)) (for single items) levels of agreement for various dimensions (Cronbach’s alpha) and statements by the teachers (n = 65) who implemented the program (across both high- and low-intensity training) evaluating the vegetable education program and statistical significance as a factor of intervention (high- vs. low-intensity training) and state (New South Wales vs. South Austalia). The ratings ranged from 1–5.
| Dimension (Cronbach’s Alpha)/Statement | Average/Median | SD/IQR | Training Intensity | State | ||
|---|---|---|---|---|---|---|
| F Value/U Value | F Value/U Value | |||||
| Constructs | ||||||
| Content quality (0.70) | 4.13 | 0.64 | 0.00 | 1.00 | 2.98 | 0.09 |
| Learning goals (0.80) | 4.01 | 0.58 | 0.50 | 0.48 | 0.7 | 0.79 |
| Motivation (0.84) | 4.21 | 0.64 | 1.49 | 0.23 | 8.62 | 0.005 |
| Accessibility (0.85) | 4.11 | 0.58 | 0.02 | 0.90 | 7.73 | 0.007 |
| Re-usability (0.98) | 3.79 | 0.92 | 2.40 | 0.13 | 0.69 | 0.41 |
| Single items | ||||||
| The program related well to the curriculum | 4 | (4;4) | 0.46 | 0.65 | 0.11 | 0.92 |
| The program contained activities that allowed to gauge how much students had learned | 4 | (3;4) | 0.18 | 0.86 | 1.36 | 0.17 |
| There was a good mix of pictorial, text and audio materials in the teaching package | 4 | (4;4) | 0.90 | 0.37 | 2.25 | 0.02 |
| The amount of preparation for each lesson was reasonable | 3 | (2;4) | 1.00 | 0.32 | 0.16 | 0.87 |
| The number of lessons was appropriate | 4 | (4;4) | 1.56 | 0.12 | 1.68 | 0.09 |
| The duration of the lessons was appropriate | 4 | (2;4) | 1.42 | 0.16 | 2.61 | 0.009 |
| I used the vegetables that were suggested for the lessons | 4 | (4;4) | 0.24 | 0.81 | 0.67 | 0.5 |
Average (standard deviation (SD)) for the constructs and median (interquartile range (IQR)) (for single items) level of agreement by the teachers for the dimensions (Cronbach’s alpha) and statements evaluating the vegetable education program, for which a statistical significance difference between the states was obtained.
| Dimension (Cronbach’s Alpha)/Statement | New South Wales | South Australia | F Value/U Value | |
|---|---|---|---|---|
| Constructs | ||||
| Motivation (0.84) | 4.39 (0.61) | 3.94 (0.61) | 8.62 | 0.005 |
| Accessibility (0.85) | 4.28 (0.53) | 3.88 (0.59) | 7.73 | 0.007 |
| Single items | ||||
| There was a good mix of pictorial, text and audio materials in the teaching package | 4 (4–4) | 4 (3–4) | 2.25 | 0.02 |
| The duration of the lessons was appropriate | 4 (4–4) | 3 (2–4) | 1.68 | 0.009 |
Figure 1Comparison between the acceptability ratings of the previous (pilot, [16]) and current (modified) versions of the vegetable education program on 11 statements (median and SE) on a scale of 1–5 based on the responses from the New South Wales teachers (n = 27 in the pilot study [16] and n = 38 in the current study). p-values indicate statistically significant differences between groups.