| Literature DB >> 26817693 |
Daniel S Furmedge1, Laura-Jane Smith2, Alison Sturrock3.
Abstract
BACKGROUND: Objective Structured Clinical Examination (OSCE) is a core component of undergraduate medical student assessment. With increased emphasis on integrated programmes, more courses include OSCEs in the traditionally 'preclinical' years. The acceptability and impact of such assessment methods at this stage of training is unknown.Entities:
Mesh:
Year: 2016 PMID: 26817693 PMCID: PMC4730723 DOI: 10.1186/s12909-016-0542-3
Source DB: PubMed Journal: BMC Med Educ ISSN: 1472-6920 Impact factor: 2.463
Student responses to Likert scale questionnaire items
| Strongly disagree | Disagree | Neutral | Agree | Strongly agree | n | Median | Mean | Standard deviation | |
|---|---|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | |||||
| My level of anxiety before this exam was detrimental to my performance | 102 (8.3 %) | 362 (29.3 %) | 393 (31.8 %) | 290 (23.5 %) | 87 (7.1 %) | 1234 | 3 | 2.92 | 1.07 |
| The exam tested my progress | 20 (2 %) | 91 (7.4 %) | 276 (22.4 %) | 652 (52.9 %) | 194 (15.7 %) | 1233 | 4 | 3.74 | 0.87 |
| The exam was a worthwhile exercise | 15 (1.2 %) | 27 (2.2 %) | 144 (11.7 %) | 534 (43.3 %) | 512 (41.6 %) | 1232 | 4 | 4.22 | 0.82 |
| The exam gave me a good chance to demonstrate my knowledge/ability | 12 (0.9 %) | 94 (7.6 %) | 314 (25.5 %) | 612 (49.6 %) | 201 (16.3 %) | 1233 | 4 | 3.73 | 0.86 |
| Thid type of exam is enjoyable | 114 (9.2 %) | 241 (19.5 %) | 379 (30.7 %) | 367 (29.7 %) | 133 (10.8 %) | 1234 | 3 | 3.13 | 1.13 |
| This type of exam is appropriate for this stage of training | 22 (1.8 %) | 95 (7.7 %) | 343 (27.8 %) | 575 (46.7 %) | 197 (16 %) | 1232 | 4 | 3.67 | 0.9 |
| This exam was acceptable to me | 19 (1.5 %) | 90 (7.3 %) | 304 (24.7 %) | 580 (47 %) | 240 (19.5 %) | 1233 | 4 | 3.75 | 0.9 |
| The exam balanced integration of clinical skills with basic science | 4 (0.3 %) | 41 (3.3 %) | 186 (15 %) | 611 (49.6 %) | 391 (31.7 %) | 1233 | 4 | 4.09 | 0.79 |
Spearman’s correlation of student responses to Likert scale questionnaire items
| Spearman’s correlation | Worthwhile | Demonstrate | Appropriate | Acceptable | Integration | Anxiety | Enjoyable |
|---|---|---|---|---|---|---|---|
| Test progress | 0.41** | 0.45** | 0.33** | 0.36** | 0.38** | −0.08* | 0.24** |
| Worthwhile | 0.49** | 0.43** | 0.52** | 0.43** | −0.08* | 0.28** | |
| Demonstrate | 0.40** | 0.43** | 0.38** | −0.15** | 0.42** | ||
| Appropriate | 0.54** | 0.38** | −0.14** | 0.39** | |||
| Acceptable | 0.52** | −0.15** | 0.34** | ||||
| Integration | −0.11** | 0.24** | |||||
| Anxiety | −0.30** |
**: p < 0.001
*: p < 0.01
Factor analysis on all student responses to Likert scale questionnaire items using Varimax rotation
| Item | Loading on factor 1a | Loading on factor 2a |
|---|---|---|
| Test progress | 0.69 | |
| Worthwhile | 0.78 | |
| Demonstrate | 0.69 | |
| Appropriate | 0.64 | |
| Acceptable | 0.75 | |
| Integration | 0.70 | |
| Anxiety | −0.87 | |
| Enjoyable | 0.36 | 0.70 |
aWeights less than 0.3 not shown
Median Likert score 1–5 (with interquartile ranges) for each cohort
| Cohort | Test progress | Worthwhile | Demonstrate | Appropriate | Acceptable | Integration | Anxiety | Enjoyable |
|---|---|---|---|---|---|---|---|---|
| year 1 students in 2013 | 4 (3–4) | 4 (4–5) | 4 (3–4) | 4 (3–4) | 4 (3–4) | 4 (4–5) | 3(2–4) | 3 (2–4) |
| year 1 students in 2014 | 4 (3–4) | 4 (4–5) | 4 (3–4) | 4 (3–4) | 4 (3–4) | 4 (4–5) | 3(2–4) | 3 (2–4) |
| year 2 students in 2013 | 4 (3–4) | 4 (4–5) | 4 (3–4) | 4 (3–4) | 4 (3–4) | 4 (4–5) | 3(2–4) | 3 (2–4) |
| year 2 students in 2014 | 4 (3–4) | 4 (4–5) | 4 (3–4) | 4 (3–4) | 4 (3–4) | 4 (4–5) | 3(2–4) | 3 (2–4) |
Pooled overall ratings with hedonic response
| Cohort | Overall rating | Hedonic |
|---|---|---|
| year 1 students in 2013 | 4 (3.5-4.3) | 3 (2.5-3.5) |
| year 1 students in 2014 | 4 (3.5-4.3) | 3 (2.5-3.5) |
| year 2 students in 2013 | 3.8 (3.5-4.3) | 3 (2.5-4) |
| year 2 students in 2014 | 3.8 (3.5-4.2) | 3 (2.5-4) |
Mann–Whitney test comparing 2013 year 1 score with 2014 year 2 scores
| Item |
|
|
|---|---|---|
| Test progress | 1.9 | 0.057 |
| Worthwhile | 1.7 | 0.093 |
| Demonstrate | 2.9 | 0.004 |
| Appropriate | 1.3 | 0.2 |
| Acceptable | 1.9 | 0.059 |
| Integration | 1.8 | 0.072 |
| Anxiety | 0.3 | 0.8 |
| Enjoyable | 1.6 | 0.11 |
|
| 1.9 | 0.052 |
|
| 1.0 | 0.3 |