| Literature DB >> 24884744 |
Lubna A Baig1, Tanya N Beran, Andrea Vallevand, Zarrukh A Baig, Mauricio Monroy-Cuadros.
Abstract
BACKGROUND: The reliability in Objective Structured Clinical Exams (OSCEs) is based on variance introduced due to examiners, stations, items, standardized patients (SP), and the interaction of one or more of these items with the candidates. The impact of SPs on the reliability has not been well studied. Accordingly, the main purpose of the present study was to assess the accuracy of portrayal by standardized patients.Entities:
Mesh:
Year: 2014 PMID: 24884744 PMCID: PMC4035823 DOI: 10.1186/1472-6920-14-97
Source DB: PubMed Journal: BMC Med Educ ISSN: 1472-6920 Impact factor: 2.463
Cases included in the study
| A | Male | 40-50 | Chest pain | History and management | Gastroesophageal reflux disease (GERD) |
| B | Female | 23-28 | Acute abdomen | History, physical examination and management | Ectopic Pregnancy |
| C | Female | 40-45 | Concerned about memory loss in father | History and counselling | Alzheimer |
| D | Female | 13-18 | Dysmenorrhea Requesting oral contraceptives | History and counselling | Counselling a teenager on contraception |
Case A - SP portrayal of history and management
| SP effectively portrayed his concerns at the opening statement | 2 | 4 | 6 | 0 | 0 | 6 | 4 | 2 | 0.004 |
| SP’s tone of voice was anxious as he is worried about a heart attack | 0 | 6 | 0 | 6 | 2 | 4 | 3 | 3 | 0.078 |
| SP’s facial expressions were appropriate for questions on present history | 6 | 0 | 6 | 0 | 3* | 0 | 6 | 0 | 0.016 |
| SP gave information without asking for questions on history | 0 | 0 | 0 | 0 | 0 | 0 | 1** | 0 | 0.372 |
| SP had appropriate expressions while asking questions at 9 minutes | 1 | 5 | 2 | 3 | 1 | 2* | 4 | 1 | 0.046 |
| SP’s tone of voice was appropriate while asking questions at 9 minutes | 0 | 6 | 0 | 5 | 1 | 5 | 4 | 1 | 0.029 |
| Accuracy (6 items X 6 cases = 36) | 6 | 21 | 18 | 14 | 5 | 27 | 22 | 7 | 0.000 |
| 17% | 58% | 50% | 39% | 14% | 75% | 61% | 19% | ||
| Overall (yes plus yes/but) | Overall = 75% | Overall = 89% | Overall = 89% | Overall = 81% | |||||
*Could not observe the remaining cases for the SP due to direction of the camera.
**The SP gave out the information without being asked only once.
Case B - portrayal of case by SPs across all tracks and both locations
| | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| | ||||||||||||
| SP effectively portrayed being alert at beginning of case | 6 | 0 | 6 | 0 | 6 | 0 | 5 | 1 | 6 | 0 | 6 | 0 |
| SP’s face looked pale♦♣ | 0 | 2** | 0 | 0 | 0 | 0* | 3 | 3 | 3 | 0* | 6 | 0 |
| SP’s mouth looked dry and she either asked for water or said that she had been drinking frequently | 2** | 0 | 6 | 0 | 2 | 4 | 0 | 5* | 3 | 3 | 3 | 3 |
| SP’s tone of voice was appropriate for presenting the chief complaint | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 |
| SP’s facial expressions were appropriate for responding to the questions on history♣♦ | 6 | 0 | 6 | 0 | 0 | 0** | 1 | 4* | 1 | 1* | 6 | 0 |
| SP gave information without asking for questions on presenting complaints*♣ | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| SP gave information without asking for questions on gynaecological/obstetrics history♣♦ | 1 | 0* | 5 | 0* | 6 | 0* | 3 | 3 | 1 | 1* | 4 | 1* |
| SP portrays screams in pain when deep palpation is released | 4 | 0* | 5 | 0 | 6 | 0 | 2 | 1** | 4 | 1** | 2 | 0** |
| SP reacted on additional physical assessment not related to the case | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| On inspection the abdomen seemed distended♣ | 0 | 0** | 0 | 0** | 6 | 0 | 0 | 1** | 0 | 0** | 0 | 0* |
| Accuracy*** | 25 | 2 | 34 | 0 | 38 | 5 | 20 | 18 | 18 | 6 | 27 | 4 |
| 42% | 3% | 57% | 05 | 63% | 8% | 33% | 30% | 30% | 10% | 45% | 6% | |
| (10 items X 6 cases = 60) | | | | | | |||||||
| Overall yes and yes/but | 45% | 57% | 72% | 63% | 40% | 51% | ||||||
*Could not observe the remaining cases for the SP.
**SP did not portray appropriately the remaining cases.
♣P-value for Location 1 < 0.05.
♦P-value for Location 2 < 0.05.
***P-value for comparison of all tracks for both Locations <0.04.
Case C - portrayal of case across all tracks
| SP’s tone of voice was appropriate for the opening statement | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 1.0 |
| SP seemed worried but composed | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 1.0 |
| The SP’s facial expressions were appropriate for responding to the questions on fathers memory | 6 | 0 | 0 | 0* | 6 | 0 | 5 | 0* | 0.0000 |
| SP cried once or twice during silence | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 1.00 |
| SP gave information without asking for questions on father’s recent memory loss♣ | 2 | 0** | 1 | 0** | 0 | 0** | 0 | 0** | 0.242 |
| SP gave information without asking for questions on father’s distant memory♣ | 1 | 0** | 0 | 0** | 0 | 0** | 0 | 0** | 0.372 |
| SP gave information without asking for questions on general health issues of her father♣ | 0 | 0** | 0 | 0** | 0 | 0** | 1 | 0** | 0.372 |
| SP gave information without asking for questions on depression and mood changes♣ | 0 | 0** | 0 | 0** | 0 | 0** | 1 | 0** | 0.372 |
| SP gave information without asking for questions on confusion/orientation in time and place♣ | 1 | 0** | 0 | 0** | 2 | 0** | 0 | 0** | 0.242 |
| Accuracy (9 items X 6 cases = 54) | 28 | 0 | 19 | 0 | 26 | 0 | 25 | 0 | 0.04*** |
| 58% | 0% | 40% | 0 | 54% | 0% | 52% | 0% | ||
| Overall (yes plus yes/but) | 58% | 40% | 54% | 52% | |||||
*Could not observe the SP due to direction of the camera.
**SP did not give out the information without asking.
♣The SPs gave out the information once.
***The comparison was between accurate portrayal and not done as there were 0 values for all “overall yes/but”.
Case D - portrayal of case across all tracks
| SP effectively portrayed the concerns regarding her menstrual cycle | 4 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 1.0 |
| SP’s tone of voice was appropriate for a young girl wishing to get pills | 6 | 0 | 6 | 0 | 6 | 0 | 6 | 0 | 1.0 |
| SP effectively discussed her concerns about her mother finding out that she is in a relationship | 1 | 2* | 2 | 2* | 0 | 0* | 0 | 0* | 0.046 |
| SP’s facial expressions were appropriate for responding to the questions family and social relationships | 1 | 2* | 2 | 2* | 0 | 0* | 0 | 0* | 0.687 |
| SP effectively portrayed her relationship with the boy friend | 1 | 2* | 2 | 2* | 0 | 0* | 0 | 0* | 0.538 |
| SP had appropriate expressions while asking for pills at 7 minutes | 3 | 1 | 6 | 0 | 6 | 0 | 5 | 0* | 0.283 |
| SP’s tone of voice was appropriate when asking about the confidentiality of her discussion with the physician | 4 | 0 | 3 | 1* | 6 | 0 | 5 | 0* | 0.328 |
| Accuracy (7 items X 6 cases = 42) | 20 | 7 | 27 | 7 | 24 | 0 | 22 | 0 | 0.04** |
| Overall (yes plus yes/but) | 48% | | 64% | | 57% | 0 | 52% | 0% | |
| 17% | | 17% | | 57% | | 52% | | ||
| 64% | 81% | ||||||||
*SP did not portray appropriately.
**The comparison was between accurate portrayal and not done as there were 0 values for all “overall yes/but”.