| Literature DB >> 29115073 |
Sang Chul Kim1,2, Young Sun Ro3, Sang Do Shin2,4, Dae Han Wi2,5, Joongsik Jeong6, Ju Ok Park2,7, Kyong Min Sun2,4, Kwangsoo Bae2,8.
Abstract
Development of a competence-based curriculum is important. This study aimed to develop competence assessment tools in emergency medicine and use it to assess competence of Cameroonian healthcare professionals. This was a cross-sectional, descriptive study. Through literature review, expert survey, and discrimination tests, we developed a self-survey questionnaire and a scenario-based competence assessment tool for assessing clinical knowledge and self-confidence to perform clinical practices or procedures. The self-survey consisted of 23 domains and 94 questionnaires on a 5-point Likert scale. Objective scenario-based competence assessment tool was used to validate the self-survey results for five life-threatening diseases presenting frequently in emergency rooms of Cameroon. Response rate of the self-survey was 82.6%. In this first half of competence assessment, knowledge of infectious disease had the highest score (4.6 ± 0.4) followed by obstetrics and gynecology (4.2 ± 0.6) and hematology and oncology (4.2 ± 0.5); in contrast, respondents rated the lowest score in the domains of disaster, abuse and assault, and psychiatric and behavior disorder (all of mean 2.8). In the scenario-based test, knowledge of multiple trauma had the highest score (4.3 ± 1.2) followed by anaphylaxis (3.4 ± 1.4), diabetic ketoacidosis (3.3 ± 1.0), ST-elevation myocardial infarction (2.5 ± 1.4), and septic shock (2.2 ± 1.1). Mean difference between the self-survey and scenario-based test was statistically insignificant (mean, -0.02; 95% confidence interval, -0.41 to 0.36), and agreement rate was 58.3%. Both evaluation tools showed a moderate correlation, and the study population had relatively low competence for specific aspects of emergency medicine and clinical procedures and skills.Entities:
Keywords: Developing Countries; Emergency Medicine; Professional Competence
Mesh:
Year: 2017 PMID: 29115073 PMCID: PMC5680490 DOI: 10.3346/jkms.2017.32.12.1931
Source DB: PubMed Journal: J Korean Med Sci ISSN: 1011-8934 Impact factor: 2.153
Comparison of self-survey competency assessment results in Korean emergency residents and Cameroonian healthcare professionals
| Topic-domain | Question No. | Korean emergency residents | Cameroonian healthcare professionals | |||||
|---|---|---|---|---|---|---|---|---|
| Junior (n = 7) | Senior (n = 5) | AUC (95% CI) | Total (n = 19) | GP (n = 9) | Specialist (n = 10) | |||
| I. Core clinical knowledge | ||||||||
| 1. Cardiovascular | 5 | 2.8 ± 0.2 | 4.2 ± 0.1 | 1.00 (1.00–1.00) | 3.8 ± 0.6 | 3.4 ± 0.5 | 4.1 ± 0.5 | 0.007 |
| 2. Pulmonary | 5 | 3.5 ± 0.2 | 4.2 ± 0.1 | 0.85 (0.61–1.00) | 3.8 ± 0.5 | 3.6 ± 0.4 | 4.0 ± 0.5 | 0.114 |
| 3. Gastrointestinal | 5 | 3.5 ± 0.3 | 4.2 ± 0.3 | 1.00 (1.00–1.00) | 3.9 ± 0.6 | 3.9 ± 0.4 | 4.0 ± 0.7 | 0.753 |
| 4. Renal and genitourinary | 6 | 2.8 ± 0.3 | 3.9 ± 0.2 | 1.00 (1.00–1.00) | 3.7 ± 0.5 | 3.5 ± 0.5 | 3.9 ± 0.4 | 0.116 |
| 5. Obstetrics and gynecology | 1 | 2.4 ± 0.3 | 3.9 ± 0.4 | 1.00 (1.00–1.00) | 4.2 ± 0.6 | 4.4 ± 0.5 | 4.1 ± 0.6 | 0.275 |
| 6. Pediatrics | 5 | 3.2 ± 0.2 | 3.9 ± 0.1 | 0.90 (0.69–1.00) | 4.1 ± 0.4 | 4.1 ± 0.3 | 4.1 ± 0.5 | 0.692 |
| 7. Infectious disease | 5 | 2.5 ± 0.4 | 3.5 ± 0.3 | 0.94 (0.78–1.00) | 4.6 ± 0.4 | 4.6 ± 0.4 | 4.6 ± 0.4 | 0.629 |
| 8. Neurological disorder | 6 | 3.1 ± 0.2 | 4.0 ± 0.1 | 0.92 (0.73–1.00) | 4.0 ± 0.5 | 3.8 ± 0.5 | 4.2 ± 0.5 | 0.126 |
| 9. Toxicology | 2 | 2.3 ± 0.3 | 3.6 ± 0.0 | 0.96 (0.84–1.00) | 3.3 ± 0.6 | 3.2 ± 0.7 | 3.4 ± 0.5 | 0.512 |
| 10. Endocrine and metabolic | 3 | 2.5 ± 0.4 | 3.8 ± 0.3 | 1.00 (1.00–1.00) | 4.0 ± 0.5 | 3.9 ± 0.6 | 4.1 ± 0.5 | 0.384 |
| 11. Hematologic and oncologic | 4 | 2.8 ± 0.5 | 3.8 ± 0.3 | 0.98 (0.90–1.00) | 4.2 ± 0.5 | 4.0 ± 0.4 | 4.4 ± 0.5 | 0.103 |
| 12. Eyes, ears, nose, throat, oral, and neck | 8 | 3.1 ± 0.2 | 3.8 ± 0.1 | 0.79 (0.50–1.00) | 3.2 ± 0.6 | 3.3 ± 0.5 | 3.1 ± 0.6 | 0.429 |
| 13. Dermatologic | 1 | 3.4 ± 0.4 | 4.6 ± 0.4 | 0.92 (0.74–1.00) | 4.1 ± 0.6 | 4.1 ± 0.5 | 4.2 ± 0.7 | 0.626 |
| 14. Trauma | 4 | 2.8 ± 0.3 | 3.9 ± 0.5 | 0.92 (0.74–1.00) | 3.7 ± 0.5 | 3.5 ± 0.4 | 3.8 ± 0.5 | 0.195 |
| 15. Musculoskeletal | 2 | 2.9 ± 0.4 | 4.1 ± 0.3 | 0.98 (0.90–1.00) | 3.8 ± 0.6 | 3.4 ± 0.6 | 4.1 ± 0.5 | 0.032 |
| 16. Psychiatric and behavior | 1 | 2.6 ± 1.0 | 3.6 ± 0.5 | 0.88 (0.65–1.00) | 2.8 ± 1.0 | 3.0 ± 1.0 | 2.7 ± 0.9 | 0.511 |
| 17. Resuscitation | 2 | 3.0 ± 0.3 | 4.3 ± 0.3 | 0.94 (0.78–1.00) | 3.3 ± 0.7 | 2.9 ± 0.6 | 3.7 ± 0.5 | 0.017 |
| II. Specific aspects of emergency medicine | ||||||||
| 18. Disaster | 1 | 1.9 ± 0.9 | 3.0 ± 1.4 | 0.77 (0.43–1.00) | 2.8 ± 1.1 | 2.6 ± 1.0 | 3.1 ± 1.1 | 0.277 |
| 19. Abuse and assault | 1 | 2.6 ± 1.0 | 3.5 ± 0.6 | 0.75 (0.44–1.00) | 2.8 ± 1.0 | 2.4 ± 0.9 | 3.2 ± 1.0 | 0.106 |
| 20. Environmental injuries | 4 | 2.4 ± 0.3 | 3.6 ± 0.4 | 0.83 (0.57–1.00) | 3.1 ± 0.6 | 2.8 ± 0.4 | 3.4 ± 0.6 | 0.045 |
| 21. Prehospital care | 5 | 1.6 ± 0.3 | 3.1 ± 0.2 | 0.79 (0.45–1.00) | 3.2 ± 0.6 | 3.0 ± 0.4 | 3.3 ± 0.6 | 0.204 |
| III. Clinical procedures and skills | ||||||||
| 22. CPR skills | 9 | 2.1 ± 0.3 | 4.3 ± 0.3 | 1.00 (1.00–1.00) | 3.0 ± 0.7 | 2.6 ± 0.4 | 3.4 ± 0.7 | 0.007 |
| 23. Procedure | 9 | 2.4 ± 0.4 | 3.5 ± 0.1 | 0.92 (0.73–1.00) | 3.5 ± 0.5 | 3.3 ± 0.5 | 3.8 ± 0.4 | 0.028 |
| Total | 94 | 2.7 ± 0.4 | 3.8 ± 0.3 | 1.00 (1.00–1.00) | 3.6 ± 0.4 | 3.5 ± 0.3 | 3.8 ± 0.3 | 0.038 |
Values are presented as mean ± SD.
SD = standard deviation, AUC = area under the curve, CI = confidence interval, GP = general physician, CPR = cardiopulmonary resuscitation.
Inter-rater reliability between two interviewers (Korean emergency physicians)
| Interviewer | Interviewer 2 | ||||||
|---|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | Total | ||
| Interviewer 1 | 1 | 12 | 2 | 0 | 1 | 0 | 15 |
| 2 | 1 | 12 | 3 | 0 | 0 | 16 | |
| 3 | 0 | 2 | 13 | 2 | 0 | 17 | |
| 4 | 0 | 0 | 2 | 18 | 0 | 20 | |
| 5 | 0 | 0 | 0 | 0 | 16 | 16 | |
| Total | 13 | 16 | 18 | 21 | 16 | 84* | |
Agreement rate, 84.5%; weighted kappa, 0.88; 95% CI, 0.82 to 0.95.
*A total score of 84 was derived from 14 questions answered by 6 Cameroonian doctors.
The gray color cells are the number of items that match the score of two reviewers.
Scenario-based competency assessment between GPs and specialists in Cameroon
| Clinical scenario | Question No. | Detailed item No. | Total (n=6) | GP (n=3) | Specialist (n=3) | |
|---|---|---|---|---|---|---|
| 1. Septic shock | 3 | 11 | 2.2±1.1 | 1.9±0.8 | 2.6±1.2 | 0.186 |
| 2. Diabetes ketoacidosis | 3 | 6 | 3.3±1.0 | 2.8±1.0 | 3.8±0.7 | 0.018 |
| 3. STEMI | 3 | 3 | 2.5±1.4 | 2.0±1.3 | 3.0±1.4 | 0.136 |
| 4. Multiple trauma | 2 | 3 | 4.3±1.2 | 4.2±1.6 | 4.5±0.8 | 0.656 |
| 5. Anaphylaxis | 3 | 3 | 3.4±1.4 | 3.6±1.5 | 3.3±1.3 | 0.740 |
| Total | 14 | 26 | 3.1±1.4 | 2.8±1.5 | 3.4±1.3 | 0.062 |
Values are presented as number or mean ± SD.
STEMI = ST-elevation myocardial infarction, SD = standard deviation, GP = general physician.
Difference between scenario-based test and self-survey test
| Subjects | Position | Mean difference* | 95% CI |
|---|---|---|---|
| Doctor 1 | GP | −0.50 | −1.80 to 0.80 |
| Doctor 2 | S | 0.00 | −0.82 to 0.82 |
| Doctor 3 | S | 0.36 | −0.54 to 1.25 |
| Doctor 4 | S | 0.57 | −0.43 to 1.58 |
| Doctor 5 | GP | 0.64 | −0.25 to 1.54 |
| Doctor 6 | GP | −1.21 | −2.15 to −0.28 |
| Total | −0.02 | −0.41 to 0.36 |
GP = general physician, S = specialist, CI = confidence interval.
*Mean difference was calculated as the average of scenario-based scores subtracted by the average of self-survey score of 14 questions.
Comparison of scores between self-survey and scenario-based competency assessments
| Self-survey score | Scenario-based score | |||||
|---|---|---|---|---|---|---|
| 1 | 2 | 3 | 4 | 5 | Total | |
| 1 | 4 | 2 | 0 | 2 | 1 | 9 |
| 2 | 0 | 5 | 3 | 3 | 4 | 15 |
| 3 | 6 | 2 | 6 | 9 | 5 | 28 |
| 4 | 3 | 4 | 6 | 5 | 5 | 23 |
| 5 | 2 | 3 | 2 | 1 | 1 | 9 |
| Total | 15 | 16 | 17 | 20 | 16 | 84* |
Agreement rate, 58.3%; under-estimation rate, 17.9%; over-estimation rate, 23.8%.
*A total score of 84 was derived from 14 questions answered by 6 Cameroonian doctors.
Gray color cells are the number of items with similar survey-based and scenario-based scores.