PURPOSE: To evaluate the effectiveness of binary content checklists in measuring increasing levels of clinical competence. METHOD: Fourteen clinical clerks, 14 family practice residents, and 14 family physicians participated in two 15-minute standardized patient interviews. An examiner rated each participant's performance using a binary content checklist and a global process rating. The participants provided a diagnosis two minutes into and at the end of the interview. RESULTS: On global scales, the experienced clinicians scored significantly better than did the residents and clerks, but on checklists, the experienced clinicians scored significantly worse than did the residents and clerks. Diagnostic accuracy increased for all groups between the two-minute and 15-minute marks without significant differences between the groups. CONCLUSION: These findings are consistent with the hypothesis that binary checklists may not be valid measures of increasing clinical competence.
RCT Entities:
PURPOSE: To evaluate the effectiveness of binary content checklists in measuring increasing levels of clinical competence. METHOD: Fourteen clinical clerks, 14 family practice residents, and 14 family physicians participated in two 15-minute standardized patient interviews. An examiner rated each participant's performance using a binary content checklist and a global process rating. The participants provided a diagnosis two minutes into and at the end of the interview. RESULTS: On global scales, the experienced clinicians scored significantly better than did the residents and clerks, but on checklists, the experienced clinicians scored significantly worse than did the residents and clerks. Diagnostic accuracy increased for all groups between the two-minute and 15-minute marks without significant differences between the groups. CONCLUSION: These findings are consistent with the hypothesis that binary checklists may not be valid measures of increasing clinical competence.
Authors: Michael McGillion; Adam Dubrowski; Robyn Stremler; Judy Watt-Watson; Fiona Campbell; Colin McCartney; Charles Victor; Jeffrey Wiseman; Linda Snell; Judy Costello; Anja Robb; Sioban Nelson; Jennifer Stinson; Judith Hunter; Thuan Dao; Sara Promislow; Nancy McNaughton; Scott White; Cindy Shobbrook; Lianne Jeffs; Kianda Mauch; Marit Leegaard; W Scott Beattie; Martin Schreiber; Ivan Silver Journal: Pain Res Manag Date: 2011 Nov-Dec Impact factor: 3.037