STUDY OBJECTIVE: The purpose of this study was to develop an objective method of evaluating resident competency in systems-based practice. STUDY DESIGN: Faculty developed a 12-station examination, the Objective Structured System-Interaction Examination (OSSIE), patterned after the Objective Structured Clinical Examinations (OSCEs), to evaluate residents' ability to effectively work within the complex medical system of care. Scenarios consisted of multiple situations, such as patient hand-offs, consultations, complicated discharges, and family meetings, in which residents interacted with simulated professionals, simulated patients, and simulated family members to demonstrate the systems-based skills. Twelve second-year residents participated in the OSSIE. FINDINGS: Along with the standardized professionals, a faculty member provided the resident with immediate feedback and completed an evaluation form designed specifically to assess systems-based practice. Residents, faculty, and staff evaluated the OSSIE and felt it provided a rich learning experience and was a beneficial means of formative assessment. The residents' third-year learning experiences were adapted to meet their needs, and suggestions were offered for curriculum revision. DISCUSSION: The OSSIE is unique in that it uses standardized professionals, involves scenarios in a variety of settings, and incorporates current technology, including an electronic health record and a state-of-the-art simulation laboratory, into the examination. Challenges to implementation include faculty time, scheduling of residents, and availability of resources. CONCLUSION: By using the OSSIE, faculty are able to assess, provide constructive feedback, and tailor training opportunities to improve resident competence in systems-based practice. Reliability and validity of an instrument developed for use with the OSSIE are currently being determined.
STUDY OBJECTIVE: The purpose of this study was to develop an objective method of evaluating resident competency in systems-based practice. STUDY DESIGN: Faculty developed a 12-station examination, the Objective Structured System-Interaction Examination (OSSIE), patterned after the Objective Structured Clinical Examinations (OSCEs), to evaluate residents' ability to effectively work within the complex medical system of care. Scenarios consisted of multiple situations, such as patient hand-offs, consultations, complicated discharges, and family meetings, in which residents interacted with simulated professionals, simulated patients, and simulated family members to demonstrate the systems-based skills. Twelve second-year residents participated in the OSSIE. FINDINGS: Along with the standardized professionals, a faculty member provided the resident with immediate feedback and completed an evaluation form designed specifically to assess systems-based practice. Residents, faculty, and staff evaluated the OSSIE and felt it provided a rich learning experience and was a beneficial means of formative assessment. The residents' third-year learning experiences were adapted to meet their needs, and suggestions were offered for curriculum revision. DISCUSSION: The OSSIE is unique in that it uses standardized professionals, involves scenarios in a variety of settings, and incorporates current technology, including an electronic health record and a state-of-the-art simulation laboratory, into the examination. Challenges to implementation include faculty time, scheduling of residents, and availability of resources. CONCLUSION: By using the OSSIE, faculty are able to assess, provide constructive feedback, and tailor training opportunities to improve resident competence in systems-based practice. Reliability and validity of an instrument developed for use with the OSSIE are currently being determined.
Authors: Antoinette S Peters; Joe Kimura; Maryjoan D Ladden; Elizabeth March; Gordon T Moore Journal: J Gen Intern Med Date: 2008-07 Impact factor: 5.128
Authors: Tim Stokes; Carolyn Tarrant; Arch G Mainous; Henk Schers; George Freeman; Richard Baker Journal: Ann Fam Med Date: 2005 Jul-Aug Impact factor: 5.166
Authors: Gail J Povar; Helen Blumen; John Daniel; Suzanne Daub; Lois Evans; Richard P Holm; Natalie Levkovich; Alice O McCarter; James Sabin; Lois Snyder; Daniel Sulmasy; Peter Vaughan; Laurence D Wellikson; Amy Campbell Journal: Ann Intern Med Date: 2004-07-20 Impact factor: 25.391
Authors: Mark J Graham; Zoon Naqvi; John A Encandela; Carma L Bylund; Randa Dean; Ayxa Calero-Breckheimer; Hilary J Schmidt Journal: Adv Health Sci Educ Theory Pract Date: 2008-02-28 Impact factor: 3.853
Authors: Gregory J Nadolski; Mary A Bell; Barbara B Brewer; Richard M Frankel; Herbert E Cushing; James J Brokaw Journal: BMC Med Educ Date: 2006-04-25 Impact factor: 2.463
Authors: Brett Kissela; Steven Harris; Dawn Kleindorfer; Christopher Lindsell; Robert Pascuzzi; Daniel Woo; Jerzy Szaflarski; Daniel Kanter; Alex Schneider; Michael Sostok; Joseph Broderick Journal: BMC Med Educ Date: 2006-04-25 Impact factor: 2.463