OBJECTIVES: To develop and validate a rubric assessment instrument for use by pediatric emergency medicine (PEM) faculty to evaluate PEM fellows and for fellows to use to self-assess. METHODS: This is a prospective study at a PEM fellowship program. The assessment instrument was developed through a multistep process: (1) development of rubric format items, scaled on the modified Dreyfus model proficiency levels, corresponding to the 6 Accreditation Council for Graduate Medical Education core competencies; (2) determination of content and construct validity of the items through structured input and item refinement by subject matter experts and focus group review; (3) collection of data using a 61-item form; (4) evaluation of psychometrics; (5) selection of items for use in the final instrument. RESULTS: A total of 261 evaluations were collected from 2006 to 2007; exploratory factor analysis yielded 5 factors with Eigenvalues >1.0; each contained ≥4 items, with factor loadings >0.4 corresponding with the following competencies: (1) medical knowledge and practice-based learning and improvement, (2) patient care and systems-based practice, (3) interpersonal skills, (4) communication skills, and (5) professionalism. Cronbach α for the final 53-item instrument was 0.989. There was also significant responsiveness of the tool to the year of training. CONCLUSION: A substantively and statistically validated rubric evaluation of PEM fellows is a reliable tool for formative and summative evaluation.
OBJECTIVES: To develop and validate a rubric assessment instrument for use by pediatric emergency medicine (PEM) faculty to evaluate PEM fellows and for fellows to use to self-assess. METHODS: This is a prospective study at a PEM fellowship program. The assessment instrument was developed through a multistep process: (1) development of rubric format items, scaled on the modified Dreyfus model proficiency levels, corresponding to the 6 Accreditation Council for Graduate Medical Education core competencies; (2) determination of content and construct validity of the items through structured input and item refinement by subject matter experts and focus group review; (3) collection of data using a 61-item form; (4) evaluation of psychometrics; (5) selection of items for use in the final instrument. RESULTS: A total of 261 evaluations were collected from 2006 to 2007; exploratory factor analysis yielded 5 factors with Eigenvalues >1.0; each contained ≥4 items, with factor loadings >0.4 corresponding with the following competencies: (1) medical knowledge and practice-based learning and improvement, (2) patient care and systems-based practice, (3) interpersonal skills, (4) communication skills, and (5) professionalism. Cronbach α for the final 53-item instrument was 0.989. There was also significant responsiveness of the tool to the year of training. CONCLUSION: A substantively and statistically validated rubric evaluation of PEM fellows is a reliable tool for formative and summative evaluation.
Authors: Earl J Reisdorff; Dale J Carlson; Mat Reeves; Gregory Walker; Oliver W Hayes; Brian Reynolds Journal: Acad Emerg Med Date: 2004-08 Impact factor: 3.451
Authors: Jane E Blood-Siegfried; Nancy M Short; Carla Gene Rapp; Elizabeth Hill; Steve Talbert; John Skinner; Amy Campbell; Linda Goodwin Journal: Int J Nurs Educ Scholarsh Date: 2008-09-05
Authors: Ryan J Koehler; Simon Amsdell; Elizabeth A Arendt; Leslie J Bisson; Jonathan P Braman; Jonathan P Bramen; Aaron Butler; Andrew J Cosgarea; Christopher D Harner; William E Garrett; Tyson Olson; Winston J Warme; Gregg T Nicandri Journal: Am J Sports Med Date: 2013-04-02 Impact factor: 6.202