Eleanor B Peterson1, Aaron W Calhoun2, Elizabeth A Rider3. 1. Department of Pediatrics, University of Louisville School of Medicine, Louisville, USA. Electronic address: ebpete01@louisville.edu. 2. Department of Pediatrics, University of Louisville School of Medicine, Louisville, USA. 3. Department of Pediatrics, Harvard Medical School, Boston, USA; Institute for Professionalism and Ethical Practice, Boston Children's Hospital, Boston, USA.
Abstract
OBJECTIVE: With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. METHODS: The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. RESULTS: The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). CONCLUSION: The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. PRACTICE IMPLICATIONS: The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners.
OBJECTIVE: With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. METHODS: The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. RESULTS: The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). CONCLUSION: The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. PRACTICE IMPLICATIONS: The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners.
Keywords:
Assessment tools; Communication assessment; Communication competency; Communication education; Communication skills; Kalamazoo Consensus Statement; Simulation
Authors: Katharine E Brock; Harvey J Cohen; Barbara M Sourkes; Julie J Good; Louis P Halamek Journal: J Palliat Med Date: 2017-04-24 Impact factor: 2.947
Authors: Eleanor B Peterson; Kimberly A Boland; Kristina A Bryant; Tara F McKinley; Melissa B Porter; Katherine E Potter; Aaron W Calhoun Journal: J Grad Med Educ Date: 2016-12
Authors: Ellen C Meltzer; Zhenzhen Shi; Alexandra Suppes; Jennifer E Hersh; Jay D Orlander; Aaron W Calhoun; Judy Tung; Lia Logio; Ruth Manna; Philip A Bialer; Cathleen A Acres; Joseph J Fins Journal: J Grad Med Educ Date: 2017-08
Authors: Anna Beatriz C N Amaral; Elizabeth A Rider; Paula P Lajolo; Luiz G Tone; Rogerio M C Pinto; Marisa P Lajolo; Aaron W Calhoun Journal: Int J Med Educ Date: 2016-12-11
Authors: César Leal-Costa; Sonia Tirado-González; Jesús Rodríguez-Marín; Carlos Javier Vander-Hofstadt-Román Journal: Int J Clin Health Psychol Date: 2015-05-09