Michelle Z Farland1, Xiaoying Feng2, Andrea S Franks3, Karen R Sando4, Linda S Behar-Horenstein5. 1. University of Florida College of Pharmacy, Department of Pharmacotherapy and Translational Research, 1225 Center Drive, Gainesville, FL 32610-0486, United States. Electronic address: mfarland@cop.ufl.edu. 2. University of Florida College of Education, School of Human Development and Organizational Studies in Education, Gainesville, FL, United States. Electronic address: fengxy@ufl.edu. 3. University of Tennessee Health Science Center College of Pharmacy, Department of Clinical Pharmacy, 1920 Alcoa Highway, Box 117, Knoxville, TN 37920, United States. Electronic address: afranks@uthsc.edu. 4. Nova Southeastern University College of Pharmacy, Department of Pharmacy Practice, 3200 S. University Dr, Office 1374, Davie, FL 33328, United States. Electronic address: ksando@nova.edu. 5. University of Florida Colleges of Dentistry, Education, Veterinary Medicine, & Pharmacy, 1395 Center Drive, Gainesville, FL 32610-0415, United States. Electronic address: lsbhoren@ufl.edu.
Abstract
INTRODUCTION: The purpose of this study was to assess: (1) student performance on topics taught by first and second year postgraduate pharmacy residents and (2) the quality of learning objectives and multiple choice questions prepared by pharmacy residents. METHODS: Using a retrospective cohort design, residents and students who taught or were enrolled, respectively, in the Medication Therapy Management course in years 2010 to 2012 were participants in this study. Student performance was assessed using scores earned on the individual readiness assurance tests (iRATs), team readiness assurance tests (tRATs), and course examinations. To assess the quality of the learning objectives and multiple choice questions written by pharmacy residents, criteria were established by the authors. Each learning objective and multiple choice question was then evaluated independently by two authors to determine if these criteria were met. RESULTS: Statistical differences were observed in student performance across all content areas among the three years for iRAT, tRAT, and course examination scores, with the exception of the heart failure course examination (p = 0.05; all other p-values < 0.05). A total of 20 (42%) learning objectives met all quality review criteria, while 73 (79%) of the multiple-choice questions met all quality review criteria. DISCUSSION AND CONCLUSIONS: Student performance varied significantly depending on the content, but the overall impact of resident instructors on student course performance was not educationally significant. Teaching and learning curriculum programs should focus on teaching residents to create quality learning objectives that help students focus on learning the most important course content.
INTRODUCTION: The purpose of this study was to assess: (1) student performance on topics taught by first and second year postgraduate pharmacy residents and (2) the quality of learning objectives and multiple choice questions prepared by pharmacy residents. METHODS: Using a retrospective cohort design, residents and students who taught or were enrolled, respectively, in the Medication Therapy Management course in years 2010 to 2012 were participants in this study. Student performance was assessed using scores earned on the individual readiness assurance tests (iRATs), team readiness assurance tests (tRATs), and course examinations. To assess the quality of the learning objectives and multiple choice questions written by pharmacy residents, criteria were established by the authors. Each learning objective and multiple choice question was then evaluated independently by two authors to determine if these criteria were met. RESULTS: Statistical differences were observed in student performance across all content areas among the three years for iRAT, tRAT, and course examination scores, with the exception of the heart failure course examination (p = 0.05; all other p-values < 0.05). A total of 20 (42%) learning objectives met all quality review criteria, while 73 (79%) of the multiple-choice questions met all quality review criteria. DISCUSSION AND CONCLUSIONS: Student performance varied significantly depending on the content, but the overall impact of resident instructors on student course performance was not educationally significant. Teaching and learning curriculum programs should focus on teaching residents to create quality learning objectives that help students focus on learning the most important course content.