Elizabeth L MacQuillan1, Jennifer Ford2, Kristin Baird2. 1. Department of Allied Health Sciences, Grand Valley State University, Grand Rapids, MI. Electronic address: macquile@gvsu.edu. 2. Department of Allied Health Sciences, Grand Valley State University, Grand Rapids, MI.
Abstract
OBJECTIVE: This study details development and testing of a tool designed to evaluate clinical competence by registered dietitian nutritionists (RDNs) on the nutrition-focused physical exam (NFPE). The process demonstrated in this study can be adapted for assessment of other clinical skills in competency-based education programs, such as Accreditation Council on Education in Nutrition and Dietetics' Future Model of Dietetics Education. DESIGN AND SETTING: The tool was tested for content validity, then used to assess the videotaped performance of the NFPE with standardized patients in a simulated clinical environment. PARTICIPANTS: Seven expert raters assessed the relevance of the tool's items for content validity. For other tests, the tool was used by 3 dietetics faculty to score a group of 18 RDNs. VARIABLES AND ANALYSIS: Content validity was tested using the item-level Content Validity Index. Interrater reliability and internal consistency of the tool were calculated and assessed. RESULTS: The interrater reliability results indicated excellent agreement between raters, both overall (kappa statistic = 0.86; 95% confidence interval, 0.86-0.87; P < 0.001) and on individual items. Cronbach α statistic was calculated at α = .91, indicating excellent internal consistency. CONCLUSIONS: The tool represents an instrument that can assess competence in the NFPE among RDNs and may be used as a template for development of other competency-based education assessment tools.
OBJECTIVE: This study details development and testing of a tool designed to evaluate clinical competence by registered dietitian nutritionists (RDNs) on the nutrition-focused physical exam (NFPE). The process demonstrated in this study can be adapted for assessment of other clinical skills in competency-based education programs, such as Accreditation Council on Education in Nutrition and Dietetics' Future Model of Dietetics Education. DESIGN AND SETTING: The tool was tested for content validity, then used to assess the videotaped performance of the NFPE with standardized patients in a simulated clinical environment. PARTICIPANTS: Seven expert raters assessed the relevance of the tool's items for content validity. For other tests, the tool was used by 3 dietetics faculty to score a group of 18 RDNs. VARIABLES AND ANALYSIS: Content validity was tested using the item-level Content Validity Index. Interrater reliability and internal consistency of the tool were calculated and assessed. RESULTS: The interrater reliability results indicated excellent agreement between raters, both overall (kappa statistic = 0.86; 95% confidence interval, 0.86-0.87; P < 0.001) and on individual items. Cronbach α statistic was calculated at α = .91, indicating excellent internal consistency. CONCLUSIONS: The tool represents an instrument that can assess competence in the NFPE among RDNs and may be used as a template for development of other competency-based education assessment tools.