Fiona McMaster1, Ken Resnicow2. 1. Faculty of Medical Science Anglia Ruskin University, Cambridge, UK. Electronic address: fiona.mcmaster@anglia.ac.uk. 2. Department of Health Behavior & Health Education, School of Public Health, University of Michigan, Ann Arbor, USA.
Abstract
OBJECTIVE: This paper examines the psychometric properties of the OnePass coding system: a new, user-friendly tool for evaluating practitioner competence in motivational interviewing (MI). We provide data on reliability and validity with the current gold-standard: Motivational Interviewing Treatment Integrity tool (MITI). METHODS: We compared scores from 27 videotaped MI sessions performed by student counselors trained in MI and simulated patients using both OnePass and MITI, with three different raters for each tool. Reliability was estimated using intra-class coefficients (ICCs), and validity was assessed using Pearson's r. RESULTS: OnePass had high levels of inter-rater reliability with 19/23 items found from substantial to almost perfect agreement. Taking the pair of scores with the highest inter-rater reliability on the MITI, the concurrent validity between the two measures ranged from moderate to high. Validity was highest for evocation, autonomy, direction and empathy. CONCLUSION: OnePass appears to have good inter-rater reliability while capturing similar dimensions of MI as the MITI. Despite the moderate concurrent validity with the MITI, the OnePass shows promise in evaluating both traditional and novel interpretations of MI. PRACTICE IMPLICATIONS: OnePass may be a useful tool for developing and improving practitioner competence in MI where access to MITI coders is limited.
OBJECTIVE: This paper examines the psychometric properties of the OnePass coding system: a new, user-friendly tool for evaluating practitioner competence in motivational interviewing (MI). We provide data on reliability and validity with the current gold-standard: Motivational Interviewing Treatment Integrity tool (MITI). METHODS: We compared scores from 27 videotaped MI sessions performed by student counselors trained in MI and simulated patients using both OnePass and MITI, with three different raters for each tool. Reliability was estimated using intra-class coefficients (ICCs), and validity was assessed using Pearson's r. RESULTS: OnePass had high levels of inter-rater reliability with 19/23 items found from substantial to almost perfect agreement. Taking the pair of scores with the highest inter-rater reliability on the MITI, the concurrent validity between the two measures ranged from moderate to high. Validity was highest for evocation, autonomy, direction and empathy. CONCLUSION: OnePass appears to have good inter-rater reliability while capturing similar dimensions of MI as the MITI. Despite the moderate concurrent validity with the MITI, the OnePass shows promise in evaluating both traditional and novel interpretations of MI. PRACTICE IMPLICATIONS: OnePass may be a useful tool for developing and improving practitioner competence in MI where access to MITI coders is limited.
Authors: Ken Resnicow; Donna Harris; Richard Wasserman; Robert P Schwartz; Veronica Perez-Rosas; Rada Mihalcea; Linda Snetselaar Journal: Pediatr Clin North Am Date: 2016-06 Impact factor: 3.278
Authors: Paula A Newman-Casey; David C Musch; Leslie M Niziol; Angela R Elam; Jason Zhang; Sayoko E Moroi; Leroy Johnson; Martha Kershaw; Jinan Saadine; Suzanne Winter; Maria A Woodward Journal: J Glaucoma Date: 2021-05-01 Impact factor: 2.290
Authors: Mellanie V Springer; Kathleen M Conley; Brisa N Sanchez; Ken Resnicow; Joan E Cowdery; Lesli E Skolarus; Lewis B Morgenstern; Devin L Brown Journal: J Relig Health Date: 2021-03-09
Authors: Delwyn Catley; Thandi Puoane; Kathy Goggin; Lungiswa P Tsolekile; Ken Resnicow; Kandace Fleming; Joshua M Smyth; Emily A Hurley; Sarah Schlachter; Mara Z Vitolins; Estelle V Lambert; Mariam Hassen; Kenneth Muhali; Rachel Schoor Journal: Transl Behav Med Date: 2020-02-03 Impact factor: 3.046
Authors: Paula Anne Newman-Casey; Leslie M Niziol; Paul P Lee; David C Musch; Kenneth Resnicow; Michele Heisler Journal: Ophthalmol Glaucoma Date: 2020-04-30