Aileen Murray1, Amanda Hall2, Geoffrey C Williams3, Suzanne M McDonough4, Nikos Ntoumanis5, Ian Taylor6, Ben Jackson7, Bethan Copsey8, Deirdre A Hurley1, James Matthews1. 1. a School of Public Health, Physiotherapy and Sports Science , University College Dublin , Dublin , Ireland. 2. b Faculty of Medicine , Memorial University of Newfoundland , St. John's , Canada. 3. c Department of Medicine , University of Rochester , Rochester , USA. 4. d School of Health Sciences , University of Ulster , Jordanstown , UK. 5. e School of Psychology and Speech Pathology , Curtin University , Perth , Australia. 6. f School of Sport, Exercise and Health Sciences , Loughborough University , Leicestershire , UK. 7. g Exercise, Health and Sport Psychology , University of Western Australia , Crawley , Australia. 8. h Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences , University of Oxford , Oxford , UK.
Abstract
PURPOSE: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. MATERIALS AND METHODS: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. RESULTS: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. CONCLUSION: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings. This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase. The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.
PURPOSE: To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. MATERIALS AND METHODS: Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. RESULTS: The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. CONCLUSION: Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a comprehensive user manual to assess how well health care providers use autonomy-supportive communication strategies in real world-clinical settings. This tool has demonstrated good inter-rater reliability and concurrent validity in its initial testing phase. The Communication Evaluation in Rehabilitation Tool can be used in future studies to assess autonomy-supportive communication and undergo further measurement property testing as per our recommendations.
Authors: Andreia Maria Novo Lima; Maria Manuela Ferreira da Silva Martins; Maria Salomé Martins Ferreira; Carla Sílvia Fernandes; Soraia Dornelles Schoeller; Vítor Sérgio Oliveira Parola Journal: Porto Biomed J Date: 2022-09-09
Authors: O Rodríguez Nogueira; J Botella-Rico; M C Martínez González; M Leal Clavel; J Morera-Balaguer; A R Moreno-Poyato Journal: PLoS One Date: 2020-03-02 Impact factor: 3.240