Ziling Qin1, Susan Armijo-Olivo1, Linda J Woodhouse2, Douglas P Gross3. 1. Faculty of Rehabilitation Medicine, University of Alberta, Edmonton, AB, Canada. 2. Department of Physical Therapy, University of Alberta, Edmonton, AB, Canada Alberta Health Services Bone and Joint Health Strategic Clinical Network, Edmonton, AB, Canada. 3. Department of Physical Therapy, University of Alberta, Edmonton, AB, Canada dgross@ualberta.ca.
Abstract
OBJECTIVE: To evaluate the concurrent validity of a clinical decision support tool (Work Assessment Triage Tool (WATT)) developed to select rehabilitation treatments for injured workers with musculoskeletal conditions. DESIGN: Methodological study with cross-sectional and prospective components. SETTING: Data were obtained from the Workers' Compensation Board of Alberta rehabilitation facility in Edmonton, Canada. SUBJECTS: A total of 432 workers' compensation claimants evaluated between November 2011 and June 2012. MAIN MEASURES: Percentage agreement between the Work Assessment Triage Tool and clinician recommendations was used to determine concurrent validity. In claimants returning to work, frequencies of matching were calculated and compared between clinician and Work Assessment Triage Tool recommendations and the actual programs undertaken by claimants. The frequency of each intervention recommended by clinicians, Work Assessment Triage Tool, and case managers were also calculated and compared. RESULTS: Percentage agreement between clinician and Work Assessment Triage Tool recommendations was poor (19%) to moderate (46%) and Kappa = 0.37 (95% CI -0.02, 0.76). The Work Assessment Triage Tool did not improve upon clinician recommendations as only 14 out of 31 claimants returning to work had programs that contradicted clinician recommendations, but were consistent with Work Assessment Triage Tool recommendations. Clinicians and case managers were inclined to recommend functional restoration, physical therapy, or no rehabilitation while the Work Assessment Triage Tool recommended additional evidence-based interventions, such as workplace-based interventions. CONCLUSIONS: Our findings do not provide evidence of concurrent validity for the Work Assessment Triage Tool compared with clinician recommendations. Based on these results, we cannot recommend further implementation of the Work Assessment Triage Tool. However, the Work Assessment Triage Tool appeared more likely than clinicians to recommend interventions supported by evidence; thus warranting further research.
OBJECTIVE: To evaluate the concurrent validity of a clinical decision support tool (Work Assessment Triage Tool (WATT)) developed to select rehabilitation treatments for injured workers with musculoskeletal conditions. DESIGN: Methodological study with cross-sectional and prospective components. SETTING: Data were obtained from the Workers' Compensation Board of Alberta rehabilitation facility in Edmonton, Canada. SUBJECTS: A total of 432 workers' compensation claimants evaluated between November 2011 and June 2012. MAIN MEASURES: Percentage agreement between the Work Assessment Triage Tool and clinician recommendations was used to determine concurrent validity. In claimants returning to work, frequencies of matching were calculated and compared between clinician and Work Assessment Triage Tool recommendations and the actual programs undertaken by claimants. The frequency of each intervention recommended by clinicians, Work Assessment Triage Tool, and case managers were also calculated and compared. RESULTS: Percentage agreement between clinician and Work Assessment Triage Tool recommendations was poor (19%) to moderate (46%) and Kappa = 0.37 (95% CI -0.02, 0.76). The Work Assessment Triage Tool did not improve upon clinician recommendations as only 14 out of 31 claimants returning to work had programs that contradicted clinician recommendations, but were consistent with Work Assessment Triage Tool recommendations. Clinicians and case managers were inclined to recommend functional restoration, physical therapy, or no rehabilitation while the Work Assessment Triage Tool recommended additional evidence-based interventions, such as workplace-based interventions. CONCLUSIONS: Our findings do not provide evidence of concurrent validity for the Work Assessment Triage Tool compared with clinician recommendations. Based on these results, we cannot recommend further implementation of the Work Assessment Triage Tool. However, the Work Assessment Triage Tool appeared more likely than clinicians to recommend interventions supported by evidence; thus warranting further research.
Authors: Douglas P Gross; Geoffrey S Rachor; Shelby S Yamamoto; Bruce D Dick; Cary Brown; Ambikaipakan Senthilselvan; Sebastian Straube; Charl Els; Tanya Jackson; Suzette Brémault-Phillips; Don Voaklander; Jarett Stastny; Theodore Berry Journal: J Occup Rehabil Date: 2021-03-09
Authors: Marianne W M C Six Dijkstra; Egbert Siebrand; Steven Dorrestijn; Etto L Salomons; Michiel F Reneman; Frits G J Oosterveld; Remko Soer; Douglas P Gross; Hendrik J Bieleman Journal: J Occup Rehabil Date: 2020-09
Authors: Douglas P Gross; Susan Armijo-Olivo; William S Shaw; Kelly Williams-Whitt; Nicola T Shaw; Jan Hartvigsen; Ziling Qin; Christine Ha; Linda J Woodhouse; Ivan A Steenstra Journal: J Occup Rehabil Date: 2016-09