G R Norman1, Kathleen W Wyrwich, Donald L Patrick. 1. Department of Clinical Epidemiology and Biostatistics, MDCL 3519, McMaster University, Hamilton, ON, L8N 3Z5, Canada. norman@mcmaster.ca
Abstract
BACKGROUND: Little consensus exists regarding the most appropriate measure of responsiveness. While most indices are variants on Cohen's effect size, the mathematical relationships among these indices have not been elucidated. Consequently, the health-related quality of life (HRQL) literature contains many publications in which a variety of different indices are computed and differences among them noted. These differences are completely predictable when the underlying analytical form of each coefficient is explicated. METHODS: In this paper, we begin with a mathematical analysis of the variance components underlying an observed change score. From this, we determine analytically the relationships among the more commonly used indices of responsiveness. CONCLUSIONS: Based on this analysis, we conclude that Cohen's effect size and the Standardized Response Mean are the two most appropriate measures, as each provides unique information and each best captures an important relation between treatment effect and variability in response. However, the latter should be interpreted with caution, as under some circumstances, any measure based on variability in change scores can give misleading information. On this basis, we recommend that future analysis of responsiveness be restricted to the Cohen effect size to ensure interpretability and comparability with treatment effects in other domains.
BACKGROUND: Little consensus exists regarding the most appropriate measure of responsiveness. While most indices are variants on Cohen's effect size, the mathematical relationships among these indices have not been elucidated. Consequently, the health-related quality of life (HRQL) literature contains many publications in which a variety of different indices are computed and differences among them noted. These differences are completely predictable when the underlying analytical form of each coefficient is explicated. METHODS: In this paper, we begin with a mathematical analysis of the variance components underlying an observed change score. From this, we determine analytically the relationships among the more commonly used indices of responsiveness. CONCLUSIONS: Based on this analysis, we conclude that Cohen's effect size and the Standardized Response Mean are the two most appropriate measures, as each provides unique information and each best captures an important relation between treatment effect and variability in response. However, the latter should be interpreted with caution, as under some circumstances, any measure based on variability in change scores can give misleading information. On this basis, we recommend that future analysis of responsiveness be restricted to the Cohen effect size to ensure interpretability and comparability with treatment effects in other domains.
Authors: Ralph J Marino; Rebecca Sinko; Anne Bryden; Deborah Backus; David Chen; Gregory A Nemunaitis; Benjamin E Leiby Journal: Top Spinal Cord Inj Rehabil Date: 2018
Authors: Christopher Morris; Helen Doll; Neville Davies; Andrew Wainwright; Tim Theologis; Keith Willett; Ray Fitzpatrick Journal: Qual Life Res Date: 2009-11-03 Impact factor: 4.147
Authors: A Sartorio; F Agosti; A De Col; G Castelnuovo; G M Manzoni; E Molinari; F M Impellizzeri Journal: J Endocrinol Invest Date: 2014-01-08 Impact factor: 4.256
Authors: M J Harrison; L M Davies; N J Bansback; M J McCoy; S M M Verstappen; K Watson; D P M Symmons Journal: Qual Life Res Date: 2009-09-24 Impact factor: 4.147
Authors: Mirjam A G Sprangers; Jeff A Sloan; Andrea Barsevick; Cynthia Chauhan; Amylou C Dueck; Hein Raat; Quiling Shi; Cornelis J F Van Noorden Journal: Qual Life Res Date: 2010-10-14 Impact factor: 4.147
Authors: Vincent C H Chung; Vivian C W Wong; Chun Hong Lau; Henny Hui; Tat Hing Lam; Lin Xiao Zhong; Samuel Y S Wong; Sian M Griffiths Journal: Health Qual Life Outcomes Date: 2010-09-30 Impact factor: 3.186
Authors: Carol E Adair; Gisele C Marcoux; Theanna F Bischoff; Brian S Cram; Carol J Ewashen; Jorge Pinzon; Joanne L Gusella; Josie Geller; Yvette Scattolon; Patricia Fergusson; Lisa Styles; Krista E Brown Journal: Health Qual Life Outcomes Date: 2010-08-11 Impact factor: 3.186