Felix Angst1, André Aeschlimann2, Jules Angst3. 1. Rehabilitation Clinic ("RehaClinic"), Department of Research, Quellenstrasse 34, 5330 Bad Zurzach, Switzerland. Electronic address: fangst@vtxmail.ch. 2. Rehabilitation Clinic ("RehaClinic"), Department of Research, Quellenstrasse 34, 5330 Bad Zurzach, Switzerland. 3. Department of Psychiatry, Psychotherapy and Psychosomatics, Psychiatric Hospital Burghölzli, University of Zurich, Lenggstrasse 31, 8008 Zurich, Switzerland.
Abstract
OBJECTIVE: To illustrate and discuss current and proposed new concepts of effect size (ES) quantification and significance, with a focus on statistical and clinical/subjective interpretation and supported by empirical examples. STUDY DESIGN AND SETTINGS: Different methods for determining minimal clinically important differences (MCIDs) are reviewed, applied to practical examples (pain score differences in knee osteoarthritis), and further developed. Their characteristics, advantages, and disadvantages are illustrated and discussed. RESULTS: Empirical score differences between verum and placebo become statistically significant if sample sizes are sufficiently large. MCIDs, by contrast, are defined by patients' perceptions. MCIDs obtained by the most common "mean change method" can be expressed as absolute or relative scores, as different ES parameters, and as the optimal cutoff point on the receiver operating characteristic curve. They can further be modeled by linear and logistic regression, adjusting for potential confounders. CONCLUSION: Absolute and relative MCIDs are easy to interpret and apply to data of investigative studies. MCIDs expressed as effect sizes reduce bias, which mainly results from dependency on the baseline score. Multivariate linear and logistic regression modeling further reduces bias. Anchor-based methods use clinical/subjective perception to define MCIDs and should be clearly differentiated from distribution-based methods that provide statistical significance only.
OBJECTIVE: To illustrate and discuss current and proposed new concepts of effect size (ES) quantification and significance, with a focus on statistical and clinical/subjective interpretation and supported by empirical examples. STUDY DESIGN AND SETTINGS: Different methods for determining minimal clinically important differences (MCIDs) are reviewed, applied to practical examples (pain score differences in knee osteoarthritis), and further developed. Their characteristics, advantages, and disadvantages are illustrated and discussed. RESULTS: Empirical score differences between verum and placebo become statistically significant if sample sizes are sufficiently large. MCIDs, by contrast, are defined by patients' perceptions. MCIDs obtained by the most common "mean change method" can be expressed as absolute or relative scores, as different ES parameters, and as the optimal cutoff point on the receiver operating characteristic curve. They can further be modeled by linear and logistic regression, adjusting for potential confounders. CONCLUSION: Absolute and relative MCIDs are easy to interpret and apply to data of investigative studies. MCIDs expressed as effect sizes reduce bias, which mainly results from dependency on the baseline score. Multivariate linear and logistic regression modeling further reduces bias. Anchor-based methods use clinical/subjective perception to define MCIDs and should be clearly differentiated from distribution-based methods that provide statistical significance only.
Authors: Robert L Askew; Carmen E Capo-Lugo; Rajbeer Sangha; Andrew Naidech; Shyam Prabhakaran Journal: Value Health Date: 2020-09-01 Impact factor: 5.725
Authors: Nicholas D Clement; Michelle Bardgett; David Weir; James Holland; Craig Gerrand; David J Deehan Journal: Clin Orthop Relat Res Date: 2018-10 Impact factor: 4.176
Authors: Ian A Jones; Ryan Togashi; Melissa L Wilson; Nathanael Heckmann; C Thomas Vangsness Journal: Nat Rev Rheumatol Date: 2019-02 Impact factor: 20.543
Authors: Poghni A Peri-Okonny; Jingyan Wang; Kensey L Gosch; Manesh R Patel; Mehdi H Shishehbor; David L Safley; J Dawn Abbott; Herbert D Aronow; Carlos Mena-Hurtado; Qurat-Ul-Ain Jelani; Yuanyuan Tang; Matthew Bunte; Clementine Labrosciano; John F Beltrame; John A Spertus; Kim G Smolderen Journal: Circ Cardiovasc Qual Outcomes Date: 2021-05-05
Authors: Francisco de Asís-Fernández; Tamara Del Corral; Ibai López-de-Uralde-Villanueva Journal: Diving Hyperb Med Date: 2020-12-20 Impact factor: 0.887