Pim Cuijpers1, Erick H Turner, Sander L Koole, Annemiek van Dijke, Filip Smit. 1. Department of Clinical Psychology, VU University Amsterdam, The Netherlands; EMGO Institute for Health and Care Research, VU University Medical Center Amsterdam, VU University Amsterdam, The Netherlands; Leuphana University, Lünebrug, Germany.
Abstract
BACKGROUND: Randomized trials can show whether a treatment effect is statistically significant and can describe the size of the effect. There are, however, no validated methods available for establishing the clinical relevance of these outcomes. Recently, it was proposed that a standardized mean difference (SMD) of 0.50 be used as cutoff for clinical relevance in the treatment of depression. METHODS: We explore what the effect size means and why the size of an effect has little bearing on its clinical relevance. We will also examine how the "minimally important difference," as seen from the patient perspective, may be helpful in deciding where the cutoff for clinical relevance should be placed for a given condition. RESULTS: Effect sizes in itself cannot give an indication of the clinical relevance of an intervention because the outcome itself determines the clinical relevance and not only the size of the effects. The "minimal important difference" (MID) could be used as a starting point for pinpointing the cutoff for clinical relevance. A first, rough attempt to implement this approach for depression resulted in a tentative clinical relevance cutoff of SMD = 0.24. Using this cutoff, psychotherapy, pharmacotherapy, and combined treatment have effect sizes above this cutoff. DISCUSSION: Statistical outcomes cannot be equated with clinical relevance. The "MID" may be used for pinpointing the cutoff for clinical relevance, but more work in this area is needed.
BACKGROUND: Randomized trials can show whether a treatment effect is statistically significant and can describe the size of the effect. There are, however, no validated methods available for establishing the clinical relevance of these outcomes. Recently, it was proposed that a standardized mean difference (SMD) of 0.50 be used as cutoff for clinical relevance in the treatment of depression. METHODS: We explore what the effect size means and why the size of an effect has little bearing on its clinical relevance. We will also examine how the "minimally important difference," as seen from the patient perspective, may be helpful in deciding where the cutoff for clinical relevance should be placed for a given condition. RESULTS: Effect sizes in itself cannot give an indication of the clinical relevance of an intervention because the outcome itself determines the clinical relevance and not only the size of the effects. The "minimal important difference" (MID) could be used as a starting point for pinpointing the cutoff for clinical relevance. A first, rough attempt to implement this approach for depression resulted in a tentative clinical relevance cutoff of SMD = 0.24. Using this cutoff, psychotherapy, pharmacotherapy, and combined treatment have effect sizes above this cutoff. DISCUSSION: Statistical outcomes cannot be equated with clinical relevance. The "MID" may be used for pinpointing the cutoff for clinical relevance, but more work in this area is needed.
Authors: Mathias Harrer; Sophia H Adam; Harald Baumeister; Pim Cuijpers; Eirini Karyotaki; Randy P Auerbach; Ronald C Kessler; Ronny Bruffaerts; Matthias Berking; David D Ebert Journal: Int J Methods Psychiatr Res Date: 2018-12-26 Impact factor: 4.035
Authors: Johannes Knauer; Yannik Terhorst; Paula Philippi; Selina Kallinger; Sandro Eiler; Reinhold Kilian; Tamara Waldmann; Morten Moshagen; Martina Bader; Harald Baumeister Journal: BMJ Open Date: 2022-06-23 Impact factor: 3.006
Authors: Franziska Holtdirk; Anja Mehnert; Mario Weiss; Johannes Mayer; Björn Meyer; Peter Bröde; Maren Claus; Carsten Watzl Journal: PLoS One Date: 2021-05-07 Impact factor: 3.240
Authors: Harald Baumeister; Natalie Bauereiss; Anna-Carlotta Zarski; Lina Braun; Claudia Buntrock; Christian Hoherz; Abdul Rahman Idrees; Robin Kraft; Pauline Meyer; Tran Bao Dat Nguyen; Rüdiger Pryss; Manfred Reichert; Theresa Sextl; Maria Steinhoff; Lena Stenzel; Lena Steubl; Yannik Terhorst; Ingrid Titzler; David Daniel Ebert Journal: Front Psychiatry Date: 2021-05-14 Impact factor: 4.157
Authors: Maria Kryza-Lacombe; Nana Pearson; Sonja Lyubomirsky; Murray B Stein; Jillian Lee Wiggins; Charles T Taylor Journal: Behav Res Ther Date: 2021-04-15