James J McGough1, Stephen V Faraone. 1. Dr. McGough is Professor of Clinical Psychiatry at the Semel Institute for Neuroscience and Human Behavior and David Geffen School of Medicine at the University of California, Los Angeles.
Abstract
OBJECTIVE: To increase understanding of effect size calculations among clinicians who over-rely on interpretations of P values in their assessment of the medical literature. DESIGN: We review five methods of calculating effect sizes: Cohen's d (also known as the standardized mean difference)-used in studies that report efficacy in terms of a continuous measurement and calculated from two mean values and their standard deviations; relative risk-the ratio of patients responding to treatment divided by the ratio of patients responding to a different treatment (or placebo), which is particularly useful in prospective clinical trials to assess differences between treatments; odds ratio- used to interpret results of retrospective case-control studies and provide estimates of the risk of side effects by comparing the probability (odds) of an outcome occurring in the presence or absence of a specified condition; number needed to treat-the number of subjects one would expect to treat with agent A to have one more success (or one less failure) than if the same number were treated with agent B; and area under the curve (also known as the drug-placebo response curve)-a six-step process that can be used to assess the effects of medication on both worsening and improvement and the probability that a medication-treated subject will have a better outcome than a placebo-treated subject. CONCLUSION: Effect size statistics provide a better estimate of treatment effects than P values alone.
OBJECTIVE: To increase understanding of effect size calculations among clinicians who over-rely on interpretations of P values in their assessment of the medical literature. DESIGN: We review five methods of calculating effect sizes: Cohen's d (also known as the standardized mean difference)-used in studies that report efficacy in terms of a continuous measurement and calculated from two mean values and their standard deviations; relative risk-the ratio of patients responding to treatment divided by the ratio of patients responding to a different treatment (or placebo), which is particularly useful in prospective clinical trials to assess differences between treatments; odds ratio- used to interpret results of retrospective case-control studies and provide estimates of the risk of side effects by comparing the probability (odds) of an outcome occurring in the presence or absence of a specified condition; number needed to treat-the number of subjects one would expect to treat with agent A to have one more success (or one less failure) than if the same number were treated with agent B; and area under the curve (also known as the drug-placebo response curve)-a six-step process that can be used to assess the effects of medication on both worsening and improvement and the probability that a medication-treated subject will have a better outcome than a placebo-treated subject. CONCLUSION: Effect size statistics provide a better estimate of treatment effects than P values alone.
Authors: S Kuperman; P J Perry; G R Gaffney; B C Lund; K A Bever-Stille; S Arndt; T L Holman; D J Moser; J S Paulsen Journal: Ann Clin Psychiatry Date: 2001-09 Impact factor: 1.567
Authors: Timothy E Wilens; Barbara R Haight; Joseph P Horrigan; James J Hudziak; Norman E Rosenthal; Daniel F Connor; Kenneth D Hampton; Nathalie E Richard; Jack G Modell Journal: Biol Psychiatry Date: 2005-04-01 Impact factor: 13.382
Authors: Graham Emslie; Christopher Kratochvil; Benedetto Vitiello; Susan Silva; Taryn Mayes; Steven McNulty; Elizabeth Weller; Bruce Waslick; Charles Casat; John Walkup; Sanjeev Pathak; Paul Rohde; Kelly Posner; John March Journal: J Am Acad Child Adolesc Psychiatry Date: 2006-12 Impact factor: 8.829
Authors: M L Wolraich; L L Greenhill; W Pelham; J Swanson; T Wilens; D Palumbo; M Atkins; K McBurnett; O Bukstein; G August Journal: Pediatrics Date: 2001-10 Impact factor: 7.124
Authors: James J McGough; Sharon B Wigal; Howard Abikoff; John M Turnbow; Kelly Posner; Eliot Moon Journal: J Atten Disord Date: 2006-02 Impact factor: 3.256
Authors: David Michelson; Lenard Adler; Thomas Spencer; Frederick W Reimherr; Scott A West; Albert J Allen; Douglas Kelsey; Joachim Wernicke; Anthony Dietrich; Denái Milton Journal: Biol Psychiatry Date: 2003-01-15 Impact factor: 13.382
Authors: Paula D Riggs; Shannon K Hall; Susan K Mikulich-Gilbertson; Michelle Lohman; Ashley Kayser Journal: J Am Acad Child Adolesc Psychiatry Date: 2004-04 Impact factor: 8.829
Authors: Joseph F McGuire; John Piacentini; Adam B Lewin; Erin A Brennan; Tanya K Murphy; Eric A Storch Journal: Depress Anxiety Date: 2015-06-30 Impact factor: 6.505
Authors: N Singh Ospina; S Maraka; R Rodriguez-Gutierrez; A E Espinosa de Ycaza; S Jasim; M Gionfriddo; A Castaneda-Guarderas; J P Brito; A Al Nofal; P Erwin; R Wermers; V Montori Journal: Osteoporos Int Date: 2016-08-25 Impact factor: 4.507