John W Finney1. 1. Center for Health Care Evaluation, VA Palo Alto Health Care System and Stanford University Medical Center, Palo Alto, CA 94025, USA. john.finney@va.gov
Abstract
AIMS: Regression to the mean (RTM) refers to the tendency for a group of cases that differ from the population mean to move (regress) towards the mean, on average, when re-assessed, if scores at the two points are less than perfectly correlated. This paper considers factors that affect the magnitude of RTM and how RTM may impact findings from primary studies and reviews of substance use disorder (SUD) treatment. DESIGN AND METHODS: The paper is guided largely by A Primer on Regression Artifacts by Campbell and Kenny. It reviews potential RTM effects in three areas of SUD treatment research. One is the extent to which within-group improvement in comparative treatment trials, including 'placebo effects', is a function of RTM. The second is the vulnerability of treatment evaluations employing non-equivalent control group designs to RTM and biased estimates of treatment effects when matching, or statistical equating is used to adjust for pre-existing group differences. The final issue is the impact of RTM in syntheses of research findings on SUD treatments. In particular, the tendency for later studies of a particular intervention to have smaller treatment effect sizes relative to earlier studies is considered as an RTM phenomenon. FINDINGS: RTM is a pervasive, but often unrecognized phenomenon that can bias findings in SUD treatment studies and in systematic reviews of that research. CONCLUSION: SUD treatment researchers should be aware of RTM, take any available steps to reduce it, and try to diagnose whether it is still affecting research findings.
AIMS: Regression to the mean (RTM) refers to the tendency for a group of cases that differ from the population mean to move (regress) towards the mean, on average, when re-assessed, if scores at the two points are less than perfectly correlated. This paper considers factors that affect the magnitude of RTM and how RTM may impact findings from primary studies and reviews of substance use disorder (SUD) treatment. DESIGN AND METHODS: The paper is guided largely by A Primer on Regression Artifacts by Campbell and Kenny. It reviews potential RTM effects in three areas of SUD treatment research. One is the extent to which within-group improvement in comparative treatment trials, including 'placebo effects', is a function of RTM. The second is the vulnerability of treatment evaluations employing non-equivalent control group designs to RTM and biased estimates of treatment effects when matching, or statistical equating is used to adjust for pre-existing group differences. The final issue is the impact of RTM in syntheses of research findings on SUD treatments. In particular, the tendency for later studies of a particular intervention to have smaller treatment effect sizes relative to earlier studies is considered as an RTM phenomenon. FINDINGS: RTM is a pervasive, but often unrecognized phenomenon that can bias findings in SUD treatment studies and in systematic reviews of that research. CONCLUSION: SUD treatment researchers should be aware of RTM, take any available steps to reduce it, and try to diagnose whether it is still affecting research findings.
Authors: Brenda M Booth; Geoffrey Curran; Xiaotong Han; Patricia Wright; Sarah Frith; Carl Leukefeld; Russel Falck; Robert G Carlson Journal: J Stud Alcohol Drugs Date: 2010-03 Impact factor: 2.582
Authors: Grace Chang; Naomi D L Fisher; Mark D Hornstein; Jennifer A Jones; Sarah H Hauke; Nina Niamkey; Christina Briegleb; Endel John Orav Journal: J Subst Abuse Treat Date: 2011-04-12
Authors: Anne C Fernandez; Rebecca Waller; Maureen A Walton; Erin E Bonar; Rosalinda V Ignacio; Stephen T Chermack; Rebecca M Cunningham; Brenda M Booth; Mark A Ilgen; Kristen L Barry; Frederic C Blow Journal: Drug Alcohol Depend Date: 2018-11-14 Impact factor: 4.492
Authors: Katie Witkiewitz; John W Finney; Alex H S Harris; Daniel R Kivlahan; Henry R Kranzler Journal: Alcohol Clin Exp Res Date: 2015-08-11 Impact factor: 3.455