Arthur N Westover1,2, T Michael Kashner1,3,4, Theresa M Winhusen5, Richard M Golden6, Paul A Nakonezny1,2, Bryon Adinoff1,7, Steven S Henley3,8. 1. a Department of Psychiatry and. 2. b Department of Clinical Sciences , University of Texas Southwestern Medical Center , Dallas , TX . 3. c Department of Medicine , Loma Linda University School of Medicine , Loma Linda , CA . 4. d Veterans Health Administration Office of Academic Affiliations , Washington , DC . 5. e Department of Psychiatry and Behavioral Neuroscience , University of Cincinnati College of Medicine , Cincinnati , OH . 6. f University of Texas at Dallas, School of Behavioral and Brain Sciences , Richardson , TX . 7. g VA North Texas Health Care System , Dallas VAMC , Dallas , TX , and. 8. h Martingale Research Corporation , Plano , TX , USA.
Abstract
BACKGROUND: Traditional approaches to subgroup analyses that test each moderating factor as a separate hypothesis can lead to erroneous conclusions due to the problems of multiple comparisons, model misspecification, and multicollinearity. OBJECTIVE: To demonstrate a novel, systematic approach to subgroup analyses that avoids these pitfalls. METHODS: A Best Approximating Model (BAM) approach that identifies multiple moderators and estimates their simultaneous impact on treatment effect sizes was applied to a randomized, controlled, 11-week, double-blind efficacy trial on smoking cessation of adult smokers with attention-deficit/hyperactivity disorder (ADHD), randomized to either OROS-methylphenidate (n = 127) or placebo (n = 128), and treated with nicotine patch. Binary outcomes measures were prolonged smoking abstinence and point prevalence smoking abstinence. RESULTS: Although the original clinical trial data analysis showed no treatment effect on smoking cessation, the BAM analysis showed significant subgroup effects for the primary outcome of prolonged smoking abstinence: (1) lifetime history of substance use disorders (adjusted odds ratio [AOR] 0.27; 95% confidence interval [CI] 0.10-0.74), and (2) more severe ADHD symptoms (baseline score >36; AOR 2.64; 95% CI 1.17-5.96). A significant subgroup effect was also shown for the secondary outcome of point prevalence smoking abstinence--age 18 to 29 years (AOR 0.23; 95% CI 0.07-0.76). CONCLUSIONS: The BAM analysis resulted in different conclusions about subgroup effects compared to a hypothesis-driven approach. By examining moderator independence and avoiding multiple testing, BAMs have the potential to better identify and explain how treatment effects vary across subgroups in heterogeneous patient populations, thus providing better guidance to more effectively match individual patients with specific treatments.
RCT Entities:
BACKGROUND: Traditional approaches to subgroup analyses that test each moderating factor as a separate hypothesis can lead to erroneous conclusions due to the problems of multiple comparisons, model misspecification, and multicollinearity. OBJECTIVE: To demonstrate a novel, systematic approach to subgroup analyses that avoids these pitfalls. METHODS: A Best Approximating Model (BAM) approach that identifies multiple moderators and estimates their simultaneous impact on treatment effect sizes was applied to a randomized, controlled, 11-week, double-blind efficacy trial on smoking cessation of adult smokers with attention-deficit/hyperactivity disorder (ADHD), randomized to either OROS-methylphenidate (n = 127) or placebo (n = 128), and treated with nicotine patch. Binary outcomes measures were prolonged smoking abstinence and point prevalence smoking abstinence. RESULTS: Although the original clinical trial data analysis showed no treatment effect on smoking cessation, the BAM analysis showed significant subgroup effects for the primary outcome of prolonged smoking abstinence: (1) lifetime history of substance use disorders (adjusted odds ratio [AOR] 0.27; 95% confidence interval [CI] 0.10-0.74), and (2) more severe ADHD symptoms (baseline score >36; AOR 2.64; 95% CI 1.17-5.96). A significant subgroup effect was also shown for the secondary outcome of point prevalence smoking abstinence--age 18 to 29 years (AOR 0.23; 95% CI 0.07-0.76). CONCLUSIONS: The BAM analysis resulted in different conclusions about subgroup effects compared to a hypothesis-driven approach. By examining moderator independence and avoiding multiple testing, BAMs have the potential to better identify and explain how treatment effects vary across subgroups in heterogeneous patient populations, thus providing better guidance to more effectively match individual patients with specific treatments.
Authors: Xin Sun; Matthias Briel; Jason W Busse; John J You; Elie A Akl; Filip Mejza; Malgorzata M Bala; Dirk Bassler; Dominik Mertz; Natalia Diaz-Granados; Per Olav Vandvik; German Malaga; Sadeesh K Srinathan; Philipp Dahm; Bradley C Johnston; Pablo Alonso-Coello; Basil Hassouneh; Stephen D Walter; Diane Heels-Ansdell; Neera Bhatnagar; Douglas G Altman; Gordon H Guyatt Journal: BMJ Date: 2012-03-15
Authors: Jan K Buitelaar; J J Sandra Kooij; J Antoni Ramos-Quiroga; Joachim Dejonckheere; Miguel Casas; Joop C van Oene; Barbara Schäuble; Goetz-Erik Trott Journal: Prog Neuropsychopharmacol Biol Psychiatry Date: 2010-12-23 Impact factor: 5.067
Authors: Bryan R Luce; Judith M Kramer; Steven N Goodman; Jason T Connor; Sean Tunis; Danielle Whicher; J Sanford Schwartz Journal: Ann Intern Med Date: 2009-06-30 Impact factor: 25.391
Authors: E D Levin; C K Conners; E Sparrow; S C Hinton; D Erhardt; W H Meck; J E Rose; J March Journal: Psychopharmacology (Berl) Date: 1996-01 Impact factor: 4.530
Authors: Lirio S Covey; Mei-Chen Hu; Carla A Green; Gregory Brigham; Richard D Hurt; Lenard Adler; Theresa Winhusen Journal: Am J Drug Alcohol Abuse Date: 2011-09 Impact factor: 3.829
Authors: John R Hughes; Josue P Keely; Ray S Niaura; Deborah J Ossip-Klein; Robyn L Richmond; Gary E Swan Journal: Nicotine Tob Res Date: 2003-02 Impact factor: 4.244
Authors: Sean X Luo; Melanie Wall; Lirio Covey; Mei-Chen Hu; Jennifer M Scodes; Frances R Levin; Edward V Nunes; Theresa Winhusen Journal: Am J Drug Alcohol Abuse Date: 2018-01-25 Impact factor: 3.829
Authors: Robert West; A Eden Evins; Neal L Benowitz; Cristina Russ; Thomas McRae; David Lawrence; Lisa St Aubin; Alok Krishen; Melissa C Maravic; Robert M Anthenelli Journal: Addiction Date: 2018-03-30 Impact factor: 6.526