Laramie E Duncan1, Matthew C Keller. 1. Harvard School of Public Health, Massachusetts General Hospital, McLean Hospital, Harvard Medical School, Belmont, USA. laramied@gmail.com
Abstract
OBJECTIVE: Gene-by-environment interaction (G×E) studies in psychiatry have typically been conducted using a candidate G×E (cG×E) approach, analogous to the candidate gene association approach used to test genetic main effects. Such cG×E research has received widespread attention and acclaim, yet cG×E findings remain controversial. The authors examined whether the many positive cG×E findings reported in the psychiatric literature were robust or if, in aggregate, cG×E findings were consistent with the existence of publication bias, low statistical power, and a high false discovery rate. METHOD: The authors conducted analyses on data extracted from all published studies (103 studies) from the first decade (2000-2009) of cG×E research in psychiatry. RESULTS: Ninety-six percent of novel cG×E studies were significant compared with 27% of replication attempts. These findings are consistent with the existence of publication bias among novel cG×E studies, making cG×E hypotheses appear more robust than they actually are. There also appears to be publication bias among replication attempts because positive replication attempts had smaller average sample sizes than negative ones. Power calculations using observed sample sizes suggest that cG×E studies are underpowered. Low power along with the likely low prior probability of a given cG×E hypothesis being true suggests that most or even all positive cG×E findings represent type I errors. CONCLUSIONS: In this new era of big data and small effects, a recalibration of views about groundbreaking findings is necessary. Well-powered direct replications deserve more attention than novel cG×E findings and indirect replications.
OBJECTIVE: Gene-by-environment interaction (G×E) studies in psychiatry have typically been conducted using a candidate G×E (cG×E) approach, analogous to the candidate gene association approach used to test genetic main effects. Such cG×E research has received widespread attention and acclaim, yet cG×E findings remain controversial. The authors examined whether the many positive cG×E findings reported in the psychiatric literature were robust or if, in aggregate, cG×E findings were consistent with the existence of publication bias, low statistical power, and a high false discovery rate. METHOD: The authors conducted analyses on data extracted from all published studies (103 studies) from the first decade (2000-2009) of cG×E research in psychiatry. RESULTS: Ninety-six percent of novel cG×E studies were significant compared with 27% of replication attempts. These findings are consistent with the existence of publication bias among novel cG×E studies, making cG×E hypotheses appear more robust than they actually are. There also appears to be publication bias among replication attempts because positive replication attempts had smaller average sample sizes than negative ones. Power calculations using observed sample sizes suggest that cG×E studies are underpowered. Low power along with the likely low prior probability of a given cG×E hypothesis being true suggests that most or even all positive cG×E findings represent type I errors. CONCLUSIONS: In this new era of big data and small effects, a recalibration of views about groundbreaking findings is necessary. Well-powered direct replications deserve more attention than novel cG×E findings and indirect replications.
Authors: Lucia A Hindorff; Praveen Sethupathy; Heather A Junkins; Erin M Ramos; Jayashri P Mehta; Francis S Collins; Teri A Manolio Journal: Proc Natl Acad Sci U S A Date: 2009-05-27 Impact factor: 11.205
Authors: Beverly H Brummett; Stephen H Boyle; Ilene C Siegler; Cynthia M Kuhn; Allison Ashley-Koch; Charles R Jonassaint; Stephan Züchner; Ann Collins; Redford B Williams Journal: Behav Genet Date: 2007-10-23 Impact factor: 2.805
Authors: Sven Cichon; Nick Craddock; Mark Daly; Stephen V Faraone; Pablo V Gejman; John Kelsoe; Thomas Lehner; Douglas F Levinson; Audra Moran; Pamela Sklar; Patrick F Sullivan Journal: Am J Psychiatry Date: 2009-04-01 Impact factor: 18.112
Authors: Stal Saurav Shrestha; Daniel S Pine; David A Luckenbaugh; Katarina Varnäs; Ioline D Henter; Robert B Innis; Aleksander A Mathé; Per Svenningsson Journal: Neurosci Lett Date: 2013-11-25 Impact factor: 3.046
Authors: Sinan Guloksuz; Lotta-Katrin Pries; Philippe Delespaul; Gunter Kenis; Jurjen J Luykx; Bochao D Lin; Alexander L Richards; Berna Akdede; Tolga Binbay; Vesile Altınyazar; Berna Yalınçetin; Güvem Gümüş-Akay; Burçin Cihan; Haldun Soygür; Halis Ulaş; EylemŞahin Cankurtaran; Semra Ulusoy Kaymak; Marina M Mihaljevic; Sanja Andric Petrovic; Tijana Mirjanic; Miguel Bernardo; Bibiana Cabrera; Julio Bobes; Pilar A Saiz; María Paz García-Portilla; Julio Sanjuan; Eduardo J Aguilar; José Luis Santos; Estela Jiménez-López; Manuel Arrojo; Angel Carracedo; Gonzalo López; Javier González-Peñas; Mara Parellada; Nadja P Maric; Cem Atbaşog Lu; Alp Ucok; Köksal Alptekin; Meram Can Saka; Celso Arango; Michael O'Donovan; Bart P F Rutten; Jim van Os Journal: World Psychiatry Date: 2019-06 Impact factor: 49.548
Authors: Lot M Geels; Maria M Groen-Blokhuis; Catharina E M van Beijsterveldt; Jacqueline M Vink; Christel M Middeldorp; Meike Bartels; Kelly A Nelson; Patricia E Huizenga; Gareth E Davies; Dorret I Boomsma Journal: Am J Med Genet B Neuropsychiatr Genet Date: 2012-10-22 Impact factor: 3.568