Patrick F Sullivan1. 1. Department of Genetics, University of North Carolina, Chapel Hill, North Carolina 27599-7264, USA. pfsulliv@med.unc.edu
Abstract
BACKGROUND: Genetic association studies are widely used in biomedical research and yet only a minority of positive findings stand the test of replication. I explored the capacity of association studies to produce false positive findings and the impact of various definitions of replication. METHODS: Genetically realistic simulation data of a typical genotyping/analytic approach for 10 single nucleotide polymorphisms (SNPs) in COMT, a commonly studied candidate gene. RESULTS: Candidate gene studies like those simulated here are highly likely to produce one or more false positive findings at alpha < or = .05, the pattern of findings can often be "compelling" or "intriguing," and false positive findings propagate and confuse the literature unless the definition of replication is precise. CONCLUSIONS: Findings from single association studies constitute "tentative knowledge" and must be interpreted with exceptional caution. For the association method to function as intended, every statistical comparison must be tracked and reported, and integrated replication is essential. Precise replication (the same SNPs, phenotype, and direction of association) is required in the interpretation of multiple association studies.
BACKGROUND: Genetic association studies are widely used in biomedical research and yet only a minority of positive findings stand the test of replication. I explored the capacity of association studies to produce false positive findings and the impact of various definitions of replication. METHODS: Genetically realistic simulation data of a typical genotyping/analytic approach for 10 single nucleotide polymorphisms (SNPs) in COMT, a commonly studied candidate gene. RESULTS: Candidate gene studies like those simulated here are highly likely to produce one or more false positive findings at alpha < or = .05, the pattern of findings can often be "compelling" or "intriguing," and false positive findings propagate and confuse the literature unless the definition of replication is precise. CONCLUSIONS: Findings from single association studies constitute "tentative knowledge" and must be interpreted with exceptional caution. For the association method to function as intended, every statistical comparison must be tracked and reported, and integrated replication is essential. Precise replication (the same SNPs, phenotype, and direction of association) is required in the interpretation of multiple association studies.
Authors: Aristotle N Voineskos; Daniel Felsky; Natasa Kovacevic; Arun K Tiwari; Clement Zai; M Mallar Chakravarty; Nancy J Lobaugh; Martha E Shenton; Tarek K Rajji; Dielle Miranda; Bruce G Pollock; Benoit H Mulsant; Anthony R McIntosh; James L Kennedy Journal: Cereb Cortex Date: 2012-07-06 Impact factor: 5.357
Authors: Ina Giegling; Antonio Drago; Martin Schäfer; Annette M Hartmann; Thomas Sander; Mohammad Reza Toliat; Hans-Jürgen Möller; Diana De Ronchi; Hans H Stassen; Dan Rujescu; Alessandro Serretti Journal: Psychopharmacology (Berl) Date: 2010-11-16 Impact factor: 4.530
Authors: Gursharan Kalsi; Po-Hsiu Kuo; Fazil Aliev; Jeffry Alexander; Omari McMichael; Diana G Patterson; Dermot Walsh; Zhongming Zhao; Marc Schuckit; John Nurnberger; Howard Edenberg; John Kramer; Victor Hesselbrock; Jay A Tischfield; Vladimir Vladimirov; Carol A Prescott; Danielle M Dick; Kenneth S Kendler; Brien P Riley Journal: Hum Mol Genet Date: 2010-03-23 Impact factor: 6.150
Authors: Falk W Lohoff; Andrew E Weller; Paul J Bloch; Aleksandra H Nall; Thomas N Ferraro; Wade H Berrettini Journal: J Neural Transm (Vienna) Date: 2008-07-30 Impact factor: 3.575
Authors: Dawn L Thiselton; Vladimir I Vladimirov; Po-Hsiu Kuo; Joseph McClay; Brandon Wormley; Ayman Fanous; Francis A O'Neill; Dermot Walsh; Edwin J C G Van den Oord; Kenneth S Kendler; Brien P Riley Journal: Biol Psychiatry Date: 2007-09-06 Impact factor: 13.382