Lauren A Sugden1, Michael R Tackett, Yiannis A Savva, William A Thompson, Charles E Lawrence. 1. Center for Computational Molecular Biology and the Division of Applied Mathematics, Brown University, Providence, RI 02912, USA, St. Laurent Institute, 317 New Boston St, Woburn, MA 01801, USA and Department of Molecular Biology, Cell Biology and Biochemistry, Brown University, Providence, RI 02912, USA.
Abstract
MOTIVATION: Validation and reproducibility of results is a central and pressing issue in genomics. Several recent embarrassing incidents involving the irreproducibility of high-profile studies have illustrated the importance of this issue and the need for rigorous methods for the assessment of reproducibility. RESULTS: Here, we describe an existing statistical model that is very well suited to this problem. We explain its utility for assessing the reproducibility of validation experiments, and apply it to a genome-scale study of adenosine deaminase acting on RNA (ADAR)-mediated RNA editing in Drosophila. We also introduce a statistical method for planning validation experiments that will obtain the tightest reproducibility confidence limits, which, for a fixed total number of experiments, returns the optimal number of replicates for the study. AVAILABILITY: Downloadable software and a web service for both the analysis of data from a reproducibility study and for the optimal design of these studies is provided at http://ccmbweb.ccv.brown.edu/reproducibility.html .
MOTIVATION: Validation and reproducibility of results is a central and pressing issue in genomics. Several recent embarrassing incidents involving the irreproducibility of high-profile studies have illustrated the importance of this issue and the need for rigorous methods for the assessment of reproducibility. RESULTS: Here, we describe an existing statistical model that is very well suited to this problem. We explain its utility for assessing the reproducibility of validation experiments, and apply it to a genome-scale study of adenosine deaminase acting on RNA (ADAR)-mediated RNA editing in Drosophila. We also introduce a statistical method for planning validation experiments that will obtain the tightest reproducibility confidence limits, which, for a fixed total number of experiments, returns the optimal number of replicates for the study. AVAILABILITY: Downloadable software and a web service for both the analysis of data from a reproducibility study and for the optimal design of these studies is provided at http://ccmbweb.ccv.brown.edu/reproducibility.html .
Authors: Lisa M McShane; Michael D Radmacher; Boris Freidlin; Ren Yu; Ming-Chung Li; Richard Simon Journal: Bioinformatics Date: 2002-11 Impact factor: 6.937
Authors: Georges St Laurent; Michael R Tackett; Sergey Nechkin; Dmitry Shtokalo; Denis Antonets; Yiannis A Savva; Rachel Maloney; Philipp Kapranov; Charles E Lawrence; Robert A Reenan Journal: Nat Struct Mol Biol Date: 2013-09-29 Impact factor: 15.369