Brian C Haynes1, Michael R Brent. 1. Center for Genome Sciences and Department of Computer Science, Washington University, St Louis, MO, USA.
Abstract
MOTIVATION: Over the past decade, the prospect of inferring networks of gene regulation from high-throughput experimental data has received a great deal of attention. In contrast to the massive effort that has gone into automated deconvolution of biological networks, relatively little effort has been invested in benchmarking the proposed algorithms. The rate at which new network inference methods are being proposed far outpaces our ability to objectively evaluate and compare them. This is largely due to a lack of fully understood biological networks to use as gold standards. RESULTS: We have developed the most realistic system to date that generates synthetic regulatory networks for benchmarking reconstruction algorithms. The improved biological realism of our benchmark leads to conclusions about the relative accuracies of reconstruction algorithms that are significantly different from those obtained with A-BIOCHEM, an established in silico benchmark. AVAILABILITY: The synthetic benchmark utility and the specific benchmark networks that were used in our analyses are available at http://mblab.wustl.edu/software/grendel/.
MOTIVATION: Over the past decade, the prospect of inferring networks of gene regulation from high-throughput experimental data has received a great deal of attention. In contrast to the massive effort that has gone into automated deconvolution of biological networks, relatively little effort has been invested in benchmarking the proposed algorithms. The rate at which new network inference methods are being proposed far outpaces our ability to objectively evaluate and compare them. This is largely due to a lack of fully understood biological networks to use as gold standards. RESULTS: We have developed the most realistic system to date that generates synthetic regulatory networks for benchmarking reconstruction algorithms. The improved biological realism of our benchmark leads to conclusions about the relative accuracies of reconstruction algorithms that are significantly different from those obtained with A-BIOCHEM, an established in silico benchmark. AVAILABILITY: The synthetic benchmark utility and the specific benchmark networks that were used in our analyses are available at http://mblab.wustl.edu/software/grendel/.
Authors: Nicole Cloonan; Alistair R R Forrest; Gabriel Kolle; Brooke B A Gardiner; Geoffrey J Faulkner; Mellissa K Brown; Darrin F Taylor; Anita L Steptoe; Shivangi Wani; Graeme Bethel; Alan J Robertson; Andrew C Perkins; Stephen J Bruce; Clarence C Lee; Swati S Ranade; Heather E Peckham; Jonathan M Manning; Kevin J McKernan; Sean M Grimmond Journal: Nat Methods Date: 2008-05-30 Impact factor: 28.547
Authors: F C Holstege; E G Jennings; J J Wyrick; T I Lee; C J Hengartner; M R Green; T R Golub; E S Lander; R A Young Journal: Cell Date: 1998-11-25 Impact factor: 41.582
Authors: Robert J Prill; Daniel Marbach; Julio Saez-Rodriguez; Peter K Sorger; Leonidas G Alexopoulos; Xiaowei Xue; Neil D Clarke; Gregoire Altan-Bonnet; Gustavo Stolovitzky Journal: PLoS One Date: 2010-02-23 Impact factor: 3.240
Authors: Alejandro F Villaverde; David Henriques; Kieran Smallbone; Sophia Bongard; Joachim Schmid; Damjan Cicin-Sain; Anton Crombach; Julio Saez-Rodriguez; Klaus Mauch; Eva Balsa-Canto; Pedro Mendes; Johannes Jaeger; Julio R Banga Journal: BMC Syst Biol Date: 2015-02-20