L Bero1, A Anglemyer2, H Vesterinen3, D Krauth4. 1. Charles Perkins Centre and Faculty of Pharmacy, University of Sydney, Australia. Electronic address: lisa.bero@sydney.edu.au. 2. Department of Collaborative Health and Human Services, California State University, Monterey Bay, USA. 3. University of California San Francisco, Program on Reproductive Health and the Environment, Oakland, USA. 4. Department of Clinical Pharmacy, University of California San Francisco, USA.
Abstract
BACKGROUND: A critical component of systematic review methodology is the assessment of the risks of bias of studies that are included in the review. There is controversy about whether funding source should be included in a risk of bias assessment of animal toxicology studies. OBJECTIVE: To determine whether industry research sponsorship is associated with methodological biases, the results, or conclusions of animal studies examining the effect of exposure to atrazine on reproductive or developmental outcomes. METHODS: We searched multiple electronic databases and the reference lists of relevant articles to identify original research studies examining the effect of any dose of atrazine exposure at any life stage on reproduction or development in non-human animals. We compared methodological risks of bias, the conclusions of the studies, the statistical significance of the findings, and the magnitude of effect estimates between industry sponsored and non-industry sponsored studies. RESULTS: Fifty-one studies met the inclusion criteria. There were no differences in methodological risks of bias in industry versus non-industry sponsored studies. 39 studies tested environmentally relevant concentrations of atrazine (11 industry sponsored, 24 non-industry sponsored, 4 with no funding disclosures). Non-industry sponsored studies (12/24, 50.0%) were more likely to conclude that atrazine was harmful compared to industry sponsored studies (2/11, 18.1%) (p value=0.07). A higher proportion of non-industry sponsored studies reported statistically significant harmful effects (8/24, 33.3%) compared to industry-sponsored studies (1/11; 9.1%) (p value=0.13). The association of industry sponsorship with decreased effect sizes for harm outcomes was inconclusive. CONCLUSION: Our findings support the inclusion of research sponsorship as a risk of bias criterion in tools used to assess risks of bias in animal studies for systematic reviews. The reporting of other empirically based risk of bias criteria for animal studies, such as blinded outcome assessment, randomization, and all animals included in analyses, needs to improve to facilitate the assessment of studies for systematic reviews.
BACKGROUND: A critical component of systematic review methodology is the assessment of the risks of bias of studies that are included in the review. There is controversy about whether funding source should be included in a risk of bias assessment of animal toxicology studies. OBJECTIVE: To determine whether industry research sponsorship is associated with methodological biases, the results, or conclusions of animal studies examining the effect of exposure to atrazine on reproductive or developmental outcomes. METHODS: We searched multiple electronic databases and the reference lists of relevant articles to identify original research studies examining the effect of any dose of atrazine exposure at any life stage on reproduction or development in non-human animals. We compared methodological risks of bias, the conclusions of the studies, the statistical significance of the findings, and the magnitude of effect estimates between industry sponsored and non-industry sponsored studies. RESULTS: Fifty-one studies met the inclusion criteria. There were no differences in methodological risks of bias in industry versus non-industry sponsored studies. 39 studies tested environmentally relevant concentrations of atrazine (11 industry sponsored, 24 non-industry sponsored, 4 with no funding disclosures). Non-industry sponsored studies (12/24, 50.0%) were more likely to conclude that atrazine was harmful compared to industry sponsored studies (2/11, 18.1%) (p value=0.07). A higher proportion of non-industry sponsored studies reported statistically significant harmful effects (8/24, 33.3%) compared to industry-sponsored studies (1/11; 9.1%) (p value=0.13). The association of industry sponsorship with decreased effect sizes for harm outcomes was inconclusive. CONCLUSION: Our findings support the inclusion of research sponsorship as a risk of bias criterion in tools used to assess risks of bias in animal studies for systematic reviews. The reporting of other empirically based risk of bias criteria for animal studies, such as blinded outcome assessment, randomization, and all animals included in analyses, needs to improve to facilitate the assessment of studies for systematic reviews.
Authors: Jeffrey M Drazen; Peter W De Leeuw; Christine Laine; Cynthia Mulrow; Catherine D Deangelis; Frank A Frizelle; Fiona Godlee; Charlotte Haug; Paul C Hébert; Astrid James; Sheldon Kotzin; Ana Marusic; Humberto Reyes; Jacob Rosenberg; Peush Sahni; Martin B Van Der Weyden; Getu Zhaori Journal: Natl Med J India Date: 2010 Jul-Aug Impact factor: 0.537
Authors: Antonio Nieto; Angel Mazon; Rafael Pamies; Juan J Linana; Amparo Lanuza; Fernando Oliver Jiménez; Alejandra Medina-Hernandez; F Javier Nieto Journal: Arch Intern Med Date: 2007-10-22
Authors: H Bart van der Worp; David W Howells; Emily S Sena; Michelle J Porritt; Sarah Rewell; Victoria O'Collins; Malcolm R Macleod Journal: PLoS Med Date: 2010-03-30 Impact factor: 11.069
Authors: Malcolm R Macleod; Susan Michie; Ian Roberts; Ulrich Dirnagl; Iain Chalmers; John P A Ioannidis; Rustam Al-Shahi Salman; An-Wen Chan; Paul Glasziou Journal: Lancet Date: 2014-01-08 Impact factor: 79.321
Authors: Andrew A Rooney; Abee L Boyles; Mary S Wolfe; John R Bucher; Kristina A Thayer Journal: Environ Health Perspect Date: 2014-04-22 Impact factor: 9.031
Authors: Christopher A Mebane; John P Sumpter; Anne Fairbrother; Thomas P Augspurger; Timothy J Canfield; William L Goodfellow; Patrick D Guiney; Anne LeHuray; Lorraine Maltby; David B Mayfield; Michael J McLaughlin; Lisa S Ortego; Tamar Schlekat; Richard P Scroggins; Tim A Verslycke Journal: Integr Environ Assess Manag Date: 2019-02-28 Impact factor: 2.992
Authors: Manuela Valenzuela; Margarita Giraldo; Sonia Gallo-Murcia; Juliana Pineda; Laura Santos; Juan Pablo Ramos-Bonilla Journal: Curr Environ Health Rep Date: 2016-12
Authors: Lariah Edwards; Nathan L McCray; Brianna N VanNoy; Alice Yau; Ruth J Geller; Gary Adamkiewicz; Ami R Zota Journal: J Expo Sci Environ Epidemiol Date: 2021-10-27 Impact factor: 6.371
Authors: Sebastian Hoffmann; Rob B M de Vries; Martin L Stephens; Nancy B Beck; Hubert A A M Dirven; John R Fowle; Julie E Goodman; Thomas Hartung; Ian Kimber; Manoj M Lalu; Kristina Thayer; Paul Whaley; Daniele Wikoff; Katya Tsaioun Journal: Arch Toxicol Date: 2017-05-13 Impact factor: 5.153