Literature DB >> 33311448

Quantifying and addressing the prevalence and bias of study designs in the environmental and social sciences.

Alec P Christie1, David Abecasis2, Mehdi Adjeroud3, Juan C Alonso4, Tatsuya Amano5, Alvaro Anton6, Barry P Baldigo7, Rafael Barrientos8, Jake E Bicknell9, Deborah A Buhl10, Just Cebrian11, Ricardo S Ceia12,13, Luciana Cibils-Martina14,15, Sarah Clarke16, Joachim Claudet17, Michael D Craig18,19, Dominique Davoult20, Annelies De Backer21, Mary K Donovan22,23, Tyler D Eddy24,25,26, Filipe M França27, Jonathan P A Gardner26, Bradley P Harris28, Ari Huusko29, Ian L Jones30, Brendan P Kelaher31, Janne S Kotiaho32,33, Adrià López-Baucells34,35,36, Heather L Major37, Aki Mäki-Petäys38,39, Beatriz Martín40,41, Carlos A Martín8, Philip A Martin42,43, Daniel Mateos-Molina44, Robert A McConnaughey45, Michele Meroni46, Christoph F J Meyer34,35,47, Kade Mills48, Monica Montefalcone49, Norbertas Noreika50,51, Carlos Palacín4, Anjali Pande26,52,53, C Roland Pitcher54, Carlos Ponce55, Matt Rinella56, Ricardo Rocha34,35,57, María C Ruiz-Delgado58, Juan J Schmitter-Soto59, Jill A Shaffer10, Shailesh Sharma60, Anna A Sher61, Doriane Stagnol20, Thomas R Stanley62, Kevin D E Stokesbury63, Aurora Torres64,65, Oliver Tully16, Teppo Vehanen66, Corinne Watts67, Qingyuan Zhao68, William J Sutherland42,43.   

Abstract

Building trust in science and evidence-based decision-making depends heavily on the credibility of studies and their findings. Researchers employ many different study designs that vary in their risk of bias to evaluate the true effect of interventions or impacts. Here, we empirically quantify, on a large scale, the prevalence of different study designs and the magnitude of bias in their estimates. Randomised designs and controlled observational designs with pre-intervention sampling were used by just 23% of intervention studies in biodiversity conservation, and 36% of intervention studies in social science. We demonstrate, through pairwise within-study comparisons across 49 environmental datasets, that these types of designs usually give less biased estimates than simpler observational designs. We propose a model-based approach to combine study estimates that may suffer from different levels of study design bias, discuss the implications for evidence synthesis, and how to facilitate the use of more credible study designs.

Entities:  

Year:  2020        PMID: 33311448     DOI: 10.1038/s41467-020-20142-y

Source DB:  PubMed          Journal:  Nat Commun        ISSN: 2041-1723            Impact factor:   14.919


  18 in total

1.  A comparison of observational studies and randomized, controlled trials.

Authors:  K Benson; A J Hartz
Journal:  N Engl J Med       Date:  2000-06-22       Impact factor: 91.245

2.  Measuring the prevalence of questionable research practices with incentives for truth telling.

Authors:  Leslie K John; George Loewenstein; Drazen Prelec
Journal:  Psychol Sci       Date:  2012-04-16

3.  Sustainability: Map the evidence.

Authors:  Madeleine C McKinnon; Samantha H Cheng; Ruth Garside; Yuta J Masuda; Daniel C Miller
Journal:  Nature       Date:  2015-12-10       Impact factor: 49.962

4.  Methods for evaluating changes in health care policy: the difference-in-differences approach.

Authors:  Justin B Dimick; Andrew M Ryan
Journal:  JAMA       Date:  2014-12-10       Impact factor: 56.272

5.  Assessing the risk of bias in choice of search sources for environmental meta-analyses.

Authors:  Ko Konno; Andrew S Pullin
Journal:  Res Synth Methods       Date:  2020-08-04       Impact factor: 5.273

6.  Four principles to make evidence synthesis more useful for policy.

Authors:  Christl A Donnelly; Ian Boyd; Philip Campbell; Claire Craig; Patrick Vallance; Mark Walport; Christopher J M Whitty; Emma Woods; Chris Wormald
Journal:  Nature       Date:  2018-06       Impact factor: 49.962

Review 7.  Best evidence synthesis: an intelligent alternative to meta-analysis.

Authors:  R E Slavin
Journal:  J Clin Epidemiol       Date:  1995-01       Impact factor: 6.437

Review 8.  Intervention research in occupational health and safety.

Authors:  L M Goldenhar; P A Schulte
Journal:  J Occup Med       Date:  1994-07

9.  Which academic search systems are suitable for systematic reviews or meta-analyses? Evaluating retrieval qualities of Google Scholar, PubMed, and 26 other resources.

Authors:  Michael Gusenbauer; Neal R Haddaway
Journal:  Res Synth Methods       Date:  2020-01-28       Impact factor: 5.273

10.  Why most published research findings are false.

Authors:  John P A Ioannidis
Journal:  PLoS Med       Date:  2005-08-30       Impact factor: 11.613

View more
  7 in total

1.  Mitigating impacts of invasive alien predators on an endangered sea duck amidst high native predation pressure.

Authors:  Kim Jaatinen; Ida Hermansson; Bertille Mohring; Benjamin B Steele; Markus Öst
Journal:  Oecologia       Date:  2022-01-13       Impact factor: 3.225

Review 2.  Quantifying research waste in ecology.

Authors:  Marija Purgar; Tin Klanjscek; Antica Culina
Journal:  Nat Ecol Evol       Date:  2022-07-21       Impact factor: 19.100

3.  Censcyt: censored covariates in differential abundance analysis in cytometry.

Authors:  Reto Gerber; Mark D Robinson
Journal:  BMC Bioinformatics       Date:  2021-05-10       Impact factor: 3.169

4.  Drought-driven wildfire impacts on structure and dynamics in a wet Central Amazonian forest.

Authors:  Aline Pontes-Lopes; Camila V J Silva; Jos Barlow; Lorena M Rincón; Wesley A Campanharo; Cássio A Nunes; Catherine T de Almeida; Celso H L Silva Júnior; Henrique L G Cassol; Ricardo Dalagnol; Scott C Stark; Paulo M L A Graça; Luiz E O C Aragão
Journal:  Proc Biol Sci       Date:  2021-05-19       Impact factor: 5.349

5.  Tapping into non-English-language science for the conservation of global biodiversity.

Authors:  Tatsuya Amano; Violeta Berdejo-Espinola; Alec P Christie; Kate Willott; Munemitsu Akasaka; András Báldi; Anna Berthinussen; Sandro Bertolino; Andrew J Bladon; Min Chen; Chang-Yong Choi; Magda Bou Dagher Kharrat; Luis G de Oliveira; Perla Farhat; Marina Golivets; Nataly Hidalgo Aranzamendi; Kerstin Jantke; Joanna Kajzer-Bonk; M Çisel Kemahlı Aytekin; Igor Khorozyan; Kensuke Kito; Ko Konno; Da-Li Lin; Nick Littlewood; Yang Liu; Yifan Liu; Matthias-Claudio Loretto; Valentina Marconi; Philip A Martin; William H Morgan; Juan P Narváez-Gómez; Pablo Jose Negret; Elham Nourani; Jose M Ochoa Quintero; Nancy Ockendon; Rachel Rui Ying Oh; Silviu O Petrovan; Ana C Piovezan-Borges; Ingrid L Pollet; Danielle L Ramos; Ana L Reboredo Segovia; A Nayelli Rivera-Villanueva; Ricardo Rocha; Marie-Morgane Rouyer; Katherine A Sainsbury; Richard Schuster; Dominik Schwab; Çağan H Şekercioğlu; Hae-Min Seo; Gorm Shackelford; Yushin Shinoda; Rebecca K Smith; Shan-Dar Tao; Ming-Shan Tsai; Elizabeth H M Tyler; Flóra Vajna; José Osvaldo Valdebenito; Svetlana Vozykova; Paweł Waryszak; Veronica Zamora-Gutierrez; Rafael D Zenni; Wenjun Zhou; William J Sutherland
Journal:  PLoS Biol       Date:  2021-10-07       Impact factor: 8.029

6.  Growth of non-English-language literature on biodiversity conservation.

Authors:  Shawan Chowdhury; Kristofer Gonzalez; M Çisel Kemahlı Aytekin; Seung-Yun Baek; Michał Bełcik; Sandro Bertolino; Sjoerd Duijns; Yuqing Han; Kerstin Jantke; Ryosuke Katayose; Mu-Ming Lin; Elham Nourani; Danielle Leal Ramos; Marie-Morgane Rouyer; William Sidemo-Holm; Svetlana Vozykova; Veronica Zamora-Gutierrez; Tatsuya Amano
Journal:  Conserv Biol       Date:  2022-03-24       Impact factor: 7.563

7.  Assessing assemblage-wide mammal responses to different types of habitat modification in Amazonian forests.

Authors:  Paula C R Almeida-Maués; Anderson S Bueno; Ana Filipa Palmeirim; Carlos A Peres; Ana Cristina Mendes-Oliveira
Journal:  Sci Rep       Date:  2022-02-02       Impact factor: 4.379

  7 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.