Literature DB >> 34764461

Seven steps toward more transparency in statistical practice.

Eric-Jan Wagenmakers1, Alexandra Sarafoglou2, Sil Aarts3, Casper Albers4, Johannes Algermissen5, Štěpán Bahník6, Noah van Dongen2, Rink Hoekstra7, David Moreau8, Don van Ravenzwaaij9, Aljaž Sluga10, Franziska Stanke11, Jorge Tendeiro9,12, Balazs Aczel13.   

Abstract

We argue that statistical practice in the social and behavioural sciences benefits from transparency, a fair acknowledgement of uncertainty and openness to alternative interpretations. Here, to promote such a practice, we recommend seven concrete statistical procedures: (1) visualizing data; (2) quantifying inferential uncertainty; (3) assessing data preprocessing choices; (4) reporting multiple models; (5) involving multiple analysts; (6) interpreting results modestly; and (7) sharing data and code. We discuss their benefits and limitations, and provide guidelines for adoption. Each of the seven procedures finds inspiration in Merton's ethos of science as reflected in the norms of communalism, universalism, disinterestedness and organized scepticism. We believe that these ethical considerations-as well as their statistical consequences-establish common ground among data analysts, despite continuing disagreements about the foundations of statistical inference.
© 2021. Springer Nature Limited.

Entities:  

Mesh:

Year:  2021        PMID: 34764461     DOI: 10.1038/s41562-021-01211-8

Source DB:  PubMed          Journal:  Nat Hum Behav        ISSN: 2397-3374


  31 in total

1.  Graphical literacy: the quality of graphs in a large-circulation journal.

Authors:  Richelle J Cooper; David L Schriger; Reb J H Close
Journal:  Ann Emerg Med       Date:  2002-09       Impact factor: 5.721

2.  Probability as certainty: dichotomous thinking and the misuse of p values.

Authors:  Rink Hoekstra; Sue Finch; Henk A L Kiers; Addie Johnson
Journal:  Psychon Bull Rev       Date:  2006-12

3.  Redefine statistical significance.

Authors:  Daniel J Benjamin; James O Berger; Magnus Johannesson; Brian A Nosek; E-J Wagenmakers; Richard Berk; Kenneth A Bollen; Björn Brembs; Lawrence Brown; Colin Camerer; David Cesarini; Christopher D Chambers; Merlise Clyde; Thomas D Cook; Paul De Boeck; Zoltan Dienes; Anna Dreber; Kenny Easwaran; Charles Efferson; Ernst Fehr; Fiona Fidler; Andy P Field; Malcolm Forster; Edward I George; Richard Gonzalez; Steven Goodman; Edwin Green; Donald P Green; Anthony G Greenwald; Jarrod D Hadfield; Larry V Hedges; Leonhard Held; Teck Hua Ho; Herbert Hoijtink; Daniel J Hruschka; Kosuke Imai; Guido Imbens; John P A Ioannidis; Minjeong Jeon; James Holland Jones; Michael Kirchler; David Laibson; John List; Roderick Little; Arthur Lupia; Edouard Machery; Scott E Maxwell; Michael McCarthy; Don A Moore; Stephen L Morgan; Marcus Munafó; Shinichi Nakagawa; Brendan Nyhan; Timothy H Parker; Luis Pericchi; Marco Perugini; Jeff Rouder; Judith Rousseau; Victoria Savalei; Felix D Schönbrodt; Thomas Sellke; Betsy Sinclair; Dustin Tingley; Trisha Van Zandt; Simine Vazire; Duncan J Watts; Christopher Winship; Robert L Wolpert; Yu Xie; Cristobal Young; Jonathan Zinman; Valen E Johnson
Journal:  Nat Hum Behav       Date:  2018-01

4.  Scientists rise up against statistical significance.

Authors:  Valentin Amrhein; Sander Greenland; Blake McShane
Journal:  Nature       Date:  2019-03       Impact factor: 49.962

5.  Discussion points for Bayesian inference.

Authors:  Balazs Aczel; Rink Hoekstra; Andrew Gelman; Eric-Jan Wagenmakers; Irene G Klugkist; Jeffrey N Rouder; Joachim Vandekerckhove; Michael D Lee; Richard D Morey; Wolf Vanpaemel; Zoltan Dienes; Don van Ravenzwaaij
Journal:  Nat Hum Behav       Date:  2020-06

6.  Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis.

Authors:  F Strack; L L Martin; S Stepper
Journal:  J Pers Soc Psychol       Date:  1988-05

7.  Time to get personal? The impact of researchers choices on the selection of treatment targets using the experience sampling methodology.

Authors:  Jojanneke A Bastiaansen; Yoram K Kunkels; Frank J Blaauw; Steven M Boker; Eva Ceulemans; Meng Chen; Sy-Miin Chow; Peter de Jonge; Ando C Emerencia; Sacha Epskamp; Aaron J Fisher; Ellen L Hamaker; Peter Kuppens; Wolfgang Lutz; M Joseph Meyer; Robert Moulder; Zita Oravecz; Harriëtte Riese; Julian Rubel; Oisín Ryan; Michelle N Servaas; Gustav Sjobeck; Evelien Snippe; Timothy J Trull; Wolfgang Tschacher; Date C van der Veen; Marieke Wichers; Phillip K Wood; William C Woods; Aidan G C Wright; Casper J Albers; Laura F Bringmann
Journal:  J Psychosom Res       Date:  2020-08-05       Impact factor: 3.006

8.  Beyond bar and line graphs: time for a new data presentation paradigm.

Authors:  Tracey L Weissgerber; Natasa M Milic; Stacey J Winham; Vesna D Garovic
Journal:  PLoS Biol       Date:  2015-04-22       Impact factor: 8.029

9.  Variability in the analysis of a single neuroimaging dataset by many teams.

Authors:  Rotem Botvinik-Nezer; Felix Holzmeister; Colin F Camerer; Anna Dreber; Juergen Huber; Magnus Johannesson; Michael Kirchler; Roni Iwanir; Jeanette A Mumford; R Alison Adcock; Paolo Avesani; Blazej M Baczkowski; Aahana Bajracharya; Leah Bakst; Sheryl Ball; Marco Barilari; Nadège Bault; Derek Beaton; Julia Beitner; Roland G Benoit; Ruud M W J Berkers; Jamil P Bhanji; Bharat B Biswal; Sebastian Bobadilla-Suarez; Tiago Bortolini; Katherine L Bottenhorn; Alexander Bowring; Senne Braem; Hayley R Brooks; Emily G Brudner; Cristian B Calderon; Julia A Camilleri; Jaime J Castrellon; Luca Cecchetti; Edna C Cieslik; Zachary J Cole; Olivier Collignon; Robert W Cox; William A Cunningham; Stefan Czoschke; Kamalaker Dadi; Charles P Davis; Alberto De Luca; Mauricio R Delgado; Lysia Demetriou; Jeffrey B Dennison; Xin Di; Erin W Dickie; Ekaterina Dobryakova; Claire L Donnat; Juergen Dukart; Niall W Duncan; Joke Durnez; Amr Eed; Simon B Eickhoff; Andrew Erhart; Laura Fontanesi; G Matthew Fricke; Shiguang Fu; Adriana Galván; Remi Gau; Sarah Genon; Tristan Glatard; Enrico Glerean; Jelle J Goeman; Sergej A E Golowin; Carlos González-García; Krzysztof J Gorgolewski; Cheryl L Grady; Mikella A Green; João F Guassi Moreira; Olivia Guest; Shabnam Hakimi; J Paul Hamilton; Roeland Hancock; Giacomo Handjaras; Bronson B Harry; Colin Hawco; Peer Herholz; Gabrielle Herman; Stephan Heunis; Felix Hoffstaedter; Jeremy Hogeveen; Susan Holmes; Chuan-Peng Hu; Scott A Huettel; Matthew E Hughes; Vittorio Iacovella; Alexandru D Iordan; Peder M Isager; Ayse I Isik; Andrew Jahn; Matthew R Johnson; Tom Johnstone; Michael J E Joseph; Anthony C Juliano; Joseph W Kable; Michalis Kassinopoulos; Cemal Koba; Xiang-Zhen Kong; Timothy R Koscik; Nuri Erkut Kucukboyaci; Brice A Kuhl; Sebastian Kupek; Angela R Laird; Claus Lamm; Robert Langner; Nina Lauharatanahirun; Hongmi Lee; Sangil Lee; Alexander Leemans; Andrea Leo; Elise Lesage; Flora Li; Monica Y C Li; Phui Cheng Lim; Evan N Lintz; Schuyler W Liphardt; Annabel B Losecaat Vermeer; Bradley C Love; Michael L Mack; Norberto Malpica; Theo Marins; Camille Maumet; Kelsey McDonald; Joseph T McGuire; Helena Melero; Adriana S Méndez Leal; Benjamin Meyer; Kristin N Meyer; Glad Mihai; Georgios D Mitsis; Jorge Moll; Dylan M Nielson; Gustav Nilsonne; Michael P Notter; Emanuele Olivetti; Adrian I Onicas; Paolo Papale; Kaustubh R Patil; Jonathan E Peelle; Alexandre Pérez; Doris Pischedda; Jean-Baptiste Poline; Yanina Prystauka; Shruti Ray; Patricia A Reuter-Lorenz; Richard C Reynolds; Emiliano Ricciardi; Jenny R Rieck; Anais M Rodriguez-Thompson; Anthony Romyn; Taylor Salo; Gregory R Samanez-Larkin; Emilio Sanz-Morales; Margaret L Schlichting; Douglas H Schultz; Qiang Shen; Margaret A Sheridan; Jennifer A Silvers; Kenny Skagerlund; Alec Smith; David V Smith; Peter Sokol-Hessner; Simon R Steinkamp; Sarah M Tashjian; Bertrand Thirion; John N Thorp; Gustav Tinghög; Loreen Tisdall; Steven H Tompson; Claudio Toro-Serey; Juan Jesus Torre Tresols; Leonardo Tozzi; Vuong Truong; Luca Turella; Anna E van 't Veer; Tom Verguts; Jean M Vettel; Sagana Vijayarajah; Khoi Vo; Matthew B Wall; Wouter D Weeda; Susanne Weis; David J White; David Wisniewski; Alba Xifra-Porxas; Emily A Yearling; Sangsuk Yoon; Rui Yuan; Kenneth S L Yuen; Lei Zhang; Xu Zhang; Joshua E Zosky; Thomas E Nichols; Russell A Poldrack; Tom Schonberg
Journal:  Nature       Date:  2020-05-20       Impact factor: 69.504

10.  Measuring the predictability of life outcomes with a scientific mass collaboration.

Authors:  Matthew J Salganik; Ian Lundberg; Alexander T Kindel; Caitlin E Ahearn; Khaled Al-Ghoneim; Abdullah Almaatouq; Drew M Altschul; Jennie E Brand; Nicole Bohme Carnegie; Ryan James Compton; Debanjan Datta; Thomas Davidson; Anna Filippova; Connor Gilroy; Brian J Goode; Eaman Jahani; Ridhi Kashyap; Antje Kirchner; Stephen McKay; Allison C Morgan; Alex Pentland; Kivan Polimis; Louis Raes; Daniel E Rigobon; Claudia V Roberts; Diana M Stanescu; Yoshihiko Suhara; Adaner Usmani; Erik H Wang; Muna Adem; Abdulla Alhajri; Bedoor AlShebli; Redwane Amin; Ryan B Amos; Lisa P Argyle; Livia Baer-Bositis; Moritz Büchi; Bo-Ryehn Chung; William Eggert; Gregory Faletto; Zhilin Fan; Jeremy Freese; Tejomay Gadgil; Josh Gagné; Yue Gao; Andrew Halpern-Manners; Sonia P Hashim; Sonia Hausen; Guanhua He; Kimberly Higuera; Bernie Hogan; Ilana M Horwitz; Lisa M Hummel; Naman Jain; Kun Jin; David Jurgens; Patrick Kaminski; Areg Karapetyan; E H Kim; Ben Leizman; Naijia Liu; Malte Möser; Andrew E Mack; Mayank Mahajan; Noah Mandell; Helge Marahrens; Diana Mercado-Garcia; Viola Mocz; Katariina Mueller-Gastell; Ahmed Musse; Qiankun Niu; William Nowak; Hamidreza Omidvar; Andrew Or; Karen Ouyang; Katy M Pinto; Ethan Porter; Kristin E Porter; Crystal Qian; Tamkinat Rauf; Anahit Sargsyan; Thomas Schaffner; Landon Schnabel; Bryan Schonfeld; Ben Sender; Jonathan D Tang; Emma Tsurkov; Austin van Loon; Onur Varol; Xiafei Wang; Zhi Wang; Julia Wang; Flora Wang; Samantha Weissman; Kirstie Whitaker; Maria K Wolters; Wei Lee Woon; James Wu; Catherine Wu; Kengran Yang; Jingwen Yin; Bingyu Zhao; Chenyun Zhu; Jeanne Brooks-Gunn; Barbara E Engelhardt; Moritz Hardt; Dean Knox; Karen Levy; Arvind Narayanan; Brandon M Stewart; Duncan J Watts; Sara McLanahan
Journal:  Proc Natl Acad Sci U S A       Date:  2020-03-30       Impact factor: 11.205

View more
  2 in total

1.  A survey on how preregistration affects the research workflow: better science but more work.

Authors:  Alexandra Sarafoglou; Marton Kovacs; Bence Bakos; Eric-Jan Wagenmakers; Balazs Aczel
Journal:  R Soc Open Sci       Date:  2022-07-06       Impact factor: 3.653

2.  What's Right and Wrong in Preclinical Science: A Matter of Principled Investigation.

Authors:  Laura N Smith
Journal:  Front Behav Neurosci       Date:  2022-03-09       Impact factor: 3.558

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.