Literature DB >> 29531079

Issues with data and analyses: Errors, underlying themes, and potential solutions.

Andrew W Brown1, Kathryn A Kaiser1, David B Allison2.   

Abstract

Some aspects of science, taken at the broadest level, are universal in empirical research. These include collecting, analyzing, and reporting data. In each of these aspects, errors can and do occur. In this work, we first discuss the importance of focusing on statistical and data errors to continually improve the practice of science. We then describe underlying themes of the types of errors and postulate contributing factors. To do so, we describe a case series of relatively severe data and statistical errors coupled with surveys of some types of errors to better characterize the magnitude, frequency, and trends. Having examined these errors, we then discuss the consequences of specific errors or classes of errors. Finally, given the extracted themes, we discuss methodological, cultural, and system-level approaches to reducing the frequency of commonly observed errors. These approaches will plausibly contribute to the self-critical, self-correcting, ever-evolving practice of science, and ultimately to furthering knowledge.

Keywords:  data analysis; quality control; reproducibility; rigor; statistical errors

Mesh:

Year:  2018        PMID: 29531079      PMCID: PMC5856502          DOI: 10.1073/pnas.1708279115

Source DB:  PubMed          Journal:  Proc Natl Acad Sci U S A        ISSN: 0027-8424            Impact factor:   11.205


  57 in total

1.  The registration of observational studies--when metaphors go bad.

Authors: 
Journal:  Epidemiology       Date:  2010-09       Impact factor: 4.822

2.  The (mis)reporting of statistical results in psychology journals.

Authors:  Marjan Bakker; Jelte M Wicherts
Journal:  Behav Res Methods       Date:  2011-09

3.  Data extraction errors in meta-analyses that use standardized mean differences.

Authors:  Peter C Gøtzsche; Asbjørn Hróbjartsson; Katja Maric; Britta Tendal
Journal:  JAMA       Date:  2007-07-25       Impact factor: 56.272

4.  Belief beyond the evidence: using the proposed effect of breakfast on obesity to show 2 practices that distort scientific evidence.

Authors:  Andrew W Brown; Michelle M Bohan Brown; David B Allison
Journal:  Am J Clin Nutr       Date:  2013-09-04       Impact factor: 7.045

5.  Potential Errors and Omissions Related to the Analysis and Conclusions Reported in Cuspidi C, et al., AJH 2014; 27(2):146-156.

Authors:  Kathryn A Kaiser; Mariel A Parman; Eric Kim; Brandon J George; David B Allison
Journal:  Am J Hypertens       Date:  2016-06       Impact factor: 2.689

6.  Errors in statistical analysis and questionable randomization lead to unreliable conclusions.

Authors:  Brandon J George; Andrew W Brown; David B Allison
Journal:  J Paramed Sci       Date:  2015

Review 7.  Common scientific and statistical errors in obesity research.

Authors:  Brandon J George; T Mark Beasley; Andrew W Brown; John Dawson; Rositsa Dimova; Jasmin Divers; TaShauna U Goldsby; Moonseong Heo; Kathryn A Kaiser; Scott W Keith; Mimi Y Kim; Peng Li; Tapan Mehta; J Michael Oakes; Asheley Skinner; Elizabeth Stuart; David B Allison
Journal:  Obesity (Silver Spring)       Date:  2016-04       Impact factor: 5.002

8.  Misrepresentation of randomized controlled trials in press releases and news coverage: a cohort study.

Authors:  Amélie Yavchitz; Isabelle Boutron; Aida Bafeta; Ibrahim Marroun; Pierre Charles; Jean Mantz; Philippe Ravaud
Journal:  PLoS Med       Date:  2012-09-11       Impact factor: 11.069

9.  A systematic appraisal of allegiance effect in randomized controlled trials of psychotherapy.

Authors:  Elena Dragioti; Ioannis Dimoliatis; Konstantinos N Fountoulakis; Evangelos Evangelou
Journal:  Ann Gen Psychiatry       Date:  2015-09-15       Impact factor: 3.455

10.  The prevalence of statistical reporting errors in psychology (1985-2013).

Authors:  Michèle B Nuijten; Chris H J Hartgerink; Marcel A L M van Assen; Sacha Epskamp; Jelte M Wicherts
Journal:  Behav Res Methods       Date:  2016-12
View more
  30 in total

1.  Availability of Statistical Code From Studies Using Medicare Data in General Medical Journals.

Authors:  Jennie DeBlanc; Bradley Kay; Jessica Lehrich; Neil Kamdar; Thomas S Valley; John Z Ayanian; Brahmajee K Nallamothu
Journal:  JAMA Intern Med       Date:  2020-06-01       Impact factor: 21.873

2.  Reproducibility of research: Issues and proposed remedies.

Authors:  David B Allison; Richard M Shiffrin; Victoria Stodden
Journal:  Proc Natl Acad Sci U S A       Date:  2018-03-12       Impact factor: 11.205

3.  Toward fulfilling the aspirational goal of science as self-correcting: A call for editorial courage and diligence for error correction.

Authors:  Colby J Vorland; Andrew W Brown; Keisuke Ejima; Evan Mayo-Wilson; Danny Valdez; David B Allison
Journal:  Eur J Clin Invest       Date:  2020-01-18       Impact factor: 4.686

4.  Conditioning on "study" is essential for valid inference when combining individual data from multiple randomized controlled trials: a comment on Reesor et al's School-based weight management program curbs summer weight gain among low-income Hispanic middle school students. J Sch Health. 2019;89(1):59-67.

Authors:  Wasantha P Jayawardene; Andrew W Brown; John A Dawson; Chanaka N Kahathuduwa; Bryan McComb; David B Allison
Journal:  J Sch Health       Date:  2019-05-03       Impact factor: 2.118

5.  Shotgun Proteomics Sample Processing Automated by an Open-Source Lab Robot.

Authors:  Yu Han; Cody T Thomas; Sara A Wennersten; Edward Lau; Maggie P Y Lam
Journal:  J Vis Exp       Date:  2021-10-28       Impact factor: 1.355

Review 6.  Childhood obesity intervention studies: A narrative review and guide for investigators, authors, editors, reviewers, journalists, and readers to guard against exaggerated effectiveness claims.

Authors:  Andrew W Brown; Douglas G Altman; Tom Baranowski; J Martin Bland; John A Dawson; Nikhil V Dhurandhar; Shima Dowla; Kevin R Fontaine; Andrew Gelman; Steven B Heymsfield; Wasantha Jayawardene; Scott W Keith; Theodore K Kyle; Eric Loken; J Michael Oakes; June Stevens; Diana M Thomas; David B Allison
Journal:  Obes Rev       Date:  2019-08-19       Impact factor: 9.213

Review 7.  University of Alabama at Birmingham Nathan Shock Center: comparative energetics of aging.

Authors:  Steven N Austad; Thomas W Buford; David B Allison; Scott W Ballinger; Andrew W Brown; Christy S Carter; Victor M Darley-Usmar; John L Hartman; Timothy R Nagy; Daniel L Smith; Liou Sun; Jianhua Zhang
Journal:  Geroscience       Date:  2021-07-25       Impact factor: 7.713

8.  Persistent confusion in nutrition and obesity research about the validity of classic nonparametric tests in the presence of heteroscedasticity: evidence of the problem and valid alternatives.

Authors:  Cynthia M Kroeger; Keisuke Ejima; Bridget A Hannon; Tanya M Halliday; Bryan McComb; Margarita Teran-Garcia; John A Dawson; David B King; Andrew W Brown; David B Allison
Journal:  Am J Clin Nutr       Date:  2021-03-11       Impact factor: 7.045

9.  Updating salamander datasets with phenotypic and stomach content information for two mainland Speleomantes.

Authors:  Enrico Lunghi; Fabio Cianferoni; Simone Giachello; Yahui Zhao; Raoul Manenti; Claudia Corti; Gentile Francesco Ficetola
Journal:  Sci Data       Date:  2021-06-09       Impact factor: 6.444

Review 10.  The Traumatic Brain Injury Model Systems National Database: A Review of Published Research.

Authors:  Samantha Tso; Ashirbani Saha; Michael D Cusimano
Journal:  Neurotrauma Rep       Date:  2021-03-12
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.