Literature DB >> 32190814

Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets.

Sara J Weston1, Stuart J Ritchie2, Julia M Rohrer3,4,5, Andrew K Przybylski6,7.   

Abstract

Secondary data analysis, or the analysis of preexisting data, provides a powerful tool for the resourceful psychological scientist. Never has this been more true than now, when technological advances enable both sharing data across labs and continents and mining large sources of preexisting data. However, secondary data analysis is easily overlooked as a key domain for developing new open-science practices or improving analytic methods for robust data analysis. In this article, we provide researchers with the knowledge necessary to incorporate secondary data analysis into their methodological toolbox. We explain that secondary data analysis can be used for either exploratory or confirmatory work, and can be either correlational or experimental, and we highlight the advantages and disadvantages of this type of research. We describe how transparency-enhancing practices can improve and alter interpretations of results from secondary data analysis and discuss approaches that can be used to improve the robustness of reported results. We close by suggesting ways in which scientific subfields and institutions could address and improve the use of secondary data analysis.

Entities:  

Keywords:  bias; file drawer; p-hacking; panel design; preexisting data; preregistration; reproducibility; secondary analysis; transparency

Year:  2019        PMID: 32190814      PMCID: PMC7079740          DOI: 10.1177/2515245919848684

Source DB:  PubMed          Journal:  Adv Methods Pract Psychol Sci        ISSN: 2515-2459


  41 in total

1.  False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant.

Authors:  Joseph P Simmons; Leif D Nelson; Uri Simonsohn
Journal:  Psychol Sci       Date:  2011-10-17

2.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies.

Authors:  Erik von Elm; Douglas G Altman; Matthias Egger; Stuart J Pocock; Peter C Gøtzsche; Jan P Vandenbroucke
Journal:  Ann Intern Med       Date:  2007-10-16       Impact factor: 25.391

3.  Registered reports: realigning incentives in scientific publishing.

Authors:  Christopher D Chambers; Zoltan Dienes; Robert D McIntosh; Pia Rotshtein; Klaus Willmes
Journal:  Cortex       Date:  2015-05       Impact factor: 4.027

4.  Editors' Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?

Authors:  Harold Pashler; Eric-Jan Wagenmakers
Journal:  Perspect Psychol Sci       Date:  2012-11

5.  The association between adolescent well-being and digital technology use.

Authors:  Amy Orben; Andrew K Przybylski
Journal:  Nat Hum Behav       Date:  2019-01-14

6.  Replication and robustness in developmental research.

Authors:  Greg J Duncan; Mimi Engel; Amy Claessens; Chantelle J Dowsett
Journal:  Dev Psychol       Date:  2014-09-22

7.  Five-factor personality traits and sleep: evidence from two population-based cohort studies.

Authors:  Mirka Hintsanen; Sampsa Puttonen; Kylie Smith; Maria Törnroos; Markus Jokela; Laura Pulkki-Råback; Taina Hintsa; Päivi Merjonen; Terence Dwyer; Olli T Raitakari; Alison Venn; Liisa Keltikangas-Järvinen
Journal:  Health Psychol       Date:  2014-08-18       Impact factor: 4.267

8.  SCIENTIFIC STANDARDS. Promoting an open research culture.

Authors:  B A Nosek; G Alter; G C Banks; D Borsboom; S D Bowman; S J Breckler; S Buck; C D Chambers; G Chin; G Christensen; M Contestabile; A Dafoe; E Eich; J Freese; R Glennerster; D Goroff; D P Green; B Hesse; M Humphreys; J Ishiyama; D Karlan; A Kraut; A Lupia; P Mabry; T A Madon; N Malhotra; E Mayo-Wilson; M McNutt; E Miguel; E Levy Paluck; U Simonsohn; C Soderberg; B A Spellman; J Turitto; G VandenBos; S Vazire; E J Wagenmakers; R Wilson; T Yarkoni
Journal:  Science       Date:  2015-06-26       Impact factor: 47.728

9.  Compensatory conscientiousness and health in older couples.

Authors:  Brent W Roberts; Jacqui Smith; Joshua J Jackson; Grant Edmonds
Journal:  Psychol Sci       Date:  2009-05

10.  Quasi-Experimental Designs for Causal Inference.

Authors:  Yongnam Kim; Peter Steiner
Journal:  Educ Psychol       Date:  2016-09-02
View more
  21 in total

1.  Dataset decay and the problem of sequential analyses on open datasets.

Authors:  William Hedley Thompson; Jessey Wright; Patrick G Bissett; Russell A Poldrack
Journal:  Elife       Date:  2020-05-19       Impact factor: 8.140

2.  Memory and Personality Development in Adulthood: Evidence From Four Longitudinal Studies.

Authors:  Yannick Stephan; Angelina R Sutin; Martina Luchetti; Antonio Terracciano
Journal:  J Gerontol B Psychol Sci Soc Sci       Date:  2021-01-01       Impact factor: 4.077

3.  Auditing the research practices and statistical analyses of the group-level temporal network approach to psychological constructs: A systematic scoping review.

Authors:  M Annelise Blanchard; Alba Contreras; Rana Begum Kalkan; Alexandre Heeren
Journal:  Behav Res Methods       Date:  2022-04-25

4.  Applying multiverse analysis to experience sampling data: Investigating whether preprocessing choices affect robustness of conclusions.

Authors:  Ginette Lafit; Glenn Kiekens; Jeroen Weermeijer; Martien Wampers; Gudrun Eisele; Zuzana Kasanova; Thomas Vaessen; Peter Kuppens; Inez Myin-Germeys
Journal:  Behav Res Methods       Date:  2022-02-09

5.  Sex differences in moral judgements across 67 countries.

Authors:  Mohammad Atari; Mark H C Lai; Morteza Dehghani
Journal:  Proc Biol Sci       Date:  2020-10-21       Impact factor: 5.349

6.  Post-traumatic growth as positive personality change: Challenges, opportunities, and recommendations.

Authors:  Eranda Jayawickreme; Frank J Infurna; Kinan Alajak; Laura E R Blackie; William J Chopik; Joanne M Chung; Anna Dorfman; William Fleeson; Marie J C Forgeard; Patricia Frazier; R Michael Furr; Igor Grossmann; Aaron S Heller; Odilia M Laceulle; Richard E Lucas; Maike Luhmann; Gloria Luong; Laurien Meijer; Kate C McLean; Crystal L Park; Ann Marie Roepke; Zeina Al Sawaf; Howard Tennen; Rebecca M B White; Renée Zonneveld
Journal:  J Pers       Date:  2020-09-23

7.  Data overuse in aging research: Emerging issues and potential solutions.

Authors:  Daniel K Mroczek; Sara J Weston; Eileen K Graham; Emily C Willroth
Journal:  Psychol Aging       Date:  2021-04-29

8.  Coordinated data analysis: Knowledge accumulation in lifespan developmental psychology.

Authors:  Eileen K Graham; Emily C Willroth; Sara J Weston; Graciela Muniz-Terrera; Sean A P Clouston; Scott M Hofer; Daniel K Mroczek; Andrea M Piccinin
Journal:  Psychol Aging       Date:  2021-05-24

9.  The Relationship of Age with the Autism-Spectrum Quotient Scale in a Large Sample of Adults.

Authors:  Jennifer Lodi-Smith; Jonathan D Rodgers; Valeria Marquez Luna; Sarah Khan; Caleb J Long; Karl F Kozlowski; James P Donnelly; Christopher Lopata; Marcus L Thomeer
Journal:  Autism Adulthood       Date:  2021-06-07

10.  Autism Characteristics and Self-Reported Health in Older Adulthood.

Authors:  Jennifer Lodi-Smith; Jonathan D Rodgers; Karl Kozlowski; Sarah Khan; Valeria Marquez Luna; Caleb J Long; James P Donnelly; Christopher Lopata; Marcus L Thomeer
Journal:  J Gerontol B Psychol Sci Soc Sci       Date:  2021-10-30       Impact factor: 4.942

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.