Literature DB >> 36131198

Do you know the Wooly Bully? Testing era-based knowledge to verify participant age online.

Rachel Hartman1,2, Aaron J Moss1, Israel Rabinowitz1, Nathaniel Bahn1, Cheskie Rosenzweig1,3, Jonathan Robinson1,4, Leib Litman5,6.   

Abstract

People in online studies sometimes misrepresent themselves. Regardless of their motive for doing so, participant misrepresentation threatens the validity of research. Here, we propose and evaluate a way to verify the age of online respondents: a test of era-based knowledge. Across six studies (N = 1543), participants of various ages completed an age verification instrument. The instrument assessed familiarity with cultural phenomena (e.g., songs and TV shows) from decades past and present. We consistently found that our instrument discriminated between people of different ages. In Studies 1a and 1b, self-reported age correlated strongly with performance on the instrument (mean r = .8). In Study 2, the instrument reliably detected imposters who we knew were misrepresenting their age. For impostors, self-reported age did not correlate with performance on the instrument (r = .077). Finally, in Studies 3a, 3b, and 3c, the instrument remained robust with African Americans, people from low educational backgrounds, and recent immigrants to the United States. Thus, our instrument shows promise for verifying the age of online respondents, and, as we discuss, our approach of assessing "insider knowledge" holds great promise for verifying other identities within online studies.
© 2022. The Psychonomic Society, Inc.

Entities:  

Keywords:  Age verification; Amazon Mechanical Turk; Data quality; Online research

Year:  2022        PMID: 36131198     DOI: 10.3758/s13428-022-01944-y

Source DB:  PubMed          Journal:  Behav Res Methods        ISSN: 1554-351X


  4 in total

1.  Current-events knowledge in adults: an investigation of age, intelligence, and nonability determinants.

Authors:  M E Beier; P L Ackerman
Journal:  Psychol Aging       Date:  2001-12

2.  Age dissociates recency and lag recency effects in free recall.

Authors:  Michael J Kahana; Marc W Howard; Franklin Zaromb; Arthur Wingfield
Journal:  J Exp Psychol Learn Mem Cogn       Date:  2002-05       Impact factor: 3.051

3.  Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants.

Authors:  David J Hauser; Norbert Schwarz
Journal:  Behav Res Methods       Date:  2016-03

4.  Online panels in social science research: Expanding sampling methods beyond Mechanical Turk.

Authors:  Jesse Chandler; Cheskie Rosenzweig; Aaron J Moss; Jonathan Robinson; Leib Litman
Journal:  Behav Res Methods       Date:  2019-10
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.