Literature DB >> 32616958

Identifying Effortful Individuals With Mixture Modeling Response Accuracy and Response Time Simultaneously to Improve Item Parameter Estimation.

Yue Liu1, Ying Cheng2, Hongyun Liu1,3.   

Abstract

The responses of non-effortful test-takers may have serious consequences as non-effortful responses can impair model calibration and latent trait inferences. This article introduces a mixture model, using both response accuracy and response time information, to help differentiating non-effortful and effortful individuals, and to improve item parameter estimation based on the effortful group. Two mixture approaches are compared with the traditional response time mixture model (TMM) method and the normative threshold 10 (NT10) method with response behavior effort criteria in four simulation scenarios with regard to item parameter recovery and classification accuracy. The results demonstrate that the mixture methods and the TMM method can reduce the bias of item parameter estimates caused by non-effortful individuals, with the mixture methods showing more advantages when the non-effort severity is high or the response times are not lognormally distributed. An illustrative example is also provided.
© The Author(s) 2020.

Keywords:  hierarchical model; mixture method; non-effortful individuals; response time

Year:  2020        PMID: 32616958      PMCID: PMC7307491          DOI: 10.1177/0013164419895068

Source DB:  PubMed          Journal:  Educ Psychol Meas        ISSN: 0013-1644            Impact factor:   2.821


  10 in total

1.  A Box-Cox normal model for response times.

Authors:  R H Klein Entink; W J van der Linden; J-P Fox
Journal:  Br J Math Stat Psychol       Date:  2009-01-30       Impact factor: 3.380

2.  Item Position Effects Are Moderated by Changes in Test-Taking Effort.

Authors:  Sebastian Weirich; Martin Hecht; Christiane Penk; Alexander Roppelt; Katrin Böhme
Journal:  Appl Psychol Meas       Date:  2016-11-22

3.  A mixture hierarchical model for response times and response accuracy.

Authors:  Chun Wang; Gongjun Xu
Journal:  Br J Math Stat Psychol       Date:  2015-04-15       Impact factor: 3.380

4.  A change-point analysis procedure based on weighted residuals to detect back random responding.

Authors:  Xiaofeng Yu; Ying Cheng
Journal:  Psychol Methods       Date:  2019-02-14

5.  Hidden Markov Item Response Theory Models for Responses and Response Times.

Authors:  Dylan Molenaar; Daniel Oberski; Jeroen Vermunt; Paul De Boeck
Journal:  Multivariate Behav Res       Date:  2016-08-11       Impact factor: 5.923

6.  A Two-Stage Approach to Differentiating Normal and Aberrant Behavior in Computer Based Testing.

Authors:  Chun Wang; Gongjun Xu; Zhuoran Shang
Journal:  Psychometrika       Date:  2016-10-28       Impact factor: 2.500

7.  A simplified version of the maximum information per time unit method in computerized adaptive testing.

Authors:  Ying Cheng; Qi Diao; John T Behrens
Journal:  Behav Res Methods       Date:  2017-04

8.  A semi-parametric within-subject mixture approach to the analyses of responses and response times.

Authors:  Dylan Molenaar; Maria Bolsinova; Jeroen K Vermunt
Journal:  Br J Math Stat Psychol       Date:  2017-10-17       Impact factor: 3.380

9.  Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times.

Authors:  Dylan Molenaar; Paul de Boeck
Journal:  Psychometrika       Date:  2018-02-01       Impact factor: 2.500

10.  Robust maximum marginal likelihood (RMML) estimation for item response theory models.

Authors:  Maxwell R Hong; Ying Cheng
Journal:  Behav Res Methods       Date:  2019-04
  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.