Literature DB >> 27738955

Modelling Conditional Dependence Between Response Time and Accuracy.

Maria Bolsinova1,2,3, Paul de Boeck4,5, Jesper Tijmstra6.   

Abstract

The assumption of conditional independence between response time and accuracy given speed and ability is commonly made in response time modelling. However, this assumption might be violated in some cases, meaning that the relationship between the response time and the response accuracy of the same item cannot be fully explained by the correlation between the overall speed and ability. We propose to explicitly model the residual dependence between time and accuracy by incorporating the effects of the residual response time on the intercept and the slope parameter of the IRT model for response accuracy. We present an empirical example of a violation of conditional independence from a low-stakes educational test and show that our new model reveals interesting phenomena about the dependence of the item properties on whether the response is relatively fast or slow. For more difficult items responding slowly is associated with a higher probability of a correct response, whereas for the easier items responding slower is associated with a lower probability of a correct response. Moreover, for many of the items slower responses were less informative for the ability because their discrimination parameters decrease with residual response time.

Keywords:  conditional independence; hierarchical model; item response theory; response times

Mesh:

Year:  2016        PMID: 27738955     DOI: 10.1007/s11336-016-9537-6

Source DB:  PubMed          Journal:  Psychometrika        ISSN: 0033-3123            Impact factor:   2.500


  4 in total

1.  Stochastic relaxation, gibbs distributions, and the bayesian restoration of images.

Authors:  S Geman; D Geman
Journal:  IEEE Trans Pattern Anal Mach Intell       Date:  1984-06       Impact factor: 6.226

2.  Evaluating cognitive theory: a joint modeling approach using responses and response times.

Authors:  Rinke H Klein Entink; Jörg-Tobias Kuhn; Lutz F Hornke; Jean-Paul Fox
Journal:  Psychol Methods       Date:  2009-03

3.  A test for conditional independence between response time and accuracy.

Authors:  Maria Bolsinova; Gunter Maris
Journal:  Br J Math Stat Psychol       Date:  2015-06-08       Impact factor: 3.380

4.  Improving the Reliability of Student Scores from Speeded Assessments: An Illustration of Conditional Item Response Theory Using a Computer-Administered Measure of Vocabulary.

Authors:  Yaacov Petscher; Alison M Mitchell; Barbara R Foorman
Journal:  Read Writ       Date:  2014-05-30
  4 in total
  14 in total

1.  Modeling Differences Between Response Times of Correct and Incorrect Responses.

Authors:  Maria Bolsinova; Jesper Tijmstra
Journal:  Psychometrika       Date:  2019-08-28       Impact factor: 2.500

2.  Using Response Times to Model Not-Reached Items due to Time Limits.

Authors:  Steffi Pohl; Esther Ulitzsch; Matthias von Davier
Journal:  Psychometrika       Date:  2019-05-03       Impact factor: 2.500

3.  Response Mixture Modeling: Accounting for Heterogeneity in Item Characteristics across Response Times.

Authors:  Dylan Molenaar; Paul de Boeck
Journal:  Psychometrika       Date:  2018-02-01       Impact factor: 2.500

4.  Bridging Models of Biometric and Psychometric Assessment: A Three-Way Joint Modeling Approach of Item Responses, Response Times, and Gaze Fixation Counts.

Authors:  Kaiwen Man; Jeffrey R Harring; Peida Zhan
Journal:  Appl Psychol Meas       Date:  2022-05-27

5.  Modeling Conditional Dependence of Response Accuracy and Response Time with the Diffusion Item Response Theory Model.

Authors:  Inhan Kang; Paul De Boeck; Roger Ratcliff
Journal:  Psychometrika       Date:  2022-01-06       Impact factor: 2.500

6.  Using a Response Time-Based Expected A Posteriori Estimator to Control for Differential Speededness in Computerized Adaptive Test.

Authors:  Justin L Kern; Edison Choe
Journal:  Appl Psychol Meas       Date:  2021-06-10

7.  Assessing Preknowledge Cheating via Innovative Measures: A Multiple-Group Analysis of Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts.

Authors:  Kaiwen Man; Jeffrey R Harring
Journal:  Educ Psychol Meas       Date:  2020-10-31       Impact factor: 3.088

8.  Conditional Dependence between Response Time and Accuracy: An Overview of its Possible Sources and Directions for Distinguishing between Them.

Authors:  Maria Bolsinova; Jesper Tijmstra; Dylan Molenaar; Paul De Boeck
Journal:  Front Psychol       Date:  2017-02-16

9.  An IRT-Multiple Indicators Multiple Causes (MIMIC) Approach as a Method of Examining Item Response Latency.

Authors:  Ioannis Tsaousis; Georgios D Sideridis; Abdullah Al-Sadaawi
Journal:  Front Psychol       Date:  2018-11-13

10.  Data Mining Techniques in Analyzing Process Data: A Didactic.

Authors:  Xin Qiao; Hong Jiao
Journal:  Front Psychol       Date:  2018-11-23
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.