Literature DB >> 34565941

Using a Response Time-Based Expected A Posteriori Estimator to Control for Differential Speededness in Computerized Adaptive Test.

Justin L Kern1, Edison Choe2.   

Abstract

This study investigates using response times (RTs) with item responses in a computerized adaptive test (CAT) setting to enhance item selection and ability estimation and control for differential speededness. Using van der Linden's hierarchical framework, an extended procedure for joint estimation of ability and speed parameters for use in CAT is developed following van der Linden; this is called the joint expected a posteriori estimator (J-EAP). It is shown that the J-EAP estimate of ability and speededness outperforms the standard maximum likelihood estimator (MLE) of ability and speededness in terms of correlation, root mean square error, and bias. It is further shown that under the maximum information per time unit item selection method (MICT)-a method which uses estimates for ability and speededness directly-using the J-EAP further reduces average examinee time spent and variability in test times between examinees above the resulting gains of this selection algorithm with the MLE while maintaining estimation efficiency. Simulated test results are further corroborated with test parameters derived from a real data example.
© The Author(s) 2021.

Entities:  

Keywords:  ability estimation; computerized adaptive testing; expected a posteriori; response times

Year:  2021        PMID: 34565941      PMCID: PMC8361377          DOI: 10.1177/01466216211014601

Source DB:  PubMed          Journal:  Appl Psychol Meas        ISSN: 0146-6216


  9 in total

1.  Modelling Conditional Dependence Between Response Time and Accuracy.

Authors:  Maria Bolsinova; Paul de Boeck; Jesper Tijmstra
Journal:  Psychometrika       Date:  2016-10-13       Impact factor: 2.500

2.  A generalized linear factor model approach to the hierarchical framework for responses and response times.

Authors:  Dylan Molenaar; Francis Tuerlinckx; Han L J van der Maas
Journal:  Br J Math Stat Psychol       Date:  2014-08-11       Impact factor: 3.380

3.  A simplified version of the maximum information per time unit method in computerized adaptive testing.

Authors:  Ying Cheng; Qi Diao; John T Behrens
Journal:  Behav Res Methods       Date:  2017-04

4.  A test for conditional independence between response time and accuracy.

Authors:  Maria Bolsinova; Gunter Maris
Journal:  Br J Math Stat Psychol       Date:  2015-06-08       Impact factor: 3.380

5.  Sequential Detection of Compromised Items Using Response Times in Computerized Adaptive Testing.

Authors:  Edison M Choe; Jinming Zhang; Hua-Hua Chang
Journal:  Psychometrika       Date:  2017-11-22       Impact factor: 2.500

6.  A Generalized Speed-Accuracy Response Model for Dichotomous Items.

Authors:  Peter W van Rijn; Usama S Ali
Journal:  Psychometrika       Date:  2017-11-21       Impact factor: 2.500

7.  A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers.

Authors:  R H Klein Entink; J-P Fox; W J van der Linden
Journal:  Psychometrika       Date:  2008-08-23       Impact factor: 2.500

8.  Conditional Dependence between Response Time and Accuracy: An Overview of its Possible Sources and Directions for Distinguishing between Them.

Authors:  Maria Bolsinova; Jesper Tijmstra; Dylan Molenaar; Paul De Boeck
Journal:  Front Psychol       Date:  2017-02-16

9.  An Overview of Models for Response Times and Processes in Cognitive Tests.

Authors:  Paul De Boeck; Minjeong Jeon
Journal:  Front Psychol       Date:  2019-02-06
  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.