Literature DB >> 34565944

On the Speed Sensitivity Parameter in the Lognormal Model for Response Times and Implications for High-Stakes Measurement Practice.

Benjamin Becker1, Dries Debeer2, Sebastian Weirich1, Frank Goldhammer3,4.   

Abstract

In high-stakes testing, often multiple test forms are used and a common time limit is enforced. Test fairness requires that ability estimates must not depend on the administration of a specific test form. Such a requirement may be violated if speededness differs between test forms. The impact of not taking speed sensitivity into account on the comparability of test forms regarding speededness and ability estimation was investigated. The lognormal measurement model for response times by van der Linden was compared with its extension by Klein Entink, van der Linden, and Fox, which includes a speed sensitivity parameter. An empirical data example was used to show that the extended model can fit the data better than the model without speed sensitivity parameters. A simulation was conducted, which showed that test forms with different average speed sensitivity yielded substantial different ability estimates for slow test takers, especially for test takers with high ability. Therefore, the use of the extended lognormal model for response times is recommended for the calibration of item pools in high-stakes testing situations. Limitations to the proposed approach and further research questions are discussed.
© The Author(s) 2021.

Entities:  

Keywords:  high-stakes assessment; item response theory; speededness; test assembly

Year:  2021        PMID: 34565944      PMCID: PMC8381695          DOI: 10.1177/01466216211008530

Source DB:  PubMed          Journal:  Appl Psychol Meas        ISSN: 0146-6216


  10 in total

1.  A latent trait model for response times on tests employing the proportional hazards model.

Authors:  Jochen Ranger; Tuulia Ortner
Journal:  Br J Math Stat Psychol       Date:  2011-10-19       Impact factor: 3.380

2.  A Bivariate Generalized Linear Item Response Theory Modeling Framework to the Analysis of Responses and Response Times.

Authors:  Dylan Molenaar; Francis Tuerlinckx; Han L J van der Maas
Journal:  Multivariate Behav Res       Date:  2015       Impact factor: 5.923

3.  A Box-Cox normal model for response times.

Authors:  R H Klein Entink; W J van der Linden; J-P Fox
Journal:  Br J Math Stat Psychol       Date:  2009-01-30       Impact factor: 3.380

4.  Using Response Times to Model Not-Reached Items due to Time Limits.

Authors:  Steffi Pohl; Esther Ulitzsch; Matthias von Davier
Journal:  Psychometrika       Date:  2019-05-03       Impact factor: 2.500

5.  Using response time data to reduce testing time in cognitive tests.

Authors:  Maria Bertling; Jonathan P Weeks
Journal:  Psychol Assess       Date:  2017-04-27

6.  Improving precision of ability estimation: Getting more from response times.

Authors:  Maria Bolsinova; Jesper Tijmstra
Journal:  Br J Math Stat Psychol       Date:  2017-06-21       Impact factor: 3.380

7.  Joint Modeling of Ability and Differential Speed Using Responses and Response Times.

Authors:  Jean-Paul Fox; Sukaesi Marianti
Journal:  Multivariate Behav Res       Date:  2016-06-07       Impact factor: 5.923

8.  A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers.

Authors:  R H Klein Entink; J-P Fox; W J van der Linden
Journal:  Psychometrika       Date:  2008-08-23       Impact factor: 2.500

9.  On the Importance of the Speed-Ability Trade-Off When Dealing With Not Reached Items.

Authors:  Jesper Tijmstra; Maria Bolsinova
Journal:  Front Psychol       Date:  2018-06-13

10.  Measuring Ability, Speed, or Both? Challenges, Psychometric Solutions, and What Can Be Gained From Experimental Control.

Authors:  Frank Goldhammer
Journal:  Measurement ( Mahwah N J)       Date:  2015-12-07
  10 in total
  1 in total

1.  Two New Models for Item Preknowledge.

Authors:  Kylie Gorney; James A Wollack
Journal:  Appl Psychol Meas       Date:  2022-06-22
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.