Literature DB >> 35661320

Sequential Generalized Likelihood Ratio Tests for Online Item Monitoring.

Hyeon-Ah Kang1.   

Abstract

The study presents statistical procedures that monitor functioning of items over time. We propose generalized likelihood ratio tests that surveil multiple item parameters and implement with various sampling techniques to perform continuous or intermittent monitoring. The procedures examine stability of item parameters across time and inform compromise as soon as they identify significant parameter shift. The performance of the monitoring procedures was validated using simulated and real-assessment data. The empirical evaluation suggests that the proposed procedures perform adequately well in identifying the parameter drift. They showed satisfactory detection power and gave timely signals while regulating error rates reasonably low. The procedures also showed superior performance when compared with the existent methods. The empirical findings suggest that multivariate parametric monitoring can provide an efficient and powerful control tool for maintaining the quality of items. The procedures allow joint monitoring of multiple item parameters and achieve sufficient power using powerful likelihood-ratio tests. Based on the findings from the empirical experimentation, we suggest some practical strategies for performing online item monitoring.
© 2022. The Author(s) under exclusive licence to The Psychometric Society.

Entities:  

Keywords:  cumulative sum control chart; item parameter drift; online monitoring; response time; sequential generalized likelihood ratio test

Year:  2022        PMID: 35661320     DOI: 10.1007/s11336-022-09871-9

Source DB:  PubMed          Journal:  Psychometrika        ISSN: 0033-3123            Impact factor:   2.500


  1 in total

1.  Compromised Item Detection for Computerized Adaptive Testing.

Authors:  Cheng Liu; Kyung T Han; Jun Li
Journal:  Front Psychol       Date:  2019-04-17
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.