Noboru Iwata1, Kenichi Kikuchi2, Yuya Fujihara3. 1. Department of Psychology, Hiroshima International University, 555-36, Kurose-Gakuendai, Higashi-Hiroshima, Hiroshima, 739-2695, Japan. iwatan@he.hirokoku-u.ac.jp. 2. Department of Information Sciences, Toho University, 2-2-1 Miyama, Funabashi, Chiba, 274-8510, Japan. 3. Department of Psychology, Yasuda Women's University, 6-13-1, Yasuhigashi, Asaminami-ku, Hiroshima, Hiroshima, 731-0153, Japan.
Abstract
BACKGROUND: An innovative measurement system using a computerized adaptive testing technique based on the item response theory (CAT) has been expanding to measure mental health status. However, little is known about details in its measurement properties based on the empirical data. Moreover, the response time (RT) data, which are not available by a paper-and-pencil measurement but available by a computerized measurement, would be worth investigating for exploring the response behavior. PURPOSE: We aimed at constructing the CAT to measure depressive symptomatology in a community population and exploring its measurement properties. Also, we examined the relationships between RTs, individual item responses, and depressive levels. METHOD: For constructing the CAT system, responses of 2061 workers and university students to 24 depression scale plus four negatively revised positive affect items were subjected to a polytomous IRT analysis. The stopping rule was set for standard error of estimation < 0.30 or the maximum 15 items displayed. The CAT and non-adaptive computer-based test (CBT) were administered to 209 undergraduates, and 168 of them administered again after 1 week. RESULTS: On average, the CAT was converged by 10.4 items. The θ values estimated by CAT and CBT were highly correlated (r = 0.94 and 0.95 for the 1st and 2nd measurements) and with the traditional scoring procedures (r's > 0.90). The test-retest reliability was at a satisfactory level (r = 0.86). RTs to some items significantly correlated with the θ estimates. The mean RT varied by the item contents and wording, i.e., the RT to positive affect items required additional 2 s or longer than the other subscale items. CONCLUSION: The CAT would be a reliable and practical measurement tool for various purposes including stress check at workplace.
BACKGROUND: An innovative measurement system using a computerized adaptive testing technique based on the item response theory (CAT) has been expanding to measure mental health status. However, little is known about details in its measurement properties based on the empirical data. Moreover, the response time (RT) data, which are not available by a paper-and-pencil measurement but available by a computerized measurement, would be worth investigating for exploring the response behavior. PURPOSE: We aimed at constructing the CAT to measure depressive symptomatology in a community population and exploring its measurement properties. Also, we examined the relationships between RTs, individual item responses, and depressive levels. METHOD: For constructing the CAT system, responses of 2061 workers and university students to 24 depression scale plus four negatively revised positive affect items were subjected to a polytomous IRT analysis. The stopping rule was set for standard error of estimation < 0.30 or the maximum 15 items displayed. The CAT and non-adaptive computer-based test (CBT) were administered to 209 undergraduates, and 168 of them administered again after 1 week. RESULTS: On average, the CAT was converged by 10.4 items. The θ values estimated by CAT and CBT were highly correlated (r = 0.94 and 0.95 for the 1st and 2nd measurements) and with the traditional scoring procedures (r's > 0.90). The test-retest reliability was at a satisfactory level (r = 0.86). RTs to some items significantly correlated with the θ estimates. The mean RT varied by the item contents and wording, i.e., the RT to positive affect items required additional 2 s or longer than the other subscale items. CONCLUSION: The CAT would be a reliable and practical measurement tool for various purposes including stress check at workplace.
Authors: Herbert Fliege; Janine Becker; Otto B Walter; Jakob B Bjorner; Burghard F Klapp; Matthias Rose Journal: Qual Life Res Date: 2005-12 Impact factor: 4.147
Authors: Thomas Forkmann; Maren Boecker; Markus Wirtz; Heide Glaesmer; Elmar Brähler; Christine Norra; Siegfried Gauggel Journal: Health Qual Life Outcomes Date: 2010-09-21 Impact factor: 3.186
Authors: Herbert Fliege; Janine Becker; Otto B Walter; Matthias Rose; Jakob B Bjorner; Burghard F Klapp Journal: Int J Methods Psychiatr Res Date: 2009 Impact factor: 4.035
Authors: Otto B Walter; Janine Becker; Jakob B Bjorner; Herbert Fliege; Burghard F Klapp; Matthias Rose Journal: Qual Life Res Date: 2007-03-07 Impact factor: 4.147