| Literature DB >> 34040828 |
Roger Watson1, Iris J L Egberink2, Lisa Kirke1, Jorge N Tendeiro2, Frank Doyle3.
Abstract
Purpose: Sample size in Mokken scales is mostly studied on simulated data, reflected in the lack of consideration of sample size in most Mokken scaling studies. Recently, [Straat, J. H., van der Ark, L. A., & Sijtsma, K. (2014). Minimum sample size requirements for Mokken scale analysis. Educational and Psychological Measurement, 74, 809-822] provided minimum sample size requirements for Mokken scale analysis based on simulation. Our study uses real data from the Warwick-Edinburgh Mental Well-Being Scale (N = 8463) to assess whether these hold.Entities:
Keywords: Mokken scaling; confidence intervals; item response theory; per element accuracy; sample size; scalability
Year: 2018 PMID: 34040828 PMCID: PMC8114397 DOI: 10.1080/21642850.2018.1505520
Source DB: PubMed Journal: Health Psychol Behav Med ISSN: 2164-2850
Mean and standard deviation of H coefficients and the number of times the lower bound of their 95% confidence intervals was below .30 for the thousand replications per different sample size.
| Item | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Mean | # < .3 | Mean | # < .3 | Mean | # < .3 | Mean | # < .3 | Mean | # < .3 | Mean | # < .3 | |
| 1 | .45 (.11) | 592 | .45 (.05) | 139 | .45 (.03) | 10 | .45 (.03) | 7 | .45 (.03) | 1 | .45 (.02) | 0 |
| 2 | .48 (.10) | 442 | .48 (.04) | 37 | .48 (.03) | 0 | .47 (.03) | 1 | .47 (.03) | 0 | .47 (.02) | 0 |
| 3 | .51 (.09) | 339 | .51 (.04) | 6 | .50 (.03) | 0 | .50 (.03) | 0 | .50 (.02) | 0 | .50 (.02) | 0 |
| 4 | .35 (.12) | 879 | .34 (.05) | 869 | .33 (.04) | 828 | .33 (.03) | 782 | .34 (.03) | 763 | .33 (.03) | 715 |
| 5 | .41 (.10) | 718 | .41 (.05) | 298 | .41 (.03) | 82 | .41 (.03) | 62 | .41 (.03) | 20 | .41 (.02) | 6 |
| 6 | .51 (.09) | 311 | .51 (.04) | 4 | .50 (.03) | 0 | .50 (.03) | 0 | .50 (.02) | 0 | .50 (.02) | 0 |
| 7 | .55 (.09) | 192 | .54 (.04) | 1 | .54 (.03) | 0 | .54 (.02) | 0 | .54 (.02) | 0 | .54 (.02) | 0 |
| 8 | .59 (.07) | 46 | .58 (.03) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 |
| 9 | .48 (.09) | 422 | .47 (.04) | 17 | .47 (.03) | 0 | .47 (.03) | 0 | .47 (.02) | 0 | .47 (.02) | 0 |
| 10 | .59 (.07) | 43 | .58 (.03) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 |
| 11 | .47 (.10) | 509 | .47 (.05) | 62 | .47 (.03) | 3 | .47 (.03) | 0 | .47 (.03) | 0 | .47 (.02) | 0 |
| 12 | .43 (.11) | 658 | .42 (.05) | 250 | .42 (.03) | 27 | .42 (.03) | 15 | .42 (.03) | 3 | .42 (.02) | 0 |
| 13 | .48 (.09) | 450 | .47 (.04) | 16 | .47 (.03) | 0 | .47 (.03) | 0 | .47 (.02) | 0 | .47 (.02) | 0 |
| 14 | .59 (.07) | 55 | .58 (.03) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 | .58 (.02) | 0 |
Note: Standard deviations are between brackets, # < .3 = number of times the lower bound of the 95% CI was below .3, H values are based on TEST for all 14 items, H values for n = 1000 are equal to H values for total sample (n = 7510).
Mean and standard deviation of H coefficients and the number of times the lower bound of their 95% confidence intervals was below .30 for the thousand replications per different sample size.
| Sample size | Mean | SD | # |
|---|---|---|---|
| 50 | .49 | .07 | 173 |
| 250 | .49 | .03 | 0 |
| 500 | .48 | .02 | 0 |
| 600 | .48 | .02 | 0 |
| 750 | .48 | .02 | 0 |
| 1000 | .48 | .02 | 0 |
Note: For total sample (n = 7510), H = .48; 95% CI = .47–.49.
Mean number of times the lower bound of the 95% confidence intervals of H was below 0 and results with regard to PEA (both AISP (left) and GA (right)) for the thousand replications per different sample size (i.e. number of times PEA was smaller than .8, minimal observed PEA value in the 1000 replications, number of times PEA was classified as mediocre, adequate, and excellent).
| Sample size | Mean # 95% CI < 0 | PEA ≤ .8 | Min PEA | # Mediocre | # Adequate | # Excellent |
|---|---|---|---|---|---|---|
| 50 | 18.64 (10.6) | 83/78 | .50 | 164/160 | 319/332 | 434/430 |
| 250 | 0.46 (0.96) | 0/0 | .86 | 2/2 | 233/233 | 765/765 |
| 500 | 0.01 (0.08) | 0/0 | .93 | 0/0 | 178/178 | 822/822 |
| 600 | 0.01 (0.08) | 0/0 | .93 | 0/0 | 155/155 | 845/845 |
| 750 | 0 (0) | 0/0 | .93 | 0/0 | 104/104 | 896/896 |
| 1000 | 0 (0) | 0/0 | .93 | 0/0 | 93/93 | 907/907 |
Note: Due to the total number of WEMWBS items (i.e. 14) , the qualification ‘good’ is never applicable (i.e. 13/14 = .93; which is qualified as ‘adequate’), mediocre: .8 < PEA ≤ .9, adequate: .9 < PEA ≤ .95, excellent: PEA > .99 (due to the total number of items, ‘excellent’ always means PEA = 1).