| Literature DB >> 30061802 |
Jamshid Jamali1,2, Seyyed Mohammad Taghi Ayatollahi3, Peyman Jafari3.
Abstract
INTRODUCTION: In recent years, Multiple Indicators Multiple Causes (MIMIC) model has been widely used to assess measurement in variance, called Differential Item Functioning (DIF) analyses, in psychological and medical studies. AIM: This simulation study aimed at assessing the effect of sample size, scale length, and magnitude of the uniform-DIF on detecting uniform-DIF with the MIMIC model when it has cross-loading in multidimensional scales.Entities:
Keywords: Monte Carlo Method; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
Year: 2018 PMID: 30061802 PMCID: PMC6029923 DOI: 10.5455/msm.2018.30.121-126
Source DB: PubMed Journal: Mater Sociomed ISSN: 1512-7680
Figure 1.A MIMIC model used to detect uniform-DIF in this study
Evaluation the impact of cross-loading on uniform DIF detection in MIMIC model in sample size 100. ρ: Correlation coefficient between the two dimensions; r: Cross-loading; MIMIC: Multiple Indicators Multiple Causes, DIF: Differential Item Functioning; CP: Coverage Probability; CR: Convergence Rate; RMSEA: Root Mean Squared Error of Approximate; SRMR: Standardized Root Mean Squared Residual; CFI: Comparative Fit Index; TLI: Tucker-Lewis Index
| scale length | 5-item scale | 10-item scale | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| performance of the MIMIC model | Goodness of Fit | performance of the MIMIC model | Goodness of Fit | ||||||||||||||
| Condition | magnitude of DIF | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR |
| ρ=0 r=0 | small | 0.326 | -0.025 | 0.969 | 76.9 | 0.045 | 0.969 | 0.959 | 0.044 | 0.430 | 0.01 | 0.972 | 88.6 | 0.032 | 0.972 | 0.969 | 0.048 |
| medium | 0.748 | -0.017 | 0.978 | 78.5 | 0.043 | 0.972 | 1.002 | 0.043 | 0.857 | 0.025 | 0.962 | 86.8 | 0.031 | 0.973 | 0.997 | 0.049 | |
| large | 0.898 | 0.015 | 0.968 | 78.3 | 0.044 | 0.971 | 0.962 | 0.043 | 0.960 | 0.015 | 0.950 | 87.5 | 0.031 | 0.975 | 0.972 | 0.049 | |
| ρ=0 r=0.61 | small | 0.145 | 0.021 | 0.931 | 84.1 | 0.044 | 0.973 | 0.963 | 0.043 | 0.194 | -0.084 | 0.894 | 91.6 | 0.032 | 0.974 | 0.971 | 0.049 |
| medium | 0.573 | 0.011 | 0.935 | 83.2 | 0.041 | 0.975 | 0.966 | 0.042 | 0.709 | -0.038 | 0.875 | 89.6 | 0.032 | 0.974 | 0.971 | 0.048 | |
| large | 0.864 | -0.011 | 0.928 | 79.2 | 0.044 | 0.974 | 0.966 | 0.042 | 0.939 | -0.098 | 0.878 | 90.1 | 0.032 | 0.975 | 0.972 | 0.049 | |
| ρ=0.25 r=0.61 | small | 0.14 | 0.004 | 0.924 | 88.6 | 0.043 | 0.974 | 0.965 | 0.041 | 0.186 | -0.087 | 0.865 | 94.4 | 0.031 | 0.975 | 0.972 | 0.047 |
| medium | 0.582 | -0.150 | 0.903 | 86.6 | 0.042 | 0.976 | 0.967 | 0.042 | 0.727 | -0.086 | 0.854 | 95.2 | 0.032 | 0.975 | 0.972 | 0.047 | |
| large | 0.897 | -0.093 | 0.902 | 87.6 | 0.044 | 0.974 | 0.965 | 0.042 | 0.954 | -0.059 | 0.858 | 95.3 | 0.032 | 0.975 | 0.972 | 0.048 | |
| ρ=0.5 r=0.61 | small | 0.141 | -0.077 | 0.885 | 92.5 | 0.042 | 0.978 | 0.97 | 0.04 | 0.170 | -0.111 | 0.850 | 98.2 | 0.031 | 0.976 | 0.973 | 0.045 |
| medium | 0.604 | -0.010 | 0.882 | 91.5 | 0.042 | 0.976 | 0.968 | 0.041 | 0.745 | -0.086 | 0.829 | 98.2 | 0.031 | 0.977 | 0.974 | 0.045 | |
| large | 0.93 | -0.098 | 0.875 | 91.9 | 0.043 | 0.978 | 0.971 | 0.041 | 0.969 | -0.094 | 0.840 | 98.2 | 0.031 | 0.976 | 0.973 | 0.046 | |
| ρ=0.75 r=0.61 | small | 0.126 | -0.114 | 0.873 | 93.0 | 0.042 | 0.979 | 0.972 | 0.039 | 0.179 | -0.112 | 0.826 | 98.2 | 0.03 | 0.979 | 0.976 | 0.042 |
| medium | 0.646 | -0.108 | 0.859 | 92.2 | 0.043 | 0.979 | 0.972 | 0.039 | 0.748 | -0.116 | 0.813 | 98.9 | 0.031 | 0.979 | 0.976 | 0.043 | |
| large | 0.94 | -0.146 | 0.859 | 93.4 | 0.041 | 0.981 | 0.974 | 0.039 | 0.983 | -0.092 | 0.824 | 98.8 | 0.030 | 0.979 | 0.976 | 0.043 | |
Evaluation the impact of cross-loading on uniform DIF detection in MIMIC model in sample size 500. ρ: Correlation coefficient between the two dimensions; r: Cross-loading; MIMIC: Multiple Indicators Multiple Causes, DIF: Differential Item Functioning; CP: Coverage Probability; CR: Convergence Rate; RMSEA: Root Mean Squared Error of Approximate; SRMR: Standardized Root Mean Squared Residual; CFI: Comparative Fit Index; TLI: Tucker-Lewis Inde
| scale length | 5-item scale | 10-item scale | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| performance of the MIMIC model | Goodness of Fit | performance of the MIMIC model | Goodness of Fit | ||||||||||||||
| Condition | magnitude of DIF | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR |
| ρ=0 r=0 | small | 0.588 | 0.072 | 0.973 | 67.8 | 0.020 | 0.994 | 0.992 | 0.018 | 0.682 | 0.014 | 0.935 | 73.8 | 0.013 | 0.996 | 0.995 | 0.020 |
| medium | 0.823 | 0.053 | 0.975 | 67.2 | 0.018 | 0.995 | 1.001 | 0.018 | 0.898 | 0.036 | 0.943 | 75.4 | 0.013 | 0.996 | 1.000 | 0.020 | |
| large | 0.875 | 0.077 | 0.988 | 68.7 | 0.019 | 0.995 | 0.993 | 0.019 | 0.928 | 0.025 | 0.951 | 72.0 | 0.013 | 0.996 | 0.995 | 0.020 | |
| ρ=0 r=0.61 | small | 0.43 | 0.077 | 0.872 | 72.5 | 0.019 | 0.995 | 0.993 | 0.018 | 0.490 | -0.074 | 0.700 | 82.2 | 0.013 | 0.996 | 0.995 | 0.020 |
| medium | 0.803 | -0.015 | 0.895 | 72.6 | 0.019 | 0.995 | 0.993 | 0.018 | 0.865 | 0.027 | 0.772 | 81.2 | 0.013 | 0.996 | 0.995 | 0.020 | |
| large | 0.886 | 0.017 | 0.909 | 71.7 | 0.019 | 0.995 | 0.993 | 0.018 | 0.924 | 0.036 | 0.834 | 77.6 | 0.013 | 0.996 | 0.995 | 0.020 | |
| ρ=0.25 r=0.61 | small | 0.444 | 0.100 | 0.798 | 78.9 | 0.019 | 0.995 | 0.993 | 0.018 | 0.495 | -0.122 | 0.599 | 89.5 | 0.012 | 0.996 | 0.996 | 0.020 |
| medium | 0.831 | -0.033 | 0.797 | 79.7 | 0.019 | 0.995 | 0.993 | 0.018 | 0.900 | -0.079 | 0.693 | 87.9 | 0.013 | 0.996 | 0.995 | 0.020 | |
| large | 0.927 | -0.034 | 0.836 | 80.6 | 0.019 | 0.995 | 0.993 | 0.018 | 0.943 | -0.061 | 0.722 | 87.1 | 0.012 | 0.996 | 0.996 | 0.020 | |
| ρ=0.5 r=0.61 | small | 0.446 | 0.026 | 0.685 | 87.4 | 0.018 | 0.996 | 0.994 | 0.018 | 0.494 | -0.158 | 0.515 | 93.6 | 0.012 | 0.996 | 0.996 | 0.019 |
| medium | 0.878 | -0.020 | 0.672 | 88.2 | 0.018 | 0.996 | 0.994 | 0.018 | 0.919 | -0.060 | 0.585 | 94.5 | 0.012 | 0.996 | 0.996 | 0.020 | |
| large | 0.955 | -0.078 | 0.737 | 87.0 | 0.019 | 0.996 | 0.994 | 0.018 | 0.951 | -0.044 | 0.637 | 95.7 | 0.012 | 0.996 | 0.996 | 0.020 | |
| ρ=0.75 r=0.61 | small | 0.380 | -0.119 | 0.511 | 95.2 | 0.018 | 0.996 | 0.995 | 0.017 | 0.502 | -0.100 | 0.488 | 97.8 | 0.012 | 0.997 | 0.996 | 0.018 |
| medium | 0.906 | -0.009 | 0.564 | 95.4 | 0.017 | 0.997 | 0.995 | 0.017 | 0.948 | -0.121 | 0.556 | 97.9 | 0.012 | 0.997 | 0.996 | 0.019 | |
| large | 0.956 | -0.065 | 0.612 | 95.8 | 0.017 | 0.997 | 0.995 | 0.017 | 0.980 | -0.091 | 0.601 | 99.0 | 0.012 | 0.997 | 0.997 | 0.019 | |
Evaluation the impact of cross-loading on uniform DIF detection in MIMIC model in sample size 250. ρ: Correlation coefficient between the two dimensions; r: Cross-loading; MIMIC: Multiple Indicators Multiple Causes, DIF: Differential Item Functioning; CP: Coverage Probability; CR: Convergence Rate; RMSEA: Root Mean Squared Error of Approximate; SRMR: Standardized Root Mean Squared Residual; CFI: Comparative Fit Index; TLI: Tucker-Lewis Index
| scale length | 5-item scale | 10-item scale | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| performance of the MIMIC model | Goodness of Fit | performance of the MIMIC model | Goodness of Fit | ||||||||||||||
| Condition | magnitude of DIF | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR | power | Bias | CP | CR | RMSEA | CFI | TLI | SRMR |
| ρ=0 r=0 | small | 0.534 | 0.060 | 0.961 | 71.6 | 0.028 | 0.988 | 0.984 | 0.027 | 0.665 | 0.023 | 0.945 | 80.5 | 0.019 | 0.991 | 0.990 | 0.030 |
| medium | 0.828 | 0.057 | 0.979 | 72.5 | 0.029 | 0.988 | 1.001 | 0.026 | 0.890 | 0.017 | 0.964 | 80.9 | 0.018 | 0.991 | 1.000 | 0.030 | |
| large | 0.888 | 0.040 | 0.98 | 70.5 | 0.028 | 0.989 | 0.985 | 0.027 | 0.944 | 0.044 | 0.949 | 78.9 | 0.019 | 0.991 | 0.990 | 0.030 | |
| ρ=0 r=0.61 | small | 0.302 | -0.020 | 0.902 | 78.4 | 0.028 | 0.989 | 0.985 | 0.027 | 0.342 | -0.037 | 0.810 | 85.3 | 0.018 | 0.992 | 0.991 | 0.029 |
| medium | 0.772 | -0.009 | 0.911 | 77.6 | 0.028 | 0.989 | 0.985 | 0.026 | 0.849 | -0.055 | 0.824 | 84.6 | 0.018 | 0.991 | 0.990 | 0.030 | |
| large | 0.898 | 0.022 | 0.915 | 74.5 | 0.028 | 0.989 | 0.986 | 0.026 | 0.949 | -0.039 | 0.854 | 84.1 | 0.017 | 0.992 | 0.991 | 0.029 | |
| ρ=0.25 r=0.61 | small | 0.295 | -0.082 | 0.84 | 84.0 | 0.027 | 0.99 | 0.986 | 0.026 | 0.380 | -0.005 | 0.741 | 92.2 | 0.018 | 0.992 | 0.991 | 0.029 |
| medium | 0.811 | -0.059 | 0.834 | 82.7 | 0.027 | 0.99 | 0.986 | 0.026 | 0.881 | -0.140 | 0.789 | 92.5 | 0.018 | 0.992 | 0.991 | 0.029 | |
| large | 0.918 | -0.093 | 0.889 | 82.2 | 0.028 | 0.99 | 0.986 | 0.026 | 0.959 | -0.066 | 0.780 | 92.8 | 0.018 | 0.992 | 0.991 | 0.029 | |
| ρ=0.5 r=0.61 | small | 0.25 | -0.082 | 0.783 | 90.3 | 0.028 | 0.991 | 0.988 | 0.026 | 0.347 | -0.081 | 0.682 | 95.6 | 0.018 | 0.992 | 0.991 | 0.028 |
| medium | 0.831 | -0.085 | 0.742 | 91.2 | 0.026 | 0.991 | 0.988 | 0.025 | 0.915 | -0.097 | 0.737 | 96.6 | 0.017 | 0.993 | 0.992 | 0.028 | |
| large | 0.947 | -0.093 | 0.795 | 92.1 | 0.028 | 0.991 | 0.988 | 0.026 | 0.974 | -0.088 | 0.739 | 97.6 | 0.018 | 0.993 | 0.992 | 0.028 | |
| ρ=0.75 r=0.61 | small | 0.227 | -0.053 | 0.722 | 94.0 | 0.026 | 0.992 | 0.989 | 0.024 | 0.337 | -0.085 | 0.657 | 98.3 | 0.017 | 0.994 | 0.993 | 0.026 |
| medium | 0.864 | -0.076 | 0.722 | 95.1 | 0.026 | 0.992 | 0.99 | 0.024 | 0.927 | -0.095 | 0.704 | 99.0 | 0.017 | 0.993 | 0.992 | 0.027 | |
| large | 0.952 | -0.121 | 0.755 | 93.6 | 0.027 | 0.992 | 0.989 | 0.025 | 0.983 | -0.094 | 0.737 | 99.0 | 0.017 | 0.994 | 0.993 | 0.026 | |