| Literature DB >> 30411658 |
Michiel Aj Luijten1, Iris Eekhout2, Marie D'Hooghe3, Bernard Mj Uitdehaag4, Lidwine B Mokkink1.
Abstract
BACKGROUND: Assessing arm and hand function of multiple sclerosis (MS) patients is important as impaired functioning may impact daily activities and reduce quality of life.Entities:
Keywords: Arm Function in Multiple Sclerosis Questionnaire; computerized adaptive testing simulations; item response model; multiple sclerosis; psychometrics
Mesh:
Year: 2018 PMID: 30411658 PMCID: PMC6282156 DOI: 10.1177/1352458518808197
Source DB: PubMed Journal: Mult Scler ISSN: 1352-4585 Impact factor: 6.312
Procedure of real-data post hoc CAT simulations in nine steps.
| 1. Check IRT assumptions on the full sample. |
| 2. Randomly divide the data into 10 subsets. |
| 3. Fit a graded response model to the data of all but the current subset and extract the estimated IRT parameters. |
| 4. Use the IRT parameters from step 3 to calculate a full-length estimated theta (θ) of the patients in the current subset using maximum likelihood estimation. |
| 5. Perform CAT simulations based on each patients estimated θ to estimate the θ adaptively, based on the item responses from the patients in the current subset. |
| 6. Compare the adaptively estimated θ with the full-length θ estimates in the current subset. |
| 7. Select optimal test length which results in the greatest similarity and accuracy between the CAT-estimated θ and full-length θ while using a minimum number of items. |
| 8. Repeat steps 2–7 for each subset until all patients have been used in CAT simulations and combine/average the results. |
| 9. Select items based on the selection criteria: discrimination parameters, total information, times selected in CAT simulation, and raw mean. |
CAT: computerized adaptive test; IRT: item response theory.
Patient characteristics (n = 690).
| Age (in years) ( | |
| Mean (SD) | 50.04 (11.96) |
| Min–max | 16–81 |
| MS duration (in years) ( | |
| Mean (SD) | 14.37 (8.03) |
| Min–max | 0–62 |
| Type of MS (%) ( | |
| RR | 57.7 |
| SP | 24.4 |
| PP | 12.6 |
| CIS | 0.3 |
| PR | 0.2 |
| Unknown | 4.8 |
| Gender (%) ( | |
| Male | 36.6 |
| Female | 63.4 |
SD: standard deviation; min: minimum; max: maximum; n: amount of patients; MS: multiple sclerosis; RR: relapsing-remitting; SP: secondary-progressive; PP: primary-progressive; CIS: clinically isolated syndrome; PR: progressive-relapsing.
Means, standard deviations, and estimated item parameters of the AMSQ.
| Item | M | SD | Item parameters | |||||
|---|---|---|---|---|---|---|---|---|
| α | β1 | β2 | β3 | β4 | β5 | |||
| 1. “Write down a short sentence with a pen” | 2.10 | 1.48 | 2.79 | 0.09 | 0.67 | 0.99 | 1.50 | 2.04 |
| 2. “Grasp small objects, for example, a key or ballpoint pen” | 2.00 | 1.25 | 3.28 | −0.01 | 0.62 | 1.16 | 1.82 | 2.63 |
| 3. “Put on a coat” | 1.83 | 1.35 | 4.22 | 0.34 | 0.82 | 1.23 | 1.57 | 1.82 |
| 4. “Tie shoelaces” | 2.25 | 1.73 | 4.54 | 0.11 | 0.55 | 0.87 | 1.12 | 1.29 |
| 5. “Hold a full plate” | 2.24 | 1.61 | 4.08 | −0.01 | 0.50 | 0.90 | 1.22 | 1.47 |
| 6. “Pour from a bottle into a glass” | 2.11 | 1.49 | 4.40 | 0.05 | 0.58 | 1.01 | 1.35 | 1.68 |
| 7: “Turn the pages of a book” | 1.86 | 1.27 | 3.75 | 0.20 | 0.81 | 1.26 | 1.65 | 2.20 |
| 8. “Use a mouse of a computer” | 1.73 | 1.25 | 3.10 | 0.39 | 1.04 | 1.53 | 1.73 | 2.09 |
| 9. “Use a pen or pencil” | 2.02 | 1.43 | 3.74 | 0.11 | 0.69 | 1.11 | 1.48 | 1.84 |
| 10. “Turn a key in a lock” | 1.87 | 1.31 | 4.03 | 0.22 | 0.83 | 1.23 | 1.67 | 1.89 |
| 11. “Cut off a piece of paper with a pair of scissors” | 1.89 | 1.39 | 5.05 | 0.27 | 0.78 | 1.16 | 1.50 | 1.81 |
| 12. “Fasten a seatbelt in a car” | 1.74 | 1.28 | 4.56 | 0.40 | 0.92 | 1.28 | 1.61 | 1.97 |
| 13. “Fasten buttons” | 2.49 | 1.63 | 4.29 | −0.29 | 0.33 | 0.72 | 1.05 | 1.47 |
| 14. “Open a bottle of soft drink” | 2.23 | 1.54 | 3.01 | −0.10 | 0.57 | 0.97 | 1.35 | 1.70 |
| 15. “Take off a sweater or T-shirt” | 1.74 | 1.23 | 4.14 | 0.35 | 0.91 | 1.40 | 1.70 | 2.01 |
| 16. “Pick up coins from a table” | 2.08 | 1.35 | 3.97 | −0.08 | 0.61 | 1.05 | 1.53 | 2.03 |
| 17. “Use a keyboard” | 1.81 | 1.24 | 3.77 | 0.24 | 0.87 | 1.36 | 1.78 | 2.08 |
| 18. “Zip up a coat” | 1.95 | 1.37 | 5.07 | 0.14 | 0.75 | 1.11 | 1.49 | 1.80 |
| 19. “Carry a shopping bag” | 2.50 | 1.71 | 2.67 | −0.24 | 0.40 | 0.80 | 1.14 | 1.46 |
| 20. “Wash your hands” | 1.48 | 1.08 | 4.52 | 0.76 | 1.18 | 1.53 | 1.86 | 2.20 |
| 21. “Cut something with a knife” | 2.05 | 1.52 | 5.01 | 0.18 | 0.64 | 0.99 | 1.32 | 1.62 |
| 22. “Pierce food with a fork” | 1.70 | 1.16 | 4.38 | 0.38 | 0.97 | 1.40 | 1.81 | 2.20 |
| 23. “Dry off your body” | 1.81 | 1.28 | 3.79 | 0.30 | 0.87 | 1.32 | 1.70 | 2.02 |
| 24. “Open a bottle with a screw cap” | 2.30 | 1.54 | ||||||
| 25. “Unbutton your shirt” | 2.31 | 1.56 | 4.35 | −0.15 | 0.44 | 0.83 | 1.23 | 1.62 |
| 26. “Wash the back of your shoulder” | 2.22 | 1.65 | 3.07 | 0.05 | 0.59 | 0.96 | 1.25 | 1.49 |
| 27. “Wash your hair” | 1.89 | 1.51 | 3.67 | 0.37 | 0.89 | 1.14 | 1.37 | 1.62 |
| 28. “Open a bag of crisps” | 1.96 | 1.44 | 3.97 | 0.21 | 0.74 | 1.15 | 1.46 | 1.78 |
| 29. “Bring a full glass or cup to your mouth” | 1.75 | 1.30 | 3.82 | 0.37 | 1.02 | 1.39 | 1.60 | 1.88 |
| 30. “Put toothpaste on a toothbrush” | 1.69 | 1.27 | 4.64 | 0.47 | 1.01 | 1.35 | 1.62 | 1.80 |
| 31. “Tuck a T-shirt/shirt in the back of your trousers using your hand” | 1.84 | 1.39 | 4.45 | 0.36 | 0.85 | 1.17 | 1.50 | 1.80 |
n = 690; M: mean; SD: standard deviation; AMSQ: Arm Function in Multiple Sclerosis Questionnaire.
Missing values have been listwise deleted; α; discrimination parameter, β1–5; threshold parameters.
Figure 1.Number of items plotted against the correlation between short-form and full-length theta.
Figure 2.Number of items plotted against the average SEM value and proportion of patients with an SEM value >0.32 for different number of items used to calculate theta.
Short-form item selection procedure ordered by discrimination parameter.
| Item | α | TI | TS (%) | Raw μ | Rank α | Rank TI | Rank TS | Rank μ |
|---|---|---|---|---|---|---|---|---|
| 18. “Zip up a coat” |
|
|
|
|
|
|
|
|
| 11. “Cut off a piece of paper with a pair of scissors” |
|
|
|
|
|
|
|
|
| 21. “Cut something with a knife” |
|
|
|
|
|
|
|
|
| 30. “Put toothpaste on a toothbrush” |
|
|
|
|
|
|
|
|
| 12. “Fasten a seatbelt in a car” | 4.56 | 316.01 | 2.48 | 1.74 | 5 | 5 | 28 | 25 |
| 4. “Tie shoelaces” |
|
|
|
|
|
|
|
|
| 20. “Wash your hands” |
|
|
|
|
|
|
|
|
| 31. “Tuck a T-shirt/shirt in the back of your trousers using your hand” | 4.45 | 293.10 | 2.48 | 1.84 | 8 | 10 | 29 | 20 |
| 6. “Pour from a bottle into a glass” |
|
|
|
|
|
|
|
|
| 22. “Pierce food with a fork” | 4.38 | 316.46 | 2.61 | 1.70 | 10 | 4 | 17 | 28 |
| 25. “Unbutton your shirt” | 4.35 | 309.79 | 4.75 | 2.31 | 11 | 6 | 3 | 3 |
| 13. “Fasten buttons” |
|
|
|
|
|
|
|
|
| 3. “Put on a coat” | 4.22 | 273.77 | 2.50 | 1.83 | 13 | 14 | 25 | 21 |
| 15. “Take off a sweater or T-shirt” | 4.14 | 278.23 | 2.50 | 1.74 | 14 | 13 | 26 | 26 |
| 5. “Hold a full plate” |
|
|
|
|
|
|
|
|
| 10. “Turn a key in a lock” | 4.03 | 265.37 | 2.57 | 1.87 | 16 | 16 | 21 | 18 |
| 28. “Open a bag of crisps” | 3.97 | 257.50 | 2.57 | 1.96 | 17 | 19 | 22 | 14 |
| 16. “Pick up coins from a table” |
|
|
|
|
|
|
|
|
| 29. “Bring a full glass or cup to your mouth” | 3.82 | 230.89 | 2.52 | 1.75 | 19 | 24 | 24 | 24 |
| 23. “Dry off your body” | 3.79 | 251.39 | 2.52 | 1.81 | 20 | 21 | 23 | 23 |
| 17. “Use a keyboard” | 3.77 | 254.53 | 2.59 | 1.81 | 21 | 20 | 18 | 22 |
| 7. “Turn the pages of a book” | 3.75 | 264.57 | 2.65 | 1.86 | 22 | 17 | 13 | 19 |
| 9. “Use a pen or pencil” | 3.74 | 248.13 | 2.63 | 2.02 | 23 | 22 | 14 | 12 |
| 27. “Wash your hair” | 3.67 | 201.09 | 2.50 | 1.89 | 24 | 25 | 27 | 16 |
| 2. “Grasp small objects, for example a key or ballpoint pen” | 3.28 | 244.27 | 3.42 | 2.00 | 25 | 23 | 7 | 13 |
| 8. “Use a mouse of a computer” | 3.10 | 181.11 | 2.61 | 1.73 | 26 | 26 | 16 | 27 |
| 26. “Wash the back of your shoulder” | 3.07 | 166.54 | 3.03 | 2.22 | 27 | 29 | 9 | 7 |
| 14. “Open a bottle of soft drink” | 3.01 | 181.02 | 3.59 | 2.23 | 28 | 27 | 5 | 6 |
| 1. “Write down a short sentence with a pen” | 2.79 | 169.72 | 2.89 | 2.10 | 29 | 28 | 12 | 9 |
| 19. “Carry a shopping bag” | 2.67 | 146.59 | 4.42 | 2.50 | 30 | 30 | 4 | 1 |
α: discrimination parameter; TI: total information under normal distribution; TS: time selected in CAT simulations; μ: mean. Items in bold were included in the Arm Function in Multiple Sclerosis Questionnaire-Short Form (AMSQ-SF).
Figure 3.Test information curves and standard error of mea-surement for the AMSQ full item bank and AMSQ short-form.
Figure 4.SEM values for the full-length and short-form AMSQ.