| Literature DB >> 35507446 |
Robin van Veen1, Luuk Wieske1,2, Ilse Lucke1, Max E Adrichem1, Ingemar S J Merkies3,4, Ivo N van Schaik1,5, Filip Eftimov1.
Abstract
It is unclear whether frequently used cutoff values for outcome measures defining minimal clinically important differences (MCIDs) can accurately identify meaningful deterioration in chronic inflammatory demyelinating polyneuropathy (CIDP). We used data from the immunoglobulin overtreatment in CIDP (IOC) trial, in which 60 clinically stable patients with CIDP were randomized to intravenous immunoglobulin (IVIg) withdrawal or continuation. We calculated change scores of the Inflammatory Rasch-Built Overall Disability Scale (I-RODS), grip strength, and Medical Research Council-sum score (MRC-SS) and classified visits based on a treatment anchor (ie, decision to restart/increase treatment after reaching a predefined early endpoint of deterioration). The variability of scores in patients without deterioration was calculated using the limits of agreement. We defined optimized MCIDs for deterioration and specific combinations of MCIDs from different outcome measures, and subsequently calculated the accuracies of the (combined) MCIDs. Substantial variability was found in scores of the I-RODS, grip strength and MRC-SS in patients without deterioration over time, and most MCIDs were within the limits of the variability observed in patients without deterioration. Some MCID cut-offs were insensitive but highly specific for detecting deterioration, for example, the MCID-SE of -1.96 of the I-RODS and -2 point on the MRC-SS. Others were sensitive, but less specific, for example, -4 centiles of the I-RODS. Some combined MCIDs resulted in high specificities and moderate sensitivities. Our results suggest that clinically important deterioration cannot be distinguished from variability over time with currently used MCIDs on the individual level. Combinations of MCIDs might improve the accuracy of determining deterioration, but this needs validation.Entities:
Keywords: chronic inflammatory demyelinating polyneuropathy; minimum important difference; outcome measures
Mesh:
Substances:
Year: 2022 PMID: 35507446 PMCID: PMC9321849 DOI: 10.1111/jns.12497
Source DB: PubMed Journal: J Peripher Nerv Syst ISSN: 1085-9489 Impact factor: 5.188
Baseline demographic and clinical characteristics at baseline (n = 60 patients)
| Patients with meaningful deterioration during trial according to treatment anchor (n = 24) | Patients without meaningful deterioration during trial according to treatment anchor (n = 36) | |
|---|---|---|
| Sex (n males [%]) | 17/24 (71%) | 25/36 (69%) |
| Age (mean [SD; range]) | 61 years (SD 14, range 30‐86) | 57 years (SD 15, range 21‐81) |
| CIDP phenotype | ||
| Typical | 20/24 (83%) | 27/36 (75%) |
| Atypical | 4/24 (17%) | 9/36 (25%) |
| Asymmetric CIDP | 2/24 (8%) | 4/36 (11%) |
| Pure motor/sensory | 2/24 (8%) | 5/36 (14%) |
| Treatment allocation during trial | ||
| IVIg continuation | 7/24 (29%) | 24/36 (67%) |
| IVIg withdrawal | 17/24 (71%) | 12/36 (33%) |
| Disease duration (median [range]) | 64 months (17‐586) | 49 months (7‐314) |
| Wear off symptoms | 8/24 (33%) | 7/36 (19%) |
| Duration of IVIg treatment | ||
| 6‐12 months | 9/24 (38%) | 19/36 (53%) |
| >12 months | 15/24 (63%) | 17/36 (47%) |
| Previous withdrawal attempts | 12/24 (50%) | 11/36 (31%) |
| IVIg interval (median [range]) | 3 weeks (2‐6) | 3 weeks (2‐6) |
| IVIg dose per infusion (median [range]) | 40 g (10‐80) | 50 g (30‐80) |
| I‐RODS (median [IQR, range]) | ||
| Logits | 3.09 (IQR 1.47‐6.25, range −2.46 to 8.11) | 5.03 (IQR 3.66‐6.25, range −0.61 to 8.11) |
| Centiles | 67 (IQR 56‐88, range 30‐100) | 78 (IQR 71‐88, range 42‐100) |
| MRC‐SS (median [IQR; range]) | 59 (IQR 56‐60, range 38‐60) | 60 (IQR 58‐60, range 51‐60) |
| Grip strength, right hand (mean [SD; range]) | 77 kPa (SD 39; 9‐155) | 83 kPa (SD 25; 42‐135) |
| Grip strength, left hand (mean [SD; range]) | 69 kPa (SD 38; 0‐155) | 82 kPa (SD 27; 40‐135) |
Note: Grip strength was measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 points (normal strength).
Abbreviations: I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; IQR, interquartile range; IVIg, intravenous immunoglobulins; kPa, kilopascal; MRC‐SS, MRC sum score; SD, standard deviation.
Change scores of visits with and without meaningful deterioration according to the treatment anchor for the I‐RODS, grip strength and MRC‐SS (VD + TA and VD − TA, n = 181 visits of 60 patients)
| Category of visit according to treatment anchor | n visits | I‐RODS, centiles (mean change [SD]) | I‐RODS, MCID‐SE (mean change [SD]) | Grip strength, kPa (mean change [SD]) | MRC‐SS, points (median change [IQR]) |
|---|---|---|---|---|---|
| Visits without meaningful deterioration (VD − TA) | 157 visits of 52 patients | 0 (SD 8) | −0.05 (SD 0.97) | −4 (SD 14) | 0 (IQR 0–0) |
| Visits with meaningful deterioration (VD + TA) | 24 visits of 24 patients | −11 (SD 8) | −1.95 (SD 1.30) | −18 (SD 19) | −0.5 (IQR −4 to 0) |
Note: For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; IQR, interquartile range; kPa, kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; SD, standard deviation; VD + TA, visit with meaningful deterioration according to the treatment anchor; VD – TA, visit without meaningful deterioration according to the treatment anchor.
FIGURE 1Change scores of visits with and without meaningful deterioration according to the treatment anchor for the I‐RODS, grip strength and MRC‐SS (VD + TA and VD − TA, n = 181 visits of 60 patients). The dotted and striped lines represent the current MCIDs. The dotted lines represent the following MCIDs: ±4 centiles on the I‐RODS, ±1.96 MCID‐SE on the I‐RODS, ±8 kPa for grip strength, and ±2 points on the MRC‐SS. The striped lines represent the MCIDs of ±14 kPa on grip strength, and ±4 points on the MRC‐SS. For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength). I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa: kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; VD + TA, visit with meaningful deterioration according to the treatment anchor; VD − TA, visit without meaningful deterioration according to the treatment anchor
Change scores of visits with and without meaningful deterioration according to the secondary patient anchor for the I‐RODS, grip strength and MRC‐SS (VD − PA and VD + PA, n = 176 visits of 60 patients)
| Category of visit according to patient anchor | n visits | I‐RODS, centiles (mean change [SD]) | I‐RODS, MCID‐SE (mean change [SD]) | Grip strength, kPa (mean change [SD]) | MRC‐SS, points (median change [IQR]) |
|---|---|---|---|---|---|
| Visits without meaningful deterioration (VD − PA) | 124 visits of 45 patients | 1 (SD 7) | 0.00 (SD 0.95) | −4 (SD 15) | 0.0 (IQR −2 to 0) |
| Visits with meaningful deterioration (VD + PA) | 52 visits of 36 patients | −7 (SD 8) | −1.10 (SD 1.32) | −10 (SD 16) | 0.0 (IQR 0–0) |
Note: For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0‐160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: kPa, kilopascal; IQR, interquartile range; I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; SD, standard deviation; VD + PA, visit with meaningful deterioration according to the patient anchor; VD − PA, visit without meaningful deterioration according to the patient anchor.
Limits of agreement for the I‐RODS, grip strength, and MRC‐SS
| Outcome measure | Mean difference (95% CI) | Lower limit of agreement | Upper limit of agreement |
|---|---|---|---|
| I‐RODS, centiles | −1 (−2, 1) | −14 | 12 |
| I‐RODS, MCID‐SE | −0.14 (−0.39, 0.11) | −2.07 | 1.80 |
| Grip strength, kPa | −4 (−8, 0) | −33 | 25 |
| MRC‐SS, points | −0.1 (−0.3, 0.2) | −2.2 | 2.0 |
Note: Calculations are based on change scores on 157 visits without meaningful deterioration based on the treatment anchor (VD − TA) of 52 patients using intercept‐only multilevel models to allow repeated measurements with the following formula: the mean difference (the fixed intercept of the multilevel model) ± 1.96 * SD (√ [the sum of the within‐patient and between‐patient variance]). These limits of agreement represent the limits of the variability; changes within these limits are not significantly different from changes observed in patients without meaningful deterioration.
For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; IQR, interquartile range; kPa, kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; SD, standard deviation.
MCIDs during visits without meaningful deterioration according to the treatment anchor (VD‐TA, n = 157 visits of 52 patients)
| Outcome measure | MCID cutoff for deterioration | No MCID for deterioration (%; n/N visits of n patients) | MCID deterioration (%; n/N visits of n patients) |
|---|---|---|---|
| Singular MCIDs | |||
| I‐RODS | −4 centiles | 77% (122/157 of 42 patients) | 23% (35/157 visits of 22 patients) |
| −1.96 MCID‐SE | 98% (154/157 of 51 patients) | 2% (3/157 of 3 patients) | |
| Grip strength | −8 kPa | 58% (91/157 of 36 patients) | 42% (66/157 of 30 patients) |
| −14 kPa | 76% (119/157 of 45 patients) | 24% (38/157 of 20 patients) | |
| MRC‐SS | −2 points | 92% (144/157 of 48 patients) | 8% (13/157 of 11 patients) |
| −4 points | 99% (156/157 of 52 patients) | 1% (1/157 of 1 patient) | |
| Combined MCIDs | |||
| I‐RODS and either grip strength or MRC‐SS | −4 centiles and either −8 kPa or −2 points | 92% (144/157 visits of 48 patients) | 8% (13/157 of 10 patients) |
| −4 centiles and either −14 kPa or −2 points | 96% (150/157 of 49 patients) | 4% (7/157 of 6 patients) | |
| I‐RODS or MRC‐SS | −4 centiles or −2 points | 71% (112/157 of 40 patients) | 29% (45/157 of 30 patients) |
| −1.96 MCID‐SE or −2 points | 90% (142/157 of 42 patients) | 10% (15/157 of 13 patients) | |
Note: The table shows the percentages of visits without meaningful deterioration (VD − TA) during which any of the existing MCIDs were reached using change scores between each follow‐up visit and the baseline visit. No MCID for deterioration was reached when the change score was >—the MCID value and the MCID for deterioration was reached when the change score was ≤—the MCID value.
For the combined MCID of “−4 centile on the I‐RODS or −2 points on the MRC‐SS”, patients had to decrease at least 4 centiles or at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. For the combined MCID of the “I‐RODS and either grip strength or MRC‐SS”, patients had to decrease at least the MCID on the I‐RODS and had to decrease at least the MCID on either grip strength or the MRC‐SS.
For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa, kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score.
MCIDs during visits without meaningful deterioration according to the secondary patient anchor (VD − PA, n = 124 visits of 46 patients)
| Outcome measure | MCID cutoff for deterioration | No MCID for deterioration (%; n/N visits of n patients) | MCID deterioration (%; n/N visits of n patients) |
|---|---|---|---|
| Singular MCIDs | |||
| I‐RODS | −4 centiles | 81% (101/124 visits of 38 patients) | 19% (23/124 visits of 15 patients) |
| −1.96 MCID‐SE | 100% (124/124 visits of 46 patients) | 0% (0/124 visits) | |
| Grip strength | −8 kPa | 60% (74/124 visits of 30 patients) | 40% (50/124 visits of 25 patients) |
| −14 kPa | 74% (92/124 visits of 39 patients) | 26% (32/124 visits of 20 patients) | |
| MRC‐SS | −2 points | 94% (116/124 visits of 44 patients) | 6% (8/124 visits of 7 patients) |
| −4 points | 99% (123/124 visits of 45 patients) | 1% (1/124 visit) | |
| Combined MCIDs | |||
| I‐RODS and either grip strength or MRC‐SS | −4 centiles and either −8 kPa or − 2 points | 95% (118/124 visits of 43 patients) | 5% (6/124 visits of 6 patients) |
| −4 centiles and either −14 kPa or − 2 points | 96% (119/124 visits of 43 patients) | 4% (5/124 of patients of 5 patients) | |
| I‐RODS or MRC‐SS | −4 centiles or − 2 points | 77% (95/124 of 38 patients) | 23% (29/124 of 20 patients) |
| −1.96 MCID‐SE or − 2 points | 94% (116/124 of 44 patients) | 6% (8/124 of 7 patients) | |
Note: The table shows the percentages of visits without meaningful deterioration (VD − PA) during which any of the existing MCIDs were reached using change scores between each follow‐up visit and the baseline visit. No MCID for deterioration was reached when the change score was >—the MCID value and the MCID for deterioration was reached when the change score was ≤—the MCID value.
Combinations between outcome measures were made by using an “and” and/or “or” function. For the combined MCID of “−4 centile on the I‐RODS or −2 points on the MRC‐SS”, patients had to decrease at least 4 centiles or at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. For the combination of the “I‐RODS and either grip strength or MRC‐SS”, patients had to decrease at least the MCID on the I‐RODS and had to decrease at least the MCID on either grip strength or the MRC‐SS.
For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: kPa, kilopascal; I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; VD + PA, visit with meaningful deterioration according to the patient anchor; VD − PA, visit without meaningful deterioration according to the patient anchor.
FIGURE 2Sensitivities and specificities of existing MCIDs (full line), combinations of existing MCIDs, and MCIDs optimized (dotted) for deterioration of the I‐RODS, grip strength and MRC‐SS. The MCID values are shown on the y‐axis, which are either existing (full line) or calculated based on our sample (dotted line). The symbol represents either the sensitivity or specificity on the x‐axis and the line the 95% confidence intervals, based on the treatment anchor. The sensitivity constitutes of the percentage of patients in which meaningful deterioration is correctly identified by the MCID of all patients with meaningful deterioration. The specificity constitutes of the percentage of the patients in which the absence of meaningful deterioration is correctly identified by the MCID of all patients without meaningful deterioration. The confidence intervals of the sensitivity and specificity are based on 2000 stratified bootstrap replicates. Combinations between outcome measures were made by using an “and” and/or “or” function. For the combined MCID of “−4 centile on the I‐RODS or −2 points on the MRC‐SS”, patients had to decrease at least 4 centiles or at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. For the combination of the “I‐RODS and either grip strength or MRC‐SS”, patients had to decrease at least the MCID on the I‐RODS and had to decrease at least the MCID on either grip strength or the MRC‐SS. In Table A3, the data are shown in full detail. I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa, kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score
Accuracy of existing MCIDs and MCIDs optimized for deterioration of the I‐RODS, grip strength and MRC‐SS
| Outcome measure | MCID calculation method | MCID cutoff for deterioration | Sensitivity (95% CI) | Specificity (95% CI) | Youden's index |
|---|---|---|---|---|---|
| I‐RODS | Optimized, Youden's index | −3 centiles | 92% (79‐100) | 66% (50‐81) | 0.58 |
| Existing MCID | −4 centiles | 83% (67‐96) | 69% (53‐83) | 0.52 | |
| Optimized, max. Specificity | −8 centiles | 63% (42‐83) | 83% (69‐94) | 0.46 | |
| Optimized, Youden's index | −0.515 MCID‐SE | 96% (79‐100) | 69% (56‐83) | 0.65 | |
| Optimized, max. Specificity | −1.82 MCID‐SE | 63% (42‐79) | 92% (81‐100) | 0.55 | |
| Existing MCID | −1.96 MCID‐SE | 50% (29‐71) | 92% (83‐100) | 0.42 | |
| Grip strength | Existing MCID | −8 kPa | 73% (55‐91) | 55% (39‐72) | 0.28 |
| Existing MCID | −14 kPa | 64% (45‐82) | 78% (64‐92) | 0.42 | |
| Optimized, Youden's index and optimized, max. Specificity | −15 kPa | 64% (45‐82) | 81% (67‐92) | 0.45 | |
| MRC‐SS | Optimized, max. Specificity | NA | ‐ | ‐ | ‐ |
| Existing MCID and Optimized, Youden's index | −2 points | 46% (25‐67) | 94% (86‐100) | 0.40 | |
| Existing MCID | −4 points | 33% (17‐50) | 100% (100‐100) | 0.33 |
Note: The sensitivities and specificities were calculated using the treatment anchor, based on data of the last visit of the RCT. The Youden's index combines the values of the sensitivity and specificity using the following formula: sensitivity + specificity − 1, and ranges from 0 (worst) to 1 (best). For calculation of the MCID based on the maximized specificity, the cutoff with the highest specificity was selected with a minimum sensitivity of 60%.
Abbreviations: CI, confidence intervals; I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa, kilopascal; max., maximized; MCID, minimal clinically important differences; MCID‐SE, individual change score of the I‐RODS divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score.
Not applicable; the lower limit of 60% sensitivity was not associated with deterioration. The cutoff had therefore no clinical meaning and was not shown.
Accuracy of existing MCIDs, combinations of existing MCIDs, and MCIDs optimized for deterioration of the I‐RODS, grip strength and MRC‐SS
| Outcome measure | Treatment anchor | Patient anchor | MCID method | MCID cutoff for deterioration | Treatment anchor | Patient anchor | ||
|---|---|---|---|---|---|---|---|---|
| AUC (95% CI) | AUC (95% CI) | Sensitivity (95% CI) | Specificity (95% CI) | Sensitivity (95% CI) | Specificity (95% CI) | |||
| I‐RODS, centiles | 0.86(0.77‐0.95) | 0.90(0.82‐0.97) | Optimized for deterioration based on Youden's index | −3 centiles | 92% (79‐100) | 66% (50‐81) | 86% (71‐96) | 79% (64‐93) |
| Existing MCID | −4 centiles | 83% (67‐96) | 69% (53‐83) | 79% (64‐93) | 82% (68‐96) | |||
| Optimized for deterioration based on maximized specificity | −8 centiles | 63% (42‐83) | 83% (69‐94) | 61% (43‐79) | 93% (82‐100) | |||
| I‐RODS, MCID‐SE | 0.87(0.78‐0.96) | 0.90(0.83‐0.97) | Optimized for deterioration based on Youden's index | −0.515 MCID‐SE | 96% (79‐100) | 69% (56‐83) | 86% (71‐96) | 82% (68‐96) |
| Optimized for deterioration based on maximized specificity | −1.82 MCID‐SE | 63% (42‐79) | 92% (81‐100) | 57% (39‐75) | 100% (100‐100) | |||
| Existing MCID | −1.96 | 50% (29‐71) | 92% (83‐100) | 46% (29‐64) | 100% (100‐100) | |||
| Grip strength, kPa | 0.72(0.58‐0.86) | 0.65(0.50‐0.79) | Existing MCID | −8 kPa | 73% (55‐91) | 55% (39‐72) | 71% (54‐89) | 57% (39‐75) |
| Existing MCID | −14 kPa | 64% (45‐82) | 78% (64‐92) | 46% (29‐64) | 68 (50‐86) | |||
| Optimized for deterioration based on Youden's index | −15 kPa | 64% (45‐82) | 81% (67‐92) | 46% (29‐64) | 71% (54‐86) | |||
| Optimized for deterioration based on maximized specificity | −15 kPa | |||||||
| MRC‐SS, points | 0.69(0.55‐0.83) | 0.68(0.55‐0.81) | Optimized for deterioration based on maximized specificity | NA | ‐ | ‐ | ‐ | ‐ |
| Existing MCID | −2 points | 46% (25‐67) | 94% (86‐100) | 36% (18‐54) | 93% (82‐100) | |||
| Optimized for deterioration based on Youden's index | −2 points | |||||||
| Existing MCID | −4 points | 33% (17‐50) | 100% (100‐100) | 25% (11‐43) | 96% (89‐100) | |||
| I‐RODS and either grip strength or MRC‐SS | 0.81(0.70‐0.91) | 0.71(0.57‐0.83) | Combined MCID | −4 centiles and either −14 kPa or −2 points | 70% (47‐87) | 92% (78‐98) | 54% (34‐72) | 89% (72‐97) |
| 0.80(0.67‐0.89) | 0.78(0.66‐0.88) | Combined MCID |
−4 centiles and either −8 kPa or −2 points | 74% (52‐90) | 83% (67‐94) | 68% (48‐84) | 89% (72‐98) | |
| I‐RODS or MRC‐SS | 0.80(0.68‐0.89) | 0.75(0.62‐0.86) | Combined MCID | −1.96 MCID‐SE or −2 points | 67% (45‐84) | 89% (74‐97) | 57% (37‐76) | 93% (77‐99) |
| 0.75(0.62‐0.85) | 0.80(0.68‐0.90) | Combined MCID | −4 centile or −2 points | 88% (68‐97) | 67% (49‐81) | 82% (63‐94) | 79% (59‐92) | |
Note: Calculations are based on data of the last visit of the RCT (n = 60 for the treatment anchor and n = 56 for the patient anchor), using ROC analysis and both anchor as reference standards. The MCID for deterioration was reached when the change score was ≤—the MCID value and no MCID for deterioration was reached when the change score was >—the MCID value.
Combinations between outcome measures were made by using an “and” and/or “or” function. For example, for the MCID of “−4 centile on the I‐RODS and −2 points on the MRC‐SS”, patients had to decrease at least 4 centiles as well as at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. This means that a patient that deteriorated at least the MCID of −4 centiles on the I‐RODS, but did not deteriorate at least the MCID of −2 points on the MRC‐SS, was not classified as deteriorated by this combined MCID. For the combined MCID of “‐4 centile on the I‐RODS or ‐2 points on the MRC‐SS”, patients had to decrease at least 4 centiles or at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. For the combination of the “I‐RODS and either grip strength or MRC‐SS”, patients had to decrease at least the MCID on the I‐RODS and had to decrease at least the MCID on either grip strength or the MRC‐SS.
The AUC is a measure of the discriminating potential of the outcome measure at various cutoffs. A higher AUC value indicates that the outcome measure is better at distinguishing between patients with and without meaningful deterioration. The AUC of the combined outcome measure is based on the C‐statistic. The sensitivity constitutes of the percentage of patients in which meaningful deterioration is correctly identified by the MCID of all patients with meaningful deterioration. The specificity constitutes of the percentage of the patients in which the absence of meaningful deterioration is correctly identified by the MCID of all patients without meaningful deterioration. The confidence intervals of the sensitivity and specificity are based on 2000 stratified bootstrap replicates.
The MCID based on Youden's index was selected based on the cutoff with the highest result of the following formula: sensitivity + specificity −1. For calculation of the MCID based on the maximized specificity, the cutoff with the highest specificity was selected with a minimum sensitivity of 60%.
For grip strength, change scores of the hand with the maximum decrease are shown measured using a Martin‐Vigorimeter ranging from 0 to 160 kPa. The MRC‐SS used for analyses ranged from 0 (total paralysis) to 60 (normal strength).
Abbreviations: AUC, area under the curve; CI, confidence intervals; IQR, interquartile range; I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa, kilopascal; MCID, minimal clinically important differences; MCID‐SE, individual change score divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score; SD, standard deviation.
Not applicable: the lower limit of 60% sensitivity was not associated with deterioration. The cutoff had therefore no clinical meaning and was not shown.
Accuracy of combined MCIDs of the I‐RODS, grip strength and MRC‐SS
| Combination of outcome measures | MCID cutoffs for deterioration | Sensitivity (95% CI) | Specificity (95% CI) | Youden's index |
|---|---|---|---|---|
| I‐RODS and grip strength | −1.96 MCID‐SE and −14 kPa | 35% (16‐57) | 100% (90‐100) | 0.35 |
| I‐RODS and MRC‐SS | −1.96 MCID‐SE and −2 points | 29% (13‐51) | 97% (85‐99) | 0.26 |
| I‐RODS and MRC‐SS | −4 centile and −2 points | 42% (22‐63) | 97% (85‐99) | 0.39 |
| I‐RODS and MRC‐SS | −3 centile and −2 points | 42% (22‐63) | 97% (85‐99) | 0.39 |
| I‐RODS and grip strength | −1.96 MCID‐SE and −8 kPa | 35% (16‐57) | 94% (81‐99) | 0.29 |
| I‐RODS and grip strength | −4 centile and −14 kPa | 55% (32‐76) | 94% (81‐99) | 0.49 |
| I‐RODS and grip strength | −3 centile and −15 kPa | 55% (32‐76) | 94% (81‐99) | 0.49 |
| I‐RODS and either grip strength or MRC‐SS | −3 centile and either −15 kPa or −2 points | 70% (47‐87) | 92% (78‐98) | 0.62 |
| I‐RODS and either grip strength or MRC‐SS | −4 centile and either −14 kPa or −2 points | 70% (47‐87) | 92% (78‐98) | 0.62 |
| I‐RODS or MRC‐SS | −1.96 MCID‐SE or −2 points | 67% (45‐84) | 89% (74‐97) | 0.56 |
| I‐RODS and grip strength | −4 centiles and −8 kPa | 59% (36‐79) | 83% (67‐93) | 0.42 |
| I‐RODS and either grip strength or MRC‐SS | −4 centiles and either −8 kPa or −2 points | 74% (52‐90) | 83% (67‐94) | 0.57 |
| I‐RODS or grip strength | −1.96 MCID‐SE or −14 kPa | 78% (56‐84) | 69% (52‐84) | 0.47 |
| I‐RODS or MRC‐SS | −4 centile or −2 points | 88% (68‐97) | 67% (49‐81) | 0.55 |
| I‐RODS or grip strength | −1.96 MCID‐SE or −8 kPa | 87% (66‐97) | 53% (35‐70) | 0.40 |
| I‐RODS or grip strength | −4 centile or −14 kPa | 91% (71‐99) | 53% (35‐70) | 0.45 |
| I‐RODS or grip strength | −3 centile or −15 kPa | 100% (86‐100) | 53% (35‐70) | 0.53 |
| I‐RODS or grip strength | −4 centile or −8 kPa | 96% (79‐100) | 42% (26‐59) | 0.38 |
Note: The gray parts of the table indicate that the sensitivity or specificity is above 60% and the Youden's index above 0.50. The darker areas implicate higher (better) values.
Combinations between outcome measures were made by using an “and” and/or “or” function. For example, for the MCID of “−4 centile on the I‐RODS and −2 points on the MRC‐SS,” patients had to decrease at least 4 centiles as well as at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. This means that a patient that deteriorated at least the MCID of −4 centiles on the I‐RODS, but did not deteriorate at least the MCID of −2 points on the MRC‐SS, was not classified as deteriorated by this combined MCID. For the combined MCID of “−4 centile on the I‐RODS or −2 points on the MRC‐SS,” patients had to decrease at least 4 centiles or at least 2 points on the MRC‐SS to be classified as deteriorated by the combined MCID. For the combination of the “I‐RODS and either grip strength or MRC‐SS,” patients had to decrease at least the MCID on the I‐RODS and had to decrease at least the MCID on either grip strength or the MRC‐SS.
The Youden's index combines the values of the sensitivity and specificity using the following formula: sensitivity + specificity − 1, and ranges from 0 (worst) to 1 (best).
Abbreviations: CI, confidence intervals; I‐RODS, Inflammatory Rasch‐built Overall Disability Scale; kPa, kilopascal; max., maximized; MCID, minimal clinically important differences; MCID‐SE, individual change score of the I‐RODS divided by their corresponding stand error of the difference; MRC‐SS, MRC sum score.
MCID cutoff optimized for deterioration calculated based on this sample.