Gregory R Toci1, Jarred A Bressner2, Carol D Morris2,3, Laura Fayad2,3,4, Adam S Levin2. 1. G. R. Toci, The Johns Hopkins University School of Medicine, Baltimore, MD, USA. 2. J. A. Bressner, C. D. Morris, L. Fayad, A. S. Levin, Department of Orthopaedic Surgery, The Johns Hopkins University, Baltimore, MD, USA. 3. C. D. Morris, L. Fayad, A. S. Levin, Department of Oncology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA. 4. L. Fayad, The Russell H. Morgan Department of Radiology and Radiologic Science, The Johns Hopkins University, Baltimore, MD, USA.
Abstract
BACKGROUND: Stratification of the fracture risk is an important treatment component for patients with multiple myeloma, which is associated with up to an 80% risk of pathologic fracture. The Mirels score, which is commonly used to estimate the fracture risk for patients with osseous lesions, was evaluated in a cohort in which fewer than 15% of lesions were caused by multiple myeloma. The behavior of multiple myeloma lesions often differs from that of lesions caused by metastatic disease, and accurate risk stratification is critical for effective care. To our knowledge, the Mirels score has not been validated specifically for multiple myeloma. QUESTIONS/PURPOSES: Our purpose was: (1) To develop a novel scoring system for the prediction of pathologic fracture in patients with long-bone lesions from multiple myeloma; and (2) to compare the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and receiver operating characteristic (ROC) area under curve (AUC) between the novel scoring system and the Mirels system. METHODS: Between 2003 and 2017, 763 patients at one center with the diagnosis of multiple myeloma were reviewed, of whom 174 presented with long-bone disease involvement. Of those, 5% (nine of 174) were missing data or radiographs at a minimum of 1 year and had not reached an endpoint (fracture or surgery) before that time and were therefore excluded. Many patients have more than one lesion; consequently, we used the largest lesion in each patient, resulting in 163 lesions in as many patients. Ten percent (16 of 163) of these patients eventually developed a fracture and 4% (six of 163) underwent prophylactic stabilization (excluded from analysis because of outcome uncertainty). During the study period, prophylactic stabilization was performed at the discretion of the orthopaedic oncologist. Fifty-one percent (83 of 163) of patients were female, and the mean (± SD) age was 60 ± 10 years at radiographic lesion identification. All lesions were characterized before determining whether the patient underwent pathologic fracture. We identified variables associated with pathologic fracture on univariate analysis. Variables independently significant on logistic regression analysis were used to generate scoring algorithms at varying weights and scoring cutoffs for comparison via ROC curves. We then selected a novel score based on ROC performance, and compared the sensitivity, specificity, PPV, and NPV of that scoring system to that of Mirels score. ROC AUCs were compared after bootstrapping 100,000 iterations. Alpha was set at 0.05. RESULTS: After controlling for potential confounders, such as age, sex, and duration of myeloma diagnosis, we found the following factors were independently associated with the occurrence of pathologic fracture: larger lesion size (area, cm2) (log odds 0.17; p = 0.03), longer lesion latency (years from diagnosis to lesion identification) (log odds 0.25; p = 0.03), presence of pain (relative risk [RR] 2.9; p = 0.04), and metaphyseal location (RR 3.2, compared with epiphyseal or diaphyseal; p = 0.003). These variables were used to formulate a novel scoring system. Compared with the Mirels system, the novel system was more sensitive (69% [95% CI 61 to 76] versus 38% [95% CI 30 to 46]; p < 0.05) but not different in terms of specificity (87% [95% CI 80 to 91] versus 87% [95% CI 81 to 92]; p > 0.05), PPV (37% [95% CI 29 to 45] versus 25% [95% CI 19 to 33]; p > 0.05), NPV (96% [95% CI 91 to 99] versus 92% [95% CI 87 to 96]; p > 0.05), or AUC (0.85 [95% CI 0.74 to 0.92] versus 0.67 [95% CI 0.51 to 0.81]; p > 0.05). CONCLUSION: The novel scoring system was found to be more sensitive than the Mirels system for predicting pathologic fracture in our retrospective cohort of patients with multiple myeloma-related bone disease. Specificity, PPV, NPV, and ROC AUC were not different with the numbers available. Thus, the novel scoring system may serve as a more effective screening tool to determine which patients with multiple myeloma would benefit from further radiologic or orthopaedic evaluation based on a skeletal survey. LEVEL OF EVIDENCE: Level III, diagnostic study.
BACKGROUND: Stratification of the fracture risk is an important treatment component for patients with multiple myeloma, which is associated with up to an 80% risk of pathologic fracture. The Mirels score, which is commonly used to estimate the fracture risk for patients with osseous lesions, was evaluated in a cohort in which fewer than 15% of lesions were caused by multiple myeloma. The behavior of multiple myeloma lesions often differs from that of lesions caused by metastatic disease, and accurate risk stratification is critical for effective care. To our knowledge, the Mirels score has not been validated specifically for multiple myeloma. QUESTIONS/PURPOSES: Our purpose was: (1) To develop a novel scoring system for the prediction of pathologic fracture in patients with long-bone lesions from multiple myeloma; and (2) to compare the sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and receiver operating characteristic (ROC) area under curve (AUC) between the novel scoring system and the Mirels system. METHODS: Between 2003 and 2017, 763 patients at one center with the diagnosis of multiple myeloma were reviewed, of whom 174 presented with long-bone disease involvement. Of those, 5% (nine of 174) were missing data or radiographs at a minimum of 1 year and had not reached an endpoint (fracture or surgery) before that time and were therefore excluded. Many patients have more than one lesion; consequently, we used the largest lesion in each patient, resulting in 163 lesions in as many patients. Ten percent (16 of 163) of these patients eventually developed a fracture and 4% (six of 163) underwent prophylactic stabilization (excluded from analysis because of outcome uncertainty). During the study period, prophylactic stabilization was performed at the discretion of the orthopaedic oncologist. Fifty-one percent (83 of 163) of patients were female, and the mean (± SD) age was 60 ± 10 years at radiographic lesion identification. All lesions were characterized before determining whether the patient underwent pathologic fracture. We identified variables associated with pathologic fracture on univariate analysis. Variables independently significant on logistic regression analysis were used to generate scoring algorithms at varying weights and scoring cutoffs for comparison via ROC curves. We then selected a novel score based on ROC performance, and compared the sensitivity, specificity, PPV, and NPV of that scoring system to that of Mirels score. ROC AUCs were compared after bootstrapping 100,000 iterations. Alpha was set at 0.05. RESULTS: After controlling for potential confounders, such as age, sex, and duration of myeloma diagnosis, we found the following factors were independently associated with the occurrence of pathologic fracture: larger lesion size (area, cm2) (log odds 0.17; p = 0.03), longer lesion latency (years from diagnosis to lesion identification) (log odds 0.25; p = 0.03), presence of pain (relative risk [RR] 2.9; p = 0.04), and metaphyseal location (RR 3.2, compared with epiphyseal or diaphyseal; p = 0.003). These variables were used to formulate a novel scoring system. Compared with the Mirels system, the novel system was more sensitive (69% [95% CI 61 to 76] versus 38% [95% CI 30 to 46]; p < 0.05) but not different in terms of specificity (87% [95% CI 80 to 91] versus 87% [95% CI 81 to 92]; p > 0.05), PPV (37% [95% CI 29 to 45] versus 25% [95% CI 19 to 33]; p > 0.05), NPV (96% [95% CI 91 to 99] versus 92% [95% CI 87 to 96]; p > 0.05), or AUC (0.85 [95% CI 0.74 to 0.92] versus 0.67 [95% CI 0.51 to 0.81]; p > 0.05). CONCLUSION: The novel scoring system was found to be more sensitive than the Mirels system for predicting pathologic fracture in our retrospective cohort of patients with multiple myeloma-related bone disease. Specificity, PPV, NPV, and ROC AUC were not different with the numbers available. Thus, the novel scoring system may serve as a more effective screening tool to determine which patients with multiple myeloma would benefit from further radiologic or orthopaedic evaluation based on a skeletal survey. LEVEL OF EVIDENCE: Level III, diagnostic study.
Authors: L Joseph Melton; Robert A Kyle; Sara J Achenbach; Ann L Oberg; S Vincent Rajkumar Journal: J Bone Miner Res Date: 2004-11-29 Impact factor: 6.741
Authors: Andrew R Evans; John Bottros; William Grant; Benjamin Y Chen; Timothy A Damron Journal: Clin Orthop Relat Res Date: 2008-03-21 Impact factor: 4.176
Authors: William G Ward; Stephanie Holsenbeck; Frederick J Dorey; Jeff Spang; David Howe Journal: Clin Orthop Relat Res Date: 2003-10 Impact factor: 4.176
Authors: Shuling Li; Yi Peng; Eric D Weinhandl; Anne H Blaes; Karynsa Cetin; Victoria M Chia; Scott Stryker; Joseph J Pinzone; John F Acquavella; Thomas J Arneson Journal: Clin Epidemiol Date: 2012-04-10 Impact factor: 4.790