Rachael K Ross1, Tzy-Mey Kuo2, Michael Webster-Clark1, Carmen L Lewis3, Christine E Kistler4, Michele Jonsson Funk1, Jennifer L Lund1. 1. Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA. 2. Lineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, North Carolina, USA. 3. Division of General Internal Medicine, Department of Internal Medicine, University of Colorado, Aurora, Colorado, USA. 4. Division of Geriatric Medicine, Department of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA.
Abstract
BACKGROUND/ OBJECTIVES: A claims-based model predicting 5-year mortality (Lund-Lewis) was developed in a 2008 cohort of North Carolina (NC) Medicare beneficiaries and included indicators of comorbid conditions, frailty, disability, and functional impairment. The objective of this study was to validate the Lund-Lewis model externally within a nationwide sample of Medicare beneficiaries. DESIGN: Retrospective validation study. SETTING: U.S. Medicare population. PARTICIPANTS: From a random sample of Medicare beneficiaries, we created four annual cohorts from 2008 to 2011 of individuals aged 66 and older with an office visit in that year. The annual cohorts ranged from 1.13 to 1.18 million beneficiaries. MEASUREMENTS: The outcome was 5-year all-cause mortality. We assessed clinical indicators in the 12 months before the qualifying office visit and estimated predicted 5-year mortality for each beneficiary in the nationwide sample by applying estimates derived in the original NC cohort. Model performance was assessed by quantifying discrimination, calibration, and reclassification metrics compared with a model fit on a comorbidity score. RESULTS: Across the annual cohorts, 5-year mortality ranged from 24.4% to 25.5%. The model had strong discrimination (C-statistics ranged across cohorts from .823 to .826). Reclassification measures showed improvement over a comorbidity score model for beneficiaries who died but reduced performance among beneficiaries who survived. The calibration slope ranged from .83 to .86; the model generally predicted a higher risk than observed. CONCLUSION: The Lund-Lewis model showed strong and consistent discrimination in a national U.S. Medicare sample, although calibration indicated slight overfitting. Future work should investigate methods for improving model calibration and evaluating performance within specific disease settings.
BACKGROUND/ OBJECTIVES: A claims-based model predicting 5-year mortality (Lund-Lewis) was developed in a 2008 cohort of North Carolina (NC) Medicare beneficiaries and included indicators of comorbid conditions, frailty, disability, and functional impairment. The objective of this study was to validate the Lund-Lewis model externally within a nationwide sample of Medicare beneficiaries. DESIGN: Retrospective validation study. SETTING: U.S. Medicare population. PARTICIPANTS: From a random sample of Medicare beneficiaries, we created four annual cohorts from 2008 to 2011 of individuals aged 66 and older with an office visit in that year. The annual cohorts ranged from 1.13 to 1.18 million beneficiaries. MEASUREMENTS: The outcome was 5-year all-cause mortality. We assessed clinical indicators in the 12 months before the qualifying office visit and estimated predicted 5-year mortality for each beneficiary in the nationwide sample by applying estimates derived in the original NC cohort. Model performance was assessed by quantifying discrimination, calibration, and reclassification metrics compared with a model fit on a comorbidity score. RESULTS: Across the annual cohorts, 5-year mortality ranged from 24.4% to 25.5%. The model had strong discrimination (C-statistics ranged across cohorts from .823 to .826). Reclassification measures showed improvement over a comorbidity score model for beneficiaries who died but reduced performance among beneficiaries who survived. The calibration slope ranged from .83 to .86; the model generally predicted a higher risk than observed. CONCLUSION: The Lund-Lewis model showed strong and consistent discrimination in a national U.S. Medicare sample, although calibration indicated slight overfitting. Future work should investigate methods for improving model calibration and evaluating performance within specific disease settings.
Authors: Elizabeth Chrischilles; Kathleen Schneider; June Wilwert; Gregory Lessman; Brian O'Donnell; Brian Gryzlak; Kara Wright; Robert Wallace Journal: Med Care Date: 2014-03 Impact factor: 2.983
Authors: Jennifer L Lund; Tzy-Mey Kuo; M Alan Brookhart; Anne-Marie Meyer; Alexandra F Dalton; Christine E Kistler; Stephanie B Wheeler; Carmen L Lewis Journal: Pharmacoepidemiol Drug Saf Date: 2019-03-19 Impact factor: 2.890
Authors: Ewout W Steyerberg; Andrew J Vickers; Nancy R Cook; Thomas Gerds; Mithat Gonen; Nancy Obuchowski; Michael J Pencina; Michael W Kattan Journal: Epidemiology Date: 2010-01 Impact factor: 4.822
Authors: Robyn L McClelland; Neal W Jorgensen; Matthew Budoff; Michael J Blaha; Wendy S Post; Richard A Kronmal; Diane E Bild; Steven Shea; Kiang Liu; Karol E Watson; Aaron R Folsom; Amit Khera; Colby Ayers; Amir-Abbas Mahabadi; Nils Lehmann; Karl-Heinz Jöckel; Susanne Moebus; J Jeffrey Carr; Raimund Erbel; Gregory L Burke Journal: J Am Coll Cardiol Date: 2015-10-13 Impact factor: 24.094
Authors: Karel G M Moons; Douglas G Altman; Johannes B Reitsma; John P A Ioannidis; Petra Macaskill; Ewout W Steyerberg; Andrew J Vickers; David F Ransohoff; Gary S Collins Journal: Ann Intern Med Date: 2015-01-06 Impact factor: 25.391
Authors: Jennifer L Lund; Paul R Duberstein; Kah Poh Loh; Nikesha Gilmore; Sandy Plumb; Lianlian Lei; Alexander P Keil; Jessica Y Islam; Laura C Hanson; Jeffrey K Giguere; Victor G Vogel; Brian L Burnette; Supriya G Mohile Journal: J Geriatr Oncol Date: 2021-09-02 Impact factor: 3.599