Chava L Ramspek1, Marie Evans2, Christoph Wanner3, Christiane Drechsler4, Nicholas C Chesnaye5, Maciej Szymczak6, Magdalena Krajewska6, Claudia Torino7, Gaetana Porto7, Samantha Hayward8,9, Fergus Caskey10, Friedo W Dekker11, Kitty J Jager5, Merel van Diepen11. 1. Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands c.l.ramspek@lumc.nl. 2. Division of Renal Medicine, Department of Clinical Science, Intervention and Technology, Karolinska Institute and Karolinska University Hospital, Stockholm, Sweden. 3. Division of Nephrology, University Hospital of Wurzburg, Wurzburg, Germany. 4. Division of Nephrology, Department of Internal Medicine 1, University Hospital Wurzburg, Wurzburg, Germany. 5. Department of Medical Informatics, European Renal Association-European Dialysis and Transplant Association Registry, Amsterdam University Medical Center, University of Amsterdam, Amsterdam Public Health Institute, Amsterdam, The Netherlands. 6. Department of Nephrology and Transplantation Medicine, Wroclaw Medical University, Wroclaw, Poland. 7. Department of Clinical Epidemiology of Renal Diseases and Hypertension, Consiglio Nazionale della Ricerche - Istituto di fisiologia clinica, Reggio Calabria, Italy. 8. Department of Translational Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom. 9. United Kingdom Renal Registry, Bristol, United Kingdom. 10. Departmen of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom. 11. Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands.
Abstract
BACKGROUND: Various prediction models have been developed to predict the risk of kidney failure in patients with CKD. However, guideline-recommended models have yet to be compared head to head, their validation in patients with advanced CKD is lacking, and most do not account for competing risks. METHODS: To externally validate 11 existing models of kidney failure, taking the competing risk of death into account, we included patients with advanced CKD from two large cohorts: the European Quality Study (EQUAL), an ongoing European prospective, multicenter cohort study of older patients with advanced CKD, and the Swedish Renal Registry (SRR), an ongoing registry of nephrology-referred patients with CKD in Sweden. The outcome of the models was kidney failure (defined as RRT-treated ESKD). We assessed model performance with discrimination and calibration. RESULTS: The study included 1580 patients from EQUAL and 13,489 patients from SRR. The average c statistic over the 11 validated models was 0.74 in EQUAL and 0.80 in SRR, compared with 0.89 in previous validations. Most models with longer prediction horizons overestimated the risk of kidney failure considerably. The 5-year Kidney Failure Risk Equation (KFRE) overpredicted risk by 10%-18%. The four- and eight-variable 2-year KFRE and the 4-year Grams model showed excellent calibration and good discrimination in both cohorts. CONCLUSIONS: Some existing models can accurately predict kidney failure in patients with advanced CKD. KFRE performed well for a shorter time frame (2 years), despite not accounting for competing events. Models predicting over a longer time frame (5 years) overestimated risk because of the competing risk of death. The Grams model, which accounts for the latter, is suitable for longer-term predictions (4 years).
BACKGROUND: Various prediction models have been developed to predict the risk of kidney failure in patients with CKD. However, guideline-recommended models have yet to be compared head to head, their validation in patients with advanced CKD is lacking, and most do not account for competing risks. METHODS: To externally validate 11 existing models of kidney failure, taking the competing risk of death into account, we included patients with advanced CKD from two large cohorts: the European Quality Study (EQUAL), an ongoing European prospective, multicenter cohort study of older patients with advanced CKD, and the Swedish Renal Registry (SRR), an ongoing registry of nephrology-referred patients with CKD in Sweden. The outcome of the models was kidney failure (defined as RRT-treated ESKD). We assessed model performance with discrimination and calibration. RESULTS: The study included 1580 patients from EQUAL and 13,489 patients from SRR. The average c statistic over the 11 validated models was 0.74 in EQUAL and 0.80 in SRR, compared with 0.89 in previous validations. Most models with longer prediction horizons overestimated the risk of kidney failure considerably. The 5-year Kidney Failure Risk Equation (KFRE) overpredicted risk by 10%-18%. The four- and eight-variable 2-year KFRE and the 4-year Grams model showed excellent calibration and good discrimination in both cohorts. CONCLUSIONS: Some existing models can accurately predict kidney failure in patients with advanced CKD. KFRE performed well for a shorter time frame (2 years), despite not accounting for competing events. Models predicting over a longer time frame (5 years) overestimated risk because of the competing risk of death. The Grams model, which accounts for the latter, is suitable for longer-term predictions (4 years).
Authors: K J Jager; G Ocak; C Drechsler; F J Caskey; M Evans; M Postorino; F W Dekker; C Wanner Journal: Nephrol Dial Transplant Date: 2012-07-04 Impact factor: 5.992
Authors: Navdeep Tangri; Morgan E Grams; Andrew S Levey; Josef Coresh; Lawrence J Appel; Brad C Astor; Gabriel Chodick; Allan J Collins; Ognjenka Djurdjev; C Raina Elley; Marie Evans; Amit X Garg; Stein I Hallan; Lesley A Inker; Sadayoshi Ito; Sun Ha Jee; Csaba P Kovesdy; Florian Kronenberg; Hiddo J Lambers Heerspink; Angharad Marks; Girish N Nadkarni; Sankar D Navaneethan; Robert G Nelson; Stephanie Titze; Mark J Sarnak; Benedicte Stengel; Mark Woodward; Kunitoshi Iseki Journal: JAMA Date: 2016-01-12 Impact factor: 56.272
Authors: Jane O Schell; Uptal D Patel; Karen E Steinhauser; Natalie Ammarell; James A Tulsky Journal: Am J Kidney Dis Date: 2012-01-04 Impact factor: 8.860
Authors: Thaminda Liyanage; Toshiharu Ninomiya; Vivekanand Jha; Bruce Neal; Halle Marie Patrice; Ikechi Okpechi; Ming-hui Zhao; Jicheng Lv; Amit X Garg; John Knight; Anthony Rodgers; Martin Gallagher; Sradha Kotwal; Alan Cass; Vlado Perkovic Journal: Lancet Date: 2015-03-13 Impact factor: 79.321
Authors: Angharad Marks; Nicholas Fluck; Gordon J Prescott; Lynn Robertson; William G Simpson; William Cairns Smith; Corri Black Journal: Nephrol Dial Transplant Date: 2015-05-05 Impact factor: 5.992
Authors: Morgan E Grams; Yingying Sang; Shoshana H Ballew; Juan Jesus Carrero; Ognjenka Djurdjev; Hiddo J L Heerspink; Kevin Ho; Sadayoshi Ito; Angharad Marks; David Naimark; Danielle M Nash; Sankar D Navaneethan; Mark Sarnak; Benedicte Stengel; Frank L J Visseren; Angela Yee-Moon Wang; Anna Köttgen; Andrew S Levey; Mark Woodward; Kai-Uwe Eckardt; Brenda Hemmelgarn; Josef Coresh Journal: Kidney Int Date: 2018-03-29 Impact factor: 18.998
Authors: Chava L Ramspek; Lucy Teece; Kym I E Snell; Marie Evans; Richard D Riley; Maarten van Smeden; Nan van Geloven; Merel van Diepen Journal: Int J Epidemiol Date: 2022-05-09 Impact factor: 9.685
Authors: Gregory L Hundemer; Navdeep Tangri; Manish M Sood; Edward G Clark; Mark Canney; Cedric Edwards; Christine A White; Matthew J Oliver; Tim Ramsay; Ayub Akbari Journal: Kidney Int Rep Date: 2021-10-08
Authors: Susan J Thanabalasingam; Eduard A Iliescu; Patrick A Norman; Andrew G Day; Ayub Akbari; Gregory L Hundemer; Christine A White Journal: Kidney Med Date: 2022-03-07