Tyrone G Harrison1,2, Brenda R Hemmelgarn1,3, Matthew T James1,2,4,5, Simon Sawhney6,7, Ngan N Lam1,2,4,5, Shannon M Ruzycki1,2, Todd A Wilson1,2, Paul E Ronksley2,4. 1. Department of Medicine, University of Calgary, Calgary, Alberta, Canada. 2. Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada. 3. Department of Medicine, University of Alberta, Edmonton, Alberta, Canada. 4. O'Brien Institute for Public Health, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada. 5. Libin Cardiovascular Institute, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada. 6. Aberdeen Centre for Health Data Sciences, University of Aberdeen, Aberdeen, Scotland. 7. National Health Service, Grampian, Aberdeen, Scotland.
Abstract
Background: People with kidney failure have high risk of postoperative morbidity and mortality. Although the revised cardiac risk index (RCRI) is used to estimate the risk of major postoperative events, it has not been validated in this population. We aimed to externally validate the RCRI and determine whether updating the model improved predictions for people with kidney failure. Methods: We derived a retrospective, population-based cohort of adults with kidney failure (maintenance dialysis or sustained estimated glomerular filtration rate < 15 mL/min per 1.73 m2) who had surgery in Alberta, Canada between 2005 and 2019. We categorized participants based on RCRI variables and assigned risk estimates of death or major cardiac events, and then estimated predictive performance. We re-estimated the coefficients for each RCRI variable and internally validated the updated model. Net benefit was estimated with decision curve analysis. Results: After 38,541 surgeries, 1204 events (3.1%) occurred. The estimated C-statistic for the original RCRI was 0.64 (95% confidence interval: 0.62, 0.65). Examination of calibration revealed significant risk overestimation. In the re-estimated RCRI model, discrimination was marginally different (C-statistic 0.67 [95% confidence interval: 0.66, 0.69]), though calibration was improved. No net benefit was observed when the data were examined with decision curve analysis, whereas the original RCRI was associated with harm. Conclusions: The RCRI performed poorly in a Canadian kidney failure cohort and significantly overestimated risk, suggesting that RCRI use in similar kidney failure populations should be limited. A re-estimated kidney failure-specific RCRI may be promising but needs external validation. Novel perioperative models for this population are urgently needed.
Background: People with kidney failure have high risk of postoperative morbidity and mortality. Although the revised cardiac risk index (RCRI) is used to estimate the risk of major postoperative events, it has not been validated in this population. We aimed to externally validate the RCRI and determine whether updating the model improved predictions for people with kidney failure. Methods: We derived a retrospective, population-based cohort of adults with kidney failure (maintenance dialysis or sustained estimated glomerular filtration rate < 15 mL/min per 1.73 m2) who had surgery in Alberta, Canada between 2005 and 2019. We categorized participants based on RCRI variables and assigned risk estimates of death or major cardiac events, and then estimated predictive performance. We re-estimated the coefficients for each RCRI variable and internally validated the updated model. Net benefit was estimated with decision curve analysis. Results: After 38,541 surgeries, 1204 events (3.1%) occurred. The estimated C-statistic for the original RCRI was 0.64 (95% confidence interval: 0.62, 0.65). Examination of calibration revealed significant risk overestimation. In the re-estimated RCRI model, discrimination was marginally different (C-statistic 0.67 [95% confidence interval: 0.66, 0.69]), though calibration was improved. No net benefit was observed when the data were examined with decision curve analysis, whereas the original RCRI was associated with harm. Conclusions: The RCRI performed poorly in a Canadian kidney failure cohort and significantly overestimated risk, suggesting that RCRI use in similar kidney failure populations should be limited. A re-estimated kidney failure-specific RCRI may be promising but needs external validation. Novel perioperative models for this population are urgently needed.
Authors: Karl Y Bilimoria; Yaoming Liu; Jennifer L Paruch; Lynn Zhou; Thomas E Kmiecik; Clifford Y Ko; Mark E Cohen Journal: J Am Coll Surg Date: 2013-09-18 Impact factor: 6.113
Authors: Jessica Spence; Yannick LeManach; Matthew TV Chan; C Y Wang; Alben Sigamani; Denis Xavier; Rupert Pearse; Pablo Alonso-Coello; Ignacio Garutti; Sadeesh K Srinathan; Emmanuelle Duceppe; Michael Walsh; Flavia Kessler Borges; German Malaga; Valsa Abraham; Atiya Faruqui; Otavio Berwanger; Bruce M Biccard; Juan Carlos Villar; Daniel I Sessler; Andrea Kurz; Clara K Chow; Carisi A Polanczyk; Wojciech Szczeklik; Gareth Ackland; Garg Amit X; Michael Jacka; Gordon H Guyatt; Robert J Sapsford; Colin Williams; Olga Lucia Cortes; Pierre Coriat; Ameen Patel; Maria Tiboni; Emilie P Belley-Côté; Stephen Yang; Diane Heels-Ansdell; Michael McGillion; Simon Parlow; Matthew Patel; Shirley Pettit; Salim Yusuf; P J Devereaux Journal: CMAJ Date: 2019-07-29 Impact factor: 8.262
Authors: Tyrone G Harrison; Shannon M Ruzycki; Matthew T James; Paul E Ronksley; Kelly B Zarnke; Marcello Tonelli; Braden J Manns; Deirdre McCaughey; Prism Schneider; Elijah Dixon; Rebecca L Hartley; Victoria S Owen; Zhihai Ma; Brenda R Hemmelgarn Journal: Am J Kidney Dis Date: 2020-10-09 Impact factor: 8.860
Authors: Reitze N Rodseth; Bruce M Biccard; Yannick Le Manach; Daniel I Sessler; Giovana A Lurati Buse; Lehana Thabane; Robert C Schutt; Daniel Bolliger; Lucio Cagini; Daniela Cardinale; Carol P W Chong; Rong Chu; Miłosław Cnotliwy; Salvatore Di Somma; René Fahrner; Wen Kwang Lim; Elisabeth Mahla; Ramaswamy Manikandan; Francesco Puma; Wook B Pyun; Milan Radović; Sriram Rajagopalan; Stuart Suttie; Thuvaraha Vanniyasingam; William J van Gaal; Marek Waliszek; P J Devereaux Journal: J Am Coll Cardiol Date: 2013-09-26 Impact factor: 24.094
Authors: Emmanuelle Duceppe; Joel Parlow; Paul MacDonald; Kristin Lyons; Michael McMullen; Sadeesh Srinathan; Michelle Graham; Vikas Tandon; Kim Styles; Amal Bessissow; Daniel I Sessler; Gregory Bryson; P J Devereaux Journal: Can J Cardiol Date: 2016-10-04 Impact factor: 5.223
Authors: Pavel S Roshanov; Daniel I Sessler; Clara K Chow; Amit X Garg; Michael W Walsh; Ngan N Lam; Ainslie M Hildebrand; Bruce M Biccard; Rey R Acedillo; S Danielle MacNeil; Vincent W Lee; Wojciech Szczeklik; Marko Mrkobrada; Lehana Thabane; P J Devereaux Journal: Can J Cardiol Date: 2021-03-23 Impact factor: 5.223
Authors: Brenda R Hemmelgarn; Fiona Clement; Braden J Manns; Scott Klarenbach; Matthew T James; Pietro Ravani; Neesh Pannu; Sofia B Ahmed; Jennifer MacRae; Nairne Scott-Douglas; Kailash Jindal; Robert Quinn; Bruce F Culleton; Natasha Wiebe; Richard Krause; Laurel Thorlacius; Marcello Tonelli Journal: BMC Nephrol Date: 2009-10-19 Impact factor: 2.388