Sarah Lacny1, Todd Wilson1, Fiona Clement1,2, Derek J Roberts3, Peter D Faris4,5, William A Ghali6,2, Deborah A Marshall7,8,9,10,11. 1. Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. 2. O'Brien Institute for Public Health, University of Calgary, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. 3. Departments of Community Health Sciences and Surgery, Cumming School of Medicine, University of Calgary, Foothills Medical Centre, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. 4. Research Priorities and Implementation, Alberta Health Services, Foothills Medical Centre, 1403-29 Street NW, Calgary, AB, T2N 2T9, Canada. 5. Alberta Bone and Joint Health Institute, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. 6. Departments of Medicine and Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. 7. Departments of Medicine and Community Health Sciences, Cumming School of Medicine, University of Calgary, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. damarsha@ucalgary.ca. 8. O'Brien Institute for Public Health, University of Calgary, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. damarsha@ucalgary.ca. 9. Health Research Innovation Centre, Room 3C56, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. damarsha@ucalgary.ca. 10. McCaig Institute for Bone and Joint Health, Calgary, AB, Canada. damarsha@ucalgary.ca. 11. Alberta Bone and Joint Health Institute, 3280 Hospital Drive NW, Calgary, AB, T2N 4Z6, Canada. damarsha@ucalgary.ca.
Abstract
BACKGROUND: Although Kaplan-Meier survival analysis is commonly used to estimate the cumulative incidence of revision after joint arthroplasty, it theoretically overestimates the risk of revision in the presence of competing risks (such as death). Because the magnitude of overestimation is not well documented, the potential associated impact on clinical and policy decision-making remains unknown. QUESTIONS/PURPOSES: We performed a meta-analysis to answer the following questions: (1) To what extent does the Kaplan-Meier method overestimate the cumulative incidence of revision after joint replacement compared with alternative competing-risks methods? (2) Is the extent of overestimation influenced by followup time or rate of competing risks? METHODS: We searched Ovid MEDLINE, EMBASE, BIOSIS Previews, and Web of Science (1946, 1980, 1980, and 1899, respectively, to October 26, 2013) and included article bibliographies for studies comparing estimated cumulative incidence of revision after hip or knee arthroplasty obtained using both Kaplan-Meier and competing-risks methods. We excluded conference abstracts, unpublished studies, or studies using simulated data sets. Two reviewers independently extracted data and evaluated the quality of reporting of the included studies. Among 1160 abstracts identified, six studies were included in our meta-analysis. The principal reason for the steep attrition (1160 to six) was that the initial search was for studies in any clinical area that compared the cumulative incidence estimated using the Kaplan-Meier versus competing-risks methods for any event (not just the cumulative incidence of hip or knee revision); we did this to minimize the likelihood of missing any relevant studies. We calculated risk ratios (RRs) comparing the cumulative incidence estimated using the Kaplan-Meier method with the competing-risks method for each study and used DerSimonian and Laird random effects models to pool these RRs. Heterogeneity was explored using stratified meta-analyses and metaregression. RESULTS: The pooled cumulative incidence of revision after hip or knee arthroplasty obtained using the Kaplan-Meier method was 1.55 times higher (95% confidence interval, 1.43-1.68; p < 0.001) than that obtained using the competing-risks method. Longer followup times and higher proportions of competing risks were not associated with increases in the amount of overestimation of revision risk by the Kaplan-Meier method (all p > 0.10). This may be due to the small number of studies that met the inclusion criteria and conservative variance approximation. CONCLUSIONS: The Kaplan-Meier method overestimates risk of revision after hip or knee arthroplasty in populations where competing risks (such as death) might preclude the occurrence of the event of interest (revision). Competing-risks methods should be used to more accurately estimate the cumulative incidence of revision when the goal is to plan healthcare services and resource allocation for revisions.
BACKGROUND: Although Kaplan-Meier survival analysis is commonly used to estimate the cumulative incidence of revision after joint arthroplasty, it theoretically overestimates the risk of revision in the presence of competing risks (such as death). Because the magnitude of overestimation is not well documented, the potential associated impact on clinical and policy decision-making remains unknown. QUESTIONS/PURPOSES: We performed a meta-analysis to answer the following questions: (1) To what extent does the Kaplan-Meier method overestimate the cumulative incidence of revision after joint replacement compared with alternative competing-risks methods? (2) Is the extent of overestimation influenced by followup time or rate of competing risks? METHODS: We searched Ovid MEDLINE, EMBASE, BIOSIS Previews, and Web of Science (1946, 1980, 1980, and 1899, respectively, to October 26, 2013) and included article bibliographies for studies comparing estimated cumulative incidence of revision after hip or knee arthroplasty obtained using both Kaplan-Meier and competing-risks methods. We excluded conference abstracts, unpublished studies, or studies using simulated data sets. Two reviewers independently extracted data and evaluated the quality of reporting of the included studies. Among 1160 abstracts identified, six studies were included in our meta-analysis. The principal reason for the steep attrition (1160 to six) was that the initial search was for studies in any clinical area that compared the cumulative incidence estimated using the Kaplan-Meier versus competing-risks methods for any event (not just the cumulative incidence of hip or knee revision); we did this to minimize the likelihood of missing any relevant studies. We calculated risk ratios (RRs) comparing the cumulative incidence estimated using the Kaplan-Meier method with the competing-risks method for each study and used DerSimonian and Laird random effects models to pool these RRs. Heterogeneity was explored using stratified meta-analyses and metaregression. RESULTS: The pooled cumulative incidence of revision after hip or knee arthroplasty obtained using the Kaplan-Meier method was 1.55 times higher (95% confidence interval, 1.43-1.68; p < 0.001) than that obtained using the competing-risks method. Longer followup times and higher proportions of competing risks were not associated with increases in the amount of overestimation of revision risk by the Kaplan-Meier method (all p > 0.10). This may be due to the small number of studies that met the inclusion criteria and conservative variance approximation. CONCLUSIONS: The Kaplan-Meier method overestimates risk of revision after hip or knee arthroplasty in populations where competing risks (such as death) might preclude the occurrence of the event of interest (revision). Competing-risks methods should be used to more accurately estimate the cumulative incidence of revision when the goal is to plan healthcare services and resource allocation for revisions.
Authors: Steven M Kurtz; Kevin L Ong; Jordana Schmier; Fionna Mowat; Khaled Saleh; Eva Dybvik; Johan Kärrholm; Göran Garellick; Leif I Havelin; Ove Furnes; Henrik Malchau; Edmund Lau Journal: J Bone Joint Surg Am Date: 2007-10 Impact factor: 5.284
Authors: Víctor Abraira; Alfonso Muriel; José I Emparanza; José I Pijoan; Ana Royuela; María Nieves Plana; Alejandra Cano; Iratxe Urreta; Javier Zamora Journal: J Clin Epidemiol Date: 2013-09-07 Impact factor: 6.437
Authors: M Daniel Wongworawat; Matthew B Dobbs; Mark C Gebhardt; Terence J Gioe; Seth S Leopold; Paul A Manner; Clare M Rimnac; Raphaël Porcher Journal: Clin Orthop Relat Res Date: 2015-02-11 Impact factor: 4.176
Authors: C Theil; J Röder; G Gosheger; N Deventer; R Dieckmann; D Schorn; J Hardes; D Andreou Journal: Clin Orthop Relat Res Date: 2019-12 Impact factor: 4.176
Authors: Marcus R Streit; Daniel Haeussler; Thomas Bruckner; Tanja Proctor; Moritz M Innmann; Christian Merle; Tobias Gotterbarm; Stefan Weiss Journal: Clin Orthop Relat Res Date: 2016-04-29 Impact factor: 4.176
Authors: Taylor M Yong; Emily C Young; Ilda B Molloy; Brian M Fisher; Benjamin J Keeney; Wayne E Moschetti Journal: J Arthroplasty Date: 2019-08-14 Impact factor: 4.757
Authors: Maaike G J Gademan; Liza N Van Steenbergen; Suzanne C Cannegieter; Rob G H H Nelissen; Perla J Marang-Van De Mheen Journal: Acta Orthop Date: 2021-01-22 Impact factor: 3.717
Authors: Alana R Cuthbert; Stephen E Graves; Lynne C Giles; Gary Glonek; Nicole Pratt Journal: Clin Orthop Relat Res Date: 2021-02-01 Impact factor: 4.755