Rolf Gedeborg1, Margaret Warner, Li-Hui Chen, Pauline Gulliver, Colin Cryer, Yvonne Robitaille, Robert Bauer, Clotilde Ubeda, Jens Lauritsen, James Harrison, Geoff Henley, John Langley. 1. From the Department of Surgical Sciences, Anesthesiology and Intensive Care (R.G.), and Uppsala Clinical Research Center (R.G.), Uppsala University, Uppsala, Sweden; National Center for Health Statistics (M.W., L.-H.C.), Centers for Disease Control and Prevention, Hyattsville, Maryland; Injury Prevention Research Unit (P.G., C.C., J.L.), University of Otago, Dunedin, New Zealand; Institut national de santé publique du Québec (INSPQ) (Y.R.), Montréal, Québec, Canada; Austrian Road Safety Board (R.B.), Research and Knowledge Management, Vienna, Austria; Programa de Prevención de Lesiones por Causas Externas (C.U.), Instituto Nacional de Epidemiología, Dr "J.H.Jara," ANLIS Malbran, Argentina; Accident Analysis Group (J.L.), Odense University Hospital and IST/Biostatistics University of Southern Denmark, Odense C, Denmark; Research Centre for Injury Studies (J.H., G.H.), Flinders University, Adelaide, Australia.
Abstract
BACKGROUND: The International Statistical Classification of Diseases, 10th Revision (ICD-10)-based Injury Severity Score (ICISS) performs well but requires diagnosis-specific survival probabilities (DSPs), which are empirically derived, for its calculation. The objective was to examine if DSPs based on data pooled from several countries could increase accuracy, precision, utility, and international comparability of DSPs and ICISS. METHODS: Australia, Argentina, Austria, Canada, Denmark, New Zealand, and Sweden provided ICD-10-coded injury hospital discharge data, including in-hospital mortality status. Data from the seven countries were pooled using four different methods to create an international collaborative effort ICISS (ICE-ICISS). The ability of the ICISS to predict mortality using the country-specific DSPs and the pooled DSPs was estimated and compared. RESULTS: The pooled DSPs were based on a total of 3,966,550 observations of injury diagnoses from the seven countries. The proportion of injury diagnoses having at least 100 discharges to calculate the DSP varied from 12% to 48% in the country-specific data set and was 66% in the pooled data set. When compared with using a country's own DSPs for ICISS calculation, the pooled DSPs resulted in somewhat reduced discrimination in predicting mortality (difference in c statistic varied from 0.006 to 0.04). Calibration was generally good when the predicted mortality risk was less than 20%. When Danish and Swedish data were used, ICISS was combined with age and sex in a logistic regression model to predict in-hospital mortality. Including age and sex improved both discrimination and calibration substantially, and the differences from using country-specific or pooled DSPs were minor. CONCLUSION: Pooling data from seven countries generated empirically derived DSPs. These pooled DSPs facilitate international comparisons and enables the use of ICISS in all settings where ICD-10 hospital discharge diagnoses are available. The modest reduction in performance of the ICE-ICISS compared with the country-specific scores is unlikely to outweigh the benefit of internationally comparable Injury Severity Scores possible with pooled data. LEVEL OF EVIDENCE: Prognostic and epidemiological study, level III.
BACKGROUND: The International Statistical Classification of Diseases, 10th Revision (ICD-10)-based Injury Severity Score (ICISS) performs well but requires diagnosis-specific survival probabilities (DSPs), which are empirically derived, for its calculation. The objective was to examine if DSPs based on data pooled from several countries could increase accuracy, precision, utility, and international comparability of DSPs and ICISS. METHODS: Australia, Argentina, Austria, Canada, Denmark, New Zealand, and Sweden provided ICD-10-coded injury hospital discharge data, including in-hospital mortality status. Data from the seven countries were pooled using four different methods to create an international collaborative effort ICISS (ICE-ICISS). The ability of the ICISS to predict mortality using the country-specific DSPs and the pooled DSPs was estimated and compared. RESULTS: The pooled DSPs were based on a total of 3,966,550 observations of injury diagnoses from the seven countries. The proportion of injury diagnoses having at least 100 discharges to calculate the DSP varied from 12% to 48% in the country-specific data set and was 66% in the pooled data set. When compared with using a country's own DSPs for ICISS calculation, the pooled DSPs resulted in somewhat reduced discrimination in predicting mortality (difference in c statistic varied from 0.006 to 0.04). Calibration was generally good when the predicted mortality risk was less than 20%. When Danish and Swedish data were used, ICISS was combined with age and sex in a logistic regression model to predict in-hospital mortality. Including age and sex improved both discrimination and calibration substantially, and the differences from using country-specific or pooled DSPs were minor. CONCLUSION: Pooling data from seven countries generated empirically derived DSPs. These pooled DSPs facilitate international comparisons and enables the use of ICISS in all settings where ICD-10 hospital discharge diagnoses are available. The modest reduction in performance of the ICE-ICISS compared with the country-specific scores is unlikely to outweigh the benefit of internationally comparable Injury Severity Scores possible with pooled data. LEVEL OF EVIDENCE: Prognostic and epidemiological study, level III.
Authors: Lisa N Sharwood; David Whyatt; Bharat P Vaikuntam; Christiana L Cheng; Vanessa K Noonan; Anthony P Joseph; Jonathon Ball; Ralph E Stanford; Mei-Ruu Kok; Samuel R Withers; James W Middleton Journal: BMC Health Serv Res Date: 2021-04-01 Impact factor: 2.655