G Bertolini1, D Ripamonti, A Cattaneo, G Apolone. 1. Laboratorio di Epidemiologia dell'Assistenza Sanitaria, Istituto di Ricerche Farmacologiche Mario Negri, Milan, Italy.
Abstract
OBJECTIVE: To assess the validity of the Pediatric Risk of Mortality (PRISM) scoring system in accurately predicting the probability of mortality in an Italian intensive care unit (ICU) sample. DESIGN: Prospective, observational, multicenter study. SETTING: Twenty-six Italian ICUs classified into two groups: a) ICUs specifically dedicated to treating pediatric patients; and b) adult ICUs treating children on a regular basis. PATIENTS: Consecutive patients (n = 1,533) <15 yrs of age admitted during 1 yr. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: To assess the performance of the PRISM scoring system, the discrimination and calibration measures were adopted both in the whole population and in 12 preselected subgroups. A good discrimination capability of the scoring system was observed for both the whole population and subgroups (areas under the receiver operating characteristic curves were never <0.82). On the other hand, we documented an unsatisfactory calibration capability in the whole population and in most subgroups (p values of the Hosmer-Lemeshow goodness-of-fit test were <.001 in all but two subgroups). CONCLUSIONS: The analyses suggest that the unsatisfactory calibration of PRISM can be attributed to various reasons. Among those reasons, a poor performance of the system, as well as its sensitivity to factors not connected to clinical ICU performance, seem particularly important. A special caution is needed in adopting a severity of illness scoring system to assess quality of care, particularly in contexts different from the one in which the instrument was originally developed.
OBJECTIVE: To assess the validity of the Pediatric Risk of Mortality (PRISM) scoring system in accurately predicting the probability of mortality in an Italian intensive care unit (ICU) sample. DESIGN: Prospective, observational, multicenter study. SETTING: Twenty-six Italian ICUs classified into two groups: a) ICUs specifically dedicated to treating pediatric patients; and b) adult ICUs treating children on a regular basis. PATIENTS: Consecutive patients (n = 1,533) <15 yrs of age admitted during 1 yr. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: To assess the performance of the PRISM scoring system, the discrimination and calibration measures were adopted both in the whole population and in 12 preselected subgroups. A good discrimination capability of the scoring system was observed for both the whole population and subgroups (areas under the receiver operating characteristic curves were never <0.82). On the other hand, we documented an unsatisfactory calibration capability in the whole population and in most subgroups (p values of the Hosmer-Lemeshow goodness-of-fit test were <.001 in all but two subgroups). CONCLUSIONS: The analyses suggest that the unsatisfactory calibration of PRISM can be attributed to various reasons. Among those reasons, a poor performance of the system, as well as its sensitivity to factors not connected to clinical ICU performance, seem particularly important. A special caution is needed in adopting a severity of illness scoring system to assess quality of care, particularly in contexts different from the one in which the instrument was originally developed.
Authors: Maria Grazia Sacco Casamassima; Jose H Salazar; Dominic Papandria; James Fackler; Kristin Chrouser; Emily F Boss; Fizan Abdullah Journal: Eur J Pediatr Date: 2013-03-23 Impact factor: 3.183
Authors: Stéphane Leteurtre; Francis Leclerc; Jessica Wirth; Odile Noizet; Eric Magnenant; Ahmed Sadik; Catherine Fourier; Robin Cremer Journal: Crit Care Date: 2004-05-21 Impact factor: 9.097