| Literature DB >> 33783617 |
Hendrik-Jan Mijderwijk1, Thomas Beez2, Daniel Hänggi2, Daan Nieboer3.
Abstract
There has been an increasing interest in articles reporting on clinical prediction models in pediatric neurosurgery. Clinical prediction models are mathematical equations that combine patient-related risk factors for the estimation of an individual's risk of an outcome. If used sensibly, these evidence-based tools may help pediatric neurosurgeons in medical decision-making processes. Furthermore, they may help to communicate anticipated future events of diseases to children and their parents and facilitate shared decision-making accordingly. A basic understanding of this methodology is incumbent when developing or applying a prediction model. This paper addresses this methodology tailored to pediatric neurosurgery. For illustration, we use original pediatric data from our institution to illustrate this methodology with a case study. The developed model is however not externally validated, and clinical impact has not been assessed; therefore, the model cannot be recommended for clinical use in its current form.Entities:
Keywords: Clinical prediction modeling; Pediatric neurosurgery; Risk assessment
Mesh:
Year: 2021 PMID: 33783617 PMCID: PMC8084798 DOI: 10.1007/s00381-021-05112-z
Source DB: PubMed Journal: Childs Nerv Syst ISSN: 0256-7040 Impact factor: 1.475
Fig. 1Guideposts (GP) for several steps for the development of clinical prediction models in pediatric neurosurgery. The process of clinical prediction consists of three phases: model development (GP A–D), model validation and/or updating (GP E), and model evaluation by impact studies (GP F). GP A: It is best to select the candidate prognostic variables by subject matter knowledge and thorough literature review. Data curation including coding of variables should be done rigorously. GP B: Be aware of the risk of overfitted prediction models. GP C: At cross-validation, the model development set is divided into subsets. For example, subset a functions as a validation set. In the other subsets (b, c, …, k) the model is refitted with a as validation set. This process is repeated until each of the subsets has served as a validation set. GP D: Adherence to the TRIPOD checklist is recommended, which can be downloaded from https://www.tripod-statement.org/. GP E: Model performance normally decreases at internal and external validation. GP F: Impact studies are considered imperative for clinical uptake. Part of the contents of this figure is based on previous literature reporting on clinical prediction models [5–7]
Description of patient characteristics
| Revision at 6 months | ||
|---|---|---|
| No ( | Yes ( | |
| Gender | ||
| Male ( | 33 (86.8%) | 5 (13.2%) |
| Female ( | 16 (64%)) | 9 (36%) |
| Age (mean, SD) | 7.1 (6.8) | 5.6 (6.4) |
| CSF diversion | ||
| VP-Shunt ( | 25 (80.6%) | 6 (19.4%) |
| ETV ( | 24 (75.0%) | 8 (25%) |
CSF cerebrospinal fluid, ETV endoscopic third ventriculocisternostomy, VP-Shunt ventriculoperitoneal shunt
Multivariable prediction models for revision of CSF diversion at 6 months
| Model 1 | Model 2 | |
|---|---|---|
| Gender ( | 1.42; 4.1 (1.1, 14.8) | 1.51; 4.5 (1.2–16.7) |
| Age ( | −0.05; 0.95 (0.86, 1.05) | −0.08; 0.92 (0.82–1.03) |
| Neurosurgical intervention ( | 0.75; 2.1 (0.5, 8.2) | |
| Intercept | −1.60 | |
| Shrinkage factor (slope) | 0.87 | 0.71 |
| 0.71 | 0.73 | |
| Optimism-corrected | 0.67 | 0.66 |
β regression coefficient, CI confidence interval, CSF cerebrospinal fluid, OR odds ratio
The full regression equation for Model 1:
The full regression equation for Model 2:
Fig. 2Calibration plot for a typical overfitted prediction model: overestimated risks for high-risk patients and underestimated risks for low-risk patients. If such a model calculates a risk of 90% and thereby identifies a child as high-risk, the pediatric neurosurgeon should taken this caveat into account when applying this model in clinical practice. Calibration is the Achilles heel of predictive analytics [18]
The type of the outcome of interest determines the regression method that is used. If the outcome is assessed on a large numerical scale, then the outcome is likely continuous. Patient-reported outcome measures including quality of life questionnaire are typically evaluated by linear regression. For an individual patient, risk prediction may come from Here, Well-known model assumption: additivity of effects on the outcome. If a binary (i.e. “yes” or “no”) outcome, for example, revision of a VP-Shunt, is truly known for all children at a particular time point, absolute risk prediction can be calculated from a transformation of the binary logistic regression function: Here, Well-known model assumption: multiplicative effect on the odds of the outcome. If the outcome of interest is time until an event occurs, Cox survival regression is usually applied. These models consider the time between a starting point such as surgical resection of a brain tumor until death or another endpoint. Patients that are lost to follow-up are censored, making this analysis unique. To predict survival the survival probability of an individual patient (that is, the patient has not experienced the outcome), a transformation of the Cox model—the survival function Well-known model assumption: proportionality of the hazard ratios. |