| Literature DB >> 26303843 |
Machteld Varewyck1, Stijn Vansteelandt1, Marie Eriksson2, Els Goetghebeur1.
Abstract
We evaluate the performance of medical centers based on a continuous or binary patient outcome (e.g., 30-day mortality). Common practice adjusts for differences in patient mix through outcome regression models, which include patient-specific baseline covariates (e.g., age and disease stage) besides center effects. Because a large number of centers may need to be evaluated, the typical model postulates that the effect of a center on outcome is constant over patient characteristics. This may be violated, for example, when some centers are specialized in children or geriatric patients. Including interactions between certain patient characteristics and the many fixed center effects in the model increases the risk for overfitting, however, and could imply a loss of power for detecting centers with deviating mortality. Therefore, we assess how the common practice of ignoring such interactions impacts the bias and precision of directly and indirectly standardized risks. The reassuring conclusion is that the common practice of working with the main effects of a center has minor impact on hospital evaluation, unless some centers actually perform substantially better on a specific group of patients and there is strong confounding through the corresponding patient characteristic. The bias is then driven by an interplay of the relative center size, the overlap between covariate distributions, and the magnitude of the interaction effect. Interestingly, the bias on indirectly standardized risks is smaller than on directly standardized risks. We illustrate our findings by simulation and in an analysis of 30-day mortality on Riksstroke.Entities:
Keywords: Firth correction; causal effects; direct and indirect standardization; misspecified model; quality of care
Mesh:
Year: 2015 PMID: 26303843 PMCID: PMC5049670 DOI: 10.1002/sim.6634
Source DB: PubMed Journal: Stat Med ISSN: 0277-6715 Impact factor: 2.373
Figure 1Extrapolation in the directly and indirectly standardized risk considering two centers (small or large center size). The 30‐day mortality risk is estimated by a model with or without interaction between center and patient's age.
Figure 2Regression line for the data‐generating model (1) and for the working model (8) both with linear link function, considering two centers (center 0 at the bottom and center 1 on top) and a scalar L.
Figure 3Estimated bias and precision for direct and indirect standardization are based on S = 500 simulations. Black dots are used for direct standardization and gray triangles for indirect, full lines are used for models without interactions and dotted lines for models with interactions. (a) Standard normal distribution for L and (b) Beta distribution for L.
Figure 4Center‐specific values for the patient's age and time to hospital (hours) for one imputed dataset. Bubble size is proportional to center size. Center 47 and 54 have more than 1% difference in its estimated potential full population risk when ignoring interactions with time to hospital (MI).
Figure 5The directly or indirectly standardized risk per center, with or without interactions between center and patient's age or time to hospital (grey without and black with interactions), in function of the standard deviation of the center‐specific distribution of patient's age or time to hospital for multiple imputation analysis. Bubble size is proportional to center size and ellipses indicate centers with more than 1% difference in estimated mortality risk.
The difference in estimated standardized risk between the model with and without interactions between center and patient's age or time to hospital, based on complete cases (CC) or multiple imputed data (MI). We report the maximum difference, the average difference (square root of the average of squared differences), and the number of centers for which the difference in standardized risk exceeds 1%.
| Max. difference ( | Average difference ( | No. centers with difference >1 | |||||
|---|---|---|---|---|---|---|---|
| CC | MI | CC | MI | CC | MI | ||
| Direct stand. | Age | 1.31 | 0.63 | 0.26 | 0.14 | 1 | 0 |
| Time to hospital | 1.33 | 2.83 | 0.28 | 0.35 | 2 | 2 | |
| Indirect stand. | Age | 0.22 | 0.24 | 0.05 | 0.04 | 0 | 0 |
| Time to hospital | 0.37 | 0.12 | 0.09 | 0.03 | 0 | 0 | |