Literature DB >> 34505045

Development of Acute Myocardial Infarction Mortality and Readmission Models for Public Reporting on Hospital Performance in Canada.

Dennis T Ko1,2,3, Tareq Ahmed4, Peter C Austin2,3, Warren J Cantor3,5, Paul Dorian3,6, Michael Goldfarb7, Yanyan Gong4, Michelle M Graham8,9, Jing Gu4, Nathaniel M Hawkins10, Thao Huynh11, Karin H Humphries10,12, Maria Koh2, Yoan Lamarche13, Laurie J Lambert14,15, Patrick R Lawler3,16, Jean-Francois Légaré17,18, Hung Q Ly13, Feng Qiu2, Ata Ur Rehman Quraishi17,19, Derek Y So20,21, Robert C Welsh8,9, Harindra C Wijeysundera1,2,3, Graham Wong10,22, Andrew T Yan3,6, Yana Gurevich4.   

Abstract

BACKGROUND: Given changes in the care and outcomes of acute myocardial infarction (AMI) patients over the past several decades, we sought to develop prediction models that could be used to generate accurate risk-adjusted mortality and readmission outcomes for hospitals in current practice across Canada.
METHODS: A Canadian national expert panel was convened to define appropriate AMI patients for reporting and develop prediction models. Preliminary candidate variable evaluation was conducted using Ontario patients hospitalized with a most responsible diagnosis of AMI from April 1, 2015 to March 31, 2018. National data from the Canadian Institute for Health Information was used to develop AMI prediction models. The main outcomes were 30-day all-cause in-hospital mortality and 30-day urgent all-cause readmission. Discrimination of these models (measured by c-statistics) was compared with that of existing Canadian Institute for Health Information models in the same study cohort.
RESULTS: The AMI mortality model was assessed in 54,240 Ontario AMI patients and 153,523 AMI patients across Canada. We observed a 30-day in-hospital mortality rate of 6.3%, and a 30-day all-cause urgent readmission rate of 10.7% in Canada. The final Canadian AMI mortality model included 12 variables and had a c-statistic of 0.834. For readmission, the model had 13 variables and a c-statistic of 0.679. Discrimination of the new AMI models had higher c-statistics compared with existing models (c-statistic 0.814 for mortality; 0.673 for readmission).
CONCLUSIONS: In this national collaboration, we developed mortality and readmission models that are suitable for profiling performance of hospitals treating AMI patients in Canada.
© 2021 The Authors.

Entities:  

Year:  2021        PMID: 34505045      PMCID: PMC8413230          DOI: 10.1016/j.cjco.2021.04.012

Source DB:  PubMed          Journal:  CJC Open        ISSN: 2589-790X


Acute myocardial infarction (AMI) is one of the most common causes of morbidity and mortality across Canada. Each year, more than 70,000 patients with AMI are admitted to Canadian hospitals. Of these, approximately 5000 patients die within 30 days of hospitalization, and about 10% to 15% are readmitted within 30 days of their initial AMI., Outcomes after AMI in Canadian hospitals have been publicly reported by the Canadian Institute for Health Information (CIHI) for close to 2 decades to identify hospitals with suboptimal outcomes and assist in creating and monitoring quality improvement efforts.4, 5, 6, 7, 8 Accurately profiling hospital performance regarding patient outcomes depends on selecting appropriate patients for reporting, and implementing accurate risk-adjustment models., However, current models are potentially limited, as they were developed almost 2 decades ago., Changes in the management and outcomes of AMI patients that have occurred during this time are substantial enough that changes in the relationship of certain clinical characteristics with AMI outcomes may have occurred., Also, many exclusion criteria that were applied in prior models are no longer appropriate. For example, AMI patients with a prior history of cancer and human immunodeficiency virus (HIV) were excluded in assessments of readmission rates in Canadian hospitals in previous reports. With more patients with cardiovascular disease living with multiple comorbidities, noncardiovascular conditions are no longer criteria for exclusion from other public reports., Recognizing these gaps in knowledge, we assembled a multidisciplinary panel across Canada with expertise in cardiology, cardiac surgery, epidemiology, biostatistics, and other disciplines. This work was undertaken with involvement by the Canadian Cardiovascular Society (CCS) Quality Reporting Steering Committee and is endorsed by the CCS and included representatives of the CCS affiliate societies. The Canadian Institute for Health Information (CIHI) was a key partner in this initiative, given their role in generating hospital public reports across Canada. Our main objective was to develop mortality and readmission models for AMI patients that could be used to generate risk-adjusted mortality and readmission outcomes for hospitals in current practice across Canada.

Methods

Data sources

Multiple administrative databases in Ontario were used to conduct the preliminary analysis that included (i) the Ontario Discharge Abstract Database from CIHI to capture comorbid conditions and hospitalizations; and (ii) the Registered Persons' Database, which contains mortality information in Ontario after hospital discharge. These datasets were linked using unique encoded identifiers and analyzed at ICES (formerly known as the Institute for Clinical Evaluative Sciences) as in previous studies.,, To develop the Canadian models, we used the national Discharge Abstract Database-Hospital Morbidity Database, which includes data from all 10 Canadian provinces and 3 territories that are combined into a single dataset at CIHI. This enabled analysis of the national cohort without the need for pooling of data from each province separately.

AMI cohorts

The AMI study cohort in Ontario included patients aged 18 years and older, who had a most responsible diagnosis (the condition that is responsible for the greatest length of stay) of AMI from April 1, 2015 to March 31, 2018. The diagnosis of AMI was identified by International Classification of Diseases, 10th revision, Canada (ICD-10-CA) codes I21 and I22. The national study population included patients hospitalized for AMI across Canada from April 1, 2015 to March 1, 2016; from April 1, 2016 to March 1, 2017; and from April 1, 2017 to March 1, 2018. The use of 11 months of data in each fiscal year was due to the need for reporting 30-day outcomes. This practice is consistent with CIHI public reporting methodology. Identification of patients by CIHI was primarily from ICD-10-CA codes I21 and I22. A small number of patients were identified according to the Canadian Coding Standards of AMI traditionally established, using a combination of procedure and diagnostic codes to account for the variations in coding practice across the country (Supplemental Table S1).

Modified Delphi process

A modified Delphi technique was used to (i) develop inclusion and exclusion criteria of eligible AMI patients for reporting, and (ii) select candidate variables for mortality and readmission models.17, 18, 19 Potential candidate variables for model development were initially assembled based on clinical knowledge and variables used in existing AMI models.,,20, 21, 22, 23, 24 We did not consider physiological variables (e.g., heart rate or blood pressure), because they were not available in Canadian administrative databases. We also did not include treatment variables during AMI hospitalization, because the main purpose of public reporting is to identify potential care gaps that lead to outcome differences among hospitals. This list of variables was categorized using ICD-10-CA codes for model development. A similar process was previously used by our group to develop quality and outcome indicators of cardiac care in Canada., Our process included several online meetings and a face-to-face meeting for the panel to discuss the potential merits and limitations of each selection, and to reconcile differences.

Outcomes

For the AMI mortality model, 30-day in-hospital mortality was our main outcome of interest, defined as deaths that occurred during any hospitalizations within 30 days after the index AMI hospitalization. For the readmission model, our main outcome was 30-day urgent readmission, defined as an urgent admission within 30 days following discharge from the index AMI hospitalization.

Statistical analysis

After obtaining a list of candidate variables for AMI mortality and readmission models from our national panel, preliminary modeling was done using Ontario data to assess the frequency of the candidate variables, examine the association of each candidate variable with our outcomes, and determine what combination of variables could maximize discrimination abilities of the models., We tested for linearity for continuous variables such as age, evaluated correlation of the candidate variables, and calculated the variance inflation factor to test for collinearity. Due to the large number of models tested with the Ontario data, we reported variables that were initially selected. Using the nationwide data, logistic regression models were used to assess the relationship of each candidate predictor variable with our outcomes of interests. In the national model, we used backward variable elimination to select variables that are significantly (P < 0.05) associated with the outcomes., Discrimination was assessed by calculating the c-statistic, also commonly known as the area under the receiver operating characteristic curve.25, 26, 27, 28 Calibration was assessed qualitatively by plotting the predicted and observed risk across the deciles of predicted risk.25, 26, 27, 28 Multi-collinearity of the variables was assessed using variance inflation factors. Several additional analyses were performed to enhance the robustness of our results. First, we compared the discrimination ability of the mortality model in Ontario, comparing 30-day in-hospital mortality to 30-day mortality with out-of-hospital deaths. This was done to increase our understanding of the potential discrepancies in Canada's public reporting, because all deaths (in-hospital and out-of-hospital) are typically included as outcomes., Second, we also examined the model properties in predicting urgent readmissions vs all readmissions (urgent and non-urgent) in Ontario. Third, we examined the prevalence of candidate comorbidities in Quebec compared with other provinces, because of the difference in how diagnostic codes are categorized. In Quebec, all secondary diagnoses are captured on the hospital discharge summary, which could result in documentation of a higher prevalence of chronic conditions compared to other jurisdictions. Due to these differences, for candidate variables that differed in prevalence in Quebec and other provinces, we examined their association with the main outcomes and created Quebec-specific covariates for variables with a higher prevalence but a lower risk of being an outcome. Finally, we compared the discriminative ability of our developed models against that of models used by the CIHI, using the Ontario data and the national data., The use of Ontario data in this project was authorized under section 45 of Ontario's Personal Health Information Protection Act, which does not require review by a Research Ethics Board. All Ontario analyses were conducted at ICES by using SAS version 9.4 (Cary, NC). The use of national data also does not require review by a Research Ethics Board. All national analyses were conducted at CIHI using SAS Enterprise Guide 7.12 (Cary, NC).

Results

Revised AMI inclusion and exclusion criteria

The panel thoroughly reviewed the existing inclusion and exclusion criteria and reaffirmed the exclusion of patients with non-urgent hospitalizations. Due to frequent transfers of AMI patients between Canadian hospitals, the panel also recommended that hospital records be linked to create a single episode of care for reporting. Additionally, the panel recommended patients be excluded who had in-hospital stays of less than 24 hours (or 1 day) or medical assistance in dying during hospitalization, who were previously included. For mortality outcomes, they reaffirmed that only the first AMI episode during the reporting year was to be considered. Based on the panel recommendation, those with previously excluded conditions (HIV, cancer, and trauma) and those who left the hospital against medical advice are now considered as candidates in the evaluation of AMI readmissions. In addition, although prior reports included all AMI hospitalizations for readmission reporting, we have categorized the first AMI admission as the index case, and the second as an outcome, if a patient was admitted with 2 AMI episodes within 30 days. This approach was needed so that we would not count 2 hospitalizations within 30 days as 2 index events. After 30 days from the index AMI hospitalization, another AMI hospitalization could be considered as an index hospitalization.

AMI mortality model

The construction of the Ontario AMI mortality cohort is detailed in Supplemental Figure S1. There were 76,222 patients hospitalized with a main diagnosis of AMI in Ontario from April 1, 2015 to March 31, 2018. After applying the exclusion criteria, 54,240 were included with a mean age of 68.3 years, and 66% were men. The 30-day in-hospital mortality rate was 6.1%, and the 30-day mortality rate including all deaths within 30 days was 6.7%. The association of the selected characteristics with 30-day mortality in Ontario is shown in Supplemental Table S2. In the Canadian cohort, there were 188,810 hospitalized AMI episodes from April 1, 2015 to March 31, 2018. We first excluded AMI episodes that hospitalized in the last month of the fiscal years (15,550), cardiac procedures performed for AMI but without hospitalization (8884), subsequent episodes (4678), non-urgent hospitalizations (3337), length of stay < 1 day (2829), and missing data. After these exclusions, our final cohort included 153,523 patients (Fig. 1A). The mean age of the included Canadian AMI cohort was 68 years; 66.6% were men; 32.1% had a history of diabetes; 9.9% had an ST-segment elevation myocardial infarction; 2.2% had shock; and 1.4% had cardiac arrest (Table 1). The 30-day in-hospital mortality rate in the national cohort was 6.3%.
Figure 1

Construction of the acute myocardial infarction (AMI) cohorts for mortality and readmission model development in Canada. (A) A total of 153,523 patients were included for Canada AMI mortality model development. (B) A total of 146,513 patients were included for Canada AMI readmission model development. MAID, medical assistance in dying.

Table 1

Characteristics of the variables selected in the Canada AMI mortality model and their association with 30-day in-hospital mortality in multivariate logistic regression analysis

CharacteristicFrequency, %Coefficient estimateOdds ratio95% CI
Demographics
 Age, y
  18-443.7RefRefRef
  45-6436.80.50611.661.28-2.16
  65-7425.21.26873.562.74-4.61
  75-8420.51.97367.205.55-9.32
  ≥ 8513.82.761115.8212.21-20.50
 Men66.6–0.11470.890.85-0.93
Clinical presentation
 Cardiac arrest1.42.29289.908.84-11.09
 STEMI9.90.15661.171.08-1.27
 Shock2.22.717815.1513.95-16.45
Prior comorbidities*
 Diabetes32.1–0.07980.920.87-0.98
 Heart failure11.60.10651.111.02-1.21
  Quebec16.90.23251.261.14-1.39
 Cancer0.70.66121.941.59-2.37
  Quebec4.70.22211.251.07-1.47
 Cerebrovascular disease0.51.08152.952.34-3.73
  Quebec3.50.17941.200.99-1.44
 Renal failure5.90.74022.101.95-2.26
  Quebec21.50.35741.431.31-1.56
 Pneumonia2.80.64091.901.74-2.07
Modified Charlson score
 060.9RefRefRef
 132.00.40011.491.40-1.59
 27.10.78262.191.96-2.45

AMI, acute myocardial infarction; CI, confidence interval; Ref, reference; STEMI, ST-segment elevation myocardial infarction.

Prior comorbidities are defined by pre-admission conditions recorded during the AMI hospitalization.

Modified Charlson index included congestive heart failure, dementia, chronic pulmonary disease, rheumatologic disease, mild liver disease, diabetes with chronic complications, hemiplegia or paraplegia, renal disease, moderate or severe liver disease, autoimmune deficiency syndrome/human immunodeficiency virus (AIDS/HIV), any malignancy (including lymphoma and leukemia), and metastatic solid tumor.

Construction of the acute myocardial infarction (AMI) cohorts for mortality and readmission model development in Canada. (A) A total of 153,523 patients were included for Canada AMI mortality model development. (B) A total of 146,513 patients were included for Canada AMI readmission model development. MAID, medical assistance in dying. Characteristics of the variables selected in the Canada AMI mortality model and their association with 30-day in-hospital mortality in multivariate logistic regression analysis AMI, acute myocardial infarction; CI, confidence interval; Ref, reference; STEMI, ST-segment elevation myocardial infarction. Prior comorbidities are defined by pre-admission conditions recorded during the AMI hospitalization. Modified Charlson index included congestive heart failure, dementia, chronic pulmonary disease, rheumatologic disease, mild liver disease, diabetes with chronic complications, hemiplegia or paraplegia, renal disease, moderate or severe liver disease, autoimmune deficiency syndrome/human immunodeficiency virus (AIDS/HIV), any malignancy (including lymphoma and leukemia), and metastatic solid tumor. The final Canadian AMI mortality model included age, sex, 3 variables related to clinical presentation (cardiac arrest, ST-segment elevation myocardial infarction, shock), 6 comorbidity variables (diabetes, heart failure, prior cancer, cerebrovascular disease, renal failure, and pneumonia), and the modified Charlson comorbidity score (Table 1). Among these variables, the highest odds ratios (ORs) associated with 30-day in-hospital mortality were shock (OR 15.15, 95% confidence interval [CI] 13.95-16.45), and cardiac arrest (OR 9.90, 95% CI 8.84- 11.09). The Canadian AMI mortality model had good discrimination ability, with a c-statistic of 0.834. As shown by the expected vs observed risk deciles in Figure 2A, the model was well calibrated.
Figure 2

Predicted and observed outcome for the Canadian acute myocardial infarction (AMI) mortality and readmission models, by decile of risk. (A) Predicted vs observed rate of events is shown for 30-day in-hospital mortality in the Canada AMI mortality model. (B) Predicted vs observed rate of events is shown for 30-day urgent readmission in the Canada AMI readmission model.

Predicted and observed outcome for the Canadian acute myocardial infarction (AMI) mortality and readmission models, by decile of risk. (A) Predicted vs observed rate of events is shown for 30-day in-hospital mortality in the Canada AMI mortality model. (B) Predicted vs observed rate of events is shown for 30-day urgent readmission in the Canada AMI readmission model.

AMI readmission model

The creation of the Ontario cohort to evaluate AMI readmission models is shown in Supplemental Figure S2. In Ontario, the all-cause readmission rate at 30 days was 12.2%, and among those readmitted, 10.8% had an urgent indication. Supplemental Table S3 shows the characteristics and their associated odds ratios in predicting 30-day readmission. Across Canada, after inclusion and exclusion criteria were applied, there were 146,513 AMI episodes included for the development of the readmission model. This cohort differed from the mortality cohort, in which we excluded patients who did not survive to hospital discharge (7675 patients) and 1802 patients who were admitted with AMI within 30 days of each other (second episode excluded). The 30-day readmission rate for an urgent indication, across Canada, was 10.7%. For the final readmission model, we selected 2 demographic variables (age, sex), 2 variables related to clinical presentation (ST-segment elevation myocardial infarction, shock), 7 comorbidity variables (diabetes, heart failure, prior cancer, renal failure, chronic obstructive pulmonary disease, dementia, and cardiac arrhythmia), modified Charlson comorbidity score, and having a hospitalization to an acute care hospital within 6 months (Table 2). Older age group (≥85 years) had the highest odds ratio (OR 2.27, 95% CI 2.01-2.55) in predicting 30-day readmission. None of the other factors had an odds ratio > 2. The national readmission model had a c-statistic at 0.679, and good calibration, as shown in Figure 2B.
Table 2

Characteristics of variables selected in the Canada AMI readmission model and their association with 30-day urgent readmission in multivariate logistic regression analysis

CharacteristicFrequency, %Coefficient estimateOdds ratio95% CI
Demographics
 Age, y
  18-443.8RefRefRef
  45-6438.10.03071.030.92-1.16
  65-7425.60.32691.391.24-1.56
  75-8420.00.56331.761.57-1.97
  ≥ 8512.40.81822.272.01-2.55
 Men67.2–0.15670.860.83-0.89
Clinical presentation
 STEMI9.7–0.09310.910.85-0.97
 Shock1.10.36351.441.26-1.65
Prior comorbidities*
 Diabetes32.10.13041.141.09-1.20
 Heart failure11.70.14751.161.09-1.23
 Cancer1.50.11621.121.0-1.26
 Renal failure8.50.33621.401.33-1.47
 COPD5.20.17271.191.11-1.27
 Dementia1.5–0.23290.790.70-0.89
 Cardiac arrythmia10.40.16381.181.12-1.24
Modified Charlson score
 061.2RefRefRef
 131.90.29231.341.27-1.41
 26.90.55891.751.59-1.92
Any hospitalization in the past 6 months12.90.65821.931.85-2.01

AMI, acute myocardial infarction; CI, confidence interval; COPD, chronic obstructive pulmonary disease; Ref, reference; STEMI, ST-segment elevation myocardial infarction.

Prior comorbidities are defined by pre-admission conditions recorded during the AMI hospitalization.

Modified Charlson index included congestive heart failure, dementia, chronic pulmonary disease, rheumatologic disease, mild liver disease, diabetes with chronic complications, hemiplegia or paraplegia, renal disease, moderate or severe liver disease, autoimmune deficiency syndrome/human immunodeficiency virus (AIDS/HIV), any malignancy (including lymphoma and leukemia), and metastatic solid tumor.

Characteristics of variables selected in the Canada AMI readmission model and their association with 30-day urgent readmission in multivariate logistic regression analysis AMI, acute myocardial infarction; CI, confidence interval; COPD, chronic obstructive pulmonary disease; Ref, reference; STEMI, ST-segment elevation myocardial infarction. Prior comorbidities are defined by pre-admission conditions recorded during the AMI hospitalization. Modified Charlson index included congestive heart failure, dementia, chronic pulmonary disease, rheumatologic disease, mild liver disease, diabetes with chronic complications, hemiplegia or paraplegia, renal disease, moderate or severe liver disease, autoimmune deficiency syndrome/human immunodeficiency virus (AIDS/HIV), any malignancy (including lymphoma and leukemia), and metastatic solid tumor.

Additional analyses

Table 3 summarizes model discrimination properties of several additional analyses. The revised models had higher discrimination ability for mortality and readmission outcomes compared with the existing models in the Ontario cohort. For 30-day mortality, the c-statistic was 0.807 for the existing model vs 0.843 for the new model; the c-statistic for 30-day readmission was 0.597 in the existing model vs 0.638 for the new model. The revised models also had greater ability to discriminate in the Canadian data population for 30-day in-hospital mortality (c-statistic 0.814 [existing] vs 0.834 [new]) and 30-day urgent readmission (c-statistic 0.673 [existing] vs 0.679 [new]).
Table 3

Summary of the discrimination performance of existing and revised AMI models

Models and variablesNumber of events/number of patients (event rate, %)C-statistic (AUC)
Mortality models
 Ontario cohort
  Existing CIHI variables to predict 30-day mortality (in-hospital and out-of-hospital)*3624/54,240 (6.7)0.807
  Revised variables to predict 30-day mortality (in-hospital and out-of-hospital)0.843
  Revised variables to predict 30-day in-hospital mortality3303/54,240 (6.1)0.856
 Canada cohort
  Existing CIHI model to predict 30-day in-hospital mortality*9685/153,523 (6.3)0.814
  New Canadian mortality model to predict 30-day in-hospital mortality0.834
Readmission models
 Ontario cohort
  Existing CIHI variables to predict 30-day readmission6563/53,917 (12.2)0.597
  Revised variables to predict 30-day readmission0.638
  Revised variables to predict 30-day urgent readmission5828/53,917 (10.8)0.662
 Canada cohort
  Existing CIHI model to predict 30-day urgent readmission*15,673/146,513 (10.7)0.673
  New Canadian 30-day readmission model to predict 30-day urgent readmission0.679

AMI, acute myocardial infarction; AUC, area under the receiver operating characteristic curve; CIHI, Canadian Institute for Health Information.

Variables in the existing CIHI AMI mortality model included age, sex, and 9 additional clinical variables (diabetes with complications, cancer, cerebrovascular disease, heart failure, pulmonary edema, acute renal failure, chronic renal failure, and shock).

Variables in the existing CIHI AMI readmission model included age, sex, chronic obstructive pulmonary disease, renal failure, diabetes with complications, heart failure, and acute hospitalization in the past 6 months.

Summary of the discrimination performance of existing and revised AMI models AMI, acute myocardial infarction; AUC, area under the receiver operating characteristic curve; CIHI, Canadian Institute for Health Information. Variables in the existing CIHI AMI mortality model included age, sex, and 9 additional clinical variables (diabetes with complications, cancer, cerebrovascular disease, heart failure, pulmonary edema, acute renal failure, chronic renal failure, and shock). Variables in the existing CIHI AMI readmission model included age, sex, chronic obstructive pulmonary disease, renal failure, diabetes with complications, heart failure, and acute hospitalization in the past 6 months. In Ontario, although 30-day in-hospital mortality captured slightly fewer events (0.6%) than it would have if out-of-hospital deaths were included, the model performance was similar for models using either outcome, with c-statistics of 0.856 and 0.843, respectively. For readmission, using urgent readmission as an outcome was associated with slightly higher c-statistics (0.638 for 30-day all readmission vs 0.662 for 30-day urgent readmission).

Discussion

Profiling hospital performance based on patient outcomes is dependent on having robust adjustment methodologies to account for patient characteristics and clinical profiles to enable fair comparisons across hospitals. Despite their importance, there has been little coordinated effort to ensure that they are updated and valid. In this study, we undertook a Canada-wide collaborative effort and included members from cardiovascular organizations and CIHI to redevelop mortality and readmission models for AMI patients hospitalized across Canada. Extensive analyses were conducted utilizing both provincial and national data. The revised Canada AMI models were found to have good discrimination and good calibration and to be suitable to generate risk-adjusted hospital outcomes in contemporary practice. Our approach of risk prediction development should be considered for adoption in other areas of medicine and surgery. Discrimination of a prediction model indicates how well it can separate those who do vs do not have an outcome of interest. Using c-statistics as a measure of discrimination, our Canadian AMI mortality model to predict 30-days in-hospital mortality had a c-statistic of 0.834, which represented an improvement compared with existing AMI mortality models used for public reporting, which had a c-statistic of 0.814. Improvement in discrimination was consistently seen in the Ontario data and the national data. In the United States, risk-adjustment of AMI mortality is primarily based on the Medicare models, for which the c-statistic is 0.71 for predicting 30-day mortality in AMI patients older than 65 years. Hospital readmission is a topic of intense research because these episodes are frequent, costly, and associated with worse patient outcomes.31, 32, 33 In 2012, the Hospital Readmission Program was initiated in the United States to impose financial penalties on hospitals if rates of 30-day readmission rates of AMI were in excess of the national average., This program was based on the Medicare AMI readmission model that included 31 variables and had a moderate c-statistic of 0.63. Despite using fewer variables in our model, we were able to achieve a slightly higher c-statistic of 0.679 in our Canadian AMI readmission model. It is important to note that c-statistics of readmission models are much lower than those for mortality models in cardiac conditions because it is much harder to accurately predict which patients will be readmitted after an AMI hospitalization. Smith and colleagues performed a systematic review including 15 AMI readmission models and found a median c-statistic of 0.65. Only 2 studies in the review achieved higher c-statistics of > 0.75, but they were based on smaller cohorts with few readmission events. In addition to generating statistical prediction models, creating suitable cohorts of AMI patients is also essential for the comparison of outcomes across different hospitals. One notable change in defining the mortality cohort was the exclusion of AMI patients who had a length of stay < 24 hours. This is because short AMI admissions are likely of patients who are investigated for AMI (“rule-out AMI”) rather than those diagnosed with it. Patients who were diagnosed with AMI and died within 24 hours are still included in the mortality cohort. We also made substantial changes to the readmission cohort and expanded the cohort of interest. Previously, patients with a history of HIV, cancer, and trauma were excluded because of significant competing risks of death. Finally, although prior reports included all AMI hospitalizations for readmission reporting, we have now categorized the first AMI admission as the index case and the second as an outcome, if a patient were admitted with 2 AMI episodes within 30 days. Several limitations of our study merit consideration. First, although it has been shown that models using clinical variables may have higher discrimination ability on an individual level compared with administrative models, we did not include potentially relevant clinical variables in our models (e.g., left ventricular ejection fraction) because they are not available in administrative databases across Canada. However, studies have demonstrated that AMI models based on clinical variables as comapred to administrative variables have similar discriminative abilities when used in aggregate at the hospital level.,, Second, we had to create variables specific to Quebec because of the differences in how comorbidities were captured in Quebec compared with other provinces. Third, the Canadian data were unable to capture deaths that occurred out of the hospital setting. However, we compared the discrimination using all mortality vs in-hospital mortality as outcomes in the Ontario dataset and found similar ability to predict mortality. Fourth, we were not able to evaluate cardiovascular death as an outcome because this variable was not available across Canada for public reporting. We also were not able to evaluate severity of heart failure or left ventricular ejection fraction in our models because of the lack of data. Also, although prior AMI or unstable angina was predictive of outcomes in the Ontario data, this variable was not included in the final Canadian model because patients who were admitted during the acute hospitalization could be miscoded as having prior AMI in administrative data in some provinces. Finally, we did not use hierarchical modelling to consider clustering of patients who might be readmitted several times in each fiscal year, because of its complexity to implement with data from across Canada.

Conclusions

We have developed and validated the Canadian AMI mortality and readmission models, which can be used to publicly report the variation among hospitals across Canada. Growing interest in the public reporting of outcomes also should parallel the need to minimize variation in quality of care and optimize outcomes across all hospitals.
  31 in total

1.  The public release of performance data: what do we expect to gain? A review of the evidence.

Authors:  M N Marshall; P G Shekelle; S Leatherman; R H Brook
Journal:  JAMA       Date:  2000-04-12       Impact factor: 56.272

2.  The Cardiovascular Health in Ambulatory Care Research Team (CANHEART): using big data to measure and improve cardiovascular health and healthcare services.

Authors:  Jack V Tu; Anna Chu; Linda R Donovan; Dennis T Ko; Gillian L Booth; Karen Tu; Laura C Maclagan; Helen Guo; Peter C Austin; William Hogg; Moira K Kapral; Harindra C Wijeysundera; Clare L Atzema; Andrea S Gershon; David A Alter; Douglas S Lee; Cynthia A Jackevicius; R Sacha Bhatia; Jacob A Udell; Mohammad R Rezai; Thérèse A Stukel
Journal:  Circ Cardiovasc Qual Outcomes       Date:  2015-02-03

3.  Readmissions, Observation, and the Hospital Readmissions Reduction Program.

Authors:  Rachael B Zuckerman; Steven H Sheingold; E John Orav; Joel Ruhter; Arnold M Epstein
Journal:  N Engl J Med       Date:  2016-02-24       Impact factor: 91.245

4.  Public Reporting II: State of the Art-Current Public Reporting in Cardiovascular Medicine.

Authors:  William S Weintraub; Kirk N Garratt
Journal:  Circulation       Date:  2017-05-09       Impact factor: 29.690

5.  An administrative claims measure suitable for profiling hospital performance based on 30-day all-cause readmission rates among patients with acute myocardial infarction.

Authors:  Harlan M Krumholz; Zhenqiu Lin; Elizabeth E Drye; Mayur M Desai; Lein F Han; Michael T Rapp; Jennifer A Mattera; Sharon-Lise T Normand
Journal:  Circ Cardiovasc Qual Outcomes       Date:  2011-03

6.  Trends in length of stay and short-term outcomes among Medicare patients hospitalized for heart failure, 1993-2006.

Authors:  Héctor Bueno; Joseph S Ross; Yun Wang; Jersey Chen; María T Vidán; Sharon-Lise T Normand; Jeptha P Curtis; Elizabeth E Drye; Judith H Lichtman; Patricia S Keenan; Mikhail Kosiborod; Harlan M Krumholz
Journal:  JAMA       Date:  2010-06-02       Impact factor: 56.272

7.  Association of Changing Hospital Readmission Rates With Mortality Rates After Hospital Discharge.

Authors:  Kumar Dharmarajan; Yongfei Wang; Zhenqiu Lin; Sharon-Lise T Normand; Joseph S Ross; Leora I Horwitz; Nihar R Desai; Lisa G Suter; Elizabeth E Drye; Susannah M Bernheim; Harlan M Krumholz
Journal:  JAMA       Date:  2017-07-18       Impact factor: 56.272

8.  Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers.

Authors:  Peter C Austin; Ewout W Steyerberg
Journal:  Stat Med       Date:  2013-08-23       Impact factor: 2.373

9.  Acute myocardial infarction hospital admissions and deaths in England: a national follow-back and follow-forward record-linkage study.

Authors:  Perviz Asaria; Paul Elliott; Margaret Douglass; Ziad Obermeyer; Michael Soljak; Azeem Majeed; Majid Ezzati
Journal:  Lancet Public Health       Date:  2017-03-01

10.  Association of Clinical Factors and Therapeutic Strategies With Improvements in Survival Following Non-ST-Elevation Myocardial Infarction, 2003-2013.

Authors:  Marlous Hall; Tatendashe B Dondo; Andrew T Yan; Shaun G Goodman; Héctor Bueno; Derek P Chew; David Brieger; Adam Timmis; Phillip D Batin; John E Deanfield; Harry Hemingway; Keith A A Fox; Christopher P Gale
Journal:  JAMA       Date:  2016-09-13       Impact factor: 56.272

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.