A Novel Biomarker Scoring System Alone or in Combination with the GRACE Score for the Prognostic Assessment in Non-ST-Elevation Myocardial Infarction.

Purpose: The Global Registry of Acute Coronary Events (GRACE) score has proven value in predicting short-term prognosis in non-ST-elevation myocardial infarction (NSTEMI), but it has only moderate discrimination for long-term outcomes. The purpose of this study is to develop and test a multi-biomarker score for better risk stratification and indication of 2-year risk in patients with NSTEMI. Patients and
Methods: A total of 6076 consecutive patients with NSTEMI (66 [59-73] years, 73.1% males) admitted at Zhongshan Hospital, Fudan University were collected in this observational, prospective study between 2012 and 2018 with a 24-month follow-up. The primary endpoint was all-cause death and non-fatal major adverse cardiac events (MACE). A biomarker score ranged from 0 to 12 was constructed. The predictive power of the biomarker score was evaluated alone or combined with the GRACE score by C-statistic, net reclassification index (NRI) and integrated discrimination index (IDI).
Results: During a 2-year follow-up, all-cause death occurred in 159 patients (2.6%), and non-fatal MACEs were presented in 709 patients (11.7%). When added to the GRACE score, the biomarker score demonstrated better prognostic accuracy, patient reclassification and risk discrimination for both mortality and non-fatal MACEs at 2 years by improving the C-statistic from 0.714 (0.671-0.756) and 0.623 (0.600-0.646) to 0.851 (0.820-0.882) and 0.721 (0.702-0.741) with NRI >25% (P<0.001) and IDI >0.30 (P<0.001).
Conclusion: The single use of biomarker score could markedly enhance the prognostic value of concurrent risk stratification tools for 2-year mortality and non-fatal MACEs in NSTEMI. The GRACE score with incorporation of the biomarker score led to more accurate risk reclassification and warrants more consideration in further NSTEMI management.

Introduction

Acute coronary syndrome (ACS) refers to an array of diseases, including unstable angina (UA), non-ST-segment elevation myocardial infarction (NSTEMI) and ST-segment elevation myocardial infarction. Incidence of UA and NSTEMI accounts for 70% of all patients, with over 625,000 new cases annually in the United States.1 With the advancement of percutaneous coronary revascularization and widespread use of evidence-based antiplatelet and secondary prevention medications, outcomes following myocardial infarction have improved.2 However, there remains an approximately 5% one-year residual rate of mortality after the first diagnosis of NSTEMI.3,4

Risk stratification to identify high-risk patients after discharge can optimize post-ACS therapy.5 To simplify the process of risk prediction, several post-ACS scoring systems have been derived to evaluate short-term or long-term cardiovascular risk in NSTEMI. The Thrombolysis in Myocardial Infarction (TIMI) risk score is an easy and valid tool to predict 30-day and 1-year mortality.6,7 However, the lack of weighting for the risk indicators leads to misclassification errors.8 The use of the Global Registry of Acute Coronary Events (GRACE) score in NSTEMI patients has a class IA recommendation for guiding prognosis in current guidelines.1,9,10 An obvious drawback was that the results of GRACE predicted only 6-month mortality and were published over 10 years ago, which is not necessarily representative of current clinical practice.11

While most prior risk-scoring models give a bias towards disease dimensions related to outcome in NSTEMI, biomarkers constitute an integral part in risk assessment.12 The levels of different biomarkers indicate different pathophysiological processes involving inflammatory conditions, cardiac dysfunction, coagulation function, etc. Many types of biomarkers have been investigated, and some of them have been validated in large clinical trials, which offers recommendations for a re-evaluation of the risk prediction tools with additional multimarker-integrated approach to assess the long-term prognostic utility.13,14

Therefore, we developed a multi-biomarker score with the biomarkers collected from the database of this single-center study to provide relatively easy and convenient means to predict 2-year incidence of all-cause death and non-fatal major adverse cardiac events (MACE) in NSTEMI patients. We also investigated the incremental value of this biomarker score of risk-stratification by comparing with the GRACE score.

Materials and Methods

Study Design and Population

The study was a prospective single-center observational study. A total of 6695 consecutive NSTEMI inpatients were screened, with 6076 patients included in the final analysis ( shows a screening flowchart). All treatment and management decisions were at the discretion of the attending physicians with a preferred practice of coronary angiography and revascularization. Eligible patients were aged ≥18 at the time of hospital presentation and had a diagnosis of NSTEMI in the presence of at least 10-minute acute chest pain at rest with one positive serum biomarker of myocardial necrosis and without new ST-segment elevation in electrocardiography. Only the first NSTEMI admission was included for patients presenting more than one ACS admission during the observation period. Exclusion criteria were incomplete records, incomplete follow-up of less than 2 years or mortality during hospital stay or within 30 days after discharge. The ethics committee of Zhongshan Hospital, Fudan University reviewed and approved the study protocol in compliance with the Helsinki Declaration. Written informed consents for collection and analysis of biological specimens were obtained from all participants on admission.

Data Collection

Baseline data were collected for each patient through electronic medical records. Demographic characteristics include age, gender and body mass index (BMI), which was calculated as weight (kg) ÷ height (m)2. We defined smokers as currently smoking or having quit for less than 6 months. Smoking status, comorbidities, family history, vital signs and Killip class were recorded at admission. According to the results of coronary angiography or coronary computed tomography angiography, number of coronary vessels with stenosis ≥50% was documented as 1-, 2- or 3-vessel disease. Cardiac function by transthoracic echocardiography was assessed before discharge. Baseline medications refer to the discharge prescriptions.

Fasting blood samples were collected on average 10 hours after admission in the early morning from an antecubital vein into citrate vacuum tubes for coagulation function and vacutainer tubes containing EDTA for determination of blood routine, hepatic function, renal function, lipid profiles and other biochemical indicators. All analyses were performed on plasma with the exception of the whole blood for blood routine and hemoglobin A1c (HbA1C) examination. The blood samples were promptly centrifuged at 4000×g for 10 minutes at 4°C. All the tests were conducted in the hospital laboratory department, which acquired ISO 15189 certification. A Sysmex XS 500i hematology analyser (Sysmex, Kobe, Japan) was used to examine blood routine. Biochemistry indices were detected by a Hitachi 7600–120 automated biochemistry analyzer (Hitachi, Tokyo, Japan). Coagulation test were performed on the STA-R Evolution Coagulation Analyzer (Stago, Asnières sur Seine, France). Cardiac troponin T (cTnT) was measured using a 5th generation Roche Elecsys highly sensitive assay (Roche Diagnostics, Mannheim, Germany) with a lower limit of 0.03 ng/mL and an upper limit of 10 ng/mL. The assay range for N-terminal pro-B-type natriuretic peptide (NT-proBNP) was 5–35000 pg/mL by using the Roche Elecsys NT-proBNP electrochemiluminescence immunoassay (Roche Diagnostics, Mannheim, Germany). Reference intervals of biomarkers are listed in and were determined by the hospital laboratory department and the manufacturers.

Follow-Up and Study Outcomes

All patients were followed up once a month for two years or until death after discharge through outpatient interview or telephone contact performed by a trained team. After the study period, follow-up information from 97.5% of the patients was obtained. The primary endpoint was the composite of all-cause death and non-fatal major adverse cardiovascular events (MACE) which included recurrent ACS, repeated coronary revascularization, ischemic or hemorrhagic stroke and unscheduled readmission greater than 24 hours by new/worsening heart failure or arrhythmia with corresponding symptoms and objective signs. The observation unit was recorded as person-month. The results of risk were converted into rates of events per person-year.

Calculation of the GRACE and TIMI Score

The GRACE score is derived from eight clinical variables which are age, heart rate, systolic blood pressure, serum creatinine concentration, Killip class, cardiac arrest at admission, presence of ST-segment deviation and elevated troponin (or other cardiac necrosis biomarkers). The calculation of the GRACE score was performed online (available at ) at admission for each patient.

The TIMI score for UA/NSTEMI was based on 7 indicators ascertained upon admission ranging from 0 to 7 points: age ≥65, ≥3 risk factors for coronary artery disease, prior coronary stenosis of 50% or more, ST-segment deviation on electrocardiogram at presentation, at least 2 anginal events in prior 24 hours, use of aspirin in prior 7 days and elevated serum cardiac markers.5

Statistical Analysis

Normality was examined using Kolmogorov–Smirnov test for all data, and equality of variances was assessed by Levene’s test. Quantitative data were reported as means with standard deviations (mean ± SD) or median with interquartile range (IQR) compared by Student t-test or Mann–Whitney U-test, while qualitative data were presented as absolute numbers and percentages compared by chi-square test or Fisher’s exact probability test. For skewed distribution data, 95% confidence intervals (CIs) of median difference were calculated by the Hodges–Lehmann estimate based on the Mann–Whitney U-test.

The univariate Cox regression model was applied to explore the effects of potential biomarkers. We screened the biomarkers with Walt test P<0.05 as candidates for multivariate analyses, by which independent prognostic biomarkers were identified using a backward stepwise Cox regression method with adjustment for GRACE scores and cTnT. The selected biomarker levels were stratified by quintiles. Some biomarker levels, for example, eGFR and HDL-C, correlated inversely with risk of MACEs, and we empirically regarded the highest quintile as the reference group. Hazard ratios (HRs) for individual biomarker levels were determined using the Cox proportional hazards regression model after controlling for GRACE scores and cTnT. A biomarker score was established by converting the statistically significant HRs to the nearest integer values as follows: biomarkers with an adjusted HR of 1.2 to 1.499 were assigned a weight of 1, biomarkers with an adjusted HR of 1.5 to 2.499 were assigned a weight of 2 and biomarkers with an adjusted HR of 2.5 or higher were assigned a weight of 3. These scores were calculated as the sum to generate a final biomarker score.

Receiver-operating characteristic curves were plotted to assess the prognostic accuracy of the biomarker and GRACE score for death and non-fatal MACEs by comparing the C-index. To test the internal validity of the model, a bootstrap resampling approach with 200 replications was carried out to obtain optimism corrected estimates of the C-index. We calculated the net reclassification improvement (NRI) and integrated discrimination improvement (IDI) to assess model discrimination. The NRI is a measure of how well the model correctly assigns individuals to their corresponding groups. As no threshold was recommended, categorical NRIs were applied with risk categories in accordance with the distribution of the cumulative incidence of primary outcomes.15 NRI is sensitive to the choice of threshold, thus the continuous NRI was examined, which represents any change of risk increase or decrease in event and nonevent subsets. The IDI quantifies changes in average sensitivity and specificity between two models. Model goodness of fit was evaluated by Hosmer–Lemeshow test and was shown by calibration plots graphing the observed events against predictive outcomes.

Statistical analyses were performed using SPSS version 26.0 or R Studio version 2021.09.0 with R version 4.0.5.

Results

Study Population

A total of 6076 patients diagnosed as NSTEMI-ACS from January 2012 to December 2018 were included in the study and followed-up for a mean of 22.7 months. A total of 159 (2.6%) all-cause deaths and 709 (11.7%) non-fatal MACEs were observed during the 24-month follow-up. Baseline characteristics of patients with and without primary endpoints are shown in Table 1. Over 70% (73.1% in all cohort, 72.4% in no-event group and 76.9% in event group) of the population was male with a median age of 66 [59-73] at time of admission. Patients with primary endpoints were more likely to have comorbidities, present Killip class III or IV and have multivessel lesions. TIMI scores and GRACE scores in the event group were significantly higher compared to the no-event group (P<0.001). Differences among biomarkers were all statistically significant except detectable levels of cTnT (P<0.05).

Table 1

Baseline Characteristics and Biomarkers of NSTEMI Patients

Characteristics	All Cohort (n=6076)	Primary Endpoints at 24 Months		P value	Mean/Median Difference 95% CI	OR (95% CI)
		No Event (n=5210)	Event (n=866)
Age, years	66 [59–73]	65 [59–72]	68 [60–76]	<0.001	((-3)–(-1))
Male	4439 (73.1)	3773 (72.4)	666 (76.9)	0.006		0.788 (0.666–0.934)
BMI, kg/m2	24.72±3.58	24.72±3.58	24.66±3.55	0.460	((-0.20)–0.32)
Smoker	2644 (43.5)	2294 (44.0)	350 (40.4)	0.047		1.160 (1.002–1.343)
Hypertension	3004 (49.4)	2531 (48.6)	473 (54.6)	0.001		0.785 (0.679–0.907)
Systolic blood pressure, mmHg	139.38±14.71	139.73±14.43	137.26±16.11	<0.001	(1.32–3.61)
Diabetes mellitus	1570 (25.8)	1305 (25.0)	265 (30.6)	0.001		0.758 (0.647–0.887)
Family history of coronary artery disease	84 (1.4)	74 (1.4)	10 (1.2)	0.535		1.233 (0.635–2.397)
Killip Class
I	5366 (89.1)	4667 (89.6)	749 (86.5)	0.007		1.343 (1.084–1.663)
II	490 (8.1)	411 (7.9)	79 (9.1)	0.217		0.853 (0.663–1.098)
III or IV	170 (2.8)	132 (2.5)	38 (4.4)	0.002		0.566 (0.392–0.819)
No. of narrowed coronary arteries
1	3274 (53.9)	2845 (54.6)	429 (49.5)	0.006		1.225 (1.061–1.415)
2	1874 (30.8)	1604 (30.8)	270 (31.2)	0.818		0.982 (0.841–1.147)
3	928 (15.3)	761 (14.6)	167 (19.3)	<0.001		0.716 (0.595–0.862)
LEVF, %	52.10±10.97	52.87±10.81	50.03±11.07	0.015	(1.10–4.28)
Prior myocardial infarction	494 (8.1)	406 (7.8)	88 (10.2)	0.018		0.747 (0.586–0.952)
Previous PCI	872 (14.4)	740 (14.2)	132 (15.2)	0.419		0.921 (0.753–1.125)
Previous CABG	447 (7.4)	369 (0.7)	78 (0.9)	<0.001		0.770 (0.596–0.994)
Baseline medications
DAPT	6003 (98.8)	5153 (98.9)	850 (98.2)	0.059		1.289 (0.748–2.222)
β-blockers	4346 (71.5)	3756 (72.1)	590 (68.1)	0.017		1.208 (1.035–1.411)
ACEI or ARBs	3948 (65.1)	3392 (65.1)	556 (64.2)	0.606		1.040 (0.895–1.209)
Statins	5896 (97.0)	5059 (97.1)	837 (96.7)	0.469		1.161 (0.775–1.739)
GRACE scores	126 [111.25–144]	124 [109–142]	139 [120–158]	<0.001	((-16)–(-12))
TIMI scores	2.80±1.14	2.81±1.15	3.17±1.19	<0.001	((-0.44)–(-0.27))
cTnT >10 ng/mL	99 (1.6)	71 (1.4)	28 (3.2)	<0.001		0.413 (0.265–0.644)
cTnT within the limit of detection, ng/mL	1.98±1.96	1.98±1.96	1.95±1.97	0.672	((-0.11)–0.17)
WBC, ×109/L	6.75 [5.49–8.41]	6.65 [5.46–8.22]	7.47 [5.80–9.54]	<0.001	((-0.88)–(-0.53))
PLT, ×109/L	200 [165–238]	199.00 [164.00–237.00]	203.50 [166.75–244.00]	0.047	((-8.00)–0)
Hb (male), g/L	136.85±16.90	136.95±16.75	135.88±17.69	0.074	((-0.67)–3.45)
Hb (female), g/L	122.14±14.10	122.40±13.83	120.23±15.77	0.065	((-1.19)–4.25)
APTT, s	27.65±3.83	27.59±3.89	27.98±3.44	0.006	((-0.66)–(-0.11))
PT, s	11.30 [10.80–11.90]	11.30 [10.80–11.80]	11.45 [10.90–12.10]	<0.001	((-0.30)–(-0.10))
TT, s	17.44±2.65	17.48±2.82	17.25±1.23	0.020	(0.04–0.42)
INR	1.03±0.17	1.02±0.17	1.05±0.16	<0.001	((-0.04)–(-0.01))
FIB, mg/dL	292.40 [248–355]	286.40 [244.70–346.10]	333.05 [277.88–413.40]	<0.001	((-51.60)–(-39.10))
D-D, mg/L	0.27 [0.19–0.52]	0.26 [0.19–0.49]	0.34 [0.19–0.75]	<0.001	((-0.60)–(-0.30))
CK, U/L	93 [65–163]	90.00 [64.00–145.00]	148.50 [76.00–426.75]	<0.001	((-49.00)–(-33.00))
CK-MB, U/L	16 [12.25–23]	15.00 [12.00–21.00]	23 [15.00–53.00]	<0.001	((-8.00)–(-6.00))
NT-proBNP, pg/mL	192 [71.43–658.15]	166.05 [65.68–541.18]	545.00 [151.40–2077.25]	<0.001	((-293.40)–(-193.90))
hsCRP, mg/L	1.90 [0.69–7.36]	1.69 [0.65–6.19]	4.80 [1.38–19.27]	<0.001	((-2.28)–(-1.48))
HbA1c, %	6.00 [5.60–6.90]	6.00 [5.60–6.90]	6.10 [5.70–7.10]	0.006	((-0.20)–0)
UA, μmol/L	340.90 [280–406]	338.00 [279.00–402.00]	357.00 [284.78–437.00]	<0.001	((-25.00)–(-10.50))
eGFR, mL/min−1·1.73 m2	83.14 [67.31–93.30]	83.88 [68.52–93.53]	78.69 [60.25–92.06]	<0.001	(2.94–5.82)
sCr, μmol/L	79 [67.23–94]	79.00 [67.00–93.00]	84.00 [70.00–102.00]	<0.001	((-7.00)–(-3.90))
ALB, g/L	41.14±4.36	41.32±4.29	40.02±4.61	<0.001	(0.99–1.62)
TC, mmol/L	3.86±1.11	3.83±1.10	3.98±1.13	<0.001	((-0.23)–(-0.07))
HDL-C, mmol/L	1.08±0.31	1.09±0.31	1.05±0.30	<0.001	(0.03–0.07)
LDL-C, mmol/L	2.19 [1.66–2.94]	2.16 [1.64–2.88]	2.44 [1.74–3.19]	<0.001	((-0.27)–(-0.13))

Notes: Variables are expressed as number (percentage), mean ± standard deviation or median [inter-quartile range]. For continuous data, the 95% confidence intervals (CI) of mean or median difference were assessed by Student t-test or the Hodges–Lehmann estimate based on Mann–Whitney U-test. For qualitative data, the odds ratios with 95% CI were reported.

Abbreviations: LEVF, left ventricular ejection fraction; PCI, percutaneous coronary intervention; CABG, coronary artery bypass graft surgery; DAPT, dual antiplatelet therapy; ACEI, angiotensin-converting enzyme inhibitors; ARB, angiotensin receptor blockers; cTnT, cardiac troponin T; WBC, white blood cell count; PLT, platelet count; Hb, hemoglobin; APTT, activated partial thromboplastin time; PT, prothrombin time; TT, thrombin time; INR, international normalized ratio; FIB, fibrinogen; D-D, D-dimer; CK, creatine kinase; NT-proBNP, N-terminal pro-B-type natriuretic peptide; hsCRP, high-sensitivity C-reactive protein; HbA1c, hemoglobin A1c; UA, uric acid; eGFR, estimated glomerular filtration rate; sCr, serum creatinine; ALB, albumin; TC, total cholesterol; HDL-C, high-density lipoprotein cholesterol; LDL-C, low-density lipoprotein cholesterol.

Model Development

Table 2 summarizes the derivation of the biomarker score. As shown in the table, all predictors had a significant relationship with the primary outcome, and were subjected to multivariate stepwise backward Cox regression analysis with adjustment for GRACE score and cTnT, leading to the removal of white blood cell count (WBC), platelet count (PLT), activated partial thromboplastin time (APTT), prothrombin time (PT), thrombin time (TT), international normalized ratio (INR), D-D (D-dimer), high-sensitivity C-reactive protein (hsCRP), HbA1c, estimated glomerular filtration rate (eGFR), albumin (ALB) and total cholesterol (TC) from the final model.

Table 2

Cox Proportional Hazard Regression Analyses for the Composite Point of All-Cause Death and Non-Fatal MACEs at 2 Years

Variables	Univariate Analysis		Multivariate Analysis
	HR (95% CI)	P value	HR (95% CI)	P value
WBC	1.035 (1.027–1.043)	<0.001
PLT	1.001 (1.000–1.002)	0.040
APTT	1.019 (1.006–1.032)	0.005
PT	1.147 (1.100–1.196)	<0.001
TT	0.868 (0.816–0.924)	<0.001
INR	1.810 (1.361–2.406)	<0.001
FIB	1.004 (1.003–1.004)	<0.001	1.003 (1.002–1.004)	<0.001
D-D	1.091 (1.056–1.128)	<0.001
CK	1.000 (1.000–1.001)	<0.001	1.000 (1.000–1.000)	<0.001
CK-MB	1.003 (1.003–1.004)	<0.001	1.003 (1.002–1.004)	<0.001
NT-proBNP	1.000 (1.000–1.000)	<0.001	1.000 (1.000–1.000)	<0.001
hsCRP	1.006 (1.005–1.007)	<0.001
HbA1c	1.073 (1.024–1.125)	0.003
UA	1.002 (1.001–1.002)	<0.001	1.001 (1.000–1.002)	0.004
eGFR	0.989 (0.986–0.992)	<0.001
ALB	0.941 (0.928–0.955)	<0.001
TC	1.112 (1.052–1.175)	<0.001
LDL-C	1.208 (1.135–1.287)	<0.001	1.155 (1.077–1.239)	<0.001
HDL-C	0.581 (0.461–0.733)	<0.001	0.599 (0.467–0.769)	<0.001

Notes: The HR and 95% CI were calculated using univariate Cox regression, and variables with statistical significance of P<0.05 were entered into backward stepwise Cox proportional hazard regression model with adjustment for GRACE scores and cTnT. Results in multivariate regression showed the final model after backward elimination process.

Abbreviations: MACE, major adverse cardiac events; HR, hazard ratio; CI, confidence interval; WBC, white blood cell count; PLT, platelet count; Hb, hemoglobin; APTT, activated partial thromboplastin time; PT, prothrombin time; TT, thrombin time; INR, international normalized ratio; FIB, fibrinogen; D-D, D-dimer; CK, creatine kinase; NT-proBNP, N-terminal pro-B-type natriuretic peptide; hsCRP, high-sensitivity C-reactive protein; HbA1c, hemoglobin A1c; UA, uric acid; eGFR, estimated glomerular filtration rate; ALB, albumin; TC, total cholesterol; HDL-C, high-density lipoprotein cholesterol; LDL-C, low-density lipoprotein cholesterol.

Therefore, the statistically significant biomarkers included hemoglobin (Hb), fibrinogen (FIB), creatine kinase (CK), CK-MB, NT-proBNP, uric acid (UA), low-density lipoprotein cholesterol (LDL-C) and high-density lipoprotein cholesterol (HDL-C) and were quintiled respectively, and the association between biomarker levels and the composite endpoint are reported in . A 1.2-fold to 2.7-fold gradient of risk was observed comparing the highest to lowest concentrations across groups of FIB, CK, CK-MB, NT-proBNP, UA and LDL-C. There remained a 1.7-fold gradient risk in the lowest concentration group of HDL-C in comparison with the highest concentration. A biomarker score was constructed by assigning tiered integer values to each significant biomarker group and was calculated by summing up the values with a range from 0 to 12 for each patient, of which the indicators included FIB, CK, CK-MB, NT-proBNP, UA, LDL-C and HDL-C (Table 3).

Table 3

Final Biomarker Risk Score

Variable	Points
FIB, mg/dL
≤274.0	0
274.1–313.4	+1
≥313.5	+2
CK, U/L
≤202	0
≥203	+1
CK-MB, U/L
≤18	0
19–27	+2
≥28	+3
NT-proBNP, pg/mL
≤934.7	0
≥934.8	+2
UA, μmol/L
≤423	0
≥424	+1
LDL-C, mmol/L
≤3.14	0
≥3.15	+1
HDL-C, mmol/L
≤0.82	+2
0.83–0.96	+1
≥0.97	0
Score range	0–12

Abbreviations: FIB, fibrinogen; CK, creatine kinase; NT-proBNP, N-terminal pro-B-type natriuretic peptide; UA, uric acid; LDL-C, low-density lipoprotein cholesterol; HDL-C, high-density lipoprotein cholesterol.

Distributions of Biomarker Scores and GRACE Scores

Figure 1A and 1B show the distributions of biomarker scores and GRACE scores, respectively. The rate of non-fatal MACE ranged from 2.3% per month in patients with a biomarker score of 0 to 27.5% per month in patients with a biomarker score of ≥11, which was approximately 12-fold greater. The rate of death had a similar trend in elevated biomarker scores, ranging from 0.3% to 19.3% (Figure 1C). Although the rates of the same endpoints increased with higher levels of GRACE scores, a greater relative increase in risk was identified in biomarker scores (Figure 1D).

Figure 1

(A) Distribution of biomarker scores; (B) Distribution of GRACE scores; (C) Annual event rate of biomarker scores; (D) Annual event rate of GRACE scores.

Prognostic Discrimination and Reclassification

When each single-item score in the biomarker scoring system was individually added to the GRACE score, biomarkers significantly improved the prognostic accuracy for risk of both mortality and non-fatal MACEs (Table 4). Biomarker scores alone showed greater C-statistic of 0.836 (95% CI, 0.801–0.871) for death and 0.692 (95% CI, 0.674–0.719) for non-fatal MACEs compared to GRACE scores with C-statistic of 0.714 (95% CI, 0.671–0.756) and 0.623 (95% CI, 0.600–0.646), respectively. Combining biomarker scores with GRACE scores incrementally elevated the C-statistic to 0.851 (95% CI, 0.820–0.822) for predicting mortality and 0.721 (0.702–0.741) for non-fatal MACEs.

Table 4

Prognostic Discrimination

Death at 2 Years	C-Statistic (95% CI)	Categorical NRI (95% CI)a	Continuous NRI (95% CI)	IDI
GRACE scoreb	0.714 (0.671–0.756)**	Reference	Reference	Reference
+FIB	0.776 (0.741–0.811)**	0.125 (−0.031–0.261)	0.082 (0.011–0.189)*	0.015 (0.006–0.023)**
+CK	0.739 (0.700–0.778)**	0.061 (0.030–0.089)*	0.071 (−0.043–0.192)	0.009 (0.002–0.015)**
+CK-MB	0.793 (0.759–0.827)**	0.136 (0.095–0.202)**	0.152 (0.060–0.267)**	0.019 (0.010–0.027)**
+NT-proBNP	0.802 (0.767–0.837)**	0.209 (0.088–0.344)**	0.248 (0.153–0.387)**	0.025 (0.009–0.040)**
+UA	0.735 (0.694–0.776)*	0.002 (−0.096–0.109)	0.069 (0.001–0.117)*	0.005 (−0.011–0.021)
+LDL-C	0.736 (0.694–0.777)*	0.047 (−0.056–0.114)	0.058 (0.007–0.122)*	0.003 (−0.001–0.007)
+HDL-C	0.723 (0.680–0.765)*	0.034 (−0.071–0.116)	0.065 (0.024–0.118)*	0.004 (−0.009–0.015)
Biomarker scorec	0.836 (0.801–0.871)**	0.465 (0.263–0.758)**	0.363 (0.227–0.453)**	0.058 (0.049–0.066)**
GRACE with biomarker scored	0.851 (0.820–0.882)**	0.552 (0.281–0.761)**	0.416 (0.309–0.531)**	0.064 (0.051–0.075)**
MACE at 2 years
GRACE scoreb	0.623 (0.600–0.646)	Reference	Reference	Reference
+FIB	0.660 (0.639–0.681)**	0.089 (0.037–0.159)*	0.040 (−0.001–0.102)	0.010 (0.004–0.015)*
+CK	0.680 (0.658–0.702)**	0.156 (0.092–0.249)**	0.105 (0.055–0.163)**	0.018 (0.012–0.024)**
+CK-MB	0.689 (0.668–0.710)**	0.199 (0.122–0.273)**	0.183 (0.121–0.237)**	0.021 (0.013–0.028)**
+NT-proBNP	0.663 (0.641–0.685)**	0.114 (0.039–0.187)*	0.135 (0.078–0.183)**	0.017 (0.002–0.031)*
+UA	0.637 (0.614–0.659)*	0.031 ((-0.016)–0.080)	0.053 (0.016–0.078)*	0.004 ((-0.002)–0.009)
+LDL-C	0.631 (0.608–0.654)*	0.041 (0.005–0.075)*	0.037 (0.017–0.063)**	0.002 ((-0.002)–0.005)
+HDL-C	0.643 (0.621–0.665)**	0.045 (0.016–0.076)*	0.032 (0.009–0.060)*	0.007 (0.002–0.015)*
Biomarker score	0.697 (0.674–0.719)**	0.228 (0.155–0.376)**	0.246 (0.183–0.321)**	0.036 (0.027–0.042)**
GRACE with biomarker score	0.721 (0.702–0.741)**	0.285 (0.215–0.390)**	0.278 (0.174–0.373)**	0.049 (0.041–0.056)**

Notes: aThe categorical NRI for all-cause death and non-fatal MACEs was evaluated at a range of thresholds from 0.02 to 0.08 and 0.10 to 0.20, respectively. bThe score for each biomarker was assessed individually on top of the GRACE score. cCompared with GRACE scores alone. dThe combination of GRACE and biomarker scores compared with GRACE scores alone. *P<0.05; **P<0.001.

Abbreviations: NRI, net reclassification improvement; IDI, integrated discrimination improvement; FIB, fibrinogen; CK, creatine kinase; NT-proBNP, N-terminal pro-B-type natriuretic peptide; UA, uric acid; LDL-C, low-density lipoprotein cholesterol; HDL-C, high-density lipoprotein cholesterol.

NRI categories were based on risk of all-cause death (<2%, 2% to 8%, >8%) and non-fatal MACEs (<10%, 10% to 20%, >20%) at 2 years. The newly created biomarker score improved discrimination ability for primary endpoints in categorical NRI, continuous NRI and IDI individually or in combination with GRACE scores. Only the single-item scores of CK-MB and BNP improved all metrics of discrimination for the primary outcomes. Simultaneously categorized risk was based on the threshold mentioned above to show annual rates of primary endpoints according to GRACE scores and biomarker scores (). Generally, biomarker scores observed more positive reclassification of risk than negative reclassification, reflected by identifying more patients with a GRACE score ≤116 who had a higher biomarker score than patients with a GRACE score ≥140 who had a lower biomarker score. Specifically, the biomarker scoring system reclassified 208 GRACE low-risk patients to high-risk groups versus 108 moved from GRACE high-risk group to biomarker low-risk group in predicting mortality (), while 236 were reclassified to higher risk versus 149 reclassified to lower risk in prediction of MACEs ().

Model Validation

In addition to C-statistic, calibration plots for internal validation of biomarker scores are presented in ; both showed good fit between the predicted and observed 2-year risk of primary outcomes. All points matched close to the 45° ideal line with a calibration bootstrap slope 1.03 (95% CI, 0.97–1.09) reflecting a small degree of overestimation of mortality (). Similarly, the calibration slope for non-fatal MACEs was 1.11 (95% CI, 0.95–1.27) ().

Discussion

In the present study, we developed a biomarker score that accurately predicted 2-year prognosis and showed good discrimination in risk stratification for both mortality and non-fatal MACE of NSTEMI patients both alone and in combination with the GRACE score. The score comprises seven readily obtainable indicators upon admission: FIB, CK, CK-MB, BNP, UA, LDL-C and HDL-C, which is simple to use in clinical practice. The biomarker scores stratify patients into 3 distinctive risk groups (low risk: 0–2; intermediate risk: 3–4; high risk: 5–8) and reclassified more patients from low-risk to high-risk than those inappropriately moved from high-risk to low-risk.

Management decisions in NSTEMI should be based on risk stratification to avoid a subjective judgement from physicians, for example, underestimating the risk among high-risk populations leading to inactive treatment. The GRACE score performs well in individualized patient risk assessment to guide the invasive timing in hospital and has been established as the gold standard score for ACS management.1,9,10,16 The GRACE score was first designed and validated to predict 6-month post-ACS discharge death with C-Statistic >0.75,11 and was generalized to predict mortality beyond 6 months with C-Statistic=0.81 at 2 years.17 The poor predictive performance (C-Statistic=0.62) of the GRACE score in non-fatal MACE and the moderate performance in predicting all-cause mortality (C-Statistic=0.71) in our study were comprehensible with several explanations accounting for the difference. First, we did not include the patients who died in hospital and within 30 days after discharge. Both TIMI and GRACE risk scores have superior prediction for in-hospital and 30-day post-discharge mortality, while the focus of the study is prognosis assessment and therapeutic decision-making for a longer term.1,6,9,10 Second, our study population included only NSTEMI eastern Chinese Han patients. This may indicate that the biomarker score derived from this study is more specific to NSTEMI than the current risk prediction tools for all types of ACS. Third, the proportion of Killip III/IV patients was relatively lower in our database. Additionally, the guideline-directed medical treatment has improved prognosis significantly and reduced the mortality rates.18,19 Non-fatal MACE is also an important outcome for risk stratification since the second hit for the heart remains a leading cause for death.20 A single biomarker may not be enough to determine prognosis, so we screened a series of potential biomarkers. The integrated biomarkers shared links which simultaneously evaluated the physiological and pathological processes of NSTEMI.21

We used contemporary statistical methods, IDI and NRI, to examine the improvement of prognostic assessment and reclassification in the study. We found that each biomarker in the newly established score has added value for determination of prognosis.

Acute exacerbation of ACS involves severe inflammatory response.22 FIB is a liver protein synthesized increasingly in response to circulating proinflammatory cytokines.23 FIB plays a critical role in determination of plasma viscosity, red cell aggregation as well as platelet activation, and it is recognized as a major factor in the initiation and progression of atherogenesis.24,25 There is evidence that plasma FIB levels can be used as an independent predictor of MACEs, and its combination with ALB, D-D and other hematological indicators also suggests a strong predictive value.26–29 It is commonly assumed that CK-MB remains a reliable marker of cardiomyocyte damage and has been shown to predict elevated MACEs in NSTEMI patients after discharge.30–32 As one of the three CK isoenzymes, CK-MB is detectable in plasma 4–8 hours following onset of myocardial infarction and peaks at 18–24 hours.33 Elevated CK-MB levels are related to a worse prognosis in our study, and a meta-analysis also indicates that a greater increase (>5× the upper limit of normal) in CK-MB causes significant improvements in mortality, which may be explained by the myocyte apoptosis affecting contractile function.34 CK catalyzes the reversible conversion of creatine and ATP into phosphocreatine and ADP.35 The diagnostic and prognostic role of CK in NSTEMI has been controversial. Some studies have suggested the elimination of CK assays to contain costs.36,37 However, our results show that CK has a positive prognosis value after adjusting for a wide range of biomarkers. Several studies have demonstrated similar results and emphasized the role of both CK and CK-MB reflecting the severity of myocardial injury.38,39 NT-proBNP is a highly sensitive marker of left ventricular dysfunction and fluid retention especially in patients with heart failure. The level of NT-proBNP relating to MACEs in NSTEMI may indicate the presence of comorbidities and has been a strong marker of long-term outcomes in an increasing number of studies.40 UA is the terminal oxidation product of purine catabolism.41 In addition to acting as a surrogate marker of dehydration in serum hyperosmolarity, it is also known as an oxidative stress marker which is presented in linear correlation to the high levels of oxidation LDL (ox-LDL) and CRP.42–44 Real-world studies have validated the relationship of high levels of UA and MACEs in patients with ACS and suggested UA as a new prognostic marker.45–47 Studies have long shown that lipids play an essential role in the development of coronary atherosclerosis beyond doubt.48 High levels of LDL have adverse effects on coronary vessels, while HDL presents a cardioprotective effect.49,50 Reduction of LDL and elevation of HDL can improve outcomes and prevent relapse of MACEs.51 Many other biomarkers suggesting peripheral dyslipidemia, such as lipoprotein(a), small dense LDL and ox-LDL have been measured and shown predictive effects.52,53

In our cohort, no significant difference was observed in the baseline medications of renin-angiotensin antagonists and statins between no-event group and event group. This might be due to the relatively low-risk patients in our study and the attending physicians prescribing the medications rigorously following the guidelines. Besides, it is probably related with patient compliance, which was not taken into consideration. We are cautious not to overstate this finding, because the reasons remain to be determined.1,10

Some limitations in this study warrant acknowledgement. First, the non-interventional nature of this study may cause incomplete data collection and the loss of sample size. Second, this is a single-center study mainly based in Shanghai, a regional area in China. The quantitative findings in our population might not be generalizable to the entire NSTEMI population. Besides, the biomarker score we created in this study has not been externally validated, which requires further studies across different regions during different time periods. Apart from the enhancement in the convenience of clinical application, the quintiled biomarkers and GRACE scores used in the study may lose information compared to the continuous form of parameters. Finally, there may be incomplete confounders, such as mean platelet volume, a thrombogenic index for immature platelets, which is related to the prognosis.54 Further consideration should be given to novel biomarker testing to address the incremental prognostic benefit from that of current biomarker scores.

Conclusion

In conclusion, this easy-to-use biomarker scoring system with the incorporation of GRACE scores can quickly identify the high-risk patients. Health care workers may refer to the biomarker score during medical decision-making and initiate more intensive follow-up accordingly.