Agreement between the SCORE and D'Agostino Scales for the classification of high cardiovascular risk in sedentary spanish patients.

BACKGROUND: To evaluate agreement between cardiovascular risk in sedentary patients as estimated by the new Framingham-D'Agostino scale and by the SCORE chart, and to describe the patient characteristics associated with the observed disagreement between the scales.
DESIGN: A cross-sectional study was undertaken involving a systematic sample of 2,295 sedentary individuals between 40-65 years of age seen for any reason in 56 primary care offices. An estimation was made of the Pearson correlation coefficient and kappa statistic for the classification of high risk subjects (> or =20% according to the Framingham-D'Agostino scale, and > or =5% according to SCORE). Polytomous logistic regression models were fitted to identify the variables associated with the discordance between the two scales.
RESULTS: The mean risk in males (35%) was 19.5% +/- 13% with D'Agostino scale, and 3.2% +/- 3.3% with SCORE. Among females, they were 8.1% +/- 6.8% and 1.2% +/- 2.2%, respectively. The correlation between the two scales was 0.874 in males (95% CI: 0.857-0.889) and 0.818 in females (95% CI: 0.800-0.834), while the kappa index was 0.50 in males (95% CI: 0.44%-0.56%) and 0.61 in females (95% CI: 0.52%-0.71%). The most frequent disagreement, characterized by high risk according to D'Agostino scale but not according to SCORE, was much more prevalent among males and proved more probable with increasing age and increased LDL-cholesterol, triglyceride and systolic blood pressure values, as well as among those who used antihypertensive drugs and smokers.
CONCLUSIONS: The quantitative correlation between the two scales is very high. Patient categorization as corresponding to high risk generates disagreements, mainly among males, where agreement between the two classifications is only moderate.

Introduction

The stratification of cardiovascular risk (CVR) is the most cost-effective way to define the priorities of cardiovascular prevention in asymptomatic patients, and is currently the best available tool for making treatment decisions in clinical practice [1-3].

The equations designed to estimate CVR are based on follow-up of population cohorts sufficiently large to secure the required precision. In Europe, use of the SCORE (Systematic Coronary Risk Evaluation) chart is recommended, based on cohorts from 12 European countries; this instrument estimates mortality risk due to cardiovascular diseases [4]. Different countries, including Spain [5-8], have carried out specific adaptations of the original charts, since they generally overestimate the true cardiovascular risk. However, it has been seen that the Spanish adaptation underestimates cardiovascular mortality [5]. Recently, a new scale (D’Agostino) based on the Framingham Heart Study has been developed to estimate the risk of new vascular events—both coronary and cerebrovascular [9].

A review of the multiple studies published in recent years reveals that there is no ideal scale for assessing CVR in Mediterranean populations. The original Framingham function [10,11], in its different versions, identifies more high CVR patients than the SCORE chart [12,13]. However, its calibration for the Spanish population (REGICOR) [14,15] identifies fewer high CVR patients than the original scale [16,17], and agreement in identification of patients with high CVR [18-21] is low. It should be kept in mind that the scales derived from the Framingham function estimate the incidence of coronary disease, with the exception of the D’Agostino scale, which estimates global cardiovascular morbidity and mortality, whereas the SCORE estimates cardiovascular mortality. The Framingham scales are commonly used as a standard for evaluating other methods, such as the presence of calcium in the coronary artery [22], and also for assessing the effectiveness of certain interventions [23]. Agreement or concordance between the SCORE and D’Agostino scales has been analyzed in hypertensive patients [24], but not in the general population, or specifically in sedentary subjects.

Thus, the aims of this study were to assess the agreement between these scales in sedentary patients aged 40–65 years, and to describe the patient characteristics associated to disagreement between the scales in identifying patients with high CVR. The objective is to evaluate the convergent validity of the new scale, accrediting its use in clinical practice for the detection of patients with a high risk of suffering cardiovascular disease.

Methods

Study Design and Patients

A cross-sectional analysis was made of the participants in a randomized, multicenter clinical trial carried out in Spain to assess a physical activity promoting program in primary care [25,26]. The participants were recruited from 11 primary care centers in eight Spanish Autonomous Communities collaborating with the Research Network in Preventive and Health Promoting Activities (redIAPP). All sedentary individuals between 20–80 years of age seen for any reason in 56 primary care offices between October 2003 and May 2004 were considered eligible for participation in the clinical trial. On one or two days of the week, the primary care physicians recruited those subjects failing to meet the minimum physical activity recommendations [27], in a systematic patient sample previously selected by the nursing personnel dedicated to the research project from among all the individuals seen in daily practice. The participants received an information sheet and signed a consent form before the measurements were made. The patients included in the analysis were between 40–65 years of age, with no history of established cardiovascular disease. A detailed description of the recruitment process and the characteristics of the patients included in the clinical trial has been published elsewhere [25,26].

Measurements

The measurements of body mass index (BMI) and blood pressure using OMROM M7® pressure recorders were made by trained nursing personnel, following the recommendations of the European Society of Hypertension [28]. The variables needed for calculating risk with both scales were obtained from the patient case histories. Morbidity-mortality risk calculated with the D’Agostino scale [9]: age, sex, total cholesterol, high-density lipoprotein cholesterol (HDL-C), systolic blood pressure (SBP, drug treatment for arterial hypertension (AHT), smoking, and history of diabetes mellitus. Cardiovascular mortality risk calculated with the SCORE [4] for low risk countries: age, sex, total cholesterol, SBP, and smoking. This instrument does not include diabetes as risk factor, but the authors recommend multiplication by four in females and by two in males in the presence of diabetes. This recommendation was followed in our study. Blood glucose and full lipid profile were also recorded. Blood lipid and glucose levels were measured on a blind basis by the laboratories associated to the participating primary care centers, after patient fasting for at least eight hours. Smoking was self-reported.

Patient Classification According to Risk

Patients at high CVR were taken to be those with a ≥20% cardiovascular morbidity-mortality risk according to the Framingham-D’Agostino scale [9], and with a risk of cardiovascular death of ≥5% according to the SCORE charts [4].

Statistical Analysis

Agreement between the two scales was quantified by the Pearson correlation coefficient, and was qualitatively assessed by the kappa statistic for high risk categorization—“excellent” agreement being considered for values of 0.81–1, “good” agreement for 0.61–0.80, “moderate” agreement for 0.41–0.60, “slight” agreement for 0.21–0.40, and “poor” agreement for 0–0.20 [29].

To evaluate the association between patient characteristics and disagreement in risk categorization or classification between the two scales, a polytomous logistic regression model was fitted in which analysis was made of the probability of agreement on both scales versus disagreement with a high D’Agostino score and a non-high SCORE, and versus disagreement with a high SCORE and a non-high D’Agostino score. As independent variables, we included patient age, sex, BMI, smoking, the presence or absence of diabetes mellitus, total cholesterol, HDL-cholesterol, low-density lipoprotein cholesterol (LDL-C), systolic blood pressure (SBP), diastolic blood pressure (DBP), and the use of antihypertensive medication. Modification of these effects by gender was moreover admitted. All calculations were made using the Statistical Analysis System (SAS) version 9.2 software package (SAS Institute Inc., Cary, NC, USA; 2008).

Results

Of the sample of 4,927 subjects between 20–80 years of age selected for the original study, 2,295 (46.5%) were within the age range recommended for use of the two scales (45–65 years), with no history of cardiovascular disease, and presenting the data needed for risk calculation. Males (35% of the total) had a higher percentage of diabetics, smokers and hypertension, a poorer lipid profile, and higher systolic and diastolic blood pressure values. The mean risk among males as determined by the D’Agostino score, which is used with a threshold of 20% for high risk, was 19.5% ± 13%, versus 3.2% ± 3.3% according to the SCORE, with a threshold of 5% for high risk. The corresponding female values were 8.1% ± 6.8% and 1.2% ± 2.2%, respectively, with a threshold for high risk same than men (Table 1).

Table 1.

Characteristics of study patients, overall and by sex.

	All (n = 2295)	Men (n = 805)	Women (n = 1490)	p*
SCORE risk	1.91 ± 2.78	3.18 ± 3.30	1.23 ± 2.16	<0.0001
D’Agostino risk	12.09 ± 10.89	19.50 ± 12.92	8.08 ± 6.83	<0.0001
SCORE risk > 5%	212 (9.24%)	151 (18.76%)	61 (4.09%)	<0.0001
D’Agostino risk > 20%	396 (17.25%)	308 (38.26%)	88 (5.91%)	<0.0001
Age (years)	52.93 ± 7.32	53.15 ± 7.24	52.81 ± 7.35	0.2989
Overweight (BMI> 30)	649 (28.30%)	215 (26.77%)	434 (29.13%)	0.2328
Smoking	586 (25.53%)	273 (33.91%)	313 (21.01%)	<0.0001
Diabetes	225 (9.80%)	114 (14.16%)	111 (7.45%)	<0.0001
High Cholesterol (Cholesterol >250 mg/dL)	424 (18.47%)	151 (18.76%)	273 (18.32%)	0.7975
Hypertensive	703 (30.63%)	296 (36.77%)	407 (27.32%)	<0.0001
BMI	27.97 ± 4.60	28.12 ± 3.72	27.89 ± 5.01	0.2038
Glycaemia (mg/dL)	99.60 ± 24.24	105.48 ± 28.29	96.40 ± 21.06	<0.0001
Ratio Cholesterol total / cHDL	3.96 ± 1.17	4.41 ± 1.22	3.72 ± 1.06	<0.0001
Ratio log(Triglycerides) / HDL	0.09 ± 0.03	0.10 ± 0.03	0.08 ± 0.03	<0.0001
Cholesterol total (mg/dL)	218.11 ± 24.24	217.34 ± 37.20	218.53 ± 36.37	0.4594
cHDL (mg/dL)	58.81 ± 17.29	52.01 ± 14.02	62.48 ± 17.78	<0.0001
cLDL (mg/dL)	136.25 ± 33.92	138.28 ± 34.93	135.15 ± 33.32	0.0369
Triglycerides (mg/dL)	120.12 ± 71.79	146.32 ± 86.51	105.947 ± 57.65	<0.0001
Systolic blood pressure (mmHg)	130.98 ± 18.21	135.85 ± 16.88	128.34 ± 18.37	<0.0001
Diastolic blood pressure (mmHg)	79.65 ± 10.52	81.83 ± 10.51	78.47 ± 10.33	<0.0001
Antihypertensive drugs	559 (24.79%)	246 (30.56%)	323 (21.68%)	<0.0001

(mean ± standard deviation or number and percent).

BMI: Body mass index; HDL: high density lipoprotein; cHDL: Cholesterol high density lipoprotein; cLDL: low density lipoprotein.

Difference between men and women. t student or ANOVA by quantitative variables and chi-square by qualitative.

The correlation between the two scales was 0.859 (95%CI: 0.848–0.870) considered globally, 0.874 (95%CI: 0.857–0.889) in males, and 0.818 (95%CI 0.800–0.834) in females. With regards to the risk category, the percentage of patients at high risk according to the SCORE was 18.8% in males and 4.1% in females, while the D’Agostino scale identified high risk for 38.3% of the males and 5.9% of the females. Table 2 shows the agreement between the two scales, with a kappa index of 0.50 in males (95%CI: 0.44%–0.56%) and 0.61 in females (95% CI: 0.52%–0.71%). The greatest disagreement was found among the high risk males as established by the D’Agostino scale; of these subjects, 20.4% did not show high risk according to the SCORE. Using the D’Agostino vs. SCORE methods will give the same classification for 80% of men and 96% of women (Table 2).

Table 2.

Classification of cardiovascular risk in the high and non high categories. Agreement in the high and low risk categories.

Assessment by SCORE	Assessment by D’Agostino		Overall
	Non-high CVR	High CVR
Men n=805
Non-high CVR	490 (60.87%)	164 (20.37%)	654
High CVR	7 (0.87%)	144(17.89%)	151
Overall	497	308	805
Kappa index: 0.50 (0.44–0.56)
Women n = 1,490
Non-high CVR	1388 (93.15%)	41 (2.75%)	1429
High CVR	14 (0.94%)	47 (3.15%)	61
Overall	1,402	88	1,490
Kappa index: 0.61 (0.52–0.71)

CVR: Cardiovascular risk. The table shows n (%) by sex from overall people.

Table 3 shows the variables of the final polytomous logistic regression model seen to be associated with disagreement between the two scales. After simultaneously fitting for the rest of covariables included in the model, the most frequent disagreement, characterized by high risk according to the D’Agostino scale but not according to the SCORE, was much more prevalent among males and proved more probable with increasing age and increased LDL-cholesterol, triglyceride and systolic blood pressure values, as well as among those who used antihypertensive drugs and smokers. While positive, the magnitude of the association between these variables and the mentioned disagreement was significantly smaller among females (p < 0.03). The presence of diabetes mellitus and higher HDL-cholesterol levels make such disagreement less probable in both males and females (Table 3).

Table 3.

Variables associated to discrepancies in classification as high CVR between SCORE and D’Agostino scales.

	D’Agostino high and SCORE Non high *	D’Agostino Non high and SCORE high**
	Odds Ratio (IC 95%)	Odds Ratio (IC 95%)
Age (1 year)
Men	1.32 (1.18–1.47)	13.11 (1.85–92.75)
Women	1.14 (1.09–1.18)	7.12 (1.33–38.12)
Age*sex	0.99 (0.98–0.99)	0.88 (0.79–0.98)
Sex (Men)***	10.65 (3.26–34.71)
BMI (kg/m2)		11.13 (9.22–13.44)
Diabetes	0.36 (0.20–0.65)	103.09 (21.77–488.17)
Cholesterol HDL (mg/dl)	0.49 (0.40–0.61)	1.56 (1.23–1.98)
Cholesterol LDL (mg/dl)	1.18 (1.12–1.25)
Triglycerides (mg/dl)		0.92 (0.86–0.99)
Men	1.09 (1.03–1.15)
Women	1 (0.98–1.03)
Systolic blood pressure (mmHg)
Men	2.11 (1.66–2.68)	0.70 (0.48–1.02)
Women	1.09 (0.95–1.24)	2.74 (1.21–6.21)
Antihypertensive drugs		0.14 (0.04–0.57)
Men	22.33 (5.97–83.52)
Women	4.85 (3.08–7.63)
Smoker
Men	13.59 (4.82–38.35)
Women	2.43 (1.56–3.80)

Interaction between sex and aged, smokers, Triglycerides, systolic blood pressure and antihypertensive drugs; p < 0.03.

Interaction between sex, aged and systolic blood pressure; p < 0.05.

Effect to be man when aged, triglycerides and systolic blood pressure take mean value and not on antihypertensive treatment and not smokers.

The probability of observing disagreements due to a high SCORE and non-high D’Agostino score was not correlated to patient sex at the mean levels of the rest of the covariables. The characteristics associated with increased probability in disagreements were older age, greater BMI, the presence of diabetes mellitus, HDL-cholesterol levels and systolic blood pressure (the latter parameter only in females). Systolic blood pressure reduced the probability of disagreement of this kind in males, while triglyceride levels and the use of antihypertensive medication reduced the probability in both sexes (Table 3).

Discussion

Our results indicate a strong correlation between cardiovascular mortality as estimated by the SCORE [4] and the risk of developing cardiovascular disease as estimated by the D’Agostino scale [9]. The problem arises when as happens in deciding treatment in clinical practice, high risk is or is not assumed for patients that exceed the 5% mortality threshold estimated by the SCORE, or the 20% risk threshold estimated by the D’Agostino scale. The agreement between the two instruments in relation to this classification of high risk patients is good in the case of females, but only moderate in the case of males. The most frequent disagreement is found among males classified as being at high risk according to the D’Agostino equation. In addition to male status, a considerable number of characteristics such as older age, smoking, increased systolic blood pressure, a poorer lipid profile and antihypertensive drug therapy define a group of patients in which the risk of cardiovascular disease could be underestimated or overestimated if only the SCORE or the D’Agostino scale were used, respectively.

The percentage of patients classified in this study as having a high CVR using the SCORE equation is similar to that reported by other studies in the primary care setting [19], in the general population [21], or in hypertensive individuals [30]. The D’Agostino scale classifies twice as many patients as being at high risk compared with the SCORE, and both scales classify a much larger proportion of males as presenting high risk. In this sense, for each female classified as being at high risk, the SCORE classifies 4.5 males and the D’Agostino scale classifies 6 males as presenting high risk.

These data indicate that the scale derived from the D’Agostino equation identify more high risk CVR subject than SCORE—despite the fact that it calculates CVR, not only coronary risk as before. Calibration of this scale in our population would therefore be necessary.

No comparison has been made in our setting between the SCORE and the D’Agostino scale at the 20% high risk cutoff point in a sample of sedentary patients between 40–65 years of age without cardiovascular antecedents—though many studies have compared different Framingham versions [10,11] with the SCORE. In studies involving subjects seen in primary care centers, the SCORE and Framingham estimate higher risk—thus indicating lipid-lowering drug treatment in a larger number of patients than the REGICOR [16,21]. The scales compared in this study measure CVR, mortality risk and morbidity-mortality risk. This is probably why agreement between the two scales shows a kappa index of 0.58, which is better than that published by other authors comparing the Framingham-REGICOR and SCORE [19,21,30], or the Framingham and SCORE [12,13,30], since these are equations that predict different cardiovascular events (coronary morbidity-mortality and cardiovascular mortality).

The percentage of patients showing disagreement between the two instruments on being classified as high risk subjects was 54.2%. Of every 100 males with disagreement, 97 showed high risk according to the D’Agostino scale and non-high risk according to the SCORE, while only three showed non-high risk according to the D’Agostino scale and high risk as determined by the SCORE. However, of every 100 females with disagreement, approximately 53 showed high risk according to the D’Agostino scale and non-high risk according to the SCORE, while 47 showed non-high risk according to the D’Agostino scale and high risk as determined by the SCORE. These figures, while substantial, are lower than the disagreements reported in other studies [13,19,21].

The males with high risk according to the D’Agostino scale and non-high risk as determined by the SCORE (i.e., the most frequent profile) were smokers, had higher blood pressure or were hypertensive, and presented higher total cholesterol, LDL-cholesterol and triglyceride levels, and lower HDL-cholesterol concentrations. Specifically, the subgroup of older males who smoke and with high systolic blood pressure, a poor lipid profile and antihypertensive drug therapy is clinically problematical, because it is the most likely to present a classification disagreement as a high risk profile. This profile has already been reported in the study published by Gil et al. [16].

In such subjects it would be accepted that the actual risk could be higher than the risk as calculated with the SCORE. These patients would have to be regarded as presenting an increased risk, and would have to be managed on an individualized basis.

A main limitation of this study is that the sample only represents the sedentary population between 40–65 years of age seen in the primary care setting—excluding patients that do not seek medical care, and active individuals.

Other limitations that must be taken into account when interpreting the results are those inherent to the actual scales in determining CVR. The SCORE only estimates cardiovascular mortality and the population in the 40–65 years age range, while the Framingham instrument comprises a population with far higher CVR than the Spanish population.

Nevertheless, the design is valid for assessing agreement by sexes between the two scales, without interfering with comparison of the two equations—though the selection of patients limits the external validity of the study when extrapolating the results to the general population.

We conclude that although a strong correlation is observed between the two scales, there is disagreement in the identification of high risk patients between the SCORE for countries with a low cardiovascular risk and the D’Agostino scale—fundamentally among males. This may justify revision of the cutoff values beyond which patients are classified as being at high risk. The description of the characteristics of those males presenting disagreement could allow improved clinical evaluation of CVR and help identify those subjects who despite a non-high risk as determined by the SCORE, may actually have a higher cardiovascular risk than estimated by the latter scale.

These findings must be confirmed by prospective studies, though their importance is explained by the fact that they underscore the need for improved validity of the scales—particularly among males—in order to optimize their usefulness in clinical practice. Cardiovascular disease incidence and mortality studies are needed to develop risk scales based on the populations in which they are going to be used.