Comparison of CT and CMR for detection and quantification of carotid artery calcification: the Rotterdam Study.

BACKGROUND: Carotid artery atherosclerosis is an important risk factor for stroke. As such, quantitative imaging of carotid artery calcification, as a proxy of atherosclerosis, has become a cornerstone of current stroke research. Yet, population-based data comparing the computed tomography (CT) and cardiovascular magnetic resonance (CMR) for the detection and quantification of calcification remain scarce.
METHODS: A total of 684 participants from the population-based Rotterdam Study underwent both a CT and CMR of the carotid artery bifurcation to quantify the amount of carotid artery calcification (mean interscan interval: 4.9 ± 1.2 years). We investigated the correlation between the amount of calcification measured on CT and CMR using Spearman's correlation coefficient, Bland-Altman plots, and linear regression. In addition, using logistic regression modeling, we assessed the association of CT and CMR based calcification volumes with a history of stroke.
RESULTS: We found a strong correlation between CT and CMR based calcification volumes (Spearman's correlation coefficient:0.86, p-value ≤0.01). Bland-Altman analyses showed a good agreement, though CT based calcification volumes were systematically larger. Finally, calcification volume assessed with either imaging modality was associated with a history of stroke with similar effect estimates (odds ratio (OR) per 1-SD increase in calcification volume: 1.52 (95% CI:1.00;2.30) for CT, and 1.47 (95% CI:1.01;2.14) for CMR.
CONCLUSION: CT based and CMR based volumes of carotid artery calcification are highly correlated, but CMR based calcification is systematically smaller than those obtained with CT. Despite this difference, both provide comparable information with regard to a history of stroke.

Background

Atherosclerosis located at the bifurcation of the carotid artery is an important risk factor for stroke [1-5]. As such, quantification of the severity of carotid atherosclerosis has become an increasingly important topic in stroke research. Multiple non-invasive imaging techniques, including ultrasound, computed tomography (CT), and cardiovascular magnetic resonance (CMR), are currently available to obtain measures of the extent of atherosclerosis [6]. An important advantage of CT and CMR is that both modalities offer possibilities for detailed characterization and quantification of the atherosclerotic plaque [7]. The mostly studied characteristic of the atherosclerotic plaque is calcification, given that it is one of the most prominent plaque characteristics and represents a reliable marker of the underlying plaque burden [8]. For the visualization of calcification, non-contrast CT is acknowledged to be superior to any other imaging modality [9]. Yet, thanks to rapid technological advances, non-contrast CMR now also allows for the detection and quantification of calcification in the atherosclerotic plaque [10] and has the major advantage over CT that it does not involve radiation exposure. Moreover, with CMR it is possible to visualize additional plaque characteristics such as intraplaque hemorrhage or lipid-rich necrotic core which provide unique additional information on the disease. Despite these potential advantages of CMR, it remains unclear whether calcification volumes obtained with CMR are comparable to those measured with CT. Against this background, we set out to quantify and compare CT-based and CMR-based carotid artery calcification in terms of absolute volumes and with respect to the history of stroke as a relevant clinical outcome, in participants from the population-based Rotterdam Study.

Methods

Setting

This study was carried out within the framework of the Rotterdam Study, a prospective population-based study among middle-aged and elderly persons [11]. Between 2003 and 2006, all participants that visited the research center were invited to undergo multi-detector computed tomography (MDCT) to quantify vascular calcification in multiple vessels, including the carotid artery bifurcation [12]. In total 2,524 participants were scanned.

From October 2007 onwards, carotid CMR was incorporated in the Rotterdam Study. Between 2007 and 2012, we invited 2,666 participants to undergo CMR of the carotid arteries to study atherosclerotic disease. These participants were selected on the basis of the presence of atherosclerosis in at least one carotid artery on ultrasound examination (defined as intima-media thickness >2.0 mm in one or both carotid arteries), which is regularly performed in all Rotterdam Study participants. In total 1,982 participants underwent carotid CMR. From these 1,982, 808 participants had also undergone a CT-examination. Due to image artifacts or low image quality (n = 31, or errors in the CMR registration process needed for analysis (n = 93) 124 participants were excluded, leaving 684 participants with usable CT and CMR data for the current study. The mean time interval between CT scan and CMR scan was 4.9 years (standard deviation 1.2 years).

Assessment of CT-based calcification

We performed a non-enhanced CT-examination (16-or 64-slice MDCT Somatom Sensation, Siemens, Forchheim, Germany) that reached from the aortic arch to the intracranial vasculature, to visualize calcification in the extracranial carotid arteries. The detailed information regarding the scan protocol is described elsewhere [12]. In short, the following scan parameters were used: 16 x 0.75 mm collimation, 120 kVp, 100 effective mAs, and 0.5 s rotation time, with a normalized pitch of 1. Images were reconstructed with an effective slice width of 1 mm, a reconstruction interval of 0.5 mm, and a medium sharp convolution kernel [12]. Calcification in the extra-cranial carotid artery was measured bilaterally within three centimeters proximal and distal of the bifurcation and was automatically quantified with dedicated commercially available software (syngo calcium scoring, Siemens, Germany) [12]. Calcification volumes in both carotid arteries were expressed in cubic millimeters (mm3) [13] (Fig. 1).

Fig. 1

Example of calcification in the left carotid artery bifurcation (indicated by the red star) on CT (left image) and on CMR (middle image; PDw-FSE-BB sequence, and right image; magnitude image of the 3D-phase contrast sequence)

Assessment of CMR-based calcification

CMR of the carotid arteries was performed on a single 1.5-T scanner (GE Healthcare, Milwaukee, WI, USA) with a dedicated bilateral phased-array surface coil (Machnet, Eelde, The Netherlands). The high-resolution images were obtained using a standardized protocol [14]. First, both carotids were identified by means of two-dimensional (2D) time-of-flight MR angiography. Second, high-resolution CMR sequences were planned to image the carotid bifurcations on both sides. These sequences consisted of four 2D sequences in the axial plane, namely a proton density weighted (PDw)-fast spin echo (FSE)-black blood (BB) sequence (in-plane resolution 130/160 x 130/128 = 0.8 x 1 cm); a PDw-FSE-BB with an increased in-plane resolution (in-plane resolution 130/224 x 130/160 = 0.5 x 0.8 cm); a PDw-echo planar image (EPI) sequence (in-plane resolution 130/160 x 70/160 = 0.8 x 0.4 cm); and a T2w-EPI sequence (in-plane resolution 130/160 x 70/160 = 0.8 x 0.4 cm). Additionally, we performed two 3D sequences, namely a 3D-T1w-gradient echo (GRE) sequence (in-plane resolution 180/192 x 180/180 = 0.9 x 1 cm), and a 3D phased-contrast MR angiography (in-plane resolution 180/256 x 180/128 = 0.7 x 1.4 cm) (Additional file 1: Table S3). The total scanning time was approximately 30 min [14]. Calcification was evaluated bilaterally within three centimeters proximal and distal of the bifurcation [12]. All calcification measurements on CMR were performed by one trained physician under the supervision of an experienced neuroradiologist. We performed an intra- and inter-observer reproducibility analysis on a random set of 30 CMR examinations. The intra- and inter-agreement was very good [Cohens’ Kappa : 0.91 (95% CI 0.82–0.99) and 0.94 (95% CI 0.86–0.99)], respectively. We defined calcification as a hypointense region in the plaque on all sequences. We manually annotated and segmented calcification in all plaques using a standardized approach. First, we pre-processed all images using a method that has been described extensively before [15]. This starts with a bias correction to reduce the intensity inhomogeneity characteristic in CMR [15]. Subsequently, the carotid artery in all images was rigidly registered to the black-blood image space using the Elastix tool [15]. For the registration of the sequences, a Region Of Interest (ROI) around the artery in black-blood was used. This ROI was obtained semi-automatically by uniformly growing an extracted carotid artery centerline, which requires three marked seed points at the common, internal and external parts of the artery [15]. Then calcification was manually delineated in every consecutive slice using an annotation tool developed in Mevislab (MeVisLab, MeVis Medical Solutions AG). Fourth, the total volume of calcification was calculated by counting the number of voxels within the annotated areas and multiplying this by the voxel volume (Fig. 1). This provided volumes of calcification in cubic millimeters.

Assessment of history of stroke

At study entry, all participants were interviewed and a history of stroke was assessed. Moreover, after enrollment, all participants are continuously followed for the occurrence of stroke [16]. All potential stroke events were reviewed by research physicians and verified by an experienced stroke neurologist [17]. At the time of CT scan, 38 participants had suffered a prior stroke [16].

Statistical analysis

Due to skewed distributions of the calcification data, we used natural log (Ln) transformed values after we added 1.0 mm3 to the non-transformed data in order to deal with calcification scores of zero (Ln (calcification volume +1.0 mm3)) [16]. Our analysis strategy consisted of four steps. First, we investigated the correlation of CT-based calcification volumes with CMR-based calcification volumes using Spearman’s correlation coefficient. Second, we used linear regression to assess the relation between CT-based and CMR-based calcification volumes while adjusting for the time interval between the scans. Given the substantial time interval between the CT and CMR examinations, we furthermore performed a sensitivity analysis in which we analyzed the correlation between CT-based and CMR-based calcification volumes only for those persons with an interval equal or less than 3 years (n = 128). We performed post-hoc sensitivity analysis while adjusting for CT-scanner type also.

Third, we assessed the agreement between CT-based and CMR-based calcification volumes using a Bland-Altman analysis. Fourth, as a proof-of-principle, we investigated the association of CT-based and CMR-based calcification volumes (per 1-SD increase) related with a history of stroke using logistic regression while adjusting for age, sex and the time interval between CT and CMR, and studied whether the results were comparable for both modalities All analyses were carried out using IBM SPSS Statistics version 21 (International Business Machines Corporation, Armonk, New York).

Results

Table 1 shows the baseline characteristics of the study population. The mean age of participants at the time of CT examination was 68.1 years (SD: 6.1 years). There were 41.5% female participants. We found no calcification in 60 participants (8.8%). There were no instances in which calcification was found on either CT or CMR and not on the other modality. The mean Ln-transformed calcification volume for CT was 3.98 mm3 (SD: 1.86 mm3), and 2.70 mm3 (SD: 1.36 mm3) for CMR.

Table 1

Baseline characteristics of study participants

Sample size	684
Woman	41.5%
Age, years at CT scan	68.8 ± 6.1
Age, years at CMR scan	74.2 ± 6.1
CT calcification volumes, mm3a	3.98 ± 1.87a
CMR calcification volumes, mm3a	2.70 ± 1.37a
Smoking (current)	40.2%
Systolic blood pressure (mm/Hg)	146.81 ± 19.46
Diastolic blood pressure (mm/Hg)	79.84 ± 10.85
Diabetes Mellitus	13.3%
Serum total cholesterol (mmol/L)	5.6 ± 0.9
HDL cholesterol (mmol/L)	1.4 ± 0.3
Antihypertensive medication use	37.7%
Statin medication use	31.1%
Stroke events	5.6%

Values are means with standard deviations for continuous variables and percentages for dichotomous or categorical variables

Abbreviation: CT computed tomography, HDL high-density lipoprotein, CMR cardiovascular magnetic resonance

aLn-transformed volumes (Ln(calcification volume + 1 mm3))

We found a strong correlation between CT and CMR calcification volumes (Spearman’s correlation coefficient:0.86) (Fig. 2, Additional file 1: Table S1, and Additional file 1: Table S2). This correlation was similar when we investigated the left and right side separately (Additional file 1: Table S1). After performing linear regression with adjustment for the time interval between the CT and CMR scan, the prominent relation between CT-based and CMR-based calcification volumes remained present [beta per 1-SD increase in CT-based calcification volume: 0.65 (95% confidence interval (CI): 0.63;0.68)]. After performing the analyses in those persons with a time interval between the scans of less or equal to 3 years, the association between CT-based and CMR-based calcification volumes was similar [beta per 1-SD increase in CT-based calcification volume: 0.65 (95% CI: 0.58;0.72)]. Adjustment for CT-scanner type did not influence the results (data not shown).

Fig. 2

Scatter plot of Ln-transformed CT-based and CMR-based calcification volumes, indicating a positive correlation between both detected and quantified calcification volumes

Figure 3 shows the Bland-Altman plot for the relation between the absolute differences in Ln-transformed calcification volumes and the mean of the two measurements of 1.27 mm3 (standard deviation: 0.92). We found that the CT-based calcification volumes were consistently larger than those obtained from CMR.

Fig. 3

Bland-Altman plot of the difference of CT-based and CMR-based Ln-transformed total calcification volumes, with a mean absolute difference (bold continues line) and 95% confidence interval of mean differences (dashed lines)

When investigating the relationship between calcification and a history of stroke, we found that both CT-based and CMR-based calcification volumes were associated with a history of stroke [CT - odds ratio per 1-SD increase: 1.52 (95% CI: 1.00; 2.30), CMR – odds ratio per 1-SD increase: 1.47 (95% CI: 1.01; 2.14)] (Table 2).

Table 2

Association of calcification volumes with stroke

	Odds ratio (95% CI)	p-value
Model 1
CT calcification volumes	1.63 (1.09–2.46)	0.01
CMR calcification volumes	1.55 (1.07–2.24)	0.01
Model 2
CT calcification volumes	1.52 (1.00–2.30)	0.04
CMR calcification volumes	1.47 (1.01–2.14)	0.04

Model 1 - scan time difference

Model 2 –adjusted for age, sex and scan time difference. Values represent odd ratios with 95% CI per 1 standard deviation increase in calcification volumes

Abbreviation: CT computed tomography, CMR cardiovascular magnetic resonance

Discussion

In this large population-based sample of persons with subclinical atherosclerosis, we found that CT-based and CMR-based volumes of carotid artery calcification are highly correlated, but CMR-based calcification is systematically smaller than those obtained with CT. Despite this difference, both provide comparable information with regard to a history of stroke.

We found that CT-based and CMR-based calcification volumes were highly correlated. Yet, we also found that the volumes measured with CMR were systematically smaller than those measured on CT. This was especially interesting in light of the fact that the CMR was performed on average 4 years later than the CT. Given that our scanning protocol on CT was specifically designed for the visualization of vascular calcification combined with that CT is currently the gold standard for the assessment calcification, it is likely that with CMR the amount of calcification is systematically underestimated [6]. The reason for this could the differences between CT-based and CMR-based calcification volume may be explained by differences in image analysis to a certain extent. Additionally, differences in spatial resolution between CT and CMR might be a potential explanation for this difference. In this light, it is important to note that CT images were analyzed automatically using dedicated commercially available software, whilst CMR images were analyzed manually for the presence and amount of calcification. To our knowledge, there are no studies that have compared CT and CMR on the detection and quantification of carotid artery using a non-invasive population-based approach. Previous research performed on the comparison between CT and CMR in 50 patients with recent TIA or minor stroke, demonstrated a correlation between CT-based and CMR-based calcification volumes of the only p: 0.55 [18]. We demonstrate that with the use of dedicated CMR-multi-sequences for the detection of calcification the correlation between CT-based and CMR-based calcification volume is substantially improved. Finally, another important topic to consider with regard to the difference between CT and CMR is the blooming effect of calcifications which is known to occur on CT [19]. Especially for calcifications with very high Hounsfield units, a gradient over multiple adjacent pixels is necessary to reach a low Hounsfield unit. This effect may lead to slight overestimation of the calcification area. On the other hand, CMR is known to underestimate the amount of calcification, because a certain amount of calcification is required before the MR-signal disappears. In this context, it is important to acknowledge that possible micro-calcifications in the atherosclerotic plaque may be missed [20].

As a proof of principle, we investigated the association of CT-based and CMR-based calcification with a history of stroke and found that both related to this outcome with comparable effect estimates. We chose history of stroke because the relationship between carotid artery calcification and stroke has been well-established [16, 21, 22]. Importantly, despite the fact that CMR systematically underestimates the amount of calcification compared to CT, we found comparable risk estimates for CT-based and CMR-based calcification volumes with respect to a history of stroke. This suggests that when assessing clinical outcomes, the value of CMR-based calcification is similar to that of CT.

Our findings have implications that should be considered in the choice for CMR or CT for the assessment of vascular calcification. First, while assessing atherosclerosis with CMR it is directly possible to visualize other plaque characteristics in addition to calcification, including intra-plaque hemorrhage and lipid-rich necrotic core which provide unique additional information on the disease. Second, CMR has the major advantage over CT that it does not involve harmful radiation exposure. Third, the systematic underestimation of calcification on CMR may pose a problem, specifically in situations where one is particularly interested in the exact amount of calcification. Fourth, drawbacks of CMR, in general, are its absolute contraindications (i.e. metal objects in the body), and the fact that CMR is more time-consuming, more expensive and less widely available than CT. Taken together, the pros and cons of both imaging modalities should be carefully considered for all research and clinical applications involving the assessment of vascular calcification.

The strengths of our study include the relatively large sample size of community-dwelling individuals, all with varying degrees of carotid atherosclerosis, and the standardized assessment of calcification volumes on both modalities. Yet, some limitations should also be taken into account of which the first is the time interval between the CT scan and the CMR scan, with a mean interval of 4.9 years. We acknowledge that the interscan interval represents a potential limitation of the current study and that during this interval there may have been slight changes in plaque composition. Yet, we would like to emphasize that in all instances the CT-scan was made before the CMR-scan and that calcification is a plaque component that generally remains present and shows only very slow progression over time [23, 24]. Therefore, it seems unlikely that the amount of calcification at the time of CMR would differ substantially from that at the time of the CT. This is further supported by the fact that adjustment for the time interval did not change the results; and secondly by our finding that CMR volumes were consistently estimated somewhat smaller than CT volumes, whereas a large influence of the time interval would induce an opposite difference. Another potential limitation is that we used two types of MDCT scanners (16-slice and 64-slice) to assess calcification. Yet, adjustment for scanner-type did not change the association.

Conclusion

In summary, CT-based and CMR-based volumes of carotid artery calcification are highly correlated, but CMR-based calcification is systematically smaller than those obtained with CT. Despite this difference, both provide comparable information with regard to a history of stroke.