The diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis compared with liver biopsy: a meta-analysis.

OBJECTIVE: To meta-analyse the diagnostic accuracy of US, CT, MRI and 1H-MRS for the evaluation of hepatic steatosis.
METHODS: From a comprehensive literature search in MEDLINE, EMBASE, CINAHL and Cochrane (up to November 2009), articles were selected that investigated the diagnostic performance imaging techniques for evaluating hepatic steatosis with histopathology as the reference standard. Cut-off values for the presence of steatosis on liver biopsy were subdivided into four groups: (1) >0, >2 and >5% steatosis; (2) >10, >15 and >20%; (3) >25, >30 and >33%; (4) >50, >60 and >66%. Per group, summary estimates for sensitivity and specificity were calculated. The natural-logarithm of the diagnostic odds ratio (lnDOR) was used as a single indicator of test performance.
RESULTS: 46 articles were included. Mean sensitivity estimates for subgroups were 73.3-90.5% (US), 46.1-72.0% (CT), 82.0-97.4% (MRI) and 72.7-88.5% (1H-MRS). Mean specificity ranges were 69.6-85.2% (US), 88.1-94.6% (CT), 76.1-95.3% (MRI) and 92.0-95.7% (1H-MRS). Overall performance (lnDOR) of MRI and 1H-MRS was better than that for US and CT for all subgroups, with significant differences in groups 1 and 2.
CONCLUSION: MRI and 1H-MRS can be considered techniques of choice for accurate evaluation of hepatic steatosis.

Introduction

The prevalence of hepatic steatosis is increasing rapidly worldwide. This is largely attributed to the association with obesity and insulin resistance in non-alcoholic fatty liver disease (NAFLD) [1, 2].

Detection and quantification of hepatic steatosis is clinically important. In NAFLD, steatosis is the hepatic manifestation of the metabolic syndrome and the earliest biomarker for the development of liver fibrosis in the more severe condition of non-alcoholic steatohepatitis (NASH). Early diagnosis and treatment of NASH can prevent the potential development of cirrhosis and hepatocellular carcinoma (HCC) [3-5]. In hepatitis C, steatosis is associated with more severe fibrosis and rapid disease progression [6, 7]. In liver transplantation surgery, the presence of steatosis impairs the regenerative capacity of the liver in both donor and recipient [8, 9].

Liver biopsy remains the reference test for the evaluation of hepatic steatosis, despite well-established drawbacks regarding its invasiveness and sampling error due to small sample size and inter-observer variability [10].

Many studies have focused on the role of imaging techniques as a non-invasive alternative to liver biopsy for detecting and quantifying hepatic steatosis [11-13]. The reported sensitivities and specificities between different imaging techniques and between different studies investigating the same technique vary substantially. Although magnetic resonance spectroscopy (1H-MRS)—generally considered the best technique—is increasingly used as a reference standard instead of liver biopsy, no evidence-based consensus currently exists on this topic.

The purpose of this systematic review therefore was to summarise the available literature on the accuracy of ultrasound (US), computed tomography (CT), magnetic resonance imaging (MRI) and 1H-MRS for the evaluation of hepatic steatosis with histopathology as the reference test. Subsequently, we aimed to identify the most accurate technique by meta-analysis.

Materials and methods

Literature search and study selection

We searched the MEDLINE (January 1966–November 2009), EMBASE (January 1980–November 2009), CINAHL and Cochrane databases without language restrictions with the assistance of an experienced clinical librarian. We combined Medical Subject Headings (MeSH) terms and accompanying entry terms for the patient group (patients with hepatic steatosis) and the index test (US, CT, MRI, 1H-MRS). The search strategy is described in detail in Online Resource 1.

Two reviewers (A.B. and J.v.W) read the titles and abstracts of all the articles obtained to select potentially relevant papers (original papers that addressed the diagnostic accuracy of US, CT, MRI or 1H-MRS for detecting hepatic steatosis in humans with histopathology as the reference test in ≥10 individuals). The reference lists of selected papers and of narrative reviews were screened for search completion.

The full texts of potentially relevant papers were reviewed for inclusion by the same reviewers independently. Inclusion criteria were: (a) hepatic steatosis was evaluated with US, CT, MRI and/or 1H-MRS; (b) imaging techniques met the minimum technical requirements of grey scale and real time for US; ≤120 kV for CT and ≥1 Tesla for MRI; (c) histopathology as the reference test; (d) evaluation of ≥10 human individuals; (e) criteria for a positive index test were clearly explained; (f) examination method of steatosis on liver biopsy was clearly explained; (g) data on diagnostic accuracy were reported. Exclusion criteria were: (a) duplicate publication; (b) reporting of combined data for different imaging techniques or data on the single technique could not be extracted; (c) no original research. Papers were not blinded with regard to authors’ names, affiliations or journal. The reviewers resolved all disagreements about inclusion and data extraction by consensus after face-to-face discussion.

Data extraction

From the articles included, the reviewers (A.B. and J.v.W.) independently recorded data using a standardised form. Papers were translated if necessary.

Methodological quality

Methodological quality was assessed based on the Quality Assessment of Studies of Diagnostic Accuracy included in Systematic Reviews (QUADAS) guidelines [14]. To be reasonably sure that the condition of the liver did not change between the two tests we chose a period of 1 month as a quality indicator [15, 16]. Additionally, we noted whether the study design was prospective or retrospective.

Patient characteristics

For each study, we extracted data on (a) sample size; (b) male-female ratio; (c) patient age; (d) body mass index (BMI) and (e) patient spectrum.

Imaging features and evaluation

For each imaging technique we recorded (a) the number of patients; (b) the criteria used for steatosis evaluation and (c) the cut-off values used. We noted whether cut-off values were defined prospectively or retrospectively. Additionally, for US we noted the type and frequency of the probe(s) used. For CT we noted: (a) the type of CT and (b) the imaging parameters (kV and mAs). For MRI, we noted: (a) magnetic field strength; (b) imaging sequence; (c) imaging parameters used; (d) whether breath holds were used; and (e) correction for T2* effects. For 1H-MRS, we noted: (a) magnetic field strength; (b) imaging sequence; (c) imaging parameters; (d) voxel size; (e) whether breath holds were used and (f) correction for T1 or T2 effects.

Reference test

For liver biopsy we included data on: (a) the number of patients biopsied; (b) cut-off values for steatosis grades and whether the presence of (c) fibrosis (d) inflammation and (e) iron was evaluated in the biopsy specimen.

Data for calculation of diagnostic accuracy

We extracted available data on true-positives (TP), false-negatives (FN), false-positives (FP) and true-negatives (TN) for detecting steatosis with the selected imaging technique to construct 2 × 2 contingency tables. Available 3 × 3 and 4 × 4 tables were dichotomised. Many different cut-off values for positive results (steatosis present) on liver biopsy were compared to the imaging techniques. We therefore grouped accuracy results from cut-off values that were almost equal into four subgroups to enable meta-analysis:

Cut-off values of >0%, >2% and >5% steatosis on biopsy;

Cut-off values of >10%, >15% and >20% steatosis on biopsy;

Cut-off values of >25%, >30% and >33% steatosis on biopsy and the qualitative designation of “moderate or severe” steatosis;

Cut-off values of >50%, >60% and >66% steatosis on biopsy and the qualitative designation of “severe” steatosis.

During analysis we corrected for dependent data such as results presented for different readers or for multiple imaging techniques within one study population. For CT and MRI, we did not use data obtained by subjective visual evaluation of examinations for analysis. If raw data in terms of 2 × 2 tables were unavailable, we attempted to contact authors for completion or verification of data.

Data analysis

We performed bivariate random-effects analysis for the pooled sensitivities and specificities per cut-off value group for each imaging technique [17]. In this analysis, the logit-transformed sensitivities and logit-transformed specificities from individual studies in a meta-analysis are assumed to follow a bivariate normal distribution around a mean logit sensitivity and a mean logit specificity. After antilogit transformation, summary estimates of sensitivity and specificity with 95% confidence intervals were calculated. Additionally, we calculated the natural logarithm (ln) of the diagnostic odds ratio (DOR): [logit sensitivity + logit specificity]. The DOR is a single indicator of test performance [18]. A higher lnDOR value indicates a better discriminatory test performance. If the lnDOR is not significantly different from 0, a test does not discriminate between patients with the disorder and those without it. We performed z-tests to compare sensitivities, specificities and lnDORs between imaging techniques. A p value < 0.05 was considered statistically significant. All meta-analyses were performed with SAS statistical software (version 9.1, SAS institute, Cary, NC, USA).

Results

The literature search yielded 6992 unique references (Fig. 1). The reviewers selected 179 potentially relevant articles after reading the titles and abstracts of which 46 papers were finally included [15, 19–63]. Twenty-eight evaluated US, twelve evaluated CT, ten evaluated MRI and five evaluated 1H-MRS. Eight papers compared two imaging techniques [22, 23, 43, 47, 54, 58, 61, 62] and one evaluated three techniques within the same population [56] (Table 1). Two studies were published in German [28, 45] and the remaining in English.

Fig. 1

Flow diagram of the articles included

Table 1

Patient and design characteristics of 46 papers included

Study	Technique	Designa	No of patients analysed (m/f)	Patient spectrum (n)	Time interval between reference test and index test
Yajima 1983	US	P	45 (ND/ND)	10 fatty liver; 8 chronic/acute hepatitis; 17 cirrhosis; 1 PSC; 9 other	≤14 days
Korte 1986	US	P	100 (67/33)	Suspected liver disease: alcohol abuse, diabetes, obesity	Mean 1.9 weeks
Saverymuttu 1986	US	P	85 (ND/ND)	50 ALD; 12 active hepatitis; 2 CPH; 3 PBC; 2 cryptogenic cirrhosis; 7 other; 4 normal	≤28 days
Lossner 1988	US	P	187 (ND/ND)	Suspected liver disease	Mean 11 days
Joseph 1991	US	P	50 (ND/ND)	30 ALD; 5 chronic persistent/reactive hepatitis; 4 cryptogenic cirrhosis; 2 PBC; 9 other	0 days
Caturelli 1992	US	P	35 (21/14)	Suspected liver disease	Unclear
Hultcrantz 1993	US	P	83 (47/36)	45 fatty liver; 14 cirrhosis; 11 chronic inflammation; 13 other	0 days
Dietrich 1998	US	P	68 (40/28)	HCV	Unclear
Kutcher 1998	US	R	64 (39/25)	HCV	Unclear
Graif 2000	US	P	28 (ND/ND)	12 HCV; 1 HBV; 1 PBC; 3 non alcoholic cirrhosis; 11 other	≤7 days
Rinella 2001	CT, MRI	R	33 (19/14)	Potential living liver donors	Unclear
Mathiesen 2002	US	P	165 (110/55)	65 NAFLD; 25 HCV; 14 ALD; 3 NASH; 3 AIH; 2 PBC; 1 A-1-antitrypsin deficiency; 52 non-specific	87% ≤ 28 days;
Saadeh 2002	US, CT, MRI	P	25 (11/14)	8 NAFLD; 17 NASH	≤90 days
Kichian 2003	US	R	49 (25/24)	NAFLD	Unclear
Rinella 2003	MRI	ND	22 (13/9)	15 potential living liver donors; 7 NAFLD	Unclear
Iwasaki 2004	CT	P	266 (137/129)	Living liver donors	Unclear
Limanond 2004	CT	R	42 (29/13)	Potential living liver donors	≤28 days
Hepburn 2005	US	R	164 (108/56)	HCV	Mean 1–2 months; range 0–6 months
Kim SH 2005	US	R	94 (71/23)	Potential living liver donors	Mean 39.9 days; range 0–140 days
Kim SH 2006	MRI	R	57 (40/17)	Potential living liver donors	Mean 14.5 days ± 18.8 days; range 0–124 d
Palmentieri 2006	US	P	235 (127/108)	146 HCV; 30 HBV; 3 HCV/HBV; 33 NAFLD; 23 other	Unclear
Park 2006	CT	P	154 (104/50)	Potential living liver donors	0 days
Hamaguchi 2007	US	P	94 (ND/ND)	68 NAFLD; 26 no disease	≤30 days
Hirche 2007	US	P	122 (78/44)	HCV	Unclear
Lee JY 2007	US, CT	R	589 (408/181)	Potential living liver donors	Unclear
Lee SW 2007	CT	R	48 (44/4)e	Living liver donors	0 days
Perez 2007	US	R	131 (78/53)	116 HCV; 5 HBV; 10 other	≤9 months
Bahl 2008	MRI	P	52 (15/37)	29 NAFLD; 23 HCV/HIV	≤4 months
Chen 2008	US	R	108 (75/33)	108 HCV	Unclear
Cho 2008	MRI, CT	R	131 (66/65)	Liver resection for benign (5) or malignant disease (126)	Median 17 days
Moura Almeida 2008	US	P	105 (26/79)	Bariatric surgery	Unclear
Orlacchio 2008	1H-MRS	P	30 (17/13)	HCV	≤30 days
Yoshimitsu 2008	CT, MRI	R	58 (35/23)	38 potential living liver donors; 20 liver metastases	≤14 days
Crum-Cianflone 2009	US	P	216 (204/12)	HIV	Mean 5.2 months ± 3.6 months
Dasarathy 2009	US	P	73 (48/25)	38 HCV; 21 NAFLD; 7 HBV; 7 other	0 days
d’Assignies 2009	MRI, 1H-MRS	P	20 (15/5)	14 NAFLD; 6 ALD	≤60 days
Friedrich-Rust 2009 (Epub)	1H-MRS	P	45 (1/44)	PBC	Median 21 days; range 0–6 months
Kim DY 2009 (Epub)	CT	P	179 (115/64)	Potential living liver donors	0 days
Krssak 2009 (Epub)	1H-MRS	P	29 (16/13)	HCV	0 days
McPherson 2009	MRI, 1H-MRS	P	94 (66/28)	37 HCV; 23 fatty liver; 11 HBV; 7 AIH/PBC; 6 colorectal metastases; 10 other	Median 9 days (range 0–209 days)
Mennesson 2009	MRI	P	40 (20/20)	10 NAFLD; 9 ALD; 4 AIH; 4 cryptogenic liver disease; 6 other	0 days
O’Rourke 2009	MRI	P	37 (23/14)	colorectal liver metastases	Unclear
Tobari 2009	US, CT	R	118 (52/66)	NASH	≤6 months
Webb 2009	US	R	111 (60/51)	43 NAFLD; 56 HCV; 3 HBV; 9 other	0 days
Yamashiki 2009	US, CT	P	78 (63/15)	Potential living liver donors	Unclear
Yu 2009	US	P	180 (102/78)	171 fatty liver; 8 NASH; 1 cirrhosis	Unclear

Epub Published online ahead of print, ND Not defined, BMI Body Mass Index, PSC Primary Sclerosing Cholangitis, ALD Alcoholic Liver Disease, CPH Chronic Persistent Hepatitis, PBC Primary Biliary Cirrhosis, HBV Hepatitis B Virus, HCV Hepatitis C Virus, NASH Non-alcoholic Steatohepatitis, HIV Human Immunodeficiency Virus, NAFLD Non-alcoholic Fatty Liver Disease, AIH Auto-immune Hepatitis

aP = prospective study design; R = retrospective study design

bUnless noted otherwise, data are mean ± standard deviation, with the range in parentheses

cMedian

dStandard error

e24 healthy individuals were matched with 24 patients for age and sex; Data for mean age ± SD are based on patient group (n = 24)

An overview of the results is given in Fig. 2. In general, 13 out of 46 (28%) studies fulfilled at least 10 of the 13 methodological criteria [19, 20, 25, 29, 33, 34, 36, 38, 41, 44, 48, 49, 52]. A complete table of individual study scores is available upon request from the authors.

Fig. 2

Study design characteristics of the 46 studies included

The 46 papers comprised 4715 patients with a median study size of 81 patients (range 20–589). Mean age reported by 37 studies was 44.5 years (range 11–89). Mean BMI reported by 18 studies was 26.6 kg/m2 (range 15–54 kg/m2). The male-to-female ratio reported in 40 studies was 1.62:1. Potential living liver donors constituted 34% of the total population (1593/4715). If specified, the disease spectrum comprised most frequently chronic hepatitis C (n = 1040) and NAFLD/NASH (n = 710). See also Table 1.

US imaging features are outlined in Online Resource 2. More than half (15/28) of the studies used the widely accepted criteria for subjective visual steatosis evaluation of bright liver with increased liver-kidney contrast; blurring of intrahepatic vessels and diaphragm and loss of echoes of posterior hepatic segments [57, 60]. Two studies evaluated quantitative methods to assess liver steatosis [30, 59].

CT imaging features are shown in Online Resource 3. Two papers evaluated both contrast-enhanced CT and unenhanced CT [22, 38]. All other papers evaluated unenhanced CT. Average Hounsfield Units (HU) in selected regions of interests (ROIs) from the liver were compared with average HU values of ROIs from the spleen. The spleen was used as an internal reference in all the papers included, either by measuring the liver-minus-spleen attenuation value (L-S) or the liver-to-spleen ratio (L/S). Two studies also evaluated steatosis by subtracting hepatic blood attenuation from the total hepatic attenuation using an algorithm. Four papers had defined cut-off values prospectively [22, 43, 58, 61]. Six papers defined optimal cut-off values retrospectively [15, 35, 38, 44, 52, 62]. The chosen cut-off values, however, varied substantially.

MRI characteristics are outlined in Online Resource 4. Magnetic field strength for all included papers was 1.5 Tesla. Sequences used were T1-weighted dual spin echo, T1-weighted dual gradient echo or T1-weighted spoiled gradient echo for in-phase and out-of-phase (IP/OP) chemical shift imaging. Two studies also evaluated T2-weighted fast spin echo imaging with and without fat suppression (±FS). Liver steatosis was evaluated by the amount of signal intensity (SI) loss on OP images compared with IP images and by SI difference between FS and non-FS images. Exact measuring methods, however, differed. Correction for T2* effects was performed by d’Assignies et al [24]. Cho et al were the only authors to define cut-off values prospectively [22].

1H-MRS imaging characteristics are outlined in Online Resource 5. Magnetic field strengths were 1.5 T(3/5) and 3 T (2/5). Four papers used a point-resolved spectroscopic sequence (PRESS), one in combination with chemical-shift selective water suppression (CHESS). Krššák et al used a stimulated echo acquisition mode (STEAM) sequence [41]. Voxel sizes varied from 18 × 18 × 18 mm to 30 × 30 × 40 mm. Hepatic steatosis was evaluated by the ratio of lipid versus water peaks and by the choline-to-lipid ratio. One paper each corrected for T2 effects or T1 and T2 effects [24, 41]. All included studies defined cut-off values retrospectively.

Details of the reference test are outlined in Online Resource 6. Cut-off values for grading steatosis severity differed among the articles included, complicating their comparison. Two studies compared semi-quantitative visual analysis of steatosis with the automatic vacuole segmentation method [24] or gas-liquid chromatography [41]. Thirty studies examined the presence of fibrosis, 24 examined the presence of inflammatory activity and eight studies examined the presence of iron.

Extraction of 2 × 2 accuracy data resulted in 48 complete data sets for US; 33 for CT; 15 for MRI and 7 for 1H-MRS. For both CT and MRI, 5 datasets were not included for analysis because the examinations were visually assessed. This resulted in 28 datasets being analysed for CT and 10 datasets being analysed for MRI. Datasets with TP and FN only were also included for analysis: 4 for US and 1 for CT. The number of datasets per cut-off group is noted in Table 2. Six authors were contacted for completion or verification of data; three answered of which one supplied additional datasets. Three studies reported data-sets for multiple readers [30, 31, 39].

Table 2

Summary estimates of US, CT, MRI and 1H-MRS per combined cut-off value group

Group 1: >0%, >2%, >5% steatosis as positives on biopsy b
			p-value
	n a	Sensitivity (95% CI)	US	CT	MRI
US	19	73.3 (62.2–82.1)	–	–	–
CT	6	46.1 (22.2–71.8)	NS	–	–
MRI	5	82.0 (63.7–92.2)	NS	0.02	–
1H-MRS	3	88.5 (76.6–94.7)	0.04	<0.01	NS
	n a	Specificity (95% CI)	US	CT	MRI
US	19	84.4 (76.2–90.1)	–	–	–
CT	6	93.5 (86.2–97.7)	NS	–	–
MRI	5	89.9 (81.0–94.9)	NS	NS	–
1H-MRS	3	92.0 (80.5–97.0)	NS	NS	NS
	n a	ln DOR (95% CI)	US	CT	MRI
US	19	2.70 (1.97–3.43)	–	–	–
CT	6	2.50 (1.13–3.87)	NS	–	–
MRI	5	3.70 (2.50–4.90)	NS	NS	–
1H-MRS	3	4.48 (3.15–5.81)	0.02	0.04	NS
Group 2: >10%, >15%, >20% steatosis as positives on biopsy c
			p-value
	n a	Sensitivity (95% CI)	US	CT	MRI
US	5	90.5 (79.3–96.0)	–	–	–
CT	8	57.0 (51.5–62.3)	<0.01	–	–
MRI	2	90.0 (73.2–96.7)	NS	<0.01	–
1H-MRS	2	82.6 (61.8–93.3)	NS	0.02	NS
	n a	Specificity (95% CI)	US	CT	MRI
US	5	69.6 (60.0–77.7)	–	–	–
CT	8	88.1 (81.1–92.7)	<0.01	–	–
MRI	2	95.3 (83.2–98.8)	<0.01	NS	–
1H-MRS	2	94.3 (79.8–98.6)	0.01	NS	NS
	n a	ln DOR (95% CI)	US	CT	MRI
US	5	3.09 (2.08–4.09)	–	–	–
CT	8	2.28 (1.70–2.87)	NS	–	–
MRI	2	5.22 (3.36–7.07)	0.05	<0.01	–
1H-MRS	2	4.36 (2.57–6.15)	NS	0.03	NS
Group 3: >25%, >30%, >33% steatosis as positives on biopsy d
			p-value
	n a	Sensitivity (95% CI)	US	CT	MRI
US	19	85.7 (78.4–90.8)	–	–	–
CT	15	72.0 (59.7–81.7)	0.03	–	–
MRI	3	97.4 (83.5–99.6)	NS	0.01	–
1H-MRS	2	72.7 (41.4–91.0)	NS	NS	0.03
	n a	Specificity (95% CI)	US	CT	MRI
US	19	85.2 (76.9–90.9)	–	–	–
CT	15	94.6 (88.1–97.7)	0.03	–	–
MRI	3	76.1 (49.6–91.2)	NS	0.02	–
1H-MRS	2	95.7 (84.5–98.9)	NS	NS	0.04
	n a	ln DOR (95% CI)	US	CT	MRI
US	19	3.54 (2.80–4.29)	–	–	–
CT	15	3.82 (2.79–4.85)	NS	–	–
MRI	3	4.77 (2.46–7.08)	NS	NS	–
1H-MRS	2	4.09 (2.15–6.04)	NS	NS	NS
Group 4: >50%, >60%, >66% steatosis as positives on biopsy
	n a	Sensitivity (95% CI)
US	9	91.1 (63.0–98.4)
CT	0	–
MRI	0	–
1H-MRS	0	–
	n a	Specificity (95% CI)
US	9	91.9 (74.3–97.8)
CT	0	–
MRI	0	–
1H-MRS	0	–
	n a	ln DOR (95% CI)
US	9	4.75 (3.41–6.08)
CT	0	–
MRI	0	–
1H-MRS	0	–

Ln DOR = logit sensitivity + logit specificity. NS = not significant

aNumber of datasets analysed

bFor CT and MRI: Only data for >0% and >5% available

cFor US and 1H-MRS: Only data for >10% steatosis available

dCT includes data for >25% and >30% steatosis only; MRI includes data for >30% only; 1H-MRS includes data for >30% and >33% only

Data-analysis

Sensitivity and specificity values including 95% confidence intervals (CI) and significant differences (p < 0.05) for the imaging techniques are presented in Table 2 and in more detail in the Online Resources 7–10.

Group 1 (cut-off values of >0%, >2% and >5% steatosis)

Sensitivity and specificity estimates were 73.3% and 84.4% for US; 46.1% and 93.5% for CT; 82.0% and 89.9% for MRI and 88.5% and 92.0% for 1H-MRS, respectively. The sensitivity of 1H-MRS was significantly higher than that of US (p = 0.04) and CT (p < 0.01) and the sensitivity of MRI was significantly higher than that of CT (p = 0.02). No significant differences in specificity were found. The lnDOR of 1H-MRS was significantly higher compared with US (p = 0.02) and CT (p = 0.04).

Group 2 (cut-off values of >10%, >15% and >20% steatosis)

Sensitivity and specificity estimates were 90.5% and 69.6% for US; 57.0% and 88.1% for CT; 90.0% and 95.3% for MRI and 82.6% and 94.3% for 1H-MRS, respectively. CT had a significantly lower sensitivity compared with US, MRI and 1H-MRS (p < 0.01, p < 0.01 and p = 0.02 respectively). Although US had a sensitivity comparable to MRI and 1H-MRS, the specificity was significantly lower than CT (p < 0.01), MRI (p < 0.01) and 1H-MRS (p = 0.01). The lnDOR of MRI was significantly higher than the lnDOR for both US (p = 0.05) and CT (p < 0.01). 1H-MRS had a significantly higher lnDOR than CT (p = 0.03).

Group 3 (cut-off values of >25%, >30% and >33% steatosis)

Sensitivity and specificity estimates were 85.7% and 85.2% for US; 72.0% and 94.6% for CT; 97.4% and 76.1% for MRI and 72.7% and 95.7% for 1H-MRS, respectively. The sensitivity of MRI was significantly higher than CT (p = 0.01) and 1H-MRS (p = 0.03). The specificity of MRI however was significantly lower than both CT (p = 0.02) and 1H-MRS (p = 0.04). Further, the sensitivity for US was significantly higher than for CT (p = 0.03), the specificity for US was significantly lower than for CT (p = 0.03). Analysis of the lnDOR did not show any significant differences.

Group 4 (cut-off values of >50%, >60% and >66% steatosis)

For this group, data analysis was possible for US only. Sensitivity and specificity estimates were 91.1% and 91.9% respectively.

Figure 3 shows the diagnostic performances (lnDOR) of all imaging techniques per cut-off value group, illustrating the better performance for both MRI and 1H-MRS compared with US and CT.

Fig. 3

Comparison of logarithmic diagnostic odds ratios of US, CT, MRI and 1H-MRS

Discussion

Our results show that MRI and 1H-MRS perform better than US and CT over the total range of cut-off values that were analysed. For the lower cut-off ranges, we found significant differences in favour of both MRI and 1H-MRS.

These findings suggest that MRI and 1H-MRS also perform better than US and CT for detecting separate disease grades, especially for mild disease (<30% steatosis). This is of value in clinical practice when an accurate estimation of the amount of hepatic steatosis is needed. Additional benefits of MRI and 1H-MRS over US are the quantitative measurements which are less subject to inter- and intraobserver variability [64]. For CT, drawbacks are the radiation exposure and factors affecting the accuracy of the results, such as imaging parameters or iron accumulation [11, 65].

Several limitations of our study must be considered. First, the studies included showed great heterogeneity regarding patient spectrum, reference test, index test and data reporting. Therefore, comparison of separate disease grades and sub-analysis of different aetiologies of steatosis (e.g. NALFD/NASH versus HCV) was precluded. Standardisation of future study designs is needed to enable these comparisons. Moreover, no studies compared all four imaging techniques within the same population, which would be the ideal study design. We were therefore restricted to summarising accuracy data for each technique separately across all the studies included. These indirect comparisons of studies, which showed substantial methodological heterogeneity, might have biased our results.

Second, we had to make the decision to group accuracy results from different cut-off values into four subgroups to enable meta-analysis and to reduce the number of summary estimates and comparisons. The ideal situation would have been to analyse accuracy results for each cut-off value separately.

Third, a standard method for meta-analysis of diagnostic studies is the summary Receiver Operating Characteristic (sROC). For the sROC approach, a negative correlation between the logit sensitivity and the logit specificity is required [17]. As we did not find this negative correlation in our data, plotting of sROC curves was not possible. We therefore used the lnDOR to summarise our results.

Fourth, we did not analyse 3 × 3 or 4 × 4 data as the reporting thereof was scarce. By dichotomising the results, we lost information on the capability of imaging techniques to diagnose the degree of steatosis.

A fifth limitation was that we chose to exclude articles with 1H-MRS as the reference standard [66-73]. 1H-MRS is increasingly used as a reference standard for steatosis quantification since the results from the Dallas Heart Study were published by Szczepaniak et al in 2005 [74]. However, no clear consensus on this topic currently exists. The articles that were excluded all compared MRI with 1H-MRS and showed good correlations. Therefore, only a small number of datasets were available for analysis of MRI. Additionally, the included articles for MRI did not evaluate triple-echo, multi-echo or multi-interference techniques, whereas the aforementioned excluded articles did. Guiu et al recently suggested that these new techniques should replace the classical dual-echo chemical shift imaging methods, which are not reliable for quantification of liver fat in the case of liver iron overload because of T2* effects [75]. We believe that the small number of available data in combination with the techniques used could have negatively influenced our accuracy results for MRI.

We therefore recommend that consensus on the role of 1H-MRS as the reference standard needs to be established. For liver biopsy evaluation, we recommend using the classification from Kleiner et al for a uniform grading of hepatic steatosis [76].

In conclusion, we have shown that MRI and 1H-MRS are most accurate for the detection of hepatic steatosis. For future research, it is important to improve the study design and reporting of accuracy results.

Below is the link to the electronic supplementary material.

Details of search strategy (DOC 45 kb)

US imaging features (DOC 62 kb)

CT imaging features (DOC 54 kb)

MR imaging features (DOC 49 kb)

1H-MRS imaging features (DOC 36 kb)

Characteristics of liver biopsy examination (DOC 76 kb)

US accuracy (DOC 192 kb)

CT accuracy (DOC 129 kb)

MRI accuracy (DOC 107 kb)

1H-MRS accuracy (DOC 74 kb)