Colonic lesion characterization in inflammatory bowel disease: A systematic review and meta-analysis.

AIM: To perform a systematic review and meta-analysis for the diagnostic accuracy of in vivo lesion characterization in colonic inflammatory bowel disease (IBD), using optical imaging techniques, including virtual chromoendoscopy (VCE), dye-based chromoendoscopy (DBC), magnification endoscopy and confocal laser endomicroscopy (CLE).
METHODS: We searched Medline, Embase and the Cochrane library. We performed a bivariate meta-analysis to calculate the pooled estimate sensitivities, specificities, positive and negative likelihood ratios (+LHR, -LHR), diagnostic odds ratios (DOR), and area under the SROC curve (AUSROC) for each technology group. A subgroup analysis was performed to investigate differences in real-time non-magnified Kudo pit patterns (with VCE and DBC) and real-time CLE.
RESULTS: We included 22 studies [1491 patients; 4674 polyps, of which 539 (11.5%) were neoplastic]. Real-time CLE had a pooled sensitivity of 91% (95%CI: 66%-98%), specificity of 97% (95%CI: 94%-98%), and an AUSROC of 0.98 (95%CI: 0.97-0.99). Magnification endoscopy had a pooled sensitivity of 90% (95%CI: 77%-96%) and specificity of 87% (95%CI: 81%-91%). VCE had a pooled sensitivity of 86% (95%CI: 62%-95%) and specificity of 87% (95%CI: 72%-95%). DBC had a pooled sensitivity of 67% (95%CI: 44%-84%) and specificity of 86% (95%CI: 72%-94%).
CONCLUSION: Real-time CLE is a highly accurate technology for differentiating neoplastic from non-neoplastic lesions in patients with colonic IBD. However, most CLE studies were performed by single expert users within tertiary centres, potentially confounding these results.

Core tip: In vivo lesion characterization in colonic inflammatory bowel disease presents many challenges. Lesions tend to be morphologically different and potentially associated with surrounding/overlying inflammation, obscuring the pit pattern. The ability to accurately characterize lesions in vivo could reduce costs and complications by decreasing the need for polypectomies. Virtual chromoendoscopy (VCE) and dye-based chromoendoscopy currently cannot be recommended for lesion characterization. Confocal laser endomicroscopy is an accurate technology at differentiating neoplastic from non-neoplastic lesions but studies within this meta-analysis involved single expert center with single advanced endoscopic operators, reducing its generalizability. Larger studies are required specifically looking at lesion characterization, especially with rapid technological advancements in VCE (Narrow band imaging, i-scan, Fujinon intelligence chromoendoscopy).

INTRODUCTION

The association between colonic inflammatory bowel disease (IBD) and colorectal cancer (CRC) has been acknowledged for almost 100 years[1]. Several meta-analyses have attempted to estimate this increased risk with varying results, reflecting the heterogeneity of studies included[2-4]. Nevertheless all agree that disease duration, disease activity and extent of IBD increase the risk for developing CRC. In response, surveillance colonoscopy is recommended by most gastroenterology societies worldwide. Yet, there is still disparity amongst the societies with regards timing of surveillance intervals.

Most CRC within IBD is thought to develop along the inflammation-dysplasia-cancer pathway; however in rare cases it may not always evolve in this stepwise fashion, and its rate of transition could potentially be accelerated in some lesions[5].

With advancements in endoscopic technology and recommendations for surveillance during inactive disease, most dysplasia is now believed to be visible[6]. Gastroenterological societies currently advocate targeted biopsies for detection of dysplasia, owing to the low yield from random biopsies, with evidence supporting dye-based chromoendoscopy (DBC) for enhancing lesion detection[6-8]. An international consensus group in 2015 recommended that dysplastic polypoid or non-polypoid lesions within a colitic segment should be treated as significant and that well circumscribed lesions with no endoscopic features of submucosal invasion can now be resected[6]. The risk for developing CRC following complete endoscopic resection is now thought to be lower than previous studies suggested[9].

Novel technologies, including narrow band imaging (NBI), fujinon intelligence chromoendoscopy (FICE), i-scan, magnification endoscopy and confocal laser endomicroscopy (CLE), have been studied to obtain an in-vivo optical diagnosis of colorectal lesions. DBC using contrast agents, such as indigo-carmine, or absorptive agents, like methylene blue, are customarily applied via a spray catheter to provide mucosal enhancement. Virtual chromoendoscopy (NBI, FICE, i-scan) are dye-less enhancement technologies that are built into the colonoscope or processor. NBI uses optical filter enhancement at the distal end of the endoscope, narrowing the light bandwidth, thereby improving visualization of the mucosa. FICE and i-scan use digital post-processing technology with spectral estimation to achieve mucosal enhancement. Magnification endoscopy possesses a variable lens, providing magnification up to 150-fold, permitting detailed examination of the mucosal pit patterns. Whilst CLE technology involves focusing laser light onto the mucosa and the reflected light is returned via a pinhole. This filters out non-focused light, giving a highly magnified, real-time histological diagnosis. CLE can either be integrated (iCLE) within the endoscope or via a probe (pCLE), which can be passed through the biopsy channel.

In patients without colitis, multiple studies have looked at in-vivo optical diagnosis of colorectal lesions using these technologies, allowing differentiation between neoplastic and non-neoplastic lesions. The hope that this would be cost-effective, reduce risk associated with polypectomy and provide instant determination of polyp surveillance intervals for the patient. A recent meta-analysis by the ASGE group looked at novel technologies to allow a “diagnose and leave” and “resect and discard” strategy[10]. To achieve a “diagnose and leave” strategy, (a decision to leave in-situ diminutive rectosigmoid polyps), the technology had to achieve > 90% NPV for adenomatous histology. To achieve a “resect and discard” strategy, (remove diminutive adenomatous polyps without histological assessment), the technology should provide > 90% agreement in post-polypectomy surveillance intervals. The meta-analysis showed that this could only be achieved with NBI technology, in endoscopists that were experienced and that the assessment of the polyp was made with high confidence. Recently a large multicenter prospective study evaluated the use of NBI assisted optical diagnosis in non-expert endoscopists for small colonic polyps and was found to not achieve the above criteria[11].

The accuracy of these technologies during surveillance colonoscopy in colonic IBD is unclear with the majority of studies being small and assessed as secondary outcomes. With additional hurdles to overcome in patients with colitis, such as active inflammation and the fact that lesions tend to be morphologically different (flatter rather than polypoid), how precise are we at characterizing lesions in IBD with the current technologies available. Our objective was to perform the first systematic review and meta-analysis for the diagnostic accuracy of optical imaging techniques for in-vivo lesion characterization in colonic IBD. We aimed to calculate the pooled estimated sensitivities, specificities, positive and negative likelihood ratios (+LHR, -LHR), diagnostic odd ratios (DOR), and area under summary receiver-operator characteristic (AUSROC) curve for each technology type, with histopathology as the reference standard. We also planned to perform a subgroup analysis looking at the accuracy of studies using real-time non-magnified Kudo pit pattern (Kudo PP) and real-time CLE[12].

MATERIALS AND METHODS

Information sources and search strategy

We performed a meta-analysis in concordance with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines[13]. RL searched Medline (from 1946 to May 2017) and Embase (from 1974 to May 2017), using the healthcare databases advanced search (HDAS) system. The search terms used included: ((((“high definition”).ti,ab OR (HD).ti,ab OR (“white light”).ti,ab OR (WL).ti,ab OR (chromoendoscop*).ti,ab OR (CE).ti,ab OR (NBI).ti,ab OR (“narrow band”).ti,ab OR (FICE).ti,ab OR (“fujinon intelligent chromoendoscopy”).ti,ab OR (“I-scan”).ti,ab OR (AFI).ti,ab OR (autofluorescence).ti,ab OR (CLE).ti,ab OR (“confocal laser”).ti,ab OR (“real time histology”).ti,ab) AND ((“colon imag*”).ti,ab OR (“intestinal imag*”).ti,ab OR (colonoscop*).ti,ab)) AND ((“inflammatory bowel disease”).ti,ab OR (IBD).ti,ab OR (coliti*).ti,ab OR (uc).ti,ab OR (“ulcerative coliti*”).ti,ab OR (“crohns coliti*”).ti,ab OR (“crohn’s coliti*”).ti,ab)) AND ((lesion*).ti,ab OR (polyp*).ti,ab OR (dysplas*).ti,ab OR (neoplas*).ti,ab)”. A Cochrane Library search for any systematic reviews relevant to this area was also performed. No language restrictions were used. The results for each database were combined and any duplicates removed.

Inclusion and exclusion criteria

Study inclusion and exclusion was determined by predefined criteria.

Inclusion criteria: (1) Studies using novel technologies to provide in-vivo optical characterization of lesions in patients with colonic IBD during colonoscopy; (2) characterized lesions into neoplastic and non-neoplastic using histology as the reference standard; (3) able to extract data to obtain a 2 × 2 contingency table to calculate the true positive (TP), false positive (FP), false negative (FN) and true negative (TN); and (4) Real-time characterization or retrospective image-review.

Exclusion criteria: (1) Case studies or case series; (2) studies not involving patients with colonic ibd; (3) inability to construct a 2 × 2 contingency table from the data given; (4) inability to differentiate detection from characterization studies; and (5) not used histology as reference standard (6) children (age < 16).

Study selection and data extraction

RL and NB identified study eligibility using the above inclusion and exclusion criteria. We searched the combined list of results for relevant studies, looking at the abstract or if supplementary information required, the full article. Reference lists of selected papers were also checked for potential missed articles. Abstract or articles for clinical trials or observational studies were eligible for inclusion if characterization of lesions by NBI, FICE, i-scan, DBC, magnification endoscopy or CLE, differentiated neoplastic from non-neoplastic lesions in colonic IBD, using histopathology as the gold standard. From this, data was extracted using a 2 × 2 contingency table. If exact figures for the true positive (TP), false positive (FP), false negative (FN) and true negative (TN) were not represented in the articles, it was calculated from the documented sensitivity, specificity, accuracy, positive predictive value (PPV) or negative predictive value (NPV). RL and VS performed data ascertainment and calculations. If TP, FP, FN and TN couldn’t be calculated from the article data, attempts were made to contact relevant authors by email for clarification of figures.

Risk of study bias

As studies included were diagnostic, RL and NM used the QUADAS-2 (quality assessment of diagnostic accuracy studies) tool to independently assess the degree of study validity[14]. This looks at the risk of bias and applicability regarding four domains: patient selection, index test, reference standard, flow and timing. Risk of bias (involved all four domains) and applicability (involved three domains) is scored using low risk, high risk or unclear. Any indifference on determining risk between RL and NM was discussed and clarified with VS, who made the final decision.

Statistical analysis

In performing a systematic review for diagnostic studies, a bivariate meta-analysis using a random effects model was performed, allowing for the assumption of heterogeneity between the studies[15]. A random effects model was used in order to provide a more conservative result due to differences between study methods such as endoscopic expertise, classification model, study type and the population studied. We obtained summary estimates for sensitivity, specificity, +LHR, -LHR and DOR, with their 95% confidence intervals. A hierarchical summary receiver-operator characteristic (ROC) curve was plotted, with its summary point estimate, and a dashed line around representing its 95% confidence interval. The area under the SROC curve (AUROC) served as a marker of test accuracy. Forest plots were also calculated to demonstrate study sensitivity and specificity.

Heterogeneity between studies was assessed using the Cochrane Q and I tests. Cochrane Q is established upon the chi-squared test, providing a weighted sum of the squared differences of each study estimate from the overall pooled estimate. P valves are given. I describes the percentage of variation between studies that is due to heterogeneity rather than chance and is not dependent on the number of studies included. I quantifies the impact of heterogeneity on the meta-analysis rather than just the extent of heterogeneity. Results range from 0-100%: 0% indicates there is no heterogeneity between the studies, whereas scores > 50% equate to moderate heterogeneity and > 75% high heterogeneity.

To help determine factors that may account for heterogeneity, we performed a subgroup analysis concentrating on real-time mucosal characterization, dividing into two groups: non-magnified Kudo PP (using VCE and DBC) and CLE. We also pooled results for all studies (real-time and retrospective image-capture) looking at non-magnified Kudo PP.

The Deeks et al[16] funnel plot assessed for publication bias. This uses regression of diagnostic log odds ratio against1/sqrt (effective sample size), weighting by sample size with a P < 0.10 for the slope coefficient as an indicator of substantial asymmetry.

All data analysis was done using Stata version 13 (Stata Corp, Texas, United States) using the user written command Midas (Dwamena, 2009)[17].

RESULTS

Study selection

One hundred and seventy-two abstracts and articles were obtained following the initial keyword search, following removal of duplicates (Figure 1). 21 studies were excluded following screening of the title, leaving 151 citations. A further 63 studies were excluded following review of the abstract, leaving 88 citations. 66 more studies were excluded following review of papers as a result of: 35 being detection studies, 25 were review articles, 2 involved patients without colonic IBD and 4 we were unable to construct a 2 × 2 contingency table.

Figure 1

Study flow chart for studies eventually included into the meta-analysis. IBD: Inflammatory bowel disease.

Study characteristics

The characteristics of the 22 studies included are presented in Table 1[18-39]. Twenty-one studies included 1491 patients, with one study not reporting the number of patients included, and 4674 lesions, of which 539 (11.5%) were neoplastic.

Table 1

Study characteristics

Authors	Year	Abstract/article	Technology	Number of endoscopists	Study design	Real time vs Image review	No. of Patients	No. of Polyps	Mucosal classification method
Virtual Chromoendoscopy
Cassinotti et al[22]	2016	Abstract	i-scan HD	/	Single centre/prospective cohort	Real time	40	287	Kudo PP + other endoscopic features
					Prospective cohort
Efthymiou et al[21]	2013	Article	NBI HD	2	Single centre/prospective cohort	Real time	44	121	Kudo PP + low level magnification
Van den broek et al[23]	2011	Article	NBI HD	4	Single centre/randomized cross-over	Real time	48	153	Kudo PP
Cassinotti et al[24]	2015	Abstract	FICE HD	1	Single centre/randomized parallel	Real time	41	261	Kudo PP
Cassinotti et al[25]	2015	Abstract	FICE HD	1	Single centre/prospective cohort	Real time	59	205	Kudo PP
Dye-based Chromoendoscopy
Carballal et al[26]	2016	Article	IC 0.4% SD/HD	15	Multi-centre/prospective cohort	Real time	350	595	Kudo PP + 10 other items
1Buchner et al[27]	2016	Abstract	MB 0.1% HD	/	Prospective cohort	Real time	22	21	/
2Wanders et al[20]	2016	Article	MB 0.1% SD	> 1	Multi-centre/prospective cohort	Real time	61	66	Kudo PP
Munoz et al [28]	2016	Abstract	IC 0.2%-0.4% HD	> 1	Multi-centre/retrospective cohort	Real time	243	953	Kudo PP
Wanders et al[29]	2015	Article	MB 0.1% or IC 0.3%	17	Multi-centre/retrospective questionnaire	Image review	/	30	/
3Hlavaty et al [18]	2011	Article	IC 0.4% SD	2	Single centre/prospective cohort	Real time	30	100	Kudo PP
Confocal Laser Endomicroscopy
2Wanders et al[20]	2016	Article	iCLE	> 1	Multi-centre/prospective cohort	Real time	61	60	Mainz criteria
Dlugosz et al[30]	2016	Article	pCLE	1 endoscopist (2 reviewed images)	Single centre/retrospective cohort	Image review	69	644	Crypt + vessel architecture
1Buchner et al[27]	2016	Abstract	pCLE	/	Prospective cohort	Real time	22	20	Miami classification
Freire et al[31]	2014	Article	iCLE	1	Single centre/randomized trial	Real time	72	104	Mainz criteria
Rispo et al[32]	2012	Article	pCLE	1	Single centre/prospective cohort	Real time	51	15	De Palma classification
Shahid et al[33]	2011	Abstract	pCLE	3 reviewed images	Single centre/retrospective cohort	Image review	25	61	/
3Hlavaty et al[18]	2011	Article	iCLE	2	Single centre/prospective cohort	Real time	30	68	Mainz classification
4Van den broek et al[19]	2011	Article	pCLE	4 endoscopists (2 reviewing images)	Single centre/retrospective cohort	Image review	22	48	Crypt + vessel architecture
Keisslich et al[34]	2007	Article	iCLE	/	Single centre/randomized trial	Real time	80	134	Mainz classification
Magnification endoscopy
Nishiyama et al[35]	2016	Article	NBI	5 reviewed images	Single centre/retrospective cohort	Image review	27	33	Surface + vessel patterns
4Van den broek et al[19]	2011	Article	NBI	4	Single centre/prospective cohort	Real time	22	48	Kudo PP + vascular patterns
Van den broek et al[36]	2008	Article	NBI	3	Single centre/randomized trial	Real time	50	98	Kudo PP
Matsumoto et al[37]	2007	Article	NBI	1	Single centre/prospective cohort	Real time	46	296	Surface structure
Keisslich et al[38]	2003	Article	MB 0.1%	1	Single centre/randomized trial	Real time	84	118	Kudo PP
Studies using combined technologies
Bisschops et al[39]	2013	Abstract	Dye-based chromo/NBI	10 reviewed images	Multi-centre / Retrospective cohort	Image review	27	50	Kudo PP

List of studies included in meta-analysis and displayed according to technology type. PP: Pit pattern; /: Data missing.

Two different technologies from same abstract;

Two different technologies from same article;

Two different technologies from same article;

Two different technologies from the same article.

The VCE group consisted of five studies, with one study looking at i-scan technology, two studies involved NBI and a further two used FICE. Three of the papers were abstracts and two being articles. All of these studies used endoscopic real-time diagnosis of lesions.

The DBC group entailed six studies, using either indigo-carmine (0.2%-0.4%) or methylene blue (0.1%) as the contrast agent. One of these studies performed endoscopic lesion diagnosis using a retrospective image-captured questionnaire, whilst the others used real-time diagnosis. Two were abstracts with the others being articles.

The CLE group comprised of nine studies; four studies used iCLE and five studies used pCLE. Three studies were retrospective image based, with the remaining being real-time studies. Two were abstracts and the others being articles.

The magnification endoscopy group consisted of five studies, four of which being used in conjunction with NBI and one used with DBC. One study was retrospective image-based, with the others being real-time diagnosis. All were articles.

For the subgroup analysis, real-time non-magnified Kudo PP involved ten studies and real-time CLE involved six studies. The “all study” Kudo PP included twelve studies of which two were retrospective image-based abstracts.

Quality of assessment

The results for the study quality assessment using the QUADAS 2 tool are presented using stacked bar charts (Figures 2 and 3), displaying risk of bias and applicability. Individual study quality assessment can be seen in the supplementary table (Table 2). Results varied across the twenty-two studies. Abstracts predominantly scored “unclear” for domains associated with “risk of bias”, due to lack of in-depth information within the abstract. However studies also scored “unclear” for “risk of bias” with regards “reference standard” if it did not clearly state if the histopathologist was blinded to the endoscopic diagnosis. Papers scoring “high” for “patient selection”, “index test” and “flow and timing” for “risk of bias”, were generally associated with retrospective image-captured studies which selected and reviewed only clear images of lesions, thereby introducing attrition bias. All studies scored “low” for all three domains with regards “applicability”.

Figure 2

Stacked bar charts showing proportion of studies with low, high or unclear risks of bias. Vertical axis represents the four domains of the quality assessment of diagnostic accuracy studies 2.

Figure 3

Stacked bar charts showing proportion of studies with low, high or unclear applicability. Vertical axis represents the three domains of the quality assessment of diagnostic accuracy studies 2.

Table 2

quality assessment of diagnostic accuracy studies 2 for each study

	Cassinotti et al[22] 2016	Efthymiou et al[21] 2013	Van den broek et al[23] 2011	Cassinotti et al[24] 2015	Cassinotti et al[25] 2015	Carballel et al[26] 2016	Buchner et al[27] 2016	Wanders et al[20] 2016	Munoz et al[28] 2016	Wanders et al[29] 2015	Hlavaty et al[18] 2011	Dlugosz et al[30] 2016	Freire et al[31] 2014	Rispo et al[32] 2012	Shahid et al[33] 2011	Van den broek et al[19] 2011	Keisslich et al[34] 2007	Nishiyama et al[35] 2016	Van den Broek et al[36] 2008	Matsumoto et al[37] 2007	Keisslich et al[38] 2003	Bisschops et al[39] 2013
DOMAIN 1
Patient selection
Risk of bias
Could selection of patients introduced bias?	L	L	L	L	L	L	U	L	L	H	U	L	L	L	H	H	L	H	L	L	L	H
Concerns regarding applicability
Concern included patients don’t match review question?	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L
DOMAIN 2
Index test
Risk of bias
Conduct or interpretation of index test introduced bias?	L	L	L	L	L	L	L	L	U	H	H	H	L	L	H	H	L	H	L	L	L	H
Concerns regarding applicability
Concern index test, its conduct or interpretation differs from review question?	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L
DOMAIN 3
Reference standard
Risk of bias
Could reference standard, conduct or interpretation have introduced bias?	U	U	L	U	U	U	U	L	U	U	L	L	L	L	U	L	L	U	L	L	L	U
Concerns regarding applicability
Concern target condition as defined by reference standard not match review question?	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L	L
DOMAIN 4
Flow and timing
Risk of bias
Could patient flow introduced bias?	U	L	H	U	U	L	U	L	U	H	H	U	L	L	H	H	L	H	L	L	L	H

L: Low risk; H: High risk; U: Unclear.

Pooled diagnostic accuracy results

A summary for the pooled diagnostic accuracy estimates for the different technologies and for the subgroup analysis is outlined in Table 3.

Table 3

Accuracy of the different technologies

Analysis groups	No. of studies	Pooled estimates (95%CI)		Likelihood ratios (95%CI)		Diagnostic odds ratio (95%CI)	Area under SROC curve (95%CI)
		Sensitivity	Specificity	LHR+	LHR-	DOR
All
VCE	5	0.86 (0.62-0.95)	0.87 (0.72-0.95)	6.7 (2.6-17.8)	0.17 (0.05-0.53)	41 (6-297)	0.93 (0.90-0.95)
DBC	6	0.67 (0.44-0.84)	0.86 (0.72-0.94)	4.9 (2.1-11.3)	0.38 (0.20-0.73)	13 (3-48)	0.84 (0.81-0.87)
Magnification	5	0.90 (0.77-0.96)	0.87 (0.81-0.91)	7.0 (4.6-10.7)	0.11 (0.05-0.28)	62 (18-209)	0.93 (0.91-0.95)
CLE	9	0.87 (0.71-0.95)	0.94 (0.87-0.97)	14.0 (6.1-32.4)	0.14 (0.06-0.33)	101 (23-442)	0.96 (0.94-0.97)
Real-time
Kudo PP	10	0.78 (0.57-0.91)	0.89 (0.80-0.94)	6.9 (3.5-13.5)	0.24 (0.11-0.55)	28 (7-110)	0.91 (0.89-0.94)
CLE	6	0.91 (0.66-0.98)	0.97 (0.94-0.98)	28.4 (13.6-59.1)	0.09 (0.02-0.43)	322 (41-2529)	0.98 (0.97-0.99)
All Kudo PP	12	0.78 (0.61-0.88)	0.86 (0.76-0.92)	5.5 (2.9-10.1)	0.26 (0.14-0.50)	21 (7-66)	0.89 (0.86-0.92)

All using both real-time and image based studies for the different technologies. Real-time, sub-group analysis with studies using only real time Kudo pit pattern (both VCE and DBC) and real-time CLE. All Kudo PP includes all studies using Kudo pit pattern (real-time and image-based). VCE: Virtual chromoendoscopy; DBC: Dye-based chromoendoscopy; CLE: Confocal laser endomicroscopy; Kudo PP: Kudo pit pattern; LHR+: Positive likelihood ratios; LHR-: Negative likelihood ratios; DOR: Diagnostic odd ratios.

The meta-analysis for the five studies involving VCE showed it was fairly accurate at differentiating neoplastic from non-neoplastic lesions with a pooled sensitivity of 86% (95%CI: 62%-95%), specificity of 87% (95%CI: 72%-95%), and the area under the SROC curve was 0.93 (95%CI: 0.90-0.95).

Pooled results of the six studies for DBC revealed the least accurate results for lesion characterization, with a sensitivity of 67% (95%CI: 44%-84%), specificity of 86% (95%CI: 72%-94%) and an area under the SROC curve was 0.84 (95%CI: 0.81-0.87). Most of the studies within this group were multi-centre with more than one endoscopist.

Results of the five studies for magnification endoscopy showed a pooled sensitivity of 90% (95%CI: 77%-96%), specificity of 87% (95%CI: 81%-91%), and an area under the SROC curve was 0.93 (95%CI: 0.91-0.95). The results are similar to those of VCE; however these were mainly single centre, single expert endoscopist studies.

Meta-analysis of nine studies for CLE showed a sensitivity of 87% (95%CI: 71%-95%), specificity of 94% (95%CI: 87%-97%), with an area under the SROC curve of 0.96 (95%CI: 0.94-0.97). Again these mere all single centre, single expert endoscopist studies.

A subgroup analysis was performed involving studies using real-time endoscopic mucosal characterisation of lesions, divided into real-time non-magnified Kudo PP (with VCE and DBC) and real-time CLE. Both the forest plots and SROC curves for real-time non-magnified Kudo PP and real-time CLE are given in Figures 4 and 5. The subgroup for real-time Kudo PP included ten studies, with a pooled estimate sensitivity of 78% (95%CI: 57%-91%), specificity of 89% (95%CI: 80%-94%), with an area under the SROC of 0.91 (95%CI: 0.89-0.94). The subgroup analysis looking at real-time CLE included 6 studies. The pooled estimated sensitivity was 91% (95%CI: 66%-98%), specificity was 97% (95%CI: 94%-98%), and the area under the AUSROC was 0.98 (0.97-0.99).

Figure 4

Forest plot for real-time Kudo pit pattern (A), and forest plot for real-time confocal laser endomicroscopy (B).

Figure 5

Area under SROC curve for real-time Kudo pit pattern (A) and area under SROC curve for real-time confocal laser endomicroscopy (B).

A further subgroup analysis was performed looking at all (real-time and image review) non-magnified Kudo PP. This included twelve studies. The pooled estimate sensitivity was 78% (95%CI: 61%-88%), specificity of 86% (95%CI: 76%-92%), and an area under the SROC of 0.89 (95%CI: 0.86-0.92).

Test for heterogeneity

I and Cochrane Q were used to test for heterogeneity. Heterogeneity for VCE was moderate to high with an I = 63% (95%CI: 16%-100%) and Q = 5.347 (P = 0.034). DBC showed extremely high levels of heterogeneity between studies with an I = 89% (95%CI: 78%-100%) and Q = 18.573 (P = 0.00). Magnification [I = 0 (95%CI: 0%-100%) and Q = 0.607 (P = 0.369)] and CLE [I = 40% (95%CI: 0%-100%) and Q = 3.335 (P = 0.094)] represented low levels of heterogeneity between studies, however had very broad 95% confidence intervals.

Real-time non-magnified Kudo PP had an I = 96% (95%CI: 92-99) and Q = 45.575 (P < 0.001) showing exceptionally high levels of heterogeneity. Real-time CLE studies had low levels of heterogeneity, with an I = 0 (95%CI: 0-100%) and Q = 1.697 (P = 0.214).

Publication bias

Deeks et al[15] funnel plot, seen in Figure 6, was used to assess publication bias. The funnel plot has slope coefficient of 9.84 (P = 0.194). The non-significant P valve would suggest a low likelihood of publication bias in this meta-analysis.

Figure 6

Funnel plot with superimposed regression line looking for publication bias.

DISCUSSION

Our meta-analysis illustrates that real-time CLE currently appears to be the best technology in performing in-vivo lesion characterization in patients with colonic IBD, with an impressive AUSROC of 0.98 (95%CI: 0.97-0.99). It demonstrates an extremely high specificity, 97% (95%CI: 94%-98%), and sensitivity, 91% (95%CI: 66%-98%), in differentiating neoplastic from non-neoplastic lesions. Using all study types (real-time and image capture) CLE again out-performs the other technologies, with an area under SROC cure of 0.96 (95%CI: 0.94-0.97). Magnification and VCE technologies also show a good accuracy with a SROC of 0.93 (95%CI: 0.91-0.95) and 0.93 (95%CI: 0.90-0.95), respectively.

Despite CLE being a highly accurate technology in lesion characterization, there are several concerns with regards applicability. Most of the studies in our meta-analysis for CLE involved a single endoscopy operator within a single-centre. They were vastly experienced in IBD surveillance endoscopy and in using CLE technology. Studies in which inexperienced operators used this technology, they themselves did not make real-time lesion diagnosis. Instead, people trained in the interpretation of the histology reviewed the images retrospectively. This is because CLE is not a routinely used modality. It requires expertise in handling, positioning of the colonoscope/probe onto the lesion and in analysing/interpreting in-vivo histology. Bowel preparation has to be meticulous, as any faecal material can interfere with image capture and lesion interrogation. This is unlikely to be achieved consistently during “real-life” surveillance lists. In one study, 32% of lesions were not accessible to CLE evaluation and a second study, 1.5% of lesions the histology was not visualised by CLE. These unclassified lesions aren’t accounted for in the final results, contributing to attrition bias in the observed results. In addition, IV fluorescein injection is required before lesion analysis, further adding to procedure time. One study showed the mean additional time per procedure being 20 min. Adoption of this technology in throughout less experienced centres is doubtful. It would demand vast resources for training, education and require new guidance for endoscopic competence.

A further concern with CLE was equipment failure. In one multi-centre study, four of the five centres had to send the equipment back to the manufactures as the lens on the endomicroscope broke. Repair took the teams months to address, significantly affecting recruitment, resulting in the study being underpowered. With concerns over equipment failure, costs of purchasing the technology and repairs, CLE could in fact be a financial burden, negating any benefit obtained from the reduction in polypectomies and histological analysis. Therefore, questions still remain unanswered with regards practicalities and applicability for this technology.

VCE showed relatively good accuracy although fell short of reaching the 90% mark for sensitivity and specificity. One major limitation for this technology was the small number of studies for VCE technology. We therefore combined the NBI, FICE and i-scan to obtain pooled results. Although the technologies have been grouped as one, there are obvious differences in the way they achieve the modified image and the modes used with that technology. NBI endoscopes contain a rotating filter in front of the light source at the end of the endoscope, allowing a narrow wavelength of light to strike the mucosa resulting in image enhancement, whereas both FICE and i-scan use a post-processing technology built within the processer to provide a coloured-enhanced image. There were several other drawbacks with the VCE group analysis. One study in our meta-analysis used the first generation NBI technology, resulting in images being less bright, undoubtedly having an impact on lesion characterization when compared with newer generation technology. Three of the five studies for VCE were abstracts making critical analysis for the quality of these studies difficult to determine. From our results we cannot currently recommend using VCE solely as an accurate technology for lesion characterization in IBD. However, with newer generation endoscopes, further evaluation is clearly warranted as these technologies continue to improve. In comparison with CLE, VCE is potentially less complicated to use, more robust, economical as they are almost universal in newer endoscope processors, and training is more likely to be attainable.

Magnification endoscopy achieves similar accuracy to VCE technology. However in the majority of these studies magnification was used in combination with NBI, predominantly using older NBI technology. This makes it challenging to differentiate the two technologies. With new colonoscopes delivering digital magnification, like “near focus” technology, it is questionable the additional information optical magnification will provide. A threshold may be reached at which further magnification provides no additional benefit for differentiating neoplastic from non-neoplastic pit patterns. However, this meta-analysis cannot necessarily address that question.

DBC pooled results were suboptimal for lesion characterization. However, more than half of the studies used standard-definition colonoscopies, reducing image resolution, and therefore impacting on lesion interpretation. With most centres now using high-definition colonoscopies accuracy is likely to improve. Another confounding factor was that the majority of the studies were multi-centred, with multiple operators, undoubtedly accounting for a diverse range of endoscopic experience and therefore skill at lesion classification.

A subgroup analysis was performed in order to look for potential sources of heterogeneity and to determine whether it was the type of mucosal classification used that influenced the accuracy rather than the technology. Real-time studies were used as this provided the most clinically authentic evaluation of lesions and minimises bias as a result of photographic selection and time for analysis. Most studies used Kudo PP or a variation on the Kudo PP (Kudo PP plus additional features) and therefore we pooled the results for both real-time VCE and DBC. Real-time Kudo PP had an area under the SROC curve of 0.91 (95%CI: 0.89-0.94), with a reasonable specificity of 89% (95%CI: 80%-94%) but a sensitivity of 78% (95%CI: 57%-91%). The poor sensitivity likely reflects inclusion of the DBC group with the majority involving standard-definition scopes. The use of Kudo PP and Kudo PP plus did not seem to influence the accuracy of lesion characterisation, independent of the technology. Caution however, has to be noted for combining DBC and VCE using Kudo PP as a mucosal classification system. Studies have shown a lack of pit pattern agreement between chromoendoscopy and NBI[40]. This has leading to the adoption of new classification systems, such as NICE for NBI[41]. Further mucosal classification systems may need to be studied, especially for i-scan and FICE. However, determining the ideal post-processing mode for these software systems could be challenging as these technologies have multiple combination options of modes.

Another important issue that wasn’t clearly stated for studies in this meta-analysis was the degree of mucosal inflammation in which the lesions resided. Varying degrees of mucosal inflammation unquestionably contribute to difficulties in pit pattern and vasculature interpretation and therefore diagnostic accuracy. Future studies looking at in-vivo lesion diagnostic accuracy could stratify patients depending on the degree of inflammation surrounding the lesions.

As with any meta-analysis there are limitations. The number of studies for each technology group was fairly limited, except for the CLE group. Seven of the twenty-two studies were abstracts introducing concerns with regards data extraction and interrogation for study validity.

Despite an extensive literature review, no papers had direct head-to-head studies, comparing the different technologies against each other. However, this would require a very large cohort looking specifically at lesion characterisation and all endoscopists participating being familiar with the different technologies. Endoscopic familiarity with certain technologies in such a study could potentially confound the accuracy of lesion interpretation.

In the majority of studies, lesion characterization was a secondary outcome, therefore in some studies the number of lesions being characterised was small. Some studies didn’t clearly state the TP, FP, FN and TN, therefore calculations had to be performed in order to achieve this.

There was also a large degree of heterogeneity within the VCE and DBC groups that was further increased when we performed real-time Kudo PP assessment. Further areas of subgroup classification that were not explored within this meta-analysis were the number of endoscopists performing the procedures in each study and also whether it was a single centre or multi-centre study. This undoubtedly will have an impact on the accuracy of the technology being used. Single-centre, single endoscopist studies are more likely to achieve better results.

Suggested avenues to explore in future studies looking at in-vivo lesion characterization in colonic IBD include: accuracy according to varying endoscopic experience, accuracy dependent on the degree of surrounding mucosal inflammation, whether the endoscopist confidence (high or low) in lesion characterization impacts accuracy and exploring new mucosal lesion classification for different technologies.

CONCLUSION

Real-time CLE appears to be currently the best commercially available technology at differentiating neoplastic from non-neoplastic lesions in patients with colonic IBD, with an area under the SROC of 0.98 (95%CI: 97%-99%). However, most CLE studies were single centered with single expert users, which could significantly confound the results, and some studies not reporting non-interpretable images, contributing to attrition bias. Clinical applicability for this technology is likely to be a challenge. VCE technology performed well but currently cannot be recommended for in-vivo lesion characterization in such a high-risk group. However, with improved endoscopes and newer generation technologies further studies are required to assess their real-time performance in clinical settings with trained colonoscopists.

ARTICLE HIGHLIGHTS

Research background

Patients with inflammatory bowel disease (IBD) colitis are known to have an increased risk of colorectal cancer compared to that of non-colitic patients. This is thought to progress along the inflammation-dysplasia-carcinoma pathway. Many studies and meta-analyses have been performed for lesion detection in IBD but few studies have looked into in-vivo lesion characterization. This is the first meta-analysis on lesion characterization in colonic IBD.

Research motivation

Characterization of colonic lesions in IBD maybe more challenging because they tend to be flatter and their pit-pattern maybe obscured by inflammation. Some patients also have numerous pseudopolyps throughout the colon, making polypectomy impractical, time-consuming, costly and potentially associated with increased risk. If we are able to characterize these lesions with a high accuracy without needing to perform polypectomy, we could potentially circumvent these problems.

Research objectives

Our objective was to perform the first systematic review and meta-analysis for the diagnostic accuracy of optical imaging techniques for in-vivo lesion characterization in colonic IBD.

Research methods

We conducted a review of the current literature and included studies which characterized lesions in-vivo into neoplastic and non-neoplastic, using histology as the gold standard. Data was pooled for each technology using a bivariate meta-analysis with a random effects model to account for study differences. Sensitivities, specificities, positive and negative likelihood ratios, diagnostic odds ratio, and area under summary receiver-operator characteristic curve, were calculated for each technology type.

Research results

Confocal laser endomicroscopy (CLE) had the greatest accuracy for differentiating neoplastic from non-neoplastic lesions in-vivo. Magnification and virtual chromoendoscopy (VCE) performed well, whilst dye-based chromoendoscopy (DBC) had suboptimal accuracy.

Research conclusions

CLE is highly accurate at in-vivo lesion characterization but studies are within experienced centres with mainly single expert users limiting its generalizability.

Research perspectives

Future studies should look at newer generation virtual chromoendoscopic technology [narrow band imaging (NBI), i-scan, fujinon intelligence chromoendoscopy (FICE)] for lesion characterization. A standardised mucosal lesion classification system specific for lesions in IBD colitis accounting for the technology being used should be explored.