Neuropathological interpretation of stimulated Raman histology images of brain and spine tumors: part B.

Intraoperative histopathological examinations are routinely performed to provide neurosurgeons with information about the entity of tumor tissue. Here, we quantified the neuropathological interpretability of stimulated Raman histology (SRH) acquired using a Raman laser imaging system in a routine clinical setting without any specialized training or prior experience. Stimulated Raman scattering microscopy was performed on 117 samples of pathological tissue from 73 cases of brain and spine tumor surgeries. A board-certified neuropathologist - novice in the interpretation of SRH - assessed image quality by scoring subjective tumor infiltration and stated a diagnosis based on the SRH images. The diagnostic accuracy was determined by comparison to frozen hematoxylin-eosin (H&E)-stained sections and the ground truth defined as the definitive neuropathological diagnosis. The overall SRH imaging quality was rated high with the detection of tumor cells classified as inconclusive in only 4.2% of all images. The accuracy of neuropathological diagnosis based on SRH images was 87.7% and was non-inferior to the current standard of fast frozen H&E-stained sections (87.3 vs. 88.9%, p = 0.783). We found a substantial diagnostic correlation between SRH-based neuropathological diagnosis and H&E-stained frozen sections (κ = 0.8). The interpretability of intraoperative SRH imaging was demonstrated to be equivalent to the current standard method of H&E-stained frozen sections. Further research using this label-free innovative alternative vs. conventional staining is required to determine to which extent SRH-based intraoperative decision-making can be streamlined in order to facilitate the advancement of surgical neurooncology.

Introduction

State-of-the-art intraoperative histopathological diagnosis in a neurosurgical setting is routinely performed using fast frozen section and H&E staining. This technique is limited by the amount of samples that can be processed in real-time in a routine clinical setting, as for a single sample there is a delay of 15–30 min from tissue removal to histopathological diagnosis. Therefore, an exhaustive histopathological sampling of tumor margins to assist neurosurgical decision-making in real-time is currently not available during routine tumor resections. Decisions on the extent of resection rather rely on subjective criteria such as visual and haptic impressions of the neurosurgeon, 5-aminolevulenic acid (5-ALA)-mediated fluorescence [24], intraoperative MRI [22], ultrasound, neuromonitoring [21], or neuronavigation.

A technological breakthrough [6, 7] leading to the development of a mobile stand-alone fiber-laser-based stimulated Raman scattering microscope (NIO Invenio Imaging Inc.) enables to perform stimulated Raman histology (SRH) with minimal delay (~ 3 min) label-free (i.e., without additional staining) directly in the operating theater [17].

Compared to conventional H&E staining, SRH has several advantages such as the ease of use, the time of data processing, and the digital nature of the obtained images. Digitalization allows remote consultations and image processing using automated classifiers and machine learning routines [9].

At the core of the novel application of SRH is the fundamental understanding of the obtained SRH images. Despite obvious analogies between SRH images and H&E-stained sections, there are also differences. Firstly, tissue specimens used in SRH are squash preparations where characteristic cytoarchitectonic features of the tissue may be disrupted. Secondly, SRH images highlight cellular features — mainly tumoral and glia fibers — but also putative axons that are usually not evident on conventional H&E stains. The incorporation of intraoperative SRH imaging into clinical routine requires a close interdisciplinary exchange, whereby neurosurgeons and neuropathologists potentially with the support of expert vibrational spectroscopists become familiar with these new imaging modalities.

Following the introduction of intraoperative SRH imaging at our institution, we have tested the applicability of this technique in a routine clinical setting [16]. The aim of the current study was to (1) quantify the interpretability of SRH images and to (2) evaluate the diagnostic accuracy of SRH compared to the current standard.

Materials and methods

Tissue acquisition and preparation

Tissue samples were collected and imaged in accordance with the guidelines of the biobank at the Department of Neurosurgery, Medical Center University of Freiburg, with the approval of the local ethics committee of the University of Freiburg (protocol 5565/15) and with written informed patient consent. One hundred seventeen samples of putative pathological tissue from 73 consecutive surgical cases of brain, spine, and peripheral tumors (1.6 ± 0.9 range from 1 to 5 samples/case) were investigated using stimulated Raman scattering microscopy. Surgeries included tumor resections (n = 67) and stereotactic biopsies (n = 6). The usual surgical routine was neither disrupted nor influenced.

Samples for SRH images were collected from the adjacent areas of samples extracted for conventional routine diagnostics. SRH was performed as described in detail in the accompanying study [16]. In all cases, pathological tissue was sampled and subject to conventional neuropathological processing (minimal time to diagnosis 2 days). According to our institution’s standard of care, in 63 of 73 cases, additional tissue was sampled and processed for intraoperative neuropathological diagnostic using fast frozen H&E-stained sections.

Sample processing and SRH imaging

Small (1–3 mm edge size) samples were compressed to a thickness of 230 µm on a sample holder designed for use in the Raman imaging system (NIO Slide; NIO Invenio Imaging Inc.). SRH images were generated using a fiber-laser-based stimulated Raman scattering microscope (NIO Laser Imaging System, Invenio Imaging Inc., Santa Clara, CA, USA). Briefly, the raw image data consisted of Raman shifts at wavenumbers 2845 cm–1 and 2940 cm–1, respectively, corresponding to the vibrational frequencies of C-H2 bonds (primarily characteristic for lipids) and C-H3 bonds (primarily characteristic for proteins and DNA), respectively. The raw images were generated as sequential line scans of 1000 pixels in width at an imaging depth of 10 µm below the coverslip. The nominal pixel size was 467 nm. The images were automatically stitched and converted to SRH (i.e., “virtual H&E”) images via subtraction and the use of a proprietary lookup table (see ref. [17]), which is part of the NIO software package (version 1.5.0). In total, 309 SRH images with an average of 4.2 ± 2.3 (range 1 to 12) images per case were generated. In 237 of 309 images, the size of the field of view was nominally set to 2 × 2 mm resulting in an effective field of view of 3.06 mm2. The average image size was 3.7 ± 2.4 ranging from 0.2 to 19.4 mm2. Images were exported in DICOM format. For ease of use, SRH images were converted to.tif format using custom written scripts (MATLAB R2020a).

Criteria for the neuropathological assessment of SRH images

The SRH images were presented to a board-certified neuropathologist (D. E.), who had no prior experience in the interpretation of SRH. To evaluate SRH image quality, each image of putative pathological tissue was classified with respect to the assessability of tumor infiltration using a ranked score: (1) infiltration is certain or can be certainly excluded, (2) possible infiltration, and (3) inconclusive, where assessment of infiltration is not possible. Next, the medical information including age, tumor location, and an anonymized brief medical history otherwise identical to the information available at the time of the conventional neuropathological consultation was revealed. Then, based on all SRH images per case, the neuropathologist stated a diagnosis. As a guideline, the following categories were an optional diagnosis: high-grade glioma, low-grade glioma, metastatic brain or spinal tumor, meningioma, CNS lymphoma, pituitary adenoma, sub-/ependymoma, sarcoma, schwannoma, necrosis, reactive gliosis, ganglioglioma, hemangioblastoma, colloid cyst, epidermoid, unclear, or other tumors. The written SRH and H&E-based diagnosis were then classified into the final categories (n = 14) by a referee (D.H.H.).

Statistical analysis

Group comparisons were performed using chi-squared testing. Significance was defined as an alpha level < 5%. Precision and recall between SRH or H&E-stained frozen section diagnosis and the ground truth (i.e., definite diagnosis) were calculated using the F measurement function in the FlowSOM package in R (RStudio Version 1.4.1106). F statistic testing was performed using linear models function in R. The inter-rater correlation was calculated using Cohen’s kappa coefficient [2] using the psych package in R.

Results

Seventy-three consecutive neurosurgical cases of brain, spine, and peripheral tumors (Fig. 1a) were investigated using SRH imaging. The mean patient age was 55.9 ± 18.1 years with 39 female and 34 male patients. The majority of tumors originated from the brain (n = 63) with high-grade gliomas (HGG, n = 17) and brain metastasis (n = 13) forming the largest groups (Fig. 1a). In this study, we defined HGG as WHO grade III and IV gliomas, and low-grade gliomas (LGG) as WHO grades I and II. The medical history was classified into 3 groups: (1) novel primary tumors (n = 39), (2) recurrent disease (n = 16), and (3) primary metastatic disease with known potential origin outside the CNS (n = 18) (Fig. 1b). While most cases of brain tumors (37/63) were primary, the majority of spine tumors (8/10) were metastatic with a known primary tumor (Fig. 1b). Examples of SRH images of the 6 largest categories of tumors (cf. Figs. 2j, 3b) are shown in Fig. 1c–h.

Fig. 1

Data and stimulated Raman histology. a Category and location of 73 cranial, spinal, and peripheral (blue) tumors. b Distribution of patient history. c–h Illustrative examples of SRH images. c GBM of the left parietal lobe in a 72-year-old female. d 53-year-old male with left frontal oligodendroglioma WHO grade II. e Spinal (TH 2/3) psammomatous meningioma in a 78-year-old male. f Left frontal dural metastasis of an esophageal cancer in a 65-year-old male. g Reactive gliosis with necrotic components (shown) after radiation of a left temporo-occipital melanoma metastasis in a 40-year-old female. h Non-hormone active pituitary adenoma in a 56-year-old male. Scale bars, 100 µm. Program used to create figure: Adobe Illustrator CS 6

Fig. 2

Assessment of tumor infiltration using SRH imaging. a–f Examples of subjective classification of tumor infiltration in SRH images as certain (a, b), possible (c, d), and inconclusive (e, f). a Certain tumor infiltration in case of a 78-year-old female with metastasis of NSCLC in the right frontal lobe. b Certain absence of tumor infiltration in case of cortical access tissue for resection of a right temporo-occipital GBM. c 72-year-old male patient with spinal metastasis of laryngeal squamous cell carcinoma. d 49-year-old male with recurrent left frontal GBM. e 77-year-old female with recurrent left temporal NSCLC metastasis. f 40-year-old female with metastasis of malignant melanoma in the left temporo-occipital lobe. g Overall assessment of tumor infiltration in 309 SRH images from 73 neurosurgical cases (cf. Fig. 1a). h Stratification of assessment of tumor infiltration according to tumor location and i the medical history. j Stratification of assessment of tumor infiltration according to diagnostic category (cf. Fig. 1a). Shown here are the 6 categories that contained > 3 cases and > 10 SRH images per category. Red line shows overall average (cf. Fig. 2g). Above all bars are the number of SRH images, below the number of cases per category. Scale bars, 100 µm. Program used to create figure, Adobe Illustrator CS 6

Fig. 3

Accuracy of diagnosis based on medical history and SRH images. A board-certified neuropathologist novice in the assessment of SRH images stated a diagnosis based on the SRH images and the clinical information in 73 cases of cranial, spinal, or peripheral tumors. a Overall agreement of the diagnosis compared to the final neuropathological diagnosis was 87.7% (cf. red line in b and d). b Stratification of diagnostic accuracy according to tumor entity. Shown here are the 6 entities that contained > 3 cases. Below all bars are the number of patients per category. c Non-inferiority of diagnostic accuracy of SRH vs. conventional fast frozen section using H&E staining (87.3 vs. 88.9%, p = 0.783 chi-squared). d Non-significant lower accuracy in primary tumor cases (cf. group 1, Fig. 1b) vs. non-primary cases (cf. groups 2 and 3, Fig. 1b) (84.6 vs. 91.2%, respectively; p = 0.395 chi-squared). e River plot showing the correspondence of SRH-based diagnosis (left) and H&E-stained fast frozen sections (right) to the definitive neuropathological diagnosis (middle) with misclassifications appearing as lane changes. Program used to create figure, Adobe Illustrator CS 6

Assessment of tumor infiltration in SRH images

To evaluate the interpretability of the obtained SRH images (n = 309) of putative pathological tissue, we established a ranked score based on the subjective confidence of a neuropathologist, who was novice in the interpretation of SRH images. The presence or absence of tumorous cells was assessed regardless of the underlying pathology. The score comprised 3 classes of tumor infiltration: class 1 certain infiltration (yes/no); class 2 possible infiltration; and class 3 inconclusive (Fig. 2a–f). Overall, 67.6% of SRH images were classified as class 1, 28.2% as class 2, and 4.2% as inconclusive class 3, respectively (Fig. 2g). The majority of SRH images (10 of 13) classified as class 3 were reported within the first 10 cases that were analyzed. They included necrosis (n = 2), fibrous tissue (case of spinal metastasis, n = 1), white matter (n = 2) (Suppl. Fig. 1), cases of diffuse infiltrating tumor (LGG and neuroblastoma, n = 7), and SRH images taken close to the sample border (sampling error, n = 1).

Stratification of subjective interpretability of SRH images by sample origin (Fig. 2h) showed a non-significant difference in class 1 confidence in brain vs. spinal tumors (66.92 vs. 70.73%, p = 0.62 chi-squared). Prior treatment such as radio- and/or chemotherapy decreased the interpretability of SRH images (Fig. 2i). In cases of recurrent disease (n = 16) vs. primary tumor cases (n = 57, group 1 and 3) (Fig. 1b), the class 1 confidence of tumor infiltration was significantly reduced (56.0 vs. 71.4%, p = 0.013 chi-squared). Stratification of subjective interpretability of SRH into the six largest tumor categories (cf. Fig. 1c–h) revealed above-average certainty of tumor infiltration in the case of pituitary adenoma, meningioma, and metastasis, while below-average certainty was observed in LGG and reactive gliosis.

Accuracy of neuropathological diagnosis based on SRH images

The neuropathologist stated a diagnosis based on all available SRH images/case and the medical history. In 2 out of 73 cases (i.e., primary epidermoid in the 4th ventricle and recurrent GBM in right temporal lobe), a diagnosis was not possible. Using the final neuropathological report as a ground truth, the overall accuracy of the diagnosis based on SRH imaging was 87.7% (64 of 73 cases) (Fig. 3a). The diagnostic accuracy based on SRH images was below-average for reactive gliosis, while there was a 100% accuracy in LGGs, pituitary adenomas, and brain or spine metastasis (Fig. 3b). For HGGs and meningiomas, the diagnostic accuracy using SRH images was 88.9% and 90.9%, respectively.

Comparison of diagnosis based on SRH images to fast frozen H&E-stained sections

A comparison of the SRH-based diagnosis to the current standard in neuropathological diagnosis based on fast frozen H&E-stained sections was performed in 63 cases (Fig. 3c, e). The accuracy of diagnosis based on SRH was 87.3% and 88.9% based on H&E-stained sections, respectively. The difference was not significant (p = 0.783, chi-squared), demonstrating that the diagnostic accuracy of SRH is en par with H&E-stained fast frozen sections, which was previously reported [4]. The correlation between the diagnosis based on SRH vs. H&E-stained sections was determined using Cohen’s kappa [2] and was indeed high at κ = 0.80 ([0.70 to 0.91] 95% CI). The precision and recall of the diagnosis based on SRH images compared to the ground truth were 0.94 and 0.90, respectively (p = 2.5E-10), with a diagnostic of correlation of κ = 0.84 ([0.75, 0.94] 95% CI, unweighted Cohen’s kappa). Similarly, the precision and recall for the diagnosis based on H&E-stained sections were 0.96 and 0.89 (p = 2.2E-16) with a diagnostic correlation of κ = 0.86 ([0.77, 0.96] 95% CI).

Estimation of bias to diagnostic accuracy

To estimate bias via the knowledge of the medical history on the neuropathological decision-making, the accuracy of primary tumors (i.e., without any previous neuropathological reports) was compared to the groups of recurrent disease and metastatic tumors with a known primary disease outside the CNS (group 2 and 3) (Fig. 1c). The diagnostic accuracy in the non-primary group was higher, although not reaching statistical significance (84.6 vs. 91.2%, p = 0.395, chi-squared test) (Fig. 3d).

Discussion

We report the first experience at our institution with the neuropathological interpretation of ex vivo SRH images, conducted in a routine clinical scenario without any specialized training. Compared to other novel tools for intraoperative histological examination in vivo such as fluorescein-assisted confocal laser endomicroscopy [8, 14] and hand-held (multimodal) Raman spectroscopy probes [3, 10], the ex vivo SRH approach described here is limited by the fact that the tissue must be removed. Despite the significant speedup of SRH compared to conventional histopathology [4], the residual delay and the inability to process samples in parallel hinder repeated arbitrary sampling. Rather, a resection strategy including the sequential histopathological examination of multiple locations of interest is required (see below).

Assessment of tumor infiltration in putative pathological samples

In 67.6% of all images, we found a high confidence in the assessment of tumor infiltration by a neuropathologist, who was unfamiliar with the interpretation of SRH images. Post hoc analysis revealed that 6 samples contained cortex adjacent to the tumor; therefore, the class of “certain infiltration” also encompassed certain non-infiltrated (i.e., putative healthy) tissue (Fig. 2a, b). We observed a steep learning curve where the majority of images labeled as inconclusive (4.2%) (Fig. 2g) were reported within the first 10 cases of unsupervised annotation.

Neuropathological diagnosis based on frozen sections of brain tumors in the case of re-operations was shown to have a significantly lower diagnostic accuracy compared to primary brain tumors (82 vs. 92%, respectively) [25]. As expected, we found the interpretability of brain tumor infiltration to be significantly reduced in cases of recurrent disease (Fig. 2i), which made up 22% of all cases in this study (cf. Fig. 1b).

Diagnostic accuracy of SRH-based neuropathological diagnosis

The accuracy of the SRH-based neuropathological diagnosis from the first samples analyzed at our institution (including the very first) was 87.7% (Fig. 3a), which was close to the lower bound of the range of diagnostic accuracy (89–98%) reported for intraoperative frozen section neuropathological diagnosis [15, 25, 26]. It should be noted that the investigators had no prior experience with sample preparation specific to Raman imaging or SRH image interpretation. We expect that the diagnostic accuracy will further increase following ongoing training and the establishment of a standardized protocol.

The SRH-based diagnosis was most accurate for solid primary tumors (e.g., metastasis, meningioma, pituitary adenoma). Misclassifications occurred in cases of recurrent pre-treated tumors, reactive gliotic tissue, and HGGs which were also difficult to interpret in conventional H&E-stained tissues (Fig. 3e). Sampling errors were reported to be another major source of error in the conventional intraoperative neuropathological diagnosis [15]. In this study, spatially similar but not identical samples were processed in parallel for SRH and H&E. It is possible that distinct parts of the tumor were submitted to either method yet not to the other. Furthermore, only parts of the samples were imaged, which may have led to undersampling of diagnostic features in SRH [17]. This is especially relevant for heterogeneous tumors (e.g., GBM), where necrotic and solid parts are interleaved.

Non-inferiority of SRH diagnosis vs. H&E-stained frozen section

As previously reported in a prospective trial by Eichberg et al. where SRH and conventional histology had a similar diagnostic accuracy [4], we found a non-inferiority of the pathological diagnosis based on SRH images compared to conventional fast frozen H&E-based images (87.3 vs. 88.9%) (Fig. 3c). The diagnostic correlation between SRH and the ground truth was κ = 0.84, which is similar to the previously reported value of κ = 0.83 [4]. The diagnostic correlation between SRH and H&E-stained sections reported here (κ = 0.8) is lower than the near-perfect values reported in Orringer et al. [17] (κ = 0.89–0.92) but is still considered to be substantial [12]. Recently, Pekmezci et al. [18] showed for resection borders of IDH mutated glioma that the gold standard of immunohistochemistry vs. SRH detected residual tumor at a similar rate (56% vs 49%).

We anticipate that neurosurgeons, neuropathologists, and potentially neuroradiologists along with radiotherapists will in future become more familiar with the interpretation of SRH images, which will yield even more accurate interpretations. In addition, it is anticipated that appropriate deep learning/machine learning strategies [9] will augment the interpretation and classification of the obtained SRH images and further reduce the time to result. The present study provides a quantitative impression of the scenario neurosurgeons and neuropathologists will face when applying advanced imaging technologies in routine clinical settings.

Workflow for the exploration of SRH-based neurosurgical decision-making

The first positive results reported here together with promising results attesting the diagnostic accuracy of SRH-based imaging similar to the current standard [4, 17, 18] lead us to conclude — comparable to previous reports [11, 18] — that intraoperative SRH may be an adequate technique for histopathological based surgical decision-making close to real-time. Modern neuropathological diagnosis relies on a multitude of molecular markers far beyond a mere morphological description [1, 13]. It is therefore worth noting that intraoperative SRH is not intended to replace conventional pathological techniques but rather work in parallel as a complementary tool in scenarios where a timely feedback is of the essence.

In a possible future surgical scenario of a brain tumor resection (Fig. 4), after exposure of the skull, a frameless stereotactic biopsy [20] of the tumor at several points along a single trajectory via a burr hole centered on the planned craniotomy is performed (duration 10–20 min) (Fig. 4b). The correlated samples are then processed in parallel using SRH and conventional methods using fast frozen sections (duration ~ 15–30 min), validating the SRH images at multiple locations. Performing the biopsy through a burr hole yields the best possible correlation with neuronavigation by minimizing brain shift as well as loss of accuracy with time [23]. Next, craniotomy and durotomy are performed, and the brain is exposed (duration ~ 30 min). Ideally, by the time of tumor resection (Fig. 4c), the conventional fast frozen pathological diagnosis has been reported to the surgeon. Using validated SRH, it will then be possible to analyze the resection borders during the intervention. In case of residual tumor, the surgeon could repeatedly add SRH results to anatomical, fluorescence [5, 24], and neurophysiological [19] criteria to decide continuation or to stop resection.

Fig. 4

Workflow for the exploration of histopathological based neurosurgical decision-making. a Coronal schematic of possible neurosurgical approach for brain tumors using intraoperative SRH imaging for detection of the tumor borders. b Use of a frameless image-guided stereotactic biopsy system through a burr hole at the center of the planned craniotomy. Yellow arrowhead symbolizes samples dedicated to conventional neuropathological diagnostic, and white arrowhead symbolizes intraoperative SRH. c Craniotomy with potential brain shift and loss of navigation accuracy over time. d Sampling of resection borders to guide resection or for assessment of final resection margins. Program used to create figure, Adobe Illustrator CS 6 and BioRender.com (2021)

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 3249 KB)