Literature DB >> 34264525

An artificial intelligence-assisted diagnostic platform for rapid near-patient hematology.

Neta Bachar1, Dana Benbassat1, David Brailovsky1, Yochay Eshel1, Dan Glück1, Daniel Levner1, Sarah Levy1, Sharon Pecker1, Evgeny Yurkovsky1, Amir Zait1, Cordelia Sever2, Alexander Kratz3,4, Carlo Brugnara5,6.   

Abstract

Hematology analyzers capable of performing complete blood count (CBC) have lagged in their prevalence at the point-of-care. Sight OLO (Sight Diagnostics, Israel) is a novel hematological platform which provides a 19-parameter, five-part differential CBC, and is designed to address the limitations in current point-of-care hematology analyzers using recent advances in artificial intelligence (AI) and computer vision. Accuracy, repeatability, and flagging capabilities of OLO were compared with the Sysmex XN-Series System (Sysmex, Japan). Matrix studies compared performance using venous, capillary and direct-from-fingerprick blood samples. Regression analysis shows strong concordance between OLO and the Sysmex XN, demonstrating that OLO performs with high accuracy for all CBC parameters. High repeatability and reproducibility were demonstrated for most of the testing parameters. The analytical performance of the OLO hematology analyzer was validated in a multicenter clinical laboratory setting, demonstrating its accuracy and comparability to clinical laboratory-based hematology analyzers. Furthermore, the study demonstrated the validity of CBC analysis of samples collected directly from fingerpricks.
© 2021 The Authors. American Journal of Hematology published by Wiley Periodicals LLC.

Entities:  

Mesh:

Year:  2021        PMID: 34264525      PMCID: PMC9290600          DOI: 10.1002/ajh.26295

Source DB:  PubMed          Journal:  Am J Hematol        ISSN: 0361-8609            Impact factor:   13.265


INTRODUCTION

A large number of laboratory tests are now available for point‐of‐care testing (POCT) including, among others, urinalysis, blood chemistry and infectious disease testing. , , , However, hematology analyzers capable of performing complete blood counts (CBCs) have lagged in their prevalence at the point‐of‐care, despite CBCs ranking among the most commonly ordered tests. The relative absence of POC CBC analyzers has also hampered the adoption of other POC tests that tend to be ordered alongside the CBC (e.g., complete metabolic panels); in particular, if a CBC is required but must be performed in the central lab due to its absence at the point‐of‐care, its companion tests may as well be ordered from the central lab. The majority of current near‐patient CBC analyzers rely on the miniaturization of large‐lab analyzers, particularly those based on flow cytometry and/or impedance cytometry techniques. , , Such miniaturization has in many cases been accompanied by simplification, which has resulted in reduced numbers of parameters (e.g., three‐part instead of five‐part differentials), narrower reportable ranges, reduced abnormal cell flagging capabilities and in some cases a reduction in accuracy (as indicated by the small number of FDA clearances). , , These CBC analyzers have also inherited many of the product attributes of their larger relatives, including the requirements for liquid reagent replacement, washout and calibration procedures, and frequent quality‐control processes which in the POC context can be limiting or prohibitive. Sight OLO (S.D. Sight Diagnostics LTD, Israel) is a novel hematological platform designed to address some of the limitations in current near‐patient and POCT hematology analyzers. Note, OLO is based on recent advances in artificial intelligence (AI) and computerized image analysis (computer vision), and it provides a 19‐parameter, five‐part differential CBC. And, OLO employs single‐use test‐kits, a “dry” instrument and an extensive “Failsafe” self‐test system to reduce operation overheads and simplify operation. Sight OLO has received FDA 510(k) clearance for use in CLIA non‐waived settings and is CE marked for POC use, including its use with samples collected directly from fingerpricks. Here, the results are presented for the accuracy of OLO as compared with the Sysmex XN‐Series System (Sysmex, Kobe, Japan), as well as repeatability, flagging capabilities, reproducibility and matrix studies comparing the venous, capillary and fingerprick blood samples.

METHODS

The device

Sight OLO is a desktop hematology platform that was designed from the ground up for POC and near‐patient settings. The device employs single‐use test kits that use a novel method for creating and staining blood smears within disposable test cartridges (please see “sample preparation” below). These monolayer blood smears are rapidly imaged using OLO's automated fluorescence microscope to yield a set of more than 1000 multispectral micrographs per sample. The images are analyzed using OLO's onboard computer as they are collected using a set of specially designed algorithms, with the analysis resulting in the 19 reported CBC parameters and several flags, including flagging WBC for the presence of nucleated RBCs, blast cells, immature granulocytes and atypical lymphocytes. Then OLO displays the diagnostic result on its touchscreen interface, optionally provides a paper printout and transmits the result digitally to a laboratory information management system (LIMS) or electronic medical records (EMR) system. The device measures 32 cm by 28 cm by 25 cm (about one cubic foot) and houses no reagents; reagents are contained within each test kit, obviating the need for regular instrument washouts. Sight OLO is factory calibrated so it requires no regular calibration. By ensuring that all the optical, mechanical and electronic elements of the system that may have a direct effect on the analyzer calibration (for example: LED intensities, illumination maps, focus mechanism, cartridge leveling etc.) remain within allowed ranges and enforced by a lock‐out method, Sight OLO's Failsafe system works as an internal quality control to ensure that the device is performing appropriately, thereby obviating external quality control (QC) materials except as mandated by regulation. In addition, the Failsafe system is designed to mitigate user errors, consumable defects and blood sample irregularities by rejecting such samples to ensure that the analyzer does not return erroneous results.

Sample requirements and preparation process

Sight OLO accepts both venous and fingerprick blood samples. In the fingerprick workflow, two drops of blood totaling 27 μl are collected directly from the finger, using the components provided in each single‐use test kit as described below. Sight OLO was designed to work with low sample volumes to permit sample collection with no “milking” of the finger, in order to minimize patient discomfort. In the venous workflow (which also supports capillary samples collected in low‐volume collection tubes), blood is provided in a K2EDTA tube; the sample is deposited from the collection tube onto hydrophobic paper using standard tube‐top dispensers (e.g., Labcon U‐Pette) and then prepared using the components of the same test kit and following the same process as fingerprick samples. Each Sight OLO single‐use test kit contains a test cartridge, two capillaries for sample collection and a reagent‐filled mixing‐bottle. In turn, the test cartridge contains two separate sample chambers: a hemoglobin chamber and an imaging chamber. During sample preparation, a single drop of undiluted blood (17 μl) is used to fill the hemoglobin chamber; in the fingerprick workflow, this drop can be collected directly from the pricked finger using the provided capillary. An additional 10 μl of blood is collected using the second capillary (K2EDTA coated) and mixed with a diluent and dried fluorescent stains within the mixing‐bottle. The resulting blood mixture is then used to fill the imaging chamber (Figure 1).
FIGURE 1

The Sight OLO hematology analyzer. (A) A rendering of the Sight OLO hematology analyzer (Sight Diagnostics, Israel), a desktop system measuring 284 mm × 255 mm × 324 mm. (B) Components of OLO's single‐use test kit: (1) cartridge, (2) mixing‐bottle, (3) dropper‐cap, (4) microcapillary. (C) Sample preparation workflow for fingerprick samples. (D,E) False‐colored micrographs collected using OLO's multispectral microscopy. Red channel: hemoglobin absorption; green channel: nuclear DNA fluorescence; blue channel: cytoplasmic staining. (D) Characteristic examples of different white blood cell types. (E) Characteristic examples of different anomalous cell types and formations [Color figure can be viewed at wileyonlinelibrary.com]

The Sight OLO hematology analyzer. (A) A rendering of the Sight OLO hematology analyzer (Sight Diagnostics, Israel), a desktop system measuring 284 mm × 255 mm × 324 mm. (B) Components of OLO's single‐use test kit: (1) cartridge, (2) mixing‐bottle, (3) dropper‐cap, (4) microcapillary. (C) Sample preparation workflow for fingerprick samples. (D,E) False‐colored micrographs collected using OLO's multispectral microscopy. Red channel: hemoglobin absorption; green channel: nuclear DNA fluorescence; blue channel: cytoplasmic staining. (D) Characteristic examples of different white blood cell types. (E) Characteristic examples of different anomalous cell types and formations [Color figure can be viewed at wileyonlinelibrary.com]

Live monolayer imaging

To facilitate high‐resolution microscopy of individual cells, the blood sample has to be presented for imaging as a monolayer ‐ a film characterized by a defined focal plane in which cells rarely overlap with each other. Traditionally, this is accomplished through the preparation of blood smears; however, since the quality of blood films prepared using this process tends to vary significantly between users and across the sample area, the method was deemed unsuitable for POC usage. Instead, Sight OLO relies on a novel monolayer formation process: the diluted blood sample is drawn using capillary action into the imaging chamber, which has a predefined height of a few hundred of microns. Since blood cells are denser than the diluent, they gradually sink and settle on the chamber floor. Due to the small height of the chamber, this process only takes about 1 min, leaving the cells at a defined focal plane as desired for imaging. Furthermore, the dilution ratio is selected to ensure that, for the most part, the settled cells do not overlap regardless of the concentration of red blood cells in the sample (which ranges roughly between 2 × 106/μl and 8 × 106/μl). No sphering or fixation reagents are included in the diluent, in order to retain cell morphology.

Staining and multispectral imaging

Traditionally, blood smears are stained with Wright‐Giemsa stains and their variants, which have a century‐long track record in the differential identification of peripheral blood cell populations. However, these stains suffer from a number of drawbacks, including significant incubation times, the requirements for washing steps, the need for fixation (which disrupts morphology) and variability in stain appearance between preparations. These shortcomings prove challenging in the POC context, where speed, automation and a compact form‐factor are desired. It is for this reason that Sight OLO departs from traditional staining methods and employs a novel staining and imaging approach. Sight OLO uses a combination of brightfield and fluorescence microscopy, so that the identification of different cell populations can be aided by their optical and chemical signatures. In total, five illumination wavelengths are used to generate multispectral images of blood samples: violet (405 nm), green (517 nm) and red (633 nm) brightfield channels as well as ultra‐violet (365 nm) and blue (460 nm) fluorescent channels. Two fluorescent reagents are included in OLO's sample preparation process and mixed with blood as it undergoes the dilution process. The first of these reagents stains cell nuclear DNA while the other stains DNA, RNA and acidic cell organelles. Additionally, violet illumination, which is highly absorbed by hemoglobin, assists in identifying RBCs and quantifying cellular hemoglobin content. Characteristic images of different normal and abnormal blood cell types as acquired by OLO are presented using false coloring in Figure 1.

Scanning hardware

Sight OLO contains a fully automated fluorescence microscope which rapidly collects high‐quality images of the blood smear present within its single‐use test cartridge. The analyzer automatically scans at least 200 non‐overlapping fields within the sample, and at each field it acquires the several channels of fluorescent and brightfield imaging. In order to simplify manufacturing constraints on cartridge flatness, OLO automatically refocuses on the sample at every field. Each blood sample is thus “digitized” into approximately 6 GB of image data. In addition to microscopy, the Sight OLO also measures hemoglobin using an unlysed, reagent‐free process utilizing four wavelengths to account for absorption and scattering. The hemoglobin chamber is directly filled with undiluted whole blood using capillary action and contains several measurement areas, which differ by optical path length. These areas are used to derive differential measurements in order to normalize for system parameters such as illumination intensity and manufacturing tolerances.

Algorithmic analysis

Sight OLO quantifies and characterizes cell populations in each image by employing three different analysis pipelines, one for each of the three primary cell types: red blood cells (RBCs), white blood cells (WBCs) and platelets. Each of these pipelines uses a similar two‐stage process: first, “candidates” are generated based on certain characteristic features of the relevant cell population; then, each of these candidates is characterized using more in‐depth analysis. Specifics for each of the three analysis pipelines are detailed below.

Red blood cells

Red blood cells (RBC) are identified by the analyzer's algorithms using brightfield images, which include images in the violet channel which is highly absorbed by the RBC hemoglobin content. This allows the detection algorithm to distinguish areas containing RBCs from their surrounding background. However, RBCs may still overlap due to landing too close to each other, an effect that can confound cell counts and per‐cell measurements. Consequently, once candidates are identified, they are screened for overlaps and split into individual cells using morphological features as necessary for accurate counting using their morphological features. Red blood cells are further characterized using Convolutional Neural network (CNN) algorithms in order to estimate cell properties such as mean cell hemoglobin (MCH). Mean cell volume (MCV) and mean cell hemoglobin concentration (MCHC) are also obtained from the images.

White blood cells

White blood cell (WBC) candidates are detected using the fluorescent staining exhibited by both their nucleus and cytoplasm, which must both be present. The candidates (which number in the order of a thousand in a typical sample) are then filtered according to size and shape to prevent debris and other unidentified objects from entering the classification process. The two fluorescent channels together with the brightfield channels are used to classify each cell as a specific WBC type. To do so, each cell's image is first segmented into a nucleus and a cytoplasm. It is then characterized by computing different features on either the cell, cytoplasm or nucleus; these features include morphological features (e.g., its area and diameter), intensity features (whether fluorescent emission or brightfield absorption) or texture (e.g., computing the standard deviation of the fluorescence of the nucleus and cytoplasm across their identified areas). These features are then used to classify the different WBC types, including abnormal cell types, by using machine‐learning classification algorithms.

Platelets

Platelets are detected using fluorescent staining. However, due to their low RNA content, platelets require a longer exposure time in order to obtain a strong enough signal to stand above the background. This signal is combined with the brightfield channels to detect the candidates. However, being much smaller and less bright than the other two cell types, cell fragments and debris are sometimes also detected as platelet candidates. Accordingly, true platelets are identified first by filtering the candidates according to different morphological and intensity properties, then applying several convolutional neural networks trained to accurately distinguish the platelets from background in different scenarios.

Clinical protocol

Method comparison study

A method comparison study was undertaken to compare Sight OLO with the Sysmex XN‐1000 System. The study design was based on the methods outlined in CLSI H20‐A2, CLSI H26‐A2 and CLSI EP09‐A3, and is consistent with the approach conducted for FDA submissions for hematology devices. Residual whole blood clinical samples (N = 679) were collected from both adult (>22 years old, N = 462) and pediatric patients (3 months to 21 years old, N = 217). The majority of samples were venous whole blood samples, while roughly 20 pediatric samples were capillary whole blood samples. All samples were collected in standard K2EDTA collection tubes (Becton Dickinson, Franklin Lakes, NJ, USA) and processed within 8 h of collection. Processing included testing on both analyzers within 2 h of each other, as well as preparing three blood smears for each sample. The study included both normal and pathological samples in order to assess Sight OLO's performance across the analytical measuring range and around medical decision points. A Passing‐Bablok regression analysis was performed for each CBC parameter after excluding any result which is invalidated by Sight OLO or by the comparative method. For each regression analysis, the slope and intercept and the 95% two‐sided confidence interval (CI) around the slope and intercept were calculated, as well as the correlation coefficient. The overall bias was calculated as the median of differences, where differences were taken either as absolute or relative, according to the nature of the data.

Repeatability study

Within‐run repeatability studies were performed using residual K2EDTA whole blood venous samples (minimum of 2 ml per sample). In order to span healthy and pathological values and the medical decision points between them, each site tested at least four samples within lab reference ranges, three samples around medical decision levels for HGB (6–10 g/dl), PLT (<50 × 103/μl) and WBC (<2 × 103/μl), and four samples around the upper range for RBC (>6 × 106/μl), HGB (>17 g/dl), WBC (>12 × 103/μl) and PLT (>600 × 103/μl). In total, this requirement led to 38 samples being scanned, with each sample measured 20 consecutive times (after excluding invalidations or rejects). Standard deviation (SD) and coefficient of variation were calculated for each run. The first 20 successful runs per measurand and were analyzed. If fewer than 20 successful scans were obtained within the required time slot from phlebotomy (8 h), the sample was still analyzed so long as 17 or more replicates were scanned. For the anemic samples (HGB 6–10 g/dl) only RBC, HGB and HCT were analyzed, while for the thrombocytopenic (<50 × 103/μl) and leukopenic (<2 × 103/μl) samples, only PLT and only the WBC concentration and differential were analyzed, respectively. This was in accordance with the CLSI guidance H26‐A2, which refers to the ICSH protocol for evaluation of blood cell counters.

Reproducibility studies

Reproducibility studies were conducted using three levels of commercial control materials (low, normal and high ‐ below, within and above the reference ranges of main parameters, respectively) for all reported parameters. A total of 240 samples were included for each level of control. Controls (R&D Systems, Minneapolis, MN) were measured over five operating days at three sites (Boston Children's Hospital, Columbia University and Sight's laboratory), with two devices at each site for a total of six devices. Two runs per day, and four replicates per run were performed. At each site the testing was performed by two operators, where the first operator conducted the first run of all days and the second operator conducted the second run. Every replicate required a new test kit and, every day, a new quality control material tube per level was opened at each site. This was in accordance with the CLSI guideline EP‐05‐A3.

Flagging study

The flagging capabilities of Sight OLO were compared to manual microscopy for WBC distributional abnormalities and WBC morphological abnormalities, which include blasts, immature granulocytes, nucleated RBCs, and atypical lymphocytes. Other invalidating messages, such as platelet clumps and RBC agglutination were not included in the flagging study. The 108 negative and 100 positive samples with WBC count larger than 4 × 103/μl were enrolled from the method comparison study. For each sample, the three prepared smears were sent to analysis by trained morphologists from Columbia University Irving Medical Center staff, who had no access to either clinical information or reference method results. The testing design was based on the test methods outlined in CLSI H20‐A2 and CLSI H26‐A2.

Matrix comparison study

A matrix comparison study was performed in two parts to assess the equivalence between venous and capillary samples, and between capillary and direct‐from‐finger samples. In the first part of the study, 67 samples (of 52 subjects, 15 of which repeated the test after a 6‐month interval) were collected in pairs. A venous sample was drawn, and a capillary sample was collected into 350 μl microtainers. Healthy volunteers were primarily tested, and additional samples at medical decision points and across the analytical measuring range (i.e.,: HGB 6–10 g/dl; WBC <2 × 103/μl; PLT <50 × 103/μl; WBC >12 × 103/μl; PLTs >500 × 103/μl; RBCs >6 × 106/μl; HGB >17 g/dl) were enrolled from subjects in Tel Aviv Sourasky Medical Center. Each pair of samples was tested on the same Sight OLO device four times: two replicates of the venous sample and two of the capillary samples. After excluding invalidated results, a Passing‐Bablok regression analysis was performed between the pair‐averaged capillary and pair‐averaged venous samples. For the second part of the matrix‐comparison study, 40 apparently healthy patients were enrolled, and capillary samples were collected from each of them using two different methods. First, a capillary sample was collected into a 350 μl microtainer. Then, two fingerprick samples from different fingers were collected, 27 μl from each, directly into the Sight OLO test kit's microcapillaries and immediately processed on the OLO. The two fingerprick samples and the two repeats of the capillary sample collected into the microtainer were averaged, and results were compared to each other using Passing‐Bablok analysis.

RESULTS

We report here on the results of a clinical study conducted from June 2018 to March 2019 across three geographically diverse sites in the US: Boston Children's Hospital (Boston, MA); Center for Advanced Laboratory Medicine, Columbia University (New York, NY); and TriCore Reference Laboratories (Albuquerque, NM). Some of the testing for the reproducibility and matrix comparison studies took place in Sight Diagnostics' lab in Israel, with samples obtained from the Tel Aviv Sourasky Medical Center in Israel. The study protocol was reviewed and accepted by the Institutional Review Board (IRB) of each site separately. The clinical and analytical performance assessments included method comparison with a comparative device, matrix comparison (venous vs. capillary and capillary vs. direct‐from‐finger samples), as well as repeatability, reproducibility and flagging studies.

Method comparison

The accuracy of Sight OLO was compared with the Sysmex XN‐1000 System. The study design was based on the methods outlined below and in accordance with CLSI H20‐A2, CLSI H26‐A2 and CLSI EP09‐A3. Samples from patients age 3 months to 94 years and included 355 males (52%) and 324 females (48%) were analyzed; 32% of the samples were from pediatric patients (3 months–21 years). Samples were selected to comprise several abnormalities, including different blood disorders and tumors (e.g., various types of anemias, leukemias, lymphomas, myelomas), and covered a wide clinical range for each of the tested parameters. The results of the regression analysis, which are included in Figure 2, show a strong concordance between the Sight OLO and the Sysmex XN both in terms of correlation coefficient and as seen through slope, bias and intercept. Sight OLO performs with high accuracy for all CBC parameters. Detailed results are included in Table S1. Figure S1 and Table S2 illustrate a version of the analysis without the exclusion of measurands invalidated by OLO, demonstrating the high number of actionable results.
FIGURE 2

Results of the method comparison study between the Sight OLO and the Sysmex XN hematology analyzers. Graphs indicate Pearson correlation, slope and bias for each parameter. These results are tabulated in Table S1 [Color figure can be viewed at wileyonlinelibrary.com]

Results of the method comparison study between the Sight OLO and the Sysmex XN hematology analyzers. Graphs indicate Pearson correlation, slope and bias for each parameter. These results are tabulated in Table S1 [Color figure can be viewed at wileyonlinelibrary.com]

Repeatability and reproducibility

Within‐run repeatability studies were performed using residual K2EDTA whole blood samples as described below. In these studies, Sight OLO demonstrated high repeatability for most of the testing parameters. Table 1 shows the pooled SD for each measurand in relevant clinical ranges across all samples within that range. Reproducibility results are included in the Table S4 and show similar performance to the within‐run whole blood repeatability shown in Table 1.
TABLE 1

Whole blood repeatability results

Pooled results of repeatability study
MeasurandUnitsN samplesN replicatesTarget rangeMeanPooled SD
WBC103/μl4780.5–4.02.040.12
WBC103/μl265124.0–80.09.260.40
RBC106/μl4801.0–3.53.020.06
RBC106/μl275313.5–8.05.040.11
PLT103/μl713620–15078.524.76
PLT103/μl24474150–800309.0116.69
HGBg/dl71395–118.950.2
HGBg/dl2447311–2514.810.28
HCT%3161410–7040.450.91
MCVfl2855450–15085.280.58
RDW%2855210–40150.34
MCHpg2855410–4528.50.2
MCHCg/dl2855426–3833.260.28
NEUT%%120WBC ≤ 4.0 × 103/μl56.971.78
NEUT%%20398WBC > 4.0 × 103/μl66.821.41
NEUT#103/μl358WBC ≤ 4.0 × 103/μl0.970.09
NEUT#103/μl20398WBC > 4.0 × 103/μl6.450.31
LYMPH%%120WBC ≤ 4.0 × 103/μl31.802.00
LYMPH%%20398WBC > 4.0 × 103/μl22.621.26
LYMPH#103/μl358WBC ≤ 4.0 × 103/μl0.840.07
LYMPH#103/μl20398WBC > 4.0 × 103/μl1.890.13
MONO%%158WBC ≤ 4.0 × 103/μl8.301.20
MONO%%20398WBC > 4.0 × 103/μl7.740.86
MONO#103/μl358WBC ≤ 4.0 × 103/μl0.160.03
MONO#103/μl20397WBC > 4.0 × 103/μl0.690.09
EOS%%158WBC ≤ 4.0 × 103/μl2.000.63
EOS%%20398WBC > 4.0 × 103/μl2.290.49
EOS#103/μl358WBC ≤ 4.0 × 103/μl0.040.02
EOS#103/μl20398WBC > 4.0 × 103/μl0.190.04
BASO%%158WBC ≤ 4.0 × 103/μl0.940.40
BASO%%20398WBC > 4.0 × 103/μl0.540.25
BASO#103/μl358WBC ≤ 4.0 × 103/μl0.020.01
BASO#103/μl20398WBC > 4.0 × 103/μl0.040.02
Whole blood repeatability results

White blood cell flagging study

The flagging capabilities of Sight OLO were compared to manual microscopy for WBC distributional abnormalities and WBC morphological abnormalities, which include blasts, immature granulocytes, nucleated RBCs, and atypical lymphocytes. Other invalidating messages, such as platelet clumps and RBC agglutination were not included in the flagging study. The 108 negative and the 100 positive samples with WBC count larger than 4 × 103/μl were enrolled from the method comparison study. For each of the 208 samples, two qualified examiners evaluated the blood films and performed a 200‐cell differential on one of three blood films, according to examination protocol. When abnormalities were present (e.g., distributional abnormalities based on manual differential count or morphological abnormality), the sample was considered abnormal. Otherwise, the sample was considered normal. Rumke analysis was used for ensuring agreements between the two examiners, whereby a third was used as an arbitrator if no such agreement was found. If no pair of examiners who agree with each other was found, the sample was discarded. The flagging study tested for both WBC distributional abnormality and the following WBC morphology abnormalities that are flagged by Sight OLO: NRBCs, blast cells, immature granulocytes and atypical lymphocytes. The OLO's flagging was assessed for agreement with the assessment of the manual blood smears. The overall WBC flagging capabilities of OLO showed good clinical utility for both sensitivity and specificity, as seen in Table S3. Specifically, the assessment of OLO's flagging performance for the WBC abnormalities demonstrated sensitivity/positive percent agreement of 93% (95% CI: 86.1%–97.1%), specificity/negative percent agreement of 80.6% (95% CI: 71.8%–87.5%) and overall agreement of 86.5% (95% CI: 81.1%–90.9%).

Matrix comparison

A matrix comparison study was performed in two parts to assess the equivalence of Sight OLO's analysis between venous and capillary samples, and between capillary and direct‐from‐finger samples. The results of the comparison between the capillary and venous samples of 67 patients, including some outside of the normal range, is shown in Table 2. Similarly, a comparison between the 40 healthy patients' direct‐from‐finger and capillary samples is shown in Table S5. In this analysis, a single sample was excluded as a clear monocyte outlier and was in fact invalidated for monocyte count and fraction. This sample was also abnormal, having less than 4 × 103/μl leukocytes. No other invalidated results were excluded from analysis. Both studies showed good agreement between the venous and capillary and between capillary and direct from fingerprick samples, with high correlation and small biases, supporting the use of the different specimen types for measurement on OLO.
TABLE 2

Venous versus capillary matrix study results

MeaurandNCapillaryVenousSlopeSlope CIInterceptIntercept CIrBias
MeanMinMaxMeanMinMax
WBC (×103/μl)657.7250.3119.207.2810.2218.901.08(1.02, 1.16)−0.1(−0.6, 0.3)0.986.8%
RBC (×106/μl)674.7562.226.274.6672.146.171.01(0.97, 1.05)0.0(−0.2, 0.2)0.991.8%
PLT (×103/μl)65231.39686231.496601.04(1.0, 1.08)−7(−18, 1)0.990.5%
HGB (g/dl)6713.567.217.913.356.817.91.00(0.97, 1.05)0.3(−0.4, 0.7)0.991.6%
HCT (%)6741.3820.754.340.6420.652.61.02(0.98, 1.07)−0.1(−1.9, 1.6)0.991.6%
NEUT# (×103/μl)494.6750.0111.624.4070.0110.021.09(1.03, 1.18)−0.2(−0.5, 0.1)0.985.7%
LYMPH# (×103/μl)492.4500.339.472.3100.337.741.05(0.96, 1.16)0.00(−0.23, 0.22)0.985.1%
MCV (fl)6787.4979.3114.487.5679.1114.61.02(0.98, 1.08)−2.1(−6.8, 1.5)0.99−0.2%
RDW (%)6713.1811.423.113.1711.422.81.00(0.96, 1.03)0.0(−0.4, 0.5)0.990.0%
MCH (pg)6728.7125.538.128.8025.638.11.00(0.97, 1.02)−0.1(−0.8, 0.7)1.00−0.3%
MCHC (g/dl)6732.8231.235.032.8831.334.91.03(0.92, 1.17)−0.9(−5.5, 2.6)0.880.0%
NEUT%4958.071.184.058.582.784.31.01(0.94, 1.07)−0.8(−4.1, 2.6)0.99−0.3
LYMPH%4931.8311.193.332.1311.095.90.98(0.93, 1.05)0.0(−2.0, 1.7)0.99−0.5
MONO%496.903.112.26.001.010.21.13(0.93, 1.34)0.0(−1.3, 1.4)0.820.85
MONO# (×103/μl)490.5440.020.940.4470.010.821.25(1.09, 1.46)−0.01(−0.11, 0.05)0.8822.0%
EOS%492.770.09.42.840.08.20.93(0.82, 1.06)0.14(−0.18, 0.35)0.94−0.1
EOS# (×103/μl)490.2130.000.620.2050.000.581.00(0.87, 1.10)0.01(−0.02, 0.03)0.940.01
BASO%490.430.01.50.440.01.61.00(0.79, 1.33)0.0(−0.1, 0.1)0.710.0
BASO# (×103/μl)490.0350.000.140.0340.000.151.09(0.88, 1.40)0.00(−0.01, 0.01)0.780.01
Venous versus capillary matrix study results

DISCUSSION

This multicenter evaluation provides a comprehensive validation of the performance characteristics of the Sight OLO hematological platform. Method comparison, repeatability and reproducibility studies demonstrate that the OLO analyzer provides CBC results that are comparable with the Sysmex XN across a wide measuring range, including highly challenging samples. A high correlation (r ≥ 0.94) was found between most RBC parameters and WBC differentials (Figure 2). In the differential, a very high correlation (r > 0.98) was seen for neutrophils, lymphocytes and eosinophils whereas a moderately high correlation (r = 0.89) was found for the monocytes fraction and a r = 0.67 correlation was found for the basophils faction. Also, low correlation was found for mean corpuscular hemoglobin concentration (r = 0.69). The slightly low correlation for basophils is not uncommon, as the typical data range for this parameter is very limited, leading to low correlation values. The slightly low correlation for MCHC is due to the fact that in both OLO and the Sysmex XN, MCHC is a calculated parameter based on the ratio of two highly correlated values (MCH and MCV or HGB and HCT), leading to a small range of MCHC values; such ratios mathematically amplify any small system‐specific differences in either of the parameters, thereby harming the correlation in the calculated parameter despite the very high correlation of MCH and MCV. These findings are equivalent to those observed for comparison between other modern laboratory analyzers. , , The OLO reproducibility and repeatability values were found to be within the CLIA allowable total errors for the relevant measurands. The present study also evaluated OLO's automated flagging of samples for the presence of distributional abnormalities, NRBCs, blast cells, immature granulocytes and atypical lymphocytes. Results indicate that for these flags the OLO system was in high accordance with manual microscopy. Sight OLO offers a full CBC utilizing only 27 μl of blood sample, providing substantial blood conservation for oncology, neonatal and pediatric patients. While OLO is currently indicated for use in patients 3 months and older, further studies are currently being conducted to increase the population range. Furthermore, the fact that 27 μl may be directly drawn from a fingerprick reduces some of the additional overheads and inconveniences associated with venous phlebotomy or larger volume capillary collection and may alleviate the anxiety involved with these for certain apprehensive populations such as pediatrics or patients who poorly tolerate traditional needle‐based blood drawings. The disposable cartridge utilized by OLO has added benefits, as the risk of carryover or system clogging are eliminated, and no maintenance and cleaning are required between runs. The study presented here successfully validated the performance of Sight OLO hematology analyzer in a multicenter clinical laboratory setting. In particular, the study demonstrated that OLO is accurate and comparable to the renowned Sysmex XN Series Hematology Analyzers. This study led to OLO's FDA 510(k) clearance, and it demonstrates the capabilities of multi‐spectral live monolayer imaging and AI‐assisted image analysis in hematology. The study also demonstrated the validity of performing five‐part differential CBC analysis using direct‐from‐finger blood samples: Sight OLO was able to produce results from fingerpricks that are equivalent to those obtained using venous blood draws. Of note, OLO is the first CBC analyzer to be cleared by the FDA for collecting samples directly from fingerpicks.

CONFLICT OF INTEREST

Employment or Leadership: Yochay Eshel, S.D. Sight Diagnostics LTD; Daniel Levner, S.D. Sight Diagnostics LTD; Amir Zait, S.D. Sight Diagnostics LTD; Dan Glück, S.D. Sight Diagnostics LTD; Dana Benbassat, S.D. Sight Diagnostics LTD; Sharon Pecker, S.D. Sight Diagnostics LTD; David Brailovsky, S.D. Sight Diagnostics LTD; Evgeny Yurkovsky, S.D. Sight Diagnostics LTD; Neta Bachar, S.D. Sight Diagnostics LTD; Sarah Levy, S.D. Sight Diagnostics LTD. Cordelia Sever, Alexander Kratz, and Carlo Brugnara received research funding from S.D. Sight Diagnostics LTD in the form of a sponsored research agreement/contract. Yochay Eshel, Daniel Levner, Amir Zait, Dan Glück, Dana Benbassat, Sharon Pecker, David Brailovsky, Evgeny Yurkovsky, Neta Bachar, and Sarah Levyare S.D. Sight Diagnostics LTD employees and stockholders.

AUTHOR CONTRIBUTIONS

All authors confirm their contribution to the intellectual content of this manuscript. All authors have met the following requirements: (a) significant contribution to conception and design, data acquisition and/or analysis, and data interpretation; (b) drafting or revision of the intellectual content of the article; (c) final approval of the article if published. Conceptualization: Yochay Eshel, Daniel Levner, Alexander Kratz, Sarah Levy. Methodology: Dana Benbassat, Sharon Pecker, Dana Benbassat, Evgeny Yurkovsky, Neta Bachar, Sarah Levy. Investigation: Dana Benbassat, Sharon Pecker, Dana Benbassat, Evgeny Yurkovsky, Neta Bachar, Sarah Levy, Cordelia Sever, Alexander Kratz, Carlo Brugnara. Supervision: Sarah Levy, Cordelia Sever, Alexander Kratz, Carlo Brugnara. Writing – original draft: Yochay Eshel, Daniel Levner, Amir Zait, Carlo Brugnara. Writing – review & editing: Yochay Eshel, Daniel Levner, Amir Zait, Cordelia Sever, Alexander Kratz, Carlo Brugnara.

CONSULTANT OR ADVISORY ROLE

None declared.

STOCK OWNERSHIP

Y. Eshel, D. Levner, A. Zait, D. Glück, D. Benbassat, S. Pecker, D. Brailovsky, E. Yurkovsky, N. Bachar, and S. Levy have ownership of S.D. Sight Diagnostics LTD stocks or stock options.

HONORARIA

None declared.

EXPERT TESTIMONY

None declared.

PATENTS

Y. Eshel, D. Levner, A. Zait, D. Glück, D. Benbassat, S. Pecker, D. Brailovsky, and S. Levy are inventors of patent applications and issued patents assigned to S.D. Sight Diagnostics LTD (PCT/IL2017/050526; PCT/IL2017/050523; PCT/IB2020/061728; PCT/IB2020/061724; PCT/IL2016/051025; PCT/IB2020/061732; PCT/IB2020/061736 PCT/IB2020/061731; PCT/IB2020/059924).

OTHER REMUNERATIONS

None declared.

ROLE OF SPONSOR

The funding organization played a direct role in study design, data review and interpretation, manuscript preparation, and manuscript final approval. Appendix S1. Supporting Information Click here for additional data file.
  14 in total

Review 1.  Point-of-care testing.

Authors:  M R Fiallos; U A Hanhan; J P Orlowski
Journal:  Pediatr Clin North Am       Date:  2001-06       Impact factor: 3.278

2.  A microfluidic biochip for complete blood cell counts at the point-of-care.

Authors:  U Hassan; B Reddy; G Damhorst; O Sonoiki; T Ghonge; C Yang; R Bashir
Journal:  Technology (Singap World Sci)       Date:  2015-12-11

3.  Evaluation of the AVOXimeter: precision, long-term stability, linearity, and use without heparin.

Authors:  S R Bailey; E L Russell; A Martinez
Journal:  J Clin Monit       Date:  1997-05

4.  [Point-of-care testing in family practices: present use and need for tests in the future].

Authors:  Jochen W L Cals; Angel M R Schols; Henk C P M van Weert; Femke Stevens; Camiel G I P Zeijen; Gea Holtman; Wim A M Lucassen; Marjolein Y Berger
Journal:  Ned Tijdschr Geneeskd       Date:  2014

5.  Comparison of performance and abnormal cell flagging of two automated hematology analyzers: Sysmex XN 3000 and Beckman Coulter DxH 800.

Authors:  S Genc; E Dervisoglu; S Erdem; O Arslan; M Aktan; B Omer
Journal:  Int J Lab Hematol       Date:  2017-10-04       Impact factor: 2.877

6.  The HemoScreen, a novel haematology analyser for the point of care.

Authors:  Yaara Ben-Yosef; Barak Marom; Galit Hirshberg; Carol D'Souza; Anders Larsson; Avishay Bransky
Journal:  J Clin Pathol       Date:  2016-01-19       Impact factor: 3.411

7.  Multicenter evaluation of the cobas m 511 integrated hematology analyzer.

Authors:  Mathias Bruegel; Tracy I George; Bo Feng; Timothy R Allen; Dan Bracco; David J Zahniser; Henk Russcher
Journal:  Int J Lab Hematol       Date:  2018-07-20       Impact factor: 2.877

8.  An artificial intelligence-assisted diagnostic platform for rapid near-patient hematology.

Authors:  Neta Bachar; Dana Benbassat; David Brailovsky; Yochay Eshel; Dan Glück; Daniel Levner; Sarah Levy; Sharon Pecker; Evgeny Yurkovsky; Amir Zait; Cordelia Sever; Alexander Kratz; Carlo Brugnara
Journal:  Am J Hematol       Date:  2021-08-02       Impact factor: 13.265

Review 9.  Cell Cytometry: Review and Perspective on Biotechnological Advances.

Authors:  Abhishek Vembadi; Anoop Menachery; Mohammad A Qasaimeh
Journal:  Front Bioeng Biotechnol       Date:  2019-06-18

Review 10.  Point-of-care testing (POCT): Current techniques and future perspectives.

Authors:  Peter B Luppa; Carolin Müller; Alice Schlichtiger; Harald Schlebusch
Journal:  Trends Analyt Chem       Date:  2011-03-21       Impact factor: 12.296

View more
  4 in total

1.  Hilab system, a new point-of-care hematology analyzer supported by the Internet of Things and Artificial Intelligence.

Authors:  Aléxia Thamara Gasparin; Claudiane Isabel Franco Araujo; Patricia Schmitt; Mônica Ribas Cardoso; Maiara Carolina Perussolo; Thainá Caroline Schuartz de Jesus; Erika Bergamo Santiago; Ivan Lucas Reis Silva; Ricardo Gurgel de Sousa; Flavia Zhu Teng; Evair Borges Severo; Victor Henrique Alves Ribeiro; Milena Andreuzo Cardoso; Fernanda D'Amico Silva; Carolina Rodrigues de Araujo Perazzoli; João Samuel de Holanda Farias; Bernardo Montesanti Machado de Almeida; Sergio Renato Rogal Júnior; Marcus Vinícius Mazega Figueredo
Journal:  Sci Rep       Date:  2022-06-21       Impact factor: 4.996

2.  An artificial intelligence-assisted diagnostic platform for rapid near-patient hematology.

Authors:  Neta Bachar; Dana Benbassat; David Brailovsky; Yochay Eshel; Dan Glück; Daniel Levner; Sarah Levy; Sharon Pecker; Evgeny Yurkovsky; Amir Zait; Cordelia Sever; Alexander Kratz; Carlo Brugnara
Journal:  Am J Hematol       Date:  2021-08-02       Impact factor: 13.265

Review 3.  A Review of Artificial Intelligence Applications in Hematology Management: Current Practices and Future Prospects.

Authors:  Yousra El Alaoui; Adel Elomri; Marwa Qaraqe; Regina Padmanabhan; Ruba Yasin Taha; Halima El Omri; Abdelfatteh El Omri; Omar Aboumarzouk
Journal:  J Med Internet Res       Date:  2022-07-12       Impact factor: 7.076

4.  Real-world evaluation of rapid and laboratory-free COVID-19 triage for emergency care: external validation and pilot deployment of artificial intelligence driven screening.

Authors:  Andrew A S Soltan; Jenny Yang; Ravi Pattanshetty; Alex Novak; Yang Yang; Omid Rohanian; Sally Beer; Marina A Soltan; David R Thickett; Rory Fairhead; Tingting Zhu; David W Eyre; David A Clifton
Journal:  Lancet Digit Health       Date:  2022-03-09
  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.