Conventional molecular recognition elements, such as antibodies, present issues for developing biomolecular assays for use in certain technologies, such as implantable devices. Additionally, antibody development and use, especially for highly multiplexed applications, can be slow and costly. We developed a perception-based platform based on an optical nanosensor array that leverages machine learning algorithms to detect multiple protein biomarkers in biofluids. We demonstrated this platform in gynecologic cancers, often diagnosed at advanced stages, leading to low survival rates. We investigated the detection of protein biomarkers in uterine lavage samples, which are enriched with certain cancer markers compared to blood. We found that the method enables the simultaneous detection of multiple biomarkers in patient samples, with F1-scores of ~0.95 in uterine lavage samples from patients with cancer. This work demonstrates the potential of perception-based systems for the development of multiplexed sensors of disease biomarkers without the need for specific molecular recognition elements.
Conventional molecular recognition elements, such as antibodies, present issues for developing biomolecular assays for use in certain technologies, such as implantable devices. Additionally, antibody development and use, especially for highly multiplexed applications, can be slow and costly. We developed a perception-based platform based on an optical nanosensor array that leverages machine learning algorithms to detect multiple protein biomarkers in biofluids. We demonstrated this platform in gynecologic cancers, often diagnosed at advanced stages, leading to low survival rates. We investigated the detection of protein biomarkers in uterine lavage samples, which are enriched with certain cancer markers compared to blood. We found that the method enables the simultaneous detection of multiple biomarkers in patient samples, with F1-scores of ~0.95 in uterine lavage samples from patients with cancer. This work demonstrates the potential of perception-based systems for the development of multiplexed sensors of disease biomarkers without the need for specific molecular recognition elements.
Current biomolecular identification methodologies rely heavily on one-to-one recognition via specific proteins and nucleic acids such as antibodies, peptides, and aptamers to bind analytes (–). However, the development of highly sensitive and specific binding moieties in quantities sufficient to detect target molecules with one-to-one recognition has multiple challenges that delay the development of a robust, versatile, and cost-effective platform for multiple analyte detection. The challenges of using antibodies include long-term stability/robustness, transient/real-time applications, and production difficulties, especially when many different antibodies must be developed (–). Hence, technologies that replace antibodies could enhance the development of certain types of point-of-care assays, medical devices such as wearable sensors, and diagnostics in underresourced settings (, ).Perception-based machine learning (ML) platforms, modeled after the complex olfactory system, can isolate individual signals through an array of relatively nonspecific receptors (). Each receptor captures certain features, and the overall ensemble response is analyzed by the neural network in our brain, resulting in perception. Biofluids such as blood, urine, saliva, and sweat are indicative of physiological conditions and enable biomarker detection in their native state (, ). Recent advances in ML methodologies have made complex algorithms more accessible, facilitating the integration of perception systems into materials science (, ). We believe that perception-based sensors can be developed to enable the successful, multiplexed detection of analytes without the need for antibodies.Previous attempts to develop perception-based sensing platforms have had limited success. Prior works include “electronic nose” technologies (–) for gas sensing, based on conducting polymers, DNA-decorated field-effect transistors (), and other technologies based on protein recognition using simple data analytic techniques (). “Optical” noses have been developed as well (, ). However, these developments are limited in their ability to detect molecules such as proteins and in physiological conditions and complex biofluids. To overcome limitations associated with one-to-one recognition elements, we are investigating the development of a perception-based methodology that uses ML processes coupled with a sensor array, where each element exhibits moderate selectivity for a wide range of molecules.The prognosis and quality of life of patients with cancer are strongly affected by the ability to accurately diagnose diseases at an early stage. One such example is ovarian cancer, the fifth leading cause of cancer-related deaths among women in the United States and first among gynecologic malignancies (), with 22,000 new cases and 14,000 deaths per year (). The 5-year relative survival rate for patients diagnosed with ovarian cancer is 44% (), while detection at stage I can increase the 5-year survival rate to more than 90% (). However, there are no methods to date that achieve early, accurate diagnoses or are there strategies to rapidly determine patient response to treatment to inform the choice of therapy.To detect gynecologic cancers, such as high-grade serous ovarian carcinoma (–) and endometrial cancers (, ), U.S. Food and Drug Administration–approved serum biomarkers such as cancer antigen 125 (CA-125) and human epididymis protein 4 (HE4) have been used as well as ultrasonography. However, these methods lack the sensitivity to detect early-stage cancer and have had little impact on survival (, ). A recent study of uterine lavage (or uterine washings, fluids removed from the uterus after perfusion with saline) found substantially higher levels of biomarkers, such as HE4, CA-125, chitinase-3-like protein 1 (YKL-40), and mesothelin, than those found in serum (). Therefore, the use of uterine lavage has the potential to improve early detection.Single-wall carbon nanotubes (SWCNTs) have unique optical properties and sensitivity that make them valuable as sensor materials (). SWCNTs emit near-infrared (NIR) photoluminescence with distinct narrow emission bands that are exquisitely sensitive to the local environment (). In addition, the emission is photostable, enabling quantitative and long-term monitoring of small molecules, proteins, nucleic acids, and enzymatic activities both in vitro and in vivo (–). Individual SWCNT species (or chiralities) have distinct bandgaps, which contribute to their varying sensitivities to redox phenomena (, ). Their emission bands also respond to the local dielectric and electrostatic charge environment, resulting in solvatochromic shifting (, ). Coatings such as DNA can confer not only colloidal stability in an aqueous solution but also selectivity by modulating the surface coverage and bandgap (). The use of DNA-wrapped SWCNTs (DNA-SWCNTs) has been used for the detection of a wide range of analytes in biological media, including in live cells and animals (, ).In this study, we investigate a perception-based sensing system to detect multiple biomarkers in human biofluids (Fig. 1). We developed a DNA-SWCNT–based photoluminescent sensor array wherein the optical responses were used to train ML models to detect gynecologic cancer biomarkers HE4, CA-125, and YKL-40 in laboratory-generated samples and patient fluids. Distinct changes in fluorescent peak position and intensity values from each DNA-SWCNT combination were observed in response to the protein analytes. ML algorithms support vector machine (SVM), random forest (RF), and artificial neural network (ANN) enabled the prediction of both the presence (classification) and concentration (regression) of each biomarker. In uterine lavage samples, the classification results were highly accurate, producing F1-scores of ~0.95 in laboratory-generated samples and classification successes of 100% for HE4 and CA-125 and 91% for YKL-40 in cancer patient samples. This work suggests that a nanosensor/perception-based sensing system can accurately detect multiple disease biomarkers in patient biofluids.
Fig. 1.
Perception-based nanosensor platform for protein biomarkers.
(1) Eleven single-stranded DNA oligonucleotides wrap SWCNT chiralities to form DNA-SWCNT sensor complexes. (2) The array of sensors is incubated in the sample of interest. (3) The optical response of the sensors is interrogated by high-throughput NIR spectroscopy. (4) The spectroscopic data are fitted to determine the wavelength and intensity of each sensor emission band. (5) The sensor responses are processed into a feature vector (FV) training set. A.U., arbitrary units. (6) ML algorithms are trained and validated for each target protein and their combinations. Seq, sequence; CNT, Carbon nanotubes. (7) Prediction results are evaluated.
Perception-based nanosensor platform for protein biomarkers.
(1) Eleven single-stranded DNA oligonucleotides wrap SWCNT chiralities to form DNA-SWCNT sensor complexes. (2) The array of sensors is incubated in the sample of interest. (3) The optical response of the sensors is interrogated by high-throughput NIR spectroscopy. (4) The spectroscopic data are fitted to determine the wavelength and intensity of each sensor emission band. (5) The sensor responses are processed into a feature vector (FV) training set. A.U., arbitrary units. (6) ML algorithms are trained and validated for each target protein and their combinations. Seq, sequence; CNT, Carbon nanotubes. (7) Prediction results are evaluated.
RESULTS
DNA-SWCNT array
We characterized multiple DNA-SWCNT complexes to form the basis of a sensor array. Eleven DNA sequences [(AT)11, (AT)15, (AT)20, (GT)12, (ATT)4, (TCT)5, T3C3T3C3T3, C3T9C3, C3T3C9, CT2C3T2C, and (AC)15] were chosen because many of them are recognition sequences of specific SWCNT chiralities, which suggest ordered wrapping on their surface, while others confer some degree of specificity to proteins or other analytes (–). Twelve semiconducting SWCNT species present in the HiPCO preparation [(6,5), (8,4), (10,3), (7,5), (7,6), (8,3), (9,5), (9,4), (8,6), (8,7), (10,2), and (9,7)] were evaluated because of their high concentrations in the sample and bright photoluminescence in the serum/water optical window of 900 to 1400 nm (fig. S1, A and B). The combinatorial possibilities of 12 SWCNT species and 11 DNA sequences resulted in the formation of 132 distinct DNA-SWCNT complexes that were investigated within the context of a sensor array. The DNA-SWCNT complexes exhibited high colloidal stability and strong photoluminescence, as previously reported (–). We characterized the complexes using ultraviolet-visible NIR (UV-Vis-NIR) absorbance, NIR fluorescence spectroscopy, atomic force microscopy (AFM), and zeta potential measurements (fig. S1). The measurements confirmed the emissive properties of at least 12 SWCNT chiralities (fig. S1B), a highly negative zeta potential of DNA-SWCNT complexes formed with all 11 DNA sequences (fig. S1C), and a DNA banding pattern along the SWCNT surface for all sequences (fig. S1, D to H).The optical responses of the DNA-SWCNT complexes to known gynecologic cancer biomarkers were assessed via spectroscopy. High-throughput NIR spectroscopy (in the range of 900 to 1400 nm) was conducted on all DNA-SWCNT complexes introduced to laboratory-generated samples of the protein biomarkers HE4, CA-125, and YKL-40 in 10% fetal bovine serum (FBS) solutions (to provide a relevant background of interferent molecules). The spectroscopic bands of all SWCNT chiralities were fitted to extract peak wavelength shift (Δλ) and intensity ratio (I/I0) with respect to a control sample in 10% FBS. As a representative example, the (7,5) chirality emission peak blue-shifted (Δλ < 0), and its intensity was attenuated (I/I0 < 1) in response to HE4 (Fig. 2A), while brightening and red shifting were observed upon exposure to CA-125 and YKL-40 (Fig. 2A and inset). Similar analyses found diverse optical responses to single biomarkers across SWCNT chiralities (Fig. 2, B and C) and DNA wrappings (Fig. 2, D and E). There were no obvious correlations between the response and conditions in which they were challenged (Fig. 2, F and G, and fig. S2).
Fig. 2.
DNA-SWCNT optical responses to gynecologic cancer biomarkers.
(A) Representative spectra of DNA-SWCNT complexes in response to cancer protein biomarkers. Inset: Normalized spectrum of the (7,5) chirality. (B) Wavelength modulation of (AC)15-SWCNT complexes upon incubation with 100 nM HE4; n = 3. (C) Intensity modulation of (AC)15-SWCNT complexes upon incubation with HE4; n = 3. (D) Wavelength modulation of DNA-(7,6) complexes upon incubation with HE4; n = 3. (E) Intensity modulation of DNA-(7,6) complexes upon incubation with HE4; n = 3. (F) Heatmap of total wavelength modulations of DNA-SWCNT complexes upon incubation with HE4; n = 3. (G) Heatmap of total intensity modulations of DNA-SWCNT complexes upon incubation with HE4; n = 3. (H) Wavelength of (AT)11-(8,6) complex upon incubation with phosphate-buffered saline (PBS), HE4, bovine serum albumin (BSA), and FBS in PBS; n = 3, means ± SEM; ****P < 0.0001, unpaired t test. (I) Intensity of (AT)11-(8,6) complex upon incubation with PBS, HE4, BSA, and FBS in PBS; n = 3, means ± SEM; ****P < 0.0001, unpaired t test. “ns” denotes not significant. (J) Principal components analysis (PCA) plot of the DNA-SWCNT response to HE4 versus interferents.
DNA-SWCNT optical responses to gynecologic cancer biomarkers.
(A) Representative spectra of DNA-SWCNT complexes in response to cancer protein biomarkers. Inset: Normalized spectrum of the (7,5) chirality. (B) Wavelength modulation of (AC)15-SWCNT complexes upon incubation with 100 nM HE4; n = 3. (C) Intensity modulation of (AC)15-SWCNT complexes upon incubation with HE4; n = 3. (D) Wavelength modulation of DNA-(7,6) complexes upon incubation with HE4; n = 3. (E) Intensity modulation of DNA-(7,6) complexes upon incubation with HE4; n = 3. (F) Heatmap of total wavelength modulations of DNA-SWCNT complexes upon incubation with HE4; n = 3. (G) Heatmap of total intensity modulations of DNA-SWCNT complexes upon incubation with HE4; n = 3. (H) Wavelength of (AT)11-(8,6) complex upon incubation with phosphate-buffered saline (PBS), HE4, bovine serum albumin (BSA), and FBS in PBS; n = 3, means ± SEM; ****P < 0.0001, unpaired t test. (I) Intensity of (AT)11-(8,6) complex upon incubation with PBS, HE4, BSA, and FBS in PBS; n = 3, means ± SEM; ****P < 0.0001, unpaired t test. “ns” denotes not significant. (J) Principal components analysis (PCA) plot of the DNA-SWCNT response to HE4 versus interferents.To study the physical properties of the DNA-SWCNT complexes that could contribute to the distinct responses, we analyzed the SWCNT surface charge and DNA wrapping patterns on the SWCNT surface. Zeta potential measurements of the DNA-SWCNTs showed that surface charge varied between approximately −44 and −55 mV, depending on the DNA sequence (fig. S1C), likely a result of differences in DNA packing densities. To further investigate, we conducted AFM, which revealed substantially differences in the density of observable height maxima/peaks on the SWCNTs of approximately 40% (fig. S1, D to H), ascribable to the DNA. These findings suggest that the unique responses of each DNA-SWCNT to the proteins are likely due, in part, to the distinct DNA wrapping patterns on each SWCNT chirality, in addition to structural differences between the biomarkers such as size, charge, hydrophobicity, and the level of glycosylation (table S1) (, ).Next, we investigated the specificity of the DNA-SWCNTs by examining the response to HE4 in the presence of interferents [i.e., bovine serum albumin (BSA) and FBS]. We found that some DNA-SWCNTs responded differently to the analyte and interferents, but the specificity of any one complex appeared marginal (Fig. 2, H and I). To assess the distinctness of DNA-SWCNT responses to a protein biomarker versus interferents, we applied principal components analysis (PCA). The analysis of DNA-SWCNT responses to HE4 and interferent proteins failed to separate distinct optical responses of HE4 (Fig. 2J). We thus concluded that more sophisticated data analyses were needed to determine whether the DNA-SWCNT array could correctly identify analytes within a complex environment.
ML feature vector construction
To differentiate the biomarkers via the DNA-SWCNT optical responses, we investigated several ML strategies. We tested two different feature vector (FV) methods to represent experimentally measured data matrices composed of DNA sequences and SWCNT chiralities (Fig. 3A). Each vector was constructed with two components: “Example ID,” SWCNT chirality or DNA sequence, and “Features,” the DNA-SWCNT complex emission intensity and wavelength response. In addition, the vector corresponds to a specific label that indicates the presence of each biomarker in the sample. The first FV (FV1) is focused on chirality [Fig. 3A, (1)] and uses DNA sequences as the example IDs and chirality-dependent optical responses as features. Underlying this choice of feature is the hypothesis that the spectroscopic response of multiple SWCNTs in combination with a single DNA sequence is sufficient to determine the presence or concentration of biomarkers. DNA sequences were encoded into IDs as either bigram or trigram term frequency vectors (). Therefore, the total number of features is 40 using a bigram representation (16 + 2 × 12) and 88 using a trigram frequency vector (64 + 2 × 12).
Fig. 3.
FV construction.
(A) The FV contains two parts, example encoding (red) and optical response–based features (purple), with each vector corresponding to a label that indicates the biomarker conditions (blue). The total features of FV1 are described by 4 + 2M, where tf denotes an n-gram term frequency vector (i.e., n = 2 in bigram and n = 3 in trigram), and M denotes the number of chiralities. The total features of FV2 are described by M + 2N, where cf denotes SWCNT chirality features, N denotes the number of sequences and M denotes the number of chiralities. a is an indicator function for the analyte presence (either 0 or 1). The subscripts C, H, and Y represent CA-125, HE4, and YKL-40, respectively. (B) Each FV is processed by a multilabel classifier (black box) to classify (detect) each biomarker. IR is the intensity ratio and defined as IR = I/I0.
FV construction.
(A) The FV contains two parts, example encoding (red) and optical response–based features (purple), with each vector corresponding to a label that indicates the biomarker conditions (blue). The total features of FV1 are described by 4 + 2M, where tf denotes an n-gram term frequency vector (i.e., n = 2 in bigram and n = 3 in trigram), and M denotes the number of chiralities. The total features of FV2 are described by M + 2N, where cf denotes SWCNT chirality features, N denotes the number of sequences and M denotes the number of chiralities. a is an indicator function for the analyte presence (either 0 or 1). The subscripts C, H, and Y represent CA-125, HE4, and YKL-40, respectively. (B) Each FV is processed by a multilabel classifier (black box) to classify (detect) each biomarker. IR is the intensity ratio and defined as IR = I/I0.The second FV (FV2) uses chiralities as the example IDs [Fig. 3A, (2)] combined with sequence-dependent optical responses as features. Underlying the FV2 is the hypothesis that a single SWCNT in combination with a number of DNA sequences is sufficient to determine the presence or concentration of biomarkers. SWCNTs were represented using the one-hot encoding (“1” for specific chirality and “0” for the other chiralities) (); hence, the total number of features used for FV2 is 34 (12 + 2 × 11).Input data formatted according to FV1 and FV2 were used to train several classification algorithms for the detection of individual biomarkers or combinations thereof (Fig. 3B). Three ML algorithms—SVM, RF, and ANN—were trained using an initial dataset and were evaluated by 10-fold cross-validation. Bayesian optimization was used for hyperparameter tuning. The resulting F1-scores were used to assess model performance (fig. S3).
Classification model training and validation
We investigated the potential for the platform to detect the presence/absence of a single biomarker, HE4, using binary classification algorithms. We introduced the DNA-SWCNT complexes to solutions of HE4 and background/interferents FBS, BSA, and mixtures, all in phosphate-buffered saline (PBS). We classified the data using several approaches such as bi-class (±HE4), multiclass (HE4, HE4 ± FBS, FBS, HE4 ± BSA, BSA), and multilabel (±HE4 and ±FBS and ±BSA). Criteria for excluding certain FVs were wavelength shifts higher than 20 nm or poor peak fitting, both most likely caused by low signal intensities. We found that RF resulted in better F1-scores than ANN and SVM (>0.93) (fig. S4A). The performance of biclass classifiers was slightly better than multiclass and multilabel classifiers. Overall, the algorithms provided high F1-scores (>0.92). While using FV2, all algorithms provided high F1-scores (1.0 for biclass and 0.9 to 1.0 for multiclass/multilabel classification). The high values of F1-scores raised concerns with overfitting, which could occur with small sample sets. Another concern is the high initial concentration of analytes in the training sets.To alleviate those concerns and determine the detection limit of the platform for HE4 classification using the model trained with high concentrations, we tested against several lower HE4 concentrations. Figure 4A shows F1-scores for the three algorithms using both FVs for 10 and 50 nM HE4 thresholds (as these concentrations are relevant to cancer diagnosis). Both FVs generated high values for F1-scores on cross-validation at 50 nM HE4 concentration (F1-score > 0.89 in FV1 and F1-score > 0.98 in FV2) and in the range of 0.79 to 0.85 at 10 nM HE4. While both FVs continued to predict with high F1-scores, the performance of FV2 was better than FV1 and provided good results for all three algorithms.
Fig. 4.
ML results and analysis.
(A) F1-scores of three algorithms for each FV corresponding to different thresholds. (B) Schematic of training/testing method for different concentrations of biomarker combinations. (C) Receiver operating characteristic (ROC) of each biomarker via RF model. Area under the curve (AUC) values for each biomarker. (D) ROC of each biomarker via ANN model. AUC values for each biomarker. (E) Feature importance of SWCNT chiralities generated by FV1. (F) Feature importance of DNA sequences generated by FV2. (G) Intensity change feature importance versus SWCNT chiral angle. (H) Normalized feature importance values of wavelength shift (Δλ) and intensity change versus SWCNT emission wavelength.
ML results and analysis.
(A) F1-scores of three algorithms for each FV corresponding to different thresholds. (B) Schematic of training/testing method for different concentrations of biomarker combinations. (C) Receiver operating characteristic (ROC) of each biomarker via RF model. Area under the curve (AUC) values for each biomarker. (D) ROC of each biomarker via ANN model. AUC values for each biomarker. (E) Feature importance of SWCNT chiralities generated by FV1. (F) Feature importance of DNA sequences generated by FV2. (G) Intensity change feature importance versus SWCNT chiral angle. (H) Normalized feature importance values of wavelength shift (Δλ) and intensity change versus SWCNT emission wavelength.To investigate the potential for the platform to detect other/multiple cancer biomarkers, we optimized multilabel classification methodologies. We trained the ML algorithms using the optical response of the DNA-SWCNT complexes to a single and multiple combinations of HE4, CA-125, and YKL-40 with various concentrations, ranging from 0 to 100 nM (Fig. 4B and table S2). To generate as comprehensive a dataset as possible, we screened over 17 different biomarker combinations, which resulted in more than 200 examples for each FV. We incubated the DNA-SWCNT complexes in FBS and PBS to assess the biomarkers in complex environments. We constructed three types of multilabel ML models: adaptive algorithm, binary relevance, and label powerset (, ). Cross-validation results (fig. S4B) show that the F1-scores using FV2 were substantially higher (>0.96) compared to FV1 (>0.68) across all the models, with RF and ANN outperforming SVM (with F1-scores of 0.97). To validate the F1-scores of the top-performing algorithms, we generated receiver operating characteristic (ROC) curves for the three biomarkers (Fig. 4, C and D). The areas under the curve (AUCs) were all greater than 0.97. Individual analyses of each biomarker showed high F1-scores for HE4 (1 and 0.99 in RF and ANN, respectively), CA-125 (1 and 0.91 in RF and ANN, respectively), and YKL40 (0.96 and 0.84 in RF and ANN, respectively). These results demonstrate the ability of the model to detect single and multiple biomarkers in mixtures with high precision (fig. S4C). In addition, the accuracy of detection was mostly high, depending on the biomarker (fig. S4D).On the basis of these results, we decided to proceed with FV2 as the FV used for the classification and RF and ANN as the ML algorithms. The better performances of FV2 suggest that the collection of spectroscopic features from a single SWCNT, in combination with a number of DNA sequences, is better than a FV that comprises data from a single DNA sequence on a number of SWCNTs.To evaluate the concentration of each biomarker in each sample, we also conducted a regression analysis. Regression results of RF and ANN using FV2 achieved R2 values of 0.93 and 0.92, respectively (shown in fig. S4E).
ML feature importance
To understand the relationship between the nanosensor array composition and the ML predictions, we used feature importance analysis to investigate the DNA-SWCNT properties that influence the prediction. We extracted the feature importance values from the algorithms using both FV1 and FV2 (Fig. 4, E and F). We found that the relative importance of nanotube chiralities on the marker prediction appeared to correlate with chiral angle of the nanotube species, as defined by Pearson’s correlation coefficient (Fig. 4G). There also appeared to be some dependence on nanotube mod (fig. S5, A and B), wherein nanotube chirality vectors (n,m) calculated via mod(n-m, 3) gives a value of 1 or 2 for semiconducting carbon nanotubes (, ). We also found some correlation between the importances of wavelength shifting responses of mod 1 chiralities with the nanotube optical bandgap (E11) (r = −0.86) and intensity responses of mod 2 chiralities with optical bandgap (r = 0.82) (Fig. 4H and fig. S5, C to F). These correlations suggest that nanotube structure contributed to the differences in the optical responses of the nanosensors that enabled enough response diversity to result in positive predictive value.Among DNA wrapping sequences, C3T3C9 and CT2C3T2C presented the highest and second highest feature importance values, respectively (Fig. 4F). The intensity ratio feature exhibited higher importance values than the wavelength shifting responses across all sequences. Using this feature importance analysis, we narrowed down the array to the five most important DNA sequences [(AC)15, (AT)11, (AT)15, CT2C3T2C, and T3C3T3C3T3] to reduce the number of features and, therefore, the number of experimental conditions. The optimized model generated F1-scores of 0.98 for classification and R2 of 0.78 for regression. The combined results suggest that the sensitivity of this platform for the biomarkers is dependent on both the nanotube structure and the unique morphology of the DNA adhesion on the nanotubes due to sequence-dependent π-π stacking of the base pairs on the graphitic sidewall of the SWCNTs.
Uterine lavage patient samples
Uterine washing samples were collected from consenting cancer patients with diagnoses of several gynecologic conditions, including ovarian and endometrial cancers (fig. S6) (, –). To investigate the ability of the platform to detect multiple biomarkers in a patient biofluid sample, we tested the optimized platform in uterine washings. We incubated the DNA-SWCNT complexes in uterine lavage samples (N = 22). The conventional clinical laboratory measurements showed a high biomarker distribution (Fig. 5A), with mean concentration values of HE4, CA-125, and YKL-40 equaling 2.75 ± 0.63 nM, 3.62 ± 1.52 nM, and 0.15 ± 0.08 nM, respectively. Because of the subnanomolar range of the biomarkers in the patient samples, we retrained the algorithms with lower concentrations of all biomarkers (1 pM to 100 nM) and used the sensor array responses from the uterine lavage patient samples as a test set (Fig. 5B). The F1-score of the training set was improved as the threshold was decreased to less than 100 pM (0.95 increased to 0.97). In addition, the F1-score of the test set was strongly improved (0.93 increased to 0.99). This result indicates that several sample concentrations of less than 100 pM were inaccurately classified with the higher threshold. Note that there was a negligible difference between the F1-scores when using a 10 or 1 pM threshold. This may be due to the fact that there was only one measurement of less than 10 pM. We further evaluated the F1-score of individual biomarker predictions (Fig. 5C). When the threshold was decreased to 10 pM (>0.95), there were substantial improvements in the sensitivities to HE4, CA-125, and YKL-40 (0.92 increased to 1, 0.87 increased to 1, and 0.89 increased to 0.95 in HE4, CA-125, and YKL-40, respectively).
Fig. 5.
Biomarker detection in uterine lavage samples.
(A) Concentrations of HE4, CA-125, and YKL-40 were measured by enzyme-linked immunosorbent assay in uterine lavage samples. (B) Classification F1-scores for detection of the three biomarkers in lavage samples from training and test datasets, applying different protein concentration thresholds. (C) Classification F1-scores of nanosensor detection of each biomarker, applying different protein concentration thresholds. (D) The success of the detection of each biomarker via classification, applying different concentration thresholds. (E) Improvement in classification success, relative to the threshold of 100 pM.
Biomarker detection in uterine lavage samples.
(A) Concentrations of HE4, CA-125, and YKL-40 were measured by enzyme-linked immunosorbent assay in uterine lavage samples. (B) Classification F1-scores for detection of the three biomarkers in lavage samples from training and test datasets, applying different protein concentration thresholds. (C) Classification F1-scores of nanosensor detection of each biomarker, applying different protein concentration thresholds. (D) The success of the detection of each biomarker via classification, applying different concentration thresholds. (E) Improvement in classification success, relative to the threshold of 100 pM.To evaluate the prediction strength, we examined the success of classification results for each threshold by comparing them to the actual levels of each biomarker measured by the clinical laboratory (Fig. 5D). We defined success as the percentage of correct classification (either true positive or true negative) for each biomarker. In all the biomarkers, the classification prediction was strongly improved when the threshold was decreased to less than 100 pM (Fig. 5E). HE4 presented the most successful classifications and showed improvement from 95 to 100% success with both 10 and 1 pM thresholds. CA-125 was initially predicted with 82% success but substantially improved to 100% success when the threshold was changed to 1 pM. The most substantial change was observed with YKL-40, from 50% success with a 100 pM threshold to 91% success with a 1 pM threshold. The platform was able to accurately classify the patient biofluid samples, indicated by the high F1-scores and classification success values.
DISCUSSION
Current diagnostic methodologies for protein biomarkers normally use one-to-one recognition assays, mainly using antibodies. Here, we described a new approach for the detection of multiple biomarkers in biofluids for disease diagnosis using an artificial molecular perception system. We developed an array of relatively nonspecific DNA-SWCNT sensors, containing individual hybrids of 132 DNA-SWCNTs. The use of multiple SWCNT chiralities enabled us to generate a large set of sensors that could be interrogated rapidly via high-throughput NIR spectroscopy to form a wide diversity of responses when they were exposed to different target proteins. On the basis of several studies (, –), we initially targeted gynecologic cancer biomarkers HE4, CA-125, and YKL-40.The advantages of the method include the high optical sensitivity of SWCNTs to diverse analytes and the ability to modify their environmental sensitivities/specificities. We introduced a diverse set of SWCNT environmental responsivities via surface coatings of different DNA sequences that modulated the optical bandgaps and surface morphologies. Commercially available and well-characterized mixtures of SWCNT chiralities enable fast and robust preparation of multiple DNA-SWCNT complexes. These mixtures provide a broad group of features/examples for ML that can be fine-tuned later, based on feature importance analysis, eliminating the need to develop specific DNA-SWCNT complexes of isolated chiralities. ML algorithms enabled training from DNA-SWCNT spectral response data to detect biomarkers in both laboratory-generated samples and cancer patient uterine lavage samples. Feature importance analysis showed that the intensity ratios contributed most to platform predictions, as compared to wavelength shifts. We believe that this phenomenon may result from the fact that SWCNT intensity exhibits greater sensitivity to more physicochemical phenomena than emission wavelength (, , ).Notably, the classification success rate in patient samples was high even in subnanomolar ranges, with a rate of 100% for HE4 and CA-125 and 91% in YKL-40. These results support the conclusion that the perception mode of sensing can successfully generate accurate predictions.Ideally, classification and regression algorithms would be trained with sensor data using biomarker concentrations at a similar order of magnitude as known concentrations from published clinical data. However, in some cases, there is no way to know the biomarker concentration in advance; several iterations may be needed to optimize the sensitivity of the platform. Combining detection and quantification will allow this technology to better screen and categorize patients based on the levels of markers for early detection.This platform could be continuously improved by increasing the sizes of datasets and analyzing feature importance. For example, interpreting the feature importance values can aid with DNA sequence design and expanding the library of DNA-SWCNT complexes. In addition, expanding the spectroscopic range may increase the number of SWCNT chiralities and, thus, sensors that can be measured. While increasing the number of features (nanosensors) may contribute to the sensitivity of the platform, the number of examples (conditions) should be increased as well (to prevent overfitting). We also recognize the need to increase the number of patient samples to continually validate and increase the robustness of the model.We believe that this platform can be translated to the clinic for use in laboratory medicine or point-of-care settings. While the development of the platform requires high-throughput NIR screening for the training of ML algorithms, we showed that comprehensive analysis of both the FV construction and feature importance values can reduce the required DNA-SWCNT array to detect biomarkers in serum samples. By studying the feature importance values obtained from the algorithms trained with FV2 (sequence-based), we found that the intensity ratios contributed more to the overall prediction than the wavelength shifts. These insights have important outcomes for potentially translating this platform to the clinic. For example, using single SWCNT chiralities and multiple DNA sequences or analyzing only intensity ratio for several SWCNT chiralities, we can reduce the optical configuration to few excitation wavelengths, requiring filters and single-channel detectors, rather than an advanced spectrometer. This enables the use of simpler, more portable optical instrumentation. However, note that the reduction of chiralities also reduces the number of examples and can increase the risk of overfitting. To avoid this problem, the number of examples should always be maximized and compared to the number of features.Last, because of the flexibility and the nonspecific nature of the individual sensor elements, the proposed platform is not restricted to ovarian cancer biomarkers and can potentially be trained to detect other disease biomarkers without the need to engineer different arrays of nanosensors. This platform enables antibody-free detection that would be useful when an especially robust or long-term measurement is needed, such as in wearable/implantable devices, point-of-care diagnostics, and for underresourced situations where cold chain storage may not be available.
MATERIALS AND METHODS
Materials
SWCNTs produced by the high-pressure carbon monoxide (HiPco) process were purchased from Unidym (Sunnyvale, CA, USA). Single-stranded DNA oligonucleotides [T3C3T3C3T3, C3T9C3, C3T3C9, (TCT)5, (GT)12, (AT)11, (AT)15, (AT)20, (ATT)4, (AC)15, and CT2C3T2C] were purchased from Integrated DNA Technologies (Coralville, IA, USA). HE4 was purchased from RayBiotech. Human CA-125, also known as MUC16, and human YKL-40 were purchased from R&D Systems. BSA was purchased from Sigma-Aldrich. FBS was purchased from Thermo Fisher Scientific. Uterine washings from the Institutional Review Board–consented patients with cancer were provided by the Department of Laboratory Medicine at Memorial Sloan Kettering.
Preparation of DNA-SWCNT complexes
SWCNTs were mixed with a specific DNA oligonucleotide at a 1:2 mass ratio, respectively, in 1 ml of IDTE buffer. The sample was ultrasonicated continuously for 45 min at 40% of maximum amplitude, using a 3-mm titanium tip (Sonics Vibra-Cell). The mixture was ultracentrifuged (Sorvall Discovery 90SE) for 30 min at 250,000g. The top 80% of the supernatant was collected, and the concentration of suspended SWCNTs was determined by UV-Vis-NIR spectrophotometry (JASCO V-670) using the extinction coefficient A910 = 0.02554 liter mg−1 cm−1; where the path length l is 1 cm. To remove excess free DNA, 300 μl of the sample was filtered twice using a 100-kDa Amicon centrifuge filter (Millipore) at 5000g for 10 min. Following filtration, the DNA-SWCNT complexes were tested at a concentration of 5 mg/liter of SWCNT in 100 μl of solution in 96-well plates. The zeta potential of the DNA-SWCNT complexes was measured using a Zetasizer ZSP (Malvern). The samples were diluted to a concentration of 0.5 mg/liter using double-distilled water.
NIR fluorescence spectroscopy of DNA-SWCNTs
NIR fluorescence spectroscopy was used to measure the photoluminescence emission from the DNA-SWCNT complexes, as described previously (). For solution measurements, spectra were acquired using an apparatus built in-house consisting of a continuous-wave 730-nm diode laser with an output power of 2 W or a SuperK EXTREME supercontinuum white-light laser source connected to a Varia variable bandpass filter accessory capable of tuning the output from 490 to 825 nm with a bandwidth of 20 nm (NKT Photonics). The laser was injected into a multimode fiber that was fed into the back of an Olympus IX-71 inverted microscope where it passed through a 20× LCPlan N, 20×/0.45 objective (Olympus, USA) and a dichroic mirror (875-nm cutoff; Semrock). The light was f-number matched to the spectrometer using several lenses and injected into an IsoPlane spectrograph (Princeton Instruments) with a slit width of 410 μm, which dispersed the emission using a 86 g mm−1 gating with a 950-nm blaze wavelength coupled to a NIRvana 2D InGaAs NIR detector (Princeton Instruments) or a Shamrock 303 spectrometer with the Andor iDus 1D InGaAs Array Camera (Oxford Instruments). An HL-3-CAL EXT halogen calibration light source (Ocean Optics) was used to correct for wavelength-dependent features in the emission intensity arising from the excitation power, spectrometer, detector, and other optics. A Hg/Ne pencil-like calibration lamp (Newport) was used to calibrate spectrometer wavelengths. Data were obtained from each well of a 96-well plate using the custom LabVIEW (National Instruments) code. Another custom program, written in MATLAB (MathWorks) software was used to subtract background, correct for abnormalities in excitation profiles, and fit the data with Lorentzian functions. Smoothing, where applicable, was done by applying a Savitzky-Golay filter.
Atomic force microscopy
DNA-SWCNT complexes were plated on a freshly cleaved mica substrate (Structure Probe, Inc) for 4 min before washing with 10 ml of distilled water and blowing dry with argon gas. An Asylum Research MFP-3D-Bio instrument equipped with an Olympus AC240TS AFM probe in alternating current mode was used. Data were acquired at 2.93 nm pixel −1 x-y resolution and 15.63 pm of z resolution. The images were analyzed using Gwyddion software. To measure height or length distributions, at least 20 ROIs were analyzed.
ML method development
The dataset comprises the photoluminescence spectra of each combination of DNA-SWCNT complex exposed to different combinations of a small number of analytes (HE4, CA-125, YKL-40, BSA, and FBS). That is, we had total N·M·L combinations where N is the number of DNA sequences, M is the number of SWCNT chiralities, and L is the number of analyte combinations. The spectra were analyzed to yield two parameters for each SWCNT type: the wavelength peak shift (Δλ) and intensity ratio (IR)andwhere λ0 and I0 are the wavelength and intensity of a control sample (DNA-SWCNT without analyte); λ and I are the wavelength and intensity of DNA-SWCNT with analyte combination, i.Input and output (target) variables were identified for the ML algorithms. The input variables include DNA sequence, SWCNT chirality, and the two spectroscopically measured parameters (Δλ, IR). The output variable either represents the presence (for classification) or concentration (for regression) of each analyte. Three classification approaches were examined: biclass (±biomarker), multiclass (±biomarker combination), and multilabel (±each biomarker).To train the models, categorical data (such as SWCNT chirality and analyte type) were transformed to numeric values, using the one-hot encoding technique (). DNA sequences were encoded as term-frequency vectors, using subsets of two or three bases as a term and calculating the frequency of that term in the sequence (). Figure S3 depicts the overall scheme for the input feature construction. Two FVs were constructed to emphasize the sensitivity of each component in the DNA/SWCNT complex and find a balance between the number of features and examples. For each FV, one component of the DNA/SWCNT complex was encoded as an ID of the example, while the other components’ responses were defined as features. In FV1, the DNA sequences were encoded as the IDs, and the chirality-dependent optical responses were encoded as features. In FV2, the SWCNT chiralities were encoded as the IDs, and the sequence-dependent optical responses were encoded as features.Three algorithms—SVM, RF, and ANN—were trained and tested with FV1 and FV2 for both classification and regression. Each model was evaluated by 10-fold cross-validation. All ML algorithms were implemented using the Scikit-learn ML library (). To find hyperparameters that maximize performance, Bayesian hyperparameter optimization was implemented using HyperOpt ().Each model was evaluated by the produced F1-score and accuracy values for classification and R2 value for regression. Accuracy (Eq. 3) calculates the percentage of correctly classified examples. F1-score, which is a composite value of precision (Eq. 4) and recall (Eq. 5), gives a measure of accuracy but takes the false positives and negatives into account as well (Eq. 6)
CA-125 concentration unit conversion
The concentration unit of CA-125 used in the clinic, units per milliliter, was converted to nanomolar by titrating CA-125 and measuring using an ARC i2000 instrument. A linear concentration curve with R2 = 0.9997 was generated. The resulting unit conversion is as follows: [U/ml] = 0.18*[pM].
Statistical analysis
In vitro experiments were analyzed by two-sided t tests. Reported P values were assigned ****P < 0.0001, ***P < 0.001, **P < 0.01, and *P < 0.05, and exact P values are reported in the captions.
Authors: Ming Zheng; Anand Jagota; Michael S Strano; Adelina P Santos; Paul Barone; S Grace Chou; Bruce A Diner; Mildred S Dresselhaus; Robert S McLean; G Bibiana Onoa; Georgii G Samsonidze; Ellen D Semke; Monica Usrey; Dennis J Walls Journal: Science Date: 2003-11-28 Impact factor: 47.728
Authors: Sebastian Vaughan; Jermaine I Coward; Robert C Bast; Andy Berchuck; Jonathan S Berek; James D Brenton; George Coukos; Christopher C Crum; Ronny Drapkin; Dariush Etemadmoghadam; Michael Friedlander; Hani Gabra; Stan B Kaye; Chris J Lord; Ernst Lengyel; Douglas A Levine; Iain A McNeish; Usha Menon; Gordon B Mills; Kenneth P Nephew; Amit M Oza; Anil K Sood; Euan A Stronach; Henning Walczak; David D Bowtell; Frances R Balkwill Journal: Nat Rev Cancer Date: 2011-09-23 Impact factor: 60.716
Authors: Jackson D Harvey; Prakrit V Jena; Hanan A Baker; Gül H Zerze; Ryan M Williams; Thomas V Galassi; Daniel Roxbury; Jeetain Mittal; Daniel A Heller Journal: Nat Biomed Eng Date: 2017-03-13 Impact factor: 25.671
Authors: Elisabeth Maritschnegg; Yuxuan Wang; Nina Pecha; Reinhard Horvat; Els Van Nieuwenhuysen; Ignace Vergote; Florian Heitz; Jalid Sehouli; Isaac Kinde; Luis A Diaz; Nickolas Papadopoulos; Kenneth W Kinzler; Bert Vogelstein; Paul Speiser; Robert Zeillinger Journal: J Clin Oncol Date: 2015-11-09 Impact factor: 44.544
Authors: Elisabeth Maritschnegg; Florian Heitz; Nina Pecha; Jirí Bouda; Fabian Trillsch; Christoph Grimm; Adriaan Vanderstichele; Christiane Agreiter; Philipp Harter; Eva Obermayr; Ignace Vergote; Robert Zeillinger; Paul Speiser Journal: Int J Gynecol Cancer Date: 2018-11 Impact factor: 3.437