Tesia Bobrowski1, Lu Chen2, Richard T Eastman2, Zina Itkin2, Paul Shinn2, Catherine Z Chen2, Hui Guo2, Wei Zheng2, Sam Michael2, Anton Simeonov2, Matthew D Hall2, Alexey V Zakharov3, Eugene N Muratov4. 1. Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, NC 27599, USA. 2. National Center for Advancing Translational Sciences (NCATS), 9800 Medical Center Drive, Rockville, MD 20850, USA. 3. National Center for Advancing Translational Sciences (NCATS), 9800 Medical Center Drive, Rockville, MD 20850, USA. Electronic address: alexey.zakharov@nih.gov. 4. Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, NC 27599, USA. Electronic address: murik@email.unc.edu.
Abstract
Antiviral drug development for coronavirus disease 2019 (COVID-19) is occurring at an unprecedented pace, yet there are still limited therapeutic options for treating this disease. We hypothesized that combining drugs with independent mechanisms of action could result in synergy against SARS-CoV-2, thus generating better antiviral efficacy. Using in silico approaches, we prioritized 73 combinations of 32 drugs with potential activity against SARS-CoV-2 and then tested them in vitro. Sixteen synergistic and eight antagonistic combinations were identified; among 16 synergistic cases, combinations of the US Food and Drug Administration (FDA)-approved drug nitazoxanide with remdesivir, amodiaquine, or umifenovir were most notable, all exhibiting significant synergy against SARS-CoV-2 in a cell model. However, the combination of remdesivir and lysosomotropic drugs, such as hydroxychloroquine, demonstrated strong antagonism. Overall, these results highlight the utility of drug repurposing and preclinical testing of drug combinations for discovering potential therapies to treat COVID-19.
Antiviral drug development for coronavirus disease 2019 (COVID-19) is occurring at an unprecedented pace, yet there are still limited therapeutic options for treating this disease. We hypothesized that combining drugs with independent mechanisms of action could result in synergy against SARS-CoV-2, thus generating better antiviral efficacy. Using in silico approaches, we prioritized 73 combinations of 32 drugs with potential activity against SARS-CoV-2 and then tested them in vitro. Sixteen synergistic and eight antagonistic combinations were identified; among 16 synergistic cases, combinations of the US Food and Drug Administration (FDA)-approved drug nitazoxanide with remdesivir, amodiaquine, or umifenovir were most notable, all exhibiting significant synergy against SARS-CoV-2 in a cell model. However, the combination of remdesivir and lysosomotropic drugs, such as hydroxychloroquine, demonstrated strong antagonism. Overall, these results highlight the utility of drug repurposing and preclinical testing of drug combinations for discovering potential therapies to treat COVID-19.
At the start of the coronavirus disease 2019 (COVID-19) pandemic, few antiviral drug combinations were explored as options for treating the disease despite past evidence that show they are especially effective in treating viral diseases. Namely, drug combinations are useful in treating viral infections due to the fact that they can substantially lower the risk of the development of resistance to any one drug. Additionally, the antiviral action of the combination may be stronger than either drug alone, a phenomenon known as synergy. Antiviral synergy has been previously illustrated in combinations tested against Ebola and other viruses. Often the reason why synergism occurs remains unclear—it is difficult to provide explanations for existing synergistic/antagonistic drug combinations without prior, extensive, experimental investigations.Some evidence suggests that combinations of antiviral drugs are more likely to be synergistic if they (1) are of different classes, (2) have independent mechanisms of action, or (3) act upon different stages of the virus life cycle., Not only could the drugs under study work through a mechanism of action (MoA) that directly inhibits portions of the viral life cycle, they could also interact with components of host-regulated pathways involved in viral replication to hinder viral replication. For example, arbidol and its analogs have been noted to disrupt the interaction between the spike glycoprotein of the SARS-CoV-2 and its host receptor ACE2, as well as the host proteases furin and TMPRSS2, which are important in proteolytic activation of the virus., According to ClinicalTrials.gov, though there have been many compounds tested against SARS-CoV-2 in vitro, many of these drugs are only being evaluated as single agents in enzymatic and cellular assays to determine antiviral activity. Comparatively, there has been limited systematic screening of drug combinations.Meanwhile, the situation in clinical trials is somewhat different. Of the 2,844 clinical trials relevant to COVID-19 as of July 31, 2020, ca. 150 describe drug combinations. However, many of these trials evaluate the same combinations, e.g., lopinavir-ritonavir and azithromycin-hydroxychloroquine. Perhaps the earliest, most noteworthy antiviral drug combination was lopinavir-ritonavir—a phase II trial for a triple antiviral therapy combining interferon-β1b, lopinavir-ritonavir, and ribavirin was shown to shorten the duration of viral shedding and hospital stay in patients with mild to moderate COVID-19. However, another study assessing the effectiveness of lopinavir-ritonavir alone in treating COVID-19 found that its administration in COVID-19patients had no benefit. As of July 31, 2020, no combination therapy has yielded positive results in phase III randomized clinical trials.There are many ongoing or upcoming clinical trials testing combinations to treat COVID-19, but few have undergone extensive preclinical studies prior to their application on patients. Due to a lack of such studies, more information is needed on the combinatorial use of existing drugs against SARS-CoV-2 in order to (1) more efficiently prioritize synergistic combinations for translation into clinical use and (2) flag antagonistic combinations for further preclinical evaluation prior to clinical trials. To this point, we used data- and text-mining approaches to propose drug combinations for repurposing against SARS-CoV-2, operating on the assumption that combinations of drugs with differing mechanisms might exhibit synergistic activity. The goal of this study is to report the antiviral activity, synergy, and antagonism of 73 binary combinations of 31 drugs identified earlier as demonstrated in an in vitro SARS-CoV-2 cytopathic assay.
Results
Performance of Matrix Screening
In total, we screened 73 pairwise combinations in a 6 × 6 dose matrix format, which involved two biological batches (cell and SARS-CoV-2 virus) and two assays (cytopathic effect and cytotoxicity against Vero E6 cells) across 42 384-well plates including replicates (Tables S1 and S4). The Z′ factor was robust across batches and assays (all Z′ > 0.7; Figure 1A). Each batch was assessed by a benchmark compound collection including five known antivirals, performed in biosafety level-3 (BSL-3). We did not observe significant drift of potencies or efficacies between batches, except for hydroxychloroquine, which consistently resulted in inconclusive dose-response curves (Figures 1C–1G; Table S2). In addition, we performed a third QC to check the reproducibility across all available replicates in CPE (cytopathic effect) or Tox (toxicity) assays (Figure 1B). CPE activity showed a biphasic trend between median activity and standard deviation: most reproducible (SD < 20) when activity is extreme (activity < 20 or > 75) but less reproducible in between (Figure 1B, ◯ points). This is probably due to the high sensitivity to technical/biological variations when the concentration is close to the EC50 (half maximal effective concentration). This biphasic reproducibility of CPE activity also highlights the importance of using a dose matrix, instead of a single dose combination, to enhance the confidence of synergism/antagonism findings. In contrast, Tox activity is highly reproducible regardless of the median activity (Figure 1B, ✕ points).
Figure 1
Performance of Matrix Screening
(A) Z′ factor on different assays (CPE or Tox) and biological batches. (B) Reproducibility across all replicates (defined as a compound at certain concentration). Number of replicates (n) may vary, e.g., more single-agent replicates were performed due to matrix setting. (C–G) Dose response curves from an independent benchmark set performed at a different site. (H) Layout of a 6 × 6 dose matrix. Wells with (or without) bold border represent dose combination (or single agent alone).
Performance of Matrix Screening(A) Z′ factor on different assays (CPE or Tox) and biological batches. (B) Reproducibility across all replicates (defined as a compound at certain concentration). Number of replicates (n) may vary, e.g., more single-agent replicates were performed due to matrix setting. (C–G) Dose response curves from an independent benchmark set performed at a different site. (H) Layout of a 6 × 6 dose matrix. Wells with (or without) bold border represent dose combination (or single agent alone).
Overview of Hits
Since synergism and antagonism might occur simultaneously in a concentration-dependent manner, we employed the highest single agent (HSA) synergy model and analyzed synergism and antagonism separately (Figure 2). Within 73 binary combinations of 32 compounds, we identified 16 synergistic and 8 antagonistic combinations, four of which displayed both synergistic and antagonistic interactions at different compound concentrations (Figures 3 and 4). There are 29 combinations with inconclusive determinations that require additional validation due to cytotoxicity or the roughness of the activity landscape (see Materials and Methods). A summary of the screening result is available in Table S4. A map of drug combinations depicting their synergism/antagonism outcomes is shown in Figure 4.
Figure 2
Summary of Synergism or Antagonism across 73 Combinations
Due to biphasic dose response, synergism was separated from antagonism. Synergism is calculated as the sum of HSA.neg values from non-toxic dose combinations (Tox > 50%) and vice versa. The size of circle reflected the confidence of the observed synergism/antagonism (bigger circle = less doses were excluded due to toxicity). The inconclusive blocks (nnon-toxic < 25 or rough activity landscape) were shown in transparent points and lines. Two dashed lines indicated the cutoff of HSA synergism (−100) or antagonism (100). Blue arrows highlighted the combinations between remdesivir and tertiary amine compounds from conclusive blocks.
Figure 3
Matrix Blocks from Remdesivir + Amine Drugs in CPE Assay
The activity was normalized so that 100 corresponded to full cytopathic effect and 0 corresponded to no cytopathic effect. Red arrow, the concentrations that synergize with the partner compound. Blue arrow, the concentrations that antagonize against the partner compound. Chemical structures were shown on the right. (A) Hydroxychloroquine, (B) mefloquine, (C) amodiaquine, (D) arbidol. (E) CPE data from single-dose combination (5 μM GS-441524 or 20 μM remdesivir ± amine compounds; nsingle-agent RdRp inhibitor = 12 and ncombination = 3). The lower and upper box hinges correspond to the first and third quartiles, and the whiskers extend from upper or lower hinges to 1.5 * IQR (inter-quartile range).
Figure 4
Heptagonal Polygonogram Depicting Some of the Binary Combinations Tested in the Study
Degrees of synergism/antagonism were ascertained from Figure 3. The definitions were defined based on the degree of HSA synergism/antagonism determined in the CPE assay.
Summary of Synergism or Antagonism across 73 CombinationsDue to biphasic dose response, synergism was separated from antagonism. Synergism is calculated as the sum of HSA.neg values from non-toxic dose combinations (Tox > 50%) and vice versa. The size of circle reflected the confidence of the observed synergism/antagonism (bigger circle = less doses were excluded due to toxicity). The inconclusive blocks (nnon-toxic < 25 or rough activity landscape) were shown in transparent points and lines. Two dashed lines indicated the cutoff of HSA synergism (−100) or antagonism (100). Blue arrows highlighted the combinations between remdesivir and tertiary amine compounds from conclusive blocks.Matrix Blocks from Remdesivir + Amine Drugs in CPE AssayThe activity was normalized so that 100 corresponded to full cytopathic effect and 0 corresponded to no cytopathic effect. Red arrow, the concentrations that synergize with the partner compound. Blue arrow, the concentrations that antagonize against the partner compound. Chemical structures were shown on the right. (A) Hydroxychloroquine, (B) mefloquine, (C) amodiaquine, (D) arbidol. (E) CPE data from single-dose combination (5 μM GS-441524 or 20 μM remdesivir ± amine compounds; nsingle-agent RdRp inhibitor = 12 and ncombination = 3). The lower and upper box hinges correspond to the first and third quartiles, and the whiskers extend from upper or lower hinges to 1.5 * IQR (inter-quartile range).Heptagonal Polygonogram Depicting Some of the Binary Combinations Tested in the StudyDegrees of synergism/antagonism were ascertained from Figure 3. The definitions were defined based on the degree of HSA synergism/antagonism determined in the CPE assay.Next, we investigated whether antiviral synergism or antagonism is attributable to combination of different MoAs. A previous study demonstrated that synergism/antagonism is predictable based on MoA in an oncology screening. Unfortunately, we found limited evidence of MoA-associated synergism/antagonism (up to 10 μM) for SARS-CoV-2 (Figure 5). The most antagonistic MoA combination came from the combination of remdesivir (an RNA-dependent RNA polymerase [RdRp] inhibitor) and an antimalarial drug, in which three (hydroxychloroquine, amodiaquine, and mefloquine) out of four appeared to be antagonistic (Figure 2). However, the current data is insufficient to conclusively infer any MoA-associated synergism/antagonism.
Figure 5
Summary of Synergism or Antagonism over Different Mechanism of Action (MoA) Combination
Inconclusive blocks or singleton MoA were excluded. Two dashed lines indicated the cutoff of HSA synergism (−100) or antagonism (100). The lower and upper box hinges correspond to the first and third quartiles, and the whiskers extend from upper or lower hinges to 1.5 * IQR (inter-quartile range).
Summary of Synergism or Antagonism over Different Mechanism of Action (MoA) CombinationInconclusive blocks or singleton MoA were excluded. Two dashed lines indicated the cutoff of HSA synergism (−100) or antagonism (100). The lower and upper box hinges correspond to the first and third quartiles, and the whiskers extend from upper or lower hinges to 1.5 * IQR (inter-quartile range).
Antagonism between Remdesivir and Lysosomotropic Agents
Most notably, our results demonstrate a strong antagonistic effect between remdesivir and the antimalarial drugs hydroxychloroquine, mefloquine, and amodiaquine (Figure 3). The most striking antagonism was observed in the combination of the only two drugs ever approved with US Food and Drug Administration (FDA) emergency use authorization (EUA) to treat COVID-19: hydroxychloroquine and remdesivir (the EUA for hydroxychloroquine has since been withdrawn by the FDA). Our results showed that 10 μM hydroxychloroquine could completely extinguish the antiviral activity of remdesivir in vitro. The antagonistic effect exerted by hydroxychloroquine could be observed at a concentration as low as 0.37 μM (Figure 3A). Other aminoquinoline drugs, mefloquine (Figure 3B) and amodiaquine (Figure 3C), showed similar antagonism at low concentrations, but they could synergize with remdesivir at high concentrations.Likewise, we observed a similar antagonism against remdesivir from another drug with a tertiary amine moiety, umifenovir (Arbidol), at low concentrations (123–370 nM; Figure 3D). Umifenovir synergized with remdesivir at high concentrations (3–10 μM). Hydroxychloroquine, mefloquine, and amodiaquine are known lysosomotropic agents, and umifenovir is a lipophilic weak base (cLogP = 5.5), suggesting an association between reduced antiviral efficacy of remdesivir by lysosomotropic amines.To further investigate the mechanism, we tested GS-441524 (a remdesivir analog absent of McGuigan prodrug moiety) to see if antagonism could be maintained. Both GS-441524 (5 μM) and remdesivir (20 μM) alone completely rescued the cytopathic effect (CPE ≈ 0) by SARS-CoV-2. However, hydroxychloroquine (0.625–10 μM), mefloquine (0.625–1.25 μM), and amodiaquine (0.625–5 μM) significantly antagonized against remdesivir, but not GS-441524 (Figure 3E). The non-lysosomotropic amine drug oseltamivir (cLogP = 2.1) demonstrated no antagonism with remdesivir (Figure 3E). Our results suggest that lysosomotropic agents antagonize remdesivir by impairing its upstream activation (e.g., esterase-mediated hydrolysis) rather than the formation of triphosphate active agent.
Synergism between Nitazoxanide and Remdesivir, Amodiaquine, or Umifenovir
Among 16 synergistic combinations, we observed an enrichment of nitazoxanide, an FDA-approved broad-spectrum antiviral and antiparasitic drug. The three most synergistic combinations with nitazoxanide, i.e., nitazoxanide + remdesivir/umifenovir/amodiaquine are shown in Figure 6. A complete rescue of CPE could be observed from 0.625–5 μM of nitazoxanide when combined with remdesivir/umifenovir/amodiaquine, where any of these drugs alone could only achieve a maximum 40%–60% rescue (Figures 6A–6C). Nitazoxanide is not cytotoxic when concentration is below 5 μM. However, we observed a mild toxicity (∼20%) of nitazoxanide to Vero E6 cells at 10 μM (Table S3), which may explain the vanishment of synergy at this concentration.
Figure 6
Matrix Blocks from Three Synergistic Combinations Involving Nitazoxanide
(A) Nitazoxanide + remdesivir; (B) nitazoxanide + arbidol; (C) nitazoxanide + amodiaquine. Red arrow, the concentrations that synergize with the partner compound.
Matrix Blocks from Three Synergistic Combinations Involving Nitazoxanide(A) Nitazoxanide + remdesivir; (B) nitazoxanide + arbidol; (C) nitazoxanide + amodiaquine. Red arrow, the concentrations that synergize with the partner compound.
Discussion
Combining modern computational techniques and experimental approaches, we have identified 16 synergistic antiviral combinations in vitro (Figure 2). Somewhat unexpectedly, our results also revealed an antagonism between remdesivir and hydroxychloroquine, the two drugs approved with FDA EUA for COVID-19 (the EUA for hydroxychloroquine has since been revoked, as of June 15, 2020). Other lysosomotropic agents, such as mefloquine, amodiaquine, and umifenovir, also antagonize remdesivir, suggesting a general mechanism. These findings demonstrate the importance of preclinical research investigating antiviral drug combinations prior to their application in patients, as well as the utility of data- and text-mining approaches to explore MoAs underlying synergism/antagonism within the context of COVID-19. Lack of preclinical studies on combinations prior to their administration in patients may significantly increase the risk of antagonism and undesirable side effects. The matrix screening platform presented in this study is an efficient, data-driven method for prioritizing synergistic combinations and flagging undesirable pharmacological interactions.Remdesivir is a nucleotide analog McGuigan prodrug, which inhibits SARS-CoV-2RdRp through inducing delayed chain termination. Although the key enzymes required to activate remdesivir into the active triphosphate form have not been fully revealed, we hypothesize that remdesivir shares, at least partially, a similar activation pathway with GS-465124, a metabolite from nucleotide prodrug GS-6620 for hepatitis C virus, based on the chemical similarity (Figure 7). Both remdesivir and GS-465124 are adenosine-like phosphoramidates, with the only difference being a methyl group on the 2′ pentose ring. Therefore, remdesivir is also likely to be hydrolyzed into alanine metabolite (GS-704277) intracellularly by cathepsin A, akin to GS-465124. Since cathepsin A is an acidic pH-dependent serine protease strictly located in lysosome, the lysosomotropic agents such as hydroxychloroquine may reduce the amount of monophosphate intermediate by increasing lysosomal pH. This mechanism is in line with our finding that lysosomotropic agents do not antagonize GS-441254, which does not need cathepsin A for activation (Figures 3E and 7). More mechanistic studies of remdesivir are in progress at NCATS, utilizing label-free mass spectra to elucidate the exact mechanisms underlying this striking antagonism.
Figure 7
The Putative Mechanism of the Antagonism between Remdesivir and the Lysosomotropic Agent
We hypothesize that lysosomotropic agents antagonize remdesivir by impairing its upstream activation (e.g., esterase-mediated hydrolysis) rather than the formation of triphosphate active agent.
The Putative Mechanism of the Antagonism between Remdesivir and the Lysosomotropic AgentWe hypothesize that lysosomotropic agents antagonize remdesivir by impairing its upstream activation (e.g., esterase-mediated hydrolysis) rather than the formation of triphosphate active agent.We have observed a notable synergism for combinations of nitazoxanide with remdesivir, umifenovir, or amodiaquine (Figure 6). Nitazoxanide is an FDA approved, bioavailable, broad-spectrum anti-infective drug, which recently has been investigated for use against SARS-CoV-2 owing to its previously established anticoronaviral activities. It was originally identified as a potential antiviral drug-repurposing candidate against SARS-CoV-2 with an IC50 of about 2 μM in a focused compound screening including remdesivir and chloroquine. Previous studies have suggested a complex antiviral mechanism for nitazoxanide, including activating retinoic-acid-inducible protein I (RIG-I) signaling and blocking entry distinct from that of endosomal pH-neutralizing agents. The concentration at which we observed synergy with remdesivir (>1.25 μM, equivalent to 0.383 mg/L) is achievable in plasma and lung trough even at low dose. Nitazoxanide is well tolerated, and there is no report of any significant adverse effects from healthy adults. As of July 31, 2020, ClinicalTrials.gov shows 17 clinical trials using nitazoxanide to treat COVID-19, either in combination with other drugs (ivermectin, hydroxychloroquine, atazanavir) or as a standalone therapy. Recently, a randomized placebo-controlled trial of 392 participants has demonstrated modest efficacy of nitazoxanide with respect to 7-day viral load and symptom resolution in an outpatient setting. Therefore, the combination of nitazoxanide with remdesivir (or its metabolite GS-441524) looks the most promising from a clinical perspective because both drugs would potentially be available for use for the treatment of COVID-19 (nitazoxanide is FDA approved and remdesivir has an EUA).Despite the synergism and antagonism demonstrated by drug combinations reported in this study, we emphasize that these results require further validation. Vero E6 cells do not express the serine proteases TMPRSS2/4, the two proteases crucial for viral entry through the early membrane fusion pathway. Vero E6 also expresses P-glycoprotein (P-gp), indicating the observed synergy could be simply due to P-gp inhibition, which enhances the exposure of remdesivir in vitro. Likewise, it has been noted that while working with SARS-CoV-2, passaging repeatedly through Vero E6 cells can result in the deletion of a putative furin-cleavage site in the spike glycoprotein of the virus. This is problematic, as this furin-cleavage site has been noted to be important in determining the host range and pathogenesis of SARS-CoV-2;, thus, this mutation could produce in inconclusive results in CPE studies performed in this cell line. Thus, all synergistic and antagonistic combinations need to be verified in other cell lines to determine how penetrant the reported synergies are, for example, in a TMPRSS2/4-expressing cell line or primary airway cell model. The synergy between amodiaquine and nitazoxanide in Vero E6 may not translate to Calu-3 (TMPRSS2+) where single-agent amodiaquine is >10-fold less potent. Moreover, the observed synergism/antagonism, especially those occurring only at high concentration (e.g., umifenovir, maximum serum concentration [Cmax] = 467 ng/mL, equivalent to 0.98 μM), may not be achievable in vivo due to complex pharmacokinetics. Meanwhile, antagonism sometimes can be circumvented by altering dosing schedule or formulation. Therefore, more in-depth in vivo validation and pharmacokinetic modeling are still necessary.Principally, these findings suggest that lysosomotropic agents such as hydroxychloroquine should be prescribed and used with increased caution in COVID-19patients due to their relatively long half-life (usually weeks). This is consistent with a statement issued by the FDA on June 15, 2020, warning that combinations of chloroquine/hydroxychloroquine with remdesivir may reduce the antiviral effectiveness of remdesivir against SARS-CoV-2. In regard to the possible clinical relevancy of any of the synergistic drug combinations discovered herein, it is important to note that many of these (e.g., remdesivir and mefloquine, amodiaquine, or umifenovir) are dose dependent, demonstrating antagonism at lower concentrations and synergism at higher concentrations. This is relevant to any clinical dosing regimen that could be derived for these drugs, as determining an appropriate dosing combination is likely more difficult in vivo than the in vitro studies presented here. Additionally, higher concentrations of these drugs in combination could result in more exaggerated or markedly different biological/cytotoxic effects than those observed in vitro. Thus, we suggest that testing of these drug combinations in animal models of SARS-CoV-2 should be tried after further validation in different human cell lines.Of the binary combinations tested, we identified 16 synergistic and 8 antagonistic combinations, with four of them exhibiting both synergy and antagonism. All together, our findings demonstrate the utility of in silico tools for rational selection of drug combinations, the importance of preclinical testing of drug combinations prior to their administration in patients, and the overall promise of using drug repurposing and combination therapies against SARS-CoV-2.
Materials and Methods
Experimental Design
A detailed description of our study design is provided in our recent paper and is also outlined in Figure 8. In the beginning, we applied a combination of text mining (Chemotext), knowledge mining (ROBOKOP/COVID-KOP knowledge graphs),, and machine learning (QSAR) tools to identify existing drugs with possible activities against SARS-CoV-2. Thus, we first identified a list of 76 individual drug candidates for repurposing in combination therapy against COVID-19. These drugs could result in 2,850 unique binary combinations. From this selection of possible combinations, we then prioritized combinations of drugs with different mechanisms of action and/or targeting the virus at different stages of its life cycle, which increases the probability of synergy between drugs., The rationale behind combination selection is depicted in Figure S1 through the example of umifenovir and emetine, which are suspected to act upon different stages of the viral life cycle. A combination of in silico tools such as Chemotext, the recently developed COVID-KOP, and QSAR models of major drug-drug interactions were used to determine if compounds had been previously tested together and if any negative drug-drug interactions were to be expected. Analyzing the result obtained using these tools, we finally prioritized 73 combinations of 32 drugs for testing in vitro against SARS-CoV-2. It should be noted that in addition to these, we also identified 95 ternary combinations of 15 drugs in silico, which will be described in a future study. A brief description of the aforementioned computational tools is provided below.
Figure 8
Study Design for Selecting Possible Synergistic Drug Combinations
In this study, we report only 73 binary combinations; 95 ternary combinations identified in a similar fashion will be reported in a future study.
Study Design for Selecting Possible Synergistic Drug CombinationsIn this study, we report only 73 binary combinations; 95 ternary combinations identified in a similar fashion will be reported in a future study.
In Silico Tools
Chemotext
Chemotext is a publicly available web server that mines the published literature in PubMed in the form of medical subject headings (MeSH) terms. One capability of Chemotext is finding papers that share two search terms, in this case, the MeSH terms of compound #1 and compound #2, and returning papers that contain both these MeSH terms. These shared MeSH terms, depicting proteins, chemicals, etc., allow us to hypothesize on how these two compounds may be connected, namely via shared biochemical pathways discussed in these common papers. Chemotext was used for elucidation of the relationships between drugs, protein targets, SARS-CoV-2, and COVID-19 from the papers’ annotated MEDLINE/PubMed database.
ROBOKOP and COVID-KOP
ROBOKOP is a data-mining tool developed within Biomedical Data Translator Initiative to efficiently query, store, rank, and explore sub-graphs of a complex knowledge graph for hypothesis generation and scoring. We have used ROBOKOP in a similar fashion as Chemotext; Chemotext can help the user to find and impute the connections among drugs, targets, and diseases, and ROBOKOP can help explore and score them. COVID-KOP, a new knowledge base integrating the existing ROBOKOP biomedical knowledge graph with information from recent biomedical literature on COVID-19 annotated in the CORD-19 collection, was developed midway through the project and was subsequently utilized instead of ROBOKOP.
QSAR Models
QSAR models developed by us earlier were used for selection of drugs, that could be repurposed as combinations and exclusion of potential drug-drug interactions and side effects. All models were developed according to the best practices of QSAR modeling,,, with special attention paid for data curation44, 45, 46 and rigorous external validation. Mixture-specific descriptors and validation techniques specially developed for modeling of drug combinations were utilized for modeling of drug-drug interactions.
Assay Protocols
All the protocols and results are freely available to the scientific community at https://opendata.ncats.nih.gov/covid19/matrix. In brief, 30 nL of each compound in DMSO was acoustically dispensed into assay-ready plates (ARPs). Media was then added to the plates at 5 μL/well and incubated at room temperature to dissolve the compounds. Vero E6 cells (selected for high ACE2 expression) were premixed with SARS-CoV-2 (USA_WA1/2020) at a MOI of 0.002 and were dispensed as 25 mL/well into ARPs within 5 min in a BSL-3 lab. The final cell density was 4,000 cells/well. The cells and virus were incubated with compounds for 72 hr, then viability was assayed by ATP content using CellTiter-Glo (Promega).For the cytotoxicity assay, ARPs were prepared in the same way as for CPE assay. Then, 5 mL/well of media was dispensed into assay plates. Vero E6 cells, suspended in medium, were dispensed into assay plates at 25 µL/well for a final cell density of 4,000 cells/well. Assay plates were incubated for 72 hr at 37°C, 5% CO2, 90% humidity, before viability was assayed by ATP content using CellTiter-Glo (Promega).
ARP Production
To generate the compound source plate, a Perkin-Elmer Janus automated workstation was used to transfer compounds from 1.4 mL matrix 2D barcode tube (sample tube) to the individual wells of Echo Qualified 384-well polypropylene microplate 2.0∗∗, along with positive and neutral (DMSO) controls (Labcyte, San Jose, CA, USA). The plates were centrifuged for 2 min at 100 × g. A comma-separated file was generated that contained the unique plate and well pairings for each of the compound matrix blocks for the Labcyte acoustic dispenser (Labcyte, San Jose, CA, USA). Compounds were dispensed to generate ARPs using an access laboratory workstation with dual Echo 655 dispensers (Labcyte). Each plate was sealed with a peelable aluminum seal, remaining covered until the initiation of the biological assay, frozen at −80°C until used for screening.
Data Analysis
CPE and Tox activity were normalized using independent control wells on each plate, so activity values were not strictly bounded between [0, 100]. For CPE assay, DMSO + virus was treated as the neutral control, whereas DMSO-only (no virus) served as the positive control. A calpain inhibitor IV was used as batch control (2 μg/mL final assay concentration). Normalized CPE activity = 1 − (x - neutralCtrl)/(positiveCtrl − neutralCtrl) × 100%. For Tox assay, DMSO-only was used as the neutral control and media-only wells (no cell) as the negative control. Normalized Tox activity = (x − negativeCtrl)/(neutralCtrl − negativeCtrl) × 100%. Plate-level data was pivoted to block-level data, and replicates were median aggregated.Synergism and antagonism from a 6 × 6 block were evaluated using the HSA model. Given a dose combination Aconc1 + Bconc2,Therefore, we haveSynergism, HSA(∗) < 0Antagonism, HSA(∗) > 0Additivity, HSA(∗) = 0.To account for dose-dependent synergism and antagonism, we analyzed the negative HSA (HSA.neg) and positive HSA (HSA.pos) separately. The overall synergism (or antagonism) given a 6 × 6 block was calculated as the sum of all negative (or positive) HSA(Aconc∗+Bconc∗) across the non-toxic dose combinations (defined as Tox activity > 50).Since variation of CPE activity is heteroscedastic (Figure 1B), which made it more difficult to ascertain the reproducibility of synergy/antagonism (given limited resources), we evaluated the smoothness of the 2D activity landscape. Smoothness was calculated as the root-mean-square deviation (RMSD) between the actual and Gaussian smoothed (σ = 2) landscape. If a block had RMSD (observed, Gaussian smoothed) > 20 or < 25 non-toxic CPE values, inconclusive synergism/antagonism was recorded. Otherwise, synergism and/or antagonism were recorded if HSA.neg < −100 and/or HSA.pos > 100.
Authors: Eugene N Muratov; Ekaterina V Varlamova; Anatoly G Artemenko; Pavel G Polishchuk; Victor E Kuz'min Journal: Mol Inform Date: 2012-03-13 Impact factor: 3.353
Authors: Wei Sun; Shihua He; Carles Martínez-Romero; Jennifer Kouznetsova; Gregory Tawa; Miao Xu; Paul Shinn; Ethan Fisher; Yan Long; Omid Motabar; Shu Yang; Philip E Sanderson; Peter R Williamson; Adolfo García-Sastre; Xiangguo Qiu; Wei Zheng Journal: Antiviral Res Date: 2016-11-24 Impact factor: 5.970
Authors: Patricia R M Rocco; Pedro L Silva; Fernanda F Cruz; Marco Antonio C Melo-Junior; Paulo F G M M Tierno; Marcos A Moura; Luís Frederico G De Oliveira; Cristiano C Lima; Ezequiel A Dos Santos; Walter F Junior; Ana Paula S M Fernandes; Kleber G Franchini; Erick Magri; Nara F de Moraes; José Mário J Gonçalves; Melanie N Carbonieri; Ivonise S Dos Santos; Natália F Paes; Paula V M Maciel; Raissa P Rocha; Alex F de Carvalho; Pedro Augusto Alves; José Luiz Proença-Módena; Artur T Cordeiro; Daniela B B Trivella; Rafael E Marques; Ronir R Luiz; Paolo Pelosi; Jose Roberto Lapa E Silva Journal: Eur Respir J Date: 2021-07-08 Impact factor: 16.671
Authors: David E Gordon; Gwendolyn M Jang; Mehdi Bouhaddou; Jiewei Xu; Kirsten Obernier; Kris M White; Matthew J O'Meara; Veronica V Rezelj; Jeffrey Z Guo; Danielle L Swaney; Tia A Tummino; Ruth Hüttenhain; Robyn M Kaake; Alicia L Richards; Beril Tutuncuoglu; Helene Foussard; Jyoti Batra; Kelsey Haas; Maya Modak; Minkyu Kim; Paige Haas; Benjamin J Polacco; Hannes Braberg; Jacqueline M Fabius; Manon Eckhardt; Margaret Soucheray; Melanie J Bennett; Merve Cakir; Michael J McGregor; Qiongyu Li; Bjoern Meyer; Ferdinand Roesch; Thomas Vallet; Alice Mac Kain; Lisa Miorin; Elena Moreno; Zun Zar Chi Naing; Yuan Zhou; Shiming Peng; Ying Shi; Ziyang Zhang; Wenqi Shen; Ilsa T Kirby; James E Melnyk; John S Chorba; Kevin Lou; Shizhong A Dai; Inigo Barrio-Hernandez; Danish Memon; Claudia Hernandez-Armenta; Jiankun Lyu; Christopher J P Mathy; Tina Perica; Kala Bharath Pilla; Sai J Ganesan; Daniel J Saltzberg; Ramachandran Rakesh; Xi Liu; Sara B Rosenthal; Lorenzo Calviello; Srivats Venkataramanan; Jose Liboy-Lugo; Yizhu Lin; Xi-Ping Huang; YongFeng Liu; Stephanie A Wankowicz; Markus Bohn; Maliheh Safari; Fatima S Ugur; Cassandra Koh; Nastaran Sadat Savar; Quang Dinh Tran; Djoshkun Shengjuler; Sabrina J Fletcher; Michael C O'Neal; Yiming Cai; Jason C J Chang; David J Broadhurst; Saker Klippsten; Phillip P Sharp; Nicole A Wenzell; Duygu Kuzuoglu-Ozturk; Hao-Yuan Wang; Raphael Trenker; Janet M Young; Devin A Cavero; Joseph Hiatt; Theodore L Roth; Ujjwal Rathore; Advait Subramanian; Julia Noack; Mathieu Hubert; Robert M Stroud; Alan D Frankel; Oren S Rosenberg; Kliment A Verba; David A Agard; Melanie Ott; Michael Emerman; Natalia Jura; Mark von Zastrow; Eric Verdin; Alan Ashworth; Olivier Schwartz; Christophe d'Enfert; Shaeri Mukherjee; Matt Jacobson; Harmit S Malik; Danica G Fujimori; Trey Ideker; Charles S Craik; Stephen N Floor; James S Fraser; John D Gross; Andrej Sali; Bryan L Roth; Davide Ruggero; Jack Taunton; Tanja Kortemme; Pedro Beltrao; Marco Vignuzzi; Adolfo García-Sastre; Kevan M Shokat; Brian K Shoichet; Nevan J Krogan Journal: Nature Date: 2020-04-30 Impact factor: 69.504
Authors: Joshua E Hochuli; Sankalp Jain; Cleber Melo-Filho; Zoe L Sessions; Tesia Bobrowski; Jun Choe; Johnny Zheng; Richard Eastman; Daniel C Talley; Ganesha Rai; Anton Simeonov; Alexander Tropsha; Eugene N Muratov; Bolormaa Baljinnyam; Alexey V Zakharov Journal: ACS Pharmacol Transl Sci Date: 2022-06-22
Authors: Adam Bess; Frej Berglind; Supratik Mukhopadhyay; Michal Brylinski; Nicholas Griggs; Tiffany Cho; Chris Galliano; Kishor M Wasan Journal: Drug Discov Today Date: 2021-11-05 Impact factor: 7.851
Authors: Seyed Mohammad Reza Hashemian; Mohammad Hossein Pourhanifeh; Michael R Hamblin; Mohammad Karim Shahrzad; Hamed Mirzaei Journal: Biomed Pharmacother Date: 2021-12-09 Impact factor: 7.419
Authors: Matthew D Hall; James M Anderson; Annaliesa Anderson; David Baker; Jay Bradner; Kyle R Brimacombe; Elizabeth A Campbell; Kizzmekia S Corbett; Kara Carter; Sara Cherry; Lillian Chiang; Tomas Cihlar; Emmie de Wit; Mark Denison; Matthew Disney; Courtney V Fletcher; Stephanie L Ford-Scheimer; Matthias Götte; Abigail C Grossman; Frederick G Hayden; Daria J Hazuda; Charlotte A Lanteri; Hilary Marston; Andrew D Mesecar; Stephanie Moore; Jennifer O Nwankwo; Jules O'Rear; George Painter; Kumar Singh Saikatendu; Celia A Schiffer; Timothy P Sheahan; Pei-Yong Shi; Hugh D Smyth; Michael J Sofia; Marla Weetall; Sandra K Weller; Richard Whitley; Anthony S Fauci; Christopher P Austin; Francis S Collins; Anthony J Conley; Mindy I Davis Journal: J Infect Dis Date: 2021-07-15 Impact factor: 7.759
Authors: Sankalp Jain; Daniel C Talley; Bolormaa Baljinnyam; Jun Choe; Quinlin Hanson; Wei Zhu; Miao Xu; Catherine Z Chen; Wei Zheng; Xin Hu; Min Shen; Ganesha Rai; Matthew D Hall; Anton Simeonov; Alexey V Zakharov Journal: ACS Pharmacol Transl Sci Date: 2021-09-17