Literature DB >> 24014644

Early identification of clinically relevant drug interactions with the human bile salt export pump (BSEP/ABCB11).

Jenny M Pedersen1, Pär Matsson, Christel A S Bergström, Janet Hoogstraate, Agneta Norén, Edward L LeCluyse, Per Artursson.   

Abstract

A comprehensive analysis was performed to investigate how inhibition of the human bile salt export pump (BSEP/ABCB11) relates to clinically observed drug-induced liver injury (DILI). Inhibition of taurocholate (TA) transport was investigated in BSEP membrane vesicles for a data set of 250 compounds, and 86 BSEP inhibitors were identified. Structure-activity modeling identified BSEP inhibition to correlate strongly with compound lipophilicity, whereas positive molecular charge was associated with a lack of inhibition. All approved drugs in the data set (n = 182) were categorized according to DILI warnings in drug labels issued by the Food and Drug Administration, and a strong correlation between BSEP inhibition and DILI was identified. As many as 38 of the 61 identified BSEP inhibitors were associated with severe DILI, including 9 drugs not previously linked to BSEP inhibition. Further, among the tested compounds, every second drug associated with severe DILI was a BSEP inhibitor. Finally, sandwich-cultured human hepatocytes (SCHH) were used to investigate the relationship between BSEP inhibition, TA transport, and clinically observed DILI in detail. BSEP inhibitors associated with severe DILI greatly reduced the TA canalicular efflux, whereas BSEP inhibitors with less severe or no DILI resulted in weak or no reduction of TA efflux in SCHH. This distinction illustrates the usefulness of SCHH in refined analysis of BSEP inhibition. In conclusion, BSEP inhibition in membrane vesicles was found to correlate to DILI severity, and altered disposition of TA in SCHH was shown to separate BSEP inhibitors associated with severe DILI from those with no or mild DILI.

Entities:  

Keywords:  alternatives to animal testing; biliary excretion; disposition; drug induced liver injury; hepatocytes; in vitro and alternatives; predictive toxicology.; risk assessment

Mesh:

Substances:

Year:  2013        PMID: 24014644      PMCID: PMC3858191          DOI: 10.1093/toxsci/kft197

Source DB:  PubMed          Journal:  Toxicol Sci        ISSN: 1096-0929            Impact factor:   4.849


During the last decade, drug-induced liver injury (DILI) has been the most frequent cause of safety-related drug marketing withdrawals in the United States (Food and Drug Administration, 2009). In addition to the suffering of individual patients and the costs of the associated health care, DILI poses a major economic challenge to the pharmaceutical industry, as a result of decreasing marketing approval rates, postmarketing restrictions, and boxed warnings. Most drugs that cause DILI do so in an irregular and unpredicted fashion, also described as idiosyncratic events. Among those drugs withdrawn from the market due to severe liver injuries, hepatic failure typically occurred in fewer than 1 of 10 000 treated patients (Food and Drug Administration, 2009). Due to the low frequency, compounds causing severe DILI are challenging to identify in clinical trials and often remain unidentified until postmarketing monitoring when the drug has become available to a larger population (Bleibel ). The initial mechanism of hepatotoxicity for drugs and their resulting metabolites varies, but independently of the origin of the first insult, the mitochondria seem to play a major role in the initiation and progression of DILI (Russmann ; Xu ). Initial cell stress can be caused by a wide range of mechanisms including glutathione depletion, binding to intracellular structures, and inhibition of hepatocellular functions, eg, canalicular bile salt secretion through inhibition of the bile salt export pump (BSEP/ABCB11) (Lee, 2003; Mackay, 1999; Pauli-Magnus and Meier, 2006; Rashid ). BSEP mediates the ATP-dependent saturable efflux of monovalent bile salts across the canalicular membrane of the hepatocyte. The transporter constitutes the rate-limiting step in the transport of bile salts from the blood into the bile and thereby acts as an important determinant of bile flow (Gerloff ). BSEP is almost exclusively expressed in the hepatocyte canalicular membrane, although low extrahepatic expression has been detected at the mRNA level (Hilgendorf ; Langmann ). The essential physiological function of BSEP in hepatobiliary bile salt secretion is apparent from several BSEP mutations resulting in absent or defective function of the protein. In progressive familial intrahepatic cholestasis type 2, the most severe form of BSEP deficiency syndrome, most of the afflicted patients have undetectable levels of BSEP protein at the canalicular membrane (Jansen ; Strautnieks ). This deficiency results in symptoms of cholestasis that develops before 6 months of age and progresses to end-stage liver disease within the first decade of life (Shneider, 2004; Whitington ). Other mutations lead to milder forms of BSEP deficiency syndromes, such as benign recurrent intrahepatic cholestasis type 2. The symptoms observed from low function variants further indicate that low BSEP activity within normal interindividual variability can be a risk factor for an increased susceptibility to acquired cholestasis, eg, intrahepatic cholestasis during pregnancy or drug-induced cholestasis (Pauli-Magnus ; van Mil ). The close link between BSEP dysfunction and different severe pathophysiological conditions, in particular the increased susceptibility to DILI, highlights the importance of early identification of clinically relevant drug interactions with BSEP. In this study, we performed a comprehensive analysis of the role that BSEP inhibition plays in DILI and the extent to which it can be used to predict such adverse events prior to large-scale clinical trials. Two in vitro systems of different complexity (inverted membrane vesicles and sandwich-cultured human hepatocytes [SCHH]) were used to determine the influence of drugs on BSEP-mediated taurocholate (TA) transport. Based on our experimental data, we developed a computational model that correctly classified 84% and 91% of the BSEP inhibitors and noninhibitors, respectively. The clinical impact of BSEP inhibition was evaluated by determining the association between BSEP inhibition and the severity of DILI warnings in drug labels issued by the Food and Drug Administration (FDA). We found BSEP inhibition in membrane vesicles to correlate with DILI severity, and altered disposition of TA in SCHH was shown to distinguish BSEP inhibitors associated with severe DILI from those associated with no or mild DILI.

MATERIALS AND METHODS

Materials.

[3H]-TA was obtained from PerkinElmer (Waltham, MA). Ko143 was a kind gift from Dr Gerrit-Jan Koomen (Van’t Hoff Institute for Molecular Sciences, University of Amsterdam, the Netherlands). GF120918 was kindly provided by GlaxoSmithKline (Stevenage, UK). MK571 was purchased from A.G. Scientific (San Diego, CA) and astemizole from MP Biomedicals (Eschwege, Germany). Bosentan was purchased from Sequoia Research Products Limited (Pangbourne, UK). All other compounds were purchased from Sigma-Aldrich, St Louis, MO, at the highest purity available (> 95%). Inverted membrane vesicles from Sf9 cells expressing human BSEP (ABCB11) were purchased from SOLVO Biotechnology (Budapest, Hungary). Dulbecco’s modified Eagle’s medium (DMEM) and fetal bovine serum were purchased from Invitrogen, Carlsbad, CA. Dexamethasone, l-glutamine, penicillin, streptomycin, insulin, transferring, and selenium were purchased from Sigma-Aldrich. Hepatocyte maintenance medium (HMM) was obtained from Lonza, Basel, Switzerland and BD Matrigel Basement Membrane Matrix, phenol red free, was purchased from BD Biosciences (Bedford, MA). Standard Hanks' balanced salt solution (HBSS) and Ca2+- and Mg2+-free HBSS were purchased from Invitrogen.

Data sets.

In the membrane vesicle screen to identify BSEP inhibitors, compounds were selected for inclusion with the intention of optimizing the structural diversity of the data set. The final data set included 250 compounds that were evenly distributed throughout the physicochemical space of registered drugs (Fig. 1).
FIG. 1.

Chemical diversity of the studied compounds. The chemical space of registered oral drugs (n = 652) was described using a principal component analysis (PCA) of 80 molecular descriptors. When projected onto this PCA, the BSEP data set (n = 250) was shown to evenly distribute through the chemical space of oral drugs.

Chemical diversity of the studied compounds. The chemical space of registered oral drugs (n = 652) was described using a principal component analysis (PCA) of 80 molecular descriptors. When projected onto this PCA, the BSEP data set (n = 250) was shown to evenly distribute through the chemical space of oral drugs. The DILI classifications were conducted on approved drugs using the U.S. FDA’s drug labels; nondrug compounds were therefore not included in our analysis. Of the compounds investigated for BSEP inhibition, 180 were identified as the active component in FDA-approved drugs. Two withdrawn drugs (troglitazone and benzbromarone) for which FDA classification data could be retrieved from the literature were also included in the DILI analysis (Chen ). A subset of 15 model compounds was selected for further investigation in SCHH. These compounds were chosen to cover the possible combinations of different degrees of BSEP inhibition (inhibitors and noninhibitors) and DILI potential (severe and mild/no DILI). BSEP inhibitors that increase the risk of severe DILI were represented by cyclosporine A, ritonavir, rosiglitazone, and troglitazone. BSEP inhibitors with no or mild reported DILI were exemplified by mifepristone, isradipine, budesonide, and glyburide. Representative BSEP noninhibitors for severe DILI were valproic acid, flutamide, and zidovudine, whereas BSEP noninhibitors with no or only mild reported DILI were represented by omeprazole, cimetidine, haloperidol, and chlorpromazine.

BSEP-dependent TA transport assay.

Taurocholate transport was determined, in a 96-well plate format, in inverted membrane vesicles from Sf9 cells overexpressing human BSEP. Statistical experimental design, as implemented in Modde version 7.0 (Umetrics, Umeå, Sweden), was used to optimize experimental parameters with regard to (1) amount of membrane vesicles per well (10–50 µg/well), (2) TA concentration (1–10µM), and (3) incubation time (1–10min), at 5 levels per evaluated parameter. On the basis of the experimental design optimization (data not shown), 10 µg vesicles were used in each well and were incubated with 2µM TA for 5min. All experiments were performed using a rapid filtration technique modified from Pedersen . Briefly, transport buffer (10mM Tris-HCl [pH 7.4], 250mM sucrose, 10mM MgCl2, and 10mM phosphocreatine) was used to dilute dimethyl sulfoxide (DMSO) stock solutions to final substrate concentrations of 2µM (0.8µM/0.1 µCi 3H-TA). Final DMSO concentrations were consistently <0.3%, which in our laboratory has been shown to have negligible effects on the TA transport. BSEP membrane vesicles were quickly thawed from −85°C to 37°C and diluted in transport buffer to a final concentration of 0.2 µg/µl. Vesicle solution (50 µl) including substrate (2µM TA) was preincubated at 37°C for 10min, after which transport was initiated by the addition of 4mM adenosine triphosphate (ATP) and 90U/ml creatine kinase. All plates included control samples in which 4mM ATP was replaced by 4mM Adenosine monophosphate (AMP) to determine passive uptake of TA in the vesicles. After a 5-min incubation at 37°C on an orbital shaker (300rpm), transport was terminated by adding 200 µl ice-cold stop solution (10mM Tris-HCl [pH 7.4], 250mM sucrose, 0.1M NaCl, and 100µM TA). The incubation solutions were immediately transferred to and filtered through a 96-well glass filter plate with a pore size of 0.65 µm (Millipore, Bedford, MA). Filters were rinsed 5 times with 200 µl ice-cold stop solution and dried before 100 µl Microscint 40 (PerkinElmer) was added. Radioactivity was measured in a TopCount NXT (PerkinElmer) scintillation counter. Measurements in cpm were converted to molar amounts by normalizing to the cpm measured in substrate solutions of known concentration. ATP-dependent transport was calculated by subtraction of passive permeability determined from AMP incubations. All experiments were performed in triplicate and positive inhibition controls with 50µM cyclosporine A or indocyanine green were included on each plate. To determine transport kinetics, the BSEP-mediated TA transport was measured in 5-min incubations at concentrations between 0.8 and 100µM. The resulting transport rates were used to determine Michaelis-Menten kinetic parameters (K m and V max) by nonlinear regression in Prism version 5 (GraphPad, San Diego, CA).

BSEP inhibition screen.

The optimized membrane vesicle assay was used to screen the selected 250 compounds for BSEP inhibition at a concentration of 50µM. The assay was performed as a normal transport experiment (described above) with the only difference being that TA in the inhibition studies was coincubated (during preincubation and incubation) with 50µM test compound. The ATP-dependent TA transport rates were measured in the presence and absence of each test compound, and relative transport rates were expressed as the percentage of the uninhibited control. All compounds that significantly (p < .05) decreased the TA transport were classified as inhibitors, which resulted in an inhibition cutoff at 27.5%. Also, in order to rank the inhibition as either weak or strong, a second cutoff at 50% transport inhibition was included. Compounds with inhibitory effects between the 2 cutoffs (ie, resulting in TA transport between 72.5% and 50% that of the controls) were denoted weak inhibitors. Compounds inhibiting the TA transport by more than 50% were denoted strong inhibitors. Compounds with nonsignificant BSEP inhibition were denoted noninhibitors. The inhibitory effects of the 2 positive controls, cyclosporine A and indocyanine green, were determined in concentration intervals of 0.1–100µM. IC50 values were calculated from the nonlinear regression of dose-response curves using Prism version 5 (GraphPad) according to equation 1:

Computational structure-inhibition modeling.

Computational models were developed to identify molecular properties associated with BSEP inhibition. A total of 249 compounds (53 strong inhibitors, 33 weak inhibitors, and 163 noninhibitors) were included in the computational analyses. Oxaliplatin was excluded from the analysis because its molecular surface areas were not possible to compute due to the presence of an unparameterized platinum atom. The data set was randomly split with a ratio of 2:1 into a training set of 163 compounds (34 strong inhibitors, 21 weak inhibitors, and 108 noninhibitors) for model development and a test set of 86 compounds (19 strong inhibitors, 12 weak inhibitors, and 55 noninhibitors) for validation of the final model. Chemical structures were obtained as 2D SD files from PubChem (Bolton ). These structures were further processed to calculate molecular descriptors using the Dragon version 6 (Talete, Italy), ADMETPredictor version 6.0 (SimulationsPlus, Lancaster, CA), and MAREA version 3.02 (in-house) software. The descriptors were related to the inhibition class using orthogonal partial least-squares projection to latent structures discriminant analysis (OPLS-DA), according to a previous protocol (Pedersen ).

Classifying DILI severity of drugs in the data set.

The main goal of this investigation was to explore to what extent BSEP inhibition predicts clinically observed DILI. We identified the classification system of adverse drug reactions (ADR) implemented in the FDA drug labels as a suitable data source. The FDA drug labels represent a consensus of regulatory and industry experts who evaluate and balance data combined from controlled clinical trials, published literature case studies, spontaneous ADR reports, and postmarket monitoring. The 3 ADR sections within the drug labels categorize ADRs by increasing severity, ranging from the least severe “adverse reactions” (AR), through the intermediate “warnings and precautions” (WP), to the most severe “boxed warnings” (BW). According to the definitions in U.S. federal regulations 21 CFR 201.57, the AR section describes the overall adverse reaction profile of a drug and includes those adverse events believed to have a causal relationship with the drug. The WP section is required to describe clinically significant adverse reactions as soon as reasonable evidence of a causal association with the drug is established. The BW section contains certain contraindications or serious warnings, particularly those that may lead to death or serious injury, and is generally based on clinical data (U.S. Federal Regulations, 2012). To assess the DILI potential of registered drugs within the data set, information on hepatic ADRs in FDA-approved drug labels was obtained from DailyMed (http://dailymed.nlm.nih.gov/), and the DILI potential was classified using the method of Chen . Briefly, FDA drug labels were reviewed for hepatic adverse reactions by searching for keywords related to liver injury (Supplementary Table S1). A compound was regarded as a DILI mediator if the keywords were identified in the BW, WP, or AR sections within a drug label. If a keyword was mentioned in several sections, the compound was classified in the most severe category (BW > WP > AR). In addition, we categorized drugs where no hepatic ADRs appeared in any of the ADR sections as “not mentioned” (NM). To verify that the classifications from the automated search were correct, a low threshold search using “liver” and “hepatic” as search keywords followed by manual inspection of matching drug labels was conducted. The ADR sections in FDA drug labels describe ADRs in a hierarchical way on the basis of their severity. To assure that the ADR sections described DILI severity in the same hierarchical way, without influence from other ADRs reported for the same drug, the severity of DILI reported in the different sections was evaluated using the approach described in Chen and Supplementary Table S2. Because FDA drug labels of registered drugs were used to investigate the correlation between BSEP inhibition and DILI, the impact on the data set composition from the exclusion of nondrug compounds (n = 68) was assessed. The frequency of BSEP inhibitors was comparable in the full data set (n = 250) investigated for BSEP inhibition in membrane vesicles (34% BSEP inhibitors) and in the subset of drugs (n = 182) in the DILI analysis (33% BSEP inhibitors). Furthermore, the exclusion of nondrugs did not skew the data set with regard to chemical diversity, as confirmed by a principal component analysis of molecular descriptors (data not shown).

Isolation and culture of human hepatocytes.

Liver tissues free from metastases were obtained from human donors undergoing partial liver resections at the Department of Surgery, Uppsala University Hospital, Sweden (see Table 1 for patient demographics). All donors gave informed consent, in accordance with the approval from the Uppsala Regional Ethical Review Board (Ethical Approval no. 2009/028). Hepatocytes were isolated using the 2-step liver digestion technique of Lecluyse and Alexandre (2010). Primary hepatocytes, with a viability >85%, were seeded in collagen-1-coated 24-well plates (BD Biosciences) at a density of 3.75×105 cells per well and initially maintained at 37°C and 5% CO2 in 500 µl DMEM supplemented with 5% (vol/vol) fetal bovine serum, 4 µg/ml insulin, 1µM dexamethasone, 4mM l-glutamine, 100U/ml penicillin, and 100 µg/ml streptomycin. Cells were allowed to attach to the plate for 2–3h in a humidified culture chamber at 37°C and 5% CO2, after which the medium was carefully aspirated and replaced with 500 µl culture medium (HMM supplemented with insulin 10 µg/ml, transferrin 5.5 µg/ml, selenium 5ng/ml, 0.1µM dexamethasone, 100U/ml penicillin, and 100 µg/ml streptomycin). After overnight incubation, the cells were overlaid with 500 µl ice-cold 0.25mg/ml Matrigel in culture medium. To allow the formation of bile canaliculi, the cells were cultured for an additional 4–6 days during which the culture medium was refreshed every 24h.
TABLE 1

Demographic Data for Human Liver Donors

SexAgeDiagnosisMedicationCytostatic Treatment
F59GISTImatinib treatment until 7 days before resection
M73MMLow dose acetylsalicylic acid
M61MMPrednisolone, simvastatin, azathioprine, cholecalciferol
M55CRCBisoprolol, loratadine, zopicloneFolfiri
M67CRCAllopurinol, tenormin, amlidopine, enalapril, alfuzisinFolfiri, cetuximab
F45CRC

Abbreviations: CRC, colorectal cancer; F, female; Folfiri, fluorouracil, leucovorin, and irinotecan; GIST, gastrointestinal stromal tumor; M, male; MM, malignant melanoma.

Demographic Data for Human Liver Donors Abbreviations: CRC, colorectal cancer; F, female; Folfiri, fluorouracil, leucovorin, and irinotecan; GIST, gastrointestinal stromal tumor; M, male; MM, malignant melanoma.

Determination of TA accumulation in sandwich-cultured hepatocytes.

Taurocholate accumulation in SCHH was determined using a method modified from that described by Liu . In short, the SCHH were rinsed twice with either 400 µl of standard HBSS, to maintain the integrity of tight junctions and bile canaliculi, or with Ca2+- and Mg2+-free HBSS, to disrupt the tight junctions. Cultures were then preincubated for 15min, with or without 10µM test compound, dissolved in either 200 µl standard or Ca2+- and Mg2+-free HBSS. DMSO was included at the same final concentration (0.1%) in control (compound-untreated) wells as that in the compound-treated wells. Preincubation medium was removed and TA uptake was initiated by the addition of 1µM substrate solution (0.75µM [3H]-TA and 0.25µM TA) together with 10µM test compound in standard or Ca2+- and Mg2+-free HBSS. Transport was stopped after 10min by removing the incubation medium and rinsing the cells twice with 400 µl ice-cold standard or Ca2+- and Mg2+-free HBSS. Cells were lysed with 100 µl 1M NaOH and kept at 4°C overnight before being analyzed for radioactivity in a TopCount NXT (PerkinElmer) scintillation counter. Total protein content was determined using the BCA Protein Assay Reagent Kit (Pierce Biotechnology, Rockford, IL) according to the manufacturer’s instructions. All experiments were performed in triplicates on 3 separate occasions, using cells isolated from 6 different donors. The measurements were used to calculate the amount of TA in the respective compartments, and the numbers were normalized to total protein content. Total accumulation (TOTALAcc; intracellular plus bile accumulation after incubation in HBSS) and intracellular accumulation (ICAcc; after incubation in Ca2+- and Mg2+-free HBSS) of TA were used to calculate bile accumulation (BILEAcc) according to equation 2: The biliary excretion index (BEI; equation 3), ie, the ratio describing the biliary accumulation of a compound in relation to its total accumulation (intracellular + bile) (Liu ), was calculated according to equation 3: In addition to BEI, we introduced the bile intracellular correlation (BIC; equation 4), which describes biliary accumulation in relation to the intracellular accumulation according to equation 4. Relating bile secretion to the intracellular accumulation is of interest because it is the intracellular substrate concentration that governs the efflux kinetics across the canalicular membrane: Finally, the in vitro biliary clearance (CLBile; equation 5) was calculated based on TA media concentrations. CLBile is dependent on the net substrate flux across the cell, ie, on the net basolateral uptake (including passive- and transporter-mediated basolateral uptake and efflux) and the net canalicular efflux: where AUC is the area under the concentration-time curve based on TA concentrations in the incubation medium. The calculated parameters were presented as percentages of the corresponding value in control incubations (ie, TA transport measured in the absence of inhibitors), to allow comparison between different batches of SCHH.

Statistical analysis.

Data are expressed as means with SDs or SEMs, as indicated in the text. In the BSEP inhibition screen, compounds that significantly decreased BSEP transport were identified by 1-way ANOVA with Bonferroni’s post hoc test, as implemented in Prism 5 (GraphPad Software, Inc, La Jolla, CA). Differences in the proportions of DILI-inducing agents in each ADR class were determined using normality tests. The Marascuillo procedure was used to determine statistical differences of mild and severe DILI distribution in the different ADR sections. Analysis of SCHH accumulation data were conducted using 2-way ANOVA with Bonferroni’s post hoc test.

RESULTS

TA Transport in Inverted Membrane Vesicles

To investigate the impact of drugs on BSEP-mediated TA transport, we used inverted membrane vesicles from cells overexpressing human BSEP. This system allows direct measurement of drug interactions with BSEP, thereby eliminating certain confounding factors that affect whole-cell systems (such as drug metabolism and the need for sufficient membrane permeability to reach transporter binding sites). The ATP-dependent transport of TA into inverted membrane vesicles was linear for up to 15min (Fig. 2A). The passive TA transport was approximately 5% of the active uptake under the conditions applied. The kinetics of the TA transport was determined from the data in Figure 2B using nonlinear regression. This resulted in a K m of 17.8±5.0µM and a V max of 286.2±28.2 pmol/mg protein/min, in good agreement with previously published data (Kis ; Yabuuchi ). Two inhibitors (cyclosporine A and indocyanine green) were used as controls throughout the experiments and gave low interday (n = 45) variability of 6% and 7%, respectively. Indocyanine green and cyclosporine A inhibited TA uptake with IC50 values of 3.7±1.3 and 4.6±1.2µM, respectively, as determined by fitting a sigmoidal dose-response relationship to the inhibition data (Figs. 2C and 2D).
FIG. 2.

Kinetics of taurocholate (TA) transport in bile salt export pump (BSEP)–overexpressing inverted Sf9 membrane vesicles. A, Linearity of TA transport. The TA transport kinetics was linear up to 15min (squares). At 5-min incubation (used in the BSEP inhibition screen and marked with a red dashed line), the passive uptake determined in AMP incubations (diamonds) was approximately 5% of the active uptake. B, Concentration dependence of TA transport. Michaelis-Menten kinetic parameters for the TA transport were determined by nonlinear regression, resulting in a K m of 17.8±5.0µM and a V max of 286.2±28.2 pmol/mg protein/min. C and D, Inhibition of the ATP-dependent TA transport by the model inhibitors indocyanine green (ICG) and cyclosporine A, respectively. The IC50 (marked with red lines) was determined to be 3.7±1.3 and 4.6±1.2µM, respectively, using nonlinear regression to a sigmoidal dose-response relationship. The interday variability (n = 45) of ICG- and cyclosporine A–mediated inhibition was 6% and 7%. Data are presented as the mean ± SD. Experiments were run in triplicates on at least 2 separate occasions.

Kinetics of taurocholate (TA) transport in bile salt export pump (BSEP)–overexpressing inverted Sf9 membrane vesicles. A, Linearity of TA transport. The TA transport kinetics was linear up to 15min (squares). At 5-min incubation (used in the BSEP inhibition screen and marked with a red dashed line), the passive uptake determined in AMP incubations (diamonds) was approximately 5% of the active uptake. B, Concentration dependence of TA transport. Michaelis-Menten kinetic parameters for the TA transport were determined by nonlinear regression, resulting in a K m of 17.8±5.0µM and a V max of 286.2±28.2 pmol/mg protein/min. C and D, Inhibition of the ATP-dependent TA transport by the model inhibitors indocyanine green (ICG) and cyclosporine A, respectively. The IC50 (marked with red lines) was determined to be 3.7±1.3 and 4.6±1.2µM, respectively, using nonlinear regression to a sigmoidal dose-response relationship. The interday variability (n = 45) of ICG- and cyclosporine A–mediated inhibition was 6% and 7%. Data are presented as the mean ± SD. Experiments were run in triplicates on at least 2 separate occasions.

Inhibition of BSEP Transport in Inverted Membrane Vesicles

Of the 250 compounds screened for inhibition of TA transport, 86 were identified to significantly (p < .05) inhibit BSEP at 50µM (Fig. 3). Thirty-seven of these have, to our knowledge, not been previously reported (Table 2). No transport stimulation was detectable at the statistical significance level used (p < .05). Among the 86 inhibitors, 53 reduced BSEP-mediated TA transport by more than 50% compared with the controls (without inhibitor) and were therefore defined as strong inhibitors (as described in the Materials and Methods section).
FIG. 3.

Inhibition of bile salt export pump (BSEP)-mediated taurocholate (TA) transport in inverted membrane vesicles. The 250 drugs and drug-like compounds were screened at 50µM concentration, identifying 86 compounds that significantly (p < .05) inhibited BSEP transport. Compounds inhibiting the TA transport by more than 50% were denoted as strong inhibitors (n = 53) and those that inhibited less than 50% of the TA transport, but still maintained significant inhibition, were denoted as weak inhibitors (n = 33). The data are presented as the mean ± SE. Experiments were run in triplicates, repeated 1–3 times.

TABLE 2

BSEP-Mediated TA Transport of 250 Test Compounds (50µM) and DILI Classifications

TA Transport (% of control)
BSEP Inhibition Classa Compound (n = 250)AverageSEMSignificanceb DILI (n = 182) Groupc
Chelerythrine −0.12.3**
Tipranavir 0.51.7**BW
Taurolithocholate3.60.2**
MK5713.80.5**
Telmisartan4.00.7**WP
Clotrimazole4.40.5**WP
Indocyanine green 4.70.0**NM
Nefazodone5.90.7**BW
Saquinavir7.00.4**WP
Lopinavir7.22.9**WP
Glyburide7.41.3**AR
Ketoconazole7.61.0**BW
Ritonavir7.91.0**BW
Cyclosporine A8.23.1**WP
Mifepristone 11.31.6**NM
Loratadine 13.21.3**AR
Bromosulfophthalein 13.72.4**
Ergocristine 14.50.8**
Benzbromarone15.00.8**WD
Fusidic acid15.40.9**
Troglitazone15.71.3**WD
Nicardipine16.71.5**AR
Bosentan17.12.9**BW
Reserpine17.41.1**WP
Lovastatin 18.45.1**WP
Felodipine 21.75.4**AR
Bromosulfalein 22.03.1**
Diethylstilbestrol 22.13.3**
GF120918 25.30.6**
Ko143 26.014.2**
Losartan27.23.8**AR
Glimepiride27.41.3**AR
Disulfiram29.54.3**WP
Simvastatin30.20.7**WP
Spironolactone 30.31.8**AR
Atorvastatin31.30.7**WP
Cerivastatin32.72.4**
Isradipine 32.82.8**NM
Hoechst 33342 33.73.5**
Ezetimibe 34.43.8**WP
Dipyridamole 35.02.0**WP
Pitavastatin35.42.9**WP
Fenofibrate37.31.0**WP
Silymarin 37.70.5**
Atazanavir 37.81.2**WP
Repaglinide 38.23.0**AR
Sulfinpyrazone 38.21.4**
Ranolazine 40.73.2**NM
Midazolam42.73.4**NM
Rosiglitazone44.33.7**WP
Nelfinavir45.18.5**AR
Budesonide 48.60.6**NM
Indinavir49.12.6**WP
Celecoxib 54.24.4**WP
Cefaclor 54.32.3**AR
Dehydroisoandrosterone 3-sulfate 55.02.4**
Rifampicin55.710.1**WP
Vinblastine56.24.8**NM
Astemizole57.13.9**
Amiodarone 58.65.6**BW
Tinidazole 59.23.2**AR
Progesterone60.13.5**WP
Pilsicainide 61.94.2**
Nitrofurantoin64.42.6**WP
Imatinib64.61.2**WP
Indomethacin64.92.4**WP
Fluvoxamine 65.94.9**AR
Ofloxacin66.44.7**
Cholate66.52.5**
Glipizide66.74.5**AR
Olmesartan 67.12.5**NM
Atenolol 67.22.1**NM
Efavirenz67.62.8**WP
Terfenadine67.64.2**
Clarithromycin 68.14.4**WP
Glycyrrhizic acid 68.84.0*
Atropine68.813.1*NM
Cholic acid69.44.6*
Nitrendipine69.54.7*
Diclofenac69.70.5*WP
Sulfamethoxazole70.27.7*WP
Naproxen70.76.7*WP
Nifedipine71.16.4*WP
Erythromycin 71.64.5*WP
Morin 72.42.1*
Flucloxacillin72.41.5*
-Thioridazine72.62.9AR
-Vincristine74.72.0NM
-Amlodipine74.94.9WP
-Sulindac75.50.7WP
-Estradiol75.53.8AR
-Doxorubicin75.67.5NM
-Valsartan76.24.9AR
-Thiotepa76.31.3NM
-Dehydroisoandrosterone76.914.2
-Glycylproline77.00.7
-Acetylsalicylic acid77.32.4NM
-Chrysin77.40.3
-Topotecan77.417.0NM
-Flupentixol77.66.7
-N-methylnicotinamide77.75.0
-Buspirone78.41.6AR
-Gemfibrozil78.68.2WP
-Naringin79.06.2
-Berberine79.25.8
-Bumetanide79.38.7AR
-Theophylline79.42.8NM
-Hydrocortisone79.76.0NM
-Testosterone79.93.5WP
-1-Methyl-4- phenylpyridinium80.16.2
-Eletriptan80.24.3AR
-Irinotecan80.46.0AR
-Fexofenadine80.513.8NM
-Coumestrol80.94.5
-Tetraethylammonium81.07.7
-Moclobemide81.25.3
-Azathioprine81.28.4WP
-Mesalazine81.42.0AR
-Ticlopidine81.42.8WP
-4-Methylumbelliferone glucuronide81.76.5
-Nicotine81.89.6NM
-Fluoxetine81.90.0AR
-Cefamandole82.75.3
-Phenacetin82.813.4
-Itraconazole83.017.0WP
-Nevirapine83.00.2BW
-Cholchicine83.110.6AR
-Metformin83.21.5NM
-Sildenafil83.34.3NM
-Dexamethasone83.42.9AR
-Fluconazole83.57.1WP
-Methoxsalen83.91.4NM
-Tamoxifen84.64.3WP
-Verapamil84.89.9WP
-Cephalexin85.04.7AR
-Procyclidine85.16.4NM
-Cimetidine85.30.5AR
-Pravastatin85.47.1WP
-Sparfloxacin85.52.4
-Carbamazepine85.85.2WP
-Fumitremorgin C86.00.6
-Fendiline86.04.0
-Lisinopril86.22.0WP
-Amantadine86.512.6WP
-Dextromethorphan86.64.3NM
-Diazepam86.96.5AR
-Biochanin A87.92.1
-Rosuvastatin87.94.5WP
-Prazosin88.00.8AR
-Loperamide88.12.7NM
- p-Acetamidophenyl glucuronide88.811.0
-Famotidine88.811.1AR
-Genistein88.83.1NM
-Tetracycline88.96.6WP
-Adefovir90.25.5WP
-Propafenone90.67.6AR
-Chloroquine90.66.1AR
-Varenicline90.713.5AR
-Quercetin90.88.7
-Caffeine90.87.8NM
-Naringenin90.99.6
- p-Aminohippuric acid91.24.3
-5-Carboxyfluorescein91.36.0
-Pioglitazone91.44.5WP
-Baicalin91.54.4
-Estrone92.07.5WP
-Chlorzoxazone92.28.4WP
-Phenylethyl isothiocyanate92.23.9
-Gliclazide92.38.6
-Atomoxetine93.02.6WP
-Disopyramide93.13.1AR
-Oxaliplatin93.15.2WP
-Tolbutamide93.27.1AR
-Noscapine93.31.6
-Cefadroxil93.97.0AR
-Isoniazid94.13.4BW
-Dofetilide94.27.5AR
-Digoxin94.59.6NM
-Daidzein94.78.4
-Ibuprofen94.76.7WP
-Antipyrine94.96.0NM
-Enalapril95.33.2AR
-Mephenytoin95.68.0AR
-Ivermectin95.610.0AR
-Ranitidine95.79.3AR
-Hydrochlorothiazide95.86.5AR
-Metoprolol95.90.1AR
-Amoxicillin95.98.8WP
-Haloperidol96.44.7AR
-Pantoprazole96.54.8AR
-Emtricitabine96.76.8AR
-Medroxyprogesterone96.70.7AR
-Amiloride97.08.0AR
-Phenytoin97.95.8WP
-Sulfasalazine98.06.8WP
-Valproic acid98.916.1BW
-Clomipramine99.12.5WP
-Sotalol99.16.7AR
-Coumarin99.22.0
-Metronidazole100.46.6NM
-Warfarin100.75.1AR
-Estradiol-17-β-glucuronide100.74.3
-Prednisolone100.83.6AR
-Etoposide100.83.2AR
-Probenecid101.06.9AR
-Phenobarbital101.23.8WP
-Cetirizine101.93.2NM
-Flutamide102.02.1BW
-Zidovudine102.110.9BW
-Acyclovir102.30.5AR
-Amodiaquine102.67.4
-Quinidine102.80.9AR
-Maprotiline103.66.7AR
-Bupropion103.91.5AR
-Paroxetine104.114.3AR
-Ouabain104.84.6
-Pindolol105.47.6NM
-Bestatin105.66.5
-Trimethoprim105.67.2NM
-Tranylcypromine105.75.5AR
-N-methylpyridinium106.317.4
-Prednisone107.07.3AR
-Mitoxantrone108.510.0AR
-Novobiocine109.012.4
-Valacyclovir109.09.7AR
-5-Carboxyfluoresceindiacetate109.45.6
-Propranolol109.58.7WP
-Nootkatone110.15.8
-Omeprazole110.45.3AR
-Procainamide110.75.6AR
-Diltiazem110.99.6WP
-Amitriptyline111.14.1AR
-Estrone-3-sulfate111.28.8
-Triazolam111.53.2AR
-Furosemide111.611.2AR
-Methotrexate111.610.5BW
-Phenformin111.79.2
-Captopril112.31.4AR
-Lansoprazole112.81.1AR
-Carnitine114.18.3NM
-Sulfaphenazole114.312.4
-Desipramine114.52.4AR
-Paclitaxel117.35.0AR
-Ciprofloxacin117.95.8WP
-Clindamycin120.37.8AR
-Apigenin121.211.8
-Chlorpromazine123.82.4AR
-Chlorprothixene125.515.7
-Quinine126.25.0AR
-Furafylline128.217.2

Inhibitors (n = 37), that to our knowledge, not have been previously published are marked with bold text.

a-/○/● classified as BSEP noninhibitor, weak inhibitor, and inhibitor, respectively.

b—/*/** describe significance with p > .05, .05–.01, and < .01, respectively.

cDILI groups for the 182 drugs according to FDA labeling sections BW, WP, and AR as described and published by DailyMed (http://dailymed.nlm.nih.gov/).

BSEP-Mediated TA Transport of 250 Test Compounds (50µM) and DILI Classifications Inhibitors (n = 37), that to our knowledge, not have been previously published are marked with bold text. a-/○/● classified as BSEP noninhibitor, weak inhibitor, and inhibitor, respectively. b—/*/** describe significance with p > .05, .05–.01, and < .01, respectively. cDILI groups for the 182 drugs according to FDA labeling sections BW, WP, and AR as described and published by DailyMed (http://dailymed.nlm.nih.gov/). Inhibition of bile salt export pump (BSEP)-mediated taurocholate (TA) transport in inverted membrane vesicles. The 250 drugs and drug-like compounds were screened at 50µM concentration, identifying 86 compounds that significantly (p < .05) inhibited BSEP transport. Compounds inhibiting the TA transport by more than 50% were denoted as strong inhibitors (n = 53) and those that inhibited less than 50% of the TA transport, but still maintained significant inhibition, were denoted as weak inhibitors (n = 33). The data are presented as the mean ± SE. Experiments were run in triplicates, repeated 1–3 times. The number of BSEP inhibitors varied in the different therapeutic classes. For example, strong BSEP inhibitors were frequently found among antiviral drugs (7 out of 14 investigated), statins (5 out of 8), and antidiabetic drugs (5 out of 11). In contrast, only fusidic acid, out of the 20 antibacterial compounds studied, was identified to inhibit TA transport by more than 50%. The lower incidence of BSEP inhibitors among antibacterial drugs may, in part, result from the fact that antibacterials tend to have different physicochemical properties than most other drugs (eg, they are larger and more hydrophilic). It may also reflect the considerable structural diversity in this therapeutic class, where many compounds derive from natural products.

Molecular Properties Important for BSEP Inhibition

Common molecular descriptors previously identified to be important for the inhibition of BSEP (Warner ) and other ATP-binding cassette (ABC) transporters (Matsson ; Pedersen ) were different for the inhibitors and noninhibitors. Eight of 10 evaluated molecular descriptors, describing lipophilicity/hydrophobicity, size, ionization state, and charge, showed significant differences between the 53 strong inhibitors and the noninhibitors (p < .01) (Figs. 4A and 4B–K). The weak inhibitors generally had intermediate values in the examined molecular properties, with statistically significant differences to noninhibitors (p < .01) only observed for molecular weight and the surface area of saturated nonpolar atoms (Figs. 4A and 4B–K). This observation suggests that weak inhibitors may not be easily distinguished from noninhibitors in the vesicle assay. To investigate this issue further, we developed 2 OPLS-DA models to describe differences between strong inhibitors and noninhibitors and between all inhibitors (strong and weak) and noninhibitors, respectively (see Supplementary Figures S1 and S2). The best model had a total prediction accuracy of 89% in the test set and correctly classified 84% and 91% of the strong inhibitors and noninhibitors, respectively (Supplementary Figure S1).
FIG. 4.

Molecular properties of the studied compounds. A, Statistical significance of differences between noninhibitors and weak and strong bile salt export pump (BSEP) inhibitors (27%–50% and > 50% inhibition, respectively), for 10 commonly used molecular properties: molecular weight (MW), octanol-water partition coefficient (logP and logD7.4, respectively), the surface areas of polar (PSA), saturated nonpolar (NPSAsaturated) and unsaturated nonpolar atoms (NPSAunsaturated), the number of rotatable bonds, hydrogen bond acceptors and hydrogen bond donors, and the molecular net charge at pH 7.4. Bars over figure parts B to I denote the p values from t tests of strong inhibitors versus noninhibitors and weak inhibitors versus noninhibitors, respectively. B–K, Average values of the 10 selected molecular properties for strong inhibitors (SI), weak inhibitors (WI), and noninhibitors (Non) of BSEP-mediated taurocholate (TA) transport. Data are presented as the mean ± SE. Statistical significance, as determined by 1-way ANOVA and Bonferroni’s post hoc test, is depicted by * for p < .05, ** for p < .01, *** for p < .001, and **** for p < .0001. L, The distribution of negative, positive, uncharged, or zwitterionic net molecular charges at pH 7.4 in the Non, SI, and WI groups.

Molecular properties of the studied compounds. A, Statistical significance of differences between noninhibitors and weak and strong bile salt export pump (BSEP) inhibitors (27%–50% and > 50% inhibition, respectively), for 10 commonly used molecular properties: molecular weight (MW), octanol-water partition coefficient (logP and logD7.4, respectively), the surface areas of polar (PSA), saturated nonpolar (NPSAsaturated) and unsaturated nonpolar atoms (NPSAunsaturated), the number of rotatable bonds, hydrogen bond acceptors and hydrogen bond donors, and the molecular net charge at pH 7.4. Bars over figure parts B to I denote the p values from t tests of strong inhibitors versus noninhibitors and weak inhibitors versus noninhibitors, respectively. B–K, Average values of the 10 selected molecular properties for strong inhibitors (SI), weak inhibitors (WI), and noninhibitors (Non) of BSEP-mediated taurocholate (TA) transport. Data are presented as the mean ± SE. Statistical significance, as determined by 1-way ANOVA and Bonferroni’s post hoc test, is depicted by * for p < .05, ** for p < .01, *** for p < .001, and **** for p < .0001. L, The distribution of negative, positive, uncharged, or zwitterionic net molecular charges at pH 7.4 in the Non, SI, and WI groups. The final models both indicated BSEP inhibition to be positively correlated with lipophilicity, hydrophobicity, and the number of halogen atoms in the molecule, whereas a negative correlation was seen for descriptors of positive charge, hydrophilicity, and hydrogen bond acceptors. Differences between strong and weak inhibitors were also indicated by the models. For instance, strong BSEP inhibitors were suggested to be larger and more flexible than the weak inhibitors; the latter were more similar to the noninhibitors. This is in agreement with the analysis of the differences in individual molecular descriptors (Fig. 4).

DILI Classification of Drugs Included in the Data Set

As described in detail in the Materials and Methods section, the DILI potential of the drugs in the data set was classified on the basis of the information on hepatic ADRs extracted from the FDA drug labels. Briefly, depending on the ADR severity, the FDA drug labels report the ADRs in different sections (BW, WP, or AR, ordered by decreasing severity). Drugs were assigned to classes according to the drug label section reporting a hepatic ADR. If hepatic ADRs were reported in several sections, the drug was assigned to the class representing the most severe drug label section. Drugs were assigned to the NM class if no hepatic ADRs were reported. FDA drug labels were available for 182 of the 250 investigated compounds, enabling their classification according to DILI severity. For 73 of these 182 drugs, hepatic ADRs were only reported in the adverse reaction section of the FDA drug label, and the compound was assigned to the AR class. In the same manner, 61 drugs were classified as WP and 14 as BW. The remaining 34 drugs were classified to have no hepatic adverse reactions (NM) (Table 2). Confirming this classification, keywords that define severe DILI (eg, acute liver failure and liver necrosis) were more often reported in the BW or WP sections than in the AR section (Supplementary Figure S3). By contrast, milder DILI (eg, increased liver aminotransferases and liver steatosis) were more frequently reported in the AR section than in the WP and BW sections (Supplementary Figure S3). This indicates that classifying DILI severity according to the FDA drug label sections was applicable for the purpose of our study.

BSEP Inhibition as a Predictor of DILI

To explore to what extent BSEP inhibition in membrane vesicles predicts DILI, the experimental results were compared with the DILI severity classification. The frequency of drugs with BW-class DILI was significantly higher for strong BSEP inhibitors than for both weak inhibitors and noninhibitors (p < .05, Fig. 5). WP-classified DILI was significantly more frequent among both strong and weak inhibitors compared with the noninhibitors (p < .05 and .01, respectively, Fig. 5). In contrast, 60 of the 121 noninhibitors were included in the AR class, resulting in a significantly higher frequency of AR-classified drugs among noninhibitors compared with inhibitors (p < .01, Fig. 5). The frequency of drugs with no reported hepatic adverse events (NM) was similar for inhibitors and noninhibitors (Fig. 5). In total, 38 out of the 61 drugs (62%) identified as inhibitors of BSEP-mediated transport were reported to increase the risk of the more severe BW- or WP-class DILI, in comparison to 37 out of the 121 (31%) BSEP noninhibitors (Figs. 6A and 6B). The orthogonal analysis showed that 51% of the compounds associated with severe DILI were BSEP inhibitors, compared with 21% BSEP inhibitors among the compounds that result in mild or no DILI (Fig. 6C). Notably, 9 compounds that are associated with severe DILI have not been identified as BSEP inhibitors before (amiodarone, atazanavir, celecoxib, clarithromycin, dipyridamole, erythromycin, ezetimibe, lovastatin, and tipranavir), suggesting that this mechanism can contribute to their observed clinical toxicity.
FIG. 5.

Drug-induced liver injury (DILI) potential of drugs associated with different levels of bile salt export pump (BSEP) inhibition. The Food and Drug Administration drug label sections, boxed warnings (BW), warning and precautions (WP), and adverse reactions (AR), were used to classify DILI potential of the drugs (n = 182) in the data set also screened for BSEP inhibition in membrane vesicles. Drugs were assigned to classes according to the most severe drug label section reporting a hepatic ADR (BW > WP > AR), or to the NM class if no hepatic ADRs were reported. Bars show the fraction of all compounds in the same BSEP inhibition class (strong/weak/noninhibitor) that are associated with DILI of a certain severity. BSEP inhibition was shown to significantly increase the frequencies of hepatic ADRs reported in the BW and WP section. Strong inhibitors are described by dark columns, weak inhibitors by intermediate, and noninhibitors by light columns. Normality tests, using BSEP noninhibitors as control, were used to test the significance of the frequency differences, illustrated by * if p < .05 and ** if p < .01.

FIG. 6.

Correlation between drug-induced liver injury (DILI) severity and bile salt export pump (BSEP) inhibition. A, Classification of the registered drugs in the data set (n = 182) with respect to BSEP inhibition in inverted membrane vesicles and DILI severity. B, Frequency of severe (boxed warnings/warnings and precautions, BW/WP) DILI among BSEP inhibitors and noninhibitors. Severe DILI was twice as common among the BSEP inhibitors as among the noninhibitors in the data set. C, Frequency of BSEP inhibitors among drugs that are associated with severe DILI, compared with drugs with mild or no DILI. Every second (51%) compound that was associated with BW/WP DILI inhibited BSEP-mediated taurocholate (TA) transport, whereas only every fifth (21%) compound associated with mild or no (adverse reactions/not mentioned, AR/NM) DILI decreased the TA transport. D, Selection of representative compounds for sandwich-cultured human hepatocytes (SCHH) experiments. Fifteen model compounds with different BSEP inhibition profiles (inhibitor or noninhibitor) and DILI potential (BW/WP or AR/NM) were selected from the 182 drugs for further investigation in SCHH.

Drug-induced liver injury (DILI) potential of drugs associated with different levels of bile salt export pump (BSEP) inhibition. The Food and Drug Administration drug label sections, boxed warnings (BW), warning and precautions (WP), and adverse reactions (AR), were used to classify DILI potential of the drugs (n = 182) in the data set also screened for BSEP inhibition in membrane vesicles. Drugs were assigned to classes according to the most severe drug label section reporting a hepatic ADR (BW > WP > AR), or to the NM class if no hepatic ADRs were reported. Bars show the fraction of all compounds in the same BSEP inhibition class (strong/weak/noninhibitor) that are associated with DILI of a certain severity. BSEP inhibition was shown to significantly increase the frequencies of hepatic ADRs reported in the BW and WP section. Strong inhibitors are described by dark columns, weak inhibitors by intermediate, and noninhibitors by light columns. Normality tests, using BSEP noninhibitors as control, were used to test the significance of the frequency differences, illustrated by * if p < .05 and ** if p < .01. Correlation between drug-induced liver injury (DILI) severity and bile salt export pump (BSEP) inhibition. A, Classification of the registered drugs in the data set (n = 182) with respect to BSEP inhibition in inverted membrane vesicles and DILI severity. B, Frequency of severe (boxed warnings/warnings and precautions, BW/WP) DILI among BSEP inhibitors and noninhibitors. Severe DILI was twice as common among the BSEP inhibitors as among the noninhibitors in the data set. C, Frequency of BSEP inhibitors among drugs that are associated with severe DILI, compared with drugs with mild or no DILI. Every second (51%) compound that was associated with BW/WP DILI inhibited BSEP-mediated taurocholate (TA) transport, whereas only every fifth (21%) compound associated with mild or no (adverse reactions/not mentioned, AR/NM) DILI decreased the TA transport. D, Selection of representative compounds for sandwich-cultured human hepatocytes (SCHH) experiments. Fifteen model compounds with different BSEP inhibition profiles (inhibitor or noninhibitor) and DILI potential (BW/WP or AR/NM) were selected from the 182 drugs for further investigation in SCHH.

DILI Prediction in SCHH Compared With BSEP Vesicles

Many cellular factors that influence the ability of a compound to inflict DILI cannot be properly assessed in the relatively simple, BSEP-expressing membrane vesicles. We therefore used SCHH to assess the relationship between DILI and TA transport inhibition in more detail (Fig. 7). A subset of 15 model compounds with different effects in the vesicle assay (inhibitors or noninhibitors) and DILI potential (BW/WP or AR/NM) was selected for the SCHH studies, as illustrated in Figure 6D (see “Data sets” in the Materials and Methods section). Untreated SCHH showed stable TA disposition in all 6 batches used with BEI of 72±3%, BIC of 2.9±1.2, and CLBile of 17±3ml/mg/min.
FIG. 7.

The impact on taurocholate (TA) transport in sandwich-cultured human hepatocytes (SCHH) of 15 drugs with different bile salt export pump (BSEP) inhibition and drug-induced liver injury (DILI) potential. Drug impact on TA disposition is shown for each of the 4 combinations of BSEP inhibition (yes or no) in inverted membrane vesicles and DILI classifications obtained from the Food and Drug Administration drug labels (severe or mild/no), as described in Figure 6D: A, BSEP inhibitors associated with severe (boxed warnings/warnings and precautions, BW/WP) DILI; B, BSEP inhibitors associated with mild or no DILI (adverse reactions/not mentioned, AR/NM); C, BSEP noninhibitors associated with BW/WP DILI; and D, BSEP noninhibitors associated with AR/NM DILI. Each panel shows, from left to right, the effect of the compounds on BSEP transport in inverted membrane vesicles (dark columns for inhibitors and light columns for noninhibitors) and on the canalicular efflux of TA transport in SCHH using 3 complementary parameters: biliary excretion index (BEI), bile intracellular correlation (BIC), and in vitro biliary clearance (CLBile), the latter of which describes the effect of the basolateral net TA uptake in addition to the canalicular efflux. Each compound was tested in triplicate experiments at 3 different occasions. Data are presented as the mean ± SE. E, Differences in TA distribution patterns between the different compound groups in (A–D). Statistical significance, as determined by 1-way ANOVA and Bonferroni’s post hoc test, is depicted by ns for p ≥ .05, * for p < .05, ** for p < .01, *** for p < .001, and **** for p < .0001. Pairwise comparisons that are not shown in the figure were nonsignificant (p >> .05). The BSEP inhibitors associated with severe (BW/WP) DILI were found to cause significantly greater changes in the hepatocellular TA distribution than any of the other compound groups.

The impact on taurocholate (TA) transport in sandwich-cultured human hepatocytes (SCHH) of 15 drugs with different bile salt export pump (BSEP) inhibition and drug-induced liver injury (DILI) potential. Drug impact on TA disposition is shown for each of the 4 combinations of BSEP inhibition (yes or no) in inverted membrane vesicles and DILI classifications obtained from the Food and Drug Administration drug labels (severe or mild/no), as described in Figure 6D: A, BSEP inhibitors associated with severe (boxed warnings/warnings and precautions, BW/WP) DILI; B, BSEP inhibitors associated with mild or no DILI (adverse reactions/not mentioned, AR/NM); C, BSEP noninhibitors associated with BW/WP DILI; and D, BSEP noninhibitors associated with AR/NM DILI. Each panel shows, from left to right, the effect of the compounds on BSEP transport in inverted membrane vesicles (dark columns for inhibitors and light columns for noninhibitors) and on the canalicular efflux of TA transport in SCHH using 3 complementary parameters: biliary excretion index (BEI), bile intracellular correlation (BIC), and in vitro biliary clearance (CLBile), the latter of which describes the effect of the basolateral net TA uptake in addition to the canalicular efflux. Each compound was tested in triplicate experiments at 3 different occasions. Data are presented as the mean ± SE. E, Differences in TA distribution patterns between the different compound groups in (A–D). Statistical significance, as determined by 1-way ANOVA and Bonferroni’s post hoc test, is depicted by ns for p ≥ .05, * for p < .05, ** for p < .01, *** for p < .001, and **** for p < .0001. Pairwise comparisons that are not shown in the figure were nonsignificant (p >> .05). The BSEP inhibitors associated with severe (BW/WP) DILI were found to cause significantly greater changes in the hepatocellular TA distribution than any of the other compound groups. In good agreement with the vesicle data, the 4 BSEP inhibitors reported to give BW- or WP-classed DILI (cyclosporine A, ritonavir, rosiglitazone, and troglitazone), significantly decreased the bile accumulation of TA compared with the untreated controls (p < 2×10−5; Table 3 and Fig. 7A). These compounds all decreased TA accumulation in bile to a much greater extent than the decrease in the intracellular compartment, which indicates that the main effect of the compounds was their inhibition of the canalicular efflux. The observation that their intracellular accumulation also decreased, although more modestly, indicates that the compounds also decreased the basolateral net uptake of TA. Notably, rosiglitazone and ritonavir had similar effects in the SCHH assay, whereas markedly different levels of BSEP inhibition were observed in the vesicles (8% and 44% activity remaining, respectively; Fig. 7A).
TABLE 3

Accumulation of TA in SCHH Treated With Compounds With Different Effects in the Vesicle Assay (Inhibitors or Noninhibitors) and DILI Potential (BW/WP or AR/NM)

TOTALAcc c (% of control)ICAcc d (% of control)BILEAcc e (% of control)
DILIa BSEP Inhibitionb AverageSEMAverageSEMAverageSEM
BW/WPYesCyclosporine A16.60.745.31.94.52.6
BW/WPYesRitonavir27.32.170.71.616.09.2
BW/WPYesRosiglitazone21.03.054.53.714.68.5
BW/WPYesTroglitazone14.00.630.41.98.90.7
AR/NMYesMifepristone78.97.7132.911.161.07.9
AR/NMYesIsradipine57.24.774.46.651.56.2
AR/NMYesBudesonide78.07.672.94.679.69.2
AR/NMYesGlyburide54.11.172.35.646.73.7
BW/WPNoValproic acid89.16.0101.410.181.39.8
BW/WPNoFlutamide100.25.9106.68.596.19.5
BW/WPNoZidovudine98.04.7104.216.996.016.2
AR/NMNoOmeprazole86.11.692.47.183.66.6
AR/NMNoCimetidine81.51.791.86.077.55.3
AR/NMNoHaloperidol102.37.5113.37.798.09.8
AR/NMNoChlorpromazine99.15.3104.310.195.410.6

aDILI groups according to FDA labeling sections BW, WP, and AR as described and published by DailyMed (http://dailymed.nlm.nih.gov/).

bBSEP inhibition—Yes: strong BSEP inhibitors and No: compounds without significant effect on BSEP transport.

cTOTALAcc, total accumulation (intracellular and bile) of TA determined in incubations with standard HBSS.

dICAcc, intracellular accumulation of TA determined in incubations with Ca2+- and Mg2+-free HBSS.

eBILEAcc, calculated from the total and intracellular accumulations (TOTALAcc − ICAcc = BILEAcc).

Accumulation of TA in SCHH Treated With Compounds With Different Effects in the Vesicle Assay (Inhibitors or Noninhibitors) and DILI Potential (BW/WP or AR/NM) aDILI groups according to FDA labeling sections BW, WP, and AR as described and published by DailyMed (http://dailymed.nlm.nih.gov/). bBSEP inhibition—Yes: strong BSEP inhibitors and No: compounds without significant effect on BSEP transport. cTOTALAcc, total accumulation (intracellular and bile) of TA determined in incubations with standard HBSS. dICAcc, intracellular accumulation of TA determined in incubations with Ca2+- and Mg2+-free HBSS. eBILEAcc, calculated from the total and intracellular accumulations (TOTALAcc − ICAcc = BILEAcc). In comparison, the 4 BSEP inhibitors with mild or no reported DILI (mifepristone, isradipine, budesonide, and glyburide) displayed significantly lower influence on the TA canalicular efflux in SCHH (Table 3 and Fig. 7B), despite showing similar degrees of BSEP inhibition in the vesicular assay (Table 3 and Figs. 7A and 7B). Within this group of compounds, the results also differed between the SCHH and the vesicular assays; glyburide and isradipine showed similarly modest effects on the canalicular efflux in SCHH, whereas the vesicular assay indicated mifepristone to be a more potent BSEP inhibitor (Fig. 7B). In the same group of compounds, budesonide resulted in comparable decreases in both intracellular and bile accumulation, suggesting that budesonide only inhibited the basolateral uptake of TA in SCHH without influencing the canalicular efflux. Regardless of their DILI severity classification, the 7 compounds that lacked inhibitory effect on BSEP-mediated TA transport in the membrane vesicles also lacked inhibitory effects in SCHH (Table 3 and Figs. 7C and 7D). Notably, the group of BSEP inhibitors associated with severe (BW or WP) DILI (Fig. 7A) had significantly greater impact on the biliary TA excretion than any of the other groups investigated (p < .0001; Fig. 7E). These results thus suggest that SCHH is a suitable in vitro model to differentiate BSEP inhibitors that may result in relatively mild DILI from those that carry the risks of more severe DILI.

DISCUSSION

Several drugs reported to cause DILI have been identified as BSEP inhibitors (Kis ; Morgan ; Stieger ) and, in a recent publication based on 85 compounds, the incidence of DILI was found to be higher among BSEP inhibitors than among noninhibitors (Dawson ). In the present investigation, BSEP inhibition in inverted membrane vesicles was correlated to DILI in human subjects, using a larger, structurally diverse series of compounds, without selection bias toward DILI-associated compounds. We investigated the role that BSEP inhibition may play in DILI and analyzed to what extent BSEP inhibition in vesicles is a predictor of DILI. In general, the results confirm the conclusions from previous investigations (Dawson ; Morgan ) with regard to the utility of BSEP-inverted membrane vesicles as a screening tool to DILI-risk evaluation within drug discovery. However, we also found that the vesicle assay results in a significant number of false positives, ie, BSEP inhibitors that do not appear to increase the risk of severe DILI in humans. This finding prompted us to explore whether SCHH (Hewitt ; Nakakariya ; Smith ) were better suited for identification of BSEP inhibitors causing DILI. Although a limited series of 15 compounds were studied in the SCHH, we propose that the SCHH assay is more effective than the vesicular assay in distinguishing compounds that may cause severe DILI due to BSEP inhibition from those that are less likely to do so. Additional preliminary results from 17 compounds studied in SCHH support these findings and confirm the capacity of SCHH to discriminate BSEP inhibitors associated with severe DILI from those less likely to induce DILI (data not shown). The major molecular properties related to BSEP inhibition were charge, lipophilicity, hydrophobicity, and size. Similar observations have previously been reported for the inhibition of BSEP (Warner ) and other ABC transporters (Matsson ; Pedersen ), suggesting that the molecular interactions may be similar, and also that inhibition of additional canalicular transporters is likely for compounds that inhibit BSEP. The strong inhibitors (ie, those that decreased TA transport by more than 50%) were found to differ from noninhibitors in 8 of 10 common molecular properties, whereas weaker (yet statistically significant) inhibitors were indistinguishable from noninhibitors in all properties except molecular weight and the surface area of saturated nonpolar atoms. These results support the use of the 50% inhibition cutoff for separation of BSEP inhibitors from noninhibitors in the OPLS-DA models. Transported BSEP substrates are preferably monovalent, negatively charged bile acids. Of the few nonbile acid substrates identified to date, all carry a negative net charge at physiological pH (Hirano ; Matsushima ). This is in agreement with our results on BSEP inhibition, where positive charge was strongly associated with a lack of inhibition (Supplementary Figure S1). However, unlike substrate interactions with BSEP, which are clearly disfavored by the lack of a negative charge (Gerloff ), the majority of the BSEP inhibitors (58%) were unionized (Fig. 4L). This highlights an important difference in inhibitor and substrate molecular interactions with BSEP. It should be noted that our data set was selected for structural diversity and can be regarded as a snapshot of the chemical space of marketed drugs. The compound selection was performed before, and hence not biased by, the DILI analysis and the overall incidence of BW (8%) was comparable with the 10% BW incidence among all approved drugs between 1975 and 1999 (Lasser ). In contrast, the 85 compounds studied by Dawson were selected on the basis of their liver-related ADRs and therefore their data set had a higher BW incidence (21%). The differences in data set selection explain the differences in ADR frequencies—including those for BW DILI—for the 2 data sets. It may also explain why we observed a relationship between BSEP inhibition and DILI severity, which the investigation by Dawson et al. did not. Our investigation of the association between BSEP inhibition and DILI found that the majority (62%) of the BSEP inhibitors increased the risk of more severe (BW and WP) DILI (Fig. 6B), and a significant proportion (18%) were associated with potentially life-threatening, BW-classified DILI (Fig. 5). Interestingly, only the strong inhibitors increased the risk of BW-classified DILI, whereas the weaker inhibitors only increased the risk of intermediate severity (WP) DILI (Fig. 5). This is in agreement with the observed differences in molecular properties between the strong and weak inhibitors. The association of strong and weak inhibitors with BW and/or WP DILI supports our assay design and shows that the vesicle assay can be used for preliminary classification of the severity of DILI associated with BSEP inhibition. SCHH were used to further assess how BSEP inhibition correlates with DILI. To enable a mechanistic interpretation of how the hepatocellular TA disposition was affected by the added compounds, we monitored the accumulation of TA in both the intracellular and bile compartments, separately as well as in combination. We also analyzed 3 derived parameters (CLBile, BEI, and BIC) that describe complementary aspects of the cellular TA disposition. CLBile describes the rate of transport across the hepatocyte from the media compartment to the bile canaliculi (equation 5). Therefore, CLBile decreases if a test compound inhibits the basolateral net uptake or the canalicular efflux. BEI describes the accumulation of TA in relation to the total accumulation (ie, the sum of the intracellular and bile accumulation; equation 3) and will decrease if a test compound inhibits the canalicular efflux. By definition, the BEI parameter includes the bile accumulation in both the numerator and denominator, and a decrease in BEI will thus not be directly proportional to a decrease in canalicular efflux caused by an added transporter inhibitor (Supplementary Table S3). As a complement to CLBile and BEI in investigations of canalicular efflux inhibition, we therefore introduced a third, easily calculated parameter—BIC—to facilitate the interpretation of SCHH data. BIC describes the canalicular efflux in relation to the intracellular accumulation (equation 4) and will, similar to BEI, decrease if a test compound inhibits the canalicular efflux. Because BIC is calculated using the accumulation in the intracellular and bile compartments (ie, the 2 compartments that are separated only by the canalicular membrane), any decreases in BIC will be directly proportional to decreases in the canalicular efflux (Supplementary Table S3). In this respect, the BIC parameter is similar to the CLBile,int parameter that was recently shown to significantly improve predictions of human in vivo biliary clearance (Nakakariya ). CLBile,int is analogous to CLBile but uses the intracellular concentration instead of that in the media. When combined, these parameters can be used to separate effects on transport processes in the basolateral membrane from those in the canalicular membrane. For instance, if a compound inhibits the basolateral net uptake (eg, Sodium-taurocholate cotransporting polypeptide [NTCP] inhibition) but not the canalicular efflux, CLBile decreases, whereas BIC remains unchanged (Supplementary Table S3). Our studies on TA transport and accumulation in SCHH supported and extended the observations obtained in the membrane vesicles. As expected from the vesicle results, the 3 BSEP inhibitors associated with severe DILI (BW or WP) resulted in major decreases in the canalicular efflux of TA in SCHH (Fig. 7A). Notably, this group of compounds had a significantly greater impact on the biliary TA excretion than any of the other groups investigated (p < .0001). In contrast, despite showing similar degrees of inhibition in the vesicle assay, the BSEP inhibitors with less severe or no reported DILIs (AR or NM) only marginally affected the canalicular TA efflux in SCHH (Fig. 7B). These results thus support the utility of SCHH in separating BSEP inhibitors associated with severe DILI from those with no or mild DILI. Importantly, compounds that inhibit BSEP but which are not reported to cause severe DILI (Fig. 7B) still resulted in modest alterations of the canalicular efflux. Such compounds may contribute to an increased ADR incidence, if coadministered with other drugs. Caution is thus warranted, although further analyses are needed to fully explore such combination effects. None of the BSEP noninhibitors (Figs. 7C and 7D) affected the TA disposition in SCHH. The increased risk of severe DILI with valproic acid, flutamide, and zidovudine must therefore derive from mechanisms other than BSEP inhibition. Valproic acid is one of the drugs most frequently implicated in acute liver failure (Bjornsson and Olsson, 2006). Its toxicity mechanisms include an increased formation of reactive oxygen species, the inhibition of the mitochondrial membrane potential, and an increased leakiness of lysosomal membranes (Pourahmad ; Tong ). Reactive metabolites have been implicated in the hepatotoxicity of flutamide, resulting in the formation of intracellular protein adducts and depletion of hepatic glutathione (Ohbuchi ). The mechanism by which zidovudine causes hepatotoxicity is not yet determined, but the compound has been associated with mitochondrial toxicity (Lynx ). The diversity of cellular mechanisms that can result in clinical DILI clearly demonstrates that multiple endpoints must be monitored to fully predict the risk of DILI for new drugs (Opar, 2012); the results here show that inhibition of BSEP is one valuable piece of such a panel of toxicity measurements. In conclusion, the present study showed that BSEP inhibition doubles the risk of severe DILI and identified half of the drugs reported to inflict severe DILI as BSEP inhibitors. This demonstrates the importance of BSEP inhibition determination in early drug discovery. We show that BSEP-expressing inverted membrane vesicles are suitable as a primary screening assay to evaluate the risk of liver injury associated with BSEP inhibition. However, it results in many false positives and therefore needs to be complemented with a physiologically more relevant method such as the SCHH. To facilitate the interpretation of such SCHH experiments, we introduced BIC as a parameter to describe canalicular efflux in relation to the intracellular substrate concentration. When used in combination with traditional parameters like CLBile and BEI, BIC can improve the mechanistic understanding of compound transport through the hepatocyte. Finally, we showed that an SCHH assay can be used to differentiate BSEP inhibitors associated with severe DILI from those less associated with DILI, thereby greatly improving the prediction of BSEP-associated DILI.

SUPPLEMENTARY DATA

Supplementary data are available online at http://toxsci.oxfordjournals.org/.

FUNDING

Swedish Research Council (521-2009-4085, 521-2009-2651); Knut and Alice Wallenberg Foundation; Swedish Foundation for Strategic Research; Swedish Fund for Research without Animal Experiments; Swedish Animal Welfare Agency.
  39 in total

1.  Timing of new black box warnings and withdrawals for prescription medications.

Authors:  Karen E Lasser; Paul D Allen; Steffie J Woolhandler; David U Himmelstein; Sidney M Wolfe; David H Bor
Journal:  JAMA       Date:  2002-05-01       Impact factor: 56.272

Review 2.  Drugs and the liver.

Authors:  Mohammed Rashid; Robert Goldin; Mark Wright
Journal:  Hosp Med       Date:  2004-08

3.  Suspected drug-induced liver fatalities reported to the WHO database.

Authors:  E Björnsson; R Olsson
Journal:  Dig Liver Dis       Date:  2005-07-28       Impact factor: 4.088

4.  Clinical and biochemical findings in progressive familial intrahepatic cholestasis.

Authors:  P F Whitington; D K Freese; E M Alonso; S J Schwarzenberg; H L Sharp
Journal:  J Pediatr Gastroenterol Nutr       Date:  1994-02       Impact factor: 2.839

5.  Bile salt export pump (BSEP/ABCB11) can transport a nonbile acid substrate, pravastatin.

Authors:  Masaru Hirano; Kazuya Maeda; Hisamitsu Hayashi; Hiroyuki Kusuhara; Yuichi Sugiyama
Journal:  J Pharmacol Exp Ther       Date:  2005-05-18       Impact factor: 4.030

6.  Biliary excretion in primary rat hepatocytes cultured in a collagen-sandwich configuration.

Authors:  X Liu; E L LeCluyse; K R Brouwer; L S Gan; J J Lemasters; B Stieger; P J Meier; K L Brouwer
Journal:  Am J Physiol       Date:  1999-07

7.  The sister of P-glycoprotein represents the canalicular bile salt export pump of mammalian liver.

Authors:  T Gerloff; B Stieger; B Hagenbuch; J Madon; L Landmann; J Roth; A F Hofmann; P J Meier
Journal:  J Biol Chem       Date:  1998-04-17       Impact factor: 5.157

Review 8.  Progressive intrahepatic cholestasis: mechanisms, diagnosis and therapy.

Authors:  Benjamin L Shneider
Journal:  Pediatr Transplant       Date:  2004-12

9.  Real-time reverse transcription-PCR expression profiling of the complete human ATP-binding cassette transporter superfamily in various tissues.

Authors:  Thomas Langmann; Richard Mauerer; Alexandra Zahn; Christoph Moehle; Mario Probst; Wolfgang Stremmel; Gerd Schmitz
Journal:  Clin Chem       Date:  2003-02       Impact factor: 8.327

10.  Benign recurrent intrahepatic cholestasis type 2 is caused by mutations in ABCB11.

Authors:  Saskia W C van Mil; Wendy L van der Woerd; Gerda van der Brugge; Ekkehard Sturm; Peter L M Jansen; Laura N Bull; Inge E T van den Berg; Ruud Berger; Roderick H J Houwen; Leo W J Klomp
Journal:  Gastroenterology       Date:  2004-08       Impact factor: 22.682

View more
  35 in total

1.  Evaluation of DILI Predictive Hypotheses in Early Drug Development.

Authors:  Rosa Chan; Leslie Z Benet
Journal:  Chem Res Toxicol       Date:  2017-03-15       Impact factor: 3.739

2.  Measures of BSEP Inhibition In Vitro Are Not Useful Predictors of DILI.

Authors:  Rosa Chan; Leslie Z Benet
Journal:  Toxicol Sci       Date:  2018-04-01       Impact factor: 4.849

3.  Molecular Mechanism of Taurocholate Transport by the Bile Salt Export Pump, an ABC Transporter Associated with Intrahepatic Cholestasis.

Authors:  Muhammad Imran Sohail; Diethart Schmid; Katrin Wlcek; Matthias Spork; Gergely Szakács; Michael Trauner; Thomas Stockner; Peter Chiba
Journal:  Mol Pharmacol       Date:  2017-08-07       Impact factor: 4.436

Review 4.  Managing the challenge of drug-induced liver injury: a roadmap for the development and deployment of preclinical predictive models.

Authors:  Richard J Weaver; Eric A Blomme; Amy E Chadwick; Ian M Copple; Helga H J Gerets; Christopher E Goldring; Andre Guillouzo; Philip G Hewitt; Magnus Ingelman-Sundberg; Klaus Gjervig Jensen; Satu Juhila; Ursula Klingmüller; Gilles Labbe; Michael J Liguori; Cerys A Lovatt; Paul Morgan; Dean J Naisbitt; Raymond H H Pieters; Jan Snoeys; Bob van de Water; Dominic P Williams; B Kevin Park
Journal:  Nat Rev Drug Discov       Date:  2019-11-20       Impact factor: 84.694

Review 5.  Molecular Modeling of Drug-Transporter Interactions-An International Transporter Consortium Perspective.

Authors:  Avner Schlessinger; Matthew A Welch; Herman van Vlijmen; Ken Korzekwa; Peter W Swaan; Pär Matsson
Journal:  Clin Pharmacol Ther       Date:  2018-08-30       Impact factor: 6.875

Review 6.  Sandwich-Cultured Hepatocytes as a Tool to Study Drug Disposition and Drug-Induced Liver Injury.

Authors:  Kyunghee Yang; Cen Guo; Jeffrey L Woodhead; Robert L St Claire; Paul B Watkins; Scott Q Siler; Brett A Howell; Kim L R Brouwer
Journal:  J Pharm Sci       Date:  2016-02       Impact factor: 3.534

7.  Evaluation of the Relevance of DILI Predictive Hypotheses in Early Drug Development: Review of In Vitro Methodologies vs BDDCS Classification.

Authors:  Rosa Chan; Leslie Z Benet
Journal:  Toxicol Res (Camb)       Date:  2018-04-18       Impact factor: 3.524

8.  Toward predicting drug-induced liver injury: parallel computational approaches to identify multidrug resistance protein 4 and bile salt export pump inhibitors.

Authors:  Matthew A Welch; Kathleen Köck; Thomas J Urban; Kim L R Brouwer; Peter W Swaan
Journal:  Drug Metab Dispos       Date:  2015-03-03       Impact factor: 3.922

Review 9.  SLC transporters as therapeutic targets: emerging opportunities.

Authors:  Lawrence Lin; Sook Wah Yee; Richard B Kim; Kathleen M Giacomini
Journal:  Nat Rev Drug Discov       Date:  2015-06-26       Impact factor: 84.694

10.  Effect of a Common Genetic Variant (p.V444A) in the Bile Salt Export Pump on the Inhibition of Bile Acid Transport by Cholestatic Medications.

Authors:  Izna Ali; Seher Khalid; Bruno Stieger; Kim L R Brouwer
Journal:  Mol Pharm       Date:  2019-01-25       Impact factor: 4.939

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.