Literature DB >> 30890943

Antimicrobial Medicines Consumption in Eastern Europeand Central Asia - An Updated Cross-National Study and Assessment of QuantitativeMetrics for Policy Action.

Jane Robertson1,2, Kotoji Iwamoto1, Iris Hoxha3, Lilit Ghazaryan4, Vafa Abilova5, Ana Cvijanovic6, Halina Pyshnik7, Marina Darakhvelidze8, Larissa Makalkina9, Arianit Jakupi10, Aigul Dzhakubekova11, Angela Carp12, Lidija Cizmovic13, Svetlana Rachina14, Vesela Radonjic15,16, Salomudin Yusufi17, Mesil Aksoy18, Muhabbat Ibragimova19, Brian Godman20,21,22,23, Hans Kluge1, Hanne Bak Pedersen1.   

Abstract

Introduction: Surveillance of antimicrobial medicines consumption is central to improving their use and reducing resistance rates. There are few published data on antibiotic consumption in Eastern Europe and Central Asia. To address this, 18 non-European Union (EU) countries and territories contribute to the WHO Regional Office for Europe (WHO Europe) Antimicrobial Medicines Consumption (AMC) Network.
Objectives: (i) Analyze 2015 consumption of J01 class antibacterials for systemic use from 16 AMC Network members; (ii) compare results with 2011 data and 2015 ESAC-Net estimates; (iii) assess consumption against suggested indicators; (iv) evaluate the impact of planned changes to defined daily doses (DDDs) in 2019 for some commonly used antibiotics; and (v) consider the utility of quantitative metrics of consumption for policy action.
Methods: Analysis methods are similar to ESAC-Net for EU countries. The Anatomical Therapeutic Chemical (ATC) classification and DDD methodology were used to calculate total consumption (DDD/1000 inhabitants/day [DID]), relative use measures (percentages), extent of use of WHO Watch and Reserve group antibiotics and impact of DDD changes. Findings: Total J01 consumption in 2015 ranged 8.0-41.5 DID (mean 21.2 DID), generally lower than in 2011 (6.4-42.3 DID, mean 23.6 DID). Beta-lactam penicillins, cephalosporins, and quinolones represented 16.2-56.6, 9.4-28.8, and 7.5-24.6% of total J01 consumption, respectively. Third-generation cephalosporins comprised up to 90% of total cephalosporin consumption in some countries. Consumption of WHO Reserve antibiotics was very low; Watch antibiotics comprised 17.3-49.5% of total consumption (mean 30.9%). Variability was similar to 2015 ESAC-Net data (11.7-38.3 DID; mean 22.6 DID). DDD changes in 2019 impact both total and relative consumption estimates: total DIDs reduced on average by 12.0% (7.3-35.5 DID), mostly due to reduced total DDDs for commonly used penicillins; impact on rankings and relative use estimates were modest. Discussion: Quantitative metrics of antibiotic consumption have value. Improvements over time reflect national activities, however, changes in total volumes may conceal shifts to less desirable choices. Relative use measures targeting antibiotics of concern may be more informative. Some, including WHO Watch and Reserve classifications, lend themselves to prescribing targets supported by guidelines and treatment protocols.

Entities:  

Keywords:  Central Asia; Eastern Europe; antibiotic utilization; antimicrobial medicines consumption; cross-national comparative study; national surveillance networks; quality indicators

Year:  2019        PMID: 30890943      PMCID: PMC6411709          DOI: 10.3389/fphar.2018.01156

Source DB:  PubMed          Journal:  Front Pharmacol        ISSN: 1663-9812            Impact factor:   5.810


Introduction

The rise in antimicrobial resistance (AMR) is a growing public health concern impacting on morbidity, mortality and costs, calling for urgent action as local problems with resistance become a global threat (Gandra et al., 2014; Michael et al., 2014; Taylor et al., 2014; O’Neill, 2015; Prestinaci et al., 2015; Jinks et al., 2016; United Nations, 2016; Jakovljevic et al., 2018). Strengthening the evidence base through surveillance of AMR and antimicrobial medicines consumption, and optimizing antimicrobial medicines use in human and animal health, are two of the five objectives of the Global Action Plan (GAP) to reduce AMR (World Health Organization, 2015). To implement the GAP, the World Health Assembly in 2015 urged Member States to develop national action plans on AMR that aligned with the objectives of the GAP (World Health Organization, 2016). Routine data collection on antimicrobial consumption in Europe predated the GAP, with reference data on antimicrobial medicines consumption from European Union (EU) member countries along with Norway and Iceland available from 1997 (European Centre for Disease Prevention and Control [ECDC], 2018). The European Surveillance of Antimicrobial Consumption (ESAC) Network (ESAC-Net) utilizes standardized methods to collect and analyze antimicrobial consumption data for both the community and the hospital sector [European Centre for Disease Control (ECDC), 2018]. Since 2011, similar methods have been used in the WHO Regional Office for Europe (WHO Europe) Antimicrobial Medicines Consumption (AMC) Network to estimate antimicrobial medicines consumption in 18 non-EU countries and territories of the WHO European region. As with ESAC-Net, data collection is based on the WHO Anatomical Therapeutic Chemical (ATC) classification system and defined daily doses (DDDs) methodology (WHO Collaborating Centre for Drug Statistics Methodology, 2018a,b). This work supplements local studies on patterns of antimicrobial consumption (Stratchounski et al., 2001; Malo et al., 2014; Smiljanic et al., 2016). 2011 data from selected countries of the WHO Europe AMC Network were published in 2014 and an analysis of AMC data for 2011–2014 published in 2017 (Versporten et al., 2014; World Health Organization Regional Office for Europe, 2017a). Both analyses reported total consumption of J01 antibacterials for systemic use (DDD per 1000 inhabitants per day [DID]), and the relative use of different pharmacological subgroups including tetracyclines, penicillins, cephalosporins, aminoglycosides, macrolides, and quinolones. These analyses also reported the relative consumption of agents recommended as second-line treatment choices including cephalosporins (particularly third- and fourth-generation agents) and quinolones on the basis that these metrics might focus attention on areas where antibiotic use could be improved. Despite some differences in data sources used and differences in levels of expenditure on medicines between Western and Eastern Europe (Jakovljevic et al., 2016), comparisons between ESAC-Net and AMC data were presented, giving a pan-European perspective on antibiotic consumption (Versporten et al., 2014; World Health Organization Regional Office for Europe, 2017a). Since then, a new classification of antibiotics introduced by WHO and some significant changes to DDD values that will take effect in 2019 have increased the range of metrics that might be reported and will affect the interpretation of some existing measures of antibiotic consumption. In addition, a number of members of the AMC Network have reviewed their antibiotic utilization patterns alongside ongoing policies to improve utilization to provide guidance for the future (Abilova et al., 2018; Bojanic et al., 2018), building on activities among European countries (Adriaenssens et al., 2011; Malo et al., 2014; Smith et al., 2014; Furst et al., 2015). There have also been activities among AMC Network countries and areas to improve the knowledge and activities of community pharmacists regarding the treatment of infections in ambulatory care as pharmacists are often the first point of contact for patients (Markovic-Pekovic et al., 2017; Hoxha et al., 2018). This builds on proposed WHO activities among pharmacists in Europe (World Health Organization Regional Office for Europe, 2014). In April 2017, the Expert Committee on the Selection and Use of Essential Medicines recommended changes to the WHO Model Lists of Essential Medicines for adults (EML) and children (EMLc), following a comprehensive review of sections 6.2.1 (Beta-lactam medicines) and 6.2.2 (Other antibacterials) (World Health Organization, 2017c). After reviewing up-to-date evidence summaries on the treatment of 21 priority infectious conditions (based on disease burden, severity of illness and prospects for improving antibiotic use), five pediatric infectious syndromes and several sexually transmitted infections (World Health Organization, 2017a), the Committee identified empirical first- and second-choice treatments for common, community-acquired infections, focusing on treatment choices broadly applicable in most countries (Sharland et al., 2018). The Expert Committee also proposed a categorization of antibiotics into Access, Watch, and Reserve groups (Boxes 1, 2), taking account of recommendations of WHO and OIE (World Organisation for Animal Health) for the management of antibacterials that are critically important for both human and animal health (World Organisation for Animal Health, 2015; World Health Organization, 2017b). Not all medicines on the Model Lists were assigned to the three groups, leaving a fourth “ungrouped” category, with the classification to be revised as additional clinical syndromes are reviewed (Sharland et al., 2018). However, this classification could support antimicrobial stewardship efforts and focus attention on prescribing practices that should be further reviewed.
Box 1

WHO categories of antibiotics – descriptions.

GroupDefinition
Access groupFirst- and second-choice antibiotics that should be widely available in all countries. They should be affordable and quality assured.
Watch groupFirst- and second-choice antibiotics that only should be used for a specific, limited number of indications due to higher resistance potential.
Reserve groupLast resort antibiotics that should be used only when other antibiotics have failed or for infections of multi-resistant bacteria.
Box 2

Medicines assigned to WHO access, watch, and reserve groups.

Access group

MedicineATC code#MedicineATC code#
Beta-lactam medicinesOther antibacterials
AmoxicillinJ01CA04AmikacinJ01GB06
Amoxicillin + clavulanic acidJ01CR02Azithromycin
AmpicillinJ01CA01ChloramphenicolJ01BA01
Benzathine benzylpenicillinJ01CE08Ciprofloxacin
BenzylpenicillinJ01CE01Clarithromycin
CefalexinJ01DB01ClindamycinJ01FF01
CefazolinJ01DB04DoxycyclineJ01AA02
CefiximeGentamicinJ01GB03
CefotaximeMetronidazoleJ01XD01, P01AB01
CeftriaxoneNitrofurantoinJ01XE01
CloxacillinJ01CF02SpectinomycinJ01XX04
PhenoxymethylpenicillinJ01CE02Sulfamethoxazole + trimethoprimJ01EE01
Piperacillin + tazobactamVancomycin (oral and parenteral)
Procaine benzylpenicillinJ01CE09

Watch group

MedicineATC code

Quinolones and fluoroquinolones e.g., ciprofloxacin, levofloxacin, moxifloxacin, norfloxacinJ01MA, J01MB
Third-generation cephalosporins (with or without beta-lactamase inhibitor) e.g., cefixime, ceftriaxone, cefotaxime, ceftazidimeJ01DD
Macrolides e.g., azithromycin, clarithromycin, erythromycinJ01FA
Glycopeptides e.g., teicoplanin, vancomycinJ01XA, A07AA09
Antipseudomonal penicillins with beta-lactamase inhibitor e.g., piperacillin + tazobactamJ01CR03, J01CR05
Carbapenems e.g., meropenem, imipenem + cilastatinJ01DH
Penems e.g., faropenemJ01DI03

Reserve group

MedicineATC code

AztreonamJ01DF01
Fourth-generation cephalosporins e.g., cefepimeJ01DE
Fifth-generation cephalosporins e.g., ceftarolineJ01DI02, J01DI01, J01DI54
Fosfomycin IVJ01XX01 (Only parenteral)
Oxazolidinone e.g., linezolidJ01XX08, J01XX11
Polymyxins e.g., polymyxin B, colistinJ01XB, A07AA10, A07AA05
TigecyclineJ01AA12
DaptomycinJ01XX09
WHO categories of antibiotics – descriptions. Medicines assigned to WHO access, watch, and reserve groups. Following an application from the European Centre for Disease Control (ECDC), in October 2017 the WHO International Working Group for Drug Statistics Methodology recommended changes to the DDDs for seven commonly used antibiotics (mainly penicillins), and endorsed new DDDs for oral colistin along with changes for a number of other products (Box 3) (WHO Collaborating Centre for Drug Statistics Methodology, 2018c). The changes were requested given evidence that current DDD allocations for commonly used medicines differed substantially from recommended doses and doses used in clinical practice. The DDD changes will be fully adopted in 2019 and will affect estimates of total antibiotic medicines consumption, relative use of classes of antibiotics and interpretation of national and cross-national comparisons over time.
Box 3

2019 changes to DDDs for commonly prescribed J01 antibacterials.

ATC codeMedicineCurrent DDDNew DDD
J01CA04Amoxicillin1 g O1.5g O
J01CA04Amoxicillin1 g P3g P
J01CR02Amoxicillin and beta-1 g O1.5g O
lactamase inhibitor
J01CA01Ampicillin2 g P6g P
J01DE01Cefepime2 g P4g P
J01DH02Meropenem2 g P3g P
J01MA02Ciprofloxacin0.5 g P0.8g P
J01XB01Colistin3 MU P9 MU P
2019 changes to DDDs for commonly prescribed J01 antibacterials. This study presents updated data from the WHO Europe AMC Network using cross-national comparisons of 2015 antibiotic consumption data for 16 network members where the Ministry of Health approved data sharing and publication. Consumption estimates for 2011 and 2015 are compared; the WHO “Watch” and “Reserve” classification of antibiotics is applied, and the impact of proposed changes to DDDs in 2019 are examined. In addition, we consider the information value of different quantitative metrics to policymakers, consumers, and health care professionals to provide future guidance.

Materials and Methods

Participating Countries and Areas

Sharing of the 2015 data was approved for 16 of 18 AMC Network members – Albania, Armenia, Azerbaijan, Bosnia and Herzegovina, Belarus, Georgia, Kazakhstan, Kyrgyzstan, Republic of Moldova, Montenegro, Russian Federation, Serbia, Tajikistan, Turkey, Uzbekistan, and Kosovo [in accordance with Security Council resolution 1244 (1999)].

Data Collection

The methods used in the AMC Network have been described elsewhere (Versporten et al., 2014; World Health Organization Regional Office for Europe, 2017a). Briefly, data collection follows a standardized protocol using an Excel template based on a national register of antimicrobial medicines with marketing authorization. Products are identified by ATC code facilitating analyses from the main class (level 1) to individual medicines (level 5). National AMC focal points enter data on the numbers of packages of each product imported or sold in their country, relevant product information, population data, and assigned DDD (World Health Organization Regional Office for Europe, 2017a; Table A1).
Table A1

List of AMC focal points and contributors to the 2015 data collection.

AlbaniaIris HoxhaDepartment of Pharmacy, University of Medicine, Tirana
ArmeniaLilit GhazaryanScientific Centre of Drug and Medical Technology Expertise of Ministry of Health
AzerbaijanVafa AbilovaDepartment of Import Medicines and Medical Devices, Analytical Expertise Center, Ministry of Health
Nazifa MursalovaSector of Sanitary Epidemiological Surveillance Ministry of Health
Bosnia and HerzegovinaAna CvijanovicSector for Providing Information on Drugs and Medical Products in Agency for Medicinal Products and Medical Devices of Bosnia and Herzegovina
Tijana SpasojevicSector for Providing Information on Drugs and Medical Products in Agency for Medicinal Products and Medical Devices of Bosnia and Herzegovina
BelarusHalina PyshnikDepartment of Pharmaceutical Inspection and Organization of Medicines Supply, Ministry of Health
GeorgiaMarina DarakhvelidzeHealth Care Department, Ministry of IDPs, Labour, Health and Social Affairs of Georgia
Marine BaidauriRegulations Division of Health Care Department, Ministry of IDPs, Labour, Health and Social Affairs of Georgia
David TsereteliNational Center for Disease Control and Public Health
KazakhstanLarissa MakalkinaDepartment of Cardiology and Internal Medicine with a course of clinical pharmacology and Pharmacy, Astana Medical University
Zhannat AsinaKazan Federal University, Alphateam LLP
KyrgyzstanIsmailova Baktygul AbdyldaevnaPublic Health Unit, Ministry of Health
Aigul DzhakubekovaUnit on Specialized Expertise of Medicines of Department of Drug Provision and Medical Devices, Ministry of Health
Republic of MoldovaNicolae FurtunaNational Public Health Centre
Angela CarpP.I. Coordination, Implementation and Monitoring Unit of the Health System Projects
MontenegroLidija CizmovicDepartment for Establishing Maximum Prices and Monitoring Consumption of Medicines, Agency for Medicines and Medical Devices
Russian FederationSvetlana RachinaInternal Medicine Department with Cardiology and Functional Diagnostics Course named after academician V.S. Moiseev, Russian Friendship University, Moscow, Russian Federation, Interregional Association for Clinical Microbiology & Antimicrobial Chemotherapy, Russian Federation
SerbiaVesela RadonjicNational Centre for Information on Medicines and Medical Device, Medicines and Medical Devices Agency of Serbia
Department of Pharmacy, Faculty of Medical Sciences, University of Kragujevac, Serbia
TajikistanNargis MaqsudovaHealth Systems, WHO Country Office in Tajikistan
Salomudin YusufiVice-Rector for Science, Avicenna Tajik State Medical University
TurkeyMelda KecikDepartment of Rational Use of Medicines. Turkish Medicines and Medical Devices Agency, Ministry of Health of Turkey
Mesil Aksoy
Ali AlkanVice Presidency of Medicines and Pharmacy Turkish Medicines and Medical Devices Agency, Ministry of Health of Turkey
Hakki GursozTurkish Medicines and Medical Devices Agency, Ministry of Health of Turkey,
Bahar Melik
Fatma İsli
Emre Umut Gurpinar
Serap Tekbacak
Omer Hakan Simsek
UzbekistanMuhabbat IbragimovaThe State Center for Expertise and Standardization of Medicines, Medical Devices and Medical Equipment of the Agency for the Development of the Pharmaceutical Industry under the Ministry of Health of the Republic of Uzbekistan
Kosovo#Arianit JakupiA2 - Pharmaceutical Consulting and UBT - Higher Education Institution
The core medicines monitored are the antibacterials for systemic use (ATC group J01); antibiotics for alimentary tract and metabolism (A07AA); and nitroimidazole derivatives against amoebiasis and other protozoal diseases (P01AB). There is optional data collection for antimycotics (J02), antifungals (D01BA), and antivirals for systemic use (J05), drugs for treatment of tuberculosis (J04A) and antimalarials (P01B). Only data for the core medicines are presented here.

Data Sources

Import data from customs records and declaration forms is the most commonly reported source of information supplemented with sales records from market authorization holders, local manufacturing estimates, wholesaler records, and in some cases, commercial data sources (see Supplementary Table 1). Data represent total consumption estimates with the exception of Kazakhstan where a commercial data source provides coverage of around 80–85% of hospital and community sales.

Data Validation

A template macro detects missing compulsory data and incorrect data units. WHO Europe also reviews entries to identify data inconsistencies, improbable estimates, errors in estimates for combination products when converted to standardized units, and a final data set for analysis is agreed.

Data Analysis and Metrics Reported

Total numbers of DDDs for each product are aggregated to give the total number of DDDs at the desired ATC code level and adjusted for population to calculate DID. World Bank population estimates were applied apart from Turkey, where estimates were adjusted to take account of the large refugee and displaced persons populations. Results are compared to publicly available 2015 ESAC-Net data that are derived using similar methods (European Centre for Disease Control [ECDC], 2017). Measures of relative consumption, expressed as a percentage of total consumption of groups of antimicrobials, were derived for pharmacological subgroups of J01, cephalosporins and quinolones as a proportion of total J01 consumption, cephalosporins by generation of agent, and for WHO Watch and Reserve groups of antibiotics. These relative use measures demonstrate the extent of consumption of second-line and last resort antibiotics. Means, medians, and ranges of estimates are presented to illustrate the variability of the 16 national datasets. Changes in total and relative consumption between 2011 and 2015 are reported. The impact of changes to assigned DDDs in 2019 is explored for total consumption and relative consumption estimates by applying DDDs for 2019 to numbers of packages consumed in 2015. Change was calculated as the percentage increase or decrease in total DDDs from the 2015 estimate using 2016 DDD values.

Role of the Funding Source

The funder (Netherlands Ministry of Health, Welfare and Sport) had no role in study design, data collection, data analysis, data interpretation, or writing the report.

Results

Total antibiotic consumption (ATC group J01) in 2015 ranged from 41.5 DID in Turkey to 8.0 DID in Azerbaijan (Figure 1). Mean and median consumption were 21.2 and 19.0 DID, respectively. The relative use of parenteral formulations varied from 4% in Turkey and Bosnia and Herzegovina to 52% in Uzbekistan (see Supplementary Figure 1). Beta-lactam penicillins (ATC group J01C) were the most commonly used antibiotics in almost all AMC Network countries, ranging from 56.6% of total J01 consumption in Kyrgyzstan to 16.2% in Georgia. In Georgia, highest relative consumption was reported for medicines in the sulfonamides and trimethoprim group (J01E, 26.4% of total consumption).
FIGURE 1

Total consumption of J01 antibacterials by pharmacological subgroup in 15 countries and Kosovo, 2015. DDD, Defined Daily Dose; ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)]; #Kazakhstan: commercial data source provides coverage of around 80–85% of hospital and community sales.

Total consumption of J01 antibacterials by pharmacological subgroup in 15 countries and Kosovo, 2015. DDD, Defined Daily Dose; ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)]; #Kazakhstan: commercial data source provides coverage of around 80–85% of hospital and community sales. ESAC-Net estimates from 25 countries reporting both community and hospital sector data in 2015 show similar variability with a range from 38.3 DID in Greece to 11.7 DID in Netherlands, with mean and median consumption of 22.6 and 22.2 DID, respectively [European Centre for Disease Control (ECDC), 2017]. Figure 2 shows the consumption of cephalosporins and quinolones as a proportion of total consumption of J01 antibacterials. Highest relative consumption of cephalosporins was reported in Turkey (28.8%,) and lowest in Azerbaijan (9.2%). Highest relative quinolone consumption was in Georgia (24.6%). Together these two groups combined represented 44% of total J01 consumption in Georgia to 20% of consumption in Kyrgyzstan.
FIGURE 2

Consumption of cephalosporins and quinolones as a proportion of the total consumption of J01 antibacterials, 2015. ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)].

Consumption of cephalosporins and quinolones as a proportion of the total consumption of J01 antibacterials, 2015. ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)]. There were high levels of consumption of first- and second-generation cephalosporins in Bosnia and Herzegovina (82% of total cephalosporin consumption) and Serbia (75%). Consumption of third-generation agents that are mostly second-line treatment options, and included in the WHO Watch list, dominated in almost half of the participating countries and represented up to 90% of total cephalosporin consumption in Tajikistan and Georgia (Figure 3). Reported consumption of fourth-generation agents (Reserve category) was low.
FIGURE 3

Relative consumption of cephalosporins by generation of agents, 2015. ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)].

Relative consumption of cephalosporins by generation of agents, 2015. ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)].

WHO Watch and Reserve Category Medicines

There were no or very low levels of consumption of Reserve group antibiotics across the studied countries (0.01–0.83% of total consumption; see Supplementary Table 2). Watch group antibiotics comprised 49.5% of total J01 consumption in Georgia to 17.3% of consumption in Kyrgyzstan (Figure 4). The mean and median relative consumption of Watch group antibiotics were 30.9 and 30.5%, respectively.
FIGURE 4

Consumption of “Watch” group of antibiotics classes as a proportion of total consumption of antibacterials. Watch group: Quinolones (J01MA and J01MB); 3rd generation cephalosporins (J01DD); macrolides (J01FA); glycopeptides (J01XA and A07AA09); antipseudomonal penicillins with beta-lactamase inhibitor (J01CR03 and J01CR05); carbapenems (J01DH); and faropenem (J01DI03). ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)].

Consumption of “Watch” group of antibiotics classes as a proportion of total consumption of antibacterials. Watch group: Quinolones (J01MA and J01MB); 3rd generation cephalosporins (J01DD); macrolides (J01FA); glycopeptides (J01XA and A07AA09); antipseudomonal penicillins with beta-lactamase inhibitor (J01CR03 and J01CR05); carbapenems (J01DH); and faropenem (J01DI03). ∗Kosovo [in accordance with United Nations Security Council resolution 1244 (1999)].

Changes Over Time

There were decreases in total consumption estimates between 2011 and 2015 in nine countries, increases in five and in one remaining reasonably stable over time (Table 1). Mean J01 consumption decreased from 23.6 to 21.2 DID between 2011 and 2015, and median consumption from 22.0 to 19.0 DID.
Table 1

Total antibiotic consumption 2011, 2015 in DDD/1000 inhabitants per day.

J01 antibiotic consumption DDD/1000 inhabitants per day

20112015
Albania25.118.2
Armenia15.910.7
Azerbaijan17.18.0
Bosnia and Herzegovina18.419.0
Belarus17.919.0
Georgia22.025.5
Kazakhstan#-18.2
Kyrgyzstan24.020.5
Republic of Moldova21.313.8
Montenegro38.333.9
Russian Federation15.315.5
Serbia26.436.5
Tajikistan36.625.7
Turkey42.341.5
Uzbekistan6.410.5
Kosovo26.423.1
Total antibiotic consumption 2011, 2015 in DDD/1000 inhabitants per day. Within these changes in total DIDs, there were some substantial changes in the reported consumption of parenteral formulations: decreasing relative consumption in Azerbaijan (47–22%) and Kyrgyzstan (72–42%) and increasing in Georgia (16–36%) and Uzbekistan (42–52%). Between 2011 and 2015, there were substantial increases in relative consumption of the cephalosporin and quinolones combined in Albania (22–37%), Azerbaijan (8–20%), Georgia (19–44%), and Kyrgyzstan (9–20%). Conversely, there were reductions in the consumption of these groups combined in Turkey (42–37%) and Uzbekistan (33–23%).

Changes to DDDs in 2019

Applying the DDD changes to be implemented in 2019 to consumption data for 2015 reduced total consumption estimates from a range of 41.5–8.0 DID using 2016 DDD values to 35.5–7.3 DID using 2019 DDD values (Table 2). The percentage reductions in total DIDs ranged from 18.4 (Uzbekistan) to 4.3% (Kazakhstan), with mean and median DID reductions of 12.0 and 13.0%, respectively, mostly due to reduced total DDDs for penicillins. However, there was limited impact on rankings from highest to lowest total consumption in DIDs (Table 2).
Table 2

Impact of 2019 changes in DDDs on estimates of total antibiotic consumption and ranking of countries.

2016 DDD values2019 DDD values


RankDID#RankDID#% decreaseChange in rank
Turkey141.5135.514.5
Serbia236.5231.015.1
Montenegro333.9329.014.4
Tajikistan425.7521.616.0-1
Georgia525.5424.25.1+1
Kosovo§623.1620.013.6
Kyrgyzstan720.5816.718.4-1
Belarus819.0917.010.3-1
Bosnia and Herzegovina919.01116.214.7-2
Kazakhstan1018.2717.44.3+3
Albania1118.21016.310.5+1
Russian federation1215.51214.19.2
Republic of Moldova1313.81312.97.0
Armenia1410.7149.412.5
Uzbekistan1510.5158.618.4
Azerbaijan168.0167.37.9
Mean21.018.4
Median19.016.5
Range8.0–41.57.3–35.5
Impact of 2019 changes in DDDs on estimates of total antibiotic consumption and ranking of countries. While absolute consumption estimates for cephalosporins and quinolones changed very little, relative consumption of the two groups combined increased slightly from 1.3% in Kazakhstan to 6.1% in Tajikistan (data not shown). Changes to DDD values increased the estimate of relative consumption of Watch group antibiotics – 17–49% of total consumption using 2016 DDD values and 21–52% using 2019 DDD values (data not shown).

Discussion

Our main findings are that total antibiotic consumption in 2015 ranged from 8.0 DID for Azerbaijan to 41.5 DID for Turkey (mean 21.2 DID). These estimates were mostly lower than those reported in 2011 (range 6.4 DID Uzbekistan to Turkey 42.3 DID, mean 23.6 DID). There were increases in relative consumption of parenteral formulations, cephalosporins (particularly third-generation agents), and quinolones that are included in the WHO Watch list of antibiotics in several countries. Changes to DDDs to be implemented in 2019 impacted on both total and relative consumption estimates, driven mostly by DDD changes for several commonly used beta-lactam penicillins. The impact of the DDD changes on ranking of countries by total consumption estimates was modest. Where the relative consumption of beta-lactams was similar, there were similar percentage reductions in total DIDs. These observations are important given the paucity of published data on antibiotic consumption from AMC network countries and areas. An IQVIA MIDAS-based study used national sample surveys of 2015 antibiotic sales extrapolated to national sales volumes for 76 countries and reported quantitative estimates of consumption for only two AMC Network members – Turkey and Russian Federation (Klein et al., 2018). We report total consumption of 41.5 DID for Turkey compared to Klein’s estimate of around 47 DID. There are likely several reasons for these differences including the extrapolation and interpolation algorithms applied to IQVIA data to generate national estimates of consumption and the assignment of DDDs for all products without a formal WHO DDD value. Medicines without an assigned DDD are excluded from our analyses. Klein et al. (2018) demonstrated good correlation of their estimates with ESAC-Net data; however, it may reflect that IQVIA data collection in EU countries is more comprehensive than in other parts of the world, reducing the impact of the extrapolations applied. The difference in absolute estimates of consumption in Turkey raises questions about using such data for “setting and enforcing per capita consumption targets” at the national level (Klein et al., 2018). AMC Network data for Russian Federation are based on IQVIA data, perhaps explaining the much closer estimates of 15.5 and 16 DIDs from the two sources. Further work is needed to compare consumption estimates from different data sources – import records, wholesaler data, health insurance records, and other commercial information sources – as the need is for reliable, actionable data on antibiotic consumption that can be used to monitor the impact of interventions to change prescribing practices. We are aware for instance that there can be considerable variation with import data from month to month. Our estimates have some limitations, relying on a complete register of antimicrobial products, full and accurate reporting of data, distinguishing between medicines for local consumption and export, and the impact of import cycles. In the absence of universal health coverage or e-prescribing, widespread availability of antibiotics without prescription, few mechanisms to engage private wholesalers and limited ability to disaggregate data to hospital and community sectors, import records remain the most feasible data source in most AMC Network countries and areas. However, the broad comparability of total consumption estimates for AMC Network and ESAC-Net countries suggest that estimates reported here are plausible and can provide a platform for national level discussions and actions. Reported decreases in total DIDs in this study are credible, reflecting sustained efforts at the national level to improve antibiotics use. Turkish health authorities have implemented an electronic prescription system to track prescription data and provide feedback to physicians and adopted a Rational Drug Use National Action Plan 2014–2017 that prioritizes the appropriate use of antibiotics (World Health Organization Regional Office for Europe, 2017b). 2011 Turkey estimates (42.3 DID) relied on commercial IMS data and reflected community consumption; the comparable community estimate in 2015 was 40.0 DID, derived from the comprehensive pharmaceutical “track and trace” system that follows medicines from production to consumption (Government of Turkey, 2018). 2015 data are also unlikely to reflect the full impact of the sustained educational and regulatory interventions undertaken since 2014. The reduction in total antibiotic consumption from 15.9 to 10.7 DID between 2011 and 2015 in Armenia is likely related to targeted awareness activities conducted by the multisectoral team of the Ministry of Health. Multiple ongoing reforms and activities in Azerbaijan targeting physicians, pharmacists and patients are suggested to have contributed to reducing total antibiotic consumption from 17.1 to 8.0 DID in the same time period (Abilova et al., 2018). However, changes in pricing policies have seen a shift from penicillins toward consumption of tetracyclines, and while overall consumption of cephalosporins was low, more than 80% was third-generation agents. Pricing policies aimed at improving affordability and access has affected market dynamics, with some manufacturers leaving the market, influencing medicine choices (Abilova et al., 2018). Pricing policies could be used to drive more appropriate use, for example, lower prices for first- and second-generation cephalosporins than third-generation agents (Abilova et al., 2018). More modest increases in total consumption in Georgia (22.0 DID in 2011 to 25.5 DID in 2015) may reflect, in part, issues in data collection, as exported products are not fully accounted for. Nonetheless, there appear to be some substantial shifts in consumption patterns, with reductions in relative consumption of beta-lactams (67.7–16.2%), increases in cephalosporins (8.8–19.2%) with more than 90% third-generation agents, and increases in quinolone consumption (10.5–24.6% of total J01 consumption). These observations highlight the importance of metrics other than total volumes of use. The choice of antimicrobial is as important as the volume of use given increasing concerns with AMR, and may be a more amenable target for changes in prescribing practices and optimizing antibiotic use when supported by evidence-based guidelines (World Health Organization, 2017a; Klein et al., 2018). Serbia reported increased consumption from 26.4 to 36.5 DID between 2011 and 2015. The reasons for this require local level investigation. However, limited resources have compromised the implementation of physician education programs, promotion of rational use of antibiotics and hospital-based antimicrobial stewardship programs (Kalaba et al., 2018). The DRIVE-AB project distinguishes between prescribing quality indicators and quantitative metrics, proposing 51 inpatient and 32 outpatient quality indicators covering aspects including stewardship, diagnostics, dosing, duration, safety and monitoring of antibiotics, as well as 12 inpatient and 6 outpatient quantity metrics (DRIVE-AB, 2014). A quality indicator reflects the degree in which the antibiotic is correct or appropriate, where the outcome has a value on its own. A quantity metric reflects the volume or costs of antibiotic use and the outcome only gains value in its comparison. By these definitions, most of the metrics presented here are quantitative metrics, although quantitative measures focusing on preferred agents might be considered pointing toward improved prescribing practices and some measure of quality. This is the first step though to improve future antibiotic use in the absence of patient level data, especially given the high rate of self-purchasing of antibiotics without a prescription in a number of network countries. Metrics such as packages of medicines per 1000 inhabitants per day have been proposed as an alternative to DIDs in the outpatient setting, partly in response to differences in prescribed daily doses in different countries (Bruyndonckx et al., 2014; Coenen et al., 2014; Watier et al., 2017). However, consumption estimates are affected by choice of measurement unit underpinning the importance of the use of the same data sources and metrics over time for assessment of temporal trends and benchmarking (Watier et al., 2017). Patient-linked volume of use measures are being used as national prescribing targets, with Sweden adopting a long-term goal of 250 prescriptions per 1000 inhabitants/year for all age groups, and the 2016 UK government proposing to halve inappropriate prescribing by 2020 (Government of Sweden, 2016; UK Department of Health Media Centre, 2016). However, prescription data are not available in all settings especially among AMC member countries and areas. Assessment of appropriate use (quality indicators) requires patient-level information linking clinical condition, patient characteristics and prescribing choices. Clinicians will more likely respond to these data than higher level aggregate measures. As health information systems develop, it will become possible to move beyond quantitative metrics toward quality indicators. In the interim, focused studies such as point prevalence studies, prescription analyses, and community surveys supplemented with qualitative studies are being undertaken in AMC Network countries and areas to help fill the information gaps and provide evidence of practices that should be reviewed (Smiljanic et al., 2016). There are also ongoing activities to improve pharmacist and patient knowledge to reduce inappropriate dispensing of antibiotics especially for upper respiratory tract infections (Markovic-Pekovic et al., 2017; Hoxha et al., 2018). Policymakers and consumers require simple metrics that are easily interpretable, identify the magnitude of problems with antibiotic consumption and suggest the need for policy actions such as regulations, the enforcement of prescription-only status and investments in education and training. In the absence of prescription data, total consumption in DID could be used for this purpose although is difficult to interpret in isolation requiring trend data at the national or cross-national level to provide some context (Van Boeckel et al., 2014; Versporten et al., 2014; World Health Organization Regional Office for Europe, 2017a). DDD changes in 2019 will likely compound the problems of interpretation of consumption estimates, with total DIDs decreasing on average by around 12% with the new DDDs applied, independent of any intervention by government, agencies or professional groups. Communication strategies will be required so stakeholders are aware of the impact of the DDD changes along with re-setting of trend lines and targets for changes in antibiotic consumption at the national level. The WHO Watch and Reserve group classifications offer promise as metrics that indicate actions required and lend themselves to prescribing targets with lower absolute and relative levels of consumption of these groups of antibiotics desirable. The Access, Watch, and Reserve classifications are already being applied – to IQVIA sales data units for single molecule and combination antibiotic products in India, and in the Access to Medicines Foundation analysis of proportions of pharmaceutical companies’ marketed antibiotics that are listed in the WHO EML antibiotic groups (McGettigan et al., 2017; Access to Medicines Foundation, 2018). More relevant for national stewardship efforts is an analysis of relative consumption of antibiotics by the WHO groups. However, a standardized method of calculation (ATC codes included and denominator definitions) is needed to ensure the validity of comparisons between settings (community, hospital, and total consumption) and for monitoring changes over time. The estimates presented here are based on total consumption – the relative use of Watch and Reserve groups would be substantially higher in a hospital-based analysis. The lists of Watch and Reserve medicines will be modified as evidence emerges, and more clinical conditions are reviewed. While the quantitative metrics presented have limited application in assessing the appropriateness of prescribing, they do illustrate differing patterns of antibiotic consumption between countries and within countries over time and point to potential problems in antibiotic use. A full exploration of reasons for the changes in consumption patterns reported in each of the 16 AMC Network countries and areas is beyond the scope of this study. However, the impact of locally produced antibiotics on treatment choices, pharmaceutical industry promotion, perverse incentives to prescribe and dispense antibiotics, availability and use of up-to-date guidelines all need to be considered in developing interventions to improve antibiotic use. Quantitative measures can be effective. Turkish health authorities responded to high levels of antibiotic consumption with substantial commitments of resources and integrated activities to improve antibiotic use (World Health Organization Regional Office for Europe, 2017b). Relative use measures targeting less appropriate treatment choices (third- and fourth-generation cephalosporins, quinolones, Watch and Reserve antibiotics) may be more effective with clinicians and provide targets for action supported by evidence-based guidelines and treatment protocols. Other measures such as the removal of incentives to prescribe and dispense antibiotics, enforcement of prescription-only status, better diagnostics, favoring narrow-spectrum over broad-spectrum antibiotics and raising awareness and education of the public regarding the importance of preserving the value of existing antibiotics are also required. These are considerations for the future among AMC Network countries and areas, and we will be reporting further on this in the future.

Data Availability

The datasets used in these analyses are available upon request to interested researchers.

Ethics Statement

Ethics committee approval is not required for this study that is based on aggregate data from customs records and declaration forms, sales records from market authorization holders, local manufacturing estimates, wholesaler records, and in some cases, commercial data sources. We have obtained signed declarations from the Ministries of Health of the 15 countries and one territory included in this study giving permission for data sharing and publication.

Author Contributions

JR, KI, and HBP developed the concept. IH, LG, VA, ACv, HP, MD, LM, AJ, AD, ACa, LC, SR, VR, SY, MA, and MI (national focal points) collected and validated national data. JR and KI undertook analysis and interpretation of data in consultation with the national focal points. JR provided first write-up of the manuscript. All co-authors KI, HBP, BG, HK, IH, LG, VA, ACv, HP, MD, LM, AJ, AD, ACa, LC, SR, VR, SY, MA, and MI reviewed and critiqued the manuscript and agreed to submission of the manuscript.

Disclaimer

The authors alone are responsible for the views expressed in this publication and they do not necessarily represent the views, decisions or policies of the institutions with which they are affiliated.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The reviewer MJ declared a shared affiliation, with no collaboration, with one of the authors, VR, to the handling Editor at the time of review.
  23 in total

1.  The usage of antibiotics in Russia and some countries in Eastern Europe.

Authors:  L Stratchounski; A Bedenkov; W Hryniewicz; V Krcmery; E Ludwig; V Semenov
Journal:  Int J Antimicrob Agents       Date:  2001-09       Impact factor: 5.283

2.  The influence of a sustained multifaceted approach to improve antibiotic prescribing in Slovenia during the past decade: findings and implications.

Authors:  Jurij Fürst; Milan Čižman; Jana Mrak; Damjan Kos; Stephen Campbell; Samuel Coenen; Lars L Gustafsson; Luka Fürst; Brian Godman
Journal:  Expert Rev Anti Infect Ther       Date:  2014-12-13       Impact factor: 5.091

3.  Global antibiotic consumption 2000 to 2010: an analysis of national pharmaceutical sales data.

Authors:  Thomas P Van Boeckel; Sumanth Gandra; Ashvin Ashok; Quentin Caudron; Bryan T Grenfell; Simon A Levin; Ramanan Laxminarayan
Journal:  Lancet Infect Dis       Date:  2014-07-09       Impact factor: 25.071

Review 4.  Economic burden of antibiotic resistance: how much do we really know?

Authors:  S Gandra; D M Barter; R Laxminarayan
Journal:  Clin Microbiol Infect       Date:  2014-11-07       Impact factor: 8.067

5.  European Surveillance of Antimicrobial Consumption (ESAC): disease-specific quality indicators for outpatient antibiotic prescribing.

Authors:  Niels Adriaenssens; Samuel Coenen; Sarah Tonkin-Crine; Theo J M Verheij; Paul Little; Herman Goossens
Journal:  BMJ Qual Saf       Date:  2011-03-21       Impact factor: 7.035

6.  The quality of outpatient antimicrobial prescribing: a comparison between two areas of northern and southern Europe.

Authors:  Sara Malo; Lars Bjerrum; Cristina Feja; María Jesús Lallana; José María Abad; María José Rabanaque-Hernández
Journal:  Eur J Clin Pharmacol       Date:  2013-12-10       Impact factor: 2.953

7.  Appropriate international measures for outpatient antibiotic prescribing and consumption: recommendations from a national data comparison of different measures.

Authors:  Samuel Coenen; Birgit Gielen; Adriaan Blommaert; Philippe Beutels; Niel Hens; Herman Goossens
Journal:  J Antimicrob Chemother       Date:  2013-10-01       Impact factor: 5.790

8.  Measuring trends of outpatient antibiotic use in Europe: jointly modelling longitudinal data in defined daily doses and packages.

Authors:  Robin Bruyndonckx; Niel Hens; Marc Aerts; Herman Goossens; Geert Molenberghs; Samuel Coenen
Journal:  J Antimicrob Chemother       Date:  2014-03-12       Impact factor: 5.790

Review 9.  The antimicrobial resistance crisis: causes, consequences, and management.

Authors:  Carolyn Anne Michael; Dale Dominey-Howes; Maurizio Labbate
Journal:  Front Public Health       Date:  2014-09-16

10.  Antibiotic use in eastern Europe: a cross-national database study in coordination with the WHO Regional Office for Europe.

Authors:  Ann Versporten; Ganna Bolokhovets; Lilit Ghazaryan; Vafa Abilova; Galina Pyshnik; Tijana Spasojevic; Irma Korinteli; Lul Raka; Baktygul Kambaralieva; Lidija Cizmovic; Angela Carp; Vesela Radonjic; Nargis Maqsudova; Hatice Demet Celik; Marina Payerl-Pal; Hanne Bak Pedersen; Nina Sautenkova; Herman Goossens
Journal:  Lancet Infect Dis       Date:  2014-03-20       Impact factor: 25.071

View more
  17 in total

1.  Antibiotic utility and susceptibility changes of multidrug-resistant Escherichia coli and Klebsiella spp: 5-year experience in a tertiary healthcare centre.

Authors:  Radmila Veličković-Radovanović; Nikola Stefanović; Ivana Damnjanović; Branislava Kocić; Snežana Mladenović-Antić; Marina Dinić; Jasmina Petrović; Radmila Mitić; Aleksandra Catić-Đorđević
Journal:  Eur J Hosp Pharm       Date:  2021-12-14

2.  Broad Spectrum project: factors determining the quality of antibiotic use in primary care: an observational study protocol from Italy.

Authors:  Peter Konstantin Kurotschka; Alice Serafini; Marco Massari; Roberto Da Cas; Adolfo Figueiras; Viviana Forte; Maria Francesca Moro; Matteo Massidda; Federico Contu; Luigi Minerba; Maurizio Marcias; Marco Nardelli; Alessandra Perra; Mauro Giovanni Carta; Stefania Spila Alegiani
Journal:  BMJ Open       Date:  2020-07-06       Impact factor: 2.692

3.  Risks in Antibiotic Substitution Following Medicine Shortage: A Health-Care Failure Mode and Effect Analysis of Six European Hospitals.

Authors:  Nenad Miljković; Brian Godman; Eline van Overbeeke; Milena Kovačević; Karyofyllis Tsiakitzis; Athina Apatsidou; Anna Nikopoulou; Cristina Garcia Yubero; Laura Portillo Horcajada; Gunar Stemer; Darija Kuruc-Poje; Thomas De Rijdt; Tomasz Bochenek; Isabelle Huys; Branislava Miljković
Journal:  Front Med (Lausanne)       Date:  2020-05-12

4.  Longitudinal Point Prevalence Survey of Antimicrobial Consumption in Russian Hospitals: Results of the Global-PPS Project.

Authors:  Svetlana Rachina; Yuliya Belkova; Roman Kozlov; Ann Versporten; Ines Pauwels; Herman Goossens; Elena Bochanova; Olga Domanskaya; Elena Elokhina; Ludmila Ezhova; Vladimir Mishchenko; Oksana Ni; Dmitry Popov; Ulyana Portnjagina; Evgeny Shchetinin; Vera Shegimova; Yulia Strezh; Vera Vityazeva; Nadezhda Zubareva
Journal:  Antibiotics (Basel)       Date:  2020-07-25

5.  The Evaluation of Antibiotic Consumption at the Inpatient Level in Kazakhstan from 2011 to 2018.

Authors:  Gulzira Zhussupova; Galina Skvirskaya; Vladimir Reshetnikov; Viktorija Dragojevic-Simic; Nemanja Rancic; Dinara Utepova; Mihajlo Jakovljevic
Journal:  Antibiotics (Basel)       Date:  2020-02-02

6.  National Antibiotic Consumption for Human Use in Sierra Leone (2017-2019): A Cross-Sectional Study.

Authors:  Joseph Sam Kanu; Mohammed Khogali; Katrina Hann; Wenjing Tao; Shuwary Barlatt; James Komeh; Joy Johnson; Mohamed Sesay; Mohamed Alex Vandi; Hannock Tweya; Collins Timire; Onome Thomas Abiri; Fawzi Thomas; Ahmed Sankoh-Hughes; Bailah Molleh; Anna Maruta; Anthony D Harries
Journal:  Trop Med Infect Dis       Date:  2021-05-13

7.  Impact of changes in the WHO's 2019 update of DDDs on the measurement of adult hospital antibacterial consumption in Catalonia (Spain), 2008-18.

Authors:  Santiago Grau; Sergi Hernández; Enric Limón; Esther Calbo; Juan P Horcajada
Journal:  JAC Antimicrob Resist       Date:  2020-10-16

8.  The Current Situation Regarding Long-Acting Insulin Analogues Including Biosimilars Among African, Asian, European, and South American Countries; Findings and Implications for the Future.

Authors:  Brian Godman; Mainul Haque; Trudy Leong; Eleonora Allocati; Santosh Kumar; Salequl Islam; Jaykaran Charan; Farhana Akter; Amanj Kurdi; Carlos Vassalo; Muhammed Abu Bakar; Sagir Abdur Rahim; Nusrat Sultana; Farzana Deeba; M A Halim Khan; A B M Muksudul Alam; Iffat Jahan; Zubair Mahmood Kamal; Humaira Hasin; Shamsun Nahar; Monami Haque; Siddhartha Dutta; Jha Pallavi Abhayanand; Rimple Jeet Kaur; Godfrey Mutashambara Rwegerera; Renata Cristina Rezende Macedo do Nascimento; Isabella Piassi Dias Godói; Mohammed Irfan; Adefolarin A Amu; Patrick Matowa; Joseph Acolatse; Robert Incoom; Israel Abebrese Sefah; Jitendra Acharya; Sylvia Opanga; Lisper Wangeci Njeri; David Kimonge; Hye-Young Kwon; SeungJin Bae; Karen Koh Pek Khuan; Abdullahi Rabiu Abubakar; Ibrahim Haruna Sani; Tanveer Ahmed Khan; Shahzad Hussain; Zikria Saleem; Oliver Ombeva Malande; Thereza Piloya-Were; Rosana Gambogi; Carla Hernandez Ortiz; Luke Alutuli; Aubrey Chichonyi Kalungia; Iris Hoxha; Vanda Marković-Peković; Biljana Tubic; Guenka Petrova; Konstantin Tachkov; Ott Laius; András Harsanyi; András Inotai; Arianit Jakupi; Svens Henkuzens; Kristina Garuoliene; Jolanta Gulbinovič; Magdalene Wladysiuk; Jakub Rutkowski; Ileana Mardare; Jurij Fürst; Stuart McTaggart; Sean MacBride-Stewart; Caridad Pontes; Corinne Zara; Eunice Twumwaa Tagoe; Rita Banzi; Janney Wale; Mihajlo Jakovljevic
Journal:  Front Public Health       Date:  2021-06-24

9.  Antibiotic Sales in Primary Care in Hubei Province, China: An Analysis of 2012-2017 Procurement Records.

Authors:  Xinping Zhang; Youwen Cui; Chaojie Liu; Keyuan Zuo; Yuqing Tang
Journal:  Int J Environ Res Public Health       Date:  2019-09-12       Impact factor: 3.390

Review 10.  Antimicrobial Resistance: Implications and Costs.

Authors:  Porooshat Dadgostar
Journal:  Infect Drug Resist       Date:  2019-12-20       Impact factor: 4.003

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.