Literature DB >> 31892839

Interplay between cost and effectiveness in influenza vaccine uptake: a vaccination game approach.

Md Rajib Arefin1,2, Tanaka Masaki1, K M Ariful Kabir1,3, Jun Tanimoto1,4.   

Abstract

Pre-emptive vaccination is regarded as one of the most protective measures to control influenza outbreak. There are mainly two types of influenza viruses-influenza A and B with several subtypes-that are commonly found to circulate among humans. The traditional trivalent (TIV) flu vaccine targets two strains of influenza A and one strain of influenza B. The quadrivalent (QIV) vaccine targets one extra B virus strain that ensures better protection against influenza; however, the use of QIV vaccine can be costly, hence impose an extra financial burden to society. This scenario might create a dilemma in choosing vaccine types at the individual level. This article endeavours to explain such a dilemma through the framework of a vaccination game, where individuals can opt for one of the three options: choose either of QIV or TIV vaccine or none. Our approach presumes a mean-field framework of a vaccination game in an infinite and well-mixed population, entangling the disease spreading process of influenza with the coevolution of two types of vaccination decision-making processes taking place before an epidemic season. We conduct a series of numerical simulations as an attempt to illustrate different scenarios. The framework has been validated by the so-called multi-agent simulation (MAS) approach.
© 2019 The Author(s).

Entities:  

Keywords:  epidemic model; influenza vaccine; vaccination game

Year:  2019        PMID: 31892839      PMCID: PMC6936611          DOI: 10.1098/rspa.2019.0608

Source DB:  PubMed          Journal:  Proc Math Phys Eng Sci        ISSN: 1364-5021            Impact factor:   2.704


Introduction

Seasonal influenza costs lots of lives throughout the world every year, causing a huge economic burden to society, involving treatment costs and productivity losses. Costs due to seasonal influenza have been reported as 2–6% of gross domestic product (GDP) per capita in low- and middle-income countries (LMICs), compared to only 0.04–0.13% of GDP in developed or high-income countries [1,2]. There are four main types of influenza viruses, A, B, C and D, that have been identified so far [3], among which influenza A and B viruses are the most common among humans that cause seasonal epidemics worldwide; however, circulation patterns and strain prevalence can be region-specific and time-specific [4]. According to a report published by the Centers for Disease Control and Prevention (CDC) [5], the United States 2017–2018 influenza season (1 October 2017 to 19 May 2018) faced severity from both influenza viruses; influenza A viruses prevailed at the beginning of the season but influenza B predominated in the later part of the season. As reported by previous studies, influenza A viruses have two strain subtypes, H1N1 and H3N2, influenza B viruses have two subtypes—B/Victoria and B/Yamagata—that have been commonly found to circulate [6,7]. Annual vaccination against influenza is suggested to be the most effective strategy to protect from the influenza disease. The traditional trivalent (TIV) vaccine targets three strain subtypes of influenza viruses (two strains of A and one of the B virus strains); on the other hand, the quadrivalent (QIV) vaccine contains one extra strain of influenza B viruse that offers improved protection against influenza B virus infections [3]. Each year public health authorities recommend which strain should be contained in vaccines for the upcoming season (for example [5,8] for USA). However, due to the mismatch between the recommended B virus strain for TIV vaccine and the circulating virus strain, influenza morbidity may increase [4,9]. Inclusion of an extra B strain to QIV vaccine provides better efficacy than that of TIV vaccine. Because they provide better protection, some of the developed countries have been turning towards QIV vaccines, although TIV vaccines are still recommended [8]. Nonetheless, many other countries including Russia are still relying on TIV vaccine [4]. Moreover, the use of QIV vaccine can be substantially expensive compared to TIV and may impose a considerable economic burden on LMICs, although the long-term impact of implementing QIV can be cost-effective [2,10]. So far, a significant amount of research has been conducted investigating the cost-effectiveness of TIV and QIV vaccine usages for developed countries and LMICs [2,10-13]. Most of these studies used an individual-based dynamic simulation model (4flu) using demographic data to evaluate the impact of TIV and QIV vaccines. However, in addition to those analyses, we also need to ponder individualistic assessment on choosing vaccine types (when both vaccines are available) as vaccination is usually voluntary in a social perspective. Thus, we need to consider individual perception on taking the vaccination with disease spreading to have a better understanding of the immunization programme. Here, we attempt to analyse people's vaccination decision (TIV or QIV or none) depending upon cost, effectiveness and other factors in the framework of a vaccination game [14-30] and then illustrate the resulting impact in a societal perspective. The vaccination game allows a framework that elucidates behaviour–disease–vaccination interactions with the help of evolutionary game theory [31-34], which has been used to study the conflict between self-interest and social interest in various circumstances [35-38]. Individuals who commit to vaccination (cooperators) can benefit themselves as well as their surroundings; however, people who do not vaccinate (defectors), expose themselves to the risk of infection that may cause illness and more financial burden compared to the vaccination cost, or they may become free riders, benefiting from ‘herd immunity’ that can be attained from the situation when a larger portion of the population is vaccinated. This scenario creates a social dilemma that can be explained by the vaccination game [35,39]. In this work, we design a mean-field vaccination game in an infinite and well-mixed population, with three strategies: taking QIV vaccine, TIV vaccine, and neither QIV nor TIV. Our approach follows a similar avenue to that of Kuga & Tanimoto [16], where the vaccination is assumed to be pre-emptive. Notably, the authors in [16] successfully developed an equivalent mean-field framework of a vaccination game, taking inspiration from [40], which mainly focused on a networked population. A similar work related to [40] can be found in [41]. The number of vaccinees remains the same during an epidemic season as we are considering seasonal influenza. Moreover, as influenza vaccines are not perfectly effective [42], we take into account vaccine efficacy in our modelling. The assumption of imperfect vaccine in the vaccination game can tackle more realistic situations, and lead to interesting results, which otherwise can be intractable (for instance, see [43,44]). In our current setting, at the end of each season, individuals assess their perceived payoffs based on the previous season's experience in terms of vaccine efficacy, cost, etc., and decide whether to vaccinate or not or if vaccinating then which vaccine to take for the next season. The strategy adaptation after each season is based on imitating others' strategy with better payoffs. The group who chooses QIV vaccine are expected to get better protection against the disease than that of the group taking TIV vaccine, although this may depend on the circulation of influenza B virus. However, the cost for TIV vaccine should be no more than the cost for QIV vaccine. Taking into account all these factors, we combine the disease spreading dynamics of influenza with the vaccination decision-making process through an evolutionary framework. We perform our simulations for repeated seasons until we reach a social equilibrium (steady state). By varying vaccine effectiveness and cost level, our numerical simulations intend to show an overall picture of influenza epidemics. At equilibrium, we calculate to what extent the average social payoff attained from the vaccination game falls short from the desired or social optimum payoff, which we name as, ‘social efficiency deficit’. Moreover, our approach has been validated with the multi-agent simulation (MAS) approach. We also explore the robustness of our framework in explaining the situation with influenza A or B virus-dominant circulation. The rest of this paper is organized as follows: §2 provides the detailed illustration of the model covering the epidemic spreading, payoff structure, strategy update and the evolutionary dynamics of vaccination coverage. Section 3 delivers a comprehensive discussion resulting from a series of numerical simulations. Section 4 concludes the findings of this work and provides some future indications.

Model description

We entangle the simultaneous spreading of two influenza viruses (A and B) and the evolution of vaccination (QIV or TIV or none) decision by constructing a repetitive sequence of a two-stage process in an infinite and well-mixed population. The disease spreading process is governed by susceptible-infected-recovered (SIR)-like dynamics [45] coupled with vaccination that allow us to estimate several fractions of individuals at the end of each epidemic period. These different groups then evaluate their payoffs and revisit their vaccination strategies by copying other individuals' strategy who achieved higher payoffs in the previous season. Finally, we update the fraction of vaccinees of both types (QIV and TIV) using evolutionary equations given in §2e. Let us note that the whole process is repeated for several steps (generations) until we reach a steady state. Figure 1 illustrates the whole dynamical set-up.
Figure 1.

The layout of the whole dynamical set-up. The vaccine efficacy of TIV vaccine against influenza B virus is assumed e, which is lower than that of QIV vaccine. However, both vaccines are assumed to have same efficacy (e) against influenza A virus. Once the disease spreading process ends, we estimate several fractions such as vaccinated and healthy, vaccinated but infected, infected with influenza A(B), etc., and evaluate their payoffs. These fractions then update their strategies for the next season. This process is repeated until we reach a steady state. Arrows depict the sequence of the evolutionary process. (Online version in colour.)

The layout of the whole dynamical set-up. The vaccine efficacy of TIV vaccine against influenza B virus is assumed e, which is lower than that of QIV vaccine. However, both vaccines are assumed to have same efficacy (e) against influenza A virus. Once the disease spreading process ends, we estimate several fractions such as vaccinated and healthy, vaccinated but infected, infected with influenza A(B), etc., and evaluate their payoffs. These fractions then update their strategies for the next season. This process is repeated until we reach a steady state. Arrows depict the sequence of the evolutionary process. (Online version in colour.)

Epidemic spreading

The first stage of our dynamical system is the disease spreading process that is based on a SIR-like model coupled with vaccination. Initially, we divide the whole population into three categories: susceptible (unvaccinated) denoted by S, QIV vaccinees denoted by V and TIV vaccinees denoted by V. It is not usually recommended to take both vaccines (TIV and QIV) in a single season [46]; therefore, we disregard any group taking both vaccines in the same season. As influenza vaccines are not 100% perfect, we consider imperfect vaccinations in our disease modelling, where both vaccines are presumed to provide the same level of efficiency against A virus but different efficacies against B virus. The inclusion of these parameters allows us to consider some individuals from vaccinated groups who fail to get immunity from vaccination (QIV or TIV) and still face the risk of infection like susceptible. The unvaccinated or vaccinated people who fail to get immunity may become infected with either influenza virus (A or B), and then these infected people transfer to the recovery state after suffering from illness. Therefore, at time t, an individual can be at any of the six compartments: susceptible, S(t); QIV vaccinees, V(t); TIV vaccinees, V(t); infected with influenza A, I(t); infected with influenza B, I(t); recovered state, R(t). We presume e (0 ≤ e≤ 1) as the vaccine efficacy of QIV against both influenza A and B viruses. As TIV (QIV) vaccine contains two strains of influenza A virus and one (two) strain(s) of influenza B virus, we assume that both QIV and TIV vaccines bestow the same level of effectiveness (e (0 ≤ e ≤ 1)) against influenza A but TIV vaccine provides relatively lower effectiveness, e (0 ≤ e ≤ e) against influenza B than that of QIV vaccine. If V(0) is the fraction of vaccinees at the beginning of an epidemic season, then a proportion e of V(0) i.e. e(0) gets perfect immunity from QIV vaccine and, the remaining fraction, V(t) − e(0) becomes vulnerable to the disease, where V(t) is the fraction of vaccinators in the V compartment at time t. A similar logic has been used for TIV vaccinees. The transmission rates and recovery rates for influenza A and B viruses are assumed β, γ and β, γ, respectively. It is worth mentioning that the state space variables represent several fractions of the total population; therefore, we are not considering a population of any particular size. Although coinfection and superinfection with two influenza viruses are possible in some cases [47,48], the incidence rate is not so significant. Therefore, our model disregards the incidence of coinfection and superinfection with two influenza viruses (A and B) and presumes long-term cross-immunity between them. Although we assume long-term cross-immunity between two viruses, short-term immunity is possible in reality. The incidence of short-term cross-immunity between two viruses may allow some individuals recovered from one virus to be infected with the other one after a short time interval (e.g. [49]). The schematic of our epidemic model is given in the disease spreading part of figure 1. The model equations are given by It is obvious that S(t) + V(t) + V(t) + I(t) + I(t) + R(t) = 1. If x, y ∈ [0, 1] (s.t. x + y ≤ 1) are the fractions of QIV and TIV vaccinees at the beginning of a season, i.e. V(0) = x, V(0) = y, then S(0) = 1 − x − y − ε − ε, where ε( → 0+) and ε( → 0+) are initial infections with influenza A and influenza B, respectively.

Outcome of disease spreading

After each epidemic season, we estimate several groups by numerically calculating fluxes from one state to another. We mainly estimate nine fractions of individuals that are, QIV vaccinees and healthy-HV, QIV vaccinees but infected with influenza A(B) virus-V (V), TIV vaccinees and healthy-HV, TIV vaccinees but infected with influenza A(B) virus-V (V), successful free riders-SFR (who are unvaccinated but did not suffer from any influenza virus), failed free riders-FFR or FFR (unvaccinated individuals infected by either influenza virus). Individuals who remain at S, V and V state at equilibrium (t → ∞), that is S(∞), V(∞) and V(∞), are termed successful free riders, healthy QIV vaccinees and healthy TIV vaccinees, respectively. Suppose φ→ is the total proportion transferred from state P to state Q during an epidemic season. Thus, QIV vaccinees who get infected with influenza A(B) virus can be evaluated from the flux, (). In a similar way, we can estimate this for TIV vaccinees. The failed free riders can be estimated by fluxes, and .

Payoff structure

Once an epidemic season ends, several groups estimate their payoffs prior to the onset of the next epidemic season. Suppose the cost of vaccination and infection are, respectively, C and C. The vaccination cost includes the vaccine price with possible side effects due to vaccination. Since the infection cost is higher than the vaccination cost, we define the relative cost of vaccination as C = C/C, (0 ≤ C ≤ 1). Without loss of generality, we can choose C = 1. Then the relative cost for QIV (TIV) vaccine can be assumed as C(C). Since the cost for TIV is assumed to be no more than QIV, we can presume 0 ≤ C ≤ 1 and 0 ≤ C ≤ C. Therefore, QIV(TIV) vaccinees who remain healthy during the epidemic period can have a payoff, − C(−C); however, QIV(TIV) vaccinees who become infected with either influenza virus (A or B) have a payoff, −C − 1(−C − 1). In addition, payoffs for successful free riders and failed free riders are assigned as 0 and −1, respectively. All fractions along with their payoffs are summarized in table 1.
Table 1.

Several fractions of individuals (at equilibrium) with their payoffs (within brackets).

strategy/statehealthyinfected with influenza Ainfected with influenza B
QIV vaccinees (VQ)HVQ (− CQ)VQIA (− CQ − 1)VQIB (− CQ − 1)
TIV vaccinees (VT)HVT (− CT)VTIA (− CT − 1)VTIB (− CT − 1)
non-vaccinated (NV)SFR (0) FFRA (− 1) FFRB (− 1)
Several fractions of individuals (at equilibrium) with their payoffs (within brackets). Using table 1, we estimate the average social payoff 〈π〉; average payoff for QIV vaccinees , TIV vaccinees and non-vaccinators (〈πNV〉) as follows:

Strategy update

Individuals assess their payoffs after an epidemic season and decide whether to imitate others' strategy or stay with their previous season's strategy. In a seminal work regarding the agent-based vaccination game model, Fu et al. [40] first used the pairwise Fermi function [50,51] to calculate the likelihood of copying others' strategy by comparing payoffs, where a focal agent i having the strategy S with the payoff π adopts the strategy S of a randomly chosen agent j having the payoff π with the probability where the parameter, k > 0 measures the strength of selection; smaller k signifies the strong selection, that is players are more responsive to the payoff difference. A typical choice of k is 0.1, which has been used in many previous studies such as [16,18-20,29]. Fukuda et al. [18] later slightly modified the formula (2.6), where rather than comparing with a single agent, a focal player i compares its payoff π with an average payoff 〈π〉 of all neighbours having the same strategy S of a randomly selected neighbour j. The modified formula becomes Although formulae (2.6) and (2.7) have been mainly used for agent-based modelling, these can also be used for the mean-field approach (such as [16,20,28,52]). Inspired by that, our approach uses formula (2.7) to update vaccination strategies for the next season. In our case, every fraction (each of nine fractions in table 1) compares its payoff with the average payoff of a mutually exclusive group (QIV, TIV, non-vaccinated in table 1); for instance, the fraction, HV can, respectively, compare its payoff with the average payoff of TIV vaccinees group (V) and non-vaccinators group (NV) by the formula Similarly, we estimate all necessary transition probabilities.

Evolutionary dynamics

As mentioned before, individuals update their vaccination strategies prior to onset of the next epidemic season. The evolution of vaccination strategies (QIV or TIV or unvaccinated) is estimated using the following evolutionary equations that have been derived by extending the master equation of the mean-field framework in a well-mixed population [52,53] and Here additions and subtractions, respectively, indicate inflows to and outflows from a state. We solve equations (2.8) and (2.9) numerically, allowing the system to reach the steady state as, t → ∞.

Results and discussion

This section deliberately explains results of the whole dynamical process. We vary several parameters such as transmission rates, vaccine effectiveness, vaccination cost, etc., to illustrate different scenarios. The symptoms of usual influenza sickness resolve after a period of 3–7 days, so the average durability in the infected stage is 5 days [49]. Therefore, we presume γ = γ = 1/5 = 0.2 throughout our numerical experiments.

Single season time series

Let us first briefly discuss the relative dynamics of infections due to influenza A and B viruses for different transmission rates and degree of initial infections in a single season without considering game aspect (figure 2). The vaccination coverage for this case is chosen as V(0) = V(0) = 0.333 with e = 0.6, e = 0.4. As e ≤ e, influenza B virus seems to dominate in the case of equal transmission rate (β = β) (figure 2a,b)). However, the virus with higher transmission rate is found to dominate irrespective to the initial infection. Hence, the sensitivity of initial infections seems insignificant comparing to the transmission rates, i.e. transmission rates show more impact on virus dominance.
Figure 2.

Time series of the fractions of infection by two influenza viruses (A and B) for different initial conditions and transmission rates without considering game approach. The vaccination coverage for each vaccine is assumed approximately 33% with vaccine effectiveness e = 0.6 and e = 0.4. The recovery rate for each flu virus is chosen as 0.2. Under the current set-up, when β = β (a,b), B virus is found to dominate because e ≤ e, whereas the flu virus with higher transmission rate (c,d) dominates the other one. The transmission rate seems more influential in virus dominance than the degree of initial dominance of each virus infection. (Online version in colour.)

Time series of the fractions of infection by two influenza viruses (A and B) for different initial conditions and transmission rates without considering game approach. The vaccination coverage for each vaccine is assumed approximately 33% with vaccine effectiveness e = 0.6 and e = 0.4. The recovery rate for each flu virus is chosen as 0.2. Under the current set-up, when β = β (a,b), B virus is found to dominate because e ≤ e, whereas the flu virus with higher transmission rate (c,d) dominates the other one. The transmission rate seems more influential in virus dominance than the degree of initial dominance of each virus infection. (Online version in colour.)

Evolutionary outcome of vaccination coverage

We estimate the coevolution of both types of vaccination at the end of each season. Owing to the complexity of equations (2.8) and (2.9), it is difficult to theoretically derive all possible equilibria; however, it is still possible to derive that numerically by tuning different parameters. Considering equal transmission rate for both viruses, we estimate six possible combinations of evolutionary outcomes (figure 3), which are (x, y) ≡ (1, 0);(x, y) ≡ (0, 0);(x, y) ≡ (x*, y*);(x, y) ≡ (x*, 0);(x, y) ≡ (0, 1);(x, y) ≡ (0, y*); where 0 < x*, y* < 1. Figure 3 suggests that there is none of the bi-stability arising from equations (2.8) and (2.9). One possible reason is that the present model as a nonlinear dynamical system instinctively has strong sinks, or steeply curved orbits, being insensible to initial conditions. Let us note that we choose initial values of x and y in such a way so that x + y ≤ 1. Moreover, when we vary initial values of x, the initial value of y is set as 0.33 and vice versa.
Figure 3.

Six possible combinations of QIV and TIV vaccination coverages at equilibrium attained from the evolutionary equations (2.8) and (2.9). The evolutionary dynamics of the vaccination coverage depends upon the choice of different parameters. Clearly, there is no bi-stability at equilibrium. There are six possible mixtures of dynamics: (a) x = 1, y = 0, when C = C = 0.4; e = 0.4, e = 0.3. (b) x = 0, y = 0, when C = 0.6, C = 0.4; e = 0.4, e = 0.3. (c) x = x*, y = y*, (coexistence or internal equilibria) when C = 0.6, C = 0.4; e = 0.8, e = 0.4. (d) x = x* (internal equilibrium), y = 0, when C = C = 0.4; e = 0.7, e = 0.4. (e) x = 0, y = 1, when C = 0.6, C = 0.4; e = 0.6, e = 0.4. (f) x = 0, y = y*, when C = 0.6, C = 0.4; e = 0.8, e = 0.6. All cases presume, β = β = 0.5; γ = γ = 0.2. The initial value of y is kept as, 0.33, while we vary the initial values of x and vice versa. (Online version in colour.)

Six possible combinations of QIV and TIV vaccination coverages at equilibrium attained from the evolutionary equations (2.8) and (2.9). The evolutionary dynamics of the vaccination coverage depends upon the choice of different parameters. Clearly, there is no bi-stability at equilibrium. There are six possible mixtures of dynamics: (a) x = 1, y = 0, when C = C = 0.4; e = 0.4, e = 0.3. (b) x = 0, y = 0, when C = 0.6, C = 0.4; e = 0.4, e = 0.3. (c) x = x*, y = y*, (coexistence or internal equilibria) when C = 0.6, C = 0.4; e = 0.8, e = 0.4. (d) x = x* (internal equilibrium), y = 0, when C = C = 0.4; e = 0.7, e = 0.4. (e) x = 0, y = 1, when C = 0.6, C = 0.4; e = 0.6, e = 0.4. (f) x = 0, y = y*, when C = 0.6, C = 0.4; e = 0.8, e = 0.6. All cases presume, β = β = 0.5; γ = γ = 0.2. The initial value of y is kept as, 0.33, while we vary the initial values of x and vice versa. (Online version in colour.)

Phase plane analysis

Case I (β = β)

Figure 4 portrays several heatmaps depicting the final epidemic size for influenza A(B) virus-FES(FES), vaccination coverage for QIV(TIV) vaccine and the average social payoff-ASP (using equation (2.2)) in the steady state as a function of (C, C) presuming an equal transmission rate for the both viruses (for the mean-field approach, we set β = β = 0.5 and I(0) = 0.00001, I(0) = 0.00002). It is worth mentioning that all heatmaps of our analyses presume the transition from the blue colour to the red colour as a good/better state to a bad/worse state of society in terms of infection, vaccination coverage and ASP, and vice versa. Clearly, infection due to influenza B virus predominates the other one that is akin to what we have observed in figure 2a,b for the case of equal transmission rates. As long as C < C and C is of lower than a certain threshold level, a broader regime in TIV heatmaps is covered by the blue colour (figure 2a-iv and b-iv); the counterpart of this region in QIV heatmaps is covered by the red colour, meaning that, because of lower cost, most individuals are interested in taking TIV vaccine until it bestows a considerable efficiency against B virus (that is of course below the efficacy of QIV vaccine). Despite a major portion taking TIV vaccine, it cannot fully suppress infection due to influenza B that can be clearly perceived from FES heatmaps, which, in accordance, bestows a lower average payoff to society (figure 4a-v). However, the increase of effectiveness (TIV vaccine) against both viruses (if e = 0.8, e = 0.6) would provide a better situation to society that can be observed from heatmaps in the second row. Remarkably, vaccination coverage for QIV vaccine seems to be dominant whenever both vaccination costs are comparable. Also, we can perceive the coexistence of both vaccinees in the borderline region between blue and red colours (yellowish regime enclosed by dotted lines in (a-iii) and (a-iv)).
Figure 4.

C versus C (C ≤ C) 2D-heatmaps with different effectiveness levels presuming mean-field (with β = β = 0.5, I(0) = 0.00001, I(0) = 0.00002) and multi-agent simulation (MAS) approach (in well-mixed population). Chronologically each column represents the final epidemic size for influenza A (FES), the final epidemic size for influenza B (FES), fraction of QIV vaccinees, fraction of TIV vaccinees and the average social payoff (ASP). Clearly, the infection due to influenza B is dominating for the case, β = β. The fraction of TIV vaccinees is seen to prevail for certain regime as long as C is below some threshold levels, however, QIV vaccinees are predominant whenever C and C are comparable. Results from MAS approach show an overall similar tendency to that of mean-field approach. The MAS approach presumes 10 000 agents with I(0) = 2 agents, I(0) = 4 agents, β = β = 5.19957 × 10−5, γ = γ = 0.2, and takes ensemble average of 100 realizations. (Online version in colour.)

C versus C (C ≤ C) 2D-heatmaps with different effectiveness levels presuming mean-field (with β = β = 0.5, I(0) = 0.00001, I(0) = 0.00002) and multi-agent simulation (MAS) approach (in well-mixed population). Chronologically each column represents the final epidemic size for influenza A (FES), the final epidemic size for influenza B (FES), fraction of QIV vaccinees, fraction of TIV vaccinees and the average social payoff (ASP). Clearly, the infection due to influenza B is dominating for the case, β = β. The fraction of TIV vaccinees is seen to prevail for certain regime as long as C is below some threshold levels, however, QIV vaccinees are predominant whenever C and C are comparable. Results from MAS approach show an overall similar tendency to that of mean-field approach. The MAS approach presumes 10 000 agents with I(0) = 2 agents, I(0) = 4 agents, β = β = 5.19957 × 10−5, γ = γ = 0.2, and takes ensemble average of 100 realizations. (Online version in colour.) Results obtained from the mean-field framework have been justified by a sequence of numerical simulations based on the MAS approach [18,40] presuming a complete graph as an underlying network (since we assume well-mixed population) with the population size, N = 10 000. The transmission rate parameters are chosen as β = β = 5.19957 × 10−5, which is estimated as the minimum transmission rate that surpasses the preset threshold final epidemic size of 0.9 without any vaccination [16]. The corresponding initial infections are I(0) = 2 agents and I(0) = 4 agents. Note that we estimate ensemble average for each 100 realizations. Generally, results obtained from the mean-field framework and MAS approach are showing overall the same tendency, albeit having subtle discrepancies in terms of colour scaling that comes from the fact that the MAS approach undertakes a finite population. Now let us focus on analysing similar phase diagrams by varying vaccine efficacies. To this aim, we generate several heatmaps as above as a function of (e, e), 0 ≤ e ≤ e ≤ 1, for the case of similar and different cost levels (figure 5). Obviously, similar cost for both vaccines would encourage people to choose QIV vaccine instead of TIV because the former one bestows better protection against both viruses. This situation illustrates why the sensitivity comes only along the direction of e (upper panels in figure 5). A lower degree of vaccine efficacy would not entice individuals to take vaccine (red region in figure 5a-iii); however, if e passes a threshold level, the fraction of QIV vaccinees mounts to the highest level (blue region in figure 5a-iii)). A further increase of e seems to suppress both infections significantly, which allows some people to avoid vaccination by free riding on herd immunity. This is why, after passing a transient regime having maximum vaccination coverage, the fraction of vaccinees decreases monotonically even with the increase of e (yellowish region in figure 5a-iii).
Figure 5.

e versus e (e ≤ e) 2D-heatmaps with similar (upper panels) and different (lower panels) cost levels presuming mean-field framework with parameters choices, β = β = 0.5, γ = γ = 0.2, and initial conditions, I(0) = 0.00001, I(0) = 0.00002. Similar cost encourages people (with a higher degree) to commit QIV vaccine, consequently, showing sensitivity in the direction of e. However, in case of different costs (C> C), QIV vaccine is seen to favour over TIV vaccine when e ≥ 0.5 (approximately), on the other hand, TIV is favoured over QIV when e ≥ 0.4 (approximately). The average social payoff for similar cost seems to be better than that of the different costs. Moreover, infection due to influenza A is lower than influenza B. (Online version in colour.)

e versus e (e ≤ e) 2D-heatmaps with similar (upper panels) and different (lower panels) cost levels presuming mean-field framework with parameters choices, β = β = 0.5, γ = γ = 0.2, and initial conditions, I(0) = 0.00001, I(0) = 0.00002. Similar cost encourages people (with a higher degree) to commit QIV vaccine, consequently, showing sensitivity in the direction of e. However, in case of different costs (C> C), QIV vaccine is seen to favour over TIV vaccine when e ≥ 0.5 (approximately), on the other hand, TIV is favoured over QIV when e ≥ 0.4 (approximately). The average social payoff for similar cost seems to be better than that of the different costs. Moreover, infection due to influenza A is lower than influenza B. (Online version in colour.) Nevertheless, if the cost for QIV is higher than TIV (lower panels in figure 5), then individuals' vaccination choice differs depending upon the degrees of e and e. More specifically, under the current setting, QIV vaccine is favoured over TIV vaccine if e is above 50% (approximately) and e is below 40% (approximately); on the other hand, if e is above 40% (approximately), then TIV vaccine is preferred over QIV vaccine regardless of e (of course with the condition, e ≤ e). Notably, in this case, the fraction of QIV vaccinees never reaches the maximum as the corresponding cost is higher; contrarily, TIV vaccinees are seen to reach the highest level for a mid-range of e, although it starts decreasing with the further increase of e that arises with the prevalence of free riders. Remarkably, the average payoff of society in case of different costs seems lower than that of the equal cost (see heatmaps for ASP in figure 5) as the former case imposes a higher financial burden to society.

Case II (β> β)

The case β> β (β = 0.6, β = 0.4) leads to infection dominance of influenza A over B virus (figure 6a,b). This situation can be controlled by TIV vaccine alone as it targets two strains of A virus. Individuals would then mostly prefer TIV vaccine over QIV vaccine as the price of TIV is lower than the price of QIV (figure 6c,d). As a consequence, we perceive the sensitivity of choosing TIV vaccine only along the direction of C.
Figure 6.

The heatmaps (a–d) show the fractions of infected individuals with influenza A and B viruses (FES, FES), fraction of QIV and TIV vaccinees as a function of C and C (C ≤ C), when the transmission rate for virus A is higher than B virus (β> β;β = 0.6, β = 0.4). (e–h) The same objects for the case β < β; β = 0.4, β = 0.6. We choose, e = 0.6 and e = 0.4 for both cases. We can perceive the infection dominance of A and B viruses according to the conditions β> β and β < β. With the current setting, the case, β> β implies the total predominance of TIV vaccinees (e,f). However, if β < β, then QIV vaccinees prevail whenever the cost difference is not so high and both costs are below 0.6 (approximately) but the prevalence of TIV vaccinees surges with the increase of C and the cost difference. The region where QIV is dominant shows more impact on disease suppression comparing to that of TIV (f,g,h). (Online version in colour.)

The heatmaps (a–d) show the fractions of infected individuals with influenza A and B viruses (FES, FES), fraction of QIV and TIV vaccinees as a function of C and C (C ≤ C), when the transmission rate for virus A is higher than B virus (β> β;β = 0.6, β = 0.4). (e–h) The same objects for the case β < β; β = 0.4, β = 0.6. We choose, e = 0.6 and e = 0.4 for both cases. We can perceive the infection dominance of A and B viruses according to the conditions β> β and β < β. With the current setting, the case, β> β implies the total predominance of TIV vaccinees (e,f). However, if β < β, then QIV vaccinees prevail whenever the cost difference is not so high and both costs are below 0.6 (approximately) but the prevalence of TIV vaccinees surges with the increase of C and the cost difference. The region where QIV is dominant shows more impact on disease suppression comparing to that of TIV (f,g,h). (Online version in colour.)

Case III (β < β)

The predominance of influenza B virus over A virus creates a dilemma of choosing vaccine types. Individuals prefer QIV vaccine over TIV whenever both costs are comparable or the cost difference between QIV and TIV is not so high (region enclosed by black dotted lines in figure 6g); however, TIV vaccine seems mostly favourable in case of higher vaccination cost for QIV or higher cost difference between QIV and TIV vaccine (region enclosed by red dotted lines in figure 6h). Figure 6g,h also depicts the coexistence of both types of vaccinees in the yellowish transient regions. Furthermore, comparing the light blue region (enclosed with black dotted lines) with the greenish region (enclosed by red dotted lines) in figure 6f, it is observed that the QIV vaccine-dominant region imposes more effect on disease suppression compared to TIV vaccine.

β versus β phase plane

We intend to observe an overall impact of the transmission rates on disease propagation and vaccine uptake. To this aim, we draw heatmaps for total infection (FES) due to both viruses, the basic reproduction number (R0) and vaccination coverage for both vaccines (QIV, TIV), as a function of (β, β) (figure 7). The vaccine-dependent basic reproduction number R0 [54,55] is defined as where and are the vaccine-dependent basic reproduction number for influenza A and B viruses, respectively. We derive and as and
Figure 7.

The effect of transmission rates (β, β) on disease spreading (a), the vaccine-dependent basic reproduction number-R0 (b), and the vaccination coverage of both vaccines (c,d). The deep blue region inside the box in (a) represents a DFE for both viruses, where R0 is below one (b), and accordingly, there is no vaccination coverage of any type inside the box. Outside of that box, influenza A(B) becomes prevalent with the increase of β(β). The red dotted line depicts the threshold level below(above) which influenza A(B) is dominant. TIV vaccinees predominate when β gets larger and QIV vaccinees predominate when β increases. The relevant parameters are set as γ = γ = 0.2; e = 0.6, e = 0.4; C = 0.4, C = 0.2. (Online version in colour.)

The effect of transmission rates (β, β) on disease spreading (a), the vaccine-dependent basic reproduction number-R0 (b), and the vaccination coverage of both vaccines (c,d). The deep blue region inside the box in (a) represents a DFE for both viruses, where R0 is below one (b), and accordingly, there is no vaccination coverage of any type inside the box. Outside of that box, influenza A(B) becomes prevalent with the increase of β(β). The red dotted line depicts the threshold level below(above) which influenza A(B) is dominant. TIV vaccinees predominate when β gets larger and QIV vaccinees predominate when β increases. The relevant parameters are set as γ = γ = 0.2; e = 0.6, e = 0.4; C = 0.4, C = 0.2. (Online version in colour.) Other relevant parameters are set as γ = γ = 0.2; e = 0.6, e = 0.4; C = 0.4, C = 0.2. Clearly, the increase of β(β) results in the upsurge of influenza A(B) virus. The deep blue regime inside the box illustrates the disease-free equilibrium (DFE) for both viruses, where R0 < 1 (figure 7b). Consequently, we observe no vaccination coverage inside that box (figure 7c,d). We perceive a red dotted line in FES-heatmap (figure 7a) below(above) which influenza A(B) predominates. As QIV vaccine provides better protection against B virus than TIV vaccine, we perceive the predominance of QIV vaccinees in case of higher β; contrarily, TIV vaccine is favoured over QIV for higher β because its price is lower than QIV.

Social efficiency deficit

Now we intend to explore how much the payoff attained at equilibrium falls short from the desired payoff or social optimum (SO) payoff. We name this payoff shortfall as the social efficiency deficit (SED) and define as where ASPEQM and ASPSO denote the average social payoff at equilibrium and social optimum, respectively. We use this parameter in explaining the degree of dilemma associated with each vaccine choice.

Derivation of SED

As there are two vaccines available, individuals face a dual dilemma situation, choose QIV vaccine or TIV vaccine or none, depending upon their assessment on cost and effectiveness. These factors allow us to evaluate SED corresponding to both vaccines to ponder the impact of both types of vaccinations to society. The procedure given below can be followed in calculating SED for both vaccines. Suppose we wish to derive SED as a function of (C, C). Note that it is also possible to express SED as a function of (e, e). Step (I) At first, we estimate ASP at equilibrium (EQM) as a function of (C, C), for instance consider the heatmap for ASP given in figure 4a-v. Step (II) Each point on this heatmap corresponds to a pair, . Also, there is a corresponding pair (x*, y*), i.e. vaccination coverage for each vaccine, for each pair . Now choosing y*(x*) as fixed and varying x(y) from 0 up to 1, we estimate the maximum average payoff (using formula (2.2)), what we call a social optimum payoff for x(y) at the point (figure 8a–c).
Figure 8.

The schematic of SED derivation. At first, we choose a point (,) on the heatmap (C versus C) illustrating the average social payoff (ASP) at equilibrium (EQM) (a), in which there is a corresponding point, (x*, y*), i.e. a corresponding pair of vaccinees (QIV, TIV). With fixed (,) and y*, we vary x (0 ≤ x ≤ 1) and estimate the maximum average payoff, which we term as social optimum (SO) payoff for x at (,) and y*, i.e. (b). After that we derive SED for x at () by subtracting ASP at equilibrium from the payoff at social optimum. We follow the same procedure to derive SED for y using (a) and (c). (Online version in colour.)

The schematic of SED derivation. At first, we choose a point (,) on the heatmap (C versus C) illustrating the average social payoff (ASP) at equilibrium (EQM) (a), in which there is a corresponding point, (x*, y*), i.e. a corresponding pair of vaccinees (QIV, TIV). With fixed (,) and y*, we vary x (0 ≤ x ≤ 1) and estimate the maximum average payoff, which we term as social optimum (SO) payoff for x at (,) and y*, i.e. (b). After that we derive SED for x at () by subtracting ASP at equilibrium from the payoff at social optimum. We follow the same procedure to derive SED for y using (a) and (c). (Online version in colour.) Step (III) Next, we derive SED for x(y) at the point by simply subtracting ASP attained in step I from the social optimum payoff attained in step II and denote it by , that is and Figure 8 schematically explains the whole procedure. Now let us explain the heatmaps for SED that are generated following the above procedure. As an archetype, we choose the case illustrated in the upper panel of figure 4, where we assumed β = β = 0.5 and e = 0.6, e = 0.4. In that case, we observed that most of the people are inclined to choose TIV vaccine whenever the cost difference between C and C gets higher but individuals prefer QIV if the cost difference becomes lower. It is conceivable that the overall desired payoff or social optimum payoff for QIV vaccinees (x) would be relatively higher than the TIV vaccinees (y), which is appeared in figure 9a,b, but in this case, the vaccination coverage for QIV seems much lower than TIV (figure 4a-iii–a-iv), which indicates that the dilemma of choosing QIV vaccine is higher than the other one. Obviously, this comes from the fact of higher cost associated with QIV vaccine. This factor results in less contribution of QIV vaccine to ASP (figure 4a-v). As a result, we perceive relatively higher payoff-gap between social optimum payoff for x and ASP (at equilibrium); hence, more areas of the heatmap for SED are seemed dark compared to its counterpart (SED). The whiteout region in heatmaps (figure 9c,d) depicts the scenario with no SED, that is there is no gap between social optimum payoff and ASP. There are two white regions in the SED-heatmap (figure 9d), which either come from 100% TIV vaccination coverage (region enclosed by blue dotted lines) resulting from lower C and higher C (blue region in figure 4a-iii), or from the scenario when everyone becomes a free rider (region enclosed by red dotted lines in figure 9b,d). The latter situation can arise for higher vaccination cost or for very low vaccine effectiveness. In this case, avoiding any type of vaccination is the best strategy (desired strategy), which agrees with the D(unvaccinated)-dominant equilibrium (figure 4a-iii,a-iv). As a result, the payoff at this equilibrium also agrees with the social optimum payoff; hence no SED or no dilemma arises in this case.
Figure 9.

Representation of social optimum payoff (a,b) and SED (c,d) for x (fraction of QIV vaccinees) and y (fraction of TIV vaccinees) as a function of (C, C). SED heatmaps are attained by subtracting the ASP at equilibrium (figure 4a-v) from the social optimum (SO) payoffs for x and y (a,b). The relevant parameters are chosen as: e = 0.6, e = 0.4, β = β = 0.5 and γ = γ = 0.2. Referring to figure 4a-i–a-iv, these parameter choices depict the prevalence of influenza B virus and lower vaccination coverage for QIV vaccine (especially when the cost difference is high). The whiteout regions in (c,d) depict that there is no gap between SO payoff (for x or y) and ASP at equilibrium. More areas in SED-heatmap for x appears to have darker regime than that of the case for y, which indicates the higher gap between SO payoff for x and ASP at equilibrium. (Online version in colour.)

Representation of social optimum payoff (a,b) and SED (c,d) for x (fraction of QIV vaccinees) and y (fraction of TIV vaccinees) as a function of (C, C). SED heatmaps are attained by subtracting the ASP at equilibrium (figure 4a-v) from the social optimum (SO) payoffs for x and y (a,b). The relevant parameters are chosen as: e = 0.6, e = 0.4, β = β = 0.5 and γ = γ = 0.2. Referring to figure 4a-i–a-iv, these parameter choices depict the prevalence of influenza B virus and lower vaccination coverage for QIV vaccine (especially when the cost difference is high). The whiteout regions in (c,d) depict that there is no gap between SO payoff (for x or y) and ASP at equilibrium. More areas in SED-heatmap for x appears to have darker regime than that of the case for y, which indicates the higher gap between SO payoff for x and ASP at equilibrium. (Online version in colour.)

Conclusion

In this paper, we consider a simultaneous spreading of two influenza viruses (A and B) coupled with two types of vaccinations. The QIV vaccine contains one extra strain of influenza B virus and hence provides better protection compared to the TIV vaccine. However, the cost of the QIV vaccine is higher than TIV, which may create a dilemma for individuals’ vaccination choice. Here we design a mean-field vaccination game model in an infinite and well-mixed population to explain people's vaccination dilemma, entangling an epidemic spreading process of influenza with the coevolution of two types of vaccinations. Our evolutionary framework assumes three strategies—choose QIV vaccine, TIV vaccine or none—that evolve at the end of each season by imitating strategies based on the previous season's experience. We perform a series of numerical simulations by varying vaccination cost, vaccine effectiveness, transmission rates, etc., to depict different scenarios. Our results show that individuals are more inclined to take QIV vaccine whenever both vaccination costs are comparable; however, they prefer TIV vaccine if the cost difference gets higher. Notably, the framework has been validated by the so-called MAS approach. Generally, people's vaccination choice is influenced by the costs as well as vaccine efficacies; however, our results show that individuals' vaccination options (QIV or TIV) are more affected by the cost difference of both vaccines as long as the vaccine with the lower price is able to bestow a considerable level of efficiency, especially against B virus. Another interesting result concerns the variation of transmission rates for both viruses and its resulting effect on disease propagation and vaccination choice. The higher transmission rate of influenza A virus leads to a maximum coverage for TIV vaccine since it possesses the same degree of effectiveness against influenza A virus as that of QIV vaccine but with a lower cost; contrarily, the higher transmission rate of influenza B virus results in almost complete dominance of QIV vaccinees that is quite conceivable. Our analysis also incorporates how much the overall payoff or the average social payoff (ASP) attained by the process of voluntary vaccination (at equilibrium) falls short from the desired payoff or social optimum payoff, what we have termed as social efficiency deficit (SED)—the payoff gap between social optimum and equilibrium. This parameter also helps us elucidate the degree of dilemma associated with each vaccination choice. It appears that for the case of equal transmission rates, people face a bigger dilemma to choose QIV vaccine rather than TIV that arises from the fact of the higher vaccination cost for QIV even though it confers relatively better protection. In sum, this work endeavours to explore individuals’ dilemma on choosing influenza vaccines through the lens of a vaccination game, where the disease spreading process is modelled by a simple SIR-like model coupled with two types of vaccinations. Our approach does not consider any strain-specific infection, rather it relies on virus-specific infection (influenza A and B) with long-term cross-immunity. It would be interesting to explore strain-specific infection, where an individual infected with a particular strain can have short-term or long-term cross-immunity against the other one (e.g. [49]). The inclusion of age structure (for instance [49,56]) in the current framework could be another aspect to explore. The influenza epidemic varies from one country to another country, thus it would be also interesting to explore the outlined framework for a specific country with proper estimation of relevant parameters [56,57]. In addition to a voluntary vaccination campaign, subsidies [14,58] provided by the government (especially for QIV vaccine) can enhance vaccination coverage to prevent disease-outbreak more efficiently. Therefore, the current framework with a subsidy provision could be another avenue to explore. In the present study, we have presumed a well-mixed situation. The next step for the current framework may be the inclusion of an underlying network. The focal point of our present model is plural vaccinations having different capabilities and costs for plural viruses of the same disease. Such a specific but quite realistic situation would be significantly influenced by a spatial structure connecting individuals. The well-mixed situation can be said, in a sense, to be an ideal assumption because the social information helping individuals to decide for vaccination is quickly shared and can also be said to be an extreme assumption because disease spreading occurs quickly vis-à-vis the case with the spatial structure. The time delay between information and disease spreading on the underlying network might be more significant for the model with plural vaccinations and plural viruses (or plural strains) than the conventional setting with a single vaccination and a single strain.
  30 in total

1.  Vaccination and the theory of games.

Authors:  Chris T Bauch; David J D Earn
Journal:  Proc Natl Acad Sci U S A       Date:  2004-08-25       Impact factor: 11.205

2.  Imitation dynamics of vaccination behaviour on social networks.

Authors:  Feng Fu; Daniel I Rosenbloom; Long Wang; Martin A Nowak
Journal:  Proc Biol Sci       Date:  2010-07-28       Impact factor: 5.349

3.  Dilemma game structure observed in traffic flow at a 2-to-1 lane junction.

Authors:  Atsuo Yamauchi; Jun Tanimoto; Aya Hagishima; Hiroki Sagara
Journal:  Phys Rev E Stat Nonlin Soft Matter Phys       Date:  2009-03-13

4.  Evolutionary vaccination dilemma in complex networks.

Authors:  Alessio Cardillo; Catalina Reyes-Suárez; Fernando Naranjo; Jesús Gómez-Gardeñes
Journal:  Phys Rev E Stat Nonlin Soft Matter Phys       Date:  2013-09-05

5.  Prioritization of vaccine strategy using an age-dependent mathematical model for 2009 A/H1N1 influenza in the Republic of Korea.

Authors:  Soyoung Kim; Eunok Jung
Journal:  J Theor Biol       Date:  2019-07-19       Impact factor: 2.691

6.  Imperfect vaccine and hysteresis.

Authors:  Xingru Chen; Feng Fu
Journal:  Proc Biol Sci       Date:  2019-01-16       Impact factor: 5.349

7.  Game dynamic model of optimal budget allocation under individual vaccination choice.

Authors:  Aniruddha Deka; Samit Bhattacharyya
Journal:  J Theor Biol       Date:  2019-03-20       Impact factor: 2.691

8.  Cost-Effectiveness of Quadrivalent versus Trivalent Influenza Vaccine in the United States.

Authors:  Pieter T de Boer; Pascal Crépey; Richard J Pitman; Bérengère Macabeo; Ayman Chit; Maarten J Postma
Journal:  Value Health       Date:  2016-07-15       Impact factor: 5.725

9.  Saving Human Lives: What Complexity Science and Information Systems can Contribute.

Authors:  Dirk Helbing; Dirk Brockmann; Thomas Chadefaux; Karsten Donnay; Ulf Blanke; Olivia Woolley-Meza; Mehdi Moussaid; Anders Johansson; Jens Krause; Sebastian Schutte; Matjaž Perc
Journal:  J Stat Phys       Date:  2014-06-05       Impact factor: 1.548

Review 10.  A systematic review of the social and economic burden of influenza in low- and middle-income countries.

Authors:  Natasha de Francisco Shapovalova; Morgane Donadel; Mark Jit; Raymond Hutubessy
Journal:  Vaccine       Date:  2015-10-25       Impact factor: 3.641

View more
  9 in total

1.  When conflicts get heated, so does the planet: coupled social-climate dynamics under inequality.

Authors:  Jyler Menard; Thomas M Bury; Chris T Bauch; Madhur Anand
Journal:  Proc Biol Sci       Date:  2021-09-15       Impact factor: 5.530

2.  Investigating the efficiency of dynamic vaccination by consolidating detecting errors and vaccine efficacy.

Authors:  Yuichi Tatsukawa; Md Rajib Arefin; Shinobu Utsumi; Jun Tanimoto
Journal:  Sci Rep       Date:  2022-05-17       Impact factor: 4.996

3.  Cost-efficiency analysis of voluntary vaccination against n-serovar diseases using antibody-dependent enhancement: A game approach.

Authors:  K M Ariful Kabir; Jun Tanimoto
Journal:  J Theor Biol       Date:  2020-07-02       Impact factor: 2.691

4.  An epidemiological model with voluntary quarantine strategies governed by evolutionary game dynamics.

Authors:  Marco A Amaral; Marcelo M de Oliveira; Marco A Javarone
Journal:  Chaos Solitons Fractals       Date:  2021-01-07       Impact factor: 5.944

5.  Effect of vaccine efficacy on disease transmission with age-structured.

Authors:  Lu Yin; YiKang Lu; ChunPeng Du; Lei Shi
Journal:  Chaos Solitons Fractals       Date:  2022-01-20       Impact factor: 5.944

6.  Game-Theoretical Model of the Voluntary Use of Insect Repellents to Prevent Zika Fever.

Authors:  Jabili Angina; Anish Bachhu; Eesha Talati; Rishi Talati; Jan Rychtář; Dewey Taylor
Journal:  Dyn Games Appl       Date:  2022-01-30       Impact factor: 1.296

7.  A study on prosocial behavior of wearing a mask and self-quarantining to prevent the spread of diseases underpinned by evolutionary game theory.

Authors:  Risa Tori; Jun Tanimoto
Journal:  Chaos Solitons Fractals       Date:  2022-03-31       Impact factor: 9.922

8.  A game-theoretic model of lymphatic filariasis prevention.

Authors:  Jan Rychtář; Dewey Taylor
Journal:  PLoS Negl Trop Dis       Date:  2022-09-22

9.  Effects of void nodes on epidemic spreads in networks.

Authors:  Kazuki Kuga; Jun Tanimoto
Journal:  Sci Rep       Date:  2022-03-10       Impact factor: 4.379

  9 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.