Literature DB >> 26888732

Using Monte Carlo simulation to assess variability and uncertainty of tobacco consumption in a city by sewage epidemiology.

De-Gao Wang1, Qian-Qian Dong1, Juan Du1, Shuo Yang1, Yun-Jie Zhang2, Guang-Shui Na3, Stuart G Ferguson4, Zhuang Wang5, Tong Zheng6.   

Abstract

OBJECTIVE: To use Monte Carlo simulation to assess the uncertainty and variability of tobacco consumption through wastewater analysis in a city.
METHODS: A total of 11 wastewater treatment plants (WWTPs) (serving 2.2 million people; approximately 83% of urban population in Dalian) were selected and sampled. By detection and quantification of principal metabolites of nicotine, cotinine (COT) and trans-3'-hydroxycotinine (OH-COT), in raw wastewater, back calculation of tobacco use in the population of WWTPs can be realised.
RESULTS: COT and OH-COT were detected in the entire set of samples with an average concentration of 2.33 ± 0.30 and 2.76 ± 0.91 µg/L, respectively. The mass load of absorbed NIC during the sampling period ranged from 0.25 to 4.22 mg/day/capita with an average of 1.92 mg/day/capita. Using these data, we estimated that smokers in the sampling area consumed an average of 14.6 cigarettes per day for active smoker. Uncertainty and variability analysis by Monte Carlo simulation were used to refine this estimate: the procedure concluded that smokers in Dalian smoked between 10 and 27 cigarettes per day. This estimate showed good agreement with estimates from epidemiological research.
CONCLUSIONS: Sewage-based epidemiology may be a useful additional tool for the large-scale monitoring of patterns of tobacco use. Probabilistic methods can be used to strengthen the reliability of estimated use generated from wastewater analysis. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Entities:  

Keywords:  Monte Carlo simulation; cotinine; tobacco use; trans-3’-hydroxycotinine; wastewater analysis

Mesh:

Substances:

Year:  2016        PMID: 26888732      PMCID: PMC4762092          DOI: 10.1136/bmjopen-2015-010583

Source DB:  PubMed          Journal:  BMJ Open        ISSN: 2044-6055            Impact factor:   2.692


This paper describes a probabilistic method to assess the uncertainty of tobacco use based on wastewater analysis. The approach offers a model to estimate tobacco consumption in a city. The main limitation to this study is that sewage-based epidemiology gives no information on demographic characteristics of smokers.

Introduction

China is the largest consumer of tobacco in the world, with an estimated 301 million smokers in 2010.1 The average cigarette consumption per smoker has remained relatively consistent during this century (estimated at 14.8 cigarettes per day (CPD) in 2002, and 14.2 CPD in 2010).2 3 In May 2015, the Chinese Government approved an increase in the tax applied to tobacco products, however, more tobacco control programmes and initiatives are needed to reduce the smoking.4 Monitoring tobacco consumption is essential for evaluating the effectiveness of tobacco control programmes and initiatives. Cross-sectional household surveys are the main sources of cross-sectional smoking prevalence estimates. The reliability of these estimates relies on large representative samples of the population providing accurate information about their use of tobacco. These methods are labour-intensive and time-consuming.5 In part, to overcome these issues, a new method of sewage epidemiology based on wastewater analysis has been developed to investigate tobacco consumption. The approach is based on the principle that the metabolites of nicotine (NIC) are excreted along with urine into the urban sewer networks. By the detection and quantification of the principal metabolites—cotinine (COT) and trans-3′-hydroxycotinine (OH-COT)—in raw wastewater, back calculation of tobacco use in the population of a wastewater treatment plant (WWTP) catchment area can be estimated. Such wastewater analysis procedures have been used to estimate tobacco consumption in several cities in Spain6 and Italy.7 The results show good agreement with prevalence data from national epidemiological surveys, and demonstrate the potential of the approach to complement existing socioepidemiological methods.8 The primary advantages of sewage epidemiology procedures are that they provide evidence-based, objective and real-time estimates of drug consumption in a defined population.9–17 However, this approach is also subject to a number of uncertainties associated with the different steps involved.11 18 19 The key uncertainties are those related to the sampling of wastewater,20 21 the chemical analysis,22 the method to back-calculate tobacco use, the estimation of the size of the population,23–25 and human urinary excretion of metabolites.16 26 27 Gaussian error propagation has become widely used to calculate the uncertainty of estimations generated.11 19 28 However, this approach analyses the uncertainty of average values of estimation, not the variability of the estimation itself. As a representative of probabilistic approach, Monte Carlo simulations can quantify model inputs in an estimation model, and therefore assess the variability and uncertainty of tobacco consumption. The objectives of the present study were to assess tobacco consumption using wastewater analyses in a region of China, and to use Monte Carlo simulations to estimate the uncertainties of the estimation of tobacco consumption generated.

Methods

Wastewater sampling and analysis

WWTPs were selected for sampling to achieve a wide geographical distribution in Dalian, China. In total, 11 plants were included, servicing a population of 2.2 million people. All 11 plants operated with the secondary wastewater treatment systems, such as biological aerated filter, cyclic active sludge technology, sequencing batch reactor, and anoxic/oxic activated sludge process. Twenty-four-hour composite samples of raw wastewater were collected in polyethylene terephthalate containers by the staff of each plant on two consecutive weekdays in June 2015. A previous study suggested that the concentrations of COT and OH-COT were consistent between weekdays and weekends.7 Each WWTP also provided information on special events that occurring during the sampling period, flow variations (as measured by a flow sensor in the inlet of the WWTP), sampling mode, and sampling frequency. The population served by each WWTP was estimated using statistical data from the government. A solid-phase extraction with reverse-phase cartridges was applied for the cleanup of the wastewater sample. Liquid chromatography coupled with tandem mass spectrometry was then used to analyse the samples. The details of sample treatment, analysis (see online supplementary table S1), and chemicals used in this study can be found in the supporting information.

Back-calculation of NIC and tobacco consumption

The per cent of COT and OH-COT excreted, the molecular weight ratio between NIC and the metabolites, the flow rate, and the population served, were used to calculate the mass load of NIC consumed in each WWTP per day (mNIC), as summarised in equation 1.where, CCOT and COH-COT are the concentrations of COT and OH-COT, F the flow rate of raw wastewater in WWTPs, MNIC, MCOT and MOH-COT the molecular weights of NIC, COT, and OH-COT, xCOT and xOH-COT the excretion percentage of COT and OH-COT relative to NIC (%). The average of the amount of NIC consumed (mNIC_Mean) was calculated by multiplying each mass load estimate by the population-equivalent weight (equation 2).where mNIC,i is mass load of WWTP of i, WP,i the population-equivalent weight for WWTP of i, and n the number of the WWTPs from 1 to 11. The population-equivalent weight for each WWTP was calculated based on the population served and total population for all 11 WWTPs (equation 3).where Pi is the population served by the WWTP of i, and the total population from 11 WWTPs. From an epidemiological and public health perspective, a desirable goal would be to estimate the number of cigarettes consumed per smoker rather than the net mass of NIC within a community. Recognising this, the number of cigarettes consumed per smoker (nC) was calculated using equation 4.where D is the content of NIC in an average cigarette, Y the average yield of NIC uptake during smoking, R15 the ratio of population aged 15 years and older (15+) in Dalian and xSmoker the smoker ratio (15+) in China. D was estimated at 0.90±0.15 mg of NIC per cigarette sold in Chinese market. The value of Y was determined to be 0.66±0.19 (based on the amount measured for that cigarette brand by standard Federal Trade Commission method and metabolites of NIC in urine29). The values of 91% and 24% for R15 and xSmoker were used to calculate the number of cigarettes smoked per smoker.

Urinary excretion profile of NIC

Studies of NIC metabolism have been conducted over several decades. Many studies have reported excretory profiles of NIC administered through smoking, oral ingestion and transdermal administration.30–38 The analysis of compiled data suggests that the urinary excretion profile is quite similar when NIC is either administered through smoking or transdermal patches; however, the oral ingestion has higher extraction rates of OH-COT and COT (see online supplementary table S2). The main elements of the excretory profile of NIC are the NIC metabolites COT and OH-COT (and their conjugated forms), and NIC itself.39 The conjugated forms of these metabolites are completely transformed to the free form by β-glucuronidase enzymes from faecal bacteria in the raw wastewater.7 Therefore, the total amount (per cent of free and conjugated forms) of OH-COT and COT accounts for 43.4±13.8% and 32.3±8.0% of the total amount of NIC equivalents excreted when smoking is the main route of NIC administration. These mean excretion percentages were used to calculate the mass of NIC consumed.

Uncertainty analysis

The calculated estimates of tobacco consumption are based on the average values of the input parameters. However, their implementations are complicated since the parameters cannot be treated as fixed-point values: each parameter may take on a range of values depending on if the actual values are uncertain (eg, concentrations of COT and OH-COT), or if they vary from person to person (eg, excretion percentage of COT and OH-COT). The most effective quantification method for uncertainty and variability is to assign to each parameter a probability density function. The Monte Carlo approach (Oracle Crystal Ball software, V.7.3.1) allows the possibility of describing the uncertainty and variability associated with the input parameters, and incorporating them into the estimate of tobacco consumption. Selecting appropriate input distributions for uncertain and variable inputs is crucial to the integrity of Monte Carlo simulation results. These distributions of density functions can take on several different forms (eg, normal, lognormal, uniform, triangular). Normal distribution can be used to represent a quantity for which the underlying mechanism can be described by the central limit theorem, such as the result of a large number of additive independent errors. In this study, we assumed the flow rates, population, the content of NIC in cigarettes and the yield of NIC uptake during smoking were normal distributions, with a conservative estimate of 10% relative SD. The central limit theorem can also be used as the basis for selecting a lognormal distribution to represent a quantity. The lognormal distribution has often been found to be a good representation of positive real values and results from the production of many random variation of the dilution of pollutant concentrations. As such, the concentrations and excretion percentage of COT and OH-COT were taken as lognormal distributions. Online supplementary tables S3 and S4 show the description of the parameter distributions for Monte Carlo simulations. Sensitivity analysis shows how much each input parameter contributes to the uncertainty or variability of the estimations. In turn, it adds information on which portion of the variability is from natural fluctuation versus how much is caused by lack of knowledge. The contribution of an assumption to the total variance of the forecast is obtained as the square of the correlation coefficient normalised to the sum of the squared correlation coefficients (adjusted to 100%).

Results and discussion

Concentrations in wastewater

NIC, COT and OH-COT were detected in all 22 samples with average concentrations of 11.5±8.73, 2.33±0.30 and 2.76±0.91 µg/L (table 1), respectively. As expected, OH-COT concentrations were approximately 1.2 times higher than those of COT, in concordance with the known metabolic fate of NIC in humans (approximately 1.3 times). These values were highly correlated (R2=0.90). The concentrations measured in the samples collected on 11 WWTPs were very similar and stable, as expected. By contrast, parent NIC concentrations were higher than expected considering only urinary excretion, and showed variability across the different WWTPs. Cigarette butts and ash contribute to the amount of NIC in wastewater, suggesting that the human metabolites of COT and OH-COT are the best biomarkers for estimating tobacco consumption. NIC concentrations did not correlated well with either COT (R2=0.69) or OH-COT (R2=0.72).
Table 1

The concentration of NIC, COT and OH-COT in wastewater, flow rate, and served population, mass loads, and smoking cigarette number for 11 WWTPs in Dalian, China

WWTPsPopulation (×104)Flow rate (×104 m3/day)COH-COT (μg/L)CCOT (μg/L)CNIC (μg/L)Mass load (mg/day/capita)Cigarette number (cigarettes/day/smoker)
MYI35102.97±0.322.52±0.3215.9±5.471.8213.8
MER258.152.99±0.332.55±0.326.81±5.842.1015.9
LSH225.52.04±0.211.76±0.164.77±1.211.108.4
FJZ100.71.57±0.791.47±0.6310.2±9.250.251.9
LHT2782.30±0.141.79±0.073.88±1.101.4010.7
QSH19.53.43.50±0.103.56±0.6518.6±8.291.4410.9
SEG2083.51±0.053.06±0.2313.5±1.993.0623.2
CYI18.882.09±0.661.35±0.807.77±7.151.6912.9
CER28.2123.22±0.302.97±0.0614.7±0.623.0723.3
HTX8.12.51.77±0.281.03±0.220.67±0.741.007.6
XJH6.534.36±0.833.51±0.6229.2±3.174.2232.0

COT, cotinine; NIC, nicotine; OH-COT, hydroxycotinine; WWTP, wastewater treatment plant.

The concentration of NIC, COT and OH-COT in wastewater, flow rate, and served population, mass loads, and smoking cigarette number for 11 WWTPs in Dalian, China COT, cotinine; NIC, nicotine; OH-COT, hydroxycotinine; WWTP, wastewater treatment plant. These concentrations are in the same range of those measured by Lopes et al40 in Lisbon, Portugal (1.1–3.5 µg/L for COT) and slightly higher than those reported by Rodríguez-Álvarez et al6 in Spain (2.2–5.9, 1.0–1.6 and 1.8–2.8 µg/L for NIC, COT and OH-COT, respectively). The concentrations can be influenced by many factors, such as tobacco prevalence and flows arriving to the WWTPs.

Mass load of NIC consumed and uncertain analysis

The mass load of absorbed NIC during the sampling period ranges from 0.25 to 4.22 mg/day/capita, with an average of 1.92 mg/day/capita (table 1). The mass load of NIC consumed, reported in this work, are similar than those reported in Spain (1.8 mg/day/capita), and lower than in Italy (3.42 mg/day/capita). These differences in the mass load of NIC consumed may be explained by the underlying differences in tobacco consumption. Figure 1 shows the probability distribution density of the NIC mass load in Dalian generated by the Monte Carlo simulations. The figure shows the 10th centile, the central tendency of consumption (50th centile) and the reasonable maximum mass load (90th centile). The value of mNIC_Mean was estimated to be 2.04 mg/day/capita, ranging from 1.56 to 2.39 mg/day/capita in Dalian. The results reveal that the uncertainty of mass load, as defined by the ratio of the 90th–10th centile, is 1.5.
Figure 1

Distribution of estimated mass load of nicotine (mg/day/capita) in Dalian: mean, median, 10th and 90th centiles.

Distribution of estimated mass load of nicotine (mg/day/capita) in Dalian: mean, median, 10th and 90th centiles. Figure 2 shows the sensitivity analysis for mNIC_Mean and the eight most significant variables influencing mass load (>1%). The two most significant parameters influencing mass load were xCOT and xOH-COT, which contribute 52% and 31% of total uncertainty of mass load, respectively. By contrast, population, flow rate, and concentration combined only contribute 17% of the observed variance. In this analysis, it can be seen that variability of extraction percentage are far more important than the uncertainty about population, flow rate, and concentration to overall variance in mass load. The variability of extraction percentage for smokers refers to interindividual heterogeneity with respect to different extraction rates of OH-COT and COT. The mechanisms underlying these differences of urinary of NIC metabolites likely involve both genetic and behavioural factors.41 Variability is an inherent property of a system under study and, therefore, is irreducible. While the uncertainty of population, flow rate and concentration due to random or systematic error in measurement can be reduced with better data and/or better models. The main uncertainty of estimation results originates from the interindividual variability, which cannot be reduced through improving the measurement technique.
Figure 2

The results of sensitivity analysis for nicotine (NIC) mass load. xCOT and xOH-COT are excretion percentage of cotinine (COT) and hydroxycotinine (OH-COT) relative to NIC (%); Pcer and Fcer are the population and flow rate in wastewater treatment plant (WWTP) of CER; CCOT_cyi is the concentration of COT in WWTP of CYI; Pseg and Fseg are the population and flow rate in WWTP of SEG; Pmyi is the population in WWTP of MYI.

The results of sensitivity analysis for nicotine (NIC) mass load. xCOT and xOH-COT are excretion percentage of cotinine (COT) and hydroxycotinine (OH-COT) relative to NIC (%); Pcer and Fcer are the population and flow rate in wastewater treatment plant (WWTP) of CER; CCOT_cyi is the concentration of COT in WWTP of CYI; Pseg and Fseg are the population and flow rate in WWTP of SEG; Pmyi is the population in WWTP of MYI.

Consumption of tobacco and uncertain analysis

Given that mean value of 0.90 mg/cigarette of NIC content in the Chinese market, and 66% yield of NIC uptake, we estimated an average of 3.0 cigarettes/day/capita across Dalian. Assuming that 24% of population (15+) in China are active smokers, and 91% of population in Dalian are adults (15+), our procedure estimates that the average Dalian smoker consumed 14.6 CPD. This compares well with survey estimates of population smoking. The 2010 Global Adult Tobacco Survey found that adult Chinese smokers consumed, on average, 14.2 manufactured CPD.3 Similarly, a 2009 smoking prevalence investigation among urban residents of Liaoning province—which includes Dalian—found that the smokers consumed, on average, 14.2±0.3 CPD.42 Hence, the smoking rate obtained from sewage analysis shows good agreement with the smoking rate estimated from epidemiological survey data. The probability distribution density for consumed number of cigarettes per smoker in Dalian is shown in figure 3. Since this estimation is calculated as the product of several probability distributions, the mass load distribution shown in figure 3 is approximately lognormal. The estimated cigarette consumption ranged from 10 to 27 CPD, with a median of 16 CPD. The uncertainty and variability of number of cigarettes was estimated as 2.0. The probability distribution of daily cigarette consumption is consistent with the questionnaire review from Jiangsu Province in 2010, which showed the median number of cigarettes consumed per day was 15, and ranged from 10 to 20 for the 25th and 75th centiles.43
Figure 3

Distribution of estimated number of cigarette consumed (cigarettes/day/smoker) in Dalian: mean, median, 10th and 90th centiles.

Distribution of estimated number of cigarette consumed (cigarettes/day/smoker) in Dalian: mean, median, 10th and 90th centiles. The sensitivity analysis for number of cigarettes smoked shows that the four parameters of Y, D, xOH-COT and xCOT contributed to 63%, 20%, 9% and 5% of variance, respectively (figure 4). The contribution of the other parameter is lower than 1%. The content of NIC in one cigarette is the most important parameter than other factors, which contribute to almost half the total uncertainty. Owing to interindividual heterogeneity of three parameters of Y, xOH-COT and xCOT, further study on improving estimating of the true values of D should be done to reduce the uncertainty of estimation for cigarette consumption.
Figure 4

The results of sensitivity analysis for number of cigarettes consumed. xCOT and xOH-COT are excretion percentage of cotinine (COT) and hydroxycotinine (OH-COT) relative to nicotine (NIC) (%); Y is the yield of NIC during smoking, and D the content of NIC in one cigarette.

The results of sensitivity analysis for number of cigarettes consumed. xCOT and xOH-COT are excretion percentage of cotinine (COT) and hydroxycotinine (OH-COT) relative to nicotine (NIC) (%); Y is the yield of NIC during smoking, and D the content of NIC in one cigarette. In summary, the present study provides a systematic assessment of tobacco use in a city based on sewage epidemiology. Generally, the estimated tobacco consumption agrees quite well with those derived from a separate epidemiology survey. Monte Carlo simulation shows that the uncertainty of mass load and cigarette number are 1.5 and 2.0. The results of sensitivity analysis show that the interindividual variability plays an important role on uncertainty of estimation results. These data are the first published estimates generated using this tool for tobacco consumption in a Chinese city. Although sewage epidemiology has some major strengths, it is not without limitations. This approach gives no information on demographic characteristics of smokers. As such, it is unlikely that such an approach could entirely replace traditional epidemiological sampling. Further work is required to develop new techniques to reduce the uncertainty of consumption. Sewage epidemiology is a potential approach to estimate consumption of NIC, and could complement conventional socioepidemiological surveys, particularly when it comes to the real-time monitoring of the impact of new tobacco control policies.
  39 in total

Review 1.  Sampling for pharmaceuticals and personal care products (PPCPs) and illicit drugs in wastewater systems: are your conclusions valid? A critical review.

Authors:  Christoph Ort; Michael G Lawrence; Jörg Rieckermann; Adriano Joss
Journal:  Environ Sci Technol       Date:  2010-08-15       Impact factor: 9.028

2.  Economic burden of smoking in China, 2000.

Authors:  H-Y Sung; L Wang; S Jin; T-W Hu; Y Jiang
Journal:  Tob Control       Date:  2006-06       Impact factor: 7.552

3.  Estimating tar and nicotine exposure: human smoking versus machine generated smoke yields.

Authors:  F K St Charles; A A Kabbani; M F Borgerding
Journal:  Regul Toxicol Pharmacol       Date:  2009-08-31       Impact factor: 3.271

4.  Systematic and day-to-day effects of chemical-derived population estimates on wastewater-based drug epidemiology.

Authors:  Foon Yin Lai; Shalona Anuj; Raimondo Bruno; Steve Carter; Coral Gartner; Wayne Hall; K Paul Kirkbride; Jochen F Mueller; Jake W O'Brien; Jeremy Prichard; Phong K Thai; Christoph Ort
Journal:  Environ Sci Technol       Date:  2015-01-20       Impact factor: 9.028

5.  Flushing out smoking: measuring population tobacco use via wastewater analysis.

Authors:  Coral Gartner
Journal:  Tob Control       Date:  2015-01       Impact factor: 7.552

6.  A novel approach for monitoring tobacco use in local communities by wastewater analysis.

Authors:  Sara Castiglioni; Ivan Senta; Andrea Borsotti; Enrico Davoli; Ettore Zuccato
Journal:  Tob Control       Date:  2014-07-11       Impact factor: 7.552

7.  Assessment of local tobacco consumption by liquid chromatography-tandem mass spectrometry sewage analysis of nicotine and its metabolites, cotinine and trans-3'-hydroxycotinine, after enzymatic deconjugation.

Authors:  Tania Rodríguez-Álvarez; Rosario Rodil; María Rico; Rafael Cela; José Benito Quintana
Journal:  Anal Chem       Date:  2014-10-10       Impact factor: 6.986

8.  Estimation of amphetamine and methamphetamine uses in Beijing through sewage-based analysis.

Authors:  Jing Li; Linlin Hou; Peng Du; Jun Yang; Kaiyang Li; Zeqiong Xu; Congcong Wang; Huafang Zhang; Xiqing Li
Journal:  Sci Total Environ       Date:  2014-06-04       Impact factor: 7.963

9.  Simultaneous determination of nicotine and eight nicotine metabolites in urine of smokers using liquid chromatography-tandem mass spectrometry.

Authors:  Michael Meger; Irmtrud Meger-Kossien; Annette Schuler-Metz; Dinamis Janket; Gerhard Scherer
Journal:  J Chromatogr B Analyt Technol Biomed Life Sci       Date:  2002-10-05       Impact factor: 3.205

10.  Validation of a LC-MS/MS method for quantifying urinary nicotine, six nicotine metabolites and the minor tobacco alkaloids--anatabine and anabasine--in smokers' urine.

Authors:  James E McGuffey; Binnian Wei; John T Bernert; John C Morrow; Baoyun Xia; Lanqing Wang; Benjamin C Blount
Journal:  PLoS One       Date:  2014-07-11       Impact factor: 3.240

View more
  4 in total

1.  Human exposure of bisphenol A and its analogues: understandings from human urinary excretion data and wastewater-based epidemiology.

Authors:  Hao Wang; Ze-Hua Liu; Jun Zhang; Ri-Ping Huang; Hua Yin; Zhi Dang
Journal:  Environ Sci Pollut Res Int       Date:  2019-12-14       Impact factor: 4.223

2.  Increased levels of the oxidative stress biomarker 8-iso-prostaglandin F in wastewater associated with tobacco use.

Authors:  Yeonsuk Ryu; Emma Gracia-Lor; Richard Bade; J A Baz-Lomba; Jørgen G Bramness; Sara Castiglioni; Erika Castrignanò; Ana Causanilles; Adrian Covaci; Pim de Voogt; Felix Hernandez; Barbara Kasprzyk-Hordern; Juliet Kinyua; Ann-Kathrin McCall; Christoph Ort; Benedek G Plósz; Pedram Ramin; Nikolaos I Rousis; Malcolm J Reid; Kevin V Thomas
Journal:  Sci Rep       Date:  2016-12-15       Impact factor: 4.379

3.  Tap Water Contributions to Plasma Concentrations of Poly- and Perfluoroalkyl Substances (PFAS) in a Nationwide Prospective Cohort of U.S. Women.

Authors:  Xindi C Hu; Andrea K Tokranov; Jahred Liddie; Xianming Zhang; Philippe Grandjean; Jaime E Hart; Francine Laden; Qi Sun; Leo W Y Yeung; Elsie M Sunderland
Journal:  Environ Health Perspect       Date:  2019-06-06       Impact factor: 9.031

4.  Can wastewater surveillance assist China to cost-effectively prevent the nationwide outbreak of COVID-19?

Authors:  Ying Zhang; Kongquan Zhu; Weiyi Huang; Zhixuan Guo; Senhua Jiang; Chujun Zheng; Yang Yu
Journal:  Sci Total Environ       Date:  2022-03-21       Impact factor: 10.753

  4 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.