Literature DB >> 24738914

Predictors, indicators, and validated measures of dependence in menthol smokers.

Kimberly Frost-Pineda1, Raheema Muhammad-Kah, Lonnie Rimmer, Qiwei Liang.   

Abstract

This article presents a comprehensive review of the menthol cigarette dependence-related literature and results from an original analysis of the Total Exposure Study (TES), which included 1,100 menthol and 2,400 nonmenthol adult smokers. The substantial scientific evidence available related to age of first cigarette, age of regular use, single-item dependence indicators (smoking frequency, cigarettes per day, time to first cigarette, night waking to smoke), smoking duration, numerous validated and widely accepted measures of nicotine/cigarette dependence, and our analysis of the TES do not support that menthol smokers are more dependent than nonmenthol smokers or that menthol increases dependence.

Entities:  

Keywords:  CPD; FTND; Menthol; TTFC; addiction; dependence; smoking

Mesh:

Substances:

Year:  2014        PMID: 24738914      PMCID: PMC4104824          DOI: 10.1080/10550887.2014.909696

Source DB:  PubMed          Journal:  J Addict Dis        ISSN: 1055-0887


INTRODUCTION

A decade ago, concerns were raised that the addition of menthol to cigarettes may enhance addiction to smoking.[1] In 2009, Congress passed the Family Smoking Prevention and Tobacco Control Act (FSPTCA), which gave the Food and Drug Administration (FDA) authority to regulate tobacco products based on a public health standard. The FSPTCA directed the FDA to refer “the issue of the impact of the use of menthol in cigarettes on the public health” to the Tobacco Products Scientific Advisory Committee (TPSAC).[2] The TPSAC provided its report to the FDA in March 2011.[3] Since that time, the FDA has published its own Preliminary Scientific Assessment of Menthol in cigarettes.[4] Regarding the impact of menthol on dependence, both reports make conclusions suggesting that menthol is associated with increased dependence. Both reports relied heavily on unpublished and unadjusted analyses. The TPSAC report has not been updated since 2011 and much of the relevant dependence literature, including studies with validated dependence measures and menthol comparisons, is not included in the FDA preliminary report or reference addendum. We believe a thorough assessment of the scientific evidence demonstrates that menthol does not increase cigarette dependence. Our analysis of data from the Total Exposure Study (TES) further supports that menthol smokers are not more dependent on smoking compared with nonmenthol smokers. In our assessment of the topic, we rely on the peer-reviewed published scientific evidence.[4] Studies that included dependence predictors, indicators, and validated dependence measures, which are widely accepted in the scientific community, are included in our review. We also considered the type of statistical testing, whether adjustments were made to control for differences between groups, whether results were statistically significant, and whether there was sufficient detail provided to be able to reproduce the study or analysis. For completeness, we included all identified dependence-related menthol literature results. Those with nonvalidated measures and incomplete descriptions are included in the discussion. In this article, we also present original results from an analysis of data collected as part of the TES. The TES included 3,585 adult smokers from 31 states across the United States. The TES data were used to estimate exposure to tobacco smoke constituents,[6] examine differences in exposure by machine-derived tar yield categories and menthol status,[7,8] and compare biomarkers of potential harm in adult smokers and nonsmokers.[9] This specific analysis examines Fagerström Test for Nicotine Dependence (FTND) scores, FTND questions, and the Heaviness of Smoking Index (HSI) among 1,104 menthol and 2,481 nonmenthol adult smokers.

Predictor of Cigarette Dependence

The relationship between age of smoking initiation and dependence has been well studied. Early onset of smoking is associated with greater likelihood of developing dependence.[10] Hu et al.[11] reported that “early age of smoking onset [was]…significantly correlated with daily smoking and lifetime nicotine dependence.” Breslau et al.[12] found that after “controlling for sex and race, persons who smoked their first cigarette at 14 to 16 years of age were 1.6 times more likely to become dependent than those who initiated smoking at an older age (P = 0.03).” The relationship between early onset of smoking and dependence was also examined in the National Cancer Institute's (NCI) Monograph 20, which reported that “In terms of smoking trajectories, early smoking onset has been associated with steeper acceleration in smoking rate, greater persistence over time, and greater likelihood of developing dependence.”[10,13-15] In a large study examining the presence of dependence among smokers, Donny and Dieker[16] found that “non-dependent smokers initiated smoking and daily smoking at a later age.” More recently, Kendler et al.[16] concluded that “controlling for genetic and familial-environmental effects, age at onset of regular smoking predicted level of nicotine dependence.” Later smoking initiation is associated with lower cigarette consumption (frequency and cigarettes per day [CPD]), higher rates of smoking cessation, shorter smoking duration, and lower dependence.[10,13,18-25] Therefore, comparisons of age of first cigarette and age of daily smoking between menthol and nonmenthol smokers could be useful as a predictor of differences in dependence.

Indicators of Cigarette Dependence

Commonly used single-item dependence indicators include frequency of smoking, CPD, and time to first cigarette (TTFC). More recently, night waking to smoke has been identified as a dependence indicator. Smoking daily, smoking more cigarettes per day, smoking within 30 minutes, and night waking to smoke are listed as the “associated features” of tobacco use disorder in the Diagnostic and Statistical Manual of Mental Disorders, 5th edition (DSM-IV).[26] Non-daily or intermittent smokers often do not meet established dependence criteria. According to the DSM-IV, approximately 50% of daily smokers met DSM-IV criteria for nicotine dependence.[26] CPD and TTFC are the 2 main factors that drive FTND scores and together comprise the HSI.[27] TTFC is also associated with cigarette consumption, and CPD is associated with night waking to smoke.[28] CPD has been described as a proxy for dependence and scientists have evaluated “the importance of phenotype definition (i.e., CPD versus FTCD score as a measure of nicotine dependence) on genome-wide association studies of nicotine dependence.”[29] Rice et al.[29] concluded that “daily cigarette consumption and the Fagerström Test for Cigarette Dependence show different associations with polymorphisms in genetic loci” associated with nicotine dependence. The authors who analyzed the National Health Interview Survey (NHIS)[30] reported that “In 2011, an estimated 19.0% (43.8 million) of U.S. adults were current cigarette smokers. Of these, 77.8% (34.1 million) smoked every day, and 22.2% (9.7 million) smoked some days.” Recent estimates from the National Survey on Drug Use and Health (NSDUH)[31] suggest that among current cigarette smokers aged 12 years or older in 2011, 60.7% were daily smokers. Non-daily smokers often do not meet established dependence criteria, and studies have reported lower scores for intermittent smokers on multiple dependence measures.[32,33] Smoking frequency, CPD, TTFC, and night waking to smoke have all been reported as significant predictors of cessation outcomes but are not always consistent across studies.[25,28,34,35] For example, the Baker et al.[35] analysis reported TTFC predicted cessation, but TTFC was not a significant predictor of cessation in other studies.[28,36] Smoking duration has also been associated with cessation outcomes and dependence.[10,37,38] Researchers have used other dependence-related statements, questions, and nonvalidated scales to compare menthol and nonmenthol smokers. However, in the current review, we focus on widely accepted and validated indicators and measures.

Validated and Widely Accepted Measures of Cigarette Dependence

Widely used and validated measures of dependence have been described and reviewed by authoritative sources including the U.S. Surgeon General's Report,[37] the NCI's Monograph 20,[10] and the World Health Organization's International Agency for Research on Cancer[39] report. These measures include the following: FTND,[40] Fagerström Tolerance Questionnaire,[41,42] Cigarette Dependence Scale (CDS-12 and CDS-5),[43-45] HSI,[46] Nicotine Dependence Syndrome Scale,[47,48] Hooked on Nicotine Checklist,[49] Wisconsin Inventory of Smoking Dependence Motives,[50] DSM-IV,[51] and the International Classification of Diseases.[52] The FTND has been one of the most widely used extensively studied measures of dependence. The FTND and DSM-IV have been described as the “two gold standard measures for nicotine dependence.”[10] The FTND includes 6-items: number of cigarettes smoked per day, time to first cigarette, difficulty refraining from smoking when forbidden, smoking when ill in bed most of the day, which cigarette would hate most to give up, and smoking frequency[40,42] Based on the score, nicotine dependence has been classified as very low (0–2), low (3–4), medium (5), high (6–7), or very high (8–10).[53] Other researchers have used different classifications in their analysis, such as low/medium (0–5) vs. high (6–10) and low (0–3), medium (4–5), and high (6–10).[54] Recently, Dr. Fagerström has proposed that the FTND be renamed to the Fagerström Test for Cigarette Dependence (FTCD).[55] We use the FTND when results were reported as such. The HSI, which includes the FTND categories of TTFC and CPD,[46] is the shortest widely accepted and validated measure of dependence.

LITERATURE REVIEW METHODS

Identifying Menthol and Dependence Related Scientific Literature

In early 2010 and 2011, we conducted two detailed searches of PubMed and Scopus for any publication with the words “menthol” and “cigarettes” or “smoking.” Since 2011, we have continued to search the literature on a quarterly basis. This review is inclusive of publications that were available in English, either online or in print, prior to January 2014. We have attempted to be inclusive of all articles and all results relevant to nicotine/cigarette dependence in menthol and non-menthol smokers. Dependence measures and indicators are often reported as part of the sample characteristics in articles not focused on dependence.

LITERATURE REVIEW

Cigarette Dependence Predictor Results

Age of Initiation and Progression among Menthol and Nonmenthol Smokers  We identified 16 articles that compared the age of initiation or progression to regular smoking among menthol and nonmenthol smokers. These studies reported the mean age of first cigarette, mean age at first regular smoking, or compared the percentage of menthol and nonmenthol smokers in age categories for these two outcomes. Among the 9 studies we identified that examined age of first cigarette use among menthol and nonmenthol smokers, 7 reported no difference in mean age overall and among various subgroups[56-62] and 2 reported later age of first cigarette among menthol smokers.[62,63] In terms of age of regular smoking, we identified 9 studies. Seven reported no difference in the age of onset of regular smoking between menthol and nonmenthol smokers[57,60,65-69] and 3 reported a later average age of regular smoking for menthol smokers.[67,70,71] Overall, these studies consistently reported that menthol smokers have the same or later mean age of first use and the same or later mean age of regular smoking.

Cigarette Dependence Indicator Results

In this section, the menthol literature which includes commonly used single-item dependence indicators include frequency of smoking, CPD, TTFC, night waking to smoke, and smoking duration is reviewed. Smoking Frequency (Daily vs. Non-daily)  We identified 8 publications that included information on daily and non-daily smoking among menthol and nonmenthol smokers. Five studies reported that menthol smokers are less likely to be daily smokers.[67,70,72-74] Three other large scale analyses reported no difference in daily vs. non-daily smoking among menthol and non-menthol smokers.[63,71,75] Cigarettes per Day  We identified 30 studies and dozens of analyses within these manuscripts that provide information on CPD among menthol and nonmenthol smokers. With the exception of 1 publication,[76] these authors consistently report that menthol smokers smoke the same or fewer CPD compared with nonmenthol smokers. Dozens of analyses have reported no difference in CPD for menthol versus nonmenthol smokers among daily and non-daily smokers[77] by race/ethnicity;[65] within specific racial/ethnic groups, including African American/Black,[62,67,78,79] White,[58,62,67] Hispanic,[67,78,79] American Indian/Alaskan Native,[67] and Asian/Pacific Islander smokers;[67] among both men and women;[65,80] and overall.[54,57,60,62,68,80-84] Other studies and analyses found that menthol smokers reported statistically significantly fewer CPD compared with nonmenthol smokers. These analyses have reported fewer CPD among menthol versus nonmenthol smokers at baseline;[66] within specific racial/ethnic groups of smokers, including African American/Black,[58,85,86] Hispanic,[58,86] and White smokers;[78,79,85,86] among both men and women;[87] among White women, African American women, and African American men;[88] among former smokers and current smokers;[69,78] and overall.[36,58,61,63,64,67,70,79,89-91] The one analysis that reported higher cigarette consumption among menthol smokers may have had an error in the coding/analysis. Muilenburg and Legge[76] reported that menthol cigarette smokers, and specifically that African American underage menthol cigarette smokers, had the highest rates of cigarette consumption. However, the authors also reported that 81% of the African American smokers in the analysis reported smoking nonmenthol cigarettes. Such a high percentage of nonmenthol use among African American smokers is inconsistent with all other published analyses of the sociodemographic patterns of menthol cigarette use. Time to First Cigarette (TTFC)  We identified 19 publications and dozens of analyses of TTFC among menthol and nonmenthol smokers. For ease in comparing findings of the various studies, the results of the analyses are reviewed in sections on the first 30 minutes versus later, FTND TTFC categories, mean TTFC, and then other TTFC categorizations. TTFC Within First 30 Minutes vs. after 30 Minutes of Waking. With the exception of one published unadjusted analysis among African Americans[81] and one unadjusted analysis among non-daily smokers,[77] all other published studies report no difference for menthol versus nonmenthol smoking for TTFC within the first 30 minutes versus after 30 minutes of waking. Nine studies, which included studies with large diverse samples and multivariate analyses, report no difference in TTFC ≤30 minutes versus >30 minutes for menthol and nonmenthol smokers.[36,54,57,67,70,77,84,92,93] TTFC FTND categories (≤5, 6–30, 31–60, and >60 Minutes). Two studies reported the percentage of menthol and nonmenthol smokers in the original FTND TTFC categories. In one unadjusted analysis, Collins and Moolchan[82] reported a higher percentage of menthol smokers in the TTFC ≤5 minutes category, but no significant differences in the percentage of menthol and nonmenthol in the 6–30, 31–60, or >60 minutes TTFC groups.[82] The TTFC ≤5 minutes comparison was based on 12 nonmenthol smokers. The study was limited by an unequal sample size, small overall number of nonmenthol smokers (n = 41), and the lack of adjustment for differences between groups. Jones et al.[63] reported 4,603 adults, aged 20+ years who participated in the NHANES 1999-2010. The authors reported no statistically significant difference in the weighted percentage of menthol and nonmenthol smokers in the TTFC ≤5, 6–30, 31–60, and >60 minutes categories.[63] Mean TTFC. Two small studies and one large study reported mean TTFC among menthol and nonmenthol smokers. In a sample of 95 women, menthol smokers had a shorter mean TTFC.[94] Another study analyzed data from 127 adult smokers (60 menthol smokers and 67 nonmenthol smokers) and found no significant difference.[95] In an analysis of data from 46,273 current adult smokers, White menthol smokers had statistically significantly longer mean TTFC compared with White nonmenthol smokers (21 vs. 20 minutes), African American menthol smokers had statistically significantly shorter mean TTFC compared with African American nonmenthol smokers (21 vs. 25 minutes), and no other statistically significant differences were found for any other race/ethnicity groups.[70] Other TTFC categorizations. Five additional studies reported various other TTFC categorizations. These studies generally report findings that are mixed, with some results suggesting shorter TTFC, some longer TTFC, and some with no difference in TTFC for menthol versus nonmenthol smokers.[62,96,97] One publication included a cohort of 13,268 adult smokers with 5 years follow-up and found baseline menthol use was associated with smoking >60 minutes after waking and menthol smokers were statistically significantly less likely to report smoking within 10 minutes of waking at follow-up.[66] An analysis of 46,273 current smokers aged 18 years and older found no overall difference in the percentage of menthol vs. nonmenthol smokers who smoked in the first 5 minutes (22.27 vs. 22.17, respectively), in 6–10 minutes (9.11 vs. 9.51, respectively), 11–15 minutes (7.03 vs. 7.50, respectively), or 16+ minutes (59.09 vs. 58.52, respectively).[70] Of the nine CPD TTFC comparisons, only one was significant by menthol status, which was TTFC ≤5 minutes for those who smoked 6–10 CPD.[70] Night Waking to Smoke  Two studies reported on night waking to smoke among menthol and nonmenthol smokers. Bover et al.[28] report that “Night-smoking status was determined by an answer of ‘yes’ to the question ‘Do you sometimes awaken at night to have a cigarette or use tobacco?’” In their multivariate analysis of predictors, menthol smokers had an increased Adjusted Odds Ratio (AOR) for night waking to smoke compared with nonmenthol (AOR, 1.497 [95% confidence interval [CI], 1.195–1.874]); however, menthol was specifically tested and was not a significant predictor of 26-week cessation outcomes.[28] An unadjusted analysis from another study reported that a higher percentage of menthol smokers reported sometimes waking at night to smoke.[58] Smoking Duration  As mentioned in the introduction, smoking duration is associated with nicotine dependence and cessation outcomes.[10,36,38] Twelve studies were identified that included smoking duration comparisons by menthol status. Three studies reported no difference,[62,84,98] one study reported no difference and shorter duration for two different groups of menthol smokers,[83] and the other 8 studies reported shorter smoking duration among menthol versus nonmenthol smokers.[57,70,80,85,87,89,90,99]

Validated and Widely Accepted Measures of Cigarette Dependence Results

We identified 23 articles in our review.[32,56,57,60,68,73,74,80-84,89,92,95,97,98,100-105] Seventeen published studies included validated measures and a menthol comparison, 1 analysis included partial FTND scores, and 5 studies compared validated dependence measures among smokers in racial/ethnic groups with disproportionately high and low menthol use. These studies are summarized in Table 1.
TABLE 1.

Studies with Validated and Widely Accepted Measures of Nicotine/Cigarette Dependence

Study AuthorsPopulation/SampleFindings Related to Validated and Widely Accepted Measures of Nicotine/Cigarette Dependence
Allen & Unger[56]432 adult AA smokersNo significant difference by menthol status in odds of higher score on FTND for both women and men.
Benowitz et al.[95]127 adult smokersNo significant difference by menthol status in FTND scores.
Brody et al.[105]63 adult smokersNo statistically significant difference in FTND scores for menthol (mean, 4.1; SD±2.1) and nonmenthol (mean, 3.9; SD±2.4) smokers.
Collins & Moolchan[82]572 adolescent smokers (531 smoked menthol)No difference in FTND scores.
DiFranza et al.[102]237 adolescentsNo difference between menthol and nonmenthol on the HONC.
Duncan et al.[101]1,376 adolescents and young adults (12–33 years), 768 AA (56%) and 610 WhiteAmong ever smokers, AA were statistically significantly less likely to be DSM-IV dependent as compared to White (19.82 vs. 32.81, respectively, p<0.001).
Faseru et al.[57]540 AA light smokers (≤10 cigarettes per day) in a clinical trial for smoking cessationNo significant difference between menthol and nonmenthol smokers on numerous measures, including FTND.
Hooper et al.[103]3,396 current smokers from the Florida 2007 BRFSSMenthol smokers had statistically significantly lower mean scores on the NDSS in the unadjusted analysis. No significant difference between menthol and nonmenthol smokers in AOR of dependence (NDSS) in the multivariate analysis.
Kandel & Chen[38]12,550 White, 4,903 AA, 4,839 Hispanic current smokers (ages 12 and older) from the NHSDADespite higher percentage of menthol, minorities smoked significantly fewer CPD compared with Whites. Whites more likely than African-Americans to be DSM-IV dependent even controlling for CPD.
Li et al.[74]14 and 15 year olds in New Zealand. 2,387 menthol and 11,071 nonmenthol.The authors reported that the “multiple linear regression model did not find a significant result linking reported HONC score to menthol preference (coef. = –.21, P = .165).”
Luo et al.[92]2,925 White and AA adult smokers (not menthol specific)African-American smokers had lower FTND scores compared with Whites.
Marsh et al.[73]New Zealand youth surveys from 2004 (N = 564), 2006 (N = 334), and 2008 (N = 325)The authors found, “there was no evidence of an association between use of menthol and HONC scores.” Authors state “However, those preferring menthol-only had lower HONC scores than those preferring only nonmenthol.” Lower HONC scores among menthol-only as compared to those who smoke both types of cigarettes.
Moolchan et al.[100]115 treatment seeking adolescentsAfrican American adolescents had significantly lower FTND scores as compared with those who were not African-Americans.
Frost-Pineda et al. reported here3,585 adult smokers (1,104 menthol and 2,481 nonmenthol)No significant increased odds of menthol use for any of the FTND questions. Menthol cigarette smoking did not increase the odds of higher FTND scores regardless of how scores were categorized. Higher FTND scores were not associated with increased odds of smoking menthol cigarettes.
Muscat et al.[97]525 adult smokersNo significant increased odds of high FTND scores vs. low/medium FTND scores among menthol as compared to nonmenthol smokers (OR, 1.1, 95% CI, 0.6, 2.1).
Murray et al.[80]5,887 adult smokersAmong males and among females, respectively, there was no significant effect of menthol on partial FTND scores.
Mustonen et al.[88]307 White and AA adult smokers in a clinical study of NRT. Smoked at least 10 CPDNo difference in FTQ scores between White males, White females, African-American males or African-American females.
Okuyemi et al.[81]600 AA smokers in a bupropion trialNo significant difference in FTND scores for menthol compared to nonmenthol.
Okuyemi et al.[60]480 adult AA smokers at an inner-city health centerNo significant difference in FTND scores between menthol and nonmenthol cigarette smokers.
Okuyemi et al.[68]755 AA smokers in smoking cessation trialNo significant difference between menthol and nonmenthol on the NDSS or MNWS (a withdrawal scale).
Reitzel et al.[104]
183 adult smokers (83 menthol and 100 nonmenthol)There was no statistically significant difference in mean HSI score between menthol (3.60) and nonmenthol (3.73) smokers.
Reitzel et al.[98]1,067 adult smokersMenthol smokers had statistically significantly lower mean dependence scores as measured by the HSI (p = .01).
Rojewski et al.[84]166 adult smokersNo significant difference between menthol and nonmenthol smokers in mean FTND scores.
Winhusen et al.[83]510 adult smokersNo statistically significant difference in FTND scores by menthol status.

AA = African American; AI = American Indian; AN = Alaska Native; AOR = adjusted odds ratio; BRFSS = Behavioral Risk Factor Surveillance System; CPD = cigarettes per day; FTND = Fagerström Test for Nicotine Dependence; FTQ = Fagerström Tolerance Questionnaire; HONC, Hooked on Nicotine Checklist; HSI = Heaviness of Smoking Index; MNWS = Minnesota Nicotine Withdrawal Scale; NDSS = Nicotine Dependence Syndrome Scale; NHIS = National Health Interview Survey; NHSDA = National Household Survey on Drug Abuse; NRT = nicotine replacement therapy; PI = Pacific Islander; TTFC = time to first cigarette; TUS CPS = Tobacco Use Supplements to the Current Population Surveys

Studies with Validated and Widely Accepted Measures of Nicotine/Cigarette Dependence AA = African American; AI = American Indian; AN = Alaska Native; AOR = adjusted odds ratio; BRFSS = Behavioral Risk Factor Surveillance System; CPD = cigarettes per day; FTND = Fagerström Test for Nicotine Dependence; FTQ = Fagerström Tolerance Questionnaire; HONC, Hooked on Nicotine Checklist; HSI = Heaviness of Smoking Index; MNWS = Minnesota Nicotine Withdrawal Scale; NDSS = Nicotine Dependence Syndrome Scale; NHIS = National Health Interview Survey; NHSDA = National Household Survey on Drug Abuse; NRT = nicotine replacement therapy; PI = Pacific Islander; TTFC = time to first cigarette; TUS CPS = Tobacco Use Supplements to the Current Population Surveys Whereas the percentage of menthol smokers is higher, studies have reported that African American adolescent smokers have lower FTND scores and DSM-IV dependence compared with Whites.[38,100,101] Among adults as well, African American smokers were reported to have lower FTND scores and DSM-IV dependence compared with White smokers.[38,92] Among adolescents, studies have found no difference by menthol status on the Hooked on Nicotine Checklist,[73,74,102] and lower Hooked on Nicotine Checklist scores for adolescent preferring only menthol vs. only nonmenthol and compared to those who smoked both.[73] No difference by menthol status on the FTND was reported in another study of adolescents.[82] Other studies have reported no significant effect of menthol on partial FTND scores among adult men and women,[80] no difference by menthol status by race and gender in Fagerström Tolerance Questionnaire scores,[88] and no difference by menthol status on the Nicotine Dependence Syndrome Scale among adults.[68,103] Menthol smokers are also reported to score the same or lower on the HSI.[97,103] Nine studies among adults have found no difference by menthol status on the FTND.[54,56,57,60,81,83,84,95,105]

TES METHODS

Study Design and Conduct

The TES was a cross-sectional, multi-center, ambulatory study conducted at 39 clinical sites across the United States. Details about the design of the study have been reported elsewhere.[6,7,106] Covance Clinical Research Unit Inc. managed the recruitment of participants and study conduct. Healthy men and women who were aged at least 21 years at study entry were screened for enrollment. Adult smokers must have reported smoking at least one manufactured cigarette per day for at least the past year. They could not have used any other nicotine-containing products and must not have changed brands or have reported smoking more than 10% of their daily cigarette consumption outside their regular brand's tar yield category for the 3 months preceding visit 1. Participants were not eligible for inclusion if they were pregnant or nursing. Good Clinical Practice and the principles of the Declaration of Helsinki[107] were followed in all aspects of the TES. The study was Institutional Review Board–approved and informed consent was documented prior to participation.

Statistical Methods for FTND and HSI Scores between Menthol and Nonmenthol Smokers

Logistic regression models were used to examine the relationships between menthol smoking status and the FTND. The response variables were measures of nicotine dependence (FTND) for Model A and menthol smoking status for Model B. Model B was used to compare the results with previous publications in the literature. The explanatory factors included in the models were age (21–34 years, 35–49 years, 50 + years), gender (male or female), race (African American/Black or White), education level ( In Model A, in addition to using the conventional FTND levels as the response variable, several other FTND categories were used. In addition, the interaction term menthol status by race was included in Model A with the other mentioned explanatory factors. Each question of the FTND was also analyzed individually. In Model B, the probability of being a menthol smoker was modeled. In a separate model, TTFC was compared between menthol and nonmenthol smokers. In another model, the effect of menthol status on the HSI was tested. The SAS PROC LOGISTICS procedure was used to run the logistic regression models. Statistical significance was evaluated at P < .05. Missing values for any of the variables required for a specific analysis resulted in the observation being excluded from the analysis. SAS version 9.1.3 software was used to perform the statistical analysis.

TES Results

In the TES study, 30% of adult smokers reported they smoked menthol cigarettes. Twenty-two percent of White smokers and 73% of African American smokers smoked menthol cigarettes. Descriptive statistics for sociodemographic characteristics and smoking-related variables of menthol and nonmenthol smokers is presented in Table 2. Results are reported for African American and White smokers as there were few respondents from other Racial groups.
TABLE 2.

Descriptive Statistics for Demographics and Smoking History

CharacteristicMenthol (n = 1044)Nonmenthol (n = 2297)
Age (years)
 Mean (SD)41.8 (12.1)42.0 (13.0)
 Range (min, max)(21, 76)(21, 80)
Gender, No. (%)
 Female664 (63.6)1258 (54.8)
 Male380 (36.4)1039 (45.2)
Race, No. (%)
 African American448 (42.9)166 (7.2)
 White596 (57.1)2131 (92.8)
BMI (kg/m[2])
 Mean (SD)28.57 (7.33)27.31 (6.29)
 Range (min, max)(16.0, 66.7)(15.0, 70.0)
Annual Household Income, No. (%)
 <$20,000374 (36.0)604 (26.4)
 $20,000–$49,999451 (43.4)1083 (47.3)
 ≥$50,000214 (20.6)603 (26.3)
 Number missing57
Education, No. (%)
 <High school graduate114 (11.0)163 (7.1)
High school graduate756 (72.8)1745 (76.4)
College graduate168 (16.2)375 (16.4)
Number missing614
Region, No. (%)
 Midwest203 (19.4)525 (22.9)
 Northeast179 (17.1)251 (10.9)
 South471 (45.1)745 (32.4)
 West191 (18.3)776 (33.8)
Cigarettes smoked per day, Mean (SD) and No. (%)
 Mean (SD)15.0 (8.7)16.8 (9.0)
 Range (min, max)(1, 54)(1, 84)
 1–10 CPD374 (35.8)594 (25.9)
 11–20 CPD442 (42.3)1054 (45.9)
 21–30 CPD168 (16.1)479 (20.9)
 <30 CPD59 (5.7)165 (7.2)
 Number missing15
Tar category, No. (%)
 ≤2.9 mg154 (14.8)326 (14.2)
 3.0–6.9 mg198 (19.0)694 (30.2)
 7.0–12.9 mg239 (22.9)753 (32.8)
 ≥13.0 mg453 (43.4)524 (22.8)
Descriptive Statistics for Demographics and Smoking History

Results for FTND and HSI Analysis

Mean FTND scores were similar for menthol (4.5 [SD, 2.13]) and nonmenthol adult smokers (4.6 [SD, 2.14]). A histogram of the FTND scores is presented in Figure 1. After adjusting for covariates, the following factors were associated with higher odds of smoking menthol cigarettes in the logistic regression model: women compared with men; African Americans compared with Whites; smoking a cigarette ≥13 mg tar yield compared with cigarettes ≤2.9 mg tar yield and being aged 34–49 years versus aged 21–31 years (Table 3). No significant increased odds of menthol use for any of the FTND questions were found (Table 3).
FIGURE 1.

Histogram of FTND scores for menthol and nonmenthol smokers.

TABLE 3.

Odds of Menthol Use in the Total Exposure Study

CharacteristicNo.Percentage mentholOR for menthol*95% CI
Gender
 Male141926.81.00Reference
 Female192234.62.131.78 to 2.56
Age
 21–34 years104129.31.00Reference
 35–49 years132835.81.311.07 to 1.62
 50+ years97227.21.130.90 to 1.42
Race
 White272721.91.00Reference
 African American614739.537.52 to 12.09
 Education
 <High school graduate27741.21.00Reference
 High school graduate250130.20.850.62 to 1.16
 College graduate54330.91.250.86 to 1.82
Income
 <$20,00097838.21.00Reference
 $20,000–$49,999153429.41.040.84 to 1.27
 ≥$50,00081726.21.080.84 to 1.39
Tar Yield Category
 ≤2.9 mg48032.11.00Reference
 3.0–6.9 mg89222.20.980.73 to 1.30
 7.0–12.9 mg99224.11.260.95 to 1.66
 ≥13.0 mg97746.42.251.72 to 2.96
Time until first cigarette
 ≤5 minutes99733.80.880.62 to 1.25
 6–30 minutes142131.30.900.66 to 1.23
 30–60 minutes48624.50.700.50 to 0.98
 ≥60 minutes42832.21.00Reference
Hate most to give up
 First in the morning159234.21.100.91 to 1.32
 All other173627.91.00Reference
How many smoked/day
 10 or less740401.00Reference
 11–20162429.90.970.76 to 1.24
 21–3072525.71.040.76 to 1.41
 31 or more23030.41.400.93 to 2.10
↑ during 1 h waking/rest of day
 No191730.91.00Reference
 Yes140531.30.940.78 to 1.14
Refrain forbidden places
 No248030.81.00Reference
 Yes84432.41.080.88 to 1.32
Ill in bed most of the day
 No2010301.00Reference
 Yes131732.81.110.92 to 1.34

Odds ratio from logistic regression model adjusting for all other factors listed in the Table.

CI = confidence interval; OR = odds ratio.

Odds of Menthol Use in the Total Exposure Study Odds ratio from logistic regression model adjusting for all other factors listed in the Table. CI = confidence interval; OR = odds ratio. Histogram of FTND scores for menthol and nonmenthol smokers. Menthol cigarette smoking did not increase the odds of higher FTND scores regardless of how the FTND scores were categorized (i.e., in 5 categorizes, 3 or 2 categories [Table 4]).
TABLE 4.

Effect of Menthol Status on FTND Scores and Time to First Cigarette (Model A)

 Menthol statusOdds ratio95% CI
 Fagerström's categorization of the scores[a]
 Menthol1.050.91 to 1.22
 Nonmenthol1Reference
Low/Medium (0–5) vs. high (6–10) scores
 Menthol0.940.79 to 1.13
 Nonmenthol1Reference
Low (0–3), medium (4–5), and high (6–10) scores
 Menthol0.970.83 to 1.13
 Nonmenthol1Reference
Time to first cigarette: >30 minutes, ≤ 30 minutes
 Menthol0.880.72 to 1.05
 Nonmenthol1Reference

5 categories: very low: 0–2 points, low: 3–4 points, medium: 5 points, high: 6–7 points, very high: 8–10 points.

Note: Adjusted for age, race, gender, education and tar yield category.

No statistically significant difference was observed.

CI = confidence interval.

Effect of Menthol Status on FTND Scores and Time to First Cigarette (Model A) 5 categories: very low: 0–2 points, low: 3–4 points, medium: 5 points, high: 6–7 points, very high: 8–10 points. Note: Adjusted for age, race, gender, education and tar yield category. No statistically significant difference was observed. CI = confidence interval. The interaction term menthol smoking status (i.e., menthol or nonmenthol) by race (i.e., African American/Black or White) was not statistically significant in Model A. This indicates that there is no evidence that menthol smoking status affects FTND scores differently in African Americans/Blacks and Whites. Higher FTND scores were not associated with increased odds of smoking menthol cigarettes (Table 5).
TABLE 5.

Effect of the FTND Scores and Time to First Cigarette on Menthol Status (Model B)

MeasureNonmentholMentholOdds Ratio95% CI
5 categories: very low: 0–2 points, low: 3–4 points, medium: 5 points, high: 6–7 points, very high: 8–10 points
Very Low FTND4191860.840.64 to 1.12
Low FTND6523270.960.75 to 1.24
Medium FTND3861811Reference
High FTND6052360.890.69 to 1.16
Very High FTND206951.320.95 to 1.83
2 categories: low/medium (0–5) and high (6–10) scores
Low/Medium FTND14576941Reference
High FTND8113311.050.88 to 1.26
3 categories: low (0–3), medium (4–5) and high (6–10) scores
Low FTND6913401Reference
Medium FTND7663541.010.82 to 1.24
High FTND8113311.060.86 to 1.31
Time to First Cigarette (TTFC)
TTFC > 30 minutes6572571Reference
TTFC ≤ 30 minutes16367821.170.96 to 1.42

Note: Adjusted for age, race, gender, education and tar yield category. No statistical significance was observed at a P value < .05.

CI = confidence interval; FTND = Fagerström Test for Nicotine Dependence

Effect of the FTND Scores and Time to First Cigarette on Menthol Status (Model B) Note: Adjusted for age, race, gender, education and tar yield category. No statistical significance was observed at a P value < .05. CI = confidence interval; FTND = Fagerström Test for Nicotine Dependence Menthol smokers have about the same odds of smoking their first cigarette more than 30 minutes after they wake up as nonmenthol smokers when adjusted for the other factors (Tables 4 and 5). In addition, the interaction term, menthol smoking status (i.e., menthol or nonmenthol) by race (i.e., African-American/Black or White) was not statistically significant in Model A. No statistically significant effect of menthol was observed on HSI scores (Table 6).
TABLE 6.

Effect of Menthol Status on Heaviness of Smoking Index (HSI) Score

Menthol statusOdds ratio95% CI
HSI score
Menthol1Reference
Nonmenthol1.130.95 to 1.34

Note: Adjusted for age, race, gender, education, income and tar yield category.

No statistically significant difference was observed.

CI = confidence interval.

Effect of Menthol Status on Heaviness of Smoking Index (HSI) Score Note: Adjusted for age, race, gender, education, income and tar yield category. No statistically significant difference was observed. CI = confidence interval.

DISCUSSION

Our review of the scientific evidence included widely accepted predictors, indicators, and validated measures of nicotine/cigarette dependence that have been published in the peer-reviewed literature. We are aware of 4 other menthol analyses in the literature that include incomplete descriptions and measures that are not listed among validated measures.[10,37,39] These publications include three analyses of the National Youth Tobacco Survey by Wackowski and Delnevo[107] and Hersey et al.[109,110] and a report by Nonnemaker et al.[111] Mixed findings were reported in the odds of endorsing three[110] or four[108] dependence-related statements. It is problematic that although the models in both of these publications did not adjust for socioeconomic status, both did adjust their dependence-related statement analyses for frequency of smoking in the past 30 days and CPD, both of which are dependence indicators. Hersey et al.[109] reported that menthol smokers had a significantly higher odds of being above the median on a nicotine dependence scale for adolescents but no details about the scores (medians, means, SD or 95% CI) are provided. Nonnemaker et al.[111] reported a statistically significant association between menthol and higher levels of dependence in the third wave of the survey (β = 1.25; 95% CI, 0.10–2.4). However, it is not clear from the data presented whether this is a meaningful difference in scores. The analyses included a scale that was not validated, scores for menthol and nonmenthol smokers were not provided, and no adjustment was made for socioeconomic status.[111] Mean scores on the questionnaire were similar for White and African American adolescent smokers despite the difference in the proportion who reported menthol.[110] We note there are several instances where validated dependence measure comparisons between menthol and nonmenthol smokers have been made and presented to the FDA and TPSAC at public meetings, but the results are not included in subsequent publications. For example, Reitzel[112-114] presented analyses from 3 studies with 3 different populations to the TPSAC and the FDA Center for Tobacco Products showing that menthol smokers were not more dependent as measured by the Wisconsin Inventory of Smoking Dependence Motives (WISDM-68) and that there was no statistically significant difference on any of the 13 WISDM subscales in their multivariate analyses. These results are available online and are referenced in the TPSAC's report to the FDA Center for Tobacco Products,[3] but are not mentioned in the subsequent publications.[98,104,115] In the current study, we reviewed dependence-related predictors, indicators, and validated dependence measures in menthol versus nonmenthol smokers. We note that menthol cigarette smokers are not a homogenous population. There are notable sociodemographic differences between menthol smokers and nonmenthol smokers, and these differences (and differences in subgroups of menthol and nonmenthol cigarette smokers), if not controlled for, could affect measures of disease risk and behavioral outcomes. Analyses of national surveys report that menthol smokers are “mainly female, aged 45–64, non-Hispanic white, married, blue-collar workers, smokers who lived in the South and metropolitan areas and who reported having attained a high school diploma or GED.”[70] Based on the 2006/2007 Tobacco Use Supplement to the Current Population Survey, approximately 27% of current adult smokers in the United States report smoking menthol cigarettes.[115] The percentage of menthol use within each sociodemographic group varies. Specifically, the percentage of adult smokers who smoke menthol cigarettes is higher (>27% and non-overlapping 95% CI with other groups) among the following: Women compared with men. Those between ages 18–24 and 45–64 years compared with those who are aged 24–44 years and those who are 65+ years. African Americans compared with every other race/ethnicity group. Those who have a family income of <$25,000 per year compared with all other income groups. Those with some high school education compared with those in other educational attainment groups. Service workers compared with blue- and white-collar workers. The unemployed compared with those who are employed and those who are not in the labor force. Studies that adjust for these differences between menthol and nonmenthol smokers are better able to assess the impact of menthol on outcomes. Numerous publications have reported the different patterns of menthol use in various groups (by gender, race/ethnicity, age, etc.),[65,67,70,71,72] provided reasons for different patterns of use,[56,59,117,118] and commented on initiation among menthol and nonmenthol smokers.[102,111] Although this literature is important to understanding the overall public health implications of menthol versus nonmenthol smoking, it is beyond the scope of this review, which is focused on dependence. Because measures of dependence are often associated with measures of cessation, a comprehensive review of the cessation-related menthol literature would also be useful for the scientific community and regulatory agencies. Briefly, we recognize that there are numerous studies with cessation-related indicators and outcomes, such as quit intentions, thinking about quitting, confidence in quitting, motivation to quit, desire to quit, reasons for not quitting, quit attempts, relapse, length of abstinence, and short- and long-term cessation outcomes by menthol status that are also informative. A review of studies with long-term cessation outcomes (6 months to >5 years) also supports the conclusion that menthol does not increase dependence. Many studies have reported that there is no difference in cessation and no effect of menthol on various long-term cessation outcomes overall[28,61,66,68,80,81,85,96,104,115,119-123] or in specific subgroups, such as among White and Hispanic smokers[58] and among those who received placebo gum or motivational interview.[68] Fu et al.[35] reported that menthol smokers who received an intervention had increased odds of cessation as compared to nonmenthol smokers. The Hyland et al.[66] and Murray et al.[80] studies are particularly noteworthy because they included the largest cohorts and long length of follow-up (5 years). In our review of the dependence-related menthol scientific literature, we found 16 publications that compared age of initiation or progression among menthol and nonmenthol smokers. Overall, these studies consistently reported that menthol smokers have the same or later mean age of first use and the same or later mean age of regular smoking. Of the 8 publications that included information on smoking frequency, 5 reported menthol smokers were less likely to be daily smokers and more likely to be some day smokers as compared to nonmenthol smokers, and 3 reported no difference in smoking frequency. We identified 30 studies and dozens of analyses that provide information on CPD among menthol and nonmenthol smokers. More than two dozen analyses found no difference in CPD for menthol versus nonmenthol, including various subgroup analyses and in the overall sample. More than two dozen other analyses found fewer CPD for menthol versus nonmenthol smokers. Only 1 publication reported a higher cigarette consumption among menthol smokers, but it appears there may have been an error in the menthol/nonmenthol coding or analysis. With that one exception, all other studies and analyses report that menthol smokers smoke the same or fewer CPD compared with nonmenthol smokers. Our review included 19 publications and dozens of analyses of TTFC among menthol and nonmenthol smokers. The published literature related to TTFC includes various TTFC categories. Some publications have focused on the TTFC ≤5 minutes comparisons, whereas the TTFC >60 minutes comparison is equally important as a predictor of cessation outcomes.[35] Most studies that have examined TTFC within the first 30 minutes of waking and found no difference between menthol and nonmenthol smokers. Of the 2 studies that compared FTND TTFC categories, 1 had a small and unequal sample size of nonmenthol smokers and the other large study found no difference in any of the four TTFC categories. Studies that included other categorizations of TTFC and studies examining mean TTFC have reported mixed results, including shorter, longer, and no difference in TTFC. The available studies with large, diverse samples and multivariate analyses do not support that menthol smokers overall have shorter TTFC, and some results suggest longer TTFC. Of the 2 studies available that included a measure of night waking to smoke, both studies reported a higher percentage of menthol smokers reporting they sometimes wake at night to smoke compared with nonmenthol smokers. Of these 2 studies, 1 did not adjust for the differences between groups and the other found that menthol was not a predictor of cessation. Among 12 studies that examined smoking duration, 4 reported no difference in smoking duration and the other 8 reported shorter smoking duration among menthol versus nonmenthol smokers. Every published study available with validated and widely accepted dependence measures consistently found that menthol smokers scored the same or lower on established measures of nicotine/cigarette dependence as compared to nonmenthol smokers. The main limitation of this review and analysis is that most studies were not specifically designed to address the impact of menthol on cigarette dependence. Some studies had small and unequal sample sizes of menthol and nonmenthol smokers, and other studies did not control for differences between the menthol and nonmenthol groups. Although we attempted to be inclusive, there may be additional articles that include dependence measures or indicators as part of the description of sample characteristics that were not identified in our literature search. This review was focused on dependence related analysis and therefore is not inclusive of other menthol-related studies. Although the TES was not designed specifically to assess the effect of menthol status on dependence scores, to our knowledge, this analysis contains the largest sample to date for which overall FTND scores, the HSI, and the results for each of the FTND questions are examined.

SUMMARY AND CONCLUSIONS

The published literature does not support that menthol smokers are more dependent than nonmenthol smokers. Menthol smokers do not have an earlier age of first cigarette smoked or an earlier age of progression to regular smoking compared with nonmenthol smokers. Menthol smokers are not more likely to smoke daily, do not smoke greater CPD, do not consistently have shorter TTFC, and do not have longer duration of smoking. Most directly relevant to answering the questions surrounding menthol and dependence, the published literature consistently demonstrated that menthol smokers do not score higher on validated measures of nicotine/cigarette dependence. Our analysis of the TES data is consistent with the literature in that menthol status also had no statistically significant effect on any single item, the HSI, or overall FTND scores regardless of how the FTND scores were categorized. These results strengthen the existing scientific evidence which demonstrates menthol does not have an effect on nicotine/cigarette dependence.
  105 in total

1.  African-American teen smokers: issues to consider for cessation treatment.

Authors:  E T Moolchan; I Berlin; M L Robinson; J L Cadet
Journal:  J Natl Med Assoc       Date:  2000-12       Impact factor: 1.798

2.  Are age of smoking initiation and purchasing patterns associated with menthol smoking?

Authors:  Anita Fernander; Mary Kay Rayens; Mei Zhang; Sarah Adkins
Journal:  Addiction       Date:  2010-12       Impact factor: 6.526

3.  The intersection of gender and race/ethnicity in smoking behaviors among menthol and non-menthol smokers in the United States.

Authors:  Catherine Cubbin; Mah-Jabeen Soobader; Felicia B LeClere
Journal:  Addiction       Date:  2010-12       Impact factor: 6.526

4.  Urine menthol as a biomarker of mentholated cigarette smoking.

Authors:  Neal L Benowitz; Katherine M Dains; Delia Dempsey; Christopher Havel; Margaret Wilson; Peyton Jacob
Journal:  Cancer Epidemiol Biomarkers Prev       Date:  2010-10-20       Impact factor: 4.254

5.  Lung cancer risk among smokers of menthol cigarettes.

Authors:  William J Blot; Sarah S Cohen; Melinda Aldrich; Joseph K McLaughlin; Margaret K Hargreaves; Lisa B Signorello
Journal:  J Natl Cancer Inst       Date:  2011-03-23       Impact factor: 13.506

6.  Predictors of cessation in African American light smokers enrolled in a bupropion clinical trial.

Authors:  Babalola Faseru; Nicole L Nollen; Matthew S Mayo; Ron Krebill; Won S Choi; Neal L Benowitz; Rachel F Tyndale; Kolawole S Okuyemi; Jasjit S Ahluwalia; Lisa Sanderson Cox
Journal:  Addict Behav       Date:  2012-11-29       Impact factor: 3.913

7.  Mentholated cigarette use and lung cancer.

Authors:  S Sidney; I S Tekawa; G D Friedman; M C Sadler; D P Tashkin
Journal:  Arch Intern Med       Date:  1995-04-10

8.  Menthol cigarettes and health risks in Lung Health Study data.

Authors:  Robert P Murray; John E Connett; Melissa A Skeans; Donald P Tashkin
Journal:  Nicotine Tob Res       Date:  2007-01       Impact factor: 4.244

9.  Predictors of smoking cessation among African-Americans enrolled in a randomized controlled trial of bupropion.

Authors:  Kari Jo Harris; Kolawole S Okuyemi; Delwyn Catley; Matthew S Mayo; Bin Ge; Jasjit S Ahluwalia
Journal:  Prev Med       Date:  2004-04       Impact factor: 4.018

10.  Current cigarette smoking among adults - United States, 2011.

Authors: 
Journal:  MMWR Morb Mortal Wkly Rep       Date:  2012-11-09       Impact factor: 17.586

View more
  8 in total

1.  A Comparison of the Fagerström Test for Cigarette Dependence and Cigarette Dependence Scale in a Treatment-Seeking Sample of Pregnant Smokers.

Authors:  Ivan Berlin; Edward G Singleton; Stephen J Heishman
Journal:  Nicotine Tob Res       Date:  2015-05-19       Impact factor: 4.244

2.  Predictive Power of Dependence Measures for Quitting Smoking. Findings From the 2016 to 2018 ITC Four Country Smoking and Vaping Surveys.

Authors:  Michael Le Grande; Ron Borland; Hua-Hie Yong; K Michael Cummings; Ann McNeill; Mary E Thompson; Geoffrey T Fong
Journal:  Nicotine Tob Res       Date:  2021-01-22       Impact factor: 4.244

3.  Does menthol cigarette use moderate the effect of nicotine metabolism on short-term smoking cessation?

Authors:  Nancy C Jao; Anna K Veluz-Wilkins; Matthew J Smith; Allison J Carroll; Sonja Blazekovic; Frank T Leone; Rachel F Tyndale; Robert A Schnoll; Brian Hitsman
Journal:  Exp Clin Psychopharmacol       Date:  2017-06       Impact factor: 3.157

4.  Relationship of trauma exposure and PTSD to cigarette smoking prevalence, frequency, and quantity: Data from a nationally representative sample of U.S. adults.

Authors:  David Estey; Jonathan Platt; Renee D Goodwin; Andrea H Weinberger
Journal:  Psychol Trauma       Date:  2020-11-30

5.  Comparisons of three nicotine dependence scales in a multiethnic sample of young adult menthol and non-menthol smokers.

Authors:  Pebbles Fagan; Pallav Pohkrel; Thaddeus Herzog; Ian Pagano; Donna Vallone; Dennis R Trinidad; Kari-Lyn Sakuma; Kymberle Sterling; Craig S Fryer; Eric Moolchan
Journal:  Drug Alcohol Depend       Date:  2015-02-14       Impact factor: 4.852

Review 6.  Menthol cigarettes and the public health standard: a systematic review.

Authors:  Andrea C Villanti; Lauren K Collins; Raymond S Niaura; Stacey Y Gagosian; David B Abrams
Journal:  BMC Public Health       Date:  2017-12-29       Impact factor: 3.295

7.  Impact of Menthol Smoking on Nicotine Dependence for Diverse Racial/Ethnic Groups of Daily Smokers.

Authors:  Julia N Soulakova; Ryan R Danczak
Journal:  Healthcare (Basel)       Date:  2017-01-11

8.  Total Exposure Study Analysis consortium: a cross-sectional study of tobacco exposures.

Authors:  Andrew W Bergen; Ruth Krasnow; Harold S Javitz; Gary E Swan; Ming D Li; James W Baurley; Xiangning Chen; Lenn Murrelle; Barbara Zedler
Journal:  BMC Public Health       Date:  2015-09-07       Impact factor: 3.295

  8 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.