Which eHealth interventions are most effective for smoking cessation? A systematic review.

PURPOSE: To synthesize evidence of the effects and potential effect modifiers of different electronic health (eHealth) interventions to help people quit smoking.
METHODS: Four databases (MEDLINE, PsycINFO, Embase, and The Cochrane Library) were searched in March 2017 using terms that included "smoking cessation", "eHealth/mHealth" and "electronic technology" to find relevant studies. Meta-analysis and meta-regression analyses were performed using Mantel-Haenszel test for fixed-effect risk ratio (RR) and restricted maximum-likelihood technique, respectively. Protocol Registration Number: CRD42017072560.
RESULTS: The review included 108 studies and 110,372 participants. Compared to nonactive control groups (eg, usual care), smoking cessation interventions using web-based and mobile health (mHealth) platform resulted in significantly greater smoking abstinence, RR 2.03 (95% CI 1.7-2.03), and RR 1.71 (95% CI 1.35-2.16), respectively. Similarly, smoking cessation trials using tailored text messages (RR 1.80, 95% CI 1.54-2.10) and web-based information and conjunctive nicotine replacement therapy (RR 1.29, 95% CI 1.17-1.43) may also increase cessation. In contrast, little or no benefit for smoking abstinence was found for computer-assisted interventions (RR 1.31, 95% CI 1.11-1.53). The magnitude of effect sizes from mHealth smoking cessation interventions was likely to be greater if the trial was conducted in the USA or Europe and when the intervention included individually tailored text messages. In contrast, high frequency of texts (daily) was less effective than weekly texts.
CONCLUSIONS: There was consistent evidence that web-based and mHealth smoking cessation interventions may increase abstinence moderately. Methodologic quality of trials and the intervention characteristics (tailored vs untailored) are critical effect modifiers among eHealth smoking cessation interventions, especially for web-based and text messaging trials. Future smoking cessation intervention should take advantages of web-based and mHealth engagement to improve prolonged abstinence.

Plain language summary

Which eHealth interventions help people to stop smoking?

Background: Smoking is expected to kill 8 million people per year by 2030. New web-based and mobile phone applications are attractive platforms to help people quit. Electronic health (eHealth)/mobile health (mHealth) approaches (ie, health care practice assisted by electronic processes and communication) are easy to use, affordable, flexible and have a wide reach. We sought to identify which strategies work the best.

Study characteristics: Up to March 2017, this review found 108 trials from over 110,000 participants. We examined those that were web-based including those integrated with medication, mobile-based, SMS texts, computer-assisted and others like “video doctor”.

Key results: In combined results, web-based approaches and those using mobile-based approaches led to higher six-month quit rates than a nonactive comparison (eg, usual care, assessment only). Quit smoking programs with personalized messages were also likely to help. Other computer-assisted programs had lower quit rates and daily messages lower than weekly messages.

Quality of the evidence: The evidence was moderate to low quality. Studies at high risk of bias showed higher quit rates.

Implications for practice: Web-based and mobile health strategies help people quit smoking, although their effects are modest over a short period.

Implications for research: New and emerging interventions should be evaluated. More research should be conducted in low and middle-income countries.

Introduction

Smoking is a modifiable cause of mortality and morbidity. Globally, 5% of all deaths are attributed to smoking and 14% of adults over 30 years old are at risk of premature death from smoking-related diseases.1 It is predicted that tobacco use will be responsible for more than 8 million deaths worldwide per year by 2030 if effective interventions are not implemented.2 A reasonable approach to tackle the global burden of smoking could be to expand the accessibility of cessation programs to all smokers. Electronic health (eHealth) approaches are considered to have many advantages including 1) easy accessibility regardless of time and place; 2) affordability and efficient delivery; 3) wider reach to large populations; and 4) flexibility to enable proactive and tailored messages and allow matching to target user characteristics (for example, by age, sex, education, or quit plan).3 Thus, recent research has suggested that innovative, technology-based strategies can be applied to improve smoking cessation.4

The technology landscape is changing rapidly, with the growth of smartphone ownership globally, reaching approximately one-third of the world’s population. In 2016 there were an estimated 2.16 billion users with access to 70,000 health and fitness apps and 79,000 medical apps via the Apple App Store® and Google Play store®.5 This revolution in technology also offers great opportunities for clinical research and interventions using mobile health, defined as “medical and public health practice supported by mobile devices”.3,6 Mobile phone text messaging services have been piloted and implemented in some tobacco cessation programs.7–11 One limitation of this approach has been a focus on text message reminders for quitting smoking, while other potentially useful tools such as abstinence behavior tracking, peer group chats, and distractions remain unused.12 Perhaps the most serious limitation of mobile health (mHealth) technology assessment to date is the lack of engagement with underserved populations (eg, low-literacy groups, geographical areas with limited internet access, or poorer communities where there are multiple users per device).13

Most of the previous systematic reviews of eHealth interventions for smoking cessation have investigated the effects of specific devices upon smoking abstinence outcomes including internet/web-based cessation program,14–21 text messaging system,22–24 and computer-based program.25 The most recent systematic review pooled results from 67 studies and found a moderate effect on smoking cessation using web-based/internet penetration with behavioral support, compared to an nonactive control group (risk ratio [RR] 1.69, 95% CI 1.30–2.18).20 That review failed to detect the effect of web-based smoking cessation compared to active control group (RR 0.92, 95% CI 0.78–1.09).20 Similarly, another systematic review of 40 internet-based smoking cessation interventions suggested a moderate effect of the smoking cessation intervention using web-based/internet penetration (eg, websites, e-mail, and multimedia component) compared to assessment-only groups (RR 1.48, 95% CI 1.11–2.78) and a significant strong effect of systems that use interactive webpages compared to print materials (RR 2.1, 95% CI 1.42–2.97).19 Computer-delivered interventions were also found to improve knowledge, attitudes, and intentions related to various health behaviors including smoking cessation.25 Although web-based smoking cessation interventions are generally found to be effective in decreasing smoking prevalence in many studies, heterogeneity in effect sizes is a significant concern.26

Previous systematic reviews have focused on identifying and evaluating the mediators of intervention effects that use text messaging to improve smoking cessation.22–24,26 A Cochrane review that pooled data from 12 studies indicated that mobile phone-based smoking interventions resulted in a moderate increase in cessation (RR 1.67).24 A meta-analysis (in 2015), pooled effects shown in 35 studies using text messaging to improve health behaviors including smoking cessation, suggested that interventions, which are not theoretically grounded, have supplementary intervention activities and have 6–12 months duration, and are most effective. In contrast, tailoring, targeting, or personalization of SMS content did not moderate the effect of the interventions.27 A related issue is that there is a dearth of knowledge on how to improve user acceptance of mHealth smoking cessation interventions.12 The most comprehensive systematic review (conducted in 2012) on the efficacy of various eHealth interventions to improve smoking abstinence from 60 studies found that internet and other electronic platforms improved smoking cessation outcomes compared to control group with assessment only or printed materials (RR 1.32 for prolonged abstinence and RR 1.14 for point prevalence abstinence).28 The main limitation of that review, however, was the focus on smoking cessation among adults, with limited evidence for young smokers.

Most intervention researches to date have been restricted to narrow comparisons of a single eHealth platform among young smokers or adult tobacco users while other vulnerable subgroups such as people living with HIV, hospitalized patients, or opioid-dependent people were not included. Second, previous reviews have shown that combining multiple cessation services and tailoring them to the specific smoker is more effective than a single, broad-based intervention (eg, mHealth and internet-based services).12 How-ever, to our knowledge, there has been no comprehensive systematic review comparing direct effects, intervention cost-effectiveness, and potential effect modifiers among published eHealth platform interventions. Third, there is little evidence regarding the level of eHealth penetration on current smoking cessation trajectories. Finally, few studies have examined the effect modifiers that contribute to the prolonged effects of eHealth smoking cessation interventions. Thus, the purpose of this systematic review was to evaluate and compare the effectiveness and identify some potential effect modifiers of the most promising eHealth platforms in smoking cessation contexts including web-based, computer-based, and mobile phone-based programs to help smoking cessation seekers to quit. The effect modifiers were examined in relation to intervention characteristics (eg, tailored/interactive vs untailored/noninteractive), risk of bias, publication date, and study site. This study will extend knowledge of the efficacy and possible effect modifiers based on recent novel evidence and should be beneficial for evidence-based policy and decision making regarding stop-smoking programs.

Method

Protocol and registration

A review protocol was registered on the international prospective register of systematic reviews under number CRD42017072560 (https://www.crd.york.ac.uk/PROS-PERO/display_record.asp?ID=CRD42017072560).

Eligibility and exclusion criteria

Studies were included based upon the following PICO questions:

Population: current smokers in the general population;

Intervention: eHealth smoking cessation interventions were classified into four groups including:

Web-based interventions defined by a unique web-page/portal address that could be accessed online.

Computer-generated programs (alone) were those with a program/application running on PC/laptop foundation. In this method, the program must be downloaded and installed online or offline before using its resources.

Mobile-based interventions included any apps or text messages (SMS) and other communication via Wireless and mobile phone/cell phone technologies.

Other platforms: social media (Facebook, Twitter), Chat rooms, digital games, or specific devices aimed at improving smoking abstinence.

Interventions were considered to be “interactive” if information sharing and interaction with the target participants (based on their personal characteristics) were described in the intervention content. Tailored interventions were defined as individually personalized messaging or content delivery to participants.

Comparison: usual practice or other smoking cessation methods;

Primary outcomes: levels of smoking abstinence;

Included study designs: randomized controlled trial (RCT), quasi-experimental designs, interrupted time series, and controlled before–after studies.

We excluded studies if they 1) did not meet the inclusion criteria; 2) utilized eHealth methods (e-mail, website, and so on) primarily for data collection or sample recruitment; 3) had short-term follow-up (<1 month); and 4) were smokeless tobacco studies. Additionally, studies that focused on eHealth penetration on recruiting participants or smoking prevention without reporting on quitting smoking behaviors were excluded.

Search strategy

A systematic search was performed in March 2017 on four electronic databases including MEDLINE, PsycINFO, Embase, and Cochrane Library from inception. Table 1 lists the “text words” searches. We used multiple combinations of search terms and Boolean operators related to smoking, type of device, eHealth, and intervention. The search strategy was modified for each database by experienced experts and researchers. Additionally, reference lists of articles retrieved, and prior relevant systematic reviews were also scanned to determine the additional eligible documents. Table S1 describes the included studies. Open Grey and Google Scholar were searched to find any additional relevant reference, which might not be captured by the selected database searches.

Table 1

“Textword” searches

Topic	Key terms
Smoking	Tobacco, smok*, cigarette
Device	Mobile phone, smartphone, smart-phone, computer, tablet, handheld, cellular phone, cell phone
eHealth	Online, mobile, technology, electronic health, eHealth, chat room, social media, mobile application, mobile health application, mhealth, text messaging, telemedicine, internet, multimedia, web, electronic mail, e-mail
Intervention	Intervent*, prevent*, trial, campaign

Abbreviations: eHealth, electronic health; mHealth, mobile health.

Study selection

All references were exported to EndNote version X7 and duplicates were removed. Titles and abstracts were independently screened by two authors, HD and LN. The studies that did not meet the eligibility criteria were removed. Full texts of relevant information or those that required further clarifications were retrieved for the final assessment of data collection. A third review author (BT) made a final decision when two reviewers had differing opinions.

Data collection process

A structured data extraction form was first piloted by two reviewers (HD and LN) and then applied to all studies. Extracted data consisted of 1) description of participants, 2) study design, 3) timing, 4) sample size, 5) length of intervention and follow-up, 6) types of eHealth (web-based, computers, mobile phone-based, quit-line, and so on), 7) primary outcomes, 8) a brief description of experiment, 9) study findings and bias assessment, and 10) effect modifiers (eg, setting, intervention characteristics, year of publication, and risk of bias). Details of the conceptual frameworks were extracted if they were described in sufficient detail. The smoking cessation outcome was also extracted. If the published paper did not provide sufficient information, we searched for its protocol or contacted the authors for further detail.

After completion of the data extraction, the results of the two reviewers (HD and LN) were compared, discussed, and any disagreements were resolved before producing the final data. Senior researchers were consulted to address any disagreements. The meta-analysis was carried out using Review Manager (RevMan) Analyses Ver. 5.3.

The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guideline was used to describe the flow of the searching and screening.29

Data items

A summary matrix was created with the data extracted from all the included studies. This matrix listed all variables for which data were sought including PICO, length of follow-up, significant behavioral outcomes, theoretical framework, author recommendation, and bias appraisal.

Risk of bias in individual studies

The included studies were assessed for risk of bias using the Quality Assessment Tool for Quantitative Studies, developed by the Effective Public Health Practice Project (EPHPP).30 The EPHPP score ranged from 6 to 24 and global ratings were based on the number of weak ratings (no WEAK rating – strong “quality”, one WEAK rating – moderate “quality”, and more than two WEAK ratings – weak “quality”). Two independent reviewers assessed six potential biases including selection bias, study design, presence or absence of blinding, confounders, data collection bias, and attrition bias. Any disagreements between the two reviewers were discussed together and if necessary with coauthors for verification.

Summary measures

This review measured the difference in smoking abstinence prevalence by type of eHealth platform, population, and time points. Smoking point prevalence of abstinence at final follow-up (self-assessed abstinence or/with biochemically validated abstinence) was recorded as the primary outcome for treatment effect. Effectiveness was measured by 7-day point abstinence or prolonged abstinence interchangeably because these indicators are strongly related to each other, and it has been shown that the use of either does not affect the results.31 Further, we note that 7-day point abstinence prevalence is the most common measure in tobacco cessation intervention studies. Based on recommendations from the literature, we considered abstinence to be short-term if the intervention used was <6 months of follow-up, and longer-term abstinence if the intervention reported was ≥6 months of follow-up.32,33 The meta-analysis was performed based on the 7-day point prevalence abstinence (PPA) or prolonged abstinence indicator, stratified by follow-up time-points and effect modifier characteristics of the control group (Table 2). To address missing data, withdrawal and dropout cases were considered to be smokers, using results from intention-to-treat-analysis based on Cochrane Tobacco Group’s guideline.34

Table 2

Subgroups of effect modifiers employed in the meta-analysis and meta-regression

Effect modifiers	Subgroup
Follow-up time- points	1. <6 months of follow-up – short-term abstinence
	2. ≥6 months of follow-up – long-term abstinence
Effective public health practice project ranking	1. Weak quality (high risk of bias)
	2. Moderate quality (moderate risk of bias)
	3. Strong quality (low risk of bias)
Target population	1. Adult smokers
	2. Youths
	3. Other vulnerable subjects (chronic patients, pregnant women, and so on)
Tailored intervention	1. Tailored intervention
	2. Untailored intervention
Interactive intervention	1. Interactive
	2. Noninteractive
Frequency of text message	1. High frequency
	2. Low frequency
Control characteristics	1. Nonactive control group
	2. Active control group
	3. Other eHealth platforms
Location of trials	1. Developed countries (USA, EU)
	2. Less developed countries (rest of the world)
Theory-based intervention	1. Yes
	2. No
Clinician contact	1. Yes
	2. No

Abbreviation: eHealth, electronic health; EU, European Union.

Synthesis of results

RR and 95% CI were used to measure the difference in smoking abstinence prevalence between control and intervention groups for each included study. A meta-analysis was conducted using the Mantel–Haenszel fixed-effect approach to pool RRs. The I2 statistic was applied to assess the presence of substantial statistical heterogeneity with three cutoff points (LOW – I2 <25%, MODERATE – I2 from 25% to 75%, and HIGH – I2 <75%).35 The visual figure of funnel plots in RevMan5 was employed to assess any potential publication bias and no evidence of publication bias in included studies was found because the included studies distributed symmetrically around the mean. Each primary outcome was Grading of Recommendations Assessment, Development and Evaluation (GRADE) assessed and concluding statements were drawn based on the importance of the evidence to identify what the difference means (eg, may provide an effect [poorer cessation outcome] vs may increase cessation [better cessation outcome]).36

To examine further explanations of the high heterogeneity between studies, multi-meta-regression analyses were performed using restricted maximum-likelihood technique. The covariates, which are hypothesized to be effect modifiers, included 1) intervention characteristics (eg, interactive, tailored, frequent, and theory-based intervention); 2) risk of bias (EPHPP); 3) year of publication; and 4) country of study, stratified by three categories of eHealth platforms (ie, web-based, computer-assisted, and mHealth).

Results

Search outcomes

Figure 1 shows the flow of studies. Initially, 3,973 potentially relevant records were identified. After deduplication (n=239) and screening titles and abstract, 3,520 records were excluded. For the remaining 214 records, full-text papers were retrieved and assessed for eligibility. Only 124 papers met the inclusion criteria following further appraisal using the EPHPP tool. An additional 16 studies were excluded due to the focus on smokeless tobacco cessation,37–39 school tobacco control program,40–43 duplicate publication of study results,37,44–46 and eHealth intervention used for participant recruitment.47–51 In total, 108 studies met all selection criteria with 110,372 participants included in the review. High consensus (90%) was achieved between two reviewers.

Figure 1

PRISMA diagram of searching and screening process.

Abbreviation: eHealth, electronic health; PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses.

Study characteristics

Table 3 summarizes the main characteristics of the included studies in the review. All but one of the included studies were published in the 21st century (from 2000).

Table 3

General characteristics of included studies (n=91)

Characteristics	N	%
Publication year
• 2010 to Feb 2017	74	68.52
• 2000–2009	33	30.56
• 1999	1	0.93
Study designs
• Randomized control trial	105	97.22
• Quasi-experiment	2	1.85
• Controlled before–after studies	1	0.93
Intervention
• Web-based	67	62.04
• Computer-based	13	12.04
• mHealth (SMS, apps)	24	22.22
• Others (social media, chat-room, and other electronic aids)	4	3.70
Settings
• USA	58	53.70
• Europe	41	37.96
• Australia and New Zealand	6	5.56
• Asia	3	2.78
Participants
• Adults	64	59.26
• Youth (from 15 to 24 years old)	26	24.07
• Patients with chronic disease, pregnant women	18	16.67
Multiple eHealth platforms
• Single eHealth platform	43	40
• Multiple eHealth platforms	32	30
• Combined with non-eHealth platform	23	21
• Combined with financial incentives	4	4
Theoretical framework
• Transtheoretical model	25	23.15
• Cognitive-behavioral therapy	16	14.81
• Social cognitive theory	11	10.19
• Multitheories	20	18.52
• Not available	18	16.67
• Others	18	16.67
Method to confirm smoking status
• Self-report	74	68.52
• Biochemically validation (CO breath test or	34	31.48
urine test)
Length of follow-up
• From 1 to <6 months	32	29.63
• From 6 to 12 months	48	44.44
• More than 12 months	28	25.93

Abbreviations: CO, exhaled carbon monoxide; eHealth, electronic health; mHealth, mobile health.

Participants

Adult smokers were the main target population (n=64), followed by youth (n=18) and other subpopulations with special needs such as people living with HIV, COPD, or pregnant women. Most of the studies were implemented in the USA (n=58), Europe (n=41), and Asia and Australia regions (n=9). No studies were found in Africa.

eHealth interventions

This review captured 67 studies that used web-based programs, followed by wireless and mobile phone-based programs (n=24), and computer-assisted intervention (n=13). Social media, virtual chat room, or other electronic aids were investigated in four studies only.

Comparison

The included studies were dominated by two arms (n=82), following by three arms (n=20), four arms (n=4), and five arms (n=2).eHealth smoking cessation interventions were compared to nonactive control groups including usual care, self-help materials, assessment only (n=63); active control groups (eg, quit-line, face-to-face counseling) (n=13), and other types of eHealth interventions (n=30). Only two studies, the improvement of sleep or physical activity, were compared with non-smoking-cessation groups.

Outcome

Most of the studies measured abstinence from 6 to 12 months of follow-up (n=48), and some measured longer follow-up at more than 12 months (n=28). The remaining studies (n=32) measured short-term outcomes (from 1 to less than 6 months).

Risk of bias within studies

Figure 2 provides the risk of bias appraisal by individual studies, using the EPHPP tool. The average quality score among 108 included studies was 8.5 (described in Table S1). Attrition bias for noncompliance (less than 60%) was the major bias, accounting for 27% among 30 studies. Meanwhile, high risk of inadequate blinding was found in 22 studies due to the fact that participants were aware of treatment allocation while blinding of assessors was not reported clearly. Selection bias might have occurred in 18 studies since <60% of recruited respondents agreed to participate in the intervention. Data collection method was rated unclear/moderate bias in 27 studies due to self-reported assessment without biochemical confirmation of smoking abstinence. Overall, 18% of included studies (n=17) were deemed to be of weak quality (with two weak points). In contrast, the remaining part was of moderate and strong quality (41% vs 39%, respectively).

Figure 2

Risk of bias graph based on review authors’ judgments across all included studies.

Effectiveness of internet smoking cessation interventions

Web-based compared to nonactive control

The forest plot (Figure 3) shows a positive effect of web-based smoking cessation interventions compared to control groups. Twenty web-based trials reported higher abstinence prevalence compared to participants in the nonactive control groups who received minimal or no intervention, such as assessment only or printed materials for adult smokers,52–69 youth,70–78 and other smokers with special needs such as pregnant women,79 people with COPD,80 heart disease,81 cancer,82 or HIV/AIDS.83,84 When 23 studies about the prevalence of smoking abstinence were pooled together, the interactive, tailored, and web-based programs demonstrated increased cessation effects for 6-month follow-up interventions (RR 2.03, 95% CI 1.73–2.38), I2=27%, and a moderate increase of smoking cessation in 11 studies with less than 6 months of follow-up (RR 1.21, 95% CI 1.08–1.36, I2=20%). In contrast, no meaningful effect on quitting cigarettes was found after pooling eleven internet studies at 12 months of follow-up (RR 1.06, 95% CI 0.98–1.16, I2=47%).

Figure 3

Forest plot of web based intervention effects by characteristics of control group.

Abbreviations: M–H, Mantel–Haenszel; NRT, nicotine replacement therapy.

Interactive tailored web-based compared to an active control group

Five of 18 studies found significant long-term effects of the tailored proactive web-based interventions compared to active control activities such as a brief generic text advice,85 a noninteractive, nontailored internet,86 and a state-of-the-art tailored web-based tobacco interventions.87 Two studies detected a short-term effect at both 1 and 3 months when measuring the effect of the proactive website (Opptur/www.slutta.no)88 or a video-validated abstinence via financial incentives based on the Mōtiv8 website.89 Compared to an active control group, the web-based program tailored to participants’ characteristics indicated little or no increase of cessation effect (RR 1.09, 95% CI 1.02–1.17, I2=0%).

Web-based compared to other eHealth control groups

Eight studies compared the effects of online smoking cessation programs with other eHealth modes for adult smokers.85,90–96 Fraser (2014)90 concluded that website information without e-mail messaging had significantly increased smoking abstinence because messaging may undermine website utilization.90 McKay (2008) measured the abstinence difference between a website using a cognitive-behavioral therapy approach and a control group receiving physical activity advice, but no significant difference was detected at either 3 or 6 months of follow-up.91 Other RCTs compared the effects of interactive smoking cessation websites and multiple types of methods such as e-mail reminders or virtual groups,93,94 video messages vs SMS advice,85,95 and proactive telephone counseling.96 It was concluded that participants who used the video-based website were more likely to be abstinent than people receiving tailored feedback via plain SMS. Meanwhile, Swan (2010) indicated that compared to web-based counseling, proactive telephone-based counseling has a significant short-term effect at 3 months, but no substantial benefit at 6 months.96 When putting together the smoking abstinence prevalence from eight RCTs, web-based interventions had no additional effect on 7-day abstinence prevalence compared to other eHealth platforms (e-mail, video, and chat room) with RR 1.03, 95% CI 0.94–1.13, P=0.55. Statistical heterogeneity was moderate (I2=37%).

Web-based integrated with pharmacotherapy

Results from 11 studies offered nicotine replacement therapy (NRT) via webpage showed moderate effect (RR 1.29, 95% CI 1.17–1.43, P<0.001). Based on the GRADE guideline, these interventions probably increase cessation slightly due to statistical heterogeneity (I2=42%, P<0.001). Of the 11 studies, six had pharmacotherapy components that were associated with significant improvement in abstinence in webpage interventions vs control conditions. Brendyen (2008) emphasized that SMS and webpages with both e-mail and interactive voice response improved treatment outcomes (eg, repeated point abstinence, NRT adherence, and self-efficacy) compared to those who received only self-help material and NRT.53 Meanwhile, there was greater evidence of effectiveness when a tobacco tactics website was combined with nurse counseling via phone and NRT, when compared with eHealth smoking cessation intervention without human contact (eg, quit-line group,97 nicotine mini-lozenges supported by a website,90 a smoke-free”website for people living with HIV/AIDS,98 e-treatment software with mobile text messages,99 web-based smoking-cessation with tailored achievement stories100). In contrast, some RCTs were unable to show substantial effects of webpage smoking treatment plus NRT for HIV-positive smokers.101–103 Similarly, no significant treatment difference was detected in the internet-home-based program for adolescents compared to a clinic-based, individual counseling.104

Effectiveness of mHealth smoking cessation intervention

Mobile-based smoking cessation programs were conducted in eight studies for adult smokers,7–11,105–107 nine studies for young smokers,108–116 and five interventions (seven reports) for HIV-positive patients or pregnant smokers.117–123 Among 22 mHealth interventions, the significant effect on smoking abstinence was confirmed in five studies among adults,7,9,105–107 six studies among young smokers,109,111–114,116 and three smoking interventions for pregnant woman and HIV-positive patients.118,119,123 However, due to high heterogeneity (I2>81%), the effect of the study sample was not pooled by the meta-analysis.

Regarding mobile apps, only three studies examined the impact of mobile apps on improving smoking cessation. However, due to methodologic weaknesses, such as small sample size (eleven participants),124 no control group and short-term follow-up (1 week),125,126 three studies were excluded in the review. Figure 4 demonstrates the benefits of mobile-based smoking cessation intervention compared with various types of control groups.

Figure 4

Forest plot of mHealth intervention effects by characteristics of control group.

Abbreviations: eHealth, electronic health; M–H, Mantel–Haenszel; mHealth, mobile health.

mHealth interventions vs nonactive controls

Text messaging-supported cessation interventions were examined in eight studies, with comparisons to nonactive controls who received usual care or a quitting brochure only. Seven studies did not detect statistically significant differences between the conditions,10,11,114,118,119 even where there were fully automated tailored SMS,111 or mobile phone-delivered counseling combined with varenicline.121 Ferguson found that the text messages may support improved use of pharmacotherapy. It is also possible that the reverse is also true if medications promote the beneficial effects of a behavioral strategy.10 A statistically significant benefit of proactive counseling phone calls was detected by Vidrine (2015) in an effort to improve smoking abstinence through changing self-efficacy among HIV-positive patients.123 After including eight text messaging studies in the meta-analysis, the RR illustrated an important increase of cessation effect of text-messaging and cell-phone intervention, compared to nonactive control group (RR 1.71, 95% CI 1.35–2.16, I2=5%).

High-frequency SMS vs low-frequency control group

Four studies compared effects on smoking abstinence between text-message conditions (multiple SMS intervention vs single SMS per week) to explore the impact of SMS intensity on behavior change. Augustson (2016) developed an intervention that delivered smoking cessation advice via three messages daily, compared to the control group that received once-weekly SMS containing smoking health effects information only.8 Bramley (2005) utilized personalized SMS daily vs SMS monthly among the Maori population in New Zealand.108 Müssener (2016) designed a 12-week NEXit core program, which had 157 text messages compared to one text per 2 weeks in the control group. Only the NEXit core program detected a short-term effect of the intervention, whereas no significant effects were found in the other studies. An mHealth application used a camera phone to prompt participants to conduct exhaled carbon monoxide tests, in combination with a brief advice via mobile phone and transdermal nicotine. Participants in the intervention group received a prize for a negative exhaled carbon monoxide test outcome.105 However, no significant effect was found at 6 months of follow-up (OR =0.99, 95% CI 0.98–1.01). Due to high heterogeneity (I2=93%), the meta-analysis was not employed to pool the effects of these trials.

mHealth vs other eHealth platforms (webpage/social media/computer-based program)

Four studies evaluated the text messages program compared to website or computer-supported program. Abroms (2014) developed a Text2Quit program delivering automated, interactive text messages based on social cognitive theory with the supports of e-mails and a website, compared to a smoking cessation website (Smokefree.gov). This trial revealed a strong effect of the intervention with RR =2.22 (95% CI 1.16–4.26).7 Similarly, a 3-month mobile phone-based counseling intervention plus hotline for people living with HIV, compared with an audio computer-supported self-interview and quit advice in the USA, found that the treatment effect was maximized at 3 months (OR=4.3, P<0.001) and decline to 2.41 (P=0.49) at 6 and 12 months.117 In contrast, no significant difference was found between a text messaging program (onQ), which provided a daily SMS tailored to the participant’s progress toward quitting, vs a static website in Australia.106,127 After pooling, the mHealth effect was confirmed with RR =1.35, 95% CI 1.04–1.75. This group of three studies had no observable heterogeneity (I2=0%). This result suggested that the mHealth intervention via text messaging may increase cessation slightly compared to a website-only intervention.

Tailored SMS vs untailored SMS

Six studies compared the tailored SMS to general SMS. Three mHealth studies applied a text messaging quitting program called txt2stop that included motivational SMS and behavioral change encouragement plus a £20 prepaid voucher, while the control group received a general SMS on other health topics. Rodgers (2005) initiated a trial in New Zealand and Free (2005) piloted and adapted the trial for young smokers (>16 years) in the UK, along with a quit buddy and SMS regarding craving, before conducting a full trial in 2011. Roger (2005) found that the quit rate at 26-week follow-up was statistically greater in the intervention (7.5%) compared to the control group (4.6%), RR =1.64 (95% CI 1.12–2.42).113 The study by Free (2001) among 200 smokers found a short-term effect of smoking abstinence at 4-week follow up (RR=2.08) but not a statistically significant difference at 6 months of follow-up (RR=1.28).109 When the full trial was carried out among 5,800 smokers, participants in the intervention group received personalized SMS advice while the control group was delivered one untailored SMS/2 weeks. That study found a 6-month sustained benefit of the intervention on 7-day PPA and continuous abstinence (RR=1.32, 95% CI 1.19–1.47).110

Further evidence of a substantial effect of tailored text messages (based on quit stage) compared to text messages unrelated to smoking cessation in a control group was found in a trial conducted by Bock et al.9 When integrated with a video, the tailored text messages were not significantly beneficial to smokers after 6 months of follow-up, compared to a control group that received general health multimedia messages.115 A short-term improvement in smoking abstinence at 4 weeks of follow-up was found in a 6-week messaging program in the USA (OR 3.33, 95% CI 1.48–7.45) but when measured at 3 months, the effect was not statistically significant.116 The pooled effect of six studies demonstrated that tailored SMS may increase cessation (RR=1.8, 95% CI 1.54–2.1), but this result should be interpreted with caution due to significantly moderate heterogeneity among studies (I2=66%, P=0.01).

Effectiveness of computer-assisted smoking cessation intervention

Figure 5 illustrates that nine computer-assisted studies were conducted among adult smokers128–136 while only four studies were undertaken among young smokers (n=2),137,138 HIV patients, and pregnant women (n=2).139,140 Among adult smokers, six studies showed improved smoking abstinence.129–133,135 The pooled effect of nine intervention resulted in greater smoking abstinence prevalence compared to control groups (RR=1.19, 95% CI 1.09–1.29, P<0.001) and low heterogeneity (I2=0%). Similar results were found after pooling effects of two studies targeting patients (eg, HIV-positive patients, chronic patients) and pregnant women (RR=1.66, 95% CI 1.06–2.62, P=0.03, I2=0%). In contrast, two computer-based interventions among young smokers did not yield a statistically significant effect (RR=1.39, 95% CI 0.88–2.19, P=0.15, I2=0%).

Figure 5

Forest plot of computer-assisted intervention effects by characteristics of control group.

Abbreviation: M–H, Mantel–Haenszel.

Among six studies using computer-assisted smoking cessation interventions compared to nonactive control groups,129,131,133,134,136,141 only two studies using individualized and interactive expert system computer reports,132 and tailored computer-generated advice reports sent to smokers at strategically suitable times found greater 6-month treatment outcomes compared to control conditions.128,132 The pooled effect of eight studies revealed little or no increase of cessation (RR=1.16, 95% CI 1.06–1.26, P=0.0007, I2=7%). The stronger efficacy of computer-assisted intervention was demonstrated in the pooled effect of five studies130,135,137–139 (RR=1.31, 95% CI 1.11–1.53, P=0.001, I2=0%). However, all five individual studies did not find statistically significant difference between a computer-assisted program and active control groups receiving brief counseling,130,138 or self-help material,139 or telephone counseling.135 The total effect of computer-generated technology was pooled, and based on the results of 14 studies, the magnitude of effect was RR=1.21 (95% CI 1.11–1.31) with low heterogeneity (I2=0%).

Effectiveness of other eHealth intervention

The efficacy of integrated video features was investigated in three studies using a “video doctor” for pregnant women,141 a tailored video-based website,66 and video messages for adults.85 Due to the high heterogeneity of studies (I2=76%), the effect of the varieties of eHealth technology was not pooled via meta-analysis. Table 4 summarizes the effect magnitude of the three eHealth interventions, subgrouped by different comparison groups.

Table 4

Summary of findings on effects of eHealth smoking cessation interventions, based on GRADE guidelines

Outcome, follow-up	Summary of the effect (95% CI)	Number of participants and studies	Quality of the evidence (GRADE)	Summary for intervention
Web-based smoking cessation interventions
Web-based vs nonactive control
Cessation, >6 months	RR 1.06 (0.99–1.16)	11,344;	⊕⊕⊕⊖a	Probably little or no increase upon cessation
	Little or no increase	11 studies	Moderate
Cessation, 6 months	RR 2.03 (1.7–2.03)	5,560;	⊕⊕⊖⊖b	May increase cessation
	Important increase	7 studies	Low
Cessation, 1–6 months	RR 1.21 (1.08–1.36)	11,078;	⊕⊕⊕⊖a	Probably increases cessation slightly
	Moderate increase	5 studies	Moderate
Tailored web-based vs untailored control group
Cessation, any follow-up	1.09 (1.02–1.17)	23,493;	⊕⊕⊕⊖a	Probably little or no increase upon cessation
	Little or no increase	18 studies	Moderate
Web-based vs control group, both groups received NRT/counseling
Cessation, any follow-up	1.29 (1.17–1.43)	3,619;	⊕⊕⊕⊖a	Probably increases cessation slightly
	Moderate increase	11 studies	Moderate
Web-based vs other eHealth modes for cessation outcome
Cessation, any follow-up	1.03 (0.94–1.13)	15,568;	⊕⊕⊕⊖a	Probably little or no increase upon cessation
	Little or no increase	8 studies	Moderate
mHealth smoking cessation interventions
mHealth vs nonactive control
Cessation, any follow-up	1.71 (1.35–2.16)	2,942;	⊕⊕⊖⊖b	May increase cessation
	Important increase	9 studies	Low
High-frequency vs low-frequency SMS
Cessation, any follow-up	1.08 (1.02–1.15)	11,376;	⊕⊕⊖⊖a,c	May make little or no difference upon cessation
	Little or no increase	4 studies	Low
mHealth vs other eHealth modes
Cessation, any follow-up	1.35 (1.04–1.75)	2,389;	⊕⊕⊖⊖a,d	May increase cessation slightly
	Moderate increase	4 studies	Low
Tailored SMS vs nonsmoking/untailored SMS
Cessation, any follow-up	1.80 (1.54–2.10)	8,147;	⊕⊕⊖⊖a,c	May increase cessation
	Important increase	6 studies	Low
Computer-assisted smoking cessation intervention
Computer-based vs usual care
Cessation, any follow-up	1.16 (1.06–1.26)	1,703;	⊕⊕⊖⊖b	May make little or no increase upon cessation
	Little or no increase	9 studies	Low
Computer-based vs active control
Cessation, any follow-up	1.31 (1.11–1.53)	13,435;	⊕⊕⊖⊖b	May increase cessation slightly
	Moderate increase	5 studies	Low

Notes: Reasons for downgrading of quality:

downgraded 1 level for significant risk of bias;

downgraded 2 levels for serious risk of bias;

downgraded 1 level of inconsistency;

downgraded 1 level for imprecision. GRADE Working Group grades of evidence. ⊕⊕⊕⊕High quality: Further research is very unlikely to change our confidence in the estimate of effect. ⊕⊕⊕⊖Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. ⊕⊕⊖⊖Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate.

Abbreviations: eHealth, electronic health; GRADE, Grading of Recommendations Assessment, Development and Evaluation; mHealth, mobile health; NRT, nicotine replacement therapy; RR, risk ratio.

Core effect modifiers

Results from meta-regression in Table 5 show heterogeneity and identify sources of effect modifiers in the meta-analysis. The log RR was estimated to decrease by 0.146 per unit increase in the EPHPP ranking. In other words, studies that have high risk of bias are more likely to overestimate the effect of web-based smoking cessation interventions. On the other hand, for mobile-based smoking cessation, the treatment effect is moderated by the trial characteristics (eg, tailored content, frequent SMS) and country where the trial was conducted. Interestingly, the log RR was estimated to increase by 0.45 and decrease by 0.224 when quitting SMS was tailored to participants’ characteristics and daily SMS delivery, compared to untailored and weekly SMS, respectively.

Table 5

Core effect modifier using meta-regression, stratified by eHealth platforms

Covariates	Treatment effect Log RR (95% CI)	P-value
Web-based (n=58)
EPHPP ranking (weak–moderate–strong)	−0.146 (−0.250 to −0.041)	0.006
Interactive intervention (yes vs no)	0.030 (−0.120 to 0.179)	0.696
Tailored intervention (yes vs no)	−0.087 (−0.239 to 0.064)	0.259
Theory-based intervention (yes vs no)	−0.106 (−0.266 to 0.054)	0.196
Computer-assisted (n=14)
EPHPP ranking (weak–moderate–strong)	0.074 (−0.101 to 0.248)	0.407
Interactive intervention (yes vs no)	0.119 (−0.047 to 0.285)	0.16
Tailored intervention (yes vs no)	0.160 (−0.095 to 0.416)	0.219
Theory-based intervention (yes vs no)	−0.244 (−0.865 to 0.376)	0.440
Clinician contact (yes vs no)	0.086 (−0.169 to −0.341)	0.509
mHealth (n=21)
EPHPP ranking (weak–moderate–strong)	0.403 (0.221 to 0.584)	0.001
Interactive intervention (yes vs no)	−0.218 (−0.471 to 0.034)	0.09
Tailored intervention (yes vs no)	0.450 (0.185 to 0.714)	0.001
Frequent messages (high vs low)	−0.224 (−0.606 to −0.359)	0.025
Location of trial (less developed vs developed countries)	−0.483 (−0.606 to −0.359)	0.001

Note: The values in bold indicate P<0.05 (statistically significant value).

Abbreviations: eHealth, electronic health; EPHPP, Effective Public Health Practice Project; mHealth, mobile health; RR, risk ratio.

Discussion

This systematic review examined the efficacy of four eHealth behavioral interventions (internet-based, mobile-based, computer-assisted, and other electronic aids) in helping people to quit smoking. Unfortunately, most of the evidence for beneficial effects is limited to follow-up at 6 months or less, with few demonstrations of longer-term abstinence. This review also explored specific attributes of eHealth and other interventions that can contribute to successful smoking abstinence. Most of the studies were conducted in affluent countries such as the USA, Canada, Europe, Australia, China, and Japan where communications technology has been widely available over several decades. There is a lack of evidence from middle- and low-income countries in Asia and Africa, where there is limited access to coordinated eHealth efforts. Future eHealth smoking cessation interventions should be conducted in developing countries, focus on disadvantaged groups, and measure long-term outcomes for a more comprehensive evaluation of the effectiveness of technology-based interventions.

The duration of follow-up is a critical consideration. This review highlights the preponderance of studies of short-term abstinence (from 1 month to less than 6 months of follow-up) of web-based interventions and text messaging systems. Only two studies obtained substantially longer effects at 1 year of follow-up. Those interventions included a video-based computer-tailored program compared to a text-based version with brief generic text advice,85 and an internet and mobile phone-based version compared to printed material only.53 This is consistent with previous systematic reviews and confirms the promising impacts of technology-based interventions in behavioral change especially to sustain smoking cessation.18,22,23,28,142,143 Further investigations should be done to address the prolonged effect of the interventions.

After pooling findings from 67 internet smoking cessation studies, the strongest evidence of efficacy is for smoking cessation webpages compared to nonactive control conditions (no intervention, print materials only, assessment only) at 6 months of follow-up, and for joint pharmacotherapy plus web-based intervention. Previous reviews support the use of pharmacotherapy in combination with behavioral support, to improve cessation rates.21,144 Interactive and tailored web-based interventions have moderate effects on smoking abstinence compared to nonactive controls at 6 months or longer.20 This finding supports the efforts of health care providers and policymakers who seek to establish web-based smoking cessation interventions conjunctive with NRT. They may be especially helpful smokers in vulnerable groups, such as patients with HIV, COPD, and cancer and those undergoing treatment for substance use disorders.

When compared to active control groups or other eHealth modes, we could not find evidence of the effectiveness of internet-based tobacco cessation programs. This is consistent with an earlier Cochrane review, which concluded that eHealth smoking cessation interventions (eg, websites or text messages) may produce little or no increase in quitting compared to an active control group.20,21 Among 12 eHealth smoking cessation interventions conducted with vulnerable patient groups, including five web-based,80,81,118,119,123 three text-messaging systems,84,98 and two computer-assisted programs,139,140 the subgroup analysis suggested that the web-based and tailored text messaging supports may increase cessation while computer-assisted interventions alone have little impact on smoking abstinence. This suggests that tobacco cessation interventions via mobile phone and other wireless devices probably offer the best uptake.

The effect size of web-based and mobile-based smoking intervention is moderated by methodologic quality. The efficacy of text message smoking cessation trials was affected by the location of study, which is the best in the USA, Canada, Europe, Australia, China, and Japan, and characteristics of interventions (eg, personalized message and frequency of SMS received). The present review suggests that stop-smoking interventions via websites and SMS with a weak quality of methodology are likely to overestimate the smoking cessation outcomes. It is possible to hypothesize that participants are less likely to disclose their smoking status if there is only self-report measurement without bioverification (as typically exists for internet smoking cessation programs). Additionally, according to the present synthesis, it is clear that trials are challenged by the difficulty of establishing double-blinding in web-based environments. The participants may be aware of the allocated intervention trial conditions. If so, the effect size of eHealth interventions might be overestimated. Finally, a critical barrier for establishing effectiveness of online interventions is attrition bias, because the penalized imputation method is highly conservative (eg, missing cases are assumed to be continuing smokers). This problem was shown by Blankers et al (2016), where the estimated effects of internet-based smoking cessation interventions are more likely to overestimate outcomes in the conditions that have the higher retention rates.145

Among 24 mobile phone-based studies, 21 interventions utilized SMS-based reminders for smoking cessation and the three other studies provided counseling via cell phones for HIV-positive patients.117,122,123 Interestingly, all three mHealth programs for patients living with HIV/AIDS showed significant improvement in smoking abstinence at 3 months. Pooled, tailored text message interventions have a moderate effect on improving health behaviors. The strongest effect in mHealth experiments was contributed by nine studies that used tailored SMS. This emphasizes the benefits of tailoring the content of messages.20,24,146,147 To maximize the effect of individually tailored messages, mHealth smoking cessation intervention should pay attention to selecting a negatively framed health message (eg, severe smoking harm), usually appropriate for those who have a high degree of nicotine dependence, or positively framed health message, targeting smokers who have lower nicotine dependence (eg, emphasizing well-being after quitting).148

This review found that effect sizes from mobile-based smoking cessation interventions were moderated by the frequency of texts. Four studies investigated the impact of SMS frequency and no significant difference was detected when comparing high-frequency vs low-frequency SMS groups. This is consistent with previous reviews that found that the effect of health behavior change interventions in general and smoking cessation programs, in particular, might not be influenced by the message frequency.24,27,149 Quantity of text messages may not be critical in determining smoking cessation outcomes,147 but rather the effects may vary in relation to personal preferences, as some smokers like to receive fewer SMS per day.150 Some participants may feel annoyed by multiple reminders per day, leading to negative results. Some studies have noted the importance of texting during critical times at high risk of cravings for smoking (eg, morning after wake-up), rather than sending texts randomly throughout the day.151

The role of health care providers is crucial for technology-based interventions such as mobile text messages or e-mails from clinicians,99 or computer-generated expert letters,84 or online resources supported by nurses72 to assist high-risk smokers to reduce and cease tobacco consumption. Programs provided largely by nurses,152 dentists, or physicians help to effectively foster patients’ initial attempts to quit and help them consider using preferred smoking cessation technology platforms.153–155 For quit program developers it is often challenging to engage clinicians who are busy and not familiar with advanced technology. Clinicians may prefer face-to-face counseling that is coupled with eHealth interventions, with the goal of establishing rapport and improving communication between patients and practitioners.

Limitations

This review has limitations. First, with the rapid growth of technology, it was not possible for us to cover all studies and eHealth interventions worldwide. The English language criterion may also have restricted capture of international studies. Second, it was difficult to compare the overall effects across multiple studies because they calculated outcomes using different indicators (self-reported 7-day or 30-day PPA with or without biochemical validation) at different time points (24 hours, 7 days, 3 months, 6 months, and so on). The significant differences in study design and outcome indicators lead to high heterogeneity, and difficulty in pooling data on the effectiveness of some eHealth subgroups. Finally, this study did not take into account the contributions of user experience (eg, user satisfaction, perceived acceptability), which might moderate the effect size of eHealth/mHealth smoking cessation interventions.

Conclusions

This review found that smoking cessation interventions using web-based and mHealth approaches may increase cessation, but with moderate effects over short term periods. There is a clear need for more research in low- and middle-income countries. Considering all of the evidence together, the findings support the use of interactive, tailored, web-based and mobile phone-based smoking cessation interventions. Although the effect sizes are not high, even interventions that influence a minority of smokers to quit are worthwhile, as the cost per person is generally low. Policymakers should encourage the use of eHealth interventions by health professionals, and provide resources to ensure that expertise, intervention materials, and funded programs are authentic and sensitive to the characteristics and needs of target populations.