Literature DB >> 34925983

Effectiveness of the Internet-Based Versus Face-to-Face Interaction on Reduction of Tobacco Use Among Adults: A Meta-Analysis.

Ravi Kant1, Poonam Yadav2, Mukesh Bairwa3.   

Abstract

Literature reported the effectiveness of internet-based interventions over face-to-face interaction on tobacco quitting; however, limited sample size reinforces to integrate and analyze these studies' findings to reach a single conclusion. Therefore, we evaluated the effectiveness of the internet as an intervention approach versus face-to-face interaction on reducing tobacco use among adults. A systematic search was performed through various electronic databases such as Medline, PsychInfo, PubMed, Embase, Cochrane Central Register of Controlled Trials (CENTRAL), ResearchGate, Google Scholar, and Academia. Reference lists of the eligible articles were also screened. Full-text articles were included as per eligibility criteria (PICO framework). No ethnicity restriction was applied. A total of 13 studies were selected for meta-analysis, with 3852 and 3908 participants in intervention and control groups, respectively. Forest plot favours the intervention group at one month follow up for tobacco quitting (OR: 2.37, CI: 1.86-3.02, P=0.00001, I2=0%), at three months (OR: 1.88, CI: 1.48-2.40, P=0.00001, I2=42%) at six months (OR: 2.02, CI: 1.64-2.50, P=0.00001, I2=38%) and at one year of follow-up (OR: 1.43, CI: 1.18-1.74, P=0.00001, I2=36%) comparing to control group. Conclusively, internet and web-based interventions are highly useful in tobacco quitting at one month, three months, six months, and one year of follow-up compared to face-to-face interaction or no intervention, although the level of evidence was moderate. Additionally, limited trials in developing countries, arising need for research on internet use for tobacco control in developing countries.
Copyright © 2021, Kant et al.

Entities:  

Keywords:  adults; internet; meta-analysis; smoking cessation; tobacco

Year:  2021        PMID: 34925983      PMCID: PMC8654642          DOI: 10.7759/cureus.19380

Source DB:  PubMed          Journal:  Cureus        ISSN: 2168-8184


Introduction and background

Tobacco use is the leading cause of avertible and premature deaths worldwide. The burden of tobacco-related disease is increasing in developed and developing countries as well [1]. Interestingly, the deaths are declining in developed countries, and the burden is shifting to developing countries [2]. However, tobacco consumption pattern varies across gender; male vs. female, domicile; rural vs. urban, regions, cultural practices, and family income [3]. Men are more frequently (23%) indulging in tobacco use than their counterparts (3%) [4]. Quitting any form of smoking is challenging and involves physiological, psychological, and many other factors, including social and environmental milieu to become successful [5]. In the case of smoking cessation, the best use of positive and negative reinforcements helps alleviate the withdrawal symptoms, and the role of behavioral approaches in smoking cessation cannot be denied [6]. Over the years, many innovative forms of internet-based approaches have been tried to quit tobacco use globally. The use of health communication and internet-based interventions like tailored computerized programs, text messages, mobile or telephone, and WhatsApp for reminder or call, app-based intervention, chat-based instant messaging, video assistance using the website and mobile [5] and use of social media, has been vividly used in recent decades to quit smoking among different age groups [7]. Although there is ample research and data regarding the potential influence of the media [7], face to face health education, cognitive behavior therapy, motivational influences, and nurses-assisted counseling [4], on behavioral changes among smokers, there are scanty reports on the internet use or behavioral interventions. They are neither planned nor conducted rigorously to indicate firm evidence of any encouraging effects on health outcomes. Interestingly, the internet and other electronic platforms are abundantly present in this era and have almost become part and parcel of the health care system [2]. A medical expert with just a computer device and internet access, and some necessary handling skills can reach many people and communicate inexpensively. Though the effectiveness of internet-based and face-to-face interventions on quitting smoking are very well reported in the literature, every study carries one or another limitation in methodology and limited sample size. Therefore, it is required to integrate and analyze these studies' findings to reach a single conclusion. This study was planned to assess the effectiveness of the internet versus face-to-face interactions on reducing tobacco use among adults.

Review

Methods Data Sources and Search Strategy The electronic databases, such as Medline, PsychInfo, PubMed, Embase, Cochrane Central Register of Controlled Trials (CENTRAL), Google Scholar, ResearchGate, and Academia, were explored. Reference lists of the eligible articles were also screened. All relevant studies available on the topic were included irrespective of time duration. The systematic search was restricted to studies published in the English language. The keywords were "smoker or smokers OR smoking," "tobacco" OR cigarette OR nicotine OR smoking cessation OR "tobacco consumption OR cessation, OR abstain* OR quit* OR stop* OR computer OR computer-aided design, OR internet, OR computer, OR networks, OR media, OR cellular phone OR mobile, OR text OR message* OR SMS, OR web, OR electronic mail OR Chat, OR video recording. Eligibility Criteria (PICO Framework) for Participants Inclusion criteria were adults aged more than 18 years who use the internet or face-to-face interventions to reduce or quit tobacco use. No ethnicity restrictions were applied. Exclusion criteria were Cochrane studies that compare the internet to face-to-face interventions with other interventions. Intervention: Internet interventions such as Phone, mobile, WhatsApp, Facebook, Online network group, Online Support group, text messaging, other internet media. Comparator: Face-to-face interventions or no intervention in the comparator group. Face-to-face interventions include counseling, cognitive behavior therapy, or health education forms with control or routine care. Outcome: Post-intervention tobacco quitting - number of participants quitting tobacco after the intervention (internet use). Study design: This study is based on randomized controlled trials. Time frame: No restriction to the time frame was applied Screening of Eligible Studies A systematic search was done by two reviewers independently. After searching, studies were screened with titles and abstracts of respective studies. All selected studies were imported to Rayyan, a free web-based software. Two reviewers (PY and RK) screened the full text of articles based on eligibility criteria determined as per review protocol. Any relevant discrepancy has been resolved by consensus with the help of a third reviewer (MB). We adhered to the guidelines of Preferred Reporting Items for Systematic Review and Meta‑Analysis (PRISMA) 2009 [8]. PRISMA flow chart displays all the steps followed in the inclusion and exclusion of studies (Figure 1)
Figure 1

Flow chart (PRISMA)

PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses

Flow chart (PRISMA)

PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses Eligible studies were exported to RevMan software 5.4 (The Cochrane Collaboration, London, UK) [9] for data analysis. Forest plots have been created to present the results with Odds ratio (OR), confidence interval (CI), and effect size. The GRADE approach was also followed to explore the quality of evidence on high, moderate, and low levels [10]. RevMan files were exported to the GRADE Profiler to assess the quality of studies and create a "Summary of Findings" table (Table 1).
Table 1

Summary of findings table

aWide confidence interval

bHeterogeneity

OR: Odds ratio, CI: confidence interval, RCTs: randomized controlled trials 

OutcomesAnticipated absolute effects (95% CI)Relative effect (95% CI)No of participants (studies)Certainty of the evidence (GRADE)
Events in the control groupEvents in the internet intervention group
Tobacco quit at 1 month follow up105 per 1,000217 per 1,000 (179 to 261)OR 2.37 (1.86 to 3.02)2531 (5 RCTs)⨁⨁⨁◯ MODERATEa
Tobacco quit at 3 months follow up164 per 1,000269 per 1,000 (225 to 320)OR 1.88 (1.48 to 2.40)1733 (5 RCTs)⨁⨁⨁◯ MODERATEb
Tobacco quit at 6 months follow up125 per 1,000224 per 1,000 (190 to 263)OR 2.02 (1.64 to 2.50)2774 (6 RCTs)⨁⨁⨁◯ MODERATEa
Tobacco quit at one year follow up187 per 1,000248 per 1,000 (214 to 286)OR 1.43 (1.18 to 1.74)2757 (6 RCTs)⨁⨁⨁◯ MODERATE

Summary of findings table

aWide confidence interval bHeterogeneity OR: Odds ratio, CI: confidence interval, RCTs: randomized controlled trials Data Extraction Two reviewers (PY and RK) extracted the data from the full text of eligible studies. Corresponding authors of included studies were contacted for the relevant data. Data excel sheet was prepared to note the characteristics of selected studies. It includes the author’s name with publication year, country, sample size, the mean age of participants, male to female ratio, baseline tobacco consumption, and follow-up period after the intervention (Table 2).
Table 2

Baseline characteristics of included studies

Author/yearCountryInterventionsSample size intervention/control groupMean age of participants (years)Intervention/control group male/female (%)Baseline cigarette consumptionFollow-up
Brendryen and Kraft [11]NorwayA digital multi‐media intervention consists of more than 400 contacts by email, Web pages, interactive voice response, and short message service technology200/200 smokersIntervention - 35.9±10.0Intervention - 49.2/50.8%Intervention 18.3±5.9 cigs/day1, 3, 6, and 12 months
 Control - 36.4±10.5Control - 50.2/49.8 (%)Control 18.1±5.8 cigs/day 
Brendryen et al. [12]NorwayA digital multi‐media intervention consists of more than 400 contacts by email, Web pages, interactive voice response, and short message service technology without nicotine therapy144/146 smokersIntervention - 39.5±11Intervention - 50/50 (%)Intervention: 16.6±7.2 cigs/day1, 3, 6, and 12 months
 Control - 39.7±10.8Control - 50/50 (%)Control 17.6±7 cigs/day
Burford et al. [13]AustraliaA computer-generated photoaging intervention with no treatment group80/80 smokersIntervention - 24.2±4.1Intervention - 31.3/68.7 (%)Range- <1 to <21; intervention - 36.3%; smoked 11-20 cigs/daySIx months
 Control - 25.1±4.1Control - 43.8/56.2 (%)Control - 33.8%; smoked 11-20 cigs/day
Clark et al. [14]United StatesInternet resources for smoking cessation compared with written self-help material85/86 smokersIntervention - 57.8±5.2Intervention - 54/46 (%)Range - <10 to <31; intervention - 48%; smoked 11-20 cigs/dayOne year
 Control - 57.0±5.3Control - 48/52 (%)Control - 44%; smoked 11-20 cigs/day
Calhoun et al. [15]United StatesInternet intervention and telehealth medication clinic combined with a telehealth medication clinic for nicotine replacement therapy205/203 smokersIntervention - 43.3±13.6Intervention - 85/15 (%)Intervention - 15.7±8.8 cigs/smoking dayThree months and 12 months
 Control - 42.6±14.3Control - 84/16 (%)Control - 14.6±8.5 cigs/smoking day
Elfeddali et al. [16]NetherlandsWeb-based computer-tailored programs190/202Intervention - 40.75±11.48Intervention - 36.7/63.3 (%)Intervention - 19.89±9.36) cigs/smoking dayTwelve months
 Control - 40.68±11.81Control - 40.1/59.9 (%)Control - 19.85±8.39 cigs/smoking day
Japuntich et al. [17]United StatesThe website which provided information on smoking cessation as well as support140/144 smokersIntervention - 40.6±12.4Intervention - 45/55 (%)Intervention - 21.1±9.5 cigs/smoking daySix months
 Control - 41.0±11.8Control - 45.1/54.9 (%)Control - 22.1±10.2 cigs/smoking day
Lawrence et al. [18]United StatesPersonalized smoking cessation through an online life magazine257/260 smokersIntervention - 20.1±1.6Intervention - 24.6/75.4 (%)Intervention - 3.8±4.7) cigs/smoking day30 weeks
 Control - 19.8±1.6Control - 29.6/70.4 (%)Control - 4.2±5.0
McDonnell et al. [19]KoreaInternet self-help smoking cessation program272/315 smokersTotal 35 years (mean)Total - 12/88 (%)Total - 14 cigs/smoking dayTwelve months
Oenema et al. [20]NetherlandsAn internet-delivered computer-tailored lifestyle intervention1080/1079 smokersIntervention - 43.1±10.4Intervention - 46/54 (%)NAOne month
 Control - 44.1±10.4Control - 47/53 (%) 
Pisinger et al. [21]DenmarkInteractive, individual advice, newly developed by the Research Centre476/442 smokersIntervention - 49.63±16Intervention - 36.8/63.2 (%)Intervention - 18.12±10 cigs/smoking dayTwelve months
 Control - 46.97±17Control - 36.6/63.4 (%)Control - 16.25±8 cigs/smoking day
Smit et al. [22]NetherlandsA computer-tailored smoking cessation intervention through the Internet552/571Intervention - 48.4±12.2Intervention - 45.8/54.2 (%)Intervention - 20.8±13.7 cigs/smoking dayOne month and six months
 Control - 48.8±12.3Control - 49.4/50.6 (%)Control - 20.4±11 cigs/smoking day
Swartz et al. [23]United StatesA video-based internet site for smoking cessation and motivational materials171/180 smokersIntervention- control - 18-70 years (range)Intervention - 46.8/53.2 (%) Control - 8.9/50.6 (%)Range - <16 to >31; 32.3% smoked 16-20 cigs/dayOne month
Risk of Bias Assessment Two reviewers (PY and MB) independently assessed the quality of included studies. Risk of bias graph and summary has been created in Review Manager software 5.4 version under the heads of random sequence generation (selection bias), blinding of participants and personnel (performance bias), allocation concealment (selection bias), blinding of outcome assessment (detection bias), selective reporting (reporting bias), incomplete outcome data (attrition bias), and other bias [9] (Figure 2).
Figure 2

Risk of bias graph and summary

The reviewers independently assessed the quality of included studies [11-23]

Risk of bias graph and summary

The reviewers independently assessed the quality of included studies [11-23] Data Analysis Review Manager software 5.4 version was used for meta‑analysis [9]. The fixed‑effects model and effect measures were calculated as the OR with P-value < 0.05 considered statistically significant. I2 statistics with 25%, 50%, and 75% were measured to compute statistical heterogeneity in low, moderate, and high grades-tabulated data presented in a forest plot (Figures 3-6).
Figure 3

Forest plot comparing internet intervention with the control group

Tobacco quit at one month follow up [11,12,14,20,22]

Figure 6

Forest plot comparing internet intervention with the control group

Tobacco quit at one year follow up [11,12,14,16,19,21]

Forest plot comparing internet intervention with the control group

Tobacco quit at one month follow up [11,12,14,20,22] Tobacco quit at three months follow up [11,12,15,17,23] Tobacco quit at six months follow up [11-13,17,18,22] Tobacco quit at one year follow up [11,12,14,16,19,21] The funnel plots have also been created to assess the publication bias across studies. It measures an effect estimate against its standard error for an outcome (Figure 7).
Figure 7

Funnel plot: shows publication bias across studies for each outcome

(a) Tobacco quitting at one month, (b) tobacco quitting at three months, (c) tobacco quitting at six months, and (d) tobacco quitting at one year

Funnel plot: shows publication bias across studies for each outcome

(a) Tobacco quitting at one month, (b) tobacco quitting at three months, (c) tobacco quitting at six months, and (d) tobacco quitting at one year Tobacco quitting among participants has been analyzed at one, three, six, and twelve months of follow-up and presented in a forest plot. Results A total of 13 articles were found suitable for meta-analysis, with 3852 and 3908 participants in intervention and control groups [11-23]. All studies revealed data with a sample size ranging from 160 [13] to 2159 [20]. Baseline characteristics of included studies have been described in Table 1. All studies have nearly equal male and female participants. Only two studies Japuntich et al. and Pisinger et al. had majority of female participants (intervention - 75.4%/control - 70.4%) and (intervention - 63.2%/control - 63.4%), respectively [17,21]. Calhoun et al. had the majority of male participants in the intervention (85%) and control group (84%) [15]. Two studies measured the outcome at four steps: one, three, six months, and one year [11,12]. Two studies followed up the participants only for one month [20,23]. Two studies measured the outcome at six months only [13,18]. Calhoun et al. measured the outcome at three months and twelve months of internet intervention and telehealth medication clinic unite with a telehealth medication clinic for nicotine replacement therapy [15]. Even four studies assessed the outcome of tobacco use at one year of different web or internet-based interventions [14,16,19,21]. Subgroup analysis with tobacco quitting outcomes at one, three, six months, and one-year follow-up further lowers the heterogeneity across studies. Sensitivity analysis was done to find a better result with a random effect model. We observed similar results with the random effect model also. Pike et al. have been removed from the analysis due to the massive difference in the number of participants in both groups, creating heterogeneity [24]. The forest plot favors the intervention group (OR: 2.37, CI: 1.86-3.02, P=0.00001, I2=0%) in comparison to the control group for quitting tobacco at a one-month follow-up (Figure 3). The forest plot also favors the intervention group compared to the control group (OR: 1.88, CI: 1.48-2.40, P=0.00001, I2=42%) for quitting tobacco at three months follow up (Figure 4). The forest plot also favors the intervention group compared to the control group (OR: 2.02, CI: 1.64-2.50, P=0.00001, I2 =38%) for quitting tobacco at six months follow up (Figure 5). The forest plot also favors the intervention group compared to the control group (OR: 1.43, CI: 1.18-1.74, P-0.00001, I2 = 36%) for quitting tobacco at a one-year follow-up (Figure 6). The forest plot suggests significantly higher tobacco quitting events in the internet intervention group at one, three, six, and twelve months of follow-up of participants with moderate heterogeneity across the studies.
Figure 4

Forest plot comparing internet intervention with the control group

Tobacco quit at three months follow up [11,12,15,17,23]

Figure 5

Forest plot comparing internet intervention with the control group

Tobacco quit at six months follow up [11-13,17,18,22]

Risk of bias has been assessed and created a risk of bias graph and summary of included studies under the heads of selection bias, performance bias, detection bias, attrition bias, reporting bias, and any other bias observed across the studies. It depicts that there was no serious risk of bias across the studies (Figure 2). A funnel plot has been created to estimate the effect against its standard error for included studies in each outcome (Figure 7). Discussion Over the year, many innovative forms of internet-based approaches, i.e., tailored computerized programs, text messages, mobile or telephone, and WhatsApp for reminder or call, app-based intervention, chat-based instant messaging, video assistance using the website and mobile and use of social media [8], have been practiced commonly to quit tobacco in different age group population. Although, various methodological issues reduce the ability to esti­mate the effects of internet-based approaches. This study evaluated the impact of the internet approaches versus face-to-face interaction on reducing tobacco use in the adult population. Results suggest significantly higher tobacco quitting events in the internet intervention group than the control group at one month, three months, six months, and one year of follow-up of participants with moderate heterogeneity across the studies. Happy ending, a digital multi‐media smoking cessation intervention consisting of more than 400 contacts through emails, interactive voice response, Web pages, and short message service compared with self‐help booklet, reported higher point abstinence rates in the treatment group in the long-term effect of the intervention [11,12]. A written list of internet resources for smoking cessation was found more helpful than written self-help material to quit smoking for a long-term period of one year [14]. Internet-based self-help smoking cessation program, interactive, individual advice, multiple computer-tailored smoking cessation internet interventions, and a video-based internet site presented strategies for motivational materials and smoking cessation found no effect at six months of intervention but the significant effect at 12 months of follow up [19,21-23]. Personalized smoking cessation through an online life magazine in the young population enhanced smoking cessation at the end of 12 months [18]. Internet use and telehealth medication clinic combined with a telehealth medication clinic for nicotine replacement therapy reported no significant difference (17% vs. 12%) in comparison to clinical-based smoking cessation after three months of intervention [15]. However, Burford et al. compared a computer-generated photoaging intervention with no treatment group and reported a higher (27.5%) incidence of smoking quit than the control group (6.3%) at six months follow up [13]. Rabius et al. reported the follow-up response rate as 38%, and Feil et al. achieved 50% responses from participants with monetary incentives [25,26]. Findings were also reinforced by the researchers that the participants' loss inevitably influences research on the internet for health purposes [27]. After the quit attempts, web-based interventions could be more effective in preventing relapse in the long term, which requires adherence to the intervention for its effectiveness [12]. Additionally, the approach to a website supporting smoking abstinence is not related to smoking cessation [12]. Civljak et al. reported the strong effect of uniting tailored materials with nicotine replacement therapy on tobacco cessation and a significant positive impact of tailored materials among pre-contemplators [28]. The internet services should be based on their preference and easily accessible to those who want to quit smoking and seek related information through the internet, need to utilize the internet services for the same [29]. Presently, internet interventions' incremental cost is less than other modalities, facilitating and evaluating online programs' effectiveness [30]. Online interventions also can access smokers and support them in quitting tobacco, which is also firmly associated with the total and physical quality of life among adults [31]. Strength and limitations Subgroup analysis explored and discussed the possibility of tobacco quitting in the adult population at different time points. Sensitivity analysis strengthened the evidence by exploring possible alternate findings. Although there was a lack of uniformity of internet-based approaches in included trials, they had different internet approaches, which have also been discussed (Table 2). The risk of included bias in the individual trial also contributed towards the limitation of meta-analysis (Figure 2). This article is available on preprint server Research Square (https://www.researchsquare.com/article/rs-318627/v1).

Conclusions

This meta-analysis pooled the data of randomized controlled trials with a limited sample size. It winded up that internet use is highly effective in tobacco quitting at one, three, six, and twelve months of follow-up of participants compared to face-to-face intervention or no intervention with moderate heterogeneity across the studies. A moderate level of evidence supports the findings. Further studies are required to explore internet interventions' durable adherence among the adult population who spared their maximum time with the internet in any form. Additionally, limited availability of trials in developing countries requires research of internet use in developing countries to quit tobacco. Findings provide evidence to policymakers to utilize the internet as an effective instrument for tobacco control in their countries. Conclusively, this meta-analysis adds to the evidence for the promising approach of the internet-based intervention in modifying behavior, reducing tobacco use, and enhancing positive health practices among adults.
  27 in total

1.  Effectiveness of a computer-tailored smoking cessation program: a randomized trial.

Authors:  J F Etter; T V Perneger
Journal:  Arch Intern Med       Date:  2001-11-26

2.  Evaluation of an Internet-based smoking cessation program: lessons learned from a pilot study.

Authors:  Edward G Feil; John Noell; Ed Lichtenstein; Shawn M Boles; H Garth McKay
Journal:  Nicotine Tob Res       Date:  2003-04       Impact factor: 4.244

3.  A randomised control study of a fully automated internet based smoking cessation programme.

Authors:  L H G Swartz; J W Noell; S W Schroeder; D V Ary
Journal:  Tob Control       Date:  2006-02       Impact factor: 7.552

4.  The RealU online cessation intervention for college smokers: a randomized controlled trial.

Authors:  Lawrence C An; Colleen Klatt; Cheryl L Perry; Emily B Lein; Deborah J Hennrikus; Unto E Pallonen; Robin L Bliss; Harry A Lando; Dana M Farley; Jasjit S Ahluwalia; Edward P Ehlinger
Journal:  Prev Med       Date:  2008-05-02       Impact factor: 4.018

5.  The millennium development goals and tobacco control.

Authors:  Neil E Collishaw
Journal:  Glob Health Promot       Date:  2010-03

6.  Comparative Effectiveness of an Internet-Based Smoking Cessation Intervention Versus Clinic-Based Specialty Care for Veterans.

Authors:  Patrick S Calhoun; Santanu Datta; Maren Olsen; Valerie A Smith; Scott D Moore; Lauren P Hair; Eric A Dedert; Angela Kirby; Michelle Dennis; Jean C Beckham; Lori A Bastian
Journal:  J Subst Abuse Treat       Date:  2016-06-17

7.  Smoking cessation via the internet: a randomized clinical trial of an internet intervention as adjuvant treatment in a smoking cessation intervention.

Authors:  Sandra J Japuntich; Mark E Zehner; Stevens S Smith; Douglas E Jorenby; José A Valdez; Michael C Fiore; Timothy B Baker; David H Gustafson
Journal:  Nicotine Tob Res       Date:  2006-12       Impact factor: 4.244

8.  Development and implementation cost analysis of telephone- and Internet-based interventions for the maintenance of weight loss.

Authors:  Richard T Meenan; Victor J Stevens; Kristine Funk; Alan Bauck; Gerald J Jerome; Lillian F Lien; Lawrence Appel; Jack F Hollis; Phillip J Brantley; Laura P Svetkey
Journal:  Int J Technol Assess Health Care       Date:  2009-07       Impact factor: 2.188

9.  Cognitive-behavioral treatment with behavioral activation for smoking cessation: Randomized controlled trial.

Authors:  Carmela Martínez-Vispo; Rubén Rodríguez-Cano; Ana López-Durán; Carmen Senra; Elena Fernández Del Río; Elisardo Becoña
Journal:  PLoS One       Date:  2019-04-08       Impact factor: 3.240

10.  A digital smoking cessation program delivered through internet and cell phone without nicotine replacement (happy ending): randomized controlled trial.

Authors:  Håvar Brendryen; Filip Drozd; Pål Kraft
Journal:  J Med Internet Res       Date:  2008-11-28       Impact factor: 5.428

View more
  1 in total

1.  Comparative study of virtual and face-to-face training methods on the quality of healthcare services provided by Kermanshah pre-hospital emergency staff (EMS): randomized educational Intervention trial.

Authors:  Reza Farahmand Rad; Akram Zolfaghari Sadrabad; Reza Nouraei; Alireza Khatony; Homayoon Bashiri; Arezoo Bozorgomid; Shahab Rezaeian
Journal:  BMC Med Educ       Date:  2022-03-25       Impact factor: 2.463

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.