Combined administration of problem- and lecture-based learning teaching models in medical education in China: A meta-analysis of randomized controlled trials.

INTRODUCTION: The aim of this meta-analysis is to assess the effectiveness of the combined administration of problem-based learning (PBL) and lecture-based learning (LBL) teaching models in Chinese medical education.
MATERIALS AND METHODS: We searched the following Chinese electronic databases: China National Knowledge Infrastructure, WanFang Data, China Science Periodical Database, and the Chinese BioMedical Literature Database. We also searched the following English electronic databases: PubMed, Embase, Cochrane Central Register of Controlled Trials, and Google Search Engine. We searched for published studies involving the combined administration of PBL+LBL teaching models in Chinese medical education. All randomized controlled trials were included. The focus of the meta-analysis was on the outcomes of knowledge scores, skill scores, medical writing scores, comprehensive ability scores and teaching satisfaction. A subgroup analysis was also performed.
RESULTS: A total of 23 RCTs were included, with a total sample size of 2589 medical students. The PBL+LBL teaching model significantly increased knowledge scores (95% CI, 2.85-5.78; P < .00001), skill scores (95% CI, 0.51-3.71; P = .01), medical writing scores (95% CI, 1.04-4.04; P = .0009), comprehensive ability scores (95% CI, 2.04-8.71; P = .002) and teaching satisfaction (RR, 1.32; 95% CI, 1.10-1.59; P = .003) compared with the LBL teaching model alone. Additionally, a subgroup analysis showed significant differences in the effect of PBL+LBL on knowledge scores, medical writing scores, and comprehensive ability scores when comparing practical and theoretical courses. Another subgroup analysis that looked at the level of training showed that the PBL+LBL teaching model also significantly improved the knowledge scores of Freshman, Sophomore, Junior, Senior and Masters students. DISCUSSION AND
CONCLUSIONS: Based on the current evidence, this meta-analysis showed that the PBL+LBL teaching model is an effective way to increase knowledge scores, skill scores, medical writing scores, and comprehensive ability scores and to improve teaching satisfaction.

Introduction

Problem-based learning (PBL) was originally introduced as a new teaching model at McMaster University in Canada in the 1960s.[ PBL is a student-centered teaching model, advocating students’ autonomous learning and aiming to fully mobilize students’ enthusiasm for learning.[ In China, PBL teaching reforms have largely been applied to clinical medicine courses, and these reforms have affected teaching effectiveness.[ Compared with traditional lecture-based learning (LBL), many studies have shown that PBL students are better at solving problems and learning autonomously than those in a traditional curriculum.[

Recently, an increasing number of studies have focused on whether the combined application of PBL and LBL teaching models has additional benefits in medical education when compared with only PBL or LBL teaching models.[ Although multiple studies over the last decade have assessed the possible alternatives of PBL+LBL in clinical medicine education in China,[ no study has evaluated all available level I trials defined as prospective randomized controlled trials (RCTs).[ A meta-analysis regarding the application of PBL+LBL in physical diagnostics education regarding Chinese medical students has been reported;[ however, this study is lacking in 2 aspects. First, RCTs are considered the gold standard for assessing the efficacy and safety of clinical interventions compared to non-RCTs.[ We found that a large number of non-RCTs were included in this previous meta-analysis. Therefore, the methodology quality and deficiencies of the non-RCTs should be considered due to the potential bias in the clinical outcome. Second, more high-quality and well-designed RCTs have been published and have shown different results over the past few years. Thus, the current authors performed an updated meta-analysis to assess the highest evidence-based (level I) studies to investigate the effectiveness of PBL+LBL in medical education in terms of

knowledge scores,

skill scores,

medical writing scores,

comprehensive ability scores, and

teaching satisfaction.

Subgroup analyses were conducted to evaluate the benefits of the application of different types of courses in terms of knowledge scores, skill scores, medical writing scores, and comprehensive ability scores, as well as teaching satisfaction. Additionally, another subgroup analysis was performed for the level of training regarding the knowledge scores.

Materials and methods

The method used for this meta-analysis is based on the recommended PRISMA checklist guidelines.[ Ethical approval is unnecessary because it is a review of previously published articles and does not involve any processing of individual patient data.

Search strategy

We searched the following Chinese electronic databases: China National Knowledge Infrastructure, WanFang Data, China Science Periodical Database, and the Chinese BioMedical Literature Database. We also searched the following English electronic databases: PubMed, Embase, and Cochrane Central Register of Controlled Trials. To search for additional eligible studies, we also used Google Search Engine. The end date for all the electronic database searches was November 2017. We used a specific set of keywords to search the above databases: (“problem-based learning” OR “PBL”) AND (“lecture-based learning” OR “LBL”). There were no restrictions on language and location.

Inclusion criteria

We had 5 inclusion criteria:

the target participants for the study were medical students;

the studies were RCTs;

the interventions included the PBL+LBL teaching model in the experimental group and the LBL teaching model in the control group;

a sufficient sample size was included in each RCT; and

the outcomes of each RCT included at least 1 of the following: knowledge scores, skill scores, medical writing scores, comprehensive ability scores, and teaching satisfaction. Studies were excluded if the study was not an RCT, and there were no sufficient outcomes. If any study did not meet the above criteria, it was excluded. All the titles and abstracts were reviewed independently by 2 reviewers (Wen Zeng, Qin Zhang) to identify potential studies. These eligible studies were then obtained for inclusion based on review of the full text. After discussion, the differences were resolved through consensus or a third review (Xue Jia) if necessary.

Assessment of methodological quality

The methodological qualities of the included trials were assessed independently by the 2 reviewers (Xue Jia, Wen Zeng) using the Cochrane Collaboration for Systematic Reviews.[ The 7 items of sequence generation, allocation sequence concealment, blinding of participants and personnel, blinding of the outcome assessment, incomplete outcome data, selective reporting, and other biases contained in this specific tool were considered as the meaningful evaluation index. The overall methodological quality of each included study was evaluated as “low risk of bias”, “high risk of bias”, and “unclear risk of bias”.

Outcome measures

The primary outcomes in this meta-analysis were knowledge scores, skill scores, medical scores, and comprehensive ability scores in the PLB+LBL group and the LBL group. We also considered teaching satisfaction (divided into satisfactory teaching effect, general teaching effect, and poor teaching effect) as a secondary outcome between the 2 groups. Additionally, subgroup analyses were conducted to assess the benefits of applying PBL+LBL and LBL to practical and theoretical courses in the above outcomes.

Data extraction

Two reviewers (Xue Jia, Qin Zhang) independently extracted the eligibility study results from the predefined data fields. The 2 databases of the 2 reviewers were compared, and any conflict was resolved by discussion. The information and data were extracted from eligibility studies regarding baseline characteristics, such as author, published time, number of participants, course name, course type, intervention method, and eligibility studies of the results. If necessary, we contacted the authors of eligible studies by e-mail to obtain sufficient information for analysis.

Data synthesis

Statistical analyses of the meta-analysis were performed using RevMan 5 software (Version 5.3, the Cochrane Collaboration, UK). For continuous data, such as knowledge scores, skill scores, medical writing scores, and comprehensive ability scores, the mean difference (MD) and the 95% confidence interval (CI) were calculated. For dichotomous data, such as teaching satisfaction, the risk ratio (RR) and the 95% CI were calculated. The chi-squared test and I2 statistic were used to assess statistical heterogeneity. If the chi-squared test >0.1 or if the I2 <50%, the fixed effects model was chosen. Otherwise, a random effects model was chosen. Publication bias was tested independently using funnel plots of knowledge scores, skill scores, medical writing scores, comprehensive ability scores, and teaching satisfaction; if the funnel plot was symmetric, then there was a low potential for publication bias, and vice-versa.

Results

Search results

The details on study inclusion and exclusion are summarized in flow diagram (Fig. 1). A total of 1863 studies were screened in the initial search, and 1725 studies were excluded based on their titles and abstracts. We scanned the full text of the remaining 138 studies, and an additional 115 were also excluded since they did not meet the inclusion criteria. Thus, a total of 23 RCTs,[ involving 2589 medical students, met the inclusion criteria and were selected for this meta-analysis. All of the included studies were published between 2006 and 2017. These studies included 1306 students in the combined administration of the PBL+LBL teaching model group and 1283 students in the LBL teaching model group. The sample size in the included trials ranged from 16 to 256. All 23 studies were published in the Chinese language, with English abstracts, and the types of courses included in the studies were epidemiology, anatomy, immunology, infectious diseases, gynecology and obstetrics, pediatrics, and so on. There were 10 RCTs[ on practical courses, and 13 RCTs[ included theoretical courses. Table 1 shows the baseline characteristics of all the included studies.

Figure 1

Preferred reporting items for systemic reviews and meta-analyses (PRISMA) flow diagram of literature selection.

Table 1

The detailed baseline characteristics of all included studies.

The quality of the 23 studies was evaluated using the Cochrane Collaboration. Randomization was conducted in all the studies.[ None of the studies reported randomized or blinded methods. The summary of the methodological quality of each study is shown in Figure 2. The meta-analysis independently uses funnel plots of knowledge scores, skill scores, medical writing scores, comprehensive ability scores and teaching satisfaction to assess publication bias; the plots were generally symmetrical and showed a lower publication bias (Fig. 3 A, B, C, D, E, F, and G).

Figure 2

Risk of publication bias summary.

Figure 3

A publication bias of knowledge scores. B publication bias of skill scores. C publication bias of medical writing scores. D Publication bias of comprehensive ability scores. E publication bias of satisfactory teaching effect. F publication bias of general teaching effect. G publication bias of poor teaching effect.

Knowledge scores

All the included studies[ reported relevant data regarding knowledge scores (1306 and 1283 students in the PBL+LBL and LBL groups, respectively). The meta-analysis of the knowledge scores found that the PBL+LBL teaching model significantly increased knowledge scores by a mean of 4.32 compared with the LBL teaching model (95% CI, 2.85–5.78; P < .00001). The random effects model was used for the meta-analysis because of higher heterogeneity (P < .00001, I2 = 97%) (Fig. 4).

Figure 4

Funnel plots of knowledge scores.

Skill scores

Thirteen studies[ reported relevant data regarding skill scores (651 and 649 students in the PBL+LBL and LBL groups, respectively). The meta-analysis of the skill scores found that the PBL+LBL teaching model significantly increased skill scores by a mean of 2.11 compared with the LBL teaching model (95% CI, 0.51–3.71; P = .01). The random effects model was used for the meta-analysis because of higher heterogeneity (P < .00001, I2 = 97%) (Fig. 5).

Figure 5

Funnel plots of skill scores.

Medical writing scores

Six studies[ reported relevant data regarding medical writing scores (288 and 287 students in the PBL+LBL and LBL groups, respectively). The meta-analysis of the medical writing scores found that the PBL+LBL teaching model significantly increased skill scores by a mean of 2.54 compared with the LBL teaching model (95% CI, 1.04–4.04; P = .0009). The random effects model was used for the meta-analysis because of higher heterogeneity (P < .00001, I2 = 84%) (Fig. 6).

Figure 6

Funnel plots of medical writing scores.

Comprehensive ability scores

Eleven studies[ reported relevant data regarding comprehensive ability scores (573 and 569 students in the PBL+LBL and LBL groups, respectively). The meta-analysis of the comprehensive ability scores found that the PBL+LBL teaching model significantly increased skill scores by a mean of 5.38 compared with the LBL teaching model (95% CI, 2.04–8.71; P = .002). The random effects model was used for the meta-analysis because of higher heterogeneity (P < .00001, I2 = 97%) (Fig. 7).

Figure 7

Funnel plots of comprehensive ability scores.

Teaching satisfaction

Teaching satisfaction is divided into 3 dimensions: satisfactory teaching effect, general teaching effect and poor teaching effect. First, a total of 9 studies[ reported relevant data regarding satisfactory teaching effect (371 and 370 students in the PBL+LBL and LBL groups, respectively). The meta-analysis of satisfactory teaching effect in the PBL+LBL teaching model found higher rates compared with the LBL teaching model (RR, 1.32; 95% CI, 1.10–1.59; P = .003). The random effects model was used for the meta-analysis because of higher heterogeneity (P = .0001, I2 = 75%) (Fig. 8). Second, a total of 6 studies[ reported relevant data regarding general teaching effect and poor teaching effect (251 and 251 students in the PBL+LBL and LBL groups, respectively). There was not a statistically significant difference in general teaching effect and poor teaching effect between the 2 groups (RR, 0.77; 95% CI, 0.55–1.08; P = .14; RR, 0.52; 95% CI, 0.23–1.51; P = .11; respectively). A fixed effects model was used for the meta-analysis because of lower heterogeneity (P = .15, I2 = 38%; P = .34, I2 = 12%; respectively) (Figs. 9 and 10)

Figure 8

Funnel plots of satisfactory teaching effect.

Figure 9

Funnel plots of general teaching effect.

Figure 10

Funnel plots ofgeneral teaching effect.

Subgroup analysis

Subgroup analyses were performed to examine the differences between practical and theoretical courses when PBL+LBL was used compared to LBL alone. The outcome revealed that the differences in knowledge scores, medical writing scores, and comprehensive ability scores between practical and theoretical courses were significant, and satisfactory teaching effects in practical courses were significant. However, no significant differences were found in skill scores, general teaching effect, or poor teaching effect between practical and theoretical courses, and no difference was observed in the satisfactory teaching effect in the theoretical courses. Table 2 shows the results of the subgroup analysis. Additionally, a subgroup analysis of the level of training showed that the PBL+LBL teaching model also significantly improved the knowledge scores of Freshman, Sophomore, Junior, Senior, and Master students (Table 3).

Table 2

Clinical results of subgroup analyses in the current meta-analysis.

Table 3

Subgroup analyses of the level of training in the current meta-analysis.

Discussion

PBL is a student-centered teaching model and has been widely used in medical education across the globe.[ However, this teaching method is controversial in China. To the best of our knowledge, few studies have assessed whether the combined application of PBL and LBL teaching models has additional benefits in medical education. Thus, we performed a meta-analysis to assess the efficacy of the PBL+LBL teaching model in medical education in China.

The main finding of this meta-analysis was that the PBL+LBL teaching model can significantly increase knowledge scores, skill scores, medical writing scores, comprehensive ability scores and teaching satisfaction compared to the application of the LBL teaching model alone. Subgroup analyses also showed that the knowledge scores, medical writing scores, and comprehensive ability scores between practical and theoretical courses were significant, and satisfactory teaching effects in practical courses were significant. Additionally, a subgroup analysis of the level of training showed that the PBL+LBL teaching model also significantly improved the knowledge scores of Freshman, Sophomore, Junior, Senior, and Master students.

The core idea of PBL teaching is based on questions, with students at the center and with teachers serving as guides.[ Consequently, the more passive, accepting style of education is transformed into active learning to stimulate student interest.[ Recently, PBL has garnered more and more attention by medical education practitioners in China, and a large number of related studies have been conducted.[ Studies have shown that PBL has more advantages compared with traditional teaching models in improving grades and in stimulating interest in learning.[ However, PBL is not perfect, and LBL has its strengths. In the early stages of the PBL teaching model, for example, students lack systematic and in-depth levels of theoretical knowledge, and they focus on solving problems.[ Thus, students are not yet able to organize and grasp the internal logical structure of knowledge, which may increase learning difficulties. Unlike Western countries, Chinese students have long accepted the traditional teaching model as adequate for the accumulation of theoretical knowledge. The PBL teaching model is new for Chinese students and has greatly stimulated their interest in learning.[ In this study, PBL+LBL and traditional LBL students use the same textbooks and syllabi. However, PBL students seem to learn more actively, leading to higher knowledge scores.

The administration of the PBL+LBL teaching method in medical education has been well established in the literature. A randomized controlled trial[ comparing 96 students who received the combined PBL+LBL teaching model or the LBL teaching model alone in vascular surgical clinical education found that PBL+LBL resulted in significantly higher knowledge scores and skill scores. Wang et al[ reported similar results comparing the PBL+LBL and LBL teaching models in gynecology and obstetrics teaching and observed increased knowledge scores and improved teaching satisfaction. Furthermore, our meta-analysis indicates that the comprehensive ability scores found in the combined group significantly increased scores by a mean of 5.38 compared with the LBL group alone. Therefore, the combined application of the PBL+LBL teaching model may be a reasonable alternative to improve learning and skills in medical education.

In our current meta-analysis, teaching satisfaction surveys were divided into 3 aspects: satisfaction teaching effect, general teaching effect, and poor teaching effect. We found that the satisfaction teaching effect of students in the PBL+LBL teaching group was significantly higher than in the LBL teaching group. Furthermore, the subgroup analysis indicated that differences in the satisfaction teaching effect were found in practical courses; however, there was no difference for theoretical courses regarding the satisfactory teaching effect between the PBL+LBL group and the LBL group. In traditional LBL teaching in China, teachers are mainly active, while students play a more passive role in accepting knowledge.[ Thus, the students are less likely to take initiative and may show a lack of analytical reasoning ability; they often have lower levels of communication and cooperation. The PBL+LBL teaching model is student-centered and question-oriented, combining the advantages of both. The model inspires students to learn both autonomously and under the guidance of teachers. In the PBL+LBL dual-track teaching model, students can effectively learn more comprehensive knowledge and can gain the flexibility to use that knowledge to solve problems. Consequently, these students naturally achieve higher degrees of satisfaction.

Compared with the meta-analyses previously published by Zhang et al[ and Dong et al,[ the present study had several strengths. First, all the included studies were well-designed, and they satisfied the defined eligibility criteria of comparing the efficacy of the combined PBL+LBL teaching model versus the LBL teaching model alone in medical education. Second, the meta-analysis included 23 RCTs. Third, a subgroup analysis was performed comparing the course type between the theoretical courses and the practical courses. The results showed that the combined administration of PBL+LBL in medical education can effectively increase knowledge scores, medical writing scores, comprehensive ability scores, and satisfactory teaching effects compared with the LBL alone. Finally, this study independently used funnel plots to assess publication bias; the plots were generally symmetrical and showed a lower publication bias.

There were also several limitations in the present study. First, although most of the included studies in this meta-analysis were RCTs, none of the included studies reported allocation concealment and blinding. Consequently, the quality of methodologies included in the meta-analysis is not generally high. Second, considering that there are only Chinese medical students in this study, this conclusion may be more suitable for medical education in China and Asia, not Western medical education. Third, the heterogeneity of the reported results, including knowledge scores and skill scores, was very high. Therefore, the authors used random effects models to analyze these data, taking into account the bias in clinical outcomes. Finally, although the subgroup analysis was performed according to different training levels, this analysis was limited by the incomplete nature of the information and data. Some results, such as the skill scores, medical writing scores, comprehensive ability scores and satisfactory teaching effects, could not be concluded. Therefore, more scientifically designed RCTs are needed in the future.

Conclusions

Based on the current evidence, this meta-analysis showed that the PBL+LBL teaching model is an effective method for increasing knowledge scores, skill scores, medical writing scores, and comprehensive ability scores and for improving teaching satisfaction. Thus, the use of the PBL+LBL teaching model may be optimal for improving medical education in China.

Author contributions

Conceptualization: Wen Zeng.

Data curation: Xue Jia, Qin Zhang.

Formal analysis: Xue Jia.

Investigation: Xue Jia, Qin Zhang.

Methodology: Xue Jia, Wen Zeng, Qin Zhang.

Software: Xue Jia, Wen Zeng, Qin Zhang.

Writing – original draft: Xue Jia.

Writing – review & editing: Xue Jia, Wen Zeng.