Assessment of the implementation of problembased learning model in Saudi medical colleges: a cross-sectional study.

BACKGROUND: Problem-based learning (PBL) is a method by which students solve clinical scenarios in a small group discussion. The aim of this study was to assess the implementation of PBL in Saudi Universities.
METHODS: This is a cross-sectional study including 151 participants from 16 universities. A questionnaire was distributed to the faculty members through e-mail messages. The questionnaire consisted of 35 questions with 5-point Likert scale arranged in three subscales.
RESULTS: The total mean of PBL implementation score was 2.5 (SD =0.39). The scores of the three PBL implementation subscales showed marked variance, with the average score of the subscale "overall PBL experience in my college" being the most highly affected, with an average score of (3.07, SD =0.72), followed by "implementation of PBL model" (2.36, SD=0.47). The least affected subscale was "preparation for PBL implementation" (2.13, SD =0.67).
CONCLUSION: Relatively moderate level of PBL implementation was observed in Saudi Arabia. However, we suggest that more courses should be introduced in order to improve the skills of faculty members and provide a strong infrastructure to implement PBL model in Saudi medical colleges.

Introduction

Problem-based learning (PBL) is a method by which the students solve clinical scenarios in a small group discussion. It is a way of conveying the medical education in an integrated, contextual, self-directed, and student-centered mode of active learning.1 Vernon and Blake reported that PBL appears to be a complicated form of a general philosophy of teaching2 and is more an educational strategy that helps the brain to learn in a different way.3 It has been one of the most important educational innovations for more than four decades.4 It was initiated by Howard Barrows in the McMaster University, Hamilton, Ontario, Canada, during the mid-1960s,1 and currently there are more than 60 medical schools in the world that have adopted his method, as a whole or in parts.5 Howard Barrows had no background in psychologically based education. He and his colleagues submitted the PBL idea as a proposal to the McMaster curriculum for making the medical education more interesting and relevant to the students.6

Medical schools have adopted different interpretations and concepts of the PBL curriculum and its approach,6 but the results were not significant.2,7,8 Also, some studies conducted by Norman and Schmidt9 and Elstein et al10 indicate that there is no evidence that one method of teaching can improve the problem-solving skills. However, the widespread adoption of PBL in medical education proves its validity and value.11

PBL involves a progressive theme of provided problems context that has to be built on an integrated prior knowledge11 and is based on the principles of the adult learning theory which refers to the motivation of the students, encouragement to set goals, and decision-making skills.12 Barrows had identified many objectives, of which that are considered as main objectives of PBL are self-directed learning skills, internal motivation, structuring knowledge and clinical background, and enhancing clinical rationalization.1 In addition, the confidence and perception of belonging to the medical schools increased, the exam scores were higher,13 and a better understanding of the basic science subjects was observed.14 Conductance of PBL for majority of the times can result in desirable outcomes for the undergraduate students, such as critical thinking, communication skills, research skills,4 leadership skills, teamwork skills, and others.15 It also helps in filling the knowledge gaps and improves previous knowledge and ideas.4 Graduates who had undergone PBL were more skillful and efficient in their clinical work, specifically in dealing with the patients, than those who had not undergone PBL.16 At the level of the competence, those who had graduated from PBL included curriculum were better than those who came from more traditional curriculum.5

The scientific-pedagogical method of conducting a PBL session begins with the triggers from the clinical scenarios which are used to facilitate and guide the students to identify special learning objectives, carry out an independent research, and clarify and interpret findings in the group discussions.17 At the beginning of the first session, students will be given a problem included clinical scenario to perform brainstorming, filtering out the unnecessary information and discussing the issues of the case and their suitable solutions. Then, the unanswered inquiries will be the objectives that have to be discussed and explained in the next session, which is called the “reporting session”. This session needs some preparations that are navigated by the objectives.18

Educationists, medical scientists, and physicians are assigned the responsibility of being the students’ supervisors during the sessions. The supervisor’s main role is to help the students learn how the scientific investigation process works and deliver the knowledge, attitudes, and skills needed to achieve the goals of the PBL.19 Also, from another perspective, Eva et al20 and Neville21 presented the PBL tutor’s role from a cognitive psychology point of view, which states that the tutor has a critical role in giving a helpful scientific feedback that may help in facilitating the student’s learning process.

In the Kingdom of Saudi Arabia, College of Medicine in Al-Qassim University was the first to adopt PBL system in its curriculum in 2003,22 followed by the rest of the universities in the country.23 A study was done to evaluate the PBL course in the College of Medicine, Al-Qassim University, which revealed that the PBL system had a positive impact on improving students’ skills. However, most of the students do not agree with the evaluation system but agree that PBL is better than traditional system.4 However, another study conducted in the College of Medicine of King Abdulaziz University stated that the PBL system encourages the students to be involved in group discussion.24 A study conducted in Taibah University concluded that the majority of their medical academic staff had a good attitude and suitable knowledge in regard to PBL.25

Nevertheless, since there is no enough literature emphasizing the adoption of PBL approach in Saudi Arabia, we still do not know if the PBL system is implemented correctly in Saudi Arabia, and this is the aim of the present paper. The specific objectives of this study are:

To assess the PBL readiness in Saudi medical colleges.

To evaluate the implementation of PBL model.

To know overall PBL experience.

Methods

This cross-sectional study was done by sending an online questionnaire through e-mail messages that were obtained from Saudi universities Websites as well as the attendants of fifth and sixth International Winter Course on PBL in Medical Education in Saudi Arabia. The e-mail messages were sent at 2-week intervals for four times (four reminder messages). The faculty members were invited to participate in the research voluntarily, so completion of the questionnaire was considered an informed consent. The confidentiality and privacy of the reordered responses were kept anonymous and there were no questions that could identify participants. The questionnaire was designed and validated by medical education experts. The institutional review board approval was taken from Al-Imam Muhammad Ibn Saud Islamic University by the research ethics committee.

The questionnaire consisted of two sections. The first section (five questions) comprises the questions on the general information of the participants (academic status, academic background, university, years of teaching, and years of experience in PBL). Section two comprises the Likert scale grouped into three subscales based on the PBL implantation. The first subscale is “preparation for PBL implementation (readiness to change)” and contains eight Likert items. The other subscale includes 21 Likert items representing “implementation of PBL model”, which contains four Likert items on “training of faculty and students”, six items on “tutor skills”, seven items regarding “the nature and number of PBL problems in the curriculum”, and five items on “assessment of PBL problems”. The last subscale measures “overall PBL experience in my college”, which includes five Likert items. These three subscales are rated on a five-point Likert scale (1–5) in a categorical manner (strongly disagree, disagree, neutral, agree, strongly agree). Sections 2, 3, and 4 are formatted as a typical five-level Likert scale (strongly agree, agree, neutral, disagree, strongly disagree).

The data were analyzed using SPSS 23 (SPSS Inc., Chicago, IL, USA). We analyzed the data on the subscale scores in two ways. First, descriptive statistics were expressed as mean ± SD for the subscales based on the Likert scale (1–5). Second, we used parametric statistics, ie, one-way ANOVA because the scores of the Likert scale were fairly normally distributed.

Results

We obtained 151 participants from 16 Saudi universities. The majority of the participants were assistant professors (47.7%). There were more number of clinicians (83.6%) than were basic scientists (16.6%). About 44.4% of them had experience in teaching for more than 10 years, while 62.3% had experience specifically in PBL for 1–5 years (Table 1). Of the 31 universities participated, tutors from 19 universities responded to the survey, with a predominance of Taibah University (16.6%) followed by Al-Imam Muhammad Ibn Saud Islamic University (14.6%) and University of Dammam (12.6%) (Table 2).

Table 1

Characteristics of participants

Academic status	% (N)
Professor	17.9 (27)
Associate professor	19.2 (29)
Assistant professor	47.7 (72)
Lecturer	7.3 (11)
Teaching assistant	7.9 (12)
Academic background
Medical (clinician)	83.4 (126)
Non-medical (basic scientist)	16.6 (25)
Years of teaching experience
None	2 (3)
1–5 years	35.8 (54)
6–10 years	17.9 (27)
>10 years	44.4 (67)
Years of experience with PBL
None	9.3 (14)
1–5 years	62.3 (94)
6–10 years	17.9 (27)
>10 years	10.6 (16)

Notes: The assessment method for every PBL session was clear to faculty members (60.3%) and students (58.9%), and the feedback of tutor to students or groups was beneficial (68.9%). The percentage of PBL components involved in each course was clear for tutors and students (70.9%), and most of the participants did not know if the percentage of PBL component in the overall course score is less than to encourage student interest in PBL sessions (33.1%) (Table 4).

Abbreviation: PBL, problem-based learning.

Table 2

Name of the universities (%)

Al Jouf University – College of Medicine	0.7
Al-Imam Muhammad ibn Saud Islamic University – College of Medicine	14.6
Alfaisal University – College of Medicine	4.6
Almajmaah University – College of Medicine	1.3
Batterjee Medical College for Sciences and Technology	2.6
King Abdulaziz University – College of Medicine and Allied Sciences	11.3
King Faisal University, Al Khobar – College of Medicine	1.3
King Khalid University – College of Medicine and Health Sciences	0.7
King Saud Bin Abdulaziz University for Health Sciences, Jeddah, College of Medicine	0.7
King Saud University, Riyadh – College of Medicine	6.6
Najran University – College of Medicine	4
Northern Borders University – College of Medicine	2
Prince Sattam bin Abdulaziz University – College of Medicine	0.7
Sulaiman Alrajhi – College of Medicine	0.7
Taibah University – College of Medicine	16.6
Taif University – College of Medicine	6.6
Umm Al-Qura University – Faculty of Medicine	9.9
University of Dammam – College of Medicine	12.6
University of Bisha – College of Medicine	2.6
Total	100

The majority of the participants agreed that the PBL system is totally different from the conventional one (87.4%), and the teacher’s role will be more of a facilitator instead of being the only source of knowledge (88.1%). About 69.5% have suitable classrooms that facilitate small group discussions, such as in PBL. Rules were modified to allow the students to gather more resources, and not restrict themselves to the classroom desk (74.8%). Some of the participants were not prepared to take the risk of reducing their control over students and did not agree with the concept that accepting mistakes is a way of learning (58.2%). Most of the teachers were prepared to change to a more collaborated interdisciplinary approach, rather than being a one-man show subject expert (65.5%) (Table 3).

Table 3

Frequency distribution of “preparation for PBL implementation”

Preparation for PBL implementation items (readiness changes)	Strongly disagree, % (N)	Disagree, % (N)	Not know, % (N)	Agree, % (N)	Strongly agree, % (N)
Everyone in my school agreed that using PBL is totally different than the conventional method	0	7.9 (12)	4.6 (7)	50.3 (76)	37.1 (56)
Faculty and students believed that the role of teacher will change to a facilitator of learning, and not the only source of knowledge	0	6 (9)	6 (9)	46.4(70)	41.7 (63)
Classrooms were designed and facilitated in a way to suit the flexibility of small group discussions of PBL	0	27.8 (42)	2.6 (4)	35.1 (53)	34.4 (52)
Rules were modified to allow students gather resources, not only waiting in the classroom desk	0	13.2 (20)	11.9 (18)	43 (56)	31.8 (48)
Integration, vertically and horizontally between different disciplines, was made in curriculum of PBL to overcome the subject compartment and boundaries	0	13.9 (21)	9.9 (15)	51 (77)	25.2 (38)
Teachers and administrators were prepared to take the risk of reducing their control over students and accepted mistakes as cause of learning	0	25.2 (38)	16.6 (25)	45 (68)	13.2 (20)
Teachers were prepared to move to a more interdisciplinary collaboration than one-man-show subject expert	0	19.9 (30)	14.6 (22)	39.7 (60)	25.8 (39)
Continuous development of PBL curriculum and rules were considered in designing and implementing the PBL model	0	15.2 (23)	11.9 (18)	51 (77)	21.9 (33)

Abbreviation: PBL, problem-based learning.

All the faculties and students did not have adequate training in PBL (44.4%), but was sufficient enough to make them understand what is PBL (54.9%) and stimulate the interest in student-centered learning among both faculty and students (59%).

The tutors were skilled at introducing the problems (67.5%), directing students’ discussions toward the objectives (76.8%), stimulating critical thinking during their discussions (71.5%), providing information only when necessary (65.6%), creating a competitive environment where all students were encouraged to participate in discussions (76.8%), taking notes to provide the feedback for individuals and the group (68.3%).

About 67.6% of the participants “agree and strongly agree” that several PBL tutorials be added to the conventional curriculum. Well-structured PBL problems were incorporated into the renewed curriculum (45.3%). There were an adequate number of problems for each course (64.9%) and across the curriculum as a whole (59.6%). They were well distributed between the basic sciences and clinical courses (60.3%), and the time given for each problem was quite sufficient (76.2%).

According to the faculty members’ experience with PBL, their perception about PBL was that it was appropriate (44.4%), and their colleges were ready to implement PBL model (49%). Obstacles faced during the implementation of PBL model were not due to faculty (40.4%) or students’ resistance toward changing into the PBL model (49.7%). Moreover, 76.2% of the tutors did not prefer going back to the conventional lecture method (Table 5).

Table 5

Frequency distribution of “overall PBL experience in my college”

Overall PBL experience in my college	Strongly disagree, % (N)	Disagree, % (N)	Not know, % (N)	Agree, % (N)	Strongly agree, % (N)
I think my college was not ready enough when they started implementing the PBL model	0	49 (74)	13.9 (21)	22.5 (34)	14.6 (22)
Faculty perception about PBL was inappropriate	0	44.4 (67)	15.2 (23)	27.8 (42)	12.6 (19)
Student insight regarding PBL was impartial	0	29.8 (45)	28.5 (43)	30.5 (46)	11.3 (17)
Faculty resistance for the change to PBL was behind the pitfalls in implementing the PBL model	0	40.4 (61)	23.8 (36)	25.8 (39)	9.9 (15)
Student resistance to change to PBL was behind the pitfalls in implementing the PBL model	0	49.7 (75)	27.8 (42)	17.9 (27)	4.6 (7)
I think it is better to go back to the conventional lecture method than adopting the PBL model	0	76.2 (115)	8.6 (13)	4 (6)	11.3 (17)

Abbreviation: PBL, problem-based learning.

The total mean of PBL implementation score was 2.5 (SD =0.39). The score of the three PBL implementation subscales showed marked variance; the average score of the subscale “overall PBL experience in my college” was the most highly affected, with an average score of (3.07, SD =0.72). This was followed by subscale “implementation of PBL model” (2.36, SD =0.47), and the least affected subscale was “preparation for PBL implementation” (2.13, SD =0.67) (Table 6).

Table 6

Difference and significance of PBL implementation subscales among Saudi medical colleges

PBL implementation subscales	Mean (SDa)	Mean (SDb)	Possible range	Possible range	P-value
Preparation for PBL implementation (readiness changes) (eight items)	2.13 (0.67)	17.05 (5.36)	8–40	8–40	0.001
Implementation of PBL model (21 items)
• Training of faculty and students (four items)	2.36 (0.47)	54.97 (10.44)	21–105	21–105	0.008
• Tutor skills (six items)	2.73 (0.83)	10.91 (3.302)	4–20	4–20	0.005
• The nature and number of PBL problems in the curriculum (seven items)	2.22 (0.68)	13.34 (4.06)	6–30	6–30	0.016
	2.56 (0.47)	18.12 (3.32)	7–35	7–35	0.039
• Assessment of PBL problems (five items)	2.51 (0.47)	12.59 (2.37)	5–25	5–25	0.442
Overall PBL experience in my college (five items)	3.07 (0.72)	15.35 (3.59)	5–25	5–25	0.225
Overall score (35 items)	2.5 (0.39)	87.37 (13.59)	35–175	35–175	0.001

Note:

Based on average of Likert scale response options: 1–5;

based on sum of the Likert scale response options: 1–5.

Abbreviation: PBL, problem-based learning.

Regarding Saudi universities, the overall score of PBL implementation and its subscales were statistically significant (P<0.05) with the exception of “overall PBL experience in my college” (P>0.05) (Table 6).

Discussion

In this study, we evaluated the “implementation of PBL” model in Saudi medical colleges. Overall, the study revealed a moderate level (50%) of PBL implementation rate in Saudi Arabia.

In a recent review of the literature, a study that assessed the learning among undergraduate medical students in schools with PBL curriculum in Saudi Arabia was done by Meo26, which stressed the fact that students undergoing PBL possessed significantly high knowledge and skills compared with those who belonged to traditional styles of medical schools. Furthermore, PBL has a good impact on the students, which was proved by a comparison between pre-PBL and post-PBL sessions.26 Also, significant improvement in overall performance was observed.12 In addition, students who followed PBL teaching model achieved better academic performance than those following the traditional (lecturebased learning [LBL]) style of education.12 Fortunately, this comes with an agreement from faculty perspective where 76.2% agree that PBL is better than conventional lectures.

The tutor skills in this study achieved a mean score of 2.22. This comes in contrast with Moutasem Aboonq’s study at the College of Medicine, Taibah University, which revealed that high percentage of faculty have a good knowledge and favorable attitude toward PBL.25 These contrasting data could be attributed to the number of universities involved in this study, including Taibah University, or due to the time difference between the studies. Regarding the tutors’ skills, most of the tutors provided feedback to the students (68.3%), which were beneficial (68.9%). However, according to a study conducted in the medical college of Al-Qassim University, about 67.4% of the students did not receive beneficial feedback from their tutors. A total of 44.2% claimed that the tutors did not mention the objectives clearly from the beginning, and they did not clarify as to what they expected from the students.4 This means that there was no clear level of communication between the tutor and the student.

About 43.7% of the participants think that both faculty and students were ready for the challenge of adopting the PBL model, but some (37.1%) stated that their colleges were not well prepared when the PBL model was being implemented; this might have led to different obstacles which are mentioned in a study done by Bashir Hamad,22 such as insufficient resources (eg, library, laboratories, clinical faculty); English language; lack of clear instructions and agreement on PBL format, and lack of satisfaction in the system; untrained tutors; lack of time (especially for selfdirected learning); student problems (preparation before the sessions, language, no willingness for self-learning, and dependence on the lectures); problem design; evaluation of PBL problems and students.

For future improvement in PBL implementation, efforts should be directed to raise tutor skills and prepare a good environment to implement the PBL teaching method efficiently (mean <2.5).

Limitations

Since the sample included in this study is low, another study with a larger sample is recommended.

Conclusion

The overall mean of PBL implementation score in Saudi medical colleges was 2.5. However, efforts should be taken in raising tutor skills and providing enough infrastructure to implement PBL teaching method efficiently.

Table 4

Frequency distribution of “implementation of PBL” model

Implementation of PBL model items	Strongly disagree, % (N)	Disagree, % (N)	Not know, % (N)	Agree, % (N)	Strongly agree, % (N)
Training of faculty and students
All faculty and students had sufficient training on PBL	0	44.4 (67)	15.9 (24)	34.4 (52)	5.3 (8)
The PBL training was fair enough to make trainees understand what is PBL	0	23.8 (36)	21.2 (32)	45 (68)	9.9 (15)
The PBL training was fair enough to stimulate the interest in student-centered learning among both faculty and students	0	26.5 (40)	14.6 (22)	44.4 (67)	14.6 (22)
All faculty and students were ready for the challenge of adopting PBL model	0	34.4 (52)	21.9 (33)	33.1 (50)	10.6 (16)
Tutor skills
Good introduction of the specific problem	0	11.9 (18)	20.5 (31)	53.6 (81)	13.9 (21)
Directed student discussion groups to concentrate on learning objectives	0	9.3 (14)	13.9 (21)	60.9 (92)	15.9 (24)
Stimulate critical thinking during group discussions	0	12.6 (19)	51.9 (24)	51 (77)	20.5 (31)
Ready to provide information only when necessary	0	17.9 (27)	16.6 (25)	49.7 (75)	15.9 (24)
Help students to participate in group discussion and creation of a competitive environment	0	8.6 (13)	14.6 (22)	51 (77)	25.8 (39)
Take notes and provide feedback for individuals and the group	0	9.3 (14)	22.5 (34)	51.7 (78)	16.6 (25)
Nature and number of PBL problems in the curriculum
Only some PBL tutorials were added to the conventional curriculum	0	44.4 (67)	23.2 (35)	23.8 (36)	8.6 (13)
No well-structured PBL problems were incorporated in the renewed curriculum	0	45.3 (82)	17.2 (26)	21.9 (33)	6.6 (10)
The number of problems per each course was adequate.	0	14.6 (22)	20.5 (31)	53 (80)	11.9 (18)
The number of problems across the curriculum was adequate	0	14.6 (22)	25.8 (39)	46.4 (70)	13.2 (20)
Problems were properly distributed between the basic science and clinical courses	0	21.2 (32)	18.5 (28)	45.7 (69)	14.6 (22)
The time allocated for each problem was quite sufficient	0	12.6 (19)	11.3 (17)	53 (80)	23.2 (35)
Assessment of PBL problems
Assessment method for each PBL session is clear to faculty members	0	26.5 (40)	13.2 (20)	44.4 (67)	15.9 (24)
Assessment method for each PBL session is clear for students	0	19.2 (29)	21.9 (33)	43.7 (66)	15.2 (23)
The feedback of tutor to students/groups is quite useful	0	11.3 (17)	19.9 (30)	43.7 (66)	25.2 (38)
The percentage of PBL components of the overall course score is clear	0	9.3 (14)	19.9 (30)	51 (77)	19.9 (30)
The percentage of PBL component in the overall course score is less than that	0	28.5 (43)	33.1 (50)	29.1 (44)	9.3 (14)
required to encourage student interest in PBL sessions

Abbreviation: PBL, problem-based learning.