Students' perception of online learning during the COVID-19 pandemic: A survey study of Polish medical students.

ABSTRACT: The COVID-19 pandemic has disrupted teaching in a variety of institutions, especially in medical schools. Electronic learning (e-learning) became the core method of teaching the curriculum during the pandemic. After 8 weeks of only online learning, a survey was conducted to investigate perception of this type of learning among medical students.A survey was conducted by distributing an online questionnaire to Polish medical students. Data gathered from the survey were analyzed with routine statistical software.Eight hundred four students answered the questionnaire. According to respondents' answers, the main advantages of online learning were the ability to stay at home (69%), continuous access to online materials (69%), learning at your own pace (64%), and comfortable surroundings (54%). The majority of respondents chose lack of interactions with patients (70%) and technical problems with IT equipment (54%) as the main disadvantages. There was no statistical difference between face-to-face and online learning in terms of opinions on the ability of the learning method to increase knowledge (P = .46). E-learning was considered less effective than face-to-face learning in terms of increasing skills (P < .001) and social competences (P < .001). Students assessed that they were less active during online classes compared to traditional classes (P < .001). E-learning was rated as enjoyable by 73% of respondents.E-learning is a powerful tool for teaching medical students. However, successful implementation of online learning into the curriculum requires a well thought-out strategy and a more active approach.

Introduction

The COVID-19 pandemic has disrupted teaching in a variety of institutions, especially in medical schools. In many countries, including Poland, typical face-to-face classes had to be suspended to ensure the safety of students, lecturers, and patients. To minimize the impact of lockdown, medical schools had to find another approach to teach medical students. Fortunately, current technology enabled electronic learning (e-learning) to be the core method of teaching the curriculum during the COVID-19 pandemic.

E-learning is defined as using information technology to improve the quality of education.[ Currently, online teaching is commonly used in the training of undergraduates---not as a sole method, but combined with the traditional teacher-led approach.[ The success of e-learning depends on many factors, including accessibility, usage of appropriate methods, course content, and assessment criteria. E-learning, like any method of teaching, has its advantages and disadvantages for both students and teachers. Besides the epidemiological benefits of e-learning during the COVID-19 pandemic, other benefits worth mentioning include increased convenience, access to resources regardless of location and time, and reduction of costs and air pollution, for example, carbon dioxide emission because of the reduction in traffic.[ Online classes also have limitations, including problems with internet access, poor internet connection quality, and insufficient digital skills of the respondents. Some benefits such as time flexibility can also be a limitation, especially for students who have difficulties with self-discipline.[

After 8 weeks of only online learning with no face-to-face learning, we decided to analyze medical students’ perception of this teaching approach.

Methods

On March 20, 2020, the Polish government declared a state of epidemic emergency, which resulted in the suspension of face-to-face learning in medical universities. All universities were obliged to conduct solely e-learning. After 8 weeks of only online learning, an anonymous questionnaire was distributed, via forums for medical students on Facebook, to Polish medical students. The questionnaire was accessed online from 20th of May to 20th of June. There were no exclusion criteria. Each student was allowed to complete the questionnaire once. All respondents were fully informed about the objectives of the study and agreed to voluntarily participate. A total of 804 students participated in this study.

This study was approved by members of the Bioethics Committee of Jan Kochanowski University, Poland (27/2020).

Questionnaire

The questionnaire (see Questionnaire, Supplemental Content) was developed by the authors for this study and it was assessed by the Bioethics Committee. The questionnaire consisted of 4 parts.

In the first part of the survey, students were asked to enter their demographic details (age, gender, year of study), describe their IT skills, and state whether they had previously participated in any online courses.

In the second part, respondents were given 6 sets of options regarding the advantages and disadvantages of e-learning, from which they could choose as many as were true for them.

In the third part, respondents had to compare, using the Likert scale[ (1 = definitely ineffective, 5 = definitely effective), face-to-face learning with online learning in terms of ability to master learning objectives (knowledge, clinical skills, and social competences). Students were also asked to rate their activity during classes (1 = extremely inactive, 5 = extremely active).

In the last part, students were asked to rate the level of acceptance of online classes using the Likert scale from 1 to 5 (1 = extremely unenjoyable, 5 = extremely enjoyable).

Because there is a noticeable difference between the amount of clinical classes from years 1 to 3 and 4 to 6 at medical school, we compared answers between these 2 groups of students.

Statistical analysis

The data were analyzed with the Statistica 13.3 (StatSoft, Inc., Tulsa, OK) statistical software. Advantages, disadvantages, and level of acceptance of e-learning were analyzed using descriptive statistics. The nonparametric Wilcoxon signed-rank test was used to compare opinions on face-to-face and online learning. The Chi-square and Mann--Whitney tests were used to compare answers between less and more advanced students. P < .05 was considered statistically significant.

Results

Characteristics of respondents

The characteristics of the medical students are summarized in Table 1. Among the 804 students, 233 (29%) were males and 571 (71%) were females. The age of the students ranged from 18 to 39 years (M = 22.66, SD = 2.15). A total of 318 (40%) students had previous experience with e-learning, whereas 486 (60%) had no experience. A total of 451 (56%) respondents described their IT skills as good, 337 (42%) as moderate, and 16 (2%) as poor.

Table 1

Characteristics of the study population (n = 804).

Variables	n (%)
Gender
Male	233 (29%)
Female	571 (71%)
Age, y
18--20	130 (16%)
21--30	670 (83%)
31--39	4 (1%)
Year in medical school
1st	140 (17%)
2nd	121 (15%)
3rd	167 (21%)
4th	168 (21%)
5th	133 (17%)
6th	75 (9%)
Previous experience in e-learning
Yes	318 (40%)
No	486 (60%)
IT skills
High	451 (56%)
Moderate	337 (42%)
Low	16 (2%)

Advantages and disadvantages of e-learning

The most frequent advantages of e-learning chosen by respondents were the ability to stay at home (69%), continuous access to online materials (69%), the opportunity to learn at your own pace (64%), and comfortable surroundings (54%). The majority of respondents chose lack of interactions with patients (70%) and technical problems with IT equipment (54%) as the main disadvantages (Table 2). Students in the first 3 years of studies more often chose technical problems with IT equipment (P = .003), lack of self-discipline (P < .001), and social isolation (P = .008) as e-learning disadvantages, while students in their 4th to 6th year of study more often chose lack of interaction with patients (P < .001).

Table 2

Advantages and disadvantages of e-learning.

Variables	Years of studies 1–3 n = 428 (53.23%)	Years of studies 4–6 n = 376 (46.76%)	P	Total n = 804 (100%)
Advantages of online learning
Access to online materials	292 (68%)	260 (69%)	.77	552 (69%)
Learning on your own pace	273 (64%)	239 (64%)	.95	512 (64%)
Ability to stay at home	287 (67%)	271 (72%)	.12	558 (69%)
Classes interactivity	13 (3%)	22 (6%)	.05	33 (4%)
Ability to record a meeting	98 (23%)	67 (18%)	.07	165 (21%)
Comfortable surrounding	219 (51%)	215 (57%)	.08	434 (54%)
Disadvantages of online learning
Reduced interaction with the teacher	200 (47%)	163 (43%)	.33	363 (45%)
Technical problems	252 (59%)	183 (49%)	.003	435 (54%)
Lack of interactions with patients	230 (54%)	336 (90%)	<.001	566 (70%)
Poor learning conditions at home	75 (18%)	49 (13%)	.07	124 (15%)
Lack of self-discipline	208 (49%)	120 (32%)	<.001	328 (41%)
Social isolation	189 (44%)	132 (35%)	.008	321 (40%)

Comparison between face-to-face and online learning

There was no statistical difference between face-to-face (M = 3.23) and online learning (M = 3.27) in terms of opinions on the ability of the learning method to increase knowledge (P = .46). E-learning was considered less effective than face-to-face learning in terms of increasing skills (M = 2.03, M = 4.3, respectively) (P < .001) and social competences (M = 2.03, M = 4.2, respectively) (P < .001) (Figure 1). Students assessed that they were less active during online classes (M = 2.72) compared with traditional classes (M = 3.82) (P < .001) (Figure 2).

Figure 1

Students’ perception on the ability to increase knowledge (A), clinical skills (B), and social skills (C) during face-to-face and e-learning. Responders used the Likert scale where 1 = definitely ineffective, 5 = definitely effective.

Figure 2

Students activity during face-to-face and e-learning, where 1 = extremely inactive, 5 = extremely active.

Acceptance of e-learning

A total of 589 (73%) respondents rated e-learning as enjoyable. Of these, 125 (15%) found it extremely enjoyable, 237 (29%) found it very enjoyable, and 227 (28%) found it somewhat enjoyable. A total of 214 (27%) students did not enjoy online learning. Of these, 80 (10%) students found it extremely unenjoyable and 134 (17%) very unenjoyable (Figure 3). There was no statistically significant difference between answers given by students in the first three years of studies and those more advanced (P = .63). There was no statistical difference between female and male students (P = .46).

Figure 3

Level of acceptance of e-learning, where 1 = extremely unenjoyable, 5 = extremely enjoyable.

Discussion

In this survey study, we evaluated Polish medical students’ perception of online learning during the COVID-19 pandemic.

Ease of access to educational materials and the ability to choose the time and place to study were shown as the strongest advantages of online learning among respondents in our survey. Remote access is of particular importance during the COVID-19 pandemic, but it can also reduce the cost of accommodation and transportation in other settings.[ E-learning enables learning materials to be quickly delivered to students, standardized, and if needed, updated.[ Content can be delivered to students using two different approaches: self-directed and instructor-led learning. Self-directed e-learning allows the learner to manage his activity independently. Recent findings by Peine et al[ showed that self-directed e-learning can outperform traditional face-to-face learning.

E-learning is not without its disadvantages. The main problem for respondents in the survey, especially those in their 4th, 5th, and 6th year of study, was the lack of interaction with patients. This finding is consistent with other recently published studies assessing students’ perception of online classes during the pandemic.[ Clinical clerkships have been cancelled in many countries. Learning from real patients in a clinical setting is crucial for medical education and it cannot be fully replaced with distance learning.[ To some extent, a solution to this issue could be the use of virtual patients (VPs). VPs are designed to simulate real-life clinical scenarios and they enable the learner to prepare him/herself before a real patient encounter.[

Surprisingly, over 60% of the respondents in our survey had never experienced any form of e-learning before the COVID-19 pandemic, which might be the reason why technical issues were the second major disadvantage of e-learning in this study. E-learning requires a reliable internet connection and the necessary hardware and software.[ Both students and teachers must be familiar with the equipment and they should receive technical support and guidance from the IT department before and during an online course. Self-learning requires the student to maintain self-discipline, which can be difficult without direct supervision from the teacher. Poor interaction between learners and facilitators, and a lack of clarity of the purpose and goals of the learning can impede the learning process.[ Stacey and Gerbic[ advocated that students’ maturity might increase their degree of self-discipline, which is consistent with findings in our study.

Our study group assessed that e-learning enabled them to increase their knowledge to the same extent as traditional learning. However, in their opinion, e-learning is definitely less effective in terms of increasing their clinical and social skills. E-learning to teach clinical skills is most effective when combined with traditional classes. Instead of using text-based materials, video instruction seems to be superior in teaching practical skills [ and it fits with Peyton's 4-step skill acquisition approach.[ In this model, the teacher conducts a silent demonstration, then he repeats the procedure, this time describing all necessary sub-steps (deconstruction). Following this, the student has to explain each sub-step while the teacher follows the student's instructions (comprehension). The last step is performance, where the student performs the complete skill while he or she describes it.

An interesting solution for improving social skills is the use of remote standardized patients (RSPs), who communicate with students via the internet. RSPs can not only portray a specific clinical situation, but they also assess the learner and provide real-time feedback. Langenau et al[ studied the use of RSPs and Skype and their effects on residents’ social skills. In their study, 90% of participants agreed that this format was effective in teaching communication skills.[

We found it interesting that respondents assessed that they were less active during e-learning than during traditional classes. One of the reasons could be the lack of an interactive approach when developing e-learning courses. Only 4% of the respondents chose class interactivity as an advantage of e-learning during the COVID-19 pandemic. E-learning methods that are less interactive are viewed less favorably.[ There are different ways to boost the interactivity of online learning. One new and promising method is gamification, in which “game design elements are used in non-game contexts.”[ In a systematic review conducted by Hamari et al,[ gamification has been proven to be effective in many fields, especially in education. A different approach could be social and collaborative learning. This technique allows students to socially interact with each other as well as instructors. They can work together to share ideas and expand their knowledge in an open forum. In a study by Bergl et al,[ the majority of residents assessed that Twitter enhanced their education. Another technique worth mentioning is branching scenarios, in which students get the opportunity to test their skills in a practical setting. This form of learning requires the learner to make a decision and then present the consequences. Each decision produces new challenges and more choices. This technique is associated with higher learning outcomes, mostly regarding increasing knowledge and clinical reasoning.[

Limitations

Limitations of this study include the response rate. Eight hundred four participants is a small number in comparison to the amount of all medical students in Poland. To ensure the safety of all participants (the anonymous and voluntary nature of the study) and in order to reduce bias in our results, the survey did not ask where each student attends university. That is why the possibility of institutional bias cannot be excluded.

Conclusion

This study showed that e-learning is a valuable method of teaching medical students. In the opinion of the respondents in our survey, e-learning is effective in increasing knowledge and is highly accepted. However, it is important not to focus only on increasing knowledge, but also on clinical and social skills. E-learning should not only be based on the delivery of content, but students should be able to work with the materials and receive feedback. Successfully implementing online learning into the curriculum requires a well thought-out strategy and a more active approach.

Author contributions

Conceptualization: Michał Marian Bączek, Michalina Zagańczyk-Bączek, Monika Szpringer, Andrzej Jaroszyński, Beata Wożakowska-Kapłon.

Methodology: Michał Marian Bączek, Michalina Zagańczyk-Bączek, Monika Szpringer, Andrzej Jaroszyński, Beata Wożakowska-Kapłon.

Project administration: Michał Marian Bączek.

Resources: Michał Marian Bączek.

Supervision: Beata Wożakowska-Kapłon.

Writing – original draft: Michał Marian Bączek, Michalina Zagańczyk-Bączek, Monika Szpringer, Andrzej Jaroszyński, Beata Wożakowska-Kapłon.