The impact of eLearning on health professional educators' attitudes to information and communication technology.

BACKGROUND: The use of information and communication technology (ICT) in health professional education is increasing rapidly. Health professional educators need to be responsive to health professionals' information and communication technological needs; however, there is a paucity of information about educators' attitudes to, and capabilities with, ICT.
METHODS: Fifty-two health professional educators, enrolled in health professional education postgraduate studies, participated in an online subject with specific eLearning components requiring the use of ICT. They completed a pre- and postquestionnaire pertaining to ICT attitudes, confidence, and usage.
RESULTS: Participants reported significant increases in overall ICT confidence during the subject despite it being high at baseline (mean: 7.0 out of 10; P=0.02). Even with increased ICT confidence, there were decreases in the participants' sense of ICT control when related to health professional education (P=0.002); whereas, the amount of time participants engaged with ICT devices was negatively correlated with the sense of ICT control (P=0.002). The effect of age and health discipline on ICT attitudes and confidence was not significant (P>0.05).
CONCLUSION: This study reports that health professional educators have perceptual deficits toward ICT. The impact of eLearning increased confidence in ICT but caused a reduction in participants' sense of control of ICT. Health professional educators require more ICT training and support to facilitate better ICT integration in health professional education settings.

Introduction

eLearning is concerned with the learning activities, resource access, communication, and assessment undertaken in an online environment. This type of learning environment normally uses a range of information and communication technologies (ICTs) accessible via computer or mobile devices. The purpose of this study was to explore the attitudes of health professional educators (HPEs) toward their use of ICT, in general, and within their educational practice, in particular. The term “ICT,” within this paper, refers to the technologies used in eLearning,

HPEs are health care practitioners who undertake the role of teacher for their professional peers, students in preregistration courses, or patients. HPEs facilitate learning for practice, from practice, and in practice within clinical, community, professional organization, or higher education contexts. A key role of HPEs, in facilitating learning and professional development, is their modeling of good professional practice1 including using ICT.2,3

Systematic reviews of research literature on eLearning and web-based learning in health professional education reveal a focus on the strategies and tools of eLearning used by HPEs and learning outcomes achieved through eLearning.4,5 Button et al’s6 recent review of the literature of eLearning and ICT in nursing education identified issues relevant to eLearning for nursing educators. These issues, however, emphasized knowledge or skill development, rather than attitudes, which were of concern to educators, such as the time for eLearning resource development and facilitation and the need for eLearning ICT skills training.

Studies that address the affective areas of eLearning in health professional education tend to focus on participants’ attitudes to ICT7–11 or their satisfaction with the eLearning experience.12,13 Childs et al14 conducted a systematic review of the health professional education literature to identify the barriers and solutions to eLearning for health professionals and students. The findings of this review identified institutional, management, learner, and HPE issues. The attitudinal issues of HPEs to eLearning included resistance to change, poor motivation, fear, anxiety, and low confidence with computers.

Confidence in being able to successfully complete learning tasks has an important role in learner achievement.15 We might expect, therefore, that HPEs learning to use ICT within eLearning will also depend on their sense of confidence with ICT. Cooper’s16 study found that intrinsic motivation and satisfaction with eLearning were the primary incentives for educators in higher education. This internal source of motivation suggests that an internal locus of control supports HPEs’ confidence in learning to use ICT within eLearning.

In this sense, locus of control refers to the extent to which people believe that they are in control of events that occur in their environment.17 People with an internal locus of control are more likely to believe that their own actions can affect environmental events, including their learning achievement.18 Conversely, people with an external locus of control are more likely to feel acted upon or controlled by their environment. Wishart and Ward19 found that a feeling of being in control of ICT, rather than being controlled by it, was linked with nursing students being less fearful of the technology. This suggests that the role of locus on control in an eLearning environment may also apply to HPEs who grapple with their motivation and confidence with eLearning ICT.

The influence of educator attitudes toward the use of ICT in eLearning on learner satisfaction with eLearning is demonstrated by previous studies.20–23 This signifies the important role that HPEs play in enabling opportunities for learner development, through eLearning, of thinking skills and self-efficacy with ICT that are transferable to professional practice settings.24,25 The relationship between attitudes and behaviors has long been recognized as complex.26 Nevertheless, encouraging HPEs to adopt the desired behaviors of using ICT in their educational practice requires that they develop their intention to act in the desired way.7 This intention to act is influenced by the attitudes toward the use of ICT in eLearning practice that HPEs develop.

HPEs differ from many of their peers by being both clinical practitioners and educators. Therefore, HPEs’ attitudes to ICT for educational practice might be influenced by their exposure to, and expected use of, ICT in their professional contexts with different ICT requirements, such as educational or clinical contexts.27 Accordingly, we sought information to identify factors and their degree of influence, which may contribute to HPE attitudes toward to ICT in eLearning.

Methods

This study was conducted at a major metropolitan Australian university that has a diverse range of undergraduate and postgraduate health professional disciplinary degrees. Health professional education, a major postgraduate degree stream, enrolled HPEs from a variety of health disciplines. The postgraduate health professional education course consisted of four mandatory subjects, two of which were delivered using online learning with a suite of elective subjects. Each subject equated to approximately 120 hours of learning, and the mandatory subjects were conducted within the same year prior to the elective components. The content of each subject offered via eLearning was related to health professional education pedagogy (clinical teaching and supervision and simulation-based learning for HPEs) with an emphasis on the incorporation of ICT into health professional education. Students enrolled in these subjects were required to complete a range of online learning activities and assignments which necessitated substantial engagement with ICT. These eLearning activities included viewing online videos and documents, sharing ideas by communicating in discussion forums, creating blended media online presentations, and submitting written assignments online. Students were encouraged to use a range of ICT devices including computers, smart phones, and tablets to get access to and complete the eLearning activities. In this way, all students enrolled in these two subjects were exposed to learning about health professional education within ICT-rich eLearning environments. Prior to undertaking the study, we determined the sample size on the assumption that the study would provide 80% power with a type one error of 5%, an attrition rate of 5%, and 5% for the adjustment for covariates. This revealed that a sample size of 52 participants was required.

Participants

Participants were HPEs enrolled in the health professional education postgraduate course. Fifty-six HPEs were recruited into the study. All participants were enrolled at different stages of their degrees; however, all had completed at least two subjects which were conducted in face-to-face modality prior to undertaking the subject via eLearning. We only included participants without prior eLearning exposure during their studies to ascertain the effect of eLearning with the subjects. If participants completed both online subjects, data were analyzed only from the first subject studied by the participants. Due to incomplete surveys and students withdrawing from the subject, n=52 participants completed the study (Table 1).

Table 1

Participant demographics (n=52)

Age, n (%)
Less than 35 years	33 (63.5)
35 years and older	19 (36.5)
Female, n (%)	40 (76.9)
Health profession, n (%)
Medical doctor	8 (15.4)
Registered nurse	24 (46.2)
Allied health*	20 (38.5)
Workplace, n (%)
Public hospital	36 (69.2)
Nonpublic settings	12 (23.1)
University	4 (7.7)

Note:

Allied health profession comprises medical radiation practitioner, occupational therapist, physiotherapist, and speech therapist.

Ethical approval

Ethical approval was granted by the Human Research Ethics Committee of the university, and all participants consented to the study prior to the commencement of the subjects.

Procedures

Participants completed a questionnaire related to ICT attitudes, experiences, and knowledge and confidence with ICT. The questionnaire was administered twice, prior to and on completion of the subject. It was undertaken in an electronic format following consent. All participants were deidentified. Participants were required to complete the prequestionnaires within the first 2 weeks of the semester and the postquestionnaires within 2 weeks of subject completion. All questions needed to be completed before submission.

Instruments

Participants completed a questionnaire about attitudes to ICT. The Information Technology Attitude Scales for Health (ITASH)28 was developed previously to ascertain health professionals’ attitudes toward ICT. The questionnaire was validated in 151 health professionals, but none were identified as HPEs. It consists of three subscales, efficiency of care (A); education, training, and development (B); and the control scale (C), which show robust reliability (Cronbach’s alpha scores: 0.88, 0.70, 0.77 for the three subscales, respectively) and construct validity established previously.28 The efficiency of care subscale explored health professionals’ attitudes to ICT improving health care while the education, training, and development subscale related to the amount and quality of ICT education and training the health professional received; and the control subscale was indicative of the health professionals sense of control over ICT. The control subscale addressed the extent to which HPEs felt that they were in control of their own ability to use ICT. We modified the ITASH subscales to match the needs of the participant cohort. The subscales were contextualized for the HPE and the health professional education domain (Table 2).

Table 2

The internal consistency of Information Technology Attitude Scales for Health subscales of efficiency of care (A); education, training, and development (B); and the control scale (C)

Scale	Item	Cronbach’s alpha
A	1. Using ICT in health professional education would improve student learning.	0.8
	2. The sort of information I can get from ICT helps me give better support to learners.
	3. Using ICT makes my communication with other health professionals faster.
	4. I worry that the use of ICT in health professional education may undermine learner confidentiality.
	5. I believe that ICT can help us deliver individualized learning support.
	6. Using ICT would make my communication with other health professionals less reliable.
	7. The cost of the system would be better used to employ more staff.
	8. The time I spend with learners would reduce because of the time I would spend using ICT.
	9. I think we are in danger of letting ICT take over.
	10. ICT helps to improve the way health professional education is delivered.
	11. The speed with which I can access information using ICT helps me give better support to learners.
	12. Time spent on ICT is out of proportion to its benefits.
	13. Use of ICT in health professional education would be more of a hindrance than a help to teaching and learning.
	14. I feel there are too many ICT devices around now.
	15. Using ICT would make health professional educators less productive.
	16. Using ICT is more trouble than it’s worth.
B	1. I think that I would have all the ICT skills I need for my educator job when I finish university.	0.7
	2. It isn’t worthwhile for health care professionals to acquire ICT skills.
	3. I can usually get help quickly when I need some advice about using ICT.
	4. I would like to know more about ICT in health professional education.
	5. I can’t think of any benefits associated with using ICT in health professional education.
	6. Using computers helps to increase the health professional educator’s knowledge base.
	7. The computer training I have received has helped me to be an efficient health professional educator.
	8. I would like to have ongoing training to help me improve my ICT skills.
	9. ICT skills are becoming more and more necessary for health professional educators.
	10. I feel I need more training to use ICT properly.
	11. In order to be successful in my career I need to be able to work with ICT.
	12. I can usually get help quickly when I have an ICT problem.
	13. I am easily able to learn new ICT skills.
	14. The ICT training I have received has helped me to use ICT efficiently.
C	1. I lack confidence in my ICT skills in a health professional education environment.	0.8
	2. I generally feel confident working with ICT.
	3. ICT makes me feel stupid.
	4. I’m often unsure what to do when using ICT.
	5. I would only attend ICT training if I had to.
	6. I sometimes feel very intimidated by the thought of using ICT.

Abbreviation: ICT, information and communication technology.

Data analysis

All descriptive statistics were reported as means, standard deviations, and ranges, where applicable. Cronbach’s alphas were calculated to quantify internal consistency, with scores ≥0.7 considered satisfactory.29 When considering the entire data set, the pre-, postsubject ITASH subscale aggregated scores (efficiency of care [A]; education, training, and development [B]; and control scale [C]) were analyzed using paired Student’s t-tests. As this study was exploratory, we sought to determine if relationships between the independent variables (age groups, health professional discipline, hours of ICT usage, and time) and the dependent variables (change in ITASH subscales and self-reported confidence) existed. This was based on previous research, which has shown age and discipline to impact on health professionals attitudes to ICT.11,30,31 Student t-tests were used to determine the effect of age (<35 years and ≥35 years) and time (pre-, postsubject), and one-way analysis of variance to compare the different health professional disciplines (medical, nursing, and other disciplines combined) on changes in attitude and self-reported confidence. Pearson’s correlation was used to analyze the relationship between hours of usage of ICT and attitudes and self-reported confidence at baseline. Statistical significance was set at alpha <0.05 for all analyses.

Results

The participant cohort was derived from two separate mandatory online subjects, and our analysis determined that there were no significant differences between the two subject groups for age groups, health discipline, ICT usage, or mean scores for the ITASH subscales and self-reported confidence (P>0.05). Accordingly, we combined the two participant groups for all subsequent analyses.

The Cronbach’s alpha for the ITASH subscales A, B, and C were 0.7, 0.7, and 0.8, respectively, indicating that the scale had strong internal consistency (Table 2). These were similar to those reported by the original tool validation.

The percentage of participants with ICT devices are shown in Figure 1. Generally, desktop or laptop computers were the most prevalent, with over 75% of participants regularly using a smartphone.

Figure 1

The percentage of participants with different information and communication technology devices.

Participants reported significant increases in overall confidence during the online subject (P<0.05) (Table 3). There were no significant differences in the ITASH efficiency of health professional education (A) and education, training, and development (B) subscales during the subject (P>0.05) (Table 3). However, ITASH control (C) subscale, indicative of the participant’s sense of ICT control, significantly declined during the subject, suggesting that despite an increase in overall ICT confidence, the participants did not feel that they were in control of ICT when related to health professional education (P=0.002).

Table 3

The change in Information Technology Attitude Scales for Health subscales and self-reported overall confidence scores during the online subject

Variable	Mean difference (95% CI)	Paired t-test
ITASH subscale A post – pre	−0.69 (−1.81 to 0.44)	t=−1.23, df =44, P=0.224
ITASH subscale B post – pre	−0.38 (−1.45 to 0.70)	t=−0.71, df =44, P=0.482
ITASH subscale C post – pre	−0.96 (−1.55 to −0.36)	t=−3.22, df =44, P=0.002*
Confidence post – pre	0.50 (0.08 to 0.92)	t=2.40, df =45, P=0.020*

Notes: Subscale A, efficiency of care; subscale B, education, training, and development; and subscale C, control.

Represents significant difference.

Abbreviations: CI, confidence interval; ITASH, Information Technology Attitude Scales for Health.

There were no statistical differences between the independent variable of age groups and different health disciplines and the dependent variables (ITASH subscale change and self-reported overall confidence; P>0.05).

There were significant negative correlations between the amount of time engaged with ICT devices and ITASH control (C) subscale and positive correlations for self-reported overall confidence (P=0.002 and P=0.001, respectively) (Table 4).

Table 4

Correlations between the amount of time spent engaged with ICT devices and Information Technology Attitude Scales for Health subscales and self-reported overall confidence at baseline

	Baseline ITASH subscale A	Baseline ITASH subscale B	Baseline ITASH subscale C	Self-reported overall confidence
Amount of time spent engaged with ICT devices
r	−0.184	−0.165	−0.415	0.451
P-value	0.193	0.243	0.002*	0.001*
n	52	52	52	52

Notes: Subscale A, efficiency of care; subscale B, education, training, and development; and subscale C, control.

Represents significant difference.

Abbreviations: ICT, information and communication technology; ITASH, Information Technology Attitude Scales for Health.

Discussion

The main findings from the study reveal that HPEs do not feel in control of ICT educational capacity despite reporting an increase in confidence in ICT usage. These are novel findings for two reasons. First, health care professionals are increasingly required to engage in ICT within health care settings, and HPEs need to be confident and in control in their ICT usage to support their educational endeavors. This study demonstrates that when HPEs engage in eLearning related to health professional pedagogy, they feel less in control. Second, confidence per se does not assist with improving attitudes to ICT, especially as related to usage and value of ICT for eLearning.

The improvement in HPEs’ confidence in using ICT as a result of their learning experience is consistent with research into the effects of training on ICT user confidence.32,33 The concurrent decrease in the sense of user control of ICT suggests that HPEs’ confidence in using ICT for their own learning may not necessarily result in the integration of ICT into their pedagogical practices. Attitudes toward learning to use ICT, in general, and attitudes toward using ICT within health professional education practice appear to be distinct issues. Further research is required to shed light on how both of these attitudinal areas may need to be addressed in the preparation of HPEs.

This study found that there were no significant differences in attitudes between age groups or between health care discipline groups. This contrasts with others exploring the attitudes of health care professionals to ICT.11,30,31 This may be because different health care disciplines may have different needs in their use of ICT for professional health care practice.34 Health professional roles, therefore, direct how ICT is used to perform those roles. In contrast, the educational roles of planning, resource development, implementation, and facilitation of learning, assessment of learning, and program evaluation are common to all educational environments, regardless of the health care discipline. Consequently, there is likely to be less difference in attitudes toward ICT for educational purposes across HPEs from different disciplines.

We found that the time spent engaging with ICT devices was related to ICT confidence and a decrease in user control. The ownership and confidence in using ICT devices of the participants in this study were similar to previous research,35 demonstrating that our cohort was representative of health professionals (Figure 1). HPEs’ increased confidence in using ICT appears to be a logical consequence of the more time they spent using ICT devices. However, ICT device engagement was negatively correlated with HPEs’ sense of control of ICT in general, not just with ICT devices. This suggests that exposing HPEs to more ICT devices may not be sufficient for HPEs to improve their sense of control over ICT. Instead, HPEs may need to develop a better general understanding of ICT and explore fewer devices in depth, particularly in terms of their use for learning and teaching. This is also recommended by Skiba et al.3 Developing a better general understanding of ICT for eLearning may improve their sense of control of ICT for eLearning.

HPEs are usually considered to have greater clinical expertise than those they teach. The “HPE as expert” self-concept may be undermined by a low sense of ICT control. Consequently, HPEs may not engage with ICT for eLearning. Our study found that this was common across the health care disciplines. This suggests that a sense of ICT control may be related to individual intrinsic properties rather than discipline-specific engagement.

The HPEs in this study experienced the use of ICT to learn content related to the design and practice of clinical teaching and supervision and clinical simulation, including embedding ICT into their eLearning practices. The difference in confidence with using ICT and the sense of user control of ICT as a result of the learning experience suggests that HPEs may not have been able to manage the cognitive load36 required by the content and learning experience. Consequently, HPEs may have responded by adopting a multifaceted approach to learning,37 implementing a deeper approach to learning of subject content and a more surface approach to the eLearning use of ICT. Further research is required to explore the relationships between cognitive load, approach to learning, and attitudes to ICT adopted by HPEs within similar ICT-embedded eLearning environments. In this way, HPEs may have experience in incorporating ICT into their educational repertoire and improve their sense of ICT control.

Metacognition is a significant component of the cognitive load requirements for HPEs engaged in the eLearning environments within this study.38 Thinking about how their own ICT-embedded eLearning experience assisted them to develop the declarative and procedural knowledge39 of the subject content may enable HPEs to synthesize better their knowledge and attitudes toward the use of ICT within health care professional education. To date, exploration of the relationships between metacognitive ability and attitudinal development of HPEs in relation to the use of ICT in health care professional education has not been examined and warrants further study.

Limitations

We undertook a power analysis and determined sample size prior to the study. The distribution of different health professional disciplines, however, may have had an impact on the findings despite the numerical distribution of disciplines indicative of clinical environments. Participants in this study were HPEs enrolled in subjects concerned with educational practice relevant to health care professional education. Participants were engaged in their student role throughout this study. This may have an impact on the external validity of the current findings to HPEs in nonstudent roles.

Conclusion

This study shows that HPEs’ attitudes to ICT for eLearning are improved in terms of their confidence with ICT, but not their sense of control, when exposed to an eLearning environment specifically designed to address ICT-embedded pedagogy for learning about health care professional educational issues. Further research is needed to investigate issues, such as cognitive load and metacognition, which may have an impact on HPEs’ sense of control in their use of ICT in their educator roles.