Teaching Medical Students How to Interpret Chest X-Rays: The Design and Development of an e-Learning Resource.

INTRODUCTION: The teaching of radiology to medical students has often been criticised for being inadequate and unstructured, with students reporting lack of confidence in assessing x-rays. In this paper, we describe how an e-learning resource, on how to interpret a chest x-ray for medical students, was designed and developed. The aim of the resource was to provide medical students with knowledge of how to interpret a chest x-ray in a systematic approach.
METHODS: The technology used to design the e-learning resource was Xerte Online Toolkits. The design and development of the e-learning resource was based upon andragogical principles and followed Overbaugh's guidelines and Mayer's 12 multimedia principles. An instructional design model called ADDIE was used to help develop the resource and its content. These included cases of common conditions, a quiz and summary table at the end. The paper focuses mainly on the way in which instructional design, education and multimedia principles were used to inform the development of the resource.
FINDINGS: A preliminary evaluation was completed by 18 medical students from year 3-5 who completed the e-learning resource. The feedback was positive with an average rating of 9/10 and 100% of students saying they would recommend the resource to a colleague. Students commented that they liked the resource as it was easy to navigate, had good visual learning and contained good explanations with relevant content. CONCLUSION AND FUTURE IMPLICATIONS: This paper demonstrates how, with the use of instructional models, educational theories and principles, an e-learning resource can be created. Preliminary evaluation showed that students were satisfied with the resource and felt it helped them acquire knowledge on how to interpret chest x-rays. This resource can be further utilized either as a standalone resource or before starting clinical placements and may prove particularly useful in the current and challenging learning environment where there is an increased need for digital resources.

Introduction

Radiology is one of the most rapidly growing medical specialties and every junior doctor must be competent in the systematic interpretation of basic imaging such as chest x-rays.1,2 However, many medical students feel that radiology teaching is inadequate and unstructured,3 often reporting lack of confidence in assessing chest x-rays.4 The Royal College of Radiologist (RCR) recently published guidelines for medical schools on the undergraduate radiology curriculum.5 The RCR emphasised the need for medical students to recognise the normal structures as they appear on imaging and on interpretation of basic imaging studies including chest x-rays, abdominal x-rays, skeletal x-rays, and computed tomography. For chest x-rays, the common conditions that medical students should know about include pneumothorax, pleural effusion, lung consolidation, heart failure and pneumoperitoneum. They should have a systematic approach in interpreting chest x-rays and learn about common lines and tubes which may be seen.

Due to the COVID-19 pandemic, medical education across the world experienced a major disruptive change.6 In the United Kingdom, measures to ensure social distancing have included closure of medical schools, ceasing of clinical attachments, and medical students and educators working from home. As a consequence, technology has been rapidly and innovatively used to maintain teaching and learning.7 To provide medical students sufficient teaching, and to help medical educators maximize the use of time for teaching, an e-learning resource on how to interpret chest x-rays was developed. It was thought that this could be used as a standalone e-learning resource or in conjunction with other teaching methods for medical students on how to interpret chest x-rays.8

Over the last few decades, there has been a shift in medical education leading to an increase in the use of e-learning resources to support and enhance the learning of medical students.9 Advantages of these resources include ease of access, flexibility for learners and greater amount of information.10 Many medical students feel that it is a valuable way of learning, as it allows them to engage in an individualised learning environment.9 Moreover, e-learning has been shown to be at least as effective as traditional lecturing in many specialties, and across many stages of medical education.12,13 Indeed, there have been numerous examples of e-learning tools and concepts used in radiology to teach medical students in recent years. One of the most successful and widely used e-learning initiatives is radiopedia.org.14 This is a free online collaborative radiology resource that was compiled by radiologists and trainees from across the world. Since being set up in 2005, radiopedia.org has become one of the most trusted sources for health professionals and medical students and is used by individuals across the world. Another example was the development of an e-learning resource to teach positron emission tomography/computed tomography (PET/CT) to 139 undergraduate medical students. This was associated with a high degree of student satisfaction and 96% of students who took the e-learning resource passed their PET/CT exam station at the end of medical school.15,16

To maximise the learning and educational impact of any e-learning resources it is important to use well established and robust educational principles when designing it.11 This can sometimes be challenging, especially to those new to creating e-learning resources.8 Therefore, in this paper, we will explain how instructional design, educational and multimedia principles were used in the design and development of an e-learning resource on how to interpret chest x-rays for medical students. The online resource can be accessed at . In line with the Royal College of Radiologists guidelines,5 the learning outcomes of the e-learning resource were written with the overarching aim of providing medical students with the knowledge on how to interpret a chest x-ray in a systematic manner (Box 1). In the paper, we also report preliminary evaluation of medical students’ satisfaction of the e-learning resource and the impact this has had on their knowledge of how to interpret a chest x-ray.

Box 1

Learning Outcomes of the e-Learning Resource

Learning Outcomes
By the end of the e-learning tutorial learners should be able to:
Assess systematically the quality of a chest radiograph
Apply a systematic approach for the interpretation of chest radiograph
Detect common abnormalities seen on a chest radiograph

Conceptual Framework: Learning Design and Development Principles

The underpinning learning theory guiding the development of this e-learning resource was adult learning theory, or andragogy.28,29 In doing so, it considers medical students as adult learners who are likely to be more motivated to learn when the learning environment provides autonomy and flexibility, and when the learning activity is informed by constructivist principles.30 According to andragogical principles, learning is more likely to be achieved when the content of the resource is tailored to learners’ needs, characteristics, and life context.28 An interactive, constructivist online learning environment, as opposed to a passive learning environment, has been found to help students learning more effectively.30 Accordingly, students are encouraged to actively engage in their learning.31 This can be through case-based scenarios, solving problems, and reflection. The way in which these educational and design principles were applied when developing the e-learning resource is described in detail below.

The design and development of this e-learning resource were based upon a range of instructional design, and multimedia principles. The ADDIE (Analysis, Design, Development, Implementation and Evaluation) model is commonly used amongst educators for designing and implementing educational resources.17 This is because it has clearly defined stages and a systematic approach that helps to organize the teaching content. However, the ADDIE model is not specific to e-learning, and therefore Overbaugh’s guidelines,18 that look specifically at e-learning was utilised. Another drawback of ADDIE is that sometimes it can be too linear and systematic, and time consuming to implement.19 In light of this, Dick and Carey instructional design model, which is a modified version of the ADDIE model, was used in the design of this e-learning resource. This modified version of ADDIE focuses on constant re-evaluation and revision of the content through formative assessment. This allows the learners’ needs to be at the centre of the e-learning resource.20

Various frameworks and design principles were utilised to ensure that the resource was developed on the assumptions upon which adult learning theory is situated. With this in mind, a PACT21 (People, Activities, Context and Technologies) analysis was utilised to analyse the learners, their needs, and their requirements of the resource. Following the PACT analysis, clear learning outcomes were developed that informed the development of learning activities in the e-learning resource. When thinking about the action verb for the intended learning outcomes, Blooms Taxonomy was used.22,23 Several important design principles were used to design the resource and develop learning activities to maximise learning and ensure it is learner centred. The main guiding design principles were Mayer’s 12 principles of multimedia.26 Overbaugh’s guidelines for the development of computer-based learning was used which is based on Gagne (2005) nine learning events of instructional framework.18,27 The manner in which these principles informed the development of the resource will be embedded in the description of its content, activities, and design features.

Methods – Putting Theory into Practice

Analysis of Needs

In line with andragogical theory and the ADDIE model, the first stage of developing the e-resource required an analysis of the learners and their needs. A PACT (People, Activities, Context and Technologies) analysis21 was conducted through informal discussions with two medical students during their clinical placement. The students were asked about their preferred activities, which revealed that they would like to learn more about x-rays of common chest conditions. These discussions revealed that interpretation of a chest x-ray is often presented during the clinical placement and forms the basis of investigation for most patients that junior doctors will see on the wards and in the emergency department. However, the students we spoke with reported difficulties understanding and performing this task. In line with RCR requirements, it was therefore recognised that this group of learners have a specific need to understand how to systematically interpret a chest x-ray.5 The medical students confirmed that the subject would be very relevant to their learning and it was established that the resource should be developed with all medical students attending a clinical placement in mind. These students should possess the pre-requisite anatomical knowledge and concepts relevant to the placement, but they lack content-specific terminology and concepts associated with chest x rays.

Design Phase

Once the target group of learners was identified, the second phase of the PACT analysis required consideration of the activities. However, before doing so it was essential to develop explicit learning outcomes that should inform the activities. The learning outcomes were therefore identified and written to reflect the radiology objectives with a focus on what medical students on clinical placement should gain upon completion of the e-resource (Box 1).

Following guidelines for the writing of good learning outcomes, they were designed to be Specific, Measurable, Achievable, Relevant and Timed (SMART).32 All the intended learning outcomes represented the higher cognitive domains in Blooms Taxonomy, as the aim of the e-learning resource is for the students to be able to interpret a chest x-ray that requires a deeper level of learning.22,23 They contain specific and active language and verbs such as assess, apply, and detect that make expectations clear and the standards by which they will be assessed (measurable). The learning outcomes also state what is likely to be achieved by completing the e-resource and are relevant for students at this stage of their studies (clinical placement in Radiology). The resource goes through a well-recognised and structured approach called ABCDE (Airway, Breathing, Cardiac, Diaphragm and Everything else) the students would be familiar with, so it places it in a relevant medical context. In addition, it contains six common cases that are in line with the common pathologies expected of medical students to be able to interpret. These are pulmonary consolidation, pleural effusion, pneumothorax, heart failure, pneumoperitoneum, and pulmonary embolism.

Development of the e-Resource

Learning activities are defined by Beetham (2007) as “a specific interaction of learner(s) with others using specific tools and resources, oriented towards a specific outcome”.24 These are of primary importance when designing an e-learning resource.25 The activities were developed with the learning outcomes in mind and in a way in which learners’ preferences were accommodated. More specifically, at the need analysis stage, students expressed a preference for an interactive, flexible tool that they could access as and when they need it.

Having considered the activities for the resource, we progressed to the third phase of the PACT model, which focuses on content. The content was created with the help of two radiology consultants who specialise in chest imaging. Additional materials were sourced from books, websites such as radiopedia.org,14 and online teaching resources. The e-learning resource takes approximately 20 minutes to complete. It has 19 slides included an initial slide on basics of chest x-ray anatomy, a systematic approach on how to review a chest x-ray, six common cases, a summary table and quiz. It is for continuous use but can be stopped and restarted at any point.

In the final phase of the PACT analysis, the technology is considered, and a decision was made to use Xerte Online Toolkits, which is free open source tool developed in 2009 for educational purposes. It was initially developed by Nottingham University but since 2014 Xerte is owned and managed by the Apero Foundation.33 Xerte allows the designer to achieve high level of interactivity and is also user friendly and suitable for those who do not have specialist Information Technology (IT) knowledge or skills. Once published the learning resource can be edited by the author or others if required. Xerte Online Toolkits is accessed via a web browser using standards compliant HTML5 and can deliver material to both small screens and large desktop computers. This means the e-learning resource can be accessed from anywhere with internet access.34

During the development phase, a storyboard was initially created on PowerPoint before transferring this to the Xerte platform.35 Overbaugh’s guidelines were used in conjunction with Mayer’s (2005) 12 multimedia principles.18,26 An initial slide on the basics of chest x-ray anatomy (Figure 1) was used to gain attention and stimulate recall of the student’s prior knowledge according to Gagne (2005) lesson framework and Mayer’s pre training principle.26,27 This allows the learners to focus on a task to promote their learning and ensure they have the necessary prior knowledge.

Figure 1

Basics – anatomy of chest x-ray slide. (1.Trachea, 2. Hila, 3. Lung, 4. Diaphragm, 5. Heart, 6. Aortic Knuckle, 7. Ribs, 8. Scapula, 9. Spine, 10. Clavicle).

In the next few slides, the e-learning resource goes through the important aspects of using a systematic approach for chest x-ray interpretation (Figures 2-5). Using Mayer’s contiguity principles, the explanations were presented in words and pictures by using annotated chest x-rays with words near the image to highlight the areas of focus (Figure 5).26,36 To prevent cognitive overload,37 Mayer’s segmenting and signaling principle was used to highlight the aspects in different coloured sections, which allows the learner to compartmentalise the structure, and have different slides that covers technical aspects, quality and systematic approach.26 Throughout the e-learning resource, Mayer’s coherence principle was used by keeping the content relevant and trying to limit the number of words per section (Figure 4).26 Mayer (2017) has shown that these principles are particularly important when students have little prior knowledge, such as the learners in the current setting.38

Figure 2

Technical aspects slide.

Figure 3

Obvious abnormality slide (arrow pointing at left lung mass).

Figure 4

Systematic approach slide.

Figure 5

Presenting slide (arrow pointing at left lung mass).

A summary table was added to reinforce what has been learnt.36 In slides 11–16 (Figure 6) there are six cases that the student can work through and think about the approach they have learnt. These include common diagnoses such as pneumonia, pneumothorax, and pleural effusion. This is in line with what is expected for medical students as part of their curriculum.5 The cases help to highlight the importance of this subject in real life. Maier and Warren (2013) suggest that cased based learning can help represent the common conditions and aid deeper learning.39 By using several different principles and theories, the e-learning resource aligns with the learning outcomes as it allows deeper learning and helps to re-enforce knowledge.

Figure 6

Cases slide.

The final quiz (Figure 7) assesses learner’s performance and if the learning outcomes have been met. There is instant feedback throughout the learning activities to help raise student’s confidence, motivation and allow them to monitor their progress.8 The e-learning resource was completed with further reading for the learner that would assist in consolidating their knowledge gained.

Figure 7

Quiz slide.

Findings – Implementation and Evaluation

Following on from the development of the e-learning resource, the final two stages were implementation and evaluation. During the implementation phase, it was important to ensure that it had been designed and developed to be functional. Evaluation of the resource was done at different points throughout the process.

Following the storyboard phase, informal feedback was sought from the two radiology consultants who helped create the initial content for the e-learning resource. This was to make sure that the content was relevant and of high standard. An example of the feedback that was received included adding a script on how to present the chest x-ray in an Objective Structured Clinical Examination (OSCE) format, which was subsequently added in the presenting section (see Figure 5). This showed the importance of gaining feedback at this stage which follows Dick and Carey's (2001) model.20

At the end of the e-learning resource a feedback form, adapted from Nesbit (2007),40 was added which the students could complete (). The feedback considered navigation, visual design, content and learning outcomes. There was also a question on rating the overall resource and if you would recommend the e-learning resource to other medical students. Free text questions such as what was good about the e-learning resource, what could be improved, and any further comments were used. These can give a lot of information about what the learners thought was good and specific areas of improvement.41

We disseminated the e-learning resource to medical students carrying out clinical placements at a busy hospital in the UK. Medical students were invited to complete the e-learning resource through email. As this was not a mandatory e-learning resource, 18 medical students from years 3–5 attending medical school at a UK University completed the e-learning resource. The breakdown of how many medical students from each year completed the e-learning resource is shown in Figure 8. The feedback received was very positive (see Figure 9), with the average rating of 9 for the e-learning resource.

Figure 8

Year of medical students completing the e-learning resource.

Figure 9

Results of feedback survey.

Ninety-four percent of learners agreed or strongly agreed that the learning outcomes were appropriate to their year of study, that the e-learning resource was easy to navigate, that the texts and graphics were of good quality, and that the content met the learning outcomes. All students said that they would recommend this e-learning resource to a colleague. Good aspects of the e-learning resource that the students highlighted were, the resource being clearly structured and easy to navigate, good visual learning and thorough explanations with relevant content. The learners highlighted some areas on how it could be further improved, such as the quiz could be more challenging, and more chest x-rays could be used to describe the diagnosis and pathology.

Conclusion and Future Implications

This paper describes the design and development of an e-learning resource for medical students on how to interpret chest x-rays. It provides an example of how instructional models, educational theories and multimedia principles can be used to create an e-learning resource.17 In particular, the use of well-established theories and models helped to organise the content and create a learner-centred resource.

Preliminary evaluation showed that students were satisfied with the e-learning resource and felt it helped them acquire knowledge on how to interpret chest x-rays. Even though the sample size was small, this was considered sufficient as it has been found that 95% of usability problems can be discovered in a sample of just five to six people.42 It must be noted, however, that this paper reports preliminary evaluation, and although positive, a more comprehensive evaluation is recommended to ascertain the impact and value of the tool.8,43 This could be expanded for example, by examining further and in-depth the long-term impact, change in behaviour and confidence in medical students with regards to chest x-rays and attitudes towards the topic.

Despite it being a small-scale evaluation, the paper does provide a useful insight for those who want to consider developing e-learning resources. It reinforces the value of using well-established educational theories and design to help guide the process. The student satisfaction of this e-learning resource is similar to other radiology e-learning resources that showed high level of satisfaction among students.15,16 The COVID-19 pandemic has led to widespread disruption of medical education as a result of which medical schools have had to rapidly provide innovative approaches and alternative ways of teaching students core areas of medicine.6,44 These have led to the use of webinars, online courses, and videos.45 This e-learning resource can be used as a stand-alone tool to increase medical student knowledge on how to interpret chest x-rays. The resource could also be used prior to medical students starting clinical placements and may give them more confidence in seeing patients and interpreting chest x-rays on the wards.4 Further e-learning resources on how to interpret common imaging modalities such as abdominal x-rays and computed tomography (CT) can also be developed which forms part of the medical students’ undergraduate curriculum.5 It may also give medical students an insight into the role a radiologist plays and motivate them to explore radiology as a future career.