The student experience of applied equivalence-based instruction for neuroanatomy teaching.

PURPOSE: Esoteric jargon and technical language are potential barriers to the teaching of science and medicine. Effective teaching strategies which address these barriers are desirable. Here, we created and evaluated the effectiveness of stand-alone 'equivalence-based instruction' (EBI) learning resources wherein the teaching of a small number of direct relationships between stimuli (e.g., anatomical regions, their function, and pathology) results in the learning of higher numbers of untaught relationships.
METHODS: We used a pre and post test design to assess students' learning of the relations. Resources were evaluated by students for perceived usefulness and confidence in the topic. Three versions of the resources were designed, to explore learning parameters such as the number of stimulus classes and the number of relationships within these classes.
RESULTS: We show that use of EBI resulted in demonstrable learning of material that had not been directly taught. The resources were well received by students, even when the quantity of material to be learned was high. There was a strong desire for more EBI-based teaching. The findings are discussed in the context of an ongoing debate surrounding 'rote' vs. 'deep' learning, and the need to balance this debate with considerations of cognitive load and esoteric jargon routinely encountered during the study of medicine.
CONCLUSION: These standalone EBI resources were an effective, efficient and well-received method for teaching neuroanatomy to medical students. The approach may be of benefit to other subjects with abundant technical jargon, science and other areas of medicine.

Introduction

Consider some basic neuroanatomical terms: ‘substantia nigra,’ ‘hippocampus,’ ‘pons,’ and ‘cerebellum,’ These structures all perform essential functions; medical students should be able to identify them, describe what they do and the consequences of damage to them. However, these names are derived from Latin or Greek words which are, at best, only distantly related to the medical relevance of these brain regions or to everyday language. The abundance of esoteric jargon has long been suggested as a reason for the persistence of rote learning strategies in medical education [1].

Jargon is a source of cognitive load [2]. The cognitive load theory of education is based upon research showing that human working memory capacity is extremely limited and easily overloaded, but that the processing of new information through working memory is essential for that information to be integrated into existing knowledge (i.e., learned) [3]. Thus there is a need to limit extraneous sources of cognitive load and focus on relevant information only [4,5]. Unfortunately the esoteric language of medicine can quickly cause working memory to become overloaded.

Equivalence-based instruction (EBI) is an instructional method based upon the theory of ‘stimulus equivalence’ [6]. A defining feature of EBI is that the subject learns more than that which is directly taught, and thus the efficiency of instruction is maximized. For example, if a student is taught a relationship between stimulus, ‘A’ (e.g., the words ‘substantia nigra’) and stimulus ‘B’ (e.g., a picture of the substantia nigra), and then taught a relationship between ‘A’ and a different stimulus ‘C’ (e.g., ‘the brain region lost in Parkinson’s disease’), then they will learn, without being directly taught, a relationship between ‘B’ and ‘C’; when shown pictures of unlabelled brain regions and asked to identify which of them is lost in Parkinson’s disease, they will correctly select the picture of the ‘substantia nigra.’ This outcome is called ‘stimulus equivalence’ [7]. The addition of a single additional taught relationship (e.g., between ‘A’ and stimulus ‘D’ ‘produces dopamine’) causes an exponential increase in the number of relationships learned without direct teaching (i.e., B=D, C=D). These interrelated stimuli (A to D) are then recognized as equivalent.

These relationships are quickly learned using a ‘match-to-sample’ (MTS) paradigm [6] consisting of learning events in which a participant is presented with an initial stimulus, known as ‘the sample.’ A number of comparison stimuli are then presented, from which the participant must the select the one which best ‘matches the sample’ (e.g., as shown in Fig. 1, the words ‘occipital cortex’ could be the sample, with pictures of the different cortical regions as comparison stimuli). Feedback may be given following each selection, to facilitate learning.

Fig. 1.

Representative screen shot of a match-to-sample trial (left) and following a successful response (right). In this example the A=B relation was being taught for stimulus class 2 (i.e., A2=B2; see Table 1). ‘Occipital cortex’ (A2) was presented as the sample, while B1, B2, B3, and B4 (in random order) were presented as comparison stimuli. Participants were required to select the correct B stimulus.

A handful of studies have experimentally demonstrated that EBI is effective as a strategy in ‘higher education.’ Fienup et al. [8] used EBI in an experimental laboratory setting to teach some basic neuroanatomy to small (4 student) groups of volunteer psychology students, while Pytte and Fienup [9] showed EBI was effective within a large-group instructor-led lecture-based setting.

Here, we evaluated the student experience of applied EBI using standalone resources streamlined to optimize the learning experience, and determine whether increasing the size and complexity of resources affected this experience. We focused on neuroanatomy in order to build on studies from Fienup et al. [8]. Also, it has been proposed that medical students/trainees will experience ‘neurophobia’: a lack of confidence and understanding in neuroanatomy/neuroscience, caused, in part, by the complexity of these topics and the (perceived) quality/quantity of the teaching received [10,11]. Learning resources aimed at improving confidence and understanding of neuroanatomy are therefore desirable.

Methods

Three resources were designed, in a consecutive manner. Relations are shown in Table 1 and Table 2. Participants were medical students at Swansea University, from both years 1 and 2. A power analysis using G*Power (GPower Software Inc., Kiel, Germany) [12] recommended a sample size of 45 (one-tailed with power 0.95, effect size 0.5 and α 0.05); our sample sizes were 43, 24, and 39 in resources 1, 2, and 3, respectively. Students completed the resource either in timetabled 25 minutes sessions or in their own time. Resources were advertised by email and in teaching sessions. No incentives were given for completing the resources, besides the learning experience itself. Resources were created using E-Prime ver. 1.3 from Psychology Software Tools Inc. (Pittsburgh, PA, USA) and were available on Windows 7 PCs with 19-inch widescreen LCD displays. Images used in Table 1 were adapted from an image in the public domain. Images were used in Table 2 under the terms of creative commons license CC-BY-SA-2.1-JP issued by the creator: BodyParts3D, © The Database Center for Life Science. Items included in the resource were selected following consultation and pilot testing with medical students interested in the subject.

Table 1.

Stimuli used in resources one and two

Stimulus class	Category
	A: structure name	B: image	C: function	D: pathology	E: anatomy
1	Frontal cortex		Function: selecting & planning responses	Pathology: impulsivity	Anatomy: Brodmann areas 4, 6, 8, 9, 10, 11, 44, 45
2	Occipital cortex		Function: vision	Pathology: sight problems	Anatomy: Brodmann areas 17, 18, 19
3	Parietal cortex		Function: attending to stimuli	Pathology: neglect	Anatomy: Brodmann areas 1, 2, 3, 5, 7, 39, 40
4	Temporal cortex		Function: identifying the nature of stimuli	Pathology: disturbed auditory perception	Anatomy: Brodmann areas 21, 22, 37, 41, 42

The four regions of the cerebral cortex constituted the classes, while the stimuli were the name (A), an image showing anatomical location (B) and information describing function (C), pathology (D), and Brodmann areas (E).

Table 2.

Stimuli used in resource 3

Stimulus class	Category
	A: structure name	B: image	C: function	D: pathology
1	Amygdala		Function: involved in the modulation of aggression	Pathology: failure to exhibit fear
2	Cerebellum		Function: co-ordination of movement	Pathology: ataxia
3	Corpus callosum		Function: connects the cerebral hemispheres	Pathology: split brain syndrome
4	Hippocampus		Function: conversion of short term memory to long term	Pathology: memory loss
5	Hypothalamus		Function: link the nervous system to the endocrine system	Pathology: hormonal/ homeostatic disruption
6	Medulla oblongata		Function: feedback loops of the autonomic nervous system	Pathology: breathing difficulty or death
7	Pons		Function: feedback loops of the autonomic nervous system	Pathology: locked-in syndrome
8	Thalamus		Function: relay between brainstem/ spinal cord and cortex	Pathology: Dejerine-Roussy syndrome

The eight stimulus classes pertained to various neuroanatomical structures, while the categories described either structure name, its anatomical location on a diagram, a particular function of the structure, and a result of pathological damage to the structure. In each case the image shown is one slice of a total twelve frames, the composite of which created a rotating animated GIF.

Research design and resource structure

We utilized a quasi-experimental pretest-postest design. Resources comprised three main phases; (1) pre-test of untaught relations and self-reported confidence in the subject, (2) learning of taught relations, and (3) post-test of (same) untaught relations and self-reported confidence in the subject. Each consisted of a series of learning events in MTS format. An example is shown in Fig. 1. To orient participants to the layout, detailed on-screen instructions were given followed by a simple MTS example: the word ‘blue’ was shown as the sample above four squares; blue, red, green, and yellow; participants had to select the blue square.

Pre-learning test of untaught relations

This tested participants baseline level of knowledge of the ‘equivalence’ relationships that would not be directly taught in the learning phase (e.g., B=C, B=D, and C=D). This is a subset of the total untaught relations, ignoring symmetrical variants (C=B, D=B, and D=C), and symmetrical variants of taught relations (B=A, C=A, and D=A). As our focus was on the student experience we felt it unnecessary to provide an exhaustive, repetitive test of all relations. For advanced learners, competence on a subset of equivalence relations implies competence on their symmetrical variants [8].

Participants were first asked “How would you rate your current level of confidence with regard to your knowledge of neuroanatomy? 1=weak, 3=average, 5=strong” on a 5-point Likert scale. They then began the pre-test. Each untaught equivalence relation was presented once only, in random order, with no feedback and a brief (1 second) blanking of the screen between. Upon completion, participants were told their score. Participants scoring 80%+ were advised that their knowledge of neuroanatomy appeared to already be quite high and thus they may not benefit from the resource, but that they were free to continue should they wish. All participants elected to proceed.

Learning of taught relations

This phase comprised repeated MTS learning blocks of all those relations with stimulus ‘A’ as the root (A=B, A=C, A= D, etc.), for each brain region in the resource. Each block contained all the different combinations of category and stimulus class being taught (A1B1, A2B2, A3B3, A4B4, A1C1, etc.) once only, in random order, before beginning a new block. Feedback was provided; if the incorrect stimulus was selected, the screen cleared and the word ‘incorrect’ was displayed in red for 3 seconds. If the choice was correct, the word ‘correct!’ was displayed in blue, together with the sample stimulus and the target stimulus, again for 3 seconds (as shown in Fig. 1). After each question participants were told how many correct answers they had achieved thus far. Blocks repeated until participants attained a required criterion of consecutive correct responses (see below).

Post-learning test of untaught relations

This was a repeat of the pre-test and confidence rating. Students were also then asked further feedback questions; firstly, “how useful did you find this learning resource?” on a five-point Likert scale with ‘not at all useful’ and ‘extremely useful’ attached as descriptive labels to points 1 and 5, respectively; secondly, “would you like more resources structured in this way?” with yes or no as response options. Further feedback comments were collected on paper or via email.

Specific details of individual resources

Resource 1 piloted EBI-based neuroanatomy teaching using four of five categories (A-D) shown in Table 1, thus there were 12 taught relations (learning phase) (A=B, A=C, and A= D×4 cortical regions) and 12 untaught relations in pre/post-test (B=C, B=D, and C=D×4 regions). Criterion for completing the learning phase was all 12 taught relations answered correctly.

Resource 2 (Table 1) included 16 (4 relations×4 regions) taught relations per block. Criterion for completing the learning phase was 16 consecutive correct answers. There were 24 untaught relations in the pre/post test phases (B=C, B=D, B=E, C=D, C=E, and D=E relations×4 regions).

Resource 3 covered three relations for eight different neuroanatomical structures, giving 24 taught relations (Table 2). Criterion for completing the learning phase was 22/24 correct within a given block with 24 untaught relations in the test phases (B=C, B=D, and C=D relations, 8 structures).

Statistical analyses

Wilcoxon matched-pairs signed rank tests were used to compare mean scores across participants on the pre-test and post-test, both for the percentage of correct answers on the untaught relations test, and confidence ratings. One-sample Wilcoxon signed rank tests were used to compare overall usefulness ratings against the ‘indifference’ midpoint of 3.

Ethical approval

It was obtained, prior to data collection, from the joint ethics committee of the Colleges of Medicine and Health and Human Sciences at Swansea University, United Kingdom.

Results

Twelve taught relations

Results are summarized in Table 3. Mean score on post-test (94%) was significantly higher than on pre-test (75%), W=-727, P<0.0001. 25/43 participants (57%) scored 100% on post-test, indicating a ceiling effect. There was also a significant improvement in participants confidence, W=-682, P< 0.0001 (Fig. 2). Students rated the resource as useful (Fig. 3), Z=3.282, P<0.005. 88% (38/43) indicated they would like additional resources in this format.

Table 3.

Results from medical student performance on the three resources, and the percentage of students requesting additional resources designed using ‘equivalence-based instruction’

Resource	Relations			Untaught relation test (%)
	Taught	Untaught	No.	Pre	Post	More?
1	12	12	43	75.3	94.2	88
2	16	24	24	46.0	91.3	92
3	24	24	39	64.1	93.1	97

Fig. 2.

Medical students’ ratings of their confidence in the topic of neuroanatomy before and after completion of resource 1 (A), 2 (B), and 3 (C). These data are shown arranged around the midpoint of the 5-point Likert-type scale. Following completion of either resource there was a clear and statistically significant shift, within the participant group, to responses indicating a higher level of confidence.

Fig. 3.

Medical student ratings of their perceived ‘usefulness’ of the individual resources. These data are shown arranged around the midpoint of the 5-point Likert-type scale. There was no significant difference found between ratings for the individual resources (see text).

Qualitative student feedback was positive (Table 4), with a desire for more of these resources being a recurring theme. Given that dissatisfied service users are more likely to provide negative feedback than satisfied users are to provide positive feedback, this was particularly encouraging. Improvements were also suggested. The small number of negative comments highlighted the repetitive feature of the EBI approach.

Table 4.

Coding of participant free text feedback for resource 1

Positive: 14	Neutral: 2	Negative: 4
Examples:	Example:	Examples:
Please can we have more	Explanations as to why an answer is right or wrong would help, and a bit more variety of answers.	Initially really enjoyed it, thought it was a good learning tool, however soon just found it annoying+frustrating, not enjoyable annoying repetition—it's learning by repetition rather than being taught.
I would like more sessions like this
Yes, more please
Very good, more please
Outrageously good
Very useful

Responses were received and simply coded into ‘positive,’ ‘neutral,’ and ‘negative,’ with examples given of each. Limited free-text comments were received for the other resources (3 in total—not shown) and these contained no new themes.

Sixteen taught relations

Results are shown in Table 3. Scores on the pretest of untaught relations were lower compared to resource 1, presumably due to the additional untaught relations. Despite the sample size being underpowered for this resource, a significant learning effect was again observed; mean score of 91% on post-test being significantly higher than pre-test (46%), W=-274, P<0.0001. 16/24 participants (66.7%) scored 100% in the post-test, again suggesting a ceiling effect. Confidence again improved (Fig. 2), W=-132, P<0.0016, and students found the resource useful, Z=3.586, P<0.001 (Fig. 3). 92% (22/24) of students indicated that they would like to see more resources in this format.

Twenty-four taught relations

Results are summarized in Table 3. Scores in the post-test (93%) were again significantly higher than on the pre-test (64%), W=-780, P<0.0001. 8/39 (21%) showed maximum scores of 100%. Confidence in knowledge of the topic was again improved, W=-553, P<0 .0001 (Fig. 2) and usefulness rating was again significantly higher than the indifference midpoint of 3, Z=4.435, P<0.001.

This resource included an additional evaluation question to probe the student experience of using EBI versus other methods. Participants were asked “please take a moment to think about the amount of time you have spent in completing the resource, what you have learned, and if this has improved your confidence in the subject of neuroanatomy. Now think about other ways you might have spent this time to study the same topic, such as reading a textbook. Overall, how well-spent do you feel your time has been in completing the resource compared to other instructional methods?” This question was presented immediately after the ‘usefulness’ question. Responses were on a 5-point Likert scale, where 1 was designated as ‘not as useful as learning from a textbook,’ 3 was designated as ‘just as useful as…’ and 5 was ‘more useful than….’ 76% of students favored the resource over a textbook (42.1% selecting ‘4’ on the Likert scale and 34.2% selecting ‘5’). Overall rating was significantly higher than the midpoint of the scale (‘3,’ ‘just as useful’), Z=4.518, P<0.001.

Comparison of the student experience across all three resources

Resources 1-3 contained increasing levels of complexity, yet completion of all resources was associated with statistically significant increases in confidence (Fig. 3) with no changes in ratings of ‘usefulness’; direct comparison of the rated ‘usefulness’ of each resource using a Kruskal-Wallis test revealed no significant difference, H=1.208, P=0.55.

Discussion

In the three studies presented here, medical students using standalone EBI-based resources to learn neuroanatomy reported a highly positive learning experience, and a significant increase in their confidence even when faced with learning a considerable volume of learning. Increasing the numbers of relations did not diminish the positive learning experience.

Improved confidence and engagement are perhaps the most salient of our findings, relating directly to the proposed causes of ‘neurophobia.’ A student having a positive learning experience, paired with a demonstrable outcome of having learned the name, location and basic function of major neuroanatomical regions in approximately 25 minutes, may be less daunted by more complex neuroanatomy. Structuring learning resources in this way also signposts students to the fundamental scaffolding of the neuroanatomy under study, something which might not be so obvious from an alternate mode of study (e.g., reading a textbook). Indeed, 76% of our participants rated even the most complex learning resource as more useful than a textbook when considering time invested.

Our findings support the claim of Pytte and Fienup [9] that EBI may be effectively implemented within a natural teaching environment at a university. Pytte and Fienup [9]’s classroom-based study appears to require a substantial investment of time, effort and planning to teach some very basic neuroanatomy. Our simpler and more cost-effective approach may best utilize the benefits of EBI through self-contained standalone online resources.

Despite these positive findings, EBI is not appropriate for all contexts in medical education; healthcare professionals clearly rely on much more than simple structure-function-pathology relationships. A small number of our participants expressed the opinion that the resources represent rote learning, possibly due to their repetitive nature. It is a widely held view that rote learning is an undesirable educational strategy [13]. A persistence of rote learning in medical education has been thought to arise, at least in part, through the existence of esoteric jargon and factual overload [1]. Rote learning is not universally regarded as negative; from the perspective of cognitive load theory it has been suggested that rote learning may facilitate the committing of core knowledge and skills to ‘automaticity,’ thereby freeing up space in the limited working memory capacity for deeper levels of thinking [14]. The approach demonstrated here, while possibly repetitive or even rote, ensures that esoteric jargon is placed directly into the relevant structure-function relationship using an extremely efficient and active form of learning, rather than traditional rote-learning or mnemonics.

There are a number of limitations to the interpretation of these data, most of which result from our taking the EBI paradigm out of the laboratory and into real classrooms. For example, students were not required to complete the resource, or to allow us to collect their responses, all of which were anonymous. Thus the positive student experience may be inflated by self-selection, compounded by the fact that our sample sizes were quite low. Further research would be helpful to determine whether the positive findings generated in this context generalize to other concepts and disciplines. It would also be useful to determine whether the information learned during EBI can be retained for a longer period of time, or to directly test how it compares when directly tested against other, more traditional teaching methods for neuroanatomy.