Increasing medical student exposure to musculoskeletal medicine: the initial impact of the Orthopaedic Surgery and Sports Medicine Interest Group.

PURPOSE: To investigate the impact of the Orthopaedic Surgery and Sports Medicine Interest Group (OSSMIG) on medical student interest and confidence in core musculoskeletal (MSK) concepts through supplemental education and experiences at a single tertiary, academic institution.
METHODS: Medical student OSSMIG members at various levels of training were anonymously surveyed at the beginning and end of the 2014-2015 academic year.
RESULTS: Eighteen (N=18) medical student interest group members completed the survey. Significant improvement in their level of training was observed with regard to respondents' self-assessed competence and confidence in MSK medicine (p<0.05). Additionally, respondents' attitudes toward exposure and support from the interest group were significantly higher than those provided by the institution (p<0.05). Members believed OSSMIG increased interest in MSK medicine, improved confidence in their ability to perform orthopedics-related physical exams, strengthened mentorship with residents and attendings, and developed a connection with the Department of Orthopedic Surgery and its residents (median "Strongly Agree", interquartile range one and two scale items).
CONCLUSION: Since its inception 8 years ago, OSSMIG has been well received and has positively impacted University of Washington School of Medicine students through various interventions. Surgical interest groups should target both the students interested in primary care and surgery. Medical schools can provide additional exposure to MSK medicine by leveraging interest groups that provide early clinical experiences and supplementary instruction.

Introduction

The burden of musculoskeletal (MSK) disorders within the USA and around the world is not reflected in current medical school curriculums.1 MSK diseases affect over half of the USA population and account for over 18% of the 1.3 billion annual health care visits.2,3 However, medical students often lack confidence and knowledge about MSK medicine, especially those pursuing nonorthopedic careers.4–7 Additionally, for students interested in pursuing surgical careers, previous research has demonstrated that early opportunities, clinical exposure, and positive role models have a positive impact.8,9 This is especially true during the preclinical years and third year clerkships, prior to beginning the residency application process.10–12

The University of Washington School of Medicine (UWSOM) has been ranked by the US News and World Report as the No. 1 medical school in the nation for primary care training in 23 of the past 24 years.13 The average number of UWSOM students entering primary care specialties has been over 50% annually.14 The UWSOM required curriculum includes one-quarter of MSK education during the first year, one general surgery rotation, and one elective surgical rotation. With an emphasis on primary care, the majority of this curriculum provides limited exposure to surgical subspecialties.

The Orthopaedic Surgery and Sports Medicine Interest Group (OSSMIG) was established in 2009. Its goals were to provide supplemental education and experiences of core MSK concepts, examinations, and diagnoses; as well as support students interested in applying to orthopedic surgery residency programs. It was proposed that OSSMIG would increase interest in orthopedics and improve medical students’ competency and confidence in MSK medicine, regardless of their chosen career path. The purpose of this study is to assess the OSSMIG through an anonymous survey of its participants.

Materials and methods

Conception and development of OSSMIG

The OSSMIG was established in August 2009 led by junior medical students with support from the orthopedic surgery department and its residents. Founding officers created a constitution and registered with the institution’s Student Activities Office. The constitution outlined five core objectives:

Provide students additional MSK instruction through lectures and workshops.

Present students with opportunities to experience the field of orthopedic surgery outside of the classroom.

Offer students orthopedic research and networking opportunities.

Support students applying for orthopedic surgery by advising them throughout the process.

Promote mentoring among medical students, residents, and the attending surgeons.

To improve the quality of mentorship and experiences, OSSMIG cultivated a relationship with the institution’s Department of Orthopedic Surgery and Sports Medicine. This relationship was established through a faculty advisor who oversaw a core group of orthopedic residents interested in educating and mentoring. Residents acted as liaisons by coordinating, teaching, and leading events.

OSSMIG officers sent information to all UWSOM students and presented at the annual interest group fair to engage anyone interested in MSK medicine. An institutional listserv (application that circulates emails to subscribers) was created, allowing leadership to easily communicate with group members. A full-featured, department-supported OSSMIG website (http://www.orthop.washington.edu/?q=ossmig/orthopaedic-surgery-and-sports-medicine-interest-group-ossmig.html) was created, which includes announcements, calendars, and member resources.

Since inception, OSSMIG has developed and maintained a diverse offering of activities, workshops, and services. These extracurricular activities allow students to explore MSK medicine and orthopedic surgery, while receiving guidance and gaining knowledge (Table 1). These events and resources are reviewed and adapted annually for quality improvement.

Table 1

Events and services provided by OSSMIG throughout the academic year

OSSMIG events and services
OSSMIG annual planning meeting
Allows OSSMIG officers, residents, and faculty advisors to meet, review previous events, and coordinate events for the upcoming academic year
Introduction to orthopedic surgery and musculoskeletal medicine
Furnishes UWSOM students with information about orthopedic surgery, an introduction to basic concepts in musculoskeletal medicine, and the opportunities available to explore this specialty through OSSMIG
Emergency room orthopedic Trauma Call
Provides UWSOM students with the opportunity to take overnight call shifts at Harborview Medical Center. Students assist residents, learning to evaluate and manage acute injuries in the ER, and gain exposure to orthopedic surgery
Workshop: basic knee, shoulder, and neurologic examination
Teaches students how to perform a thorough knee and shoulder exam, as well as a proper upper and lower extremity distal neurovascular exam
Workshop: basic splinting
Teaches students to correctly apply a variety of splints to the upper and lower extremities, as well as perform simple reduction techniques
Detailed medical student guides
These documents include: general orthopedic information, managing away rotations, streamlining the application process, as well as an impression of orthopedic programs. Guides are internally developed and updated annually
Mentorship networking
Coordinates longitudinal advising of medical students by senior medical students and residents throughout the medical school and the residency application process
Community outreach
OSSMIG members teach local college and high school students about basic musculoskeletal topics through show-and-tell and question-and-answer formats
Research and preceptorships
Facilitates UWSOM students’ setting up and coordinating research opportunities and preceptorships with the Department of Orthopedic Surgery and Sports Medicine faculty
Subinternships/application counseling
Offers guidance to students throughout the subinternships (away rotations) and residency application process. Meetings and guides are provided
Fourth year mock interviews
A simulated interview experience for fourth year medical students applying to orthopedic surgery residency programs. A panel of residents provides feedback

Abbreviations: ER, emergency room; OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group; UWSOM, University of Washington School of Medicine.

Outcomes

Cross-sectional surveys of OSSMIG members were administered using a secure anonymous institutional online survey system. Surveys were conducted at the beginning and end of each academic year as part of an internal quality assurance and quality improvement process. The survey from the 2014–2015 academic year used a de-identified submission process allowing for blinded data analysis. The institution’s Human Subjects Division reviewed the study and determined it to be exempt from Institutional Review Board approval due to the usage of anonymous surveys and data. Informed consent was provided through the survey platform and verified upon submission of the survey.

At the start of the academic year, members completed a 15-question survey regarding their planned career path, perception of current MSK education, confidence in basic MSK knowledge, and expectations. At the end of the academic year, members completed a 20-question survey inquiring about their satisfaction with OSSMIG, influence on their interests, and comfort with MSK concepts. Answers were provided on a five-point Likert scale.

Statistical analysis

Statistics were performed with R version 3.2.2 (R Core Team, Vienna, Austria) including packages ggplot2, pwr, and plyr. Due to categorical data that did not generally have a normal distribution, nonparametric statistics were utilized. Central tendency is reported by the median and interquartile range (IQR). Differences in paired responses were assessed by the Wilcoxon signed rank test. For unpaired responses, the Wilcoxon rank sum test was used. A p value of <0.05 was considered significant. All analyses were preplanned. A power analysis based on finding a strong effect size estimated that 18 evaluation periods would provide an 80% chance of finding a difference between paired responses, if one exists.6

Results

Membership

For the 2014–2015 academic year, there were 60 active OSSMIG members (6.7% of the student body; 60/900). Membership consists of students interested in pursuing orthopedic surgery (67%), primary care (22%), and undecided students (11%). From 2009 to 2015, OSSMIG membership increased from 20 to 60 students. Membership peaks at the beginning of each academic year and is highest among preclinical students (67% – first and second year students). The 2014–2015 interest group membership survey response rate was 30% (18/60). The 18 interest group member respondents comprising the analysis group had diverse training levels (three first year, five second year, five third year, four fourth year medical students, and one student declining to answer the question). Respondents were queried at the end of the academic year about the overall influence of OSSMIG on their career plans (N=18). These members reported that OSSMIG confirmed their interest in orthopedic surgery (50%), convinced them to pursue orthopedic surgery (17%), influenced them to continue to pursue another specialty (28%), and dissuaded them from pursuing orthopedic surgery (5%).

Self-assessed competence

Two sets of questions compared respondents’ self-assessed competence and confidence for their level of training. When students were asked if they felt competent with MSK anatomy, responses improved from a median of “Neutral” (IQR – one scale item) before the interest group involvement to “Agree” (IQR – zero) afterward. This self-assessment was significant (Wilcoxon signed rank test, p=0.007; Figure 1). When students were asked if they felt competent with basic MSK trauma care, the median answer from pre- to post-interest group involvement shifted from “Disagree” (IQR – 1.75 scale items) to “Agree” (IQR – two scale items), which was significant (Wilcoxon signed rank test, p=0.006; Figure 2).

Figure 1

Medical students’ pre- and post-OSSMIG self-assessed competence with musculoskeletal anatomy.

Abbreviation: OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group.

Figure 2

Medical students’ pre- and post-OSSMIG self-assessed competence with basic musculoskeletal trauma.

Abbreviation: OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group.

Attitudes of institution vs interest group

Two sets of questions compared respondents’ attitudes regarding exposure and support from their institution and the interest group. When responding to a statement about providing adequate exposure to MSK medicine and the field of orthopedic surgery, the interest group received significantly higher scores (median of “Disagree” vs “Agree”, Wilcoxon rank sum test p=0.009; Figure 3). Similarly, when responding to a statement about providing adequate support to students pursuing a residency in orthopedic surgery, the interest group received significantly more positive responses (median of “Disagree” vs “Agree”, Wilcoxon rank sum test p=0.001; Figure 4).

Figure 3

Medical students’ attitudes toward institutional vs OSSMIG exposure to musculoskeletal medicine and the field of orthopedic surgery.

Abbreviation: OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group.

Figure 4

Medical student attitudes toward institutional vs OSSMIG support to students pursuing a residency in orthopedic surgery.

Abbreviation: OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group.

Assessment of the interest group

A series of questions asked respondents about their experiences with the interest group. Overall, the results were positive (Figure 5). Respondents tended to find OSSMIG helpful in deciding whether to pursue a career in orthopedics (median “Agree”, IQR two scale items), increasing interest in MSK medicine (median “Agree”, IQR two scale items), improving confidence and ability to perform orthopedics-related physical exams (median “Agree”, IQR two scale items), fostering mentorships with residents and attendings (median “Agree”, IQR one scale item), and feeling more connected with the Department of Orthopedic Surgery and its residents (median “Agree”, IQR 1.25 scale items). The participants strongly recommended other medical schools to have an active orthopedic interest group (median “Strongly Agree”, IQR one scale item).

Figure 5

Medical students’ experiences and attitudes toward OSSMIG.

Abbreviation: OSSMIG, Orthopaedic Surgery and Sports Medicine Interest Group.

Discussion

OSSMIG and MSK medicine education

OSSMIG has evolved over the past 8 years to provide supplementary education, opportunities, and support to UWSOM medical students. Membership increased to over 60 medical students annually, and targets both students interested in pursuing orthopedic surgery (67%) and primary care specialties (22%), but seeking a better understanding of MSK medicine. The group’s greatest impact appears to be the supplemental MSK education, resources, and experiences provided to the medical students outside of the standard UWSOM curriculum. This deficiency of subjective competence with MSK anatomy and basic trauma care was evident in the students surveyed prior to their involvement in OSSMIG (Figures 1 and 2). A lack of exposure to MSK medicine and orthopedics was also reported (Figure 3).

This trend appears to echo a nationwide concern regarding inadequacies in MSK teaching within the medical education landscape.3–7 The literature provides widespread evidence that medical students and residents may not be sufficiently prepared to perform accurate MSK workups and examinations.15–20 When evaluating medical students, Skelley et al observed only 19% assessed obtained a passing score on the competency assessment.18 Similarly, Schmale found that <50% of fourth year medical students at a single institution successfully demonstrated competency in MSK concepts.4

Though MSK complaints continue to be one of the most common reasons people seek medical care annually, a majority of these patients will not be evaluated by an orthopedic surgeon, but rather by primary care physicians (eg, family medicine, rehabilitation, internal medicine, and/or pediatrics).1,2 Deficiency in MSK knowledge appears to be present in these first-line physician fields.19,20 An MSK competency assessment created by Freedman and Bernstein revealed MSK-related knowledge deficiencies in primary care fields.6 When family practice, internal medicine, and pediatric faculty from a single hospital were assessed by Lynch et al, 64 physicians were not able to demonstrate adequate MSK knowledge.20

Although the initiation of an interest group is not necessarily the answer, it provides complementary instruction and unique experiences difficult to provide in a classroom. In orthopedics, dedicated exposure to MSK instruction can improve competence, even in undergraduates.21 Within OSSMIG, those members surveyed demonstrated a positive attitude toward OSSMIG in a number of areas. The year-end query of students’ subjective competency increased in both MSK anatomy (“Neutral” to “Agree”, p=0.007) and basic trauma care (“Disagree” to “Agree”, p=0.006) after involvement in the group’s events (Figures 1 and 2). They believed that OSSMIG increased their interest in MSK medicine and improved their confidence to perform a proficient MSK physical exam (Figure 5). The group was also impactful on students in deciding whether to pursue a career in orthopedics (Figure 5). Respondents reported that OSSMIG provided superior exposure to MSK medicine and the field of orthopedic surgery (Figure 3).

This improved exposure is likely a result of providing the ability for OSSMIG members to explore the “real world” of MSK medicine. During the preclinical years, these students have limited opportunities outside the classroom and sometimes limited exposure inside as well. In fact, the inclusion of MSK education within the medical school classroom curriculum has been associated with a 12% higher rate of application into orthopedic surgery residency programs.22 The Trauma Call experience is an example of one of the OSSMIG programs created to address this deficiency (Table 1). This program has become popular and jointly beneficial – for students, it offers a unique clinical experience and exposure to orthopedics; for the resident, it provides a valuable team member to assist during busy call shifts and the opportunity to teach. These experiences outside the classroom have been shown to help increase student interest.23–26 While the establishment and impact of orthopedic medical student interest groups was not found during review of the literature, general surgery interest groups at other institutions have been described and found to be positively received and demonstrate similar benefits. These general surgery interest groups exhibited positive supplemented surgical education, provided opportunities to improve procedural skills, and increased entrance rates into general surgery residency programs threefold.24,26

It appears that an interest group’s impact is highest when it is welcoming to all students, not just dedicated to assisting those pursuing a specific specialty. For an orthopedic interest group, focusing on unique MSK experiences and supportive MSK education in a supplementary fashion may help strengthen the MSK competence and confidence of those students involved in whatever career path they choose.

Limitations and future direction

This study has a number of limitations. The index surveys were issued as part of the group’s quality assurance and improvement processes and were reviewed retrospectively. These were not designed with a specific research question in mind and serial year data were not available for evaluation. Response rate was only 30%. Members were asked about their confidence in MSK medicine, but no competency assessment tool was administered. No comparison data were available from a control group that was not involved in OSSMIG, so correlations are difficult to infer.

The study was performed at a single institution with a large primary care focus, and thus, the study population may not be representative of other medical schools. Specifically, the MSK curriculum, required clerkships, and established support system can vary between schools. Thus, the impact of a dedicated orthopedic interest group may differ.

Lastly, the entire student body was not queried about the adequacy of MSK instruction. Since those surveyed were only OSSMIG members, responders may have bias toward feeling the instruction provided by the medical school curriculum was inadequate and, thus, actively sought out supplementary instruction.

Future studies will focus on assessing pre- and post-competency using an objective assessment measure and comparing this to a matched group of students who are not involved in the interest group. Additional assessments into the reasoning and motivations of the members who switched their focus from orthopedics to another specialty would be advantageous. A national query to investigate what other medical schools are doing would be helpful to see what is effective and if the findings in this and future studies are transferable.

Conclusion

Education in MSK medicine is inadequate within the USA medical school curricula. In concert with several studies evaluating medical school MSK education, it is recommended that medical schools provide more effective preparation and exposure to this field. This can be accomplished by increasing MSK instruction time, providing early clinical experiences, and integrating supplementary education by means of extracurricular interest groups. Since its inception 8 years ago, OSSMIG has been well received and has positively impacted UWSOM students through various interventions. By welcoming students’ interest in both primary care and surgery, it has expanded their exposure to MSK medicine and increased their subjective competence and confidence.

Maintaining strong student leadership and developing a relationship with the institution’s orthopedic surgery department is crucial to enhance the group’s function. An interest group that provides general MSK instruction to all-comers and supportive guidance to those applying to orthopedic surgery appears most effective. The development of similar interest groups at other schools is encouraged. OSSMIG will continue to refine, strengthen, and build its educational offerings, ultimately furthering student interest and success in orthopedic surgery and primary care MSK medicine.