Assessment of medical students' shared decision-making in standardized patient encounters.

BACKGROUND: Shared decision-making, in which physicians and patients openly explore beliefs, exchange information, and reach explicit closure, may represent optimal physician-patient communication. There are currently no universally accepted methods to assess medical students' competence in shared decision-making.
OBJECTIVE: To characterize medical students' shared decision-making with standardized patients (SPs) and determine if students' use of shared decision-making correlates with SP ratings of their communication.
DESIGN: Retrospective study of medical students' performance with four SPs. PARTICIPANTS: Sixty fourth-year medical students. MEASUREMENTS: Objective blinded coding of shared decision-making quantified as decision moments (exploration/articulation of perspective, information sharing, explicit closure for a particular decision); SP scoring of communication skills using a validated checklist.
RESULTS: Of 779 decision moments generated in 240 encounters, 312 (40%) met criteria for shared decision-making. All students engaged in shared decision-making in at least two of the four cases, although in two cases 5% and 12% of students engaged in no shared decision-making. The most commonly discussed decision moment topics were medications (n = 98, 31%), follow-up visits (71, 23%), and diagnostic testing (44, 14%). Correlations between the number of decision moments in a case and students' communication scores were low (rho = 0.07 to 0.37).
CONCLUSIONS: Although all students engaged in some shared decision-making, particularly regarding medical interventions, there was no correlation between shared decision-making and overall communication competence rated by the SPs. These findings suggest that SP ratings of students' communication skill cannot be used to infer students' use of shared decision-making. Tools to determine students' skill in shared decision-making are needed.

BACKGROUND

Medical students must achieve communication skills competence to provide effective care to patients. Communication skills have been linked to patient outcomes such as satisfaction and adherence1,2. Doctor–patient communication can entail many behaviors including establishing rapport, eliciting the patient’s perspective, and engaging in shared decision-making.

Shared decision-making has been promoted by experts in clinical communication as an ideal model of physician–patient communication. Shared decision-making is based on the premise that the best medical decision for an individual patient incorporates the patient’s preferences and values through a process in which the physician and patient openly explore beliefs, exchange information, and reach explicit closure.3–8 Advocates of shared decision-making believe it provides a better medical encounter experience than either paternalistic (physician-directed) or consumerist (patient-directed) decision-making styles.7,9 Patients who experience their preferred decision-making style with their primary physicians are more likely to perceive those physicians as providing excellent care.10,11 Some studies show that shared decision-making improves patient satisfaction, adherence to medications, and health outcomes. 12–14

Assessing shared decision-making behavior may not be simple, for either practicing physicians or students. It has been operationalized as a set of measurable communication behaviors incorporating patients’ preferences and values.4,7,15 There are three domains of behaviors common to the shared decision-making process: 1) exchange of feelings and beliefs; 2) exchange of information about the disease, its diagnosis and treatment; and 3) reaching closure.4,7,15 In a qualitative study examining the relationship of shared decision-making to patient satisfaction, the presence or absence of shared decision-making in a given encounter did not consistently correlate with patients’ satisfaction with their physicians’ communication and relationship-building behavior, suggesting that shared decision-making is only one of several facets of communication that influence overall patient satisfaction.15

Medical students’ competence in communication skills is often assessed through the communication component of clinical practice examinations in which trained standardized patients typically assess students’ communication competence using a communication behaviors checklist.16 These ratings may or may not capture medical students’ use of shared decision-making. For instance, communication behaviors such as building rapport, expressing empathy, and using body language may occur in the absence (or presence) of active patient involvement in decision-making.17 Nonetheless, there is a growing need to assess medical student engagement in shared decision-making behavior with their patients to understand how trainees develop this skill.18 Physician belief in the benefits of shared decision-making and motivation to engage in shared decision-making are crucial facilitators of this behavior19, and it is important to impart these attitudes during the formative stages of training before practice patterns are established.20 However, with their less mature clinical skills, students may be more challenged than physicians by the time constraints of ambulatory encounters, which are a major barrier to shared decision-making.21 We designed this study to characterize the nature and amount of medical students’ shared decision-making and to determine if ratings of general communication correlate with students’ use of shared decision-making.

METHODS

Design

This was a retrospective observational study of medical students’ performance with standardized patients. The Institutional Review Board approved the study.

Subjects and Setting

After the third-year core clerkships, all University of California, San Francisco (UCSF) students are required to take the Clinical Performance Examination (CPX). The CPX is an eight-station comprehensive standardized patient examination developed by the eight medical schools comprising the California Consortium for the Assessment of Clinical Competence. Each CPX encounter lasts 15 minutes and is videotaped. After each encounter, standardized patients complete a criterion-based checklist evaluating students’ history taking, physical examination, communication and information sharing skills. Checklist accuracy by the consortium’s standardized patients exceeds 95%.22

A total of 143 UCSF medical students comprising the class of 2006 participated in the May–June 2005 CPX. The class of 2006 was 63% female. The self-described racial makeup of the class was 48% White, 33% Asian, 3% Black, 2% Native American, 6% other race, 2% unknown, and 6% multirace. We used a random number generator to select a 60-student probability sample for the study. This sample size (n = 60) gave adequate (80%) power to detect correlations of 0.35 and outstanding power (99%) to detect correlations of 0.5 or larger. All CPX encounters were video-recorded as part of usual exam procedure. Videotapes of the four study cases from the 60 randomly selected students were transcribed for analysis.

Communications skills cases and rating instrument: For this study, we selected four CPX cases that highlighted medical conditions likely to prompt decision-making opportunities regarding disease management or behaviors. (Appendix 1, available online) For shared decision-making to occur, one necessary prerequisite is a decision with multiple options4,23. Standardized patients participated in 17 hours of training over five sessions. Two different standardized patients portrayed the hypertension case and three portrayed each of the other three cases. The trainer assessed the standardized patients for consistency of portrayal and checklist accuracy during training and the exam.

The CPX case checklists used by the standardized patients included seven communication items (listening, rapport building, professional demeanor, and addressing the patient’s perspective and needs) based on the Common Ground checklist. This checklist was previously shown to have high reliability (rho = > 0.80) when completed by trained raters and high correlation with global ratings of communication by faculty experts (r = 0.84).24 Standardized patients scored the communication items from 0 to 1.0 on a six-point scale (0, 0.2, 0.4, 0.6, 0.8, 1.0, as defined in Appendix 2, available online), with total scores reported as percentages (maximum 100%).

Shared decision-making coding: Four investigators (KEH, AF, AT, GS) coded shared decision-making using a coding manual (Appendix 3, summary available online) and coding worksheet (Appendix 4, available online) from an instrument used to code physician–patient encounters.15 The worksheet includes checkboxes for decision moment identification and each of the key dimensions of shared decision-making within a single decision moment: exploration/articulation of perspective (beliefs, values), information sharing, and explicit closure, each of which could be done by the student, standardized patient, or both. In contrast to some other published shared decision-making scales,6,11,17 we captured both the student physician’s sharing of beliefs and values and the students’ responses to information from the patient. A single worksheet was used for each decision moment, which begins when a suggestion is made to change behavior or consider medical therapy or testing. Each dimension was marked as present or absent for each decision discussed by the student and standardized patient; each dimension was attributed to the student or patient only once per decision moment.

Examples of shared decision-making decision moment discussions between students and standardized patients are shown in Text box 1. There was no maximum number of decision moments per case; it was also possible for an encounter to have none. Each of the 240 encounters was coded by two coders, and reconciled by consensus discussion between the two coders, or with other coders in the event of discrepancy, which was rare.

Text box 1: Shared decision-making decision moment examples.

Shared Decision-Making Decision Moment Examples

Analysis

For analysis, we defined shared decision-making as a decision moment that included at least four of the possible ten decision-making elements (in addition to decision identification) on the worksheet (Appendix 4, available online) in which one of the four was closure of the decision by the patient. Inclusion of at least four elements ensures participation by both student and patient with presence of essential domains of shared decision-making (exchange of feelings and beliefs, exchange of information, and closure). This cutoff is similar to that used in prior literature, with a slightly lower cutoff due to students’ earlier point in training than practicing physicians.15 Closure of the decision by the patient is essential to determine whether shared decision-making has occurred; without closure by the patient, the physician may make decisions unilaterally. Traditionally, physicians are more vocal about closure than patients (e.g., ‘we will change your medicine’; ‘I want you to monitor your glucose’); patients’ verbalization of closure ensures their agreement.

We calculated the total number of decision moments overall and by decision topic. The key outcome used in correlation analyses was the number of decision moments with ≥4 elements as defined above. We used Spearman rank correlations, a non-parametric test, to examine the association between number of decision moments with ≥4 elements and the CPX communication score for each case. Data analyses were performed using SPSS 17.0 (SPSS, Inc., Chicago).

RESULTS

The 240 encounters from the 60 students generated 779 decision moments across all four cases. Of the 779 decision moments, 483 (62%) had shared decision-making scores of four or greater, 390 (50%) included patient closure, and 312 (40%) had both. These 312 comprised the shared decision moment dataset. The number of decision moments per student across all four cases ranged from 6.00 to 23.00; the mean (standard deviation) was 13.98 (3.07). Considering each case individually, the number of decision moments was: diabetes 3.93 (2.25), headache 2.15 (1.13), hypertension 3.87 (1.23), and teen 2.97 (1.22).

All students engaged at least once in shared decision-making (i.e., included at least four elements, one of which was patient closure) in both the hypertension and teen cases. In contrast, for the other two cases, 5% (diabetes) and 12% (headache) of students did not engage in any shared decision-making.

As shown in Table 1, among the 312 shared decision moments, the most commonly discussed topics were medications (n = 98, 31%), follow-up visits (71, 23%), and diagnostic testing (44, 14%). Lifestyle changes such as exercise (30, 9%) and diet (27, 10%) were discussed less frequently using shared decision-making.

Table 1

Topics of Shared Decision-Making Decision for 4 Standardized Patient Cases

	CASE
	Diabetes		Headache		Hypertension		Teen		TOTAL
Decision Moment	N	%	N	%	N	%	N	%	N	%
Adjust medications	25	8.0%	38	12.2%	35	11.2%			98	31.4%
Follow-up appointment with physician	12	3.8%	5	1.6%	50	16.0%	4	1.3%	71	22.8%
Get more tests			26	8.3%	7	2.2%	11	3.5%	44	14.1%
Exercise	15	4.8%			15	4.8%			30	9.6%
Diet change	16	5.1%			11	3.5%			27	8.7%
Self-monitor glucose	14	4.5%							14	4.5%
Refer to ancillary health professional	8	2.6%			1	0.3%	1	0.3%	10	3.2%
Refer to another physician	6	1.9%	1	0.3%					7	2.2%
Engage in safer sex							5	1.6%	5	1.6%
Self-monitor blood pressure					3	1.0%			3	1.0%
Talk to patient’s mother							3	1.0%	3	1.0%
TOTAL	96	30.8%	70	22.4%	122	39.1%	24	7.7%	312	100.0%

Sixty students each completed four cases (240 encounters), during which a total of 312 decision moments occurred

Association Between Communication Scores and Shared Decision Making

The mean (standard deviation) communication scores out of a maximum of 100 for the 60 students were: diabetes 68.71 (7.86), headache 69.57 (7.99), hypertension 61.23 (6.81), and teen 69.19 (8.79). The correlations between number of shared decision-making moments in a case and the respective communication score from the standardized patient were low for three cases: diabetes (rho = 0.07; 95% confidence interval -0.109, 0.32), headache (rho = 0.10; -0.16, 0.34), and teen (rho = 0.08; -0.18, 0.33), and moderate for the hypertension case (rho = 0.37; 0.13, 0.57).

DISCUSSION

In this analysis of student-standardized patient encounters in a high-stakes clinical skills examination, we found that, although all students engaged in some shared decision-making with their patients, the number of shared decision-making moments per case had limited correlation with the checklist communication score rendered by standardized patients. This finding implies shortcomings in existing measures of communication skills in that shared decision-making is independent of other aspects of communication, such as students’ communication behaviors and patients’ perceptions of rapport. Shared decision-making seems to involve additional aspects of the interaction and may challenge students working with standardized (or actual) patients to collaborate in care planning in ways not rewarded in typical communication checklists.

CPX scores may reflect meaningful aspects of communication that differ from shared decision-making. Although shared decision-making is often cited as an ideal model of physician–patient communication, our findings of limited correlation between shared decision-making and overall communication scores from standardized patients are consistent with prior literature showing that patients’ preferences for decision-making style are complex and variable. Approximately one third of patients may prefer a different style,10,15,25 particularly based on their medical conditions.26 Other aspects of communication, such as empathy and rapport, may be valued more highly than decision-making style.

Our results suggest that commonly used standardized patient checklists could be modified to include explicit assessment of shared decision-making behaviors. Our work extends that done using the OPTION scale6, another scale for assessing shared decision-making, in student-standardized patient encounters, in which capturing balanced measures of both persons’ contributions is important in student assessment. Assessing students’ shared decision-making in standardized patient examinations raises practical challenges including requirements for detailed coding of interactions and extensive standardized patient training. While this task is daunting, the evidence for shared decision-making as a preferred communication strategy is growing and the applications expanding.27–31 To address feasibility concerns, efforts could focus on a few key components of shared decision-making while still capturing both patient and physician perspectives on decision-making.32,33 Alternatively, assessing shared decision-making in formative standardized patient examinations might allow for meaningful feedback from patients to students34 without necessitating high checklist reliability.

It is encouraging that, in our study, all students engaged in some shared decision-making. Of the decision moments, almost half met our criteria for shared decision-making. This percentage is comparable to findings with actual physician–patient encounters, in which, using a slightly different threshold, half of decision moments qualified as shared decision-making.15 Our results also provide insights into students’ predilection to emphasize biomedical rather than lifestyle topics while counseling patients with a variety of clinical presentations. We found that students used shared decision-making more when discussing medical interventions, such as medications and tests, rather than patient self-management strategies. Prior studies have shown low rates of physician counseling about lifestyle modification.35,36 Students may lack knowledge about the benefits of lifestyle modification, or, more likely, about how to engage patients to implement these changes.37 These findings suggest that medical school curricula and assessments should increase their focus on lifestyle modification; students should possess the skills to empower their patients accordingly.

This study has limitations. We collected data from a single institution in a single year. Although we compared scores for shared decision-making to standardized patient communication ratings, we do not know if either score would translate to improved patient outcomes with actual patients. These findings apply only to the particular communication skills checklist we used, which may not generalize to other communication skills assessments. Other shared decision-making scales might have yielded different results, although our scale does address eight of nine essential elements of shared decision-making identified in a systematic review.38 Other more lengthy shared decision-making scales could be even less practical for medical school assessments.6,11 Further study of our shared decision-making scale could provide information about its psychometric properties. Strengths of our study include the large number of encounters assessed, the detailed, rigorous measurement of shared decision-making behaviors, and the inclusion of a range of acute and chronic patient presentations.

In this study of medical students’ shared decision-making with standardized patients, we found minimal correlation between the frequency of shared decision-making and standardized patients’ ratings of overall communication. All students engaged in some shared decision-making, although they focused their discussions on physician-oriented topics rather than patient self-management. Further study is needed to determine how medical students can best engage their patients in collaborative care, and how educators can measure that engagement with psychometrically sound instruments. That knowledge would enhance both medical education and patient care.

Below is the link to the electronic supplementary material.

Description of four standardized patient cases used in the evaluation of shared decision-making. (DOC 26 kb)

PATIENT/PHYSICIAN INTERACTION Communication rating form used by standardized patients. (DOC 37 kb)

Additional study methods related to shared decision-making coding. (DOC 23.5 kb)

Shared decision-making coding worksheet. (DOC 44.5 kb)