Entrustable professional activities - visualization of competencies in postgraduate training. Position paper of the Committee on Postgraduate Medical Training of the German Society for Medical Education (GMA).

Authors

The three authors contributed equally to this paper.

Introduction

Quality and structure of postgraduate medical training and educational experiences in undergraduate and postgraduate training play a major role in career decisions of young medical graduates [14], [19], [23], [28]. They consider structured mandatory and challenging postgraduate training programmes delivered by experienced trainers with high training competencies as important factors of attractiveness and good starting of their clinical career [23].

The present postgraduate training in Germany widely differs between the medical disciplines. Best-practice examples of a structured competency-based postgraduate training that may serve as models for other clinical fields exist for anaesthesiology [24], family medicine [25], urology [11] and surgery [18]. However, a national comprehensive and binding curricular structure ensuring comparable competencies independent of training site is missing. Certification examinations in all medical disciplines follow an unstructured oral assessment format outside of the clinical context. Thus, it neither adequately assesses clinical competencies of medical doctors at the time of certification nor does it represent professional tasks [Musterweiterbildungsordnung 2003 der Bundesärztekammer (accessed February 12, 2013)].

The evaluation of postgraduate training launched by the German Medical Association in 2009 and 2011 revealed mediocre overall satisfaction of the trainees [Bundesrapport 2009. Evaluation der Weiterbildung in Deutschland (accessed February 12, 2013)], [Bundesrapport 2011. Evaluation der Weiterbildung in Deutschland (accessed February 12, 2013)]. Forty-five percent of the respondents rated postgraduate training between satisfactory and failed on a school grade scale. More than a third evaluated the training culture in their work environment and the support in acquiring professional competencies as only satisfactory to deficient. The most worrying result was the lack of training in evidence-based medicine and its transfer to the delivery of patient care, which 69% of respondents rated as only satisfactory or below. As for transparency of postgraduate training, only one third of the respondents obtained a structured plan and defined outcome objectives in written form, 42% received no training schedule at all [Bundesrapport 2011. Evaluation der Weiterbildung in Deutschland (accessed February 12, 2013)]. There was a slight improvement between the two evaluation cycles in 2009 and 2011 suggesting the necessity of a further decisive and perceptible action plan to advance the present postgraduate training culture in Germany.

Currently, a vigorous discussion on the future of postgraduate medical training in Germany is ongoing among political stakeholders, the German Medical Association, the State Chambers of Physicians, scientific medical societies, professional medical organizations and all physicians in charge of postgraduate training supervision. On the 115th annual conference of the German Physicians Board 2012 the managing-committee of the German Medical Association was requested to work out concrete propositions for new Postgraduate Professional Education Regulations, which represent the reality of health care provision today and define professional competencies as essential outcomes of postgraduate training [15].

The suggestion to entirely omit guiding numerical values for medical procedures in favour of competencies was not supported by the majority. However, there is agreement that the new regulations should include the following fundamentals:

Definition of competency-based educational goals,

integration of domains and levels of competencies,

a focus on educational contents rather than duration,

a reduction of numerical values for medical procedures [Bartmann F-J. Musterweiterbildungsordnung – Sachstand zur Novellierung. 2013 (accessed June 29, 2013)].

In order to facilitate an exchange of ideas the German Medical Association has established the "WIKI-BÄK-Platform" in December 2012 to allow scientific medical societies and professional medical organizations to place their propositions and thus contribute to the new regulations for certification between February and April 2013 [Bundesärztekammer (accessed February 12, 2013)].

In Austria the present situation in postgraduate medical training appears similar to that in Germany: evaluation reveals only mediocre overall satisfaction of the trainees. There is an ongoing discussion, based on the reform of undergraduate training in 2002 and the increased mobility of young doctors, that postgraduate training urgently needs new and more structured curricula. They should pursue the agreed and planned competency-based education of the final year of undergraduate training and follow a modular structure with internship, common trunk and major/elective subjects.

A slightly different situation is reported form Switzerland: all postgraduate training programs were accredited in 2011, and the national postgraduate training regulation was revised in 2013. An independent institute, the Swiss Institute for Postgraduate Training (SIWF), is responsible. Regarding the orientation towards professional competencies as outcomes of postgraduate training the present national regulation defines general outcomes for all programs. These are listed in detail in an associated catalogue of general learning objectives based on the CanMEDS roles and integrating other frameworks like the ACGME General Competencies [Lernzielkatalog – Allgemeine Lernziele für die Weiterbildungsprogramme (accessed October 19, 2013)]. Moreover different postgraduate training programs have implemented workplace-based assessments aiming at monitoring the achievement of professional competencies [20].

The present situation represents an ideal chance for considering and implementing new concepts of postgraduate training which would stress the continuum of undergraduate and postgraduate training as well as continuous professional development [17]. The Society for Medical Education (GMA) should have a significant share in the discussion and promotion of the ongoing process of developing an interdisciplinary evidence-based postgraduate education strategy for Germany in the 21st century. The Committee on Postgraduate Medical Education of the GMA has elucidated crucial questions and formulated essential stimuli supporting the current process [4]. This position paper is aimed at presenting successful competency-based frameworks for postgraduate medical education and appreciating prospects of integrating these frameworks in the current German reforms.

Competency-based frameworks for postgraduate medical training

Competency-based medical education, both in undergraduate and postgraduate training, is today considered an important prerequisite for adequate delivery of patient care in the 21st century [2], [10], [30]. Epstein and Hundert propose that professional competence may be defined as "the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and community being served" [6]. Thus, professional competence builds on a basis of cognition, clinical skills and personal attitudes paired with the willingness and motivation to apply these skills in concrete medical contexts for adequate problem solving toward a humane patient care and to resume responsibility [6], [32], [Wildt J. The shift from teaching to learning. 2007 (accessed January 10, 2013)]. Not the time spent in clinical rotations or the numbers of medical procedures, but the demonstration of competence in delivering medical care represents the essence of competency-based postgraduate training [9], [16], [30].

Two major competency-based postgraduate training frameworks rest on this outcome-oriented fundament, the CanMEDS Physician Competency Framework and the Outcome Project of the Accreditation Council for Graduate Medical Education (ACGME) [ACGME Outcome project – General competencies documentation (accessed January 13, 2013)], [7], [8], [12], [27]. Apart from a structured postgraduate training curriculum the integration of workplace-based assessment formats, e.g. mini-clinical evaluation exercise, clinical encounter cards, direct observation of procedural skills, case-based discussion with the provision of feedback seem to be an adequate tool to support the development of clinical competencies of trainees in the course of postgraduate medical training [22]. The integration of entrustable professional activities (EPAs) in training and formative assessment may close the gap between the theory of competency-based training and the patient-centred practice in the clinical context [21], [30]. Thus, EPAs have become the core of postgraduate trainings in various disciplines [1], [3],[21].

Entrustable professional activities (EPAs)

EPAs can be based on the Canadian Medical Education Directions for Specialists (CanMEDS) framework [8] which defines competencies a physician should attain summarized in seven roles: medical expert (the central role), communicator, collaborator, manager, health advocate, scholar and professional. Not the time spent in training is the important outcome measure but rather the attainment of competence. As each EPA defines a real professional activity that can be entrusted to a resident and as each EPA is linked to several competencies which are most crucial to a specific EPA we follow the suggestion by Mulder et al. to refer to the seven CanMEDS roles as ‘domains of competence’ [21]. Each CanMEDS role or ‘domain of competence’, respectively, is underpinned by knowledge, skills and attitude [21] and can be divided further into facets of competence [34]. The ‘communicator’ role, for example, which is referred to as ‘communication’ domain [21], includes several facets of competence: ‘verbal communication with colleagues and supervisors’, ‘empathy and openness’, ‘adapted informing of patients’, ‘respecting privacy and autonomy of the patient’ and others [34], and in turn each facet of competence includes different aspects of knowledge, skills and attitudes.

Based on the CanMEDS framework a range of EPAs for the different stages of residency training can be appointed by defining the specific domains of competence relevant for each EPA [21]. For every step in residency training each EPA is ‘a critical part of professional work that can be identified as a unit to be entrusted to a trainee once sufficient competence has been reached’ [29], [30]. Using this framework, representative EPAs for the different stages of residency training can be defined and as they are linked to explicit domains of competence they also provide a base for observation and assessment in clinical practice [21].

A three-step approach resulting in an EPA-based workplace curriculum for physician assistant training has been proposed by Mulder et al. [21]. This approach can be adapted for residency training in a similar way:

Selection of EPAs for a specific residency training,

Description of the EPAs,

Plan training and assessment of EPAs (see table 1 (Tab. 1)).

Table 1

Outline for the design of an EPA based residency training. Steps adapted according to Mulder et al. [21]

This outline will lead to observable levels of proficiency in executing each EPA and schedule EPAs and level of competence over the course of the training. The levels of proficiency could be adapted for residency training as suggested by Wijnen-Meijer et al. for medical graduates [33]:

the resident is not able to do this,

the resident is able to do this under direct supervision,

the resident is able to do this if supervision is available,

the resident is able to do this independently,

the resident is able to supervise others in performing this activity (see table 2 (Tab. 2)).

Table 2

Levels of proficiency in residency training. Levels adapted according to Wijnen-Meijer et al. [34]

Furthermore, the following four factors of influence on entrustment decisions have been identified and need to be kept in mind when planning a curriculum for residents based on EPAs: characteristics of the resident, the attending, the clinical context, and the critical task [26].

In the professional workplace of every resident in a hospital a mutual EPA for their first year of postgraduate training could be “running a ward in a multidisciplinary team”, which may serve as an example to illustrate the underlying principle for selection of EPAs for an EPA- based workplace curriculum. This EPA is a fairly broad one, which includes multiple smaller EPAs each one being linked to several domains of competence. Table 3 (Tab. 3) shows a blueprint underpinning the EPAs with their included domains of competence. After the EPAs are identified they need to be described in the next step. Mulder et al. suggest to provide a title and to describe the content of each EPA, to select the underpinning domains of competence, to specify the required knowledge and skill and to describe the assessment methods [21]. As an example, two more elementary EPAs from the set of EPAs in table 3 are given in tables 4 (Tab. 4) and 5 (Tab. 5).

Table 3

Blueprint of EPAs and their respective underpinning domains of competence for the EPA „running a ward in a multidisciplinary team”. XXX: patients from a certain specialty, e.g. pulmonology in this example

Table 4

Description of an EPA, example from pulmonology

Table 5

Description of an EPA, example form abdominal surgery

For the achievement of the EPA “running a ward in a multidisciplinary team” the expected level of entrusted independence must be defined for each underpinning EPA. While for the EPA “leading a ward round” level 4 (the resident is able to do this independently) may be expected, for the EPA “taking a history and performing a physical examination of XXX-patients” level 5 (the resident is able to supervise others in performing this activity) seems adequate as a resident may supervise medical students in their practice year performing this task. The overall achievement of the EPA “running a ward in a multidisciplinary team” at level 3 (the resident is able to do this if supervision is available) can be expected at an early time of residency, while level 4 may be reached at a later stage of residency. Rather than the time spent on a certain EPA the achieved level of independence is the driving force for entrustment; this can differ between residents according to their individual behaviour and competencies [31]. However, an exemplary timeframe when certain levels for certain EPAs are expected during residency training may guide and help to visualize the longitudinal dimension of EPAs (see table 6 (Tab. 6)).

Table 6

Framework for expected mastering of the different levels of selected EPAs during the years of residency training. XXX: patients from a certain specialty. The numbers refer to the levels of proficiency from table 2.

In the actual planning of an EPA-based residency curriculum a few aspects need particular attention independently of a specific discipline. To distinguish EPAs from general learning objectives or skills it can be helpful to complete the sentence “Tomorrow the resident will be allowed to …” [21]. For example, one can be allowed to perform a pleural puncture under direct supervision – this would be EPA performance level 2 – whereas one cannot be allowed to “communicate respectfully” which would be a skill needed to achieve informed consent from the patient for this procedure. As described above and shown in table 1 (Tab. 1), EPAs can vary in complexity and scope. A complex EPA, e.g. “running a ward in a multidisciplinary team”, can consist of several less complex EPAs. To be able to define the number of EPAs needed for a residency training one should think of the requirements of a resident close to taking the board exam. When considering this it will be noticeable that certain EPAs will be relevant for all disciplines, some EPAs will be of interdisciplinary relevance and a special set of EPAs will be only relevant for a specific discipline.

The description of the individual EPAs and their underpinning domains of competence including knowledge, skills and attitudes should be explicit enough for observed assessment. Assessment may include direct observation and feedback (e.g. following a ward round) or “indirect observation” by assessing the quality of patient reports and discharge letters. Another assessment method could be a developmental portfolio in combination with progress interviews where milestones for reaching level 4, i.e. independent work, can be marked. This assessment method can be used to adjust the curriculum according to the progress of the individual resident [5].

It is essential to mix assessment of directly observed behavior with judgments of trainees’ performance over a certain period of time. Whereas specific objective workplace-based assessments tools, such as mini-clinical evaluation exercise (mini CEX) or objective-structured assessment of technical skills (OSATS) may be used to assess directly observed behaviour, multisource feedback (MSF) may serve to asses performance over time [21], [22]. First experiences show that a ratio 1:5 to 1:10 between assessment of directly observed behavior and performance judgments over time may be feasible [26]. All the more the few tasks, which should be assessed by direct observation, must be chosen wisely to capture the most important activities for effective and safe entrustment decisions. Finally, the process and tools for assessment of entrustment decisions should be clearly defined, structured and transparent to supervisors and trainees. Training of supervisors will be crucial, particularly with respect to assessment and entrustment decisions, as most clinicians may not be familiar with short structured observations and the culture of regular written feedback [21].

The German perspective

The authors feel confident that the definition and use of professional competencies as essential outcomes of postgraduate training could be the one central driving force to reform and further develop the German, but also the Austrian and Swiss postgraduate medical education systems.

As already mentioned earlier, major competency-based postgraduate training frameworks, such as CanMEDS and the ACGME Outcome Project, were defined some years ago [ACGME Outcome project – General competencies documentation (accessed January 13, 2013)], [7], [8], [12] and have already been integrated in a number of countries in daily postgraduate training [30]. In Germany the CanMEDS framework builds the backbone of the National Competence-Based Learning Objectives Catalogue for Undergraduate Medical Education (NKLM), which is being developed by a nation-wide initiative led by the Association of Medical Faculties (MFT) and the Association for Medical Education (GMA) [13]. However, many clinicians still feel uncomfortable or even reject these competency-based frameworks [30]. Many see it as “theoretical constructs” with some academic but not much practical value: unclear and artificial in terminology, complicated not self-explanatory in structure, with unrealistic assessment methods etc. Consequently, well-meant initiatives may never reach implementation in clinical training.

Similar apprehensions may lead the present discussion concerning the call for new concepts of postgraduate training by the 115th annual conference of the German Physicians Board 2012. We face hesitation to omit the present regulations consisting listings of general clinical learning topics and numerical values for medical procedures in favour of competencies [Bartmann F-J. Musterweiterbildungsordnung – Sachstand zur Novellierung. 2013 (accessed June 29, 2013)]. We must answer two central questions if competence-based frameworks are meant to reach wide acceptance and implementation in residency reality:

How can we align a competence-based curriculum with the day-to-day patient care of residents and their supervisors?

How can we integrate regular and valid, and feasible assessment strategies depicting the various physician roles in all fields of clinical practice?

We believe that the present concept of EPAs can “bridge the gap between theory and clinical practice” and may be used as a framework for implementation of the new regulations for certification (MWBO) in the clinical residency programs of all medical disciplines. A rough proposal of a workflow including representative steps towards implementation of such a framework is shown in table 7 (Tab. 7). Such a process would integrate the national development of a new competence-based framework and faculty development measures to support local implementation.

Table 7

Workflow for the establishment of EPA based postgraduate training

Furthermore, any new initiative in postgraduate medical education should consider the current development in undergraduate medical education. New regulations of certification should be aligned with the newly developed NKLM. The integration of EPAs in the practical year of the undergraduate medical curriculum in close matching with the NKLM, would provide an optimal transfer and continuity between under- to postgraduate education [17].

In summary, the EPA concept may have the potential for wide acceptance in the clinical world and shows perspectives, which currently used curricular frameworks lack:

Focus on relevant and daily clinical activities including the continuum from single procedures to general competencies.

Obvious and self-explanatory levels of entrustment enabling the definition of guiding timeframes but also the consideration of individual learning curves.

Feasible and transparently structured assessment systems consisting of a mixture of objective measures and entrustment decisions.

The Commission of Postgraduate Medical Training of the German Society for Medical Education works on exemplary EPA curricula development and pursues supporting activities and tools to further introduce and promote the concept on different levels of German postgraduate medical education.

Competing interests

The authors declare that they have no competing interests.