Pedagogical strategies in teaching invasive prenatal procedures: a scoping review protocol.

INTRODUCTION: Invasive prenatal procedures (IPP) are core competencies in a Maternal-Fetal Medicine (MFM) fellowship training programme yet no standardised competency-based curriculum exists. This scoping review aims to provide a comprehensive understanding of the existing educational strategies for amniocentesis, chorionic villus sampling, fetal blood sampling and intrauterine blood transfusion. The objective is also to describe current gaps in the literature regarding evidence-based standards for training and assessment in IPP. Finally, we hope to encourage medical educators who are seeking to develop curricula based on competence by design to foster adaptive expertise through incorporating contextual variations in their teaching thus helping future MFM specialists to handle challenges and respond creatively to changing clinical circumstances and environmental variations. METHODS AND ANALYSIS: Using the five-stage framework of Arksey and O'Malley's scoping review methodology as a guide, we will perform a systematic search in the Medline, Embase and Cochrane library databases to identify relevant studies on the educational strategies for IPP. We will include relevant English articles published after 1978. For a comprehensive search, we will explore websites and key journals, and hand-searched reference lists of key studies. Key studies are articles deemed relevant according to the specific inclusion and exclusion criteria. We will chart and sort data using a descriptive and thematic analysis approach. ETHICS AND DISSEMINATION: This review will be the first to examine all forms of pedagogical strategies used in training invasive fetal procedures. As an analysis of pre-existing available data in the literature, this scoping review does not require ethical approval. We anticipate that results will identify research gaps as well as novel ideas for education strategies and assessment. Findings from this study will be disseminated through publication in a peer-reviewed journal, medical education and clinical conferences, and in knowledge translation settings, aiming to improve clinical practice and quality of care. © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

This scoping review is a novel review approach offering an overarching picture of invasive fetal procedures, within the context of education and assessment.

Findings will have implications for educators and researchers in recognising opportunities, pitfalls and contextual variations in teaching invasive prenatal procedure.

This review comprises broad inclusion criteria (peer review journal and grey literature) without assessing the quality of the articles included which gives breadth and comprehensiveness and is consistent with scoping review guidelines.

Rigour will be enhanced by a study design that includes the use of an established scoping review methodology, data-charting form and a transparent iterative team approach.

Findings are limited to articles written in English.

Introduction

Procedural skills are an essential aspect of Maternal–Fetal Medicine (MFM) practice and an expected component of a MFM fellowship programme. Despite widespread ambitions to provide education by Competency BY Design (CBD) in many programmes,1 the rhetoric of CBD remains a wish more than practice for training MFM fellows in invasive prenatal procedures (IPP). Globally, MFM training programmes in IPP are developed by local experts who have traditionally learnt to perform these procedures in an apprenticeship model: ‘see one, do one, and teach one’.2 This apprenticeship model is challenged by the significant reduction of the number of IPP due to the local and global implementation of non-invasive prenatal testing.3–7 Moreover, multiple external factors have reduced the opportunities for hands-on training in invasive procedures. These factors include centralisation, increasing staff workload and decreasing physician-teaching time.8 However, the widespread use of non-invasive prenatal testing has not completely replaced the role of IPP for diagnostic and therapeutic purposes. Thus, the need to find methods of effective training is now more pressing than ever.

There are two important components to consider in this area: first, what are the appropriate frameworks for education in postgraduate medical education? Second, what are the current practices in training, and how do they align with known appropriate frameworks?

In terms of frameworks, two major ones have become prominent. The first framework is competency-based education in Canada with a specific variant known as competence by design (CBD). Competence by design is an outcome-based approach organised around competencies derived from an analysis of societal and patient needs to enhance patient safety and care by improving physician training and assessment.9 Much has been written about the advantages and disadvantages of this approach. We draw attention on essential limitations of CBD for training prenatal procedures.10 11 One of the notable limitations is that standardisation does not address the challenges that future MFM practitioners will face in their independent practice.10 Outcome-based approach addresses routine cases through standardisation and algorithms. However, in practice, physicians must also be trained to be adaptable and address the challenges in non-routine and/or complex cases.10 12–14 While CBD is useful for training procedural skills in strictly controlled environments, complementary frameworks may be needed to address training for complexity and novelty. One such framework is the adaptive expertise (AE) framework. This model of enhanced cognitive capacity supports learning when challenged by novel, complex or varied clinical presentations, and employ innovation and learning through practice.12–14 AE, a learnt skillset, develops over time and with practice10 12 13 through a training environment that incorporates innovation, contextual variations, opportunities for students to struggle and immediate feedback.14 AE reduces the standardisation effect of competency-based education and enables future providers to be responsive to a constantly changing environment and dynamic environments. Moreover, the goal is not just to train innovators but those who can effectively combine routine practice as well as necessary innovation and adaptive problem solving by drawing on deep conceptual knowledge and wide arrays of skills.12–14 A combined framework of CBD and AE has been used previously to structure training for complex capacities and skills.15 The advantages of this approach for structuring curricula are also being established. While these frameworks are articulated in the general medical education literature, the alignment of existing practice in prenatal procedure training is less clear. A general overview of the existing literature did not show any consensus regarding the optimal pedagogical strategy or assessment that both addresses technical and non-technical skills in IPP when training adaptive experts. The initial review was limited to indications,5 outcomes,16 17 techniques,18 complications3 and highlighted a lack of conceptual framework, and a paucity of evidence on the educational needs for future MFM fellows.14 Moreover, less is known about the clinical training environment including important questions on effective instructional and educational methods, assessments and feedback, and the structure of clinical training. Lastly, how these existing practices can lead to the production of competent and adaptive experts is unknown. In short, our overview lead us to suspect that a clear mapping of the literature is required.

To address this gap, we propose a scoping review in order to provide a ‘snapshot’ of current pedagogical approaches; to identify empirical evidence that informs medical educators and researchers regarding current practices in teaching IPP and to identify gaps in current knowledge. The primary objective of this research is to map any available evidence regarding techniques and education approaches in IPP, that is, available in both the peer-reviewed and grey literature. The second purpose is to examine how these approaches align and facilitate the future development of a competency-based curriculum in IPP that trains adaptive experts. Finally, the scoping review will contribute to the general IPP literature.

Protocol design

To the authors’ knowledge, there is no published knowledge synthesis of the pedagogical strategies used in teaching IPP. This makes a scoping review an important addition to this topic area. This scoping review follows the scoping review framework developed by Arksey and O’Malley,19 which has been enhanced further by Levac et al 20 and the Joanna Briggs Institute (JBI).21 The results will be reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Protocols guidelines.22 This method includes the following five steps: (1) identifying the research question; (2) identifying relevant studies balancing breadth and comprehensiveness; (3) study selection using an iterative team approach; (4) charting the data and (5) collating, summarising and reporting the results as they relate to the study purpose and implications of the study findings for policy, practice and research. The optional sixth step proposed by Arksey and O’Malley,19 which comprises a consultation with key stakeholders, will not be included in this report.

Step1: identifying the research questions

Based on our described objective, this primary review asks the following questions.

What educational interventions have been identified in the literature for teaching invasive prenatal procedure to MFM fellows?

In addition to this primary research question, we developed the following secondary research questions for this scoping review:

What type of research has been conducted in IPP and what were the goals?

What kind of educational activities that impart specific skills related to patient safety or healthcare quality are addressed in the literature? (Variety of educational strategies, teaching modalities used and so on)

In what setting are these educational interventions provided?

What evidence, if any, is there of the effectiveness of these interventions?

What instruments have been developed and are being used to assess the learning outcomes for MFM fellows?

What are the barriers and the facilitators of education interventions identified in the literature?

What lesson is learnt as a result of this review?

Step 2: identifying relevant studies

A comprehensive review was developed with the help of an experienced health sciences librarian at the University of Toronto using specific Medical Subject Headings terms and keywords related to invasive prenatal procedures in order to review the relevant literature comprehensively (see online supplementary appendix 1). Studies or abstracts published from the year 1978, the year when ultrasound assistance was first introduced, until 2019 will be included. The search strategy will follow the three-step approach recommended by JBI scoping review guidelines.21 The search will be initially conducted using Ovid Medline electronic database and saved to ensure reproducibility of the search results. The Ovid interface is also a shared platform, which allows for quicker translation and querying of other Ovid-based databases (Medline In-Process, Embase) and will translate the search to Cochrane databases. Second, using all identified terms and keywords, we will supplement the search by a grey literature search utilising Google Scholar, Web of Science, websites of various relevant organisations, our institutional database, conference abstracts or reviews in order to identify any related studies. Grey literature is defined as ‘Information produced on all levels of government, academia, business and industry in electronic and print formats not controlled by commercial publishing, i.e. where publication is not the primary activity of the producing body’.23 Finally, we will screen the bibliography of selected articles to identify articles relevant to this scoping review. We will frequently seek feedback from our research team to refine our search strategy, and we will contact authors of relevant primary studies or reviews for further information. We will also assess the quality of our search protocol using the PRESS 2015 Evidence-based checklist guidelines.24 All references will be imported in an online bibliographic management programme (RefWorks) ensuring removal of duplicates. We will also report the search strategy for the databases in the online supplementary appendix as outlined in a Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement.25

Step 3: study selection

An independent reviewer (GN) will apply a two-step approach screening to determine the eligibility of articles according to their inclusion and exclusion criteria. The eligibility criteria are developed in consensus by the research team and serve to filter for relevant sources. The first step will consist of a title and abstract scan and the second will entail a full-text review of all identified citations from step 1. A second reviewer (RW) will help to adjucicate uncertainty of the first reviewer about inclusion eligibility of specific titles and abstracts. A sample of the retrieved articles (ie, 20%) will be screened by the second reviewer (RW) to ensure a consistent application of the eligibility criteria for inclusion in the review. Disagreements about study eligibility of the sampled articles will be discussed between the two reviewers until a consensus is reached and we will confer with a third reviewer if no agreement is reached.

Inclusion criteria

Based on ‘Population–Concept–Context (PCC)’ framework recommended by the JBI for scoping reviews21 and presented in table 1.

Table 1

PCC framework

Population	Participants are any health personnel who provide health services within the provision of Obstetric and Maternal and Fetal Medicine healthcare during pregnancy and childbirth such as MFM specialists, MFM fellows, Obstetric Gynaecology residents and nurses
Concept	Articles with specific focus and/or statements mentioning invasive prenatal procedural skills (amniocentesis, chorionic villus sampling, fetal blood sampling and intrauterine blood transfusion), competencies, assessments and educational activities conducted on human, animals and models
Context	The review will include all study designs (qualitative, quantitative and mixed methods) as well as book chapters, published in English after 1978 when ultrasound was first introduced

MFM, Maternal–Fetal Medicine; PCC, Population–Concept–Context.

We will exclude studies not providing a description of the instructional strategy, learning content and evaluation methods.

We will exclude studies representing opinions such editorials and commentaries.

Step 4: data charting

The research team will develop a data-charting form (table 2).

Table 2

Draft-charting form

Study characteristics	First author last name Publication year Country Topic Purpose Publication type Study design Type of invasive prenatal procedure
Educational component	Curriculum Training Teaching Technique Assessment Mode of education delivery
Conceptual or theoretical framework	Competence by design Adaptive expertise Meaningful variation Preparation for future learning None Other
Study setting	Clinical Classroom Simulation Online modules Videos Other
Instructional methods	Hands-on training Competency based (mastery learning and deliberate practice) Step by step feedback Unsupervised coaching Reflective practices Repetition: psychomotor training
Assessment	Checklists Feedback Global rating scale Direct observation Mini clinical evaluation exercise
Major findings

Since a scoping review aims to provide a comprehensive view of the literature, data extracted from relevant studies will include general information about each article such as author, publication year, country, study purpose setting, methodology, outcomes, key findings and reported challenges and limitations. In addition, we will extract information specific to addressing the gaps in IPP education. Data will include the topic of the article, the type of the article (review, commentary, primary research), study design, study setting and an educational component (assessment, teaching, training and mode of delivery of teaching, training and assessment), conceptual or theoretical framework, instructional methods and assessment. The data-charting form will be refined during the full-text screening to capture all pertinent information for each study. Articles that meet the eligibility criteria will be organised in data-charting form using Microsoft Excel database. Two reviewers (GN and RW) will pilot the data extraction form on a sample of three articles and will assess that the form identifies all different themes relevant to the research question.

Step 5: synthesising

The fifth stage described by Arksey and O’Malley framework19 for collating and summarising data will involve a descriptive numerical summary and a thematic analysis. We will use a qualitative thematic analysis approach to chart and sort the data according to key themes. This approach is a commonly used method for scoping review and it involves identifying themes across literature and synthesising using summary tables with thematic headings.26 We will summarise the quantitative data in a table outlining the overall number of studies, countries, topics, type and years of publication, and study designs. Next, we will organise, code and analyse the themes identified from all studies. The exact format cannot be established until data are charted and discussed with the review team.

Patient and public involvement

Patients and public were not involved in the study design.

Ethics and dissemination

This paper presents the protocol for a scoping review on the educational approaches in teaching IPP. The results from this study will inform clinicians, medical educators, knowledge users and researchers of the current gap in the literature and inform future study focused on the development of a standardised based curriculum.

Ethics approval is not necessary as the data are collected from publicly available sources and there will be no consultative phase. The results will be disseminated through presentations at local, national, and clinical and medical education conferences and through publication in a peer-reviewed journal.