Hands-on Training in a Digital World: Novel Simulation-Based Virtual Training for Subdermal Contraceptive Implant Placement and Removal.

OBJECTIVE: The COVID-19 pandemic necessitated a shift from traditional in-person instruction for learning new technical skills to virtual delivery of medical education training. The objectives of this study were to develop and evaluate a virtual simulation-based training program for Canadian health care professionals (HCPs) on the insertion, localization, and removal of the etonogestrel subdermal contraceptive implant.
METHODS: A scientific committee of Canadian family planning experts developed a 2-part virtual training program during the COVID-19 pandemic. Core educational content (part 1) was provided in an asynchronous, self-directed, online format. Part 2 consisted of synchronous, simulation-based training using web conferencing. HCPs were provided with model arms and placebo applicators; trainers demonstrated implant insertion and removal techniques, and trainees received individual feedback. All trainees were asked to complete an online evaluation upon completion of the program.
RESULTS: Between September 22, 2020, and December 31, 2021, 83 trainers conducted 565 virtual training sessions. A total of 3162 HCPs completed part 1 of the training program, of whom 2740 had completed part 2 by December 31, 2021. Participants reported high levels of satisfaction with virtual simulation-based training; 96.5% of respondents (1570/1627) agreed that the virtual format was effective. Additional training prior to inserting the implant in clinical practice was requested by 4.5% of respondents (75/1671).
CONCLUSION: Virtual simulation-based learning provides effective education and technique training for etonogestrel implant insertion and removal. Online training for implant use can be scaled, as needed, to reach professionals in remote or underserved locations. This virtual training approach may be appropriate for other technical or minor surgical procedures.

INTRODUCTION

Simulation-based education is ideal for the acquisition of new procedural skills and has been proposed to be superior to more traditional teaching modalities. Medical educators and clinical experts have encouraged the use of simulation training for obstetrics and gynecology. Obstacles to providing and obtaining adequate and effective training for new procedures or technologies include the logistical challenges of location, timing, and availability of qualified trainers/teachers. Traditionally, training on new procedures and technologies has been conducted in face-to-face training sessions. However, rapid developments in Internet technology and virtual conferencing capabilities have created novel opportunities for continuing medical education and training.

When the etonogestrel subdermal contraceptive implant (Nexplanon®) was approved by Health Canada in May 2020, the product monograph stipulated that insertion and removal of the implant should be performed by trained healthcare professionals (HCPs). Training programs for the insertion and removal of the implant in other countries had involved live face-to-face instruction with a trainer who provided didactic training and also demonstrated implant insertion and removal using a model arm with placebo training applicators. Participants then practised the procedures on the model arm under the supervision of the trainer and received feedback on their technique. Social distancing restrictions and limitations on face-to-face interactions necessitated by the COVID-19 pandemic resulted in the need to transition from a “hands-on” in-person training approach to a virtual training format to provide the required training on insertion and removal of the implant.

This paper describes the development, implementation, and evaluation of a virtual clinical training program for Canadian HCPs. The methodology of the training program was based in part on the principles of mastery learning, , in which learners acquire relevant knowledge and skills before advancing to the next learning stage, on studies supporting the effectiveness of simulation-based education in medicine, , and on optimal proposed frameworks for procedural skills training. The training program included asynchronous didactic content delivery, as well as synchronous virtual simulation-based instruction for insertion and removal procedures using model arms and placebo implants/applicators. Trainee feedback from post-training program evaluations was used to evaluate the program’s effectiveness.

METHODS

Training Program Development

The etonogestrel subdermal contraceptive implant clinical training program was initially designed as a single face-to-face session with didactic presentation and demonstration components. The onset of the COVID-19 pandemic necessitated the conversion of the initial in-person program, to a two-part online program. The program was developed by a scientific committee of family planning physicians. Members of the scientific committee also served as Master Trainers (i.e., trainers who trained additional trainers). Training was available in French and English.

Part 1 of the training program consisted of asynchronous viewing of an expert-led core content presentation on the Canadian contraception landscape, unmet contraceptive needs, contraceptive options, and a review of standardized implant insertion and removal procedure videos.

Part 2 of the training program consisted of a 2-hour small-group (no more than six participants and a trainer) virtual “hands-on” training session via a teleconferencing platform. Internet access was required. Sessions were led by a trained trainer and participants took part virtually from their location of choice. In advance of the session, each participant received a training package with the requisite equipment for the simulated training, including a model arm, instruments, and placebo training applicators. To reinforce learning, a repetitive “learn-see-practice-prove-do” model, which has been proposed as an optimal framework for procedural skills training, was used. The trainer demonstrated implant insertion and removal with the model arm and placebo applicators and then the group of trainees performed these steps simultaneously along with the trainer. Finally, each trainee was spotlighted within the web conference and individually demonstrated these procedures on a model arm. The trainer provided individual guidance and feedback while other trainees observed. Multiple attempts were allowed and encouraged until both trainer and trainee were satisfied with the trainee’s technique. Trainees were required to attend the entire session to obtain a confirmation of attendance.

Proof of Concept for Virtual Simulation-Based Training

Prior to implementing the program nationally, the teleconferencing platform training experience was pilot tested to demonstrate the feasibility of the virtual training format. The initial pilot test identified essential physical/technical parameters for the virtual training sessions (Table 1 ). In particular, dual camera usage (one camera directed at the presenter and one camera directed at the model arm, Figure 1 ) was necessary to provide a good user experience. A third-party “producer” was instrumental in managing camera choice and speaker features.

Table 1

Physical and technical requirements for virtual simulated training of contraceptive implant insertion and removal

Item	Description
Adequate desk/table space	Depth and width needed to be sufficient to accommodate all required equipment
2 cameras for the trainer	• 1 (laptop) focused on the trainer (with flexibility to move this camera to the model arm in a single motion) • 1 (smartphone on tripod) focused on the model arm and technique demonstration
1 camera for the trainee	This allowed the trainer to visualize the simulated procedures on the model arm
Third-party “producer”	This individual managed the camera choice and speaker features on the video teleconference platform and toggled between trainer and trainee views, thereby allowing participants to focus on the training, not the technology

Figure 1

Suggested simulation set-up for (in this case, right-handed) trainer.

Following the pilot test, a full simulation for the synchronous virtual training was conducted and the recommended setup for trainers was determined (Figure 1). The proof of concept step verified the importance of having an optimized process, equipment, and technological setup to make the virtual training format as analogous to an in-person format as possible and to provide consistency across training sessions and trainers. An implementation guide was developed. For HCP trainees, the camera/computer and training equipment setup was optimized by sending them a “placemat” in advance of the session, which provided visual and written guidance on the training item placement.

Participants were required to register on-line for the training program. Participants were required to complete Part 1 prior to registration for Part 2.

Program Evaluation

Upon completion of Part 2, participants were asked to complete an anonymous evaluation of the training program using a three-point Likert scale (agree, neutral, or disagree). Trainees were also asked if they would like additional training (yes/no); if so, they were given the opportunity to provide contact information for follow-up. The link to this survey was sent the next business day after session completion by the program sponsor. Descriptive analyses of these data were performed.

As this study was a quality assurance and program evaluation activity, research ethics board review was not required.

RESULTS

Training Program Enrollment and Evaluations

Between September 14, 2020 and June 2, 2021, six sessions were conducted to train 83 HCPs, including five scientific committee members, to be trainers for the Part 2 virtual “hands on” simulation training. The trainers were chosen based on considerations, including geographic location and expertise. The trainers conducted 565 simulation training sessions between September 22, 2020 and December 31, 2021.

Between September 2, 2020 and December 31, 2021, 5540 HCPs registered for the training program; 3162 (57.1%) completed the Part 1 asynchronous self-directed content viewing. Of the HCPs who completed Part 1, 2740 (86.7%) had completed the Part 2 synchronous simulated training session as of December 31, 2021.

Of the 2740 participants who completed the simulated training sessions, 60.1% (1646) were family physicians, 24.7% (677) were nurse practitioners (including a small number of registered nurses for whom this area was in their scope of practice), 12.7% (348) were obstetrician/gynecologists, and 2.5% (69) listed other specialties, including postgraduate trainees (Table 2 ). There were participants from all Canadian provinces and territories. Ontario had the highest number of HCPs who completed Part 2 (n=913), followed by Quebec (n=588), British Columbia (n=458), and Alberta (n=440) (Table 2).

Table 2

Professional status and geographic distribution of health care professionals who completed the contraceptive implant virtual training program (N = 2740)

	No. (%) of participants
Professional status
Family physician	1646 (60.1)
Nurse practitioner/RN	677 (24.7)
Obstetrician/gynaecologist	349 (12.7)
Other specialty	69 (2.5)
Geographic location
Yukon	2 (0.07)
Price Edward Island	9 (0.3)
Nunavut	20 (0.7)
Northwest Territories	25 (0.9)
New Brunswick	32 (1.2)
Newfoundland	40 (1.5)
Manitoba	66 (2.4)
Saskatchewan	66 (2.4)
Nova Scotia	81 (3.0)
Alberta	440 (16.1)
British Columbia	458 (16.7)
Quebec	588 (21.5)
Ontario	913 (33.3)

RN: registered nurse.

Of the 2740 HCPs who completed Part 2, 1730 (63.1%) submitted a post-training evaluation (Table 3 ). Some respondents did not answer all questions. Most respondents (1570/1627 [96.5%]) reported that the virtual format of the “hands-on” training was effective. When asked “Would you like to request additional training on insertion and removal techniques?”, 4.5% (75/1671) of respondents answered “yes”.

Table 3

Post-training evaluations from HCPs who completed Part 2 of the training program (n=1730 respondents; not all respondents answered every question)

Question	n	No. (%) of respondents
		Agree	Neutral	Disagree
The “hands-on” training was clinically useful and relevant	1667	1651 (99.0)	10 (0.6)	6 (0.4)
The “hands-on” training was presented clearly and effectively	1670	1652 (98.9)	13 (0.8)	5 (0.3)
The virtual format of the ‘hands-on’ training was effective	1627	1570 (96.5)	47 (2.9)	10 (0.6)
The picture quality and clarity for the ‘hands-on’ training were adequate	1632	1599 (98.0)	28 (1.7)	5 (0.3)
The length of the ‘hands-on’ training was appropriate	1667	1577 (94.6)	69 (4.1)	21 (1.3)
The number of participants was appropriate	1666	1644 (98.7)	18 (1.1)	5 (0.3)
There was ample opportunity for questions and discussion during the ‘hands-on’ training	1665	1647 (98.9)	12 (0.7)	6 (0.4)

Note: Total answers may not equal 100% due to rounding.

HCPs: health care professionals.

DISCUSSION

Canada was the first country to initially utilize a completely remote virtual training program for the contraceptive implant. Converting from face-to-face to virtual training environments required careful development to ensure Canadian training met previously established global standards. Best practices for teaching procedural skills and to improve patient safety were utilized, including demonstrating and organizing procedures into steps and the repetitive framework of “learn, see, practice, prove, do, maintain,”. The program incorporated principles of simulation-based mastery learning which emphasize tailoring education to the learner’s pace and the use of feedback to enhance skill acquisition. , Simulation-based mastery learning initiatives have been found to result in substantial retention of knowledge and may improve patient care practices and outcomes. The majority of our survey respondents found that the program was clinically relevant, useful, and effective for their training needs.

Learnings From the Virtual Simulation Training Program

The virtual adaptation of Part 1, a pre-recorded session reviewing core content, required technology (voice over slides) and infrastructure (web platforms capable of hosting pre-recorded slide presentations) that were available pre-pandemic. Ongoing engagement with the training program was high between Part 1 and Part 2. At the time of this analysis, not all participants who completed Part 1 had registered for or completed Part 2. Others may have been interested in learning about a new contraceptive option for patient counseling purposes but did not plan to do implant insertions or removals themselves.

The virtual synchronous simulated training sessions in Part 2 required adaptations and utilization of web-based conferencing platforms to optimize the trainer/trainee experience. Essential features for success of the virtual simulation-based training were identified. These included clearly outlined procedures for both the trainer and the trainee, as well as a list of requirements for trainee set-up (proper equipment, Internet connection, training models, placebo applicators, lighting). This allowed training to be standardized and replicated across different trainers and sessions (Figure 1, Figure 2 A) and ensured all trainees had the same optimized view of the model arm (Figure 2B). This may have been an improvement over live training where trainees often have partially blocked views or different angles. A technology dry run with the trainer (dual camera, audio, etc.) prior to initiating the training sessions was critical for trainer confidence with the technology and to troubleshoot in advance.

Figure 2

Visualization of the contraceptive implant virtual training program. (A) Live setup from the trainer perspective. (B) View from the trainee perspective as the trainer demonstrates steps involved in inserting the contraceptive implant.

Unexpected issues can arise during any training program but virtual learning is particularly sensitive to technology or equipment failures. Technical requirements should be confirmed in advance, so trainees have the fidelity needed for participation. Important logistical considerations included coordination of shipping for materials in advance of scheduled simulation sessions and time zone considerations. Solutions included early shipment (as much in advance of the synchronous training session date as feasible) and confirmation of receipt of materials by the HCP. Conducting synchronous training sessions across different time zones resulted in some HCPs not attending their session at the scheduled time and/or inadvertently having clinical obligations during scheduled training sessions. Highlighting time zones in messages and including calendar options during registration to ensure meeting times were automatically switched to the trainee’s time zone helped address these issues.

A major tenet of adult learning principles is active involvement in the learning process. Simulation-based medical education has advantages over traditional clinical skill training, including opportunities to offer support and guidance in a less stressful environment. Providing each trainee with a model arm and placebo training applicators was essential so they could view the procedure being performed remotely by an expert and then practise it and receive real-time expert feedback on technique. Gynecology has many potential applications for simulation-based training. A recent Danish survey identified over 30 procedures suitable for simulation-based education and ob/gyn training program curriculums, including the insertion of contraceptive devices. The need for this form of “hands on” training took on greater urgency during the COVID-19 pandemic. Although the impetus for our virtual training program was the pandemic, the lessons learned would extend beyond this unique period. Virtual simulation-based training programs may allow widespread access to knowledge and skill acquisition for other medical procedures. This type of medical training satisfies important needs by providing: (1) an active HCP user experience to improve performance in medical procedures; (2) remote education that removes geographical and resource-based constraints for attending the training; and (3) the opportunity to network/interact with other HCPs across geographies. Lack of HCP training has been identified as a key barrier to the use of long-acting contraceptive methods.14,15,16 Remote education is a challenge that can be addressed by programs like the one we have described. Web-based programs can reach anywhere with Internet access or cellular networks, including remote geographic locations and regions that may not have sufficient experts to guide training.

LIMITATIONS

Because no in-person training program existed for Canadian HCPs during the pandemic, it is not possible to do a direct comparison to in-person learning opportunities or to conduct a cost-effectiveness comparison, which is an important consideration in the provision of access to training across the country. We aimed to provide training for the contraceptive implant in Canada similar to what had been successfully used in other countries, thus we did not explore additional options for simulation-based medical education, including virtual reality or screen-based simulators. These alternatives may be helpful in further expanding outreach and enhancing the training experience. Lastly, program evaluations were completed by 1730 participants who completed the program (response rate 63.1%), leading to a potential response bias.

Virtual web-based training offers many advantages, but it is important to acknowledge potential drawbacks. Virtual training programs have the potential to be highly cost-effective, but programs that require individual training materials will need additional resources for shipping and logistical support. Most conventional live training programs offer on-site support from experts (e.g., ‘staying behind for questions,’) and although additional 1:1 time (both at the end and at a later time) was available in our program to support learners as needed, not all who would have wanted to may have taken advantage of this. Adequate wireless (Wi-Fi) or cellular data networks are required, and these may not be available in more remote locations. However, it is possible that some aspects of the training could be conducted with lower resolution, which may help expand virtual training outreach.

CONCLUSIONS

The creation of a virtual simulation training program that can be delivered remotely takes initial time and effort to develop consistent training across different trainers and sessions and to ensure an optimal training experience. Once achieved, this program can be continually replicated and allow for greater access to training opportunities, particularly in more remote geographic locations. Virtual, simulation-based training on web-based platforms may be a valuable continuing medical education modality that provides greater flexibility for learners. Although our program was specific for the contraceptive implant, it may provide a template or procedures in other areas of medicine in the future.

Uncited reference

14., 15., 16..