Assessment of YouTube as an Educational Tool in Teaching Key Indicator Cases in Otolaryngology During the COVID-19 Pandemic and Beyond: Neck Dissection.

OBJECTIVES: YouTube has become the preferred resource for trainees in otolaryngology to prepare for surgery. This study aimed to compare the evaluation by 2 attending physicians and 2 resident physicians of the quality of videos on YouTube on neck dissection, a key indicator case in head and neck surgery. The authors aimed to assess the quality and quantity of YouTube videos available for development of a virtual surgical educational curriculum for trainees in otolaryngology.
METHODS: Using the YouTube search feature, the top 10 videos by relevance and view count were compiled using the following search terms: radical neck dissection, selective neck dissection, modified radical neck dissection, lateral neck dissection, levels I-III neck dissection, levels II-IV, left neck dissection, right neck dissection, cervical nodal dissection, and supraomohyoid neck dissection. A total of 37 videos on neck dissection were identified and analyzed using the LAP-VEGaS criteria as well as author-specific modified LAP-VEGaS criteria.
RESULTS: The mean comprehensive LAP-VEGaS score was 8.74 (SD 3.10). The majority of videos (24/37) were designated as medium quality; 10 of 37 videos were low quality and 3 of 37 videos were high quality. In the total group analysis, there was excellent inter-rater reliability between attending physicians (Cohen's kappa coefficient of 0.84) and good inter-rater reliability between resident physicians (Cohen's kappa coefficient of 0.58). There was no correlation between total view count, video age, or number of likes/dislikes and the overall LAP-VEGaS score. The presence of audio or written commentary had a moderate positive correlation with LAP-VEGaS score (adjusted R2 of 0.36). There was no statistically significant difference in video quality between videos posted by US and non-US based physicians (95% confidence interval -0.10 to 4.10; p = 0.06). However, videos made by an otolaryngology-trained physician had a LAP-VEGaS score that was 3.93 points higher (95% confidence interval 2.34-5.52; p < 0.001) than that of videos made by a nonotolaryngology-trained physician.
CONCLUSIONS: Online videos of neck dissection represent an increasingly ubiquitous and appropriate resource for trainees in learning otolaryngology key indicator cases. While free-to-access video repositories, such as YouTube, have become increasingly popular among trainees as a primary resource for learning and preparing for surgical cases, they lack consistent quality and as such, global efforts should be taken to improve the breadth and depth of educational video content in otolaryngology.

Introduction

Over the last several decades, technology has revolutionized medical education. In the present day, trainees have access to online resources that include, but are not limited, to research journals, specialized applications, textbooks, and educational videos. , Specifically, online video publications such as the Journal of Medical Insight, the Journal of Visualized Surgery, CSurgeries, and the Journal of Visualized Experiments, as well as video-sharing websites, such as YouTube and Vimeo, have become platforms to disseminate otolaryngology surgical videos. Despite rapid improvements in technology and access, high-quality otolaryngology-specific videos often require a paid subscription. As such, trainees often turn to free-to-access, online educational content; in fact, a recent study by Rapp et al. found that 90% of learners (residents and medical students) reported using videos for surgical preparation. Furthermore, among those learners who used video sources to prepare for surgical cases, 95% reported using YouTube. However, while operative videos on YouTube are ubiquitously used in surgical education, YouTube content is not selected for quality of content but instead is ranked by popularity as well as a variety of other proprietary metrics including view count, comments, and likes/dislikes. Several studies have shown that for general surgery procedures such as laparoscopic cholecystectomies and appendectomies, the majority of videos evaluated demonstrated concerning maneuvers, failure to maintain an adequate critical view of safety, or poor educational quality (including lack of audio, no discussion of relevant anatomy, etc.). , In otolaryngology, similar studies have largely focused on general information for procedures such as tonsillectomies and ear tube placements; those studies found that fewer than 25% of videos provided accurate and helpful information. , However, these studies did not use validated methodologies to address video quality. One study conducted by Shires et al. evaluated thyroid surgery videos using surgeon-author characteristics and audience response as surrogates for video quality. The authors found that the majority of videos were posted by surgeons without a publication history in thyroid surgery.

The novel coronavirus 2019 (COVID-19) pandemic has brought unprecedented challenges to the healthcare community. While providing clinical care and ensuring public health are key priorities, it is important to consider the impact of COVID-19 on surgical education. Medical student clinical participation has been suspended indefinitely. Furthermore, the American College of Surgeons and government institutions have recommended against the continuation of elective surgery. As a result, many institutions are restricting participants in surgical operations to essential personnel only. These changes are resulting in a reduction in surgical case volume for residents and fellows. Institutions have responded with curriculum changes to include flipped classroom learning, expanded didactic sessions, and online video-based learning. , As such, it is important to critically evaluate the library of video content that is available for trainees to continue honing their operative acumen.

The aim of this study is to objectively analyze the quality of videos on YouTube as an educational tool in learning how to perform a neck dissection, one of the key indicator cases for trainees in otolaryngology.

Methods

Using the YouTube (YouTube, Alphabet Inc., Mountain View, CA) search feature, the top 10 videos by relevance and view count were compiled using the following search terms: radical neck dissection, selective neck dissection, modified radical neck dissection, lateral neck dissection, levels I-III neck dissection, levels II-IV, left neck dissection, right neck dissection, cervical nodal dissection, and supraomohyoid neck dissection. Only videos that demonstrated an open approach to neck dissection were included. Exclusion criteria included endoscopic approach, presentations without video footage, patient testimonials, consumer advertisements, and cadaveric dissections. Every video was evaluated independently by four evaluators; the evaluators are otolaryngology residents (C.Y. and J.D.) and attendings (K.T. and P.T.). Video-based data including date published, view count, video length, likes, and dislikes were measured. The presence of audio and/or subtitles as well as the surgeon's specialty and country of practice were noted. Finally, each video was graded according to the LAParoscopic surgery Video Educational GuidelineS (LAP-VEGaS), a validated video assessment tool. , LAP-VEGaS guidelines include nine line items with every item being scored from 0 (item not present in the video) to 2 (item extensively presented in the video), with a total marking score ranging from 0 to 18. The assessment tool was developed for identifying and selecting videos for acceptance for conference presentation and publication and as such, provides an assessment tool with a high level of internal consistency and generalizability. The authors grouped scores into categories of low, medium, or high quality (low: 0-6, medium: 7-12, high: 13-18). Because the authors wanted to focus on free-to-access videos on YouTube as opposed to videos created for submission to conferences and presentations, they also performed a modified subgroup analysis based on the original LAP-VEGaS assessment scale to focus on the audiovisual and content quality of the surgery itself; this scale used items 3, 4, 5, 8, and 9 from the LAP-VEGaS guidelines to derive a modified 10-point scale (low: 0-3, medium: 4-7, high: 8-10). Two-sample t tests were performed to look at the quality difference between United States (US) based and non-US based physicians as well as otolaryngology versus nonotolaryngology trained physicians. The specialty training of the video authors was determined via Google search engine inquiry of the video author's name. If the author was in academic practice, their specialty training history was referenced from their academic faculty profile. If the author was in independent and/or private practice, their specialty training history was referenced from their biography and description of clinical experience. Inter-rater reliability between attending physicians and resident physicians was calculated using Cohen's kappa coefficient. Statistical analysis was performed with Microsoft Excel. This study is exempt from institutional review board approval, because it involves research using publicly available video footage whereby participants were deidentified.

Results

Video Characteristics

The search terms for “neck dissection” identified a total list of 37 YouTube videos that met inclusion criteria for analysis. The characteristics of the selected 37 videos are described in Table 1 . The videos had a total of 938,613 overall views with average viewership totaling 25,368 views; videos had as few as 82 views and as many as 114,556 views. On average, videos were 4.1 years old; videos ranged from 0.1 years old to 11 years old. The average length of videos was approximately 13 minutes; the shortest video was 2 minutes long, while the longest video was 48 minutes long. These videos had an average of 91 likes (range 0-601) and 6 dislikes (range 0-34). Overall, 7 of 37 (19%) of videos were made in the United States and 14 of 37 (38%) of videos were produced in India. The remaining 16 of 37 (43%) of videos were made by surgeons in Brazil, France, Germany, Japan, New Zealand, South Korea, Spain, Turkey, and the United Kingdom. Otolaryngologists narrated 22 of 37 (59%) of videos; 10 of 37 (27%) of videos were posted by surgical oncologists. Only 25 of 37 (68%) of videos had audio; of the 12 of 37 (32%) remaining videos, 4 had subtitles to annotate the surgery.

TABLE 1

Video Characteristics of the 37 Selected Videos on Neck Dissection (Ordered From Highest to Lowest View Count as of 5/6/2020)

Number	Title and Link	View Count	Video Age (in Years)	Length	Likes	Dislikes	Specialty	Country
1	Selective neck dissection HD https://www.youtube.com/watch?v=ufQzvPuMedo	114,556	5.92	0:12:45	601	34	Otolaryngology	France
2	Modified Radical Neck Dissection Part I. Dr John M Chaplin, Auckland, New Zealand https://www.youtube.com/watch?v=UF0RpRXrUEw	104,009	7.17	0:09:40	314	17	Otolaryngology	New Zealand
3	Neck Dissection part1, Dr.Gopinath https://www.youtube.com/watch?v=IKvUHRA4XuU	94,452	11.00	0:08:03	73	14	Surgical Oncology	India
4	Neck Dissection from 3D Anatomy for Otolaryngology and Head and Neck Surgery https://www.youtube.com/watch?v=mJDi_VtRSi8	83,560	8.00	0:02:30	125	9	Unknown	United Kingdom
5	TOTAL LARYNGECTOMY WITH LEVEL II,III,IV NECK DISSECTION https://www.youtube.com/watch?v=3S9MBy8krWo	52,724	8.25	0:02:16	32	11	Otolaryngology	India
6	Complete Left Lateral Neck Dissection https://www.youtube.com/watch?v=R7Qsw5Y5lOI	48,685	3.17	0:05:45	223	10	Otolaryngology	USA
7	Part 2 of a Modified Radical Neck Dissection by Dr John Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=i_A9tPkdmlM	46,925	7.17	0:10:09	205	5	Otolaryngology	New Zealand
8	Functional neck dissection using the fascial plane technique: J Gavilán https://www.youtube.com/watch?v=sdqQxbZMLlA	46,807	5.33	0:12:05	314	10	Otolaryngology	Spain
9	Radical Neck Dissection (HD)- Head Neck Surgery- Dr Rajnish Talwar https://www.youtube.com/watch?v=AK8N5NoWlAI	41,012	6.67	0:22:55	151	11	Surgical Oncology	India
10	Functional Neck Dissection https://www.youtube.com/watch?v=6iqTTULxvhM	39,925	5.92	0:05:24	70	9	Otolaryngology	Italy
11	Right Selective Neck Dissection levels IIa-Vb. Audio Dr John M Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=0VQYP6JXKxs	38,739	7.17	0:09:59	94	9	Otolaryngology	New Zealand
12	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the N0 Neck https://www.youtube.com/watch?v=TnGCDC93XqM&t=112s	38,335	5.58	0:15:40	203	2	Otolaryngology	USA
13	Functional Neck Dissection with Total Thyroidectomy- Berchtold Diathermy https://www.youtube.com/watch?v=iXRwCTFVerk	25,258	7.17	0:23:21	39	10	Surgical Oncology	India
14	Right Neck Dissection for Thyroid Cancer https://www.youtube.com/watch?v=OHb62qQCc9g	23,281	3.17	0:05:32	125	10	Otolaryngology	USA
15	MODIFIED RADICAL NECK DISSECTION BY DR GUNJAN AGRAWAL https://www.youtube.com/watch?v=eqkUB3s7JSA	22,392	5.33	0:21:38	45	18	Oral and Maxillofacial Surgery	India
16	RND- Radical Neck Dissection- Electrosurgery Video- Dr Rajnish Talwar https://www.youtube.com/watch?v=P7vBy8F8OpQ	17,611	7.75	0:22:55	35	4	Surgical Oncology	India
17	Modified Radical Neck Dissection type 3 (MRND) by Dr Sandeep Nayak, Bangalore https://www.youtube.com/watch?v=Lqic2aKXDYk	15,468	8.17	0:07:29	26	3	Surgical Oncology	India
18	SUPRAOMOHYOID NECK DISSECTION https://www.youtube.com/watch?v=_ncEBqMjnL4	14,210	2.92	0:07:02	64	5	Otolaryngology	Brazil
19	Radical Neck Dissection by Prof Rajaraman https://www.youtube.com/watch?v=nFkAS4ULP_4	12,651	2.17	0:32:30	123	3	Surgical Oncology	India
20	Supraomohyoid Neck Dissection for buccomandibular squamous cell carcinoma https://www.youtube.com/watch?v=GGbPPThUMF8	10,508	5.00	0:04:49	17	7	Facial Plastic and Reconstructive Surgery	Turkey
21	NECK DISSECTION step by step https://www.youtube.com/watch?v=L8u6VuA50K8	9,286	1.00	0:12:48	113	6	Otolaryngology	India
22	Lymph Node Dissection for Well-Differentiated Thyroid Cancer https://www.youtube.com/watch?v=VziSl7p_zNM	7,723	3.17	0:13:37	32	3	Surgical Oncology	USA
23	Selective Neck Dissection Level II-IV (Using the Fascial Plane) https://www.youtube.com/watch?v=3Mr8NH4bjOM&t=13s	5,245	1.75	0:12:01	77	0	Otolaryngology	Italy
24	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the Lateral Neck in Papillary T https://www.youtube.com/watch?v=FryPU-JxhZA	4,680	5.58	0:17:00	12	3	Otolaryngology	Japan
25	Comprehensive Left Lateral Neck Dissection https://www.youtube.com/watch?v=9aWOSCTAexw	3,634	3.17	0:06:05	19	1	Otolaryngology	USA
26	Selective Radical Neck Dissection 2-5 https://www.youtube.com/watch?v=5og5FJ-wb2E&t=42s	3,372	0.50	0:24:22	35	0	Otolaryngology	USA
27	Level II-IV Select Neck Dissection https://www.youtube.com/watch?v=TdKQ22w70t0	2,968	0.08	0:24:36	65	2	Otolaryngology	USA
28	Selective neck dissection https://www.youtube.com/watch?v=J-Oi_BexJXs	2,543	1.75	0:14:54	41	0	Otolaryngology	India
29	Supra Omohyoid Neck Dissection - Dr. Subbiah Shanmugam, Chennai https://www.youtube.com/watch?v=TEdhm6OVutw	1,520	1.58	0:15:48	19	0	Surgical Oncology	India
30	Modified radical neck dissection https://www.youtube.com/watch?v=R6gmzyyXh8w	1,319	0.83	0:09:24	5	0	Unknown	Unknown
31	Neck Dissection II-IV Part 2: Level IIb https://www.youtube.com/watch?v=Jbh_k7FlyPk	1,192	1.58	0:08:34	15	1	Otolaryngology	Germany
32	supra omohyoid Neck dissection mudit https://www.youtube.com/watch?v=r0E_R-ERrmU	1,070	2.50	0:08:10	6	0	Surgical Oncology	India
33	Neck Dissection II-IV Part 1: Skin Flap https://www.youtube.com/watch?v=VyN4c_wsZuY	994	1.67	0:05:01	14	1	Otolaryngology	Germany
34	Supraomohyoid Neck Dissection https://www.youtube.com/watch?v=WoAf9y6omfc	923	0.67	0:05:29	10	0	Otolaryngology	India
35	Neck Dissection II-IV Part 3: Level IIa-IV https://www.youtube.com/watch?v=Uu5s2QE0CS0	590	1.33	0:05:53	8	0	Otolaryngology	Germany
36	SupraOmohyoid neck dissection Dr Vijay Haribhakti https://www.youtube.com/watch?v=_qyya9PtvzI	364	0.75	0:11:00	4	0	Surgical Oncology	India
37	Modified Radical Neck Dissection https://www.youtube.com/watch?v=h-sj5geqisk	82	0.08	0:47:53	0	0	Oral and Maxillofacial Surgery	South Korea

Video Content and Quality Assessment Using LAP-VEGaS Guidelines

The comprehensive LAP-VEGaS assessment is displayed in Table 2 . In the comprehensive assessment, values of low, medium, and high quality were attributed to videos with scores of LAP-VEGaS scores of 0-6, 7-12, and 13-18, respectively (Table 3 ). The mean comprehensive LAP-VEGaS score was 8.74 (SD 3.10). The majority of videos (24/37) were designated as medium quality; 10 of 37 videos were low quality and 3 of 37 videos were high quality. In the total group analysis, there was excellent inter-rater reliability between attending physicians (Cohen's kappa coefficient of 0.84) and good inter-rater reliability between resident physicians (Cohen's kappa coefficient of 0.58).

TABLE 2

Overall Video Quality Assessment using the LAP-VEGaSTotalScoreby Attending Physicians and Resident Physicians in Otolaryngology

		1. Author and Institution				2. Case Presentation				3. Positioning				4. Surgical Procedure				5. Intraoperative Findings				6. Procedure Outcomes				7. Additional Graphic Content				8. English Audio/Commentary				9. Image Quality				LAP-VEGaS (Total)
Number	Title and Link	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4
1	Selective neck dissection HDhttps://www.youtube.com/watch?v=ufQzvPuMedo	2	1	2	2	0	0	0	0	0	2	0	0	2	2	2	2	2	2	1	2	0	0	0	0	2	2	1	1	2	1	1	2	2	2	2	2	12	12	9	11
2	Modified Radical Neck Dissection Part I. Dr John M Chaplin, Auckland, New Zealandhttps://www.youtube.com/watch?v=UF0RpRXrUEw	2	2	2	2	2	1	1	1	0	0	1	0	2	2	2	2	2	2	2	2	0	0	0	0	0	1	0	0	2	2	2	2	2	2	2	2	12	12	12	11
3	Neck Dissection part1, Dr.Gopinathhttps://www.youtube.com/watch?v=IKvUHRA4XuU	1	0	0	0	0	0	0	0	0	1	1	0	2	1	2	0	1	1	0	1	0	0	0	0	0	0	0	0	1	1	0	1	1	1	1	1	6	5	4	3
4	Neck Dissection from 3D Anatomy for Otolaryngology and Head and Neck Surgeryhttps://www.youtube.com/watch?v=mJDi_VtRSi8	0	0	0	1	0	0	0	0	0	0	0	0	1	1	1	0	2	2	1	1	0	0	0	0	0	0	0	0	2	2	2	2	2	2	2	1	7	7	6	5
5	TOTAL LARYNGECTOMY WITH LEVEL II,III,IV NECK DISSECTIONhttps://www.youtube.com/watch?v=3S9MBy8krWo	1	1	1	1	1	0	0	0	0	0	1	1	0	1	1	1	0	1	1	1	0	0	0	0	0	1	1	0	1	1	0	2	0	1	1	0	3	6	6	6
6	Complete Left Lateral Neck Dissectionhttps://www.youtube.com/watch?v=R7Qsw5Y5lOI	2	2	2	2	2	1	1	2	0	0	0	0	2	1	2	0	2	2	1	2	1	0	0	1	0	0	1	0	2	2	2	2	2	2	2	1	13	10	11	10
7	Part 2 of a Modified Radical Neck Dissection by Dr John Chaplin, Auckland, New Zealand.https://www.youtube.com/watch?v=i_A9tPkdmlM	2	2	2	2	2	1	1	1	0	0	0	0	2	2	2	2	2	2	2	2	0	0	0	0	0	1	0	0	2	2	2	2	2	2	2	2	11	12	11	11
8	Functional neck dissection using the fascial plane technique: J Gavilánhttps://www.youtube.com/watch?v=sdqQxbZMLlA	2	1	2	2	0	0	0	0	0	0	0	0	2	2	2	2	2	2	2	2	0	0	0	0	2	2	1	1	2	2	2	2	2	2	2	1	12	11	11	10
9	Radical Neck Dissection (HD)- Head Neck Surgery- Dr Rajnish Talwarhttps://www.youtube.com/watch?v=AK8N5NoWlAI	1	1	0	1	0	0	0	0	0	2	1	0	2	2	2	0	2	2	1	1	0	0	0	0	0	0	0	0	2	2	2	2	1	2	1	1	8	11	7	5
10	Functional Neck Dissectionhttps://www.youtube.com/watch?v=6iqTTULxvhM	1	0	0	1	0	0	0	0	0	0	0	0	1	1	1	0	1	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	2	1	1	3	4	2	2
11	Right Selective Neck Dissection levels IIa-Vb. Audio Dr John M Chaplin, Auckland, New Zealand.https://www.youtube.com/watch?v=0VQYP6JXKxs	2	2	2	2	2	1	2	2	0	0	1	0	2	2	2	1	2	2	1	2	0	0	0	0	0	1	0	0	2	2	2	2	1	1	1	1	11	11	11	10
12	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the N0 Neckhttps://www.youtube.com/watch?v=TnGCDC93XqM&t=112s	2	1	0	2	0	1	0	0	0	0	0	0	1	2	2	2	2	2	2	1	0	0	0	0	2	1	1	2	2	2	2	2	1	1	1	1	10	10	8	10
13	Functional Neck Dissection with Total Thyroidectomy- Berchtold Diathermyhttps://www.youtube.com/watch?v=iXRwCTFVerk	1	1	0	1	2	2	2	2	0	0	0	0	2	2	2	1	2	2	2	2	0	0	0	0	0	0	0	0	2	1	2	2	1	1	1	1	10	9	9	9
14	Right Neck Dissection for Thyroid Cancerhttps://www.youtube.com/watch?v=OHb62qQCc9g	2	2	2	2	0	1	0	0	0	0	0	0	1	1	2	0	2	2	2	2	1	1	0	1	2	1	2	0	2	2	2	2	2	2	2	1	12	12	12	8
15	MODIFIED RADICAL NECK DISSECTION BY DR GUNJAN AGRAWALhttps://www.youtube.com/watch?v=eqkUB3s7JSA	1	1	2	2	0	0	0	0	0	1	0	0	1	0	2	0	0	0	1	0	0	0	0	0	0	0	0	0	0	0	0	0	1	1	2	2	3	3	7	4
16	RND- Radical Neck Dissection- Electrosurgery Video- Dr Rajnish Talwarhttps://www.youtube.com/watch?v=P7vBy8F8OpQ	2	1	1	1	1	0	0	0	0	1	0	0	1	2	2	0	1	2	2	1	1	0	0	0	0	1	0	0	2	1	2	2	1	1	1	1	9	9	8	5
17	Modified Radical Neck Dissection type 3 (MRND) by Dr Sandeep Nayak, Bangalorehttps://www.youtube.com/watch?v=Lqic2aKXDYk	2	1	1	1	0	1	0	0	0	2	1	1	2	1	1	0	2	1	1	1	0	0	0	0	0	2	1	0	2	1	0	0	1	1	2	2	9	10	7	5
18	SUPRAOMOHYOID NECK DISSECTIONhttps://www.youtube.com/watch?v=_ncEBqMjnL4	2	2	2	2	1	1	1	2	0	0	0	0	2	2	2	2	1	2	1	1	0	0	0	0	0	0	0	0	2	2	1	2	1	1	2	1	9	10	9	10
19	Radical Neck Dissection by Prof Rajaramanhttps://www.youtube.com/watch?v=nFkAS4ULP_4	2	2	2	2	0	1	0	0	0	1	0	1	2	1	2	0	2	2	1	1	0	0	0	0	0	0	1	0	2	1	1	1	1	2	2	2	9	10	9	7
20	Supraomohyoid Neck Dissection for buccomandibular squamous cell carcinomahttps://www.youtube.com/watch?v=GGbPPThUMF8	1	1	1	1	0	1	1	0	0	0	0	0	1	0	2	0	0	1	1	0	0	0	0	0	0	1	1	0	0	0	0	0	0	2	1	2	2	6	7	3
21	NECK DISSECTION step by stephttps://www.youtube.com/watch?v=L8u6VuA50K8	2	2	2	2	2	1	0	0	0	2	1	1	2	2	2	2	2	2	2	2	1	1	1	1	2	2	1	2	2	2	2	2	2	1	2	1	15	15	13	13
22	Lymph Node Dissection for Well-Differentiated Thyroid Cancerhttps://www.youtube.com/watch?v=VziSl7p_zNM	2	2	2	2	2	2	2	2	0	0	0	0	0	0	0	0	0	0	1	0	0	2	0	0	2	1	0	2	2	2	2	2	2	0	1	0	10	9	8	8
23	Selective Neck Dissection Level II-IV (Using the Fascial Plane)https://www.youtube.com/watch?v=3Mr8NH4bjOM&t=13s	1	1	1	1	1	1	1	1	0	0	0	0	2	2	2	2	2	1	2	2	0	0	0	0	2	2	2	1	2	1	2	2	2	2	2	1	12	10	12	10
24	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the Lateral Neck in Papillary Thttps://www.youtube.com/watch?v=FryPU-JxhZA	2	2	2	2	2	2	2	2	0	1	0	0	2	2	2	2	2	1	1	1	2	1	1	1	2	1	0	2	2	2	2	2	2	1	2	2	16	13	12	14
25	Comprehensive Left Lateral Neck Dissectionhttps://www.youtube.com/watch?v=9aWOSCTAexw	2	2	2	2	2	1	1	2	0	0	0	0	2	1	2	0	2	2	1	2	1	0	0	1	0	0	1	0	2	2	2	2	2	2	2	1	13	10	11	10
26	Selective Radical Neck Dissection 2-5https://www.youtube.com/watch?v=5og5FJ-wb2E&t=42s	1	0	0	0	0	0	0	0	0	0	0	0	2	2	1	1	2	2	2	2	0	0	0	0	0	1	0	0	2	2	2	2	1	1	1	1	8	8	6	6
27	Level II-IV Select Neck Dissectionhttps://www.youtube.com/watch?v=TdKQ22w70t0	2	1	2	2	2	0	0	1	1	2	1	2	2	2	2	2	2	2	2	2	1	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	16	13	13	15
28	Selective neck dissectionhttps://www.youtube.com/watch?v=J-Oi_BexJXs	2	2	2	1	0	1	0	1	0	0	1	0	2	2	2	2	2	2	2	2	0	0	0	0	1	1	0	0	2	2	2	2	2	2	2	2	11	12	11	10
29	Supra Omohyoid Neck Dissection - Dr. Subbiah Shanmugam, Chennaihttps://www.youtube.com/watch?v=TEdhm6OVutw	1	0	0	0	0	0	0	0	0	0	0	0	1	0	2	0	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	2	2	2	2	5	2	4	2
30	Modified radical neck dissectionhttps://www.youtube.com/watch?v=R6gmzyyXh8w	1	0	0	0	0	0	0	0	0	0	1	0	1	0	2	0	1	1	1	1	1	0	0	0	1	1	1	0	1	1	1	2	2	2	2	1	8	5	8	4
31	Neck Dissection II-IV Part 2: Level IIbhttps://www.youtube.com/watch?v=Jbh_k7FlyPk	1	1	1	1	0	0	0	0	0	0	0	0	2	2	2	2	2	2	2	2	0	0	0	0	2	2	2	1	2	2	2	2	2	1	2	2	11	10	11	10
32	supra omohyoid Neck dissection mudithttps://www.youtube.com/watch?v=r0E_R-ERrmU	2	1	1	1	0	0	0	0	0	1	0	0	1	0	2	0	1	0	1	0	0	0	0	0	0	0	0	0	0	0	0	0	1	1	2	2	5	3	6	3
33	Neck Dissection II-IV Part 1: Skin Flaphttps://www.youtube.com/watch?v=VyN4c_wsZuY	1	1	1	1	0	0	0	0	0	0	0	0	2	2	2	2	2	2	2	2	0	0	0	0	2	2	1	1	2	2	2	2	2	1	2	2	11	10	10	10
34	Supraomohyoid Neck Dissectionhttps://www.youtube.com/watch?v=WoAf9y6omfc	2	2	2	2	1	1	1	1	0	1	0	0	1	2	2	1	1	2	1	1	0	0	0	0	0	0	0	0	2	2	2	2	1	1	1	1	8	11	9	8
35	Neck Dissection II-IV Part 3: Level IIa-IVhttps://www.youtube.com/watch?v=Uu5s2QE0CS0	1	1	1	1	0	0	0	0	0	0	0	0	2	2	2	2	2	2	2	2	0	0	0	0	2	2	1	2	2	2	2	2	2	1	2	2	11	10	10	11
36	SupraOmohyoid neck dissection Dr Vijay Haribhaktihttps://www.youtube.com/watch?v=_qyya9PtvzI	1	1	2	2	1	1	1	0	0	1	0	0	1	2	1	2	1	2	1	2	0	0	0	0	0	1	0	0	2	2	2	2	1	1	1	1	7	11	8	9
37	Modified Radical Neck Dissectionhttps://www.youtube.com/watch?v=h-sj5geqisk	1	1	2	2	0	0	0	0	0	1	1	0	0	0	2	0	0	1	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0	1	2	1	1	4	8	3

TABLE 3

Overall Video Quality Assessment Using a Tiered Quality Scale Based on LAP-VEGaSTotalScoreby Attending Physicians and Resident Physicians in Otolaryngology

Number	Title and Link	R1	R2	R3	R4	Total
1	Selective neck dissection HD https://www.youtube.com/watch?v=ufQzvPuMedo	Medium	Medium	Medium	Medium	Medium
2	Modified Radical Neck Dissection Part I. Dr John M Chaplin, Auckland, New Zealand https://www.youtube.com/watch?v=UF0RpRXrUEw	Medium	Medium	Medium	Medium	Medium
3	Neck Dissection part1, Dr.Gopinath https://www.youtube.com/watch?v=IKvUHRA4XuU	Low	Low	Low	Low	Low
4	Neck Dissection from 3D Anatomy for Otolaryngology and Head and Neck Surgery https://www.youtube.com/watch?v=mJDi_VtRSi8	Medium	Medium	Low	Low	Low
5	TOTAL LARYNGECTOMY WITH LEVEL II,III,IV NECK DISSECTION https://www.youtube.com/watch?v=3S9MBy8krWo	Low	Low	Low	Low	Low
6	Complete Left Lateral Neck Dissection https://www.youtube.com/watch?v=R7Qsw5Y5lOI	High	Medium	Medium	Medium	Medium
7	Part 2 of a Modified Radical Neck Dissection by Dr John Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=i_A9tPkdmlM	Medium	Medium	Medium	Medium	Medium
8	Functional neck dissection using the fascial plane technique: J Gavilán https://www.youtube.com/watch?v=sdqQxbZMLlA	Medium	Medium	Medium	Medium	Medium
9	Radical Neck Dissection (HD)- Head Neck Surgery- Dr Rajnish Talwar https://www.youtube.com/watch?v=AK8N5NoWlAI	Medium	Medium	Medium	Low	Medium
10	Functional Neck Dissection https://www.youtube.com/watch?v=6iqTTULxvhM	Low	Low	Low	Low	Low
11	Right Selective Neck Dissection levels IIa-Vb. Audio Dr John M Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=0VQYP6JXKxs	Medium	Medium	Medium	Medium	Medium
12	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the N0 Neck https://www.youtube.com/watch?v=TnGCDC93XqM&t=112s	Medium	Medium	Medium	Medium	Medium
13	Functional Neck Dissection with Total Thyroidectomy- Berchtold Diathermy https://www.youtube.com/watch?v=iXRwCTFVerk	Medium	Medium	Medium	Medium	Medium
14	Right Neck Dissection for Thyroid Cancer https://www.youtube.com/watch?v=OHb62qQCc9g	Medium	Medium	Medium	Medium	Medium
15	MODIFIED RADICAL NECK DISSECTION BY DR GUNJAN AGRAWAL https://www.youtube.com/watch?v=eqkUB3s7JSA	Low	Low	Medium	Low	Low
16	RND- Radical Neck Dissection- Electrosurgery Video- Dr Rajnish Talwar https://www.youtube.com/watch?v=P7vBy8F8OpQ	Medium	Medium	Medium	Low	Medium
17	Modified Radical Neck Dissection type 3 (MRND) by Dr Sandeep Nayak, Bangalore https://www.youtube.com/watch?v=Lqic2aKXDYk	Medium	Medium	Medium	Low	Medium
18	SUPRAOMOHYOID NECK DISSECTION https://www.youtube.com/watch?v=_ncEBqMjnL4	Medium	Medium	Medium	Medium	Medium
19	Radical Neck Dissection by Prof Rajaraman https://www.youtube.com/watch?v=nFkAS4ULP_4	Medium	Medium	Medium	Medium	Medium
20	Supraomohyoid Neck Dissection for buccomandibular squamous cell carcinoma https://www.youtube.com/watch?v=GGbPPThUMF8	Low	Low	Medium	Low	Low
21	NECK DISSECTION step by step https://www.youtube.com/watch?v=L8u6VuA50K8	High	High	High	High	High
22	Lymph Node Dissection for Well-Differentiated Thyroid Cancer https://www.youtube.com/watch?v=VziSl7p_zNM	Medium	Medium	Medium	Medium	Medium
23	Selective Neck Dissection Level II-IV (Using the Fascial Plane) https://www.youtube.com/watch?v=3Mr8NH4bjOM&t=13s	Medium	Medium	Medium	Medium	Medium
24	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the Lateral Neck in Papillary T https://www.youtube.com/watch?v=FryPU-JxhZA	High	High	Medium	High	High
25	Comprehensive Left Lateral Neck Dissection https://www.youtube.com/watch?v=9aWOSCTAexw	High	Medium	Medium	Medium	Medium
26	Selective Radical Neck Dissection 2-5 https://www.youtube.com/watch?v=5og5FJ-wb2E&t=42s	Medium	Medium	Low	Low	Medium
27	Level II-IV Select Neck Dissection https://www.youtube.com/watch?v=TdKQ22w70t0	High	High	High	High	High
28	Selective neck dissection https://www.youtube.com/watch?v=J-Oi_BexJXs	Medium	Medium	Medium	Medium	Medium
29	Supra Omohyoid Neck Dissection - Dr. Subbiah Shanmugam, Chennai https://www.youtube.com/watch?v=TEdhm6OVutw	Low	Low	Low	Low	Low
30	Modified radical neck dissection https://www.youtube.com/watch?v=R6gmzyyXh8w	Medium	Low	Medium	Low	Low
31	Neck Dissection II-IV Part 2: Level IIb https://www.youtube.com/watch?v=Jbh_k7FlyPk	Medium	Medium	Medium	Medium	Medium
32	supra omohyoid Neck dissection mudit https://www.youtube.com/watch?v=r0E_R-ERrmU	Low	Low	Low	Low	Low
33	Neck Dissection II-IV Part 1: Skin Flap https://www.youtube.com/watch?v=VyN4c_wsZuY	Medium	Medium	Medium	Medium	Medium
34	Supraomohyoid Neck Dissection https://www.youtube.com/watch?v=WoAf9y6omfc	Medium	Medium	Medium	Medium	Medium
35	Neck Dissection II-IV Part 3: Level IIa-IV https://www.youtube.com/watch?v=Uu5s2QE0CS0	Medium	Medium	Medium	Medium	Medium
36	SupraOmohyoid neck dissection Dr Vijay Haribhakti https://www.youtube.com/watch?v=_qyya9PtvzI	Medium	Medium	Medium	Medium	Medium
37	Modified Radical Neck Dissection https://www.youtube.com/watch?v=h-sj5geqisk	Low	Low	Medium	Low	Low

The modified LAP-VEGaS assessment is displayed in Table 4 . In the modified assessment, values of low, medium, and high quality were attributed to videos with modified LAP-VEGaS scores of 0-3, 4-7, and 8-10, respectively (Table 5 ). The mean subgroup LAP-VEGaS score was 6.03 (SD 1.99). The majority of videos (25/37) were designated as medium quality; 4/37 were determined to be low quality and 8 of 37 were determined to be high quality. In the modified subgroup analysis, there was fair inter-rater reliability between attending physicians (Cohen's kappa coefficient of 0.33) with good inter-rater reliability between resident physicians (Cohen's kappa coefficient of 0.47).

TABLE 4

Overall Video Quality Assessment Using the LAP-VEGaSSubgroupScoreby Attending Physicians and Resident Physicians in Otolaryngology

		3. Positioning				4. Surgical Procedure				5. Intraoperative Findings				8. English Audio/Commentary				9. Image Quality				LAP-VEGaS (Subgroup)
Number	Title and Link	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4	R1	R2	R3	R4
1	Selective neck dissection HDhttps://www.youtube.com/watch?v=ufQzvPuMedo	0	2	0	0	2	2	2	2	2	2	1	2	2	1	1	2	2	2	2	2	9	9	6	8
2	Modified Radical Neck Dissection Part I. Dr John M Chaplin, Auckland, New Zealandhttps://www.youtube.com/watch?v=UF0RpRXrUEw	0	0	1	0	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	9	8	9	8
3	Neck Dissection part1, Dr.Gopinathhttps://www.youtube.com/watch?v=IKvUHRA4XuU	0	1	1	0	2	1	2	0	1	1	0	1	1	1	0	1	1	1	1	1	6	5	4	3
4	Neck Dissection from 3D Anatomy for Otolaryngology and Head and Neck Surgeryhttps://www.youtube.com/watch?v=mJDi_VtRSi8	0	0	0	0	1	1	1	0	2	2	1	1	2	2	2	2	2	2	2	1	8	7	6	4
5	TOTAL LARYNGECTOMY WITH LEVEL II,III,IV NECK DISSECTIONhttps://www.youtube.com/watch?v=3S9MBy8krWo	0	0	1	1	0	1	1	1	0	1	1	1	1	1	0	2	0	1	1	0	2	4	4	5
6	Complete Left Lateral Neck Dissectionhttps://www.youtube.com/watch?v=R7Qsw5Y5lOI	0	0	0	0	2	1	2	0	2	2	1	2	2	2	2	2	2	2	2	1	9	7	7	5
7	Part 2 of a Modified Radical Neck Dissection by Dr John Chaplin, Auckland, New Zealand.https://www.youtube.com/watch?v=i_A9tPkdmlM	0	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	9	8	8	8
8	Functional neck dissection using the fascial plane technique: J Gavilánhttps://www.youtube.com/watch?v=sdqQxbZMLlA	0	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	1	9	8	8	7
9	Radical Neck Dissection (HD)- Head Neck Surgery- Dr Rajnish Talwarhttps://www.youtube.com/watch?v=AK8N5NoWlAI	0	2	1	0	2	2	2	0	2	2	1	1	2	2	2	2	1	2	1	1	8	10	7	4
10	Functional Neck Dissectionhttps://www.youtube.com/watch?v=6iqTTULxvhM	0	0	0	0	1	1	1	0	1	1	0	0	0	0	0	0	0	2	1	1	3	4	2	1
11	Right Selective Neck Dissection levels IIa-Vb. Audio Dr John M Chaplin, Auckland, New Zealand.https://www.youtube.com/watch?v=0VQYP6JXKxs	0	0	1	0	2	2	2	1	2	2	1	2	2	2	2	2	1	1	1	1	8	7	7	6
12	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the N0 Neckhttps://www.youtube.com/watch?v=TnGCDC93XqM&t=112s	0	0	0	0	1	2	2	2	2	2	2	1	2	2	2	2	1	1	1	1	7	7	7	6
13	Functional Neck Dissection with Total Thyroidectomy- Berchtold Diathermyhttps://www.youtube.com/watch?v=iXRwCTFVerk	0	0	0	0	2	2	2	1	2	2	2	2	2	1	2	2	1	1	1	1	8	6	7	6
14	Right Neck Dissection for Thyroid Cancerhttps://www.youtube.com/watch?v=OHb62qQCc9g	0	0	0	0	1	1	2	0	2	2	2	2	2	2	2	2	2	2	2	1	8	7	8	5
15	MODIFIED RADICAL NECK DISSECTION BY DR GUNJAN AGRAWALhttps://www.youtube.com/watch?v=eqkUB3s7JSA	0	1	0	0	1	0	2	0	0	0	1	0	0	0	0	0	1	1	2	2	3	2	5	2
16	RND- Radical Neck Dissection- Electrosurgery Video- Dr Rajnish Talwarhttps://www.youtube.com/watch?v=P7vBy8F8OpQ	0	1	0	0	1	2	2	0	1	2	2	1	2	1	2	2	1	1	1	1	6	7	7	4
17	Modified Radical Neck Dissection type 3 (MRND) by Dr Sandeep Nayak, Bangalorehttps://www.youtube.com/watch?v=Lqic2aKXDYk	0	2	1	1	2	1	1	0	2	1	1	1	2	1	0	0	1	1	2	2	8	6	5	4
18	SUPRAOMOHYOID NECK DISSECTIONhttps://www.youtube.com/watch?v=_ncEBqMjnL4	0	0	0	0	2	2	2	2	1	2	1	1	2	2	1	2	1	1	2	1	7	7	6	6
19	Radical Neck Dissection by Prof Rajaramanhttps://www.youtube.com/watch?v=nFkAS4ULP_4	0	1	0	1	2	1	2	0	2	2	1	1	2	1	1	1	1	2	2	2	8	7	6	5
20	Supraomohyoid Neck Dissection for buccomandibular squamous cell carcinomahttps://www.youtube.com/watch?v=GGbPPThUMF8	0	0	0	0	1	0	2	0	0	1	1	0	0	0	0	0	0	2	1	2	2	3	4	2
21	NECK DISSECTION step by stephttps://www.youtube.com/watch?v=L8u6VuA50K8	0	2	1	1	2	2	2	2	2	2	2	2	2	2	2	2	2	1	2	1	9	9	9	8
22	Lymph Node Dissection for Well-Differentiated Thyroid Cancerhttps://www.youtube.com/watch?v=VziSl7p_zNM	0	0	0	0	0	0	0	0	0	0	1	0	2	2	2	2	2	0	1	0	5	2	4	2
23	Selective Neck Dissection Level II-IV (Using the Fascial Plane)https://www.youtube.com/watch?v=3Mr8NH4bjOM&t=13s	0	0	0	0	2	2	2	2	2	1	2	2	2	1	2	2	2	2	2	1	9	6	8	7
24	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the Lateral Neck in Papillary Thttps://www.youtube.com/watch?v=FryPU-JxhZA	0	1	0	0	2	2	2	2	2	1	1	1	2	2	2	2	2	1	2	2	9	7	7	7
25	Comprehensive Left Lateral Neck Dissectionhttps://www.youtube.com/watch?v=9aWOSCTAexw	0	0	0	0	2	1	2	0	2	2	1	2	2	2	2	2	2	2	2	1	9	7	7	5
26	Selective Radical Neck Dissection 2-5https://www.youtube.com/watch?v=5og5FJ-wb2E&t=42s	0	0	0	0	2	2	1	1	2	2	2	2	2	2	2	2	1	1	1	1	8	7	6	6
27	Level II-IV Select Neck Dissectionhttps://www.youtube.com/watch?v=TdKQ22w70t0	1	2	1	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	10	10	9	10
28	Selective neck dissectionhttps://www.youtube.com/watch?v=J-Oi_BexJXs	0	0	1	0	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	2	9	8	9	8
29	Supra Omohyoid Neck Dissection - Dr. Subbiah Shanmugam, Chennaihttps://www.youtube.com/watch?v=TEdhm6OVutw	0	0	0	0	1	0	2	0	1	0	0	0	0	0	0	0	2	2	2	2	5	2	4	2
30	Modified radical neck dissectionhttps://www.youtube.com/watch?v=R6gmzyyXh8w	0	0	1	0	1	0	2	0	1	1	1	1	1	1	1	2	2	2	2	1	6	4	7	4
31	Neck Dissection II-IV Part 2: Level IIbhttps://www.youtube.com/watch?v=Jbh_k7FlyPk	0	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	2	1	2	2	9	7	8	8
32	supra omohyoid Neck dissection mudithttps://www.youtube.com/watch?v=r0E_R-ERrmU	0	1	0	0	1	0	2	0	1	0	1	0	0	0	0	0	1	1	2	2	4	2	5	2
33	Neck Dissection II-IV Part 1: Skin Flaphttps://www.youtube.com/watch?v=VyN4c_wsZuY	0	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	2	1	2	2	9	7	8	8
34	Supraomohyoid Neck Dissectionhttps://www.youtube.com/watch?v=WoAf9y6omfc	0	1	0	0	1	2	2	1	1	2	1	1	2	2	2	2	1	1	1	1	6	8	6	5
35	Neck Dissection II-IV Part 3: Level IIa-IVhttps://www.youtube.com/watch?v=Uu5s2QE0CS0	0	0	0	0	2	2	2	2	2	2	2	2	2	2	2	2	2	1	2	2	9	7	8	8
36	SupraOmohyoid neck dissection Dr Vijay Haribhaktihttps://www.youtube.com/watch?v=_qyya9PtvzI	0	1	0	0	1	2	1	2	1	2	1	2	2	2	2	2	1	1	1	1	6	8	5	7
37	Modified Radical Neck Dissectionhttps://www.youtube.com/watch?v=h-sj5geqisk	0	1	1	0	0	0	2	0	0	1	1	0	0	0	0	0	0	1	2	1	1	3	6	1

TABLE 5

Overall Video Quality Assessment Using a Tiered Quality Scale Based on LAP-VEGaSSubgroupScoreby Attending Physicians and Resident Physicians in Otolaryngology

Number	Title and Link	R1	R2	R3	R4	Subgroup
1	Selective neck dissection HD https://www.youtube.com/watch?v=ufQzvPuMedo	High	High	Medium	High	High
2	Modified Radical Neck Dissection Part I. Dr John M Chaplin, Auckland, New Zealand https://www.youtube.com/watch?v=UF0RpRXrUEw	High	High	High	High	High
3	Neck Dissection part1, Dr.Gopinath https://www.youtube.com/watch?v=IKvUHRA4XuU	Medium	Medium	Medium	Low	Medium
4	Neck Dissection from 3D Anatomy for Otolaryngology and Head and Neck Surgery https://www.youtube.com/watch?v=mJDi_VtRSi8	Medium	Medium	Medium	Medium	Medium
5	TOTAL LARYNGECTOMY WITH LEVEL II,III,IV NECK DISSECTION https://www.youtube.com/watch?v=3S9MBy8krWo	Low	Medium	Medium	Medium	Medium
6	Complete Left Lateral Neck Dissection https://www.youtube.com/watch?v=R7Qsw5Y5lOI	High	Medium	Medium	Medium	Medium
7	Part 2 of a Modified Radical Neck Dissection by Dr John Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=i_A9tPkdmlM	High	High	High	High	High
8	Functional neck dissection using the fascial plane technique: J Gavilán https://www.youtube.com/watch?v=sdqQxbZMLlA	High	High	High	Medium	High
9	Radical Neck Dissection (HD)- Head Neck Surgery- Dr Rajnish Talwar https://www.youtube.com/watch?v=AK8N5NoWlAI	Medium	High	Medium	Medium	Medium
10	Functional Neck Dissection https://www.youtube.com/watch?v=6iqTTULxvhM	Low	Medium	Low	Low	Low
11	Right Selective Neck Dissection levels IIa-Vb. Audio Dr John M Chaplin, Auckland, New Zealand. https://www.youtube.com/watch?v=0VQYP6JXKxs	Medium	Medium	Medium	Medium	Medium
12	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the N0 Neck https://www.youtube.com/watch?v=TnGCDC93XqM&t=112s	Medium	Medium	Medium	Medium	Medium
13	Functional Neck Dissection with Total Thyroidectomy- Berchtold Diathermy https://www.youtube.com/watch?v=iXRwCTFVerk	Medium	Medium	Medium	Medium	Medium
14	Right Neck Dissection for Thyroid Cancer https://www.youtube.com/watch?v=OHb62qQCc9g	Medium	Medium	High	Medium	Medium
15	MODIFIED RADICAL NECK DISSECTION BY DR GUNJAN AGRAWAL https://www.youtube.com/watch?v=eqkUB3s7JSA	Low	Low	Medium	Low	High
16	RND- Radical Neck Dissection- Electrosurgery Video- Dr Rajnish Talwar https://www.youtube.com/watch?v=P7vBy8F8OpQ	Medium	Medium	Medium	Medium	Medium
17	Modified Radical Neck Dissection type 3 (MRND) by Dr Sandeep Nayak, Bangalore https://www.youtube.com/watch?v=Lqic2aKXDYk	Medium	Medium	Medium	Medium	Medium
18	SUPRAOMOHYOID NECK DISSECTION https://www.youtube.com/watch?v=_ncEBqMjnL4	Medium	Medium	Medium	Medium	Medium
19	Radical Neck Dissection by Prof Rajaraman https://www.youtube.com/watch?v=nFkAS4ULP_4	Medium	Medium	Medium	Medium	Medium
20	Supraomohyoid Neck Dissection for buccomandibular squamous cell carcinoma https://www.youtube.com/watch?v=GGbPPThUMF8	Low	Low	Medium	Low	Low
21	NECK DISSECTION step by step https://www.youtube.com/watch?v=L8u6VuA50K8	High	High	High	High	High
22	Lymph Node Dissection for Well-Differentiated Thyroid Cancer https://www.youtube.com/watch?v=VziSl7p_zNM	Medium	Low	Medium	Low	Medium
23	Selective Neck Dissection Level II-IV (Using the Fascial Plane) https://www.youtube.com/watch?v=3Mr8NH4bjOM&t=13s	High	Medium	High	Medium	Medium
24	Video Panel 1 Surgical Pearls for Neck Dissection – Management of the Lateral Neck in Papillary T https://www.youtube.com/watch?v=FryPU-JxhZA	High	Medium	Medium	Medium	Medium
25	Comprehensive Left Lateral Neck Dissection https://www.youtube.com/watch?v=9aWOSCTAexw	High	Medium	Medium	Medium	Medium
26	Selective Radical Neck Dissection 2-5 https://www.youtube.com/watch?v=5og5FJ-wb2E&t=42s	Medium	Medium	Medium	Medium	Medium
27	Level II-IV Select Neck Dissection https://www.youtube.com/watch?v=TdKQ22w70t0	High	High	High	High	High
28	Selective neck dissection https://www.youtube.com/watch?v=J-Oi_BexJXs	High	High	High	High	High
29	Supra Omohyoid Neck Dissection - Dr. Subbiah Shanmugam, Chennai https://www.youtube.com/watch?v=TEdhm6OVutw	Medium	Low	Medium	Low	Medium
30	Modified radical neck dissection https://www.youtube.com/watch?v=R6gmzyyXh8w	Medium	Medium	Medium	Medium	Medium
31	Neck Dissection II-IV Part 2: Level IIb https://www.youtube.com/watch?v=Jbh_k7FlyPk	High	Medium	High	High	High
32	supra omohyoid Neck dissection mudit https://www.youtube.com/watch?v=r0E_R-ERrmU	Low	Low	Medium	Low	Medium
33	Neck Dissection II-IV Part 1: Skin Flap https://www.youtube.com/watch?v=VyN4c_wsZuY	High	Medium	High	High	High
34	Supraomohyoid Neck Dissection https://www.youtube.com/watch?v=WoAf9y6omfc	Medium	High	Medium	Medium	Medium
35	Neck Dissection II-IV Part 3: Level IIa-IV https://www.youtube.com/watch?v=Uu5s2QE0CS0	High	Medium	High	High	High
36	SupraOmohyoid neck dissection Dr Vijay Haribhakti https://www.youtube.com/watch?v=_qyya9PtvzI	Medium	High	Medium	Medium	Medium
37	Modified Radical Neck Dissection https://www.youtube.com/watch?v=h-sj5geqisk	High	Low	Medium	Low	Low

Factors Associated With Overall Video Quality

Two-sample t test (assuming same variance) and linear regression analyses were performed on video characteristics to ascertain factors associated with overall video quality and are displayed in Table 6 . In both the total and subgroup analyses, there was no statistically significant difference in video quality between videos posted by US and non-US based physicians (95% confidence interval [CI] −0.10 to 4.10; p = 0.06 and 95% CI: −1.00 to 2.26; p = 0.44, respectively). However, videos made by an otolaryngology-trained physician had a LAP-VEGaS score that was 3.93 points higher (95% CI: 2.34-5.52; p < 0.001) in total score and 2.37 points higher (95% CI: 1.26-3.48; p < 0.001) in subgroup score. View count and video age were not correlated with the overall video quality score (adjusted R2 value of −0.03 to 0.01). The likes:dislikes ratio (“L:D ratio”) of the video had a weakly positive correlation with the overall video quality score (adjusted R2 value of 0.09 and 0.13 for total and subgroup score, respectively). The presence of narrated audio and/or subtitle annotations had a moderately positive correlation with overall video quality score (adjusted R2 value of 0.36 and 0.40 for total and subgroup score, respectively).

TABLE 6

Factors Associated With Overall Video Quality

	Total Score		Subgroup Score
	p-value	Adjusted R2	p-value	Adjusted R2
US vs non-US	0.06		0.44
Otolaryngology vs non-Otolaryngology	<0.001*		<0.001*
View count		−0.03		−0.02
Video age		0.01		−0.01
L/D ratio		0.09		0.13
Presence of audio/subtitles		0.36		0.40

L/D = Likes/Dislikes,

Statistically Significant,

Discussion

This study provides a detailed evaluation and analysis of 37 surgical videos on neck dissection, a key indicator case for trainees in otolaryngology, available on the free-to-access platform, YouTube, as of May 6, 2020. The videos combined for a total of approximately one million total views worldwide. Given the expansive reach and growing popularity of YouTube as an educational platform, it is imperative that current videos be verified for their educational utility and that future videos are produced with an emphasis on creating a repository of high-quality surgical education videos.

Objectively, using the LAP-VEGaS scoring criteria, the quality of the selected videos was very heterogeneous. O the 24 of 37 (65%) of videos were rated as medium quality, while 10 of 37 (27%) of videos were rated as low quality. Only 3 of 37 (8%) of videos were rated to be high quality. While the popularity and relevance of YouTube is traditionally predicated on video characteristics such as total view count, date uploaded, number of likes, and number of dislikes, these video characteristics did not correlate with or predict the quality of videos. Interestingly, the authors found that attributes such as total view count and date uploaded (or video age) had no correlation with overall quality scores for neck dissection videos. While the L:D ratio had a mildly positive correlation with LAP-VEGaS scores, only the presence of narrated audio and/or annotated subtitles had a moderate positive correlation with LAP-VEGaS score. That said, it is widely accepted in the medical education literature that the utility of video instruction is maximized when audio narration is matched effectively to the video display.

The authors also found that videos produced by US-based physicians did not outperform videos produced by non-US-based surgeons, but videos produced by otolaryngology-trained physicians were statistically better than videos posted by surgeons trained in other surgical subspecialties. This speaks to the growing need for the otolaryngology community to expand their platform for e-learning by creating easy free-to-access, and high-quality video content. In fact, the American Academy of Otolaryngology-Head and Neck Surgery (AAO-HNS) and American Head and Neck Society (AHNS) do not presently provide educational surgical videos on key indicator cases in head and neck surgery such as neck dissection. They presently only provide videos on free and regional flap head and neck reconstruction. In a study on the importance of otolaryngology exposure in undergraduate medical education, Fung addresses the paucity of medical education tools designed to effectively teach otolaryngology; among his suggestions include heightened focus on bringing e-learning and simulation to the forefront of innovative curriculums. Tarpada et al. performed a systematic review of studies evaluating e-learning and otolaryngology and found that out of 12 studies, 9 reported either improved objective performance in academic or clinical measures, or no difference in performance but higher satisfaction with use of e-learning materials when compared to standard teaching methods. Hughes et al. discussed the challenges that exist in contemporary surgical education with producing skilled otolaryngologists while mitigating the effects of burnout and fatigue by suggesting the expansion of use of online platforms such as YouTube. They suggest user-generated otolaryngology-specific educational channels beneficial to the otolaryngology trainee, but caution viewers to validate the quality and content of these videos.

The current COVID-19 pandemic has accelerated the need for a robust e-learning platform for trainees in otolaryngology. A recent publication by Stanford University has highlighted the increased risks that otolaryngologists face due to their proximity to upper airway and mucosal structures. As a result, institutions across the nation have overhauled medical student and resident clinical rotations; for example, medical students have been removed from their clinical duties and residents are limited in their involvement in outpatient clinics and elective surgeries. Trainees in otolaryngology are largely supplementing their clinical education with remote virtual learning. However, this drastic change in the curriculum presents problems as Comer et al. predict that a 2-year cycle of resident education could be exhausted in less than 2 months if COVID-19-inducted limitations persist. Multiple consortia in otolaryngology education have been established to continue otolaryngology resident education remotely in the setting of reduced clinical experience, limited educational resources, and limited in-person contact during the COVID-19 pandemic.23, 24, 25 AAO-HNS has also provided free access to AcademyU and Otosource for all residents through 2020. However, these resources have largely focused on providing remote lectures across multiple institutions as well as web-based learning modules. Few resources have been dedicated toward creating high-quality educational videos designed to help trainees improve their surgical acumen. As such, this study analyzes the existing repository of videos available on the free-to-access platform YouTube, and suggests a set of criteria important to creating high-quality surgical videos for the otolaryngology trainee. The authors hope that in creating guidelines for developing high-quality surgical videos, surgeons globally can create content that will augment the virtual otolaryngology curriculum for trainees.

Study Limitations

This study has a number of limitations. First, only videos on neck dissection available on YouTube were reported. While trainees report that their most widely used resource is YouTube, there are a variety of alternative resources including free-to-access and paid subscription videos that would require further analysis. Second, it is important to note that surgeons are not necessarily uploading their videos to YouTube for educational purposes; there is no requirement that content on YouTube be inherently educational. That is, it is not possible to determine the YouTube author's original intent – authors can upload videos for any number of reasons that include, but certainly are not limited to marketing, entertainment, and education. Furthermore, it is difficult to assess the video author's intended audience. Videos can potentially be targeted toward trainees, peers, and/or patients. Additionally, the validated survey instrument (LAP-VEGaS) used by the study authors was originally intended for grading the appropriateness of videos for submission for conferences and academic presentations. It is unlikely that the LAP-VEGaS criteria were known to authors uploading their videos to YouTube. As a result, video authors are graded against criteria that they likely did not incorporate or consider when creating their video content. Thus, it is important to note that these factors likely skew the perceived appropriateness for the videos’ specific use as an educational tool for trainees. That said, there is an implicit understanding that once a video is made public, viewership will follow and thus, it is important that stricter guidelines be used to produce high-quality educational content for viewers. Third, the guidelines laid out by the authors are limited by the judgment of the four reviewers; future endeavors should focus on establishing a panel of reviewers to create a validated tool for creating quality surgical videos.

Future Directions

In this study, the authors have assessed not only the existing quality and content of neck dissection videos on YouTube, but they have compiled an understanding of the qualities that dictate the educational value of a surgical video. Thus, the authors recommend that surgeons looking to create high-quality educational content for trainees in otolaryngology follow the attributes displayed in Table 7 . First and foremost, videos should be of a live operation with a human subject; while cadaveric dissections provide educational value, it is more beneficial to the trainee to observe a live procedure. Videos should provide narrated audio or closed captioning to guide the viewer through the surgery; it is important to note that videos with voice-over narration are preferred to those with live operating room conversation. Surgeries should be performed and explained in a step-by-step manner that allows the viewer to understand the flow of the surgery. Surgeons should take care to name all relevant anatomy and structures; specifically, anatomy should be directly pointed to, annotated, or highlighted on the screen. Patient positioning as well as surgeon positioning should be reviewed and alluded to throughout the procedure (especially if the operating surgeon is changing vantage points). Surgeons should take care to ensure the field of view of the operating field is clear at all times; cameras should not zoom in too closely so as to obscure the global view, but they also should not zoom too far out so as to lose the finer details of the procedure. Videos should be time-efficient and would, ideally, range between 10 and 20 minutes. Finally, videos should include a title page that includes the name of the procedure, patient pathology, location of institutions, and the name of the operating surgeon.

TABLE 7

Key Attributes for a High-Quality Educational Surgical Video

1. Live operation with a human subject 2. Narrated audio or closed captioning in English language 3. Step-by-step procedure 4. Names and annotates all relevant anatomy/structures 5. High-definition, clear view of the operative field 6. Time efficient (<20 minutes) 7. Title page that includes name of procedure, pathology, where it was performed, and name of the operating surgeon

Conclusions

Online videos of neck dissection represent an increasingly ubiquitous and appropriate resource for trainees in otolaryngology learning key indicator cases. Free-to-access video repositories, such as YouTube, have become increasingly popular among trainees as a primary resource for learning and preparing for surgical cases. In spite of this trend, videos on public domains are not subject to strict regulation and thus, vary widely in quality of content. During the COVID-19 pandemic when medical students, residents, and fellows are limited in their clinical exposure, virtual curriculums are becoming increasingly prevalent; the expectation is that the current pandemic will likely transform the way surgical education is delivered going forward. As such, future efforts should be taken to improve the breadth and depth of educational video content in otolaryngology by focusing on applying guidelines such as the LAP-VEGaS guidelines or following recommendations for creating high-quality educational video content.