Amr Salama1, Janet Panoch1, Elhaam Bandali1, Aaron Carroll2, Sarah Wiehe3, Stephen Downs3, Mark P Cain1, Richard Frankel4, Katherine H Chan5. 1. Department of Urology, Indiana University School of Medicine, USA. 2. Department of Pediatrics, Center for Pediatric and Adolescent Comparative Effectiveness Research, USA. 3. Department of Pediatrics, Children's Health Services Research Center, USA. 4. Department of Medicine, Indiana University School of Medicine, Indianapolis, Indiana, USA; Cleveland Clinic Learner Institute, Cleveland, OH, USA. 5. Department of Urology, Indiana University School of Medicine, USA; Department of Pediatrics, Center for Pediatric and Adolescent Comparative Effectiveness Research, USA. Electronic address: kchubert@iupui.edu.
Abstract
INTRODUCTION: Parents who make decisions about hypospadias repair for their child may seek information from online platforms such as YouTube. OBJECTIVE: The purpose of this study is to evaluate the health literacy demand of hypospadias videos on YouTube using the Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-A/V). STUDY DESIGN: We performed a YouTube search using the term "hypospadias," limiting results to the first 100 videos. We excluded videos that were <1 min or >20 min and videos that were not in English or did not include subtitles. Two evaluators independently examined videos and determined PEMAT-A/V scores for understandability and actionability (i.e., ability to identify actions the viewer can take). Videos with scores >70% are understandable or actionable. The inter-rater reliability (kappa) and intraclass correlation coefficient (ICC) of PEMAT scores were calculated. Bivariate and multivariable linear regression models assessed the association of video characteristics with respective scores. RESULTS: Of the 100 videos that were identified on YouTube, 47 (47%) were excluded leaving 53 for analysis: 14 were >20 min, 14 were <1 min, 9 had no audio or subtitles, 7 were not in English, 1 was a duplicate, 1 was unrelated to hypospadias, and 1 was deleted at the time of data analysis. Three (5.6%) were understandable (mean score 54.5%, standard deviation (SD) 14.9) and eight (15.1%) were actionable (mean score 21.8%, SD 16.6) (Extended Summary Figure). Kappa values ranged from 0.4 to 1. The ICC's were 0.55 and 0.33 for understandability and actionability, respectively. In the bivariate analysis, mean understandability scores were significantly higher for English language videos (p = 0.04), videos with animation (p = 0.002), and those produced by industry (p = 0.02). In the multivariable analysis, mean understandability scores were significantly higher for "expert testimonial" or "other" video types after adjusting for graphics type and overall tone (p = 0.04). Mean understandability scores were also significantly higher for videos with animation after adjusting for video type and overall tone (p = 0.01). Mean actionability scores were significantly higher for videos with a negative tone (p = 0.01). DISCUSSION: The vast majority of hypospadias-related YouTube content is not appropriate for users with low health literacy although certain types of videos, such those with animation and expert testimonials, scored higher on understandability than other types. CONCLUSION: Due to the lack of sufficient online informational content regarding hypospadias, we plan to engage parents of sons with hypospadias in the development of high-quality patient educational materials about hypospadias.
INTRODUCTION: Parents who make decisions about hypospadias repair for their child may seek information from online platforms such as YouTube. OBJECTIVE: The purpose of this study is to evaluate the health literacy demand of hypospadias videos on YouTube using the Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-A/V). STUDY DESIGN: We performed a YouTube search using the term "hypospadias," limiting results to the first 100 videos. We excluded videos that were <1 min or >20 min and videos that were not in English or did not include subtitles. Two evaluators independently examined videos and determined PEMAT-A/V scores for understandability and actionability (i.e., ability to identify actions the viewer can take). Videos with scores >70% are understandable or actionable. The inter-rater reliability (kappa) and intraclass correlation coefficient (ICC) of PEMAT scores were calculated. Bivariate and multivariable linear regression models assessed the association of video characteristics with respective scores. RESULTS: Of the 100 videos that were identified on YouTube, 47 (47%) were excluded leaving 53 for analysis: 14 were >20 min, 14 were <1 min, 9 had no audio or subtitles, 7 were not in English, 1 was a duplicate, 1 was unrelated to hypospadias, and 1 was deleted at the time of data analysis. Three (5.6%) were understandable (mean score 54.5%, standard deviation (SD) 14.9) and eight (15.1%) were actionable (mean score 21.8%, SD 16.6) (Extended Summary Figure). Kappa values ranged from 0.4 to 1. The ICC's were 0.55 and 0.33 for understandability and actionability, respectively. In the bivariate analysis, mean understandability scores were significantly higher for English language videos (p = 0.04), videos with animation (p = 0.002), and those produced by industry (p = 0.02). In the multivariable analysis, mean understandability scores were significantly higher for "expert testimonial" or "other" video types after adjusting for graphics type and overall tone (p = 0.04). Mean understandability scores were also significantly higher for videos with animation after adjusting for video type and overall tone (p = 0.01). Mean actionability scores were significantly higher for videos with a negative tone (p = 0.01). DISCUSSION: The vast majority of hypospadias-related YouTube content is not appropriate for users with low health literacy although certain types of videos, such those with animation and expert testimonials, scored higher on understandability than other types. CONCLUSION: Due to the lack of sufficient online informational content regarding hypospadias, we plan to engage parents of sons with hypospadias in the development of high-quality patient educational materials about hypospadias.
Authors: Kapil Chalil Madathil; A Joy Rivera-Rodriguez; Joel S Greenstein; Anand K Gramopadhye Journal: Health Informatics J Date: 2014-03-25 Impact factor: 2.681
Authors: K H Vincent Lau; Pue Farooque; Gary Leydon; Michael L Schwartz; R Mark Sadler; Jeremy J Moeller Journal: Med Teach Date: 2017-11-07 Impact factor: 3.650
Authors: Amarbir S Gill; Philip C Biggs; Garrett Hagwood; Angela M Beliveau; Kiarash Shahlaie; E B Strong; Toby O Steele Journal: J Neurol Surg B Skull Base Date: 2021-05-17