Literature DB >> 34141997

The revised Approved Instructional Resources score: An improved quality evaluation tool for online educational resources.

Andrew Grock1,2, Jaime Jordan2,3, Fareen Zaver1,2,3,4,5,6,7,8,9,10, Isabelle N Colmers-Gray5, Keeth Krishnan6, Teresa Chan7,8, Brent Thoma9,10, Charlotte Alexander1,2,3,4,5,6,7,8,9,10, Mohammed Alkhalifah1,2,3,4,5,6,7,8,9,10, Abdulaziz S Almehlisi1,2,3,4,5,6,7,8,9,10, Saeed Alqahtani1,2,3,4,5,6,7,8,9,10, Scott Anderson1,2,3,4,5,6,7,8,9,10, Shelaina Anderson1,2,3,4,5,6,7,8,9,10, Colin Andrews1,2,3,4,5,6,7,8,9,10, Jocelyn Andruko1,2,3,4,5,6,7,8,9,10, Nikytha Antony1,2,3,4,5,6,7,8,9,10, Diptesh Aryal1,2,3,4,5,6,7,8,9,10, Barbra Backus1,2,3,4,5,6,7,8,9,10, Jennifer Baird1,2,3,4,5,6,7,8,9,10, Andrew Baker1,2,3,4,5,6,7,8,9,10, Sarah Batty1,2,3,4,5,6,7,8,9,10, Jared Baylis1,2,3,4,5,6,7,8,9,10, Braeden Beaumont1,2,3,4,5,6,7,8,9,10, Chris Belcher1,2,3,4,5,6,7,8,9,10, Brent Benavides1,2,3,4,5,6,7,8,9,10, Michael Benham1,2,3,4,5,6,7,8,9,10, Julian Botta1,2,3,4,5,6,7,8,9,10, Elyse Berger Pelletier1,2,3,4,5,6,7,8,9,10, Nicholas Bouchard1,2,3,4,5,6,7,8,9,10, Victoria Brazil1,2,3,4,5,6,7,8,9,10, Emily Brumfield1,2,3,4,5,6,7,8,9,10, Anthony Bryson1,2,3,4,5,6,7,8,9,10, Wisarut Bunchit1,2,3,4,5,6,7,8,9,10, Kat Butler1,2,3,4,5,6,7,8,9,10, Lindy Buzikievich1,2,3,4,5,6,7,8,9,10, David Calcara1,2,3,4,5,6,7,8,9,10, Rob Carey1,2,3,4,5,6,7,8,9,10, Maria Rosa Carrillo1,2,3,4,5,6,7,8,9,10, Stephen Carroll1,2,3,4,5,6,7,8,9,10, Casey Lyons1,2,3,4,5,6,7,8,9,10, Louise Cassidy1,2,3,4,5,6,7,8,9,10, Kirsty Challen1,2,3,4,5,6,7,8,9,10, Kathryn Chan1,2,3,4,5,6,7,8,9,10, Tim Chaplin1,2,3,4,5,6,7,8,9,10, Natasha Chatham-Zvelebil1,2,3,4,5,6,7,8,9,10, Eric Chen1,2,3,4,5,6,7,8,9,10, Lucy Chen1,2,3,4,5,6,7,8,9,10, Sushant Chhabra1,2,3,4,5,6,7,8,9,10, Alvin Chin1,2,3,4,5,6,7,8,9,10, Eric Chochi1,2,3,4,5,6,7,8,9,10, Tina Choudhri1,2,3,4,5,6,7,8,9,10, Jeremy Christensen1,2,3,4,5,6,7,8,9,10, Kimberly Connors1,2,3,4,5,6,7,8,9,10, Veronica Coppersmith1,2,3,4,5,6,7,8,9,10, Abby Cosgrove1,2,3,4,5,6,7,8,9,10, Gregory Costello1,2,3,4,5,6,7,8,9,10, Kevin Cullison1,2,3,4,5,6,7,8,9,10, Andrew D'Alessandro1,2,3,4,5,6,7,8,9,10, Kerstin Wit1,2,3,4,5,6,7,8,9,10, Marie Decock1,2,3,4,5,6,7,8,9,10, Rayan Delbani1,2,3,4,5,6,7,8,9,10, William Denq1,2,3,4,5,6,7,8,9,10, Julianna Deutscher1,2,3,4,5,6,7,8,9,10, Brendan Devine1,2,3,4,5,6,7,8,9,10, Maia Dorsett1,2,3,4,5,6,7,8,9,10, Taylor Duda1,2,3,4,5,6,7,8,9,10, Justin Dueweke1,2,3,4,5,6,7,8,9,10, Teresa Dunphy1,2,3,4,5,6,7,8,9,10, Sean Dyer1,2,3,4,5,6,7,8,9,10, Karthryn T Eastley1,2,3,4,5,6,7,8,9,10, Marcia Edmonds1,2,3,4,5,6,7,8,9,10, Ken Edwards1,2,3,4,5,6,7,8,9,10, Robert Ehrman1,2,3,4,5,6,7,8,9,10, Youness Elkhalidy1,2,3,4,5,6,7,8,9,10, Preston Fedor1,2,3,4,5,6,7,8,9,10, Brian Ficiur1,2,3,4,5,6,7,8,9,10, Caley Flynn1,2,3,4,5,6,7,8,9,10, Bill Fraser1,2,3,4,5,6,7,8,9,10, Meagan Fu1,2,3,4,5,6,7,8,9,10, James Fukakusa1,2,3,4,5,6,7,8,9,10, Eric Funk1,2,3,4,5,6,7,8,9,10, Damjan Gaco1,2,3,4,5,6,7,8,9,10, Viktor Gawlik1,2,3,4,5,6,7,8,9,10, Kenn Ghaffarian1,2,3,4,5,6,7,8,9,10, Laleh Gharahbaghian1,2,3,4,5,6,7,8,9,10, Andrew Griffith1,2,3,4,5,6,7,8,9,10, Phil Griffith1,2,3,4,5,6,7,8,9,10, Tanner Gronowski1,2,3,4,5,6,7,8,9,10, Cathy Grossman1,2,3,4,5,6,7,8,9,10, Jaroslaw Gucwa1,2,3,4,5,6,7,8,9,10, Pawan Gupta1,2,3,4,5,6,7,8,9,10, Alexandra Gustafson1,2,3,4,5,6,7,8,9,10, Andrew Guy1,2,3,4,5,6,7,8,9,10, Mary Haas1,2,3,4,5,6,7,8,9,10, Stanislaw Haciski1,2,3,4,5,6,7,8,9,10, Emina Hajdinjak1,2,3,4,5,6,7,8,9,10, Andrew K Hall1,2,3,4,5,6,7,8,9,10, Regina Hammock1,2,3,4,5,6,7,8,9,10, Jan Hansel1,2,3,4,5,6,7,8,9,10, Alexander Hart1,2,3,4,5,6,7,8,9,10, Larissa Hattin1,2,3,4,5,6,7,8,9,10, Brandon Herb1,2,3,4,5,6,7,8,9,10, SueLin Hilbert1,2,3,4,5,6,7,8,9,10, Jeff Hill1,2,3,4,5,6,7,8,9,10, Jesse Hill1,2,3,4,5,6,7,8,9,10, Amy Ho1,2,3,4,5,6,7,8,9,10, Emily House1,2,3,4,5,6,7,8,9,10, Nina House1,2,3,4,5,6,7,8,9,10, Simon York Ming Huang1,2,3,4,5,6,7,8,9,10, James Huffman1,2,3,4,5,6,7,8,9,10, Charlie Inboriboon1,2,3,4,5,6,7,8,9,10, Alex Ireland1,2,3,4,5,6,7,8,9,10, Ali Jamal1,2,3,4,5,6,7,8,9,10, Mohammad Ali Jamil1,2,3,4,5,6,7,8,9,10, Victor Jansen1,2,3,4,5,6,7,8,9,10, Zach Jarou1,2,3,4,5,6,7,8,9,10, Vivian Jia1,2,3,4,5,6,7,8,9,10, Levi Johnston1,2,3,4,5,6,7,8,9,10, Drew Kalnow1,2,3,4,5,6,7,8,9,10, Puneet Kapur1,2,3,4,5,6,7,8,9,10, Seth Kelly1,2,3,4,5,6,7,8,9,10, Kyle Kelson1,2,3,4,5,6,7,8,9,10, William Kent1,2,3,4,5,6,7,8,9,10, Rishi Khakhkhar1,2,3,4,5,6,7,8,9,10, Jaasmit Khurana1,2,3,4,5,6,7,8,9,10, Ashley Kilp1,2,3,4,5,6,7,8,9,10, Scott Knapp1,2,3,4,5,6,7,8,9,10, Sebastian Kohler1,2,3,4,5,6,7,8,9,10, Ivanna Kruhlak1,2,3,4,5,6,7,8,9,10, Nadim Lalani1,2,3,4,5,6,7,8,9,10, Samantha Lam1,2,3,4,5,6,7,8,9,10, Patrick Lank1,2,3,4,5,6,7,8,9,10, Zander Laurie1,2,3,4,5,6,7,8,9,10, Kristina Lea1,2,3,4,5,6,7,8,9,10, Ernest Leber1,2,3,4,5,6,7,8,9,10, Ching-Hsing Lee1,2,3,4,5,6,7,8,9,10, Haakon Lenes1,2,3,4,5,6,7,8,9,10, Nilantha Lenora1,2,3,4,5,6,7,8,9,10, Jesse Leontowicz1,2,3,4,5,6,7,8,9,10, Kelly Lien1,2,3,4,5,6,7,8,9,10, Michelle Lin1,2,3,4,5,6,7,8,9,10, Yingchun Lin1,2,3,4,5,6,7,8,9,10, Andrew Little1,2,3,4,5,6,7,8,9,10, Harry Liu1,2,3,4,5,6,7,8,9,10, Ivy Liu1,2,3,4,5,6,7,8,9,10, Steve Liu1,2,3,4,5,6,7,8,9,10, Stephanie Louka1,2,3,4,5,6,7,8,9,10, Elise Lovell1,2,3,4,5,6,7,8,9,10, David Lowe1,2,3,4,5,6,7,8,9,10, Ashley Lubberdink1,2,3,4,5,6,7,8,9,10, Jessica Luc1,2,3,4,5,6,7,8,9,10, Sheng-Hsiang Ma1,2,3,4,5,6,7,8,9,10, Hugh MacLeod1,2,3,4,5,6,7,8,9,10, Nick Mancuso1,2,3,4,5,6,7,8,9,10, Anali Maneshi1,2,3,4,5,6,7,8,9,10, Jesse May1,2,3,4,5,6,7,8,9,10, John Mayo1,2,3,4,5,6,7,8,9,10, Mike McDonnell1,2,3,4,5,6,7,8,9,10, Susan McLellan1,2,3,4,5,6,7,8,9,10, Carolyn McQuarrie1,2,3,4,5,6,7,8,9,10, Therese Mead1,2,3,4,5,6,7,8,9,10, Cory Meeuwisse1,2,3,4,5,6,7,8,9,10, Patrick Meloy1,2,3,4,5,6,7,8,9,10, Perry Menzies1,2,3,4,5,6,7,8,9,10, Anne Messman1,2,3,4,5,6,7,8,9,10, Stephen Miazga1,2,3,4,5,6,7,8,9,10, Logan Mills1,2,3,4,5,6,7,8,9,10, Allan Mix1,2,3,4,5,6,7,8,9,10, Steve Montag1,2,3,4,5,6,7,8,9,10, Brendan Moore1,2,3,4,5,6,7,8,9,10, Justin Morgenstern1,2,3,4,5,6,7,8,9,10, Sarah Mott1,2,3,4,5,6,7,8,9,10, P Mukherj1,2,3,4,5,6,7,8,9,10, Ali Mulla1,2,3,4,5,6,7,8,9,10, Sheena Nandalal1,2,3,4,5,6,7,8,9,10, Taylor Nikel1,2,3,4,5,6,7,8,9,10, Julia Nood1,2,3,4,5,6,7,8,9,10, Sean Nugent1,2,3,4,5,6,7,8,9,10, Morgan Oakland1,2,3,4,5,6,7,8,9,10, Werner Oberholzer1,2,3,4,5,6,7,8,9,10, Onyeka Otugo1,2,3,4,5,6,7,8,9,10, Taofiq Segun Oyedokun1,2,3,4,5,6,7,8,9,10, Alim Pardhan1,2,3,4,5,6,7,8,9,10, Kinjal Patel1,2,3,4,5,6,7,8,9,10, Quinten Paterson1,2,3,4,5,6,7,8,9,10, Catherine Patocka1,2,3,4,5,6,7,8,9,10, Christine Patterson1,2,3,4,5,6,7,8,9,10, James Pearlman1,2,3,4,5,6,7,8,9,10, Alexis Pelletier-Bui1,2,3,4,5,6,7,8,9,10, Marc Phan1,2,3,4,5,6,7,8,9,10, Zafrina Poonja1,2,3,4,5,6,7,8,9,10, Aubrey Powell1,2,3,4,5,6,7,8,9,10, Kamini Premkumar1,2,3,4,5,6,7,8,9,10, Gregor Prosen1,2,3,4,5,6,7,8,9,10, Vishal Puri1,2,3,4,5,6,7,8,9,10, Tanis Quaife1,2,3,4,5,6,7,8,9,10, Ryan Raffel1,2,3,4,5,6,7,8,9,10, Ali Raja1,2,3,4,5,6,7,8,9,10, Randi Ramunno1,2,3,4,5,6,7,8,9,10, Louise Rang1,2,3,4,5,6,7,8,9,10, Suzanne Rannazzisi1,2,3,4,5,6,7,8,9,10, Shauna Regan1,2,3,4,5,6,7,8,9,10, Salim R Rezaie1,2,3,4,5,6,7,8,9,10, Milan Ridderikhof1,2,3,4,5,6,7,8,9,10, Vanessa Rogers1,2,3,4,5,6,7,8,9,10, Christine Roh1,2,3,4,5,6,7,8,9,10, Keith Rosenberg1,2,3,4,5,6,7,8,9,10, Marina Roure1,2,3,4,5,6,7,8,9,10, Sherri Rudinsky1,2,3,4,5,6,7,8,9,10, Joshua Rudner1,2,3,4,5,6,7,8,9,10, Adeeb Saleh1,2,3,4,5,6,7,8,9,10, Will Sanderson1,2,3,4,5,6,7,8,9,10, Owen Scheirer1,2,3,4,5,6,7,8,9,10, Paul Schofield1,2,3,4,5,6,7,8,9,10, Paul Schunk1,2,3,4,5,6,7,8,9,10, Evan Schwarz1,2,3,4,5,6,7,8,9,10, Parisa Shahrabadi1,2,3,4,5,6,7,8,9,10, Eric Shappell1,2,3,4,5,6,7,8,9,10, Julia Sheffield1,2,3,4,5,6,7,8,9,10, Manpreet Singh1,2,3,4,5,6,7,8,9,10, Hector C Singson1,2,3,4,5,6,7,8,9,10, Dave Slessor1,2,3,4,5,6,7,8,9,10, Sam Smith1,2,3,4,5,6,7,8,9,10, Paula Sneath1,2,3,4,5,6,7,8,9,10, Robert Sobehart1,2,3,4,5,6,7,8,9,10, Kerry Spearing1,2,3,4,5,6,7,8,9,10, James Stempien1,2,3,4,5,6,7,8,9,10, Britni Sternard1,2,3,4,5,6,7,8,9,10, Tara Stratton1,2,3,4,5,6,7,8,9,10, Katherine Stuart1,2,3,4,5,6,7,8,9,10, Bob Stuntz1,2,3,4,5,6,7,8,9,10, Michael Susalla1,2,3,4,5,6,7,8,9,10, Colleen Sweeney1,2,3,4,5,6,7,8,9,10, Loice Swisher1,2,3,4,5,6,7,8,9,10, Henry Swoboda1,2,3,4,5,6,7,8,9,10, Shahbaz Syed1,2,3,4,5,6,7,8,9,10, Taku Taira1,2,3,4,5,6,7,8,9,10, Nikhil Tambe1,2,3,4,5,6,7,8,9,10, Richard Tang1,2,3,4,5,6,7,8,9,10, Elisha Targonsky1,2,3,4,5,6,7,8,9,10, Alan Taylor1,2,3,4,5,6,7,8,9,10, Rachel Taylor1,2,3,4,5,6,7,8,9,10, Todd Taylor1,2,3,4,5,6,7,8,9,10, Paxton Ting1,2,3,4,5,6,7,8,9,10, Gerhard Tiwald1,2,3,4,5,6,7,8,9,10, Evelyn Tran1,2,3,4,5,6,7,8,9,10, Kelvin Tran1,2,3,4,5,6,7,8,9,10, Jason Trickovic1,2,3,4,5,6,7,8,9,10, Paul Trinquero1,2,3,4,5,6,7,8,9,10, Aaron Tyagi1,2,3,4,5,6,7,8,9,10, Manrique Umana1,2,3,4,5,6,7,8,9,10, Patrick Vallance1,2,3,4,5,6,7,8,9,10, Patricia Van den Berg1,2,3,4,5,6,7,8,9,10, Kelly van Diepen1,2,3,4,5,6,7,8,9,10, Luis Vargas1,2,3,4,5,6,7,8,9,10, Rene Verbeek1,2,3,4,5,6,7,8,9,10, Sandra Viggers1,2,3,4,5,6,7,8,9,10, Zlata Vlodaver1,2,3,4,5,6,7,8,9,10, Matthew Wagner1,2,3,4,5,6,7,8,9,10, Noorin Walji1,2,3,4,5,6,7,8,9,10, Joe Walter1,2,3,4,5,6,7,8,9,10, Miranda Wan1,2,3,4,5,6,7,8,9,10, Rachel Wang1,2,3,4,5,6,7,8,9,10, Gregory Wanner1,2,3,4,5,6,7,8,9,10, Wyatt Warawa1,2,3,4,5,6,7,8,9,10, Mike Ward1,2,3,4,5,6,7,8,9,10, Jennifer Weekes1,2,3,4,5,6,7,8,9,10, Kristen Weersink1,2,3,4,5,6,7,8,9,10, Cara Weessies1,2,3,4,5,6,7,8,9,10, Anna Whalen-Browne1,2,3,4,5,6,7,8,9,10, Brian Whiteside1,2,3,4,5,6,7,8,9,10, Matthew Willis1,2,3,4,5,6,7,8,9,10, Jonas Wilmer1,2,3,4,5,6,7,8,9,10, Nelson Wong1,2,3,4,5,6,7,8,9,10, Mark Woodcroft1,2,3,4,5,6,7,8,9,10, Rob Woods1,2,3,4,5,6,7,8,9,10, Lawrence Yau1,2,3,4,5,6,7,8,9,10, Jessica Yee1,2,3,4,5,6,7,8,9,10, Calvin Yeh1,2,3,4,5,6,7,8,9,10, Katherine Yurkiw1,2,3,4,5,6,7,8,9,10, Fareen Zaver1,2,3,4,5,6,7,8,9,10, Alexander Zozula1,2,3,4,5,6,7,8,9,10.   

Abstract

BACKGROUND: Free Open-Access Medical education (FOAM) use among residents continues to rise. However, it often lacks quality assurance processes and residents receive little guidance on quality assessment. The Academic Life in Emergency Medicine Approved Instructional Resources tool (AAT) was created for FOAM appraisal by and for expert educators and has demonstrated validity in this context. It has yet to be evaluated in other populations.
OBJECTIVES: We assessed the AAT's usability in a diverse population of practicing emergency medicine (EM) physicians, residents, and medical students; solicited feedback; and developed a revised tool.
METHODS: As part of the Medical Education Translational Resources: Impact and Quality (METRIQ) study, we recruited medical students, EM residents, and EM attendings to evaluate five FOAM posts with the AAT and provide quantitative and qualitative feedback via an online survey. Two independent analysts performed a qualitative thematic analysis with discrepancies resolved through discussion and negotiated consensus. This analysis informed development of an initial revised AAT, which was then further refined after pilot testing among the author group. The final tool was reassessed for reliability.
RESULTS: Of 330 recruited international participants, 309 completed all ratings. The Best Evidence in Emergency Medicine (BEEM) score was the component most frequently reported as difficult to use. Several themes emerged from the qualitative analysis: for ease of use-understandable, logically structured, concise, and aligned with educational value. Limitations include deviation from questionnaire best practices, validity concerns, and challenges assessing evidence-based medicine. Themes supporting its use include evaluative utility and usability. The author group pilot tested the initial revised AAT, revealing a total score average measure intraclass correlation coefficient (ICC) of moderate reliability (ICC = 0.68, 95% confidence interval [CI] = 0 to 0.962). The final AAT's average measure ICC was 0.88 (95% CI = 0.77 to 0.95).
CONCLUSIONS: We developed the final revised AAT from usability feedback. The new score has significantly increased usability, but will need to be reassessed for reliability in a broad population.
© 2021 by the Society for Academic Emergency Medicine.

Entities:  

Year:  2021        PMID： 34141997      PMCID： PMC8194147          DOI： 10.1002/aet2.10601

Source DB:  PubMed          Journal:  AEM Educ Train        ISSN： 2472-5390


  21 in total

Review 1.  Quality indicators for blogs and podcasts used in medical education: modified Delphi consensus recommendations by an international cohort of health professions educators.

Authors:  Michelle Lin; Brent Thoma; N Seth Trueger; Felix Ankel; Jonathan Sherbino; Teresa Chan
Journal:  Postgrad Med J       Date:  2015-08-14       Impact factor: 2.401

Review 2.  A Systematic Review and Qualitative Analysis to Determine Quality Indicators forHealth Professions Education Blogs and Podcasts.

Authors:  Quinten S Paterson; Brent Thoma; W Kenneth Milne; Michelle Lin; Teresa M Chan
Journal:  J Grad Med Educ       Date:  2015-12

3.  The use of free online educational resources by Canadian emergency medicine residents and program directors.

Authors:  Eve Purdy; Brent Thoma; Joseph Bednarczyk; David Migneault; Jonathan Sherbino
Journal:  CJEM       Date:  2015-03       Impact factor: 2.410

4.  Learning from mistakes on social media.

Authors:  Sarah Edwards; Damian Roland
Journal:  Emerg Med J       Date:  2019-07-10       Impact factor: 2.740

5.  The Social Media Index as an Indicator of Quality for Emergency Medicine Blogs: A METRIQ Study.

Authors:  Brent Thoma; Teresa M Chan; Puneet Kapur; Derek Sifford; Marshall Siemens; Michael Paddock; Felix Ankel; Andy Grock; Michelle Lin
Journal:  Ann Emerg Med       Date:  2018-07-03       Impact factor: 5.721

6.  Examining Reliability and Validity of an Online Score (ALiEM AIR) for Rating Free Open Access Medical Education Resources.

Authors:  Teresa Man-Yee Chan; Andrew Grock; Michael Paddock; Kulamakan Kulasegaram; Lalena M Yarris; Michelle Lin
Journal:  Ann Emerg Med       Date:  2016-03-29       Impact factor: 5.721

7.  The Revised METRIQ Score: A Quality Evaluation Tool for Online Educational Resources.

Authors:  Isabelle N Colmers-Gray; Keeth Krishnan; Teresa M Chan; N Seth Trueger; Michael Paddock; Andrew Grock; Fareen Zaver; Brent Thoma
Journal:  AEM Educ Train       Date:  2019-07-30

8.  Integration of a Blog into an Emergency Medicine Residency Curriculum.

Authors:  Jay Khadpe; James Willis; Mark A Silverberg; Andrew Grock; Teresa Smith
Journal:  West J Emerg Med       Date:  2015-11-12

9.  A survey of the current utilization of asynchronous education among emergency medicine residents in the United States.

Authors:  Mike Mallin; Sarah Schlein; Shaneen Doctor; Susan Stroud; Matthew Dawson; Megan Fix
Journal:  Acad Med       Date:  2014-04       Impact factor: 6.893

10.  Derivation of Two Critical Appraisal Scores for Trainees to Evaluate Online Educational Resources: A METRIQ Study.

Authors:  Teresa M Chan; Brent Thoma; Keeth Krishnan; Michelle Lin; Christopher R Carpenter; Matt Astin; Kulamakan Kulasegaram
Journal:  West J Emerg Med       Date:  2016-07-26
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.