B Farzin1, J-C Gentric2, M Pham2, S Tremblay-Paquet2, L Brosseau2, C Roy2, S Jamali1, M Chagnon3, T E Darsaut4, F Guilbert2, O Naggara5, J Raymond6. 1. Interventional Neuroradiology Laboratory, centre hospitalier de l'université de Montréal (CHUM), Research Centre, 1560 Sherbrooke east, Simard Z-12909, H2L4M1 Montreal, Quebec, Canada. 2. Service of Neuroradiology, Department of Radiology, centre hospitalier de l'université de Montréal (CHUM), Notre-Dame Hospital, 1560 Sherbrooke east, Simard Z-12909, H2L4M1 Montreal, Quebec, Canada. 3. Department of Mathematics and Statistics, université de Montréal, Faculty of Science, Pavillon André-Aisenstadt, 2920, chemin de la tour, local AA-5190, H3T 1J4 Montréal, Quebec, Canada. 4. Department of Surgery, Division of Neurosurgery, University of Alberta Hospital, Mackenzie Health Sciences Centre, 8440-112 Street, T6G 2B7 Edmonton, Alberta, Canada. 5. Inserm S894, Department of Radiology, Université Paris Descartes Sorbonne Paris Cité, centre hospitalier Sainte-Anne, 1, rue Cabanis, 75014 Paris, France. 6. Interventional Neuroradiology Laboratory, centre hospitalier de l'université de Montréal (CHUM), Research Centre, 1560 Sherbrooke east, Simard Z-12909, H2L4M1 Montreal, Quebec, Canada; Service of Neuroradiology, Department of Radiology, centre hospitalier de l'université de Montréal (CHUM), Notre-Dame Hospital, 1560 Sherbrooke east, Simard Z-12909, H2L4M1 Montreal, Quebec, Canada. Electronic address: jean.raymond@umontreal.ca.
Abstract
PURPOSE: The goal of this study was to estimate the frequency and the quality of agreement studies published in diagnostic imaging journals. MATERIALS AND METHODS: All studies published between January 2011 and December 2012 in four radiology journals were reviewed. Four trained readers evaluated agreement studies using a 24-item form that included the 15 items of the Guidelines for Reporting Reliability and Agreement Studies criteria. RESULTS: Of 2229 source titles, 280 studies (13%) reported agreement. The mean number of patients per study was 81±99 (SD) (range, 0-180). Justification for sample size was found in 9 studies (3%). The number of raters was≤2 in 226 studies (81%). No intra-observer study was performed in 212 (76%) articles. Confidence intervals and interpretation of statistical estimates were provided in 98 (35%) and 147 (53%) of the studies, respectively. In 168 studies (60%), the agreement study was not mentioned in the discussion section. In 8 studies (3%), reporting of the agreement study was judged to be adequate. Twenty studies (7%) were dedicated to agreement. CONCLUSION: Agreement studies are preliminary and not adequately reported. Studies dedicated to agreement are infrequent. They are research opportunities that should be promoted.
PURPOSE: The goal of this study was to estimate the frequency and the quality of agreement studies published in diagnostic imaging journals. MATERIALS AND METHODS: All studies published between January 2011 and December 2012 in four radiology journals were reviewed. Four trained readers evaluated agreement studies using a 24-item form that included the 15 items of the Guidelines for Reporting Reliability and Agreement Studies criteria. RESULTS: Of 2229 source titles, 280 studies (13%) reported agreement. The mean number of patients per study was 81±99 (SD) (range, 0-180). Justification for sample size was found in 9 studies (3%). The number of raters was≤2 in 226 studies (81%). No intra-observer study was performed in 212 (76%) articles. Confidence intervals and interpretation of statistical estimates were provided in 98 (35%) and 147 (53%) of the studies, respectively. In 168 studies (60%), the agreement study was not mentioned in the discussion section. In 8 studies (3%), reporting of the agreement study was judged to be adequate. Twenty studies (7%) were dedicated to agreement. CONCLUSION: Agreement studies are preliminary and not adequately reported. Studies dedicated to agreement are infrequent. They are research opportunities that should be promoted.
Authors: L Letourneau-Guillon; B Farzin; T E Darsaut; M Kotowski; F Guilbert; M Chagnon; A Diouf; D Roy; A Weill; M Lemus; C Bard; M Belair; D Landry; L Nico; A Tellier; R Jabre; C Kauffmann; J Raymond Journal: AJNR Am J Neuroradiol Date: 2020-03-26 Impact factor: 3.825
Authors: Maya S Krasnow; John F Griffin; Jonathan M Levine; Wilfried Mai; Theresa E Pancotto; Marc Kent; Thomas R Harcourt-Brown; Sheila C Carrera-Justiz; Lindsey J Gilmour; Amanda E Masciarelli; Nicholas D Jeffery Journal: J Vet Intern Med Date: 2021-12-03 Impact factor: 3.333
Authors: Oscar Han; Hao Wei Tan; Steven Julious; Laura Sutton; Richard Jacques; Ellen Lee; Jen Lewis; Stephen Walters Journal: BMC Med Res Methodol Date: 2022-09-19 Impact factor: 4.612