OBJECTIVE: Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies. STUDY DESIGN AND SETTING: Eight experts in reliability and agreement investigation developed guidelines for reporting. RESULTS: Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications. CONCLUSION: The proposed guidelines intend to improve the quality of reporting.
OBJECTIVE: Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies. STUDY DESIGN AND SETTING: Eight experts in reliability and agreement investigation developed guidelines for reporting. RESULTS: Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications. CONCLUSION: The proposed guidelines intend to improve the quality of reporting.
Authors: Florence C M Reith; Ruben Van den Brande; Anneliese Synnot; Russell Gruen; Andrew I R Maas Journal: Intensive Care Med Date: 2015-11-12 Impact factor: 17.440
Authors: Philip Hansen; Finn E Johannsen; Stine Hangaard; Sandra E Stallknecht; Bjarke B Hansen; Janus D Nybing; Mikael Boesen Journal: Skeletal Radiol Date: 2015-10-28 Impact factor: 2.199
Authors: Wan Ling Lee; Karuthan Chinna; Awang Bulgiba; Khatijah Lim Abdullah; Imran Zainal Abidin; Stefan Höfer Journal: Qual Life Res Date: 2015-08-09 Impact factor: 4.147
Authors: Anass Benomar; Behzad Farzin; David Volders; Guylaine Gevry; Justine Zehr; Robert Fahed; William Boisseau; Jean-Christophe Gentric; Elsa Magro; Lorena Nico; Daniel Roy; Alain Weill; Charbel Mounayer; François Guilbert; Laurent Létourneau-Guillon; Gregory Jacquin; Chiraz Chaalala; Marc Kotowski; Thanh N Nguyen; David Kallmes; Phil White; Tim E Darsaut; Jean Raymond Journal: Neuroradiology Date: 2021-02-24 Impact factor: 2.804
Authors: Robbert W van Hamersvelt; Martin J Willemink; Richard A P Takx; Anouk L M Eikendal; Ricardo P J Budde; Tim Leiner; Christian P Mol; Ivana Isgum; Pim A de Jong Journal: Eur Radiol Date: 2014-05-10 Impact factor: 5.315
Authors: Carlos Oliver Valderrama-Molina; Mauricio Estrada-Castrillón; Jorge Andrés Hincapie; Luz Helena Lugo-Agudelo Journal: Colomb Med (Cali) Date: 2014-12-30
Authors: Maarten W Barentsz; Valentina Taviani; Jung M Chang; Debra M Ikeda; Kanae K Miyake; Suchandrima Banerjee; Maurice A A J van den Bosch; Brian A Hargreaves; Bruce L Daniel Journal: J Magn Reson Imaging Date: 2015-04-24 Impact factor: 4.813
Authors: David J Wallace; Jeremy M Kahn; Derek C Angus; Christian Martin-Gill; Clifton W Callaway; Thomas D Rea; Jagpreet Chhatwal; Kristen Kurland; Christopher W Seymour Journal: Acad Emerg Med Date: 2014-01 Impact factor: 3.451