OBJECTIVE: Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies. STUDY DESIGN AND SETTING: Eight experts in reliability and agreement investigation developed guidelines for reporting. RESULTS: Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications. CONCLUSION: The proposed guidelines intend to improve the quality of reporting.
OBJECTIVE: Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies. STUDY DESIGN AND SETTING: Eight experts in reliability and agreement investigation developed guidelines for reporting. RESULTS: Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications. CONCLUSION: The proposed guidelines intend to improve the quality of reporting.
Authors: Sabine Ivison; Mehrnoush Malek; Rosa V Garcia; Raewyn Broady; Anne Halpin; Manon Richaud; Rollin F Brant; Szu-I Wang; Mathieu Goupil; Qingdong Guan; Peter Ashton; Jason Warren; Amr Rajab; Simon Urschel; Deepali Kumar; Mathias Streitz; Birgit Sawitzki; Stephan Schlickeiser; Janetta J Bijl; Donna A Wall; Jean-Sebastien Delisle; Lori J West; Ryan R Brinkman; Megan K Levings Journal: JCI Insight Date: 2018-12-06
Authors: Jessica D Richardson; Sarah Grace Hudspeth Dalton; Jennifer Shafer; Janet Patterson Journal: Am J Speech Lang Pathol Date: 2016-12-01 Impact factor: 2.408