Stephen F Hall1, Patti A Groome, David L Streiner, Paula A Rochon. 1. Department of Otolaryngology, Queen's University, and Division of Cancer Care and Epidemiology, Queen's Cancer Research Institute, Queen's University, Kingston, Ontario, Canada. sfh@post.queensu.ca
Abstract
OBJECTIVE: Comorbidity indices are commonly used to stratify patients to control for treatment selection bias. The objectives here were to review the reporting of interrater reliability when studies use comorbidity indices in clinical research publications and to report the interrater reliability of four common indices in a particular research setting. STUDY DESIGN AND SETTING: Four trained abstractors reviewed the same 40 charts of patients with squamous cell carcinoma of the head and neck from a regional cancer center. Scores for the Charlson Index, the Index of Co-existent Disease, the Cumulative Illness Rating Scale, and the Kaplan-Feinstein Classification were calculated, and the intraclass correlation coefficient was used to assess interrater reliability. RESULTS: The details on the training of abstractors and the results of interrater reliability tests are not commonly reported. In our study setting, the Charlson Index had excellent reliability and the others had acceptable reliability. CONCLUSION: If the quality of a study using an index or scale is to be assessed, the reliability and interrater reliability of the score assignment process should be reported.
OBJECTIVE: Comorbidity indices are commonly used to stratify patients to control for treatment selection bias. The objectives here were to review the reporting of interrater reliability when studies use comorbidity indices in clinical research publications and to report the interrater reliability of four common indices in a particular research setting. STUDY DESIGN AND SETTING: Four trained abstractors reviewed the same 40 charts of patients with squamous cell carcinoma of the head and neck from a regional cancer center. Scores for the Charlson Index, the Index of Co-existent Disease, the Cumulative Illness Rating Scale, and the Kaplan-Feinstein Classification were calculated, and the intraclass correlation coefficient was used to assess interrater reliability. RESULTS: The details on the training of abstractors and the results of interrater reliability tests are not commonly reported. In our study setting, the Charlson Index had excellent reliability and the others had acceptable reliability. CONCLUSION: If the quality of a study using an index or scale is to be assessed, the reliability and interrater reliability of the score assignment process should be reported.
Authors: Jan Schmolders; Max J Friedrich; Robert Michel; Andreas C Strauss; Matthias D Wimmer; Thomas M Randau; Peter H Pennekamp; Dieter C Wirtz; Sascha Gravius Journal: Int Orthop Date: 2015-06-24 Impact factor: 3.075
Authors: Joshua D Meade; Garrett R Jackson; Michael S Schallmo; Bradley Young; Robert L Parisien; David P Trofa; Patrick M Connor; Shadley Schiffern; Nady Hamid; Bryan M Saltzman Journal: Int Orthop Date: 2022-06-06 Impact factor: 3.479
Authors: Chin-Yen Lin; Jennifer L Miller; Terry A Lennie; Martha J Biddle; Gia Mudd-Martin; Muna Hammash; Debra K Moser Journal: J Cardiovasc Nurs Date: 2020 Nov/Dec Impact factor: 2.083
Authors: William Corser; Alla Sikorskii; Ade Olomu; Manfred Stommel; Camille Proden; Margaret Holmes-Rovner Journal: BMC Health Serv Res Date: 2008-04-16 Impact factor: 2.655