Henrica C W de Vet1, Caroline B Terwee, Dirk L Knol, Lex M Bouter. 1. Institute for Research in Extramural Medicine, VU University Medical Center, Amsterdam, Van der Boechorststraat 7, Amsterdam 1081 BT, The Netherlands. hcw.devet@vumc.nl
Abstract
BACKGROUND: Reproducibility concerns the degree to which repeated measurements provide similar results. Agreement parameters assess how close the results of the repeated measurements are, by estimating the measurement error in repeated measurements. Reliability parameters assess whether study objects, often persons, can be distinguished from each other, despite measurement errors. In that case, the measurement error is related to the variability between persons. Consequently, reliability parameters are highly dependent on the heterogeneity of the study sample, while the agreement parameters, based on measurement error, are more a pure characteristic of the measurement instrument. METHODS AND RESULTS: Using an example of an interrater study, in which different physical therapists measure the range of motion of the arm in patients with shoulder complaints, the differences and relationships between reliability and agreement parameters for continuous variables are illustrated. CONCLUSION: If the research question concerns the distinction of persons, reliability parameters are the most appropriate. But if the aim is to measure change in health status, which is often the case in clinical practice, parameters of agreement are preferred.
BACKGROUND: Reproducibility concerns the degree to which repeated measurements provide similar results. Agreement parameters assess how close the results of the repeated measurements are, by estimating the measurement error in repeated measurements. Reliability parameters assess whether study objects, often persons, can be distinguished from each other, despite measurement errors. In that case, the measurement error is related to the variability between persons. Consequently, reliability parameters are highly dependent on the heterogeneity of the study sample, while the agreement parameters, based on measurement error, are more a pure characteristic of the measurement instrument. METHODS AND RESULTS: Using an example of an interrater study, in which different physical therapists measure the range of motion of the arm in patients with shoulder complaints, the differences and relationships between reliability and agreement parameters for continuous variables are illustrated. CONCLUSION: If the research question concerns the distinction of persons, reliability parameters are the most appropriate. But if the aim is to measure change in health status, which is often the case in clinical practice, parameters of agreement are preferred.
Authors: Caroline B Terwee; Lidwine B Mokkink; Mireille N M van Poppel; Mai J M Chinapaw; Willem van Mechelen; Henrica C W de Vet Journal: Sports Med Date: 2010-07-01 Impact factor: 11.136
Authors: Petter Wilberg; Adriani Kanellopoulos; Ellen Ruud; Marianne Jensen Hjermstad; Sophie Dorothea Fosså; Bente Brokstad Herlofson Journal: Support Care Cancer Date: 2015-09-12 Impact factor: 3.603
Authors: Philip Hansen; Finn E Johannsen; Stine Hangaard; Sandra E Stallknecht; Bjarke B Hansen; Janus D Nybing; Mikael Boesen Journal: Skeletal Radiol Date: 2015-10-28 Impact factor: 2.199
Authors: B P Chumpitazi; M M Self; D I Czyzewski; S Cejka; P R Swank; R J Shulman Journal: Neurogastroenterol Motil Date: 2015-12-21 Impact factor: 3.598
Authors: Wan Ling Lee; Karuthan Chinna; Awang Bulgiba; Khatijah Lim Abdullah; Imran Zainal Abidin; Stefan Höfer Journal: Qual Life Res Date: 2015-08-09 Impact factor: 4.147