Peter H Van Ness1, Virginia R Towle, Manisha Juthani-Mehta. 1. Yale University School of Medicine, Department of Internal Medicine, Program on Aging, 300 George Street, Suite 775, New Haven, Connecticut 06511, USA. peter.vanness@yale.edu
Abstract
OBJECTIVE: The authors recommend confidence intervals as measures of precision for reliability coefficients, regression modeling as supplements for such omnibus reliability statistics, and unreliability detection as a goal of reliability testing distinct from reliability inference. METHODS: Illustrative reliability analyses are conducted on measures selected from a study of clinical features associated with urinary tract infection in older nursing home residents. RESULTS: Standard methods for reliability testing (e.g., kappa coefficients) are often inappropriate for small samples, and exact methods or descriptive reliability statistics are viable alternatives. DISCUSSION: Supplementation of omnibus statistics by loglinear regression modeling is especially appropriate for aging research because it facilitates tests of marginal homogeneity and comparisons of reliability results for relatively young and old subgroups. Latent class regression analysis is useful for older samples because multifactorial health conditions are often measured in multiple ways and assessment of their reliability can be integrated, granting certain assumptions, with validity assessment.
OBJECTIVE: The authors recommend confidence intervals as measures of precision for reliability coefficients, regression modeling as supplements for such omnibus reliability statistics, and unreliability detection as a goal of reliability testing distinct from reliability inference. METHODS: Illustrative reliability analyses are conducted on measures selected from a study of clinical features associated with urinary tract infection in older nursing home residents. RESULTS: Standard methods for reliability testing (e.g., kappa coefficients) are often inappropriate for small samples, and exact methods or descriptive reliability statistics are viable alternatives. DISCUSSION: Supplementation of omnibus statistics by loglinear regression modeling is especially appropriate for aging research because it facilitates tests of marginal homogeneity and comparisons of reliability results for relatively young and old subgroups. Latent class regression analysis is useful for older samples because multifactorial health conditions are often measured in multiple ways and assessment of their reliability can be integrated, granting certain assumptions, with validity assessment.
Authors: E W Ely; S K Inouye; G R Bernard; S Gordon; J Francis; L May; B Truman; T Speroff; S Gautam; R Margolin; R P Hart; R Dittus Journal: JAMA Date: 2001-12-05 Impact factor: 56.272
Authors: Mallika L Mendu; Andrew Lundquist; Ayal A Aizer; David E Leaf; Emily Robinson; David J R Steele; Sushrut S Waikar Journal: JAMA Intern Med Date: 2015-05 Impact factor: 21.873
Authors: Mallika L Mendu; Andrew Lundquist; Ayal A Aizer; David E Leaf; Emily Robinson; David J R Steele; Sushrut S Waikar Journal: Nephrology (Carlton) Date: 2016-10 Impact factor: 2.506