Trudy Mallinson1, Joan Stelmack, Craig Velozo. 1. Clinical Research Scientist, Center for Rehabilitation Outcomes Research, Rehabilitation Institute of Chicago, Chicago, Illinois 60611, USA. trudy@northwestern.edu
Abstract
BACKGROUND: Short-form outcomes measures are becoming common in response to demands for increased efficiency in health care. This study examines Rasch measurement as an aid to selecting items for short form tests. The focus of this paper is on maintaining test quality while reducing items. The separation ratio (SR) aids item reduction by indicating how removing items impacts measurement precision. Results of the SR and coefficient alpha are compared. OBJECTIVES: To demonstrate the use of Rasch measurement to shorten clinical outcomes measures and to compare the separation ratio and coefficient alpha in evaluating when item reduction improved efficiency without sacrificing measurement precision. RESEARCH DESIGN: Retrospective analysis of existing health outcomes data. SUBJECTS: A convenience sample of 58 patients receiving cataract surgery. MEASURES: The 14 items of the VF-14 (a measure of visual functioning), the published subset of items from this test (the VF-7), and 5 other 7-item combinations of the items. RESULTS: The largest coefficient alpha was obtained from the VF14 (.84) while the largest separation ratio (2.67) was obtained from the 7-item subtest with the reduced rating scale. CONCLUSIONS: This study demonstrated one way that Rasch measurement can be helpful in selecting items for minimum item sets while maintaining test precision. Both alpha and the separation ratio provide information about how a sample performed with a given test although variations in measurement precision may not always be detected with alpha.
BACKGROUND: Short-form outcomes measures are becoming common in response to demands for increased efficiency in health care. This study examines Rasch measurement as an aid to selecting items for short form tests. The focus of this paper is on maintaining test quality while reducing items. The separation ratio (SR) aids item reduction by indicating how removing items impacts measurement precision. Results of the SR and coefficient alpha are compared. OBJECTIVES: To demonstrate the use of Rasch measurement to shorten clinical outcomes measures and to compare the separation ratio and coefficient alpha in evaluating when item reduction improved efficiency without sacrificing measurement precision. RESEARCH DESIGN: Retrospective analysis of existing health outcomes data. SUBJECTS: A convenience sample of 58 patients receiving cataract surgery. MEASURES: The 14 items of the VF-14 (a measure of visual functioning), the published subset of items from this test (the VF-7), and 5 other 7-item combinations of the items. RESULTS: The largest coefficient alpha was obtained from the VF14 (.84) while the largest separation ratio (2.67) was obtained from the 7-item subtest with the reduced rating scale. CONCLUSIONS: This study demonstrated one way that Rasch measurement can be helpful in selecting items for minimum item sets while maintaining test precision. Both alpha and the separation ratio provide information about how a sample performed with a given test although variations in measurement precision may not always be detected with alpha.
Authors: James Stuart Wolffsohn; Jonathan Jackson; Olivia Anne Hunt; Charles Cottriall; Jennifer Lindsay; Richard Gilmour; Anne Sinclair; Robert Harper Journal: Int J Ophthalmol Date: 2014-02-18 Impact factor: 1.779
Authors: Zhiqun Tang; Ronald E Claus; Robert G Orwin; Wendy B Kissin; Carlos Arieira Journal: Drug Alcohol Depend Date: 2011-12-03 Impact factor: 4.492