J Hobart1, S Cano. 1. Neurological Outcome Measures Unit, Department of Clinical Neurosciences, Peninsula College of Medicine and Dentistry, Plymouth, UK.
Abstract
OBJECTIVES: In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. REVIEW METHODS: A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. RESULTS: Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. CONCLUSIONS: There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.
OBJECTIVES: In this monograph we examine the added value of new psychometric methods (Rasch measurement and Item Response Theory) over traditional psychometric approaches by comparing and contrasting their psychometric evaluations of existing sets of rating scale data. We have concentrated on Rasch measurement rather than Item Response Theory because we believe that it is the more advantageous method for health measurement from a conceptual, theoretical and practical perspective. Our intention is to provide an authoritative document that describes the principles of Rasch measurement and the practice of Rasch analysis in a clear, detailed, non-technical form that is accurate and accessible to clinicians and researchers in health measurement. REVIEW METHODS: A comparison was undertaken of traditional and new psychometric methods in five large sets of rating scale data: (1) evaluation of the Rivermead Mobility Index (RMI) in data from 666 participants in the Cannabis in Multiple Sclerosis (CAMS) study; (2) evaluation of the Multiple Sclerosis Impact Scale (MSIS-29) in data from 1725 people with multiple sclerosis; (3) evaluation of test-retest reliability of MSIS-29 in data from 150 people with multiple sclerosis; (4) examination of the use of Rasch analysis to equate scales purporting to measure the same health construct in 585 people with multiple sclerosis; and (5) comparison of relative responsiveness of the Barthel Index and Functional Independence Measure in data from 1400 people undergoing neurorehabilitation. RESULTS: Both Rasch measurement and Item Response Theory are conceptually and theoretically superior to traditional psychometric methods. Findings from each of the five studies show that Rasch analysis is empirically superior to traditional psychometric methods for evaluating rating scales, developing rating scales, analysing rating scale data, understanding and measuring stability and change, and understanding the health constructs we seek to quantify. CONCLUSIONS: There is considerable added value in using Rasch analysis rather than traditional psychometric methods in health measurement. Future research directions include the need to reproduce our findings in a range of clinical populations, detailed head-to-head comparisons of Rasch analysis and Item Response Theory, and the application of Rasch analysis to clinical practice.
Authors: Stina Bladh; Maria H Nilsson; Gun-Marie Hariz; Albert Westergren; Jeremy Hobart; Peter Hagell Journal: J Neurol Date: 2011-09-29 Impact factor: 4.849
Authors: Catharina Sjödahl Hammarlund; Maria H Nilsson; Markus Idvall; Scott R Rosas; Peter Hagell Journal: Qual Life Res Date: 2014-01-04 Impact factor: 4.147
Authors: Stefan J Cano; Anna Mayhew; Allan M Glanzman; Kristin J Krosschell; Kathryn J Swoboda; Marion Main; Birgit F Steffensen; Carole Bérard; Françoise Girardot; Christine A M Payan; Eugenio Mercuri; Elena Mazzone; Bakri Elsheikh; Julaine Florence; Linda S Hynan; Susan T Iannaccone; Leslie L Nelson; Shree Pandya; Michael Rose; Charles Scott; Reza Sadjadi; Mackensie A Yore; Cynthia Joyce; John T Kissel Journal: Muscle Nerve Date: 2013-07-26 Impact factor: 3.217
Authors: John H Powers; Donald L Patrick; Marc K Walton; Patrick Marquis; Stefan Cano; Jeremy Hobart; Maria Isaac; Spiros Vamvakas; Ashley Slagle; Elizabeth Molsen; Laurie B Burke Journal: Value Health Date: 2017-01-10 Impact factor: 5.725
Authors: Anne F Klassen; Stefan J Cano; Roona Sinha; Areej Shahbaz; Robert Klaassen; David Dix Journal: Health Expect Date: 2013-11-28 Impact factor: 3.377