BACKGROUND: The increasing influence of patient-reported outcome (PRO) measurement instruments indicates their scrutiny has never been more crucial. Above all, PRO instruments should be valid: shown to assess what they purport to assess. OBJECTIVES: To evaluate a widely used fatigue PRO instrument, highlight key issues in understanding PRO instrument validity, demonstrate limitations of those approaches and justify notable changes in the validation process. METHODS: A two-phase evaluation of the 40-item Fatigue Impact scale (FIS): a qualitative evaluation of content and face validity using expert opinion (n=30) and a modified Delphi technique; a quantitative psychometric evaluation of internal and external construct validity of data from 333 people with multiple sclerosis using traditional and modern methods. RESULTS: Qualitative evaluation did not support content or face validity of the FIS. Expert opinion agreed with the subscale placement of 23 items (58%), and classified all 40 items as being non-specific to fatigue impact. Nevertheless, standard quantitative psychometric evaluations implied, largely, FIS subscales were reliable and valid. CONCLUSIONS: Standard quantitative 'psychometric' evaluations of PRO instrument validity can be misleading. Evaluation of existing PRO instruments requires both qualitative and statistical methods. Development of new PRO instruments requires stronger conceptual underpinning, clearer definitions of the substantive variables for measurement and hypothesis-testing experimental designs.
BACKGROUND: The increasing influence of patient-reported outcome (PRO) measurement instruments indicates their scrutiny has never been more crucial. Above all, PRO instruments should be valid: shown to assess what they purport to assess. OBJECTIVES: To evaluate a widely used fatigue PRO instrument, highlight key issues in understanding PRO instrument validity, demonstrate limitations of those approaches and justify notable changes in the validation process. METHODS: A two-phase evaluation of the 40-item Fatigue Impact scale (FIS): a qualitative evaluation of content and face validity using expert opinion (n=30) and a modified Delphi technique; a quantitative psychometric evaluation of internal and external construct validity of data from 333 people with multiple sclerosis using traditional and modern methods. RESULTS: Qualitative evaluation did not support content or face validity of the FIS. Expert opinion agreed with the subscale placement of 23 items (58%), and classified all 40 items as being non-specific to fatigue impact. Nevertheless, standard quantitative psychometric evaluations implied, largely, FIS subscales were reliable and valid. CONCLUSIONS: Standard quantitative 'psychometric' evaluations of PRO instrument validity can be misleading. Evaluation of existing PRO instruments requires both qualitative and statistical methods. Development of new PRO instruments requires stronger conceptual underpinning, clearer definitions of the substantive variables for measurement and hypothesis-testing experimental designs.
Authors: Catharina Sjödahl Hammarlund; Maria H Nilsson; Markus Idvall; Scott R Rosas; Peter Hagell Journal: Qual Life Res Date: 2014-01-04 Impact factor: 4.147
Authors: Virginia Meca-Lallana; María Brañas-Pampillón; Yolanda Higueras; Antonio Candeliere-Merlicco; Yolanda Aladro-Benito; Ofir Rodríguez-De la Fuente; Elisa Salas-Alonso; Jorge Maurino; Javier Ballesteros Journal: Mult Scler J Exp Transl Clin Date: 2019-11-09
Authors: Thomas Morel; Stefan Cano; Susan J Bartlett; Caroline Gordon; Birgit Haier; Antoine Regnault; Matthias Schneider; Christian Stach; Sophie Cleanthous Journal: Rheumatology (Oxford) Date: 2022-08-03 Impact factor: 7.046