Carrie R Houts1, Elizabeth Nicole Bush2, Michael C Edwards3, R J Wirth3. 1. Vector Psychometric Group, LLC, Chapel Hill, USA. crhouts@vpgcentral.com. 2. Eli Lilly & Company, Indianapolis, USA. 3. Vector Psychometric Group, LLC, Chapel Hill, USA.
Abstract
BACKGROUND: Scale development is a complex activity requiring significant investments of time and money to produce evidence of a scale's ability to produce reliable scores and valid inferences. With increasing use of clinical outcome assessments (COAs) in medical product development, evidentiary expectations of regulatory bodies to support inferences are a key consideration. The goal of this paper is to demonstrate how existing methods in measurement science can be used to identify and fill evidence gaps when considering re-purposing an existing scale for a new use case (e.g., new patient population, altering the recall period), rather than creating a new COA tool. METHODS: We briefly review select validity theory and psychometric concepts, linking them to the nomenclature in the COA/regulated space. Four examples (two in-text and two in online supplemental materials) of modifications are presented to demonstrate these ideas in practice for quality of life (QOL)-related measures. RESULTS: Each example highlights the initial process of evaluating the desired validity claims, identifying gaps in evidence to support these claims, and determining how such gaps could be filled, often without having to develop a new measure. CONCLUSIONS: If an existing scale, with minimal modification or additional evidence, can be shown to be fit for a new purpose, considerable effort can be saved and research waste avoided. In many cases, a new instrument is simply unnecessary. Far better to recycle an "old" scale for a new use-with sufficient evidence that it is fit for that purpose-than to "buy" a new one.
BACKGROUND: Scale development is a complex activity requiring significant investments of time and money to produce evidence of a scale's ability to produce reliable scores and valid inferences. With increasing use of clinical outcome assessments (COAs) in medical product development, evidentiary expectations of regulatory bodies to support inferences are a key consideration. The goal of this paper is to demonstrate how existing methods in measurement science can be used to identify and fill evidence gaps when considering re-purposing an existing scale for a new use case (e.g., new patient population, altering the recall period), rather than creating a new COA tool. METHODS: We briefly review select validity theory and psychometric concepts, linking them to the nomenclature in the COA/regulated space. Four examples (two in-text and two in online supplemental materials) of modifications are presented to demonstrate these ideas in practice for quality of life (QOL)-related measures. RESULTS: Each example highlights the initial process of evaluating the desired validity claims, identifying gaps in evidence to support these claims, and determining how such gaps could be filled, often without having to develop a new measure. CONCLUSIONS: If an existing scale, with minimal modification or additional evidence, can be shown to be fit for a new purpose, considerable effort can be saved and research waste avoided. In many cases, a new instrument is simply unnecessary. Far better to recycle an "old" scale for a new use-with sufficient evidence that it is fit for that purpose-than to "buy" a new one.
Authors: Donald M Bushnell; Kelly P McCarrier; Elizabeth Nicole Bush; Lucy Abraham; Carol Jamieson; Fiona McDougall; Madhukar H Trivedi; Michael E Thase; Linda Carpenter; Stephen Joel Coons Journal: Value Health Date: 2019-05-17 Impact factor: 5.725
Authors: Anthony L Vaccarino; Kenneth R Evans; Amir H Kalali; Sidney H Kennedy; Nina Engelhardt; Benicio N Frey; John H Greist; Kenneth A Kobak; Raymond W Lam; Glenda MacQueen; Roumen Milev; Franca M Placenza; Arun V Ravindran; David V Sheehan; Terrence Sills; Janet B W Williams Journal: Innov Clin Neurosci Date: 2016-10-01