BACKGROUND: Validity evidence based on response processes was first introduced explicitly as a source of validity evidence in the latest edition of Standards for Educational and Psychological Testing. In this paper, we present the theory, the relationship with other sources of validity evidence, and the methods available for validation studies aimed at obtaining validity evidence about response processes. METHOD: A comprehensive review of the literature along with theoretical and practical proposals. RESULTS: The articles provides arguments for determining when validity evidence based on response processes is critical for supporting the use of the test for a particular purpose, and examples of how to perform a validation study to obtain such validity evidence. CONCLUSIONS: There are methods for obtaining validity evidence based on response processes. Special attention should be paid to validation studies using the cognitive interview method given its features and possibilities. Future research problems pose how to combine data from different methods -qualitative and quantitative-, to develop complete validity arguments that support the use of the test for a particular purpose.
BACKGROUND: Validity evidence based on response processes was first introduced explicitly as a source of validity evidence in the latest edition of Standards for Educational and Psychological Testing. In this paper, we present the theory, the relationship with other sources of validity evidence, and the methods available for validation studies aimed at obtaining validity evidence about response processes. METHOD: A comprehensive review of the literature along with theoretical and practical proposals. RESULTS: The articles provides arguments for determining when validity evidence based on response processes is critical for supporting the use of the test for a particular purpose, and examples of how to perform a validation study to obtain such validity evidence. CONCLUSIONS: There are methods for obtaining validity evidence based on response processes. Special attention should be paid to validation studies using the cognitive interview method given its features and possibilities. Future research problems pose how to combine data from different methods -qualitative and quantitative-, to develop complete validity arguments that support the use of the test for a particular purpose.
Authors: Quira Zeidan; Jennifer Loertscher; Adele J Wolfson; John T Tansey; Erika G Offerdahl; Peter J Kennelly; Daniel R Dries; Victoria Del Gaizo Moore; Diane M Dean; L Michael Carastro; Sachel M Villafañe; Ludmila Tyler Journal: CBE Life Sci Educ Date: 2021-06 Impact factor: 3.325