OBJECTIVE: The purpose of this paper is to introduce researchers to the measurement and subsequent analysis considerations involved when using externally rated data. We will define and describe two categories of externally rated data, recommend methodological approaches for analyzing and interpreting data in these two categories, and explore factors affecting agreement between self-rated and externally rated reports. We conclude with a discussion of needs for future research. DATA SOURCES/STUDY SETTING: Data sources for this paper are previous published studies and reviews comparing self-rated with externally rated data. STUDY DESIGN/DATA COLLECTION/EXTRACTION METHODS: This is a psychometric conceptual paper. PRINCIPAL FINDINGS: We define two types of externally rated data: proxy data and other-rated data. Proxy data refer to those collected from someone who speaks for a patient who cannot, will not, or is unavailable to speak for him or herself, whereas we use the term other-rater data to refer to situations in which the researcher collects ratings from a person other than the patient to gain multiple perspectives on the assessed construct. These two types of data differ in the way the measurement model is defined, the definition of the gold standard against which the measurements are validated, the analysis strategies appropriately used, and how the analyses are interpreted. There are many factors affecting the discrepancies between self- and external ratings, including characteristics of the patient, the proxy, and of the rated construct. Several psychological theories can be helpful in predicting such discrepancies. CONCLUSIONS: Externally rated data have an important place in health services research, but use of such data requires careful consideration of the nature of the data and how it will be analyzed and interpreted.
OBJECTIVE: The purpose of this paper is to introduce researchers to the measurement and subsequent analysis considerations involved when using externally rated data. We will define and describe two categories of externally rated data, recommend methodological approaches for analyzing and interpreting data in these two categories, and explore factors affecting agreement between self-rated and externally rated reports. We conclude with a discussion of needs for future research. DATA SOURCES/STUDY SETTING: Data sources for this paper are previous published studies and reviews comparing self-rated with externally rated data. STUDY DESIGN/DATA COLLECTION/EXTRACTION METHODS: This is a psychometric conceptual paper. PRINCIPAL FINDINGS: We define two types of externally rated data: proxy data and other-rated data. Proxy data refer to those collected from someone who speaks for a patient who cannot, will not, or is unavailable to speak for him or herself, whereas we use the term other-rater data to refer to situations in which the researcher collects ratings from a person other than the patient to gain multiple perspectives on the assessed construct. These two types of data differ in the way the measurement model is defined, the definition of the gold standard against which the measurements are validated, the analysis strategies appropriately used, and how the analyses are interpreted. There are many factors affecting the discrepancies between self- and external ratings, including characteristics of the patient, the proxy, and of the rated construct. Several psychological theories can be helpful in predicting such discrepancies. CONCLUSIONS: Externally rated data have an important place in health services research, but use of such data requires careful consideration of the nature of the data and how it will be analyzed and interpreted.
Authors: Nallini Gnanadesigan; Debra Saliba; Carol P Roth; David H Solomon; John T Chang; John Schnelle; Rick Smith; Paul G Shekelle; Neil S Wenger Journal: J Am Med Dir Assoc Date: 2004 May-Jun Impact factor: 4.669
Authors: Eric J Boldingh; Monique A Jacobs-van der Bruggen; Gustaaf J Lankhorst; Lex M Bouter Journal: Arch Phys Med Rehabil Date: 2004-05 Impact factor: 3.966
Authors: Franz Porzsolt; Marina Kojer; Martina Schmidl; Elfriede R Greimel; Jörg Sigle; Joerg Richter; Martin Eisemann Journal: Health Qual Life Outcomes Date: 2004-02-19 Impact factor: 3.186
Authors: A Lynn Snow; Cashuna Huddleston; Christina Robinson; Mark E Kunik; Amber L Bush; Nancy Wilson; Jessica Calleo; Amber Paukert; Cynthia Kraus-Schuman; Nancy J Petersen; Melinda A Stanley Journal: Aging Ment Health Date: 2012-02-28 Impact factor: 3.658
Authors: Tara Clinton-McHarg; Mariko Carey; Rob Sanson-Fisher; Anthony Shakeshaft; Kathy Rainbird Journal: Health Qual Life Outcomes Date: 2010-03-06 Impact factor: 3.186
Authors: Sophie Martin; Clémence Mazzocco; Pascale Maury; Anne Grosselin; Wim Van der Elst; Roger A Dixon; Denis Brouillet Journal: Arch Gerontol Geriatr Date: 2014-10-22 Impact factor: 3.250