Feifei Ye1, Layla Parast2, Ron D Hays3, Marc N Elliott2, Kirsten Becker2, William G Lehrman4, Debra Stark4, Steven Martino1. 1. RAND Corporation, Pittsburgh, Pennsylvania, USA. 2. RAND Corporation, Santa Monica, California, USA. 3. Department of Medicine, Division of General Internal Medicine & Health Services Research, University of California, Los Angeles, California, USA. 4. Centers for Medicare & Medicaid Services, Baltimore, Maryland, USA.
Abstract
OBJECTIVES: To (1) develop a survey to assess the patient experience of care in hospital-based emergency departments (ED) and (2) evaluate the reliability and validity of composite measures of patient experience using data collected through the experimental implementation of the newly developed Emergency Department Patient Experience of Care (EDPEC) Discharged to Community (DTC) Survey. DATA SOURCE: 4893 adult patients were treated in the ED of 16 hospitals across the United States in 2018. STUDY DESIGN: The study utilized a cross-sectional survey. DATA COLLECTION: Survey development activities included a literature review, focus groups, and cognitive interviews with recently discharged ED patients, technical expert panels, and multiple field experiments. Survey development resulted in a 34-item instrument; the analysis reported here focuses on 18 items on patient experience of care. Using data from the EDPEC DTC Survey in the 2018 Feasibility Test, we performed confirmatory factor analysis to group 15 evaluative survey items into composite measures. We examined internal consistency reliability, interunit reliability, and associations between each composite measure and patients' overall rating and willingness to recommend the ED. PRINCIPAL FINDINGS: Analyses of 15 evaluative items identified four composite measures: Getting Timely Care, How Well Doctors and Nurses Communicate, Communication about Medications, and Communication about Follow-up. Patient-level internal consistency reliability exceeded 0.75 for two of four composites; ED-level internal consistency reliability exceeded 0.83 for all four composites. Interunit reliability estimates indicated that 450 survey completes per ED results in at least 0.70 reliability for all composites. Higher scores on each composite were associated with higher overall ratings and willingness to recommend the ED. CONCLUSIONS: The composite measures derived from the EDPEC DTC Survey are statistically reliable and valid. These results provide guidance for EDPEC DTC Survey adopters on how to construct meaningful and psychometrically-sound composite measures for monitoring the quality of care they provide.
OBJECTIVES: To (1) develop a survey to assess the patient experience of care in hospital-based emergency departments (ED) and (2) evaluate the reliability and validity of composite measures of patient experience using data collected through the experimental implementation of the newly developed Emergency Department Patient Experience of Care (EDPEC) Discharged to Community (DTC) Survey. DATA SOURCE: 4893 adult patients were treated in the ED of 16 hospitals across the United States in 2018. STUDY DESIGN: The study utilized a cross-sectional survey. DATA COLLECTION: Survey development activities included a literature review, focus groups, and cognitive interviews with recently discharged ED patients, technical expert panels, and multiple field experiments. Survey development resulted in a 34-item instrument; the analysis reported here focuses on 18 items on patient experience of care. Using data from the EDPEC DTC Survey in the 2018 Feasibility Test, we performed confirmatory factor analysis to group 15 evaluative survey items into composite measures. We examined internal consistency reliability, interunit reliability, and associations between each composite measure and patients' overall rating and willingness to recommend the ED. PRINCIPAL FINDINGS: Analyses of 15 evaluative items identified four composite measures: Getting Timely Care, How Well Doctors and Nurses Communicate, Communication about Medications, and Communication about Follow-up. Patient-level internal consistency reliability exceeded 0.75 for two of four composites; ED-level internal consistency reliability exceeded 0.83 for all four composites. Interunit reliability estimates indicated that 450 survey completes per ED results in at least 0.70 reliability for all composites. Higher scores on each composite were associated with higher overall ratings and willingness to recommend the ED. CONCLUSIONS: The composite measures derived from the EDPEC DTC Survey are statistically reliable and valid. These results provide guidance for EDPEC DTC Survey adopters on how to construct meaningful and psychometrically-sound composite measures for monitoring the quality of care they provide.
Authors: William Boulding; Seth W Glickman; Matthew P Manary; Kevin A Schulman; Richard Staelin Journal: Am J Manag Care Date: 2011-01 Impact factor: 2.229
Authors: Marc N Elliott; Alan M Zaslavsky; Elizabeth Goldstein; William Lehrman; Katrin Hambarsoomians; Megan K Beckett; Laura Giordano Journal: Health Serv Res Date: 2009-04 Impact factor: 3.402
Authors: Mark E Frisse; Kevin B Johnson; Hui Nian; Coda L Davison; Cynthia S Gadd; Kim M Unertl; Pat A Turri; Qingxia Chen Journal: J Am Med Inform Assoc Date: 2011-11-04 Impact factor: 4.497
Authors: Feifei Ye; Layla Parast; Ron D Hays; Marc N Elliott; Kirsten Becker; William G Lehrman; Debra Stark; Steven Martino Journal: Health Serv Res Date: 2021-08-12 Impact factor: 3.402