Nanne Bos1, Steve Sizmur, Chris Graham, Henk F van Stel. 1. Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Heidelberglaan 100, Utrecht, The Netherlands. n.bos-2@umcutrecht.nl
Abstract
BACKGROUND: The National Health Service National Patient Survey Programme systematically gathers patients' experiences about the care they have recently received. Prioritising quality improvement activities in the accident and emergency (A&E) department requires that survey outcomes are meaningful and reliable. We aimed to determine which method of obtaining summary scores for the A&E department questionnaire optimally combined good interpretability with robust psychometric characteristics. METHODS: A&E department questionnaire data from 151 hospital trusts were analysed, covering 49 646 patients. Three methods of grouping and summarising items of the questionnaire were compared: principal components analysis (PCA); Department of Health dimensions; sections according to the patient's journey through the A&E department. The patient-level reliability of summary scores was determined by Cronbach's α coefficients (threshold: α>0.70), construct validity by Pearson's correlation coefficients, and the discriminative capacity by intra-class correlation coefficients (ICCs) and reliability of A&E-level mean scores. RESULTS: The PCA provided the best score reliability on six clear and interpretable composites: waiting time; doctors and nurses; your care and treatment; hygiene; information before discharge; overall. The discriminative power of the concepts was comparable for the three methods, with ICCs between 0.010 and 0.061. A&E sample sizes were adequate to obtain good to excellent reliability of A&E-level mean scores. CONCLUSIONS: The A&E department questionnaire is a valid and reliable questionnaire to assess patients' experiences with the A&E. The discriminative power of six summary scores offers a reliable comparison of healthcare performance between A&Es to increase patient centredness and quality of care.
BACKGROUND: The National Health Service National Patient Survey Programme systematically gathers patients' experiences about the care they have recently received. Prioritising quality improvement activities in the accident and emergency (A&E) department requires that survey outcomes are meaningful and reliable. We aimed to determine which method of obtaining summary scores for the A&E department questionnaire optimally combined good interpretability with robust psychometric characteristics. METHODS: A&E department questionnaire data from 151 hospital trusts were analysed, covering 49 646 patients. Three methods of grouping and summarising items of the questionnaire were compared: principal components analysis (PCA); Department of Health dimensions; sections according to the patient's journey through the A&E department. The patient-level reliability of summary scores was determined by Cronbach's α coefficients (threshold: α>0.70), construct validity by Pearson's correlation coefficients, and the discriminative capacity by intra-class correlation coefficients (ICCs) and reliability of A&E-level mean scores. RESULTS: The PCA provided the best score reliability on six clear and interpretable composites: waiting time; doctors and nurses; your care and treatment; hygiene; information before discharge; overall. The discriminative power of the concepts was comparable for the three methods, with ICCs between 0.010 and 0.061. A&E sample sizes were adequate to obtain good to excellent reliability of A&E-level mean scores. CONCLUSIONS: The A&E department questionnaire is a valid and reliable questionnaire to assess patients' experiences with the A&E. The discriminative power of six summary scores offers a reliable comparison of healthcare performance between A&Es to increase patient centredness and quality of care.
Authors: Nanne Bos; Ian J Seccombe; Leontien M Sturms; Rebecca Stellato; Augustinus J P Schrijvers; Henk F van Stel Journal: Health Expect Date: 2014-10-09 Impact factor: 3.377
Authors: Marjolein N T Kremers; Elsemieke E M Mols; Yvonne A E Simons; Sander M J van Kuijk; Frits Holleman; Prabath W B Nanayakkara; Harm R Haak Journal: PLoS One Date: 2020-12-01 Impact factor: 3.240