Marianne Jossen1, Fabio Valeri2, Christina Heilmaier3, David Schwappach4,5. 1. EQUAM Foundation, Effingerstrasse 25, 3008, Bern, Switzerland. marianne.jossen@icloud.com. 2. Institute of Primary Care, University of Zurich and University Hospital of Zurich, Pestalozzistrasse 24, 8091, Zurich, Switzerland. 3. Department of Diagnostic and Interventional Radiology, University Hospital Zurich, Raemistrasse 100, 8091, Zurich, Switzerland. 4. Swiss Patient Safety Foundation, Asylstrasse 77, 8032, Zurich, Switzerland. 5. Institute for Social and Preventive Medicine (ISPM), University Bern, Finkenhubelweg 11, 3012, Bern, Switzerland.
Abstract
INTRODUCTION: Safe practice and safety culture are important issues in outpatient diagnostic imaging services. As questionnaires assessing safety culture through the measurement of safety climate in this setting are not yet available, the present study aimed to develop and validate such an instrument. MATERIALS AND METHODS: After adaptation of an existing questionnaire and qualitative pretesting, the instrument was tested by collaborators from three outpatient imaging services in Switzerland. Results were first assessed using descriptive statistics. Scores of individual services were compared using a Wilcoxon test assessing differences between rank distributions. The final instrument was tested for validity using inter-rater agreement measures, such as reliability within groups (rWG), and an intraclass correlation coefficient measure (ICC(1)). These measures allowed the assessment of validity of aggregation into a total score (rWG(j)) and validated the instrument for its capacity to distinguish various safety climates of different groups by comparing inter-rater agreement in the overall sample to inter-rater agreement of individual services (rWG) and by measuring group effects (ICC(1)). Furthermore, the final instrument was tested for internal consistency and reliability using Cronbach's Alpha. RESULTS: Safety climate scores vary significantly between services. Inter-rater agreement measures show that item aggregation is justified and that the instrument distinguishes various patterns of safety climate. The final instrument proves to be valid, consistent and reliable. CONCLUSIONS: The final instrument presents a valid, consistent and reliable option to measure safety climate in outpatient diagnostic imaging services. Results can be used as a basis for quality improvement. KEY POINTS: • An adapted questionnaire that assesses safety climate in outpatient diagnostic imaging services was developed and tested in Switzerland. • Psychometric evaluation showed the questionnaire to be a valid, consistent and reliable instrument. • Results are of interest for imaging services as well as for stakeholders interested more globally in monitoring and quality improvement.
INTRODUCTION: Safe practice and safety culture are important issues in outpatient diagnostic imaging services. As questionnaires assessing safety culture through the measurement of safety climate in this setting are not yet available, the present study aimed to develop and validate such an instrument. MATERIALS AND METHODS: After adaptation of an existing questionnaire and qualitative pretesting, the instrument was tested by collaborators from three outpatient imaging services in Switzerland. Results were first assessed using descriptive statistics. Scores of individual services were compared using a Wilcoxon test assessing differences between rank distributions. The final instrument was tested for validity using inter-rater agreement measures, such as reliability within groups (rWG), and an intraclass correlation coefficient measure (ICC(1)). These measures allowed the assessment of validity of aggregation into a total score (rWG(j)) and validated the instrument for its capacity to distinguish various safety climates of different groups by comparing inter-rater agreement in the overall sample to inter-rater agreement of individual services (rWG) and by measuring group effects (ICC(1)). Furthermore, the final instrument was tested for internal consistency and reliability using Cronbach's Alpha. RESULTS: Safety climate scores vary significantly between services. Inter-rater agreement measures show that item aggregation is justified and that the instrument distinguishes various patterns of safety climate. The final instrument proves to be valid, consistent and reliable. CONCLUSIONS: The final instrument presents a valid, consistent and reliable option to measure safety climate in outpatient diagnostic imaging services. Results can be used as a basis for quality improvement. KEY POINTS: • An adapted questionnaire that assesses safety climate in outpatient diagnostic imaging services was developed and tested in Switzerland. • Psychometric evaluation showed the questionnaire to be a valid, consistent and reliable instrument. • Results are of interest for imaging services as well as for stakeholders interested more globally in monitoring and quality improvement.
Entities:
Keywords:
Organisational culture; Outpatient service; Psychometrics; Safety; Surveys and questionnaires
Authors: John B Sexton; Robert L Helmreich; Torsten B Neilands; Kathy Rowan; Keryn Vella; James Boyden; Peter R Roberts; Eric J Thomas Journal: BMC Health Serv Res Date: 2006-04-03 Impact factor: 2.655