Frauke Wichmann1,2, Mirko Brandes1, Ingeborg Jahn1, Saskia Muellmann1, Manuela Peters1, Claudia Ruth Pischke3, Hajo Zeeb1,4. 1. Abt. Prävention und Evaluation, Leibniz-Institut für Präventionsforschung und Epidemiologie, Bremen. 2. Institut für Public Health und Pflegeforschung, Universität Bremen, Bremen. 3. Medizinische Fakultät, Institut für Medizinische Soziologie, Centre for Health and Society, Heinrich-Heine- Universität Düsseldorf, Düsseldorf. 4. Wissenschaftsschwerpunkt Gesundheitswissenschaften, Universität Bremen, Bremen.
Abstract
OBJECTIVES: To date, knowledge about the effects and implementation quality of disease prevention and health promotion projects in Germany is limited. Only a few structured evaluation systems exist that can be easily used and which include features for evaluating research and practice projects. The aim of the current project was to develop and carry out a pilot study of an online evaluation tool that enables structured self-evaluation of projects in disease prevention and health promotion practice and contributes to an improved documentation and cyclical development of projects. METHODS: The mixed-methods approach taken in this project included 2 steps: a) search of literature and database to develop a theoretical framework for the tool and b) adaptation process to test the fit of the tool for practice, including a focus group discussion and a usability test with different disease prevention and health promotion stakeholders (N=12). RESULTS: The resulting documentation and evaluation system (DEVASYS) is comprised of the components "planning", "documentation", and "evaluation" which can be used independently of one another. The conceptual basis of the tool is the RE-AIM framework. To determine the quality of an individual project, dimensions of both the output (reach, acceptance, implementation) and the outcome levels (effectiveness, maintenance) can be documented with the tool. CONCLUSION: DEVASYS is a practice-oriented tool contributing to an improved evaluation of existing practice-related intervention projects and the overall quality of future projects in the area of disease prevention and health promotion. Systematic dissemination and implementation of the tool are the next steps to be taken. Thieme. All rights reserved.
OBJECTIVES: To date, knowledge about the effects and implementation quality of disease prevention and health promotion projects in Germany is limited. Only a few structured evaluation systems exist that can be easily used and which include features for evaluating research and practice projects. The aim of the current project was to develop and carry out a pilot study of an online evaluation tool that enables structured self-evaluation of projects in disease prevention and health promotion practice and contributes to an improved documentation and cyclical development of projects. METHODS: The mixed-methods approach taken in this project included 2 steps: a) search of literature and database to develop a theoretical framework for the tool and b) adaptation process to test the fit of the tool for practice, including a focus group discussion and a usability test with different disease prevention and health promotion stakeholders (N=12). RESULTS: The resulting documentation and evaluation system (DEVASYS) is comprised of the components "planning", "documentation", and "evaluation" which can be used independently of one another. The conceptual basis of the tool is the RE-AIM framework. To determine the quality of an individual project, dimensions of both the output (reach, acceptance, implementation) and the outcome levels (effectiveness, maintenance) can be documented with the tool. CONCLUSION: DEVASYS is a practice-oriented tool contributing to an improved evaluation of existing practice-related intervention projects and the overall quality of future projects in the area of disease prevention and health promotion. Systematic dissemination and implementation of the tool are the next steps to be taken. Thieme. All rights reserved.