Monika Jurkeviciute1, Amia Enam2,3, Johanna Torres-Bonilla4,5, Henrik Eriksson2. 1. Centre for Healthcare Improvement (CHI), Chalmers University of Technology, Vera Sandbergs allé 8, 41296, Gothenburg, Sweden. monika.jurkeviciute@chalmers.se. 2. Centre for Healthcare Improvement (CHI), Chalmers University of Technology, Vera Sandbergs allé 8, 41296, Gothenburg, Sweden. 3. NTNU, Sentralbygg 1, Gløshaugen, Alfred Getz vei 3, Trondheim, Norway. 4. Centre for Healthcare Improvement (CHI), Chalmers University of Technology, Vera Sandbergs allé 8, 41296, Gothenburg, Sweden. torresj@alumni.chalmers.se. 5. , Pasaje De Los Virreyes N27-35 y Calle Selva Alegre, 170520, Quito, Ecuador. torresj@alumni.chalmers.se.
Abstract
BACKGROUND: Summative eHealth evaluations frequently lack quality, which affects the generalizability of the evidence, and its use in practice and further research. To guarantee quality, a number of activities are recommended in the guidelines for evaluation planning. This study aimed to examine a case of an eHealth evaluation planning in a multi-national and interdisciplinary setting and to provide recommendations for eHealth evaluation planning guidelines. METHODS: An empirical eHealth evaluation process was developed through a case study. The empirical process was compared with selected guidelines for eHealth evaluation planning using a pattern-matching technique. RESULTS: Planning in the interdisciplinary and multi-national team demanded extensive negotiation and alignment to support the future use of the evidence created. The evaluation planning guidelines did not provide specific strategies for different set-ups of the evaluation teams. Further, they did not address important aspects of quality evaluation, such as feasibility analysis of the outcome measures and data collection, monitoring of data quality, and consideration of the methods and measures employed in similar evaluations. CONCLUSIONS: Activities to prevent quality problems need to be incorporated in the guidelines for evaluation planning. Additionally, evaluators could benefit from guidance in evaluation planning related to the different set-ups of the evaluation teams.
BACKGROUND: Summative eHealth evaluations frequently lack quality, which affects the generalizability of the evidence, and its use in practice and further research. To guarantee quality, a number of activities are recommended in the guidelines for evaluation planning. This study aimed to examine a case of an eHealth evaluation planning in a multi-national and interdisciplinary setting and to provide recommendations for eHealth evaluation planning guidelines. METHODS: An empirical eHealth evaluation process was developed through a case study. The empirical process was compared with selected guidelines for eHealth evaluation planning using a pattern-matching technique. RESULTS: Planning in the interdisciplinary and multi-national team demanded extensive negotiation and alignment to support the future use of the evidence created. The evaluation planning guidelines did not provide specific strategies for different set-ups of the evaluation teams. Further, they did not address important aspects of quality evaluation, such as feasibility analysis of the outcome measures and data collection, monitoring of data quality, and consideration of the methods and measures employed in similar evaluations. CONCLUSIONS: Activities to prevent quality problems need to be incorporated in the guidelines for evaluation planning. Additionally, evaluators could benefit from guidance in evaluation planning related to the different set-ups of the evaluation teams.
Authors: Martin R Cowie; Jeroen Bax; Nico Bruining; John G F Cleland; Friedrich Koehler; Marek Malik; Fausto Pinto; Enno van der Velde; Panos Vardas Journal: Eur Heart J Date: 2015-08-24 Impact factor: 29.983