Miriam Luhnen1,2, Barbara Prediger3, Edmund A M Neugebauer4,5, Tim Mathes2. 1. Department of Medicine, Faculty of Health, Witten/Herdecke University, Cologne, Germany. 2. International Affairs Unit, Institute for Quality and Efficiency in Health Care (IQWiG), Cologne, Germany. 3. Institute for Research in Operative Medicine, Witten/Herdecke University, Cologne, Germany. 4. Brandenburg Medical School - Theodor Fontane, Faculty of Health, Neuruppin, Germany. 5. Interdisciplinary Centre for Health Services Research, Witten/Herdecke University, Witten, Germany.
Abstract
INTRODUCTION: The number of systematic reviews of health economic evaluations (SR-HEs) is increasing. We aimed at providing a detailed overview of the characteristics and applied methods in recently published SR-HEs. METHODS: We searched MEDLINE (03/2017) for SR-HEs published since 2015 using validated search filters. We included studies that performed a systematic review of full economic evaluations and searched at least one electronic database. We extracted data in a standardized, beforehand piloted form that was deduced from the items of the PRISMA and CHEERS checklists. Data were extracted by one reviewer, and a 10% random sample was verified by a second. We prepared descriptive statistical measures to describe the SR-HEs. RESULTS: We included 202 SR-HEs. We identified similarities especially in the methods for information retrieval. Study selection, data extraction, and assessment of quality and transferability were frequently not reported or performed without taking measures to reduce errors (eg, independent study selection). A wide range of different tools was applied for critical appraisal. Moreover, the reporting of included economic evaluations and the synthesis of their results showed strong variations. CONCLUSIONS: Overall, we identified few common features in the applied methods for SR-HEs. The information retrieval processes are largely standardized, but many studies did not use validated search filters. For the other systematic review steps, the methodological approaches varied. In particular, important challenges seem to be the methodological quality and transferability assessment as well as presentation and (quantitative) synthesis of results. Efforts are needed for increasing standardization, quality of applied methods, and reporting of SR-HEs.
INTRODUCTION: The number of systematic reviews of health economic evaluations (SR-HEs) is increasing. We aimed at providing a detailed overview of the characteristics and applied methods in recently published SR-HEs. METHODS: We searched MEDLINE (03/2017) for SR-HEs published since 2015 using validated search filters. We included studies that performed a systematic review of full economic evaluations and searched at least one electronic database. We extracted data in a standardized, beforehand piloted form that was deduced from the items of the PRISMA and CHEERS checklists. Data were extracted by one reviewer, and a 10% random sample was verified by a second. We prepared descriptive statistical measures to describe the SR-HEs. RESULTS: We included 202 SR-HEs. We identified similarities especially in the methods for information retrieval. Study selection, data extraction, and assessment of quality and transferability were frequently not reported or performed without taking measures to reduce errors (eg, independent study selection). A wide range of different tools was applied for critical appraisal. Moreover, the reporting of included economic evaluations and the synthesis of their results showed strong variations. CONCLUSIONS: Overall, we identified few common features in the applied methods for SR-HEs. The information retrieval processes are largely standardized, but many studies did not use validated search filters. For the other systematic review steps, the methodological approaches varied. In particular, important challenges seem to be the methodological quality and transferability assessment as well as presentation and (quantitative) synthesis of results. Efforts are needed for increasing standardization, quality of applied methods, and reporting of SR-HEs.