E Hanisch1, T F Weigel2, A Buia3, H-P Bruch4. 1. Asklepios Klinik Langen, Röntgenstr 20, 63225, Langen, Deutschland. e.hanisch@asklepios.com. 2. Heilig-Geist-Hospital Bingen, Bingen, Deutschland. 3. Asklepios Klinik Langen, Röntgenstr 20, 63225, Langen, Deutschland. 4. Berufsverband der Deutschen Chirurgen, Langenbeck-Virchow-Haus, Berlin, Deutschland.
Abstract
BACKGROUND: The assessment of the quality of medical practice is a legitimate requirement by society. Reliable methods for measurement of the quality of performance are sought worldwide. Quality is often quantified by using administrative data and in Germany this method has been implemented by the health insurance company AOK. OBJECTIVES: (1) How is the AOK quality system rated by senior consultant surgeons? (2) How valid are quality statements derived from administrative data? METHODS: This article was compiled following the PRISMA (i.e. preferred reporting items for systematic reviews and meta-analyses) statement for qualitative systematic reviews. In order to answer the first question the Professional Association of German Surgeons (Berufsverband der Deutschen Chirurgen) initiated two surveys and to answer the second question a structured literature search following the PICO (i.e. patient problem or population, intervention, comparison control or comparator and outcomes) format was initiated. In addition numerous websites were contacted. RESULTS: Of the responding senior consultant surgeons 95% considered that the AOK method of quality measurement by administrative data is not objective. One third was definitely wrongly classified. The literature search revealed that no validation data exist for the AOK indicators, including the Elixhauser comorbidity risk score. Altogether, the sensitivity of indicators is poor when good sensitivity is defined by the Institute for Applied Quality Improvement and Research in Health Care (AQUA Institute) as ≥ 80 < 90%. CONCLUSIONS: Quality statements resulting from administrative data alone are unreliable.
BACKGROUND: The assessment of the quality of medical practice is a legitimate requirement by society. Reliable methods for measurement of the quality of performance are sought worldwide. Quality is often quantified by using administrative data and in Germany this method has been implemented by the health insurance company AOK. OBJECTIVES: (1) How is the AOK quality system rated by senior consultant surgeons? (2) How valid are quality statements derived from administrative data? METHODS: This article was compiled following the PRISMA (i.e. preferred reporting items for systematic reviews and meta-analyses) statement for qualitative systematic reviews. In order to answer the first question the Professional Association of German Surgeons (Berufsverband der Deutschen Chirurgen) initiated two surveys and to answer the second question a structured literature search following the PICO (i.e. patient problem or population, intervention, comparison control or comparator and outcomes) format was initiated. In addition numerous websites were contacted. RESULTS: Of the responding senior consultant surgeons 95% considered that the AOK method of quality measurement by administrative data is not objective. One third was definitely wrongly classified. The literature search revealed that no validation data exist for the AOK indicators, including the Elixhauser comorbidity risk score. Altogether, the sensitivity of indicators is poor when good sensitivity is defined by the Institute for Applied Quality Improvement and Research in Health Care (AQUA Institute) as ≥ 80 < 90%. CONCLUSIONS: Quality statements resulting from administrative data alone are unreliable.
Authors: Lawrence So; Cynthia A Beck; Susan Brien; James Kennedy; Thomas E Feasby; William A Ghali Journal: Health Informatics J Date: 2010-06 Impact factor: 2.681
Authors: Haytham M A Kaafarani; Ann M Borzecki; Kamal M F Itani; Susan Loveland; Hillary J Mull; Kathleen Hickson; Sally Macdonald; Marlena Shin; Amy K Rosen Journal: J Am Coll Surg Date: 2010-12-14 Impact factor: 6.113
Authors: Garth H Utter; Patricia A Zrelak; Ruth Baron; Daniel J Tancredi; Banafsheh Sadeghi; Jeffrey J Geppert; Patrick S Romano Journal: Surgery Date: 2013-09-26 Impact factor: 3.982
Authors: Alessandro Liberati; Douglas G Altman; Jennifer Tetzlaff; Cynthia Mulrow; Peter C Gøtzsche; John P A Ioannidis; Mike Clarke; P J Devereaux; Jos Kleijnen; David Moher Journal: BMJ Date: 2009-07-21
Authors: Raymund E Horch; Werner Hohenberger; Klaus Weber; Andreas Arkudas; Justus P Beier Journal: Int J Colorectal Dis Date: 2016-03-15 Impact factor: 2.571