BACKGROUND: Hospital Episode Statistics (HES) data are used to measure surgical outcomes, but its quality has been considered inferior to that of clinical databases. We compare the recording accuracy of HES, an administrative database used in the National Health Service (NHS), with that of ACS NSQIP (American College of Surgeons National Surgical Quality Improvement Program), a well-established clinical database. METHODS: 1323 patient records from our hospital, common to both databases were compared for ten surgical procedures (amputation, appendicectomy, cholecystectomy, femoral hernia repair, Hartmann's procedure, incisional hernia repair, inguinal hernia repair, long saphenous vein surgery, parathyroidectomy and umbilical hernia repair) and nine postoperative complications (acute renal failure, myocardial infarction, pneumonia, pulmonary embolism, urinary tract infection, blood transfusion, septic shock, surgical site infection and wound disruption) using text strings or ICD-10 (International Classification of Diseases) codes. κ coefficient was calculated as a measure of concordance between HES and ACS NSQIP databases. RESULTS: The databases showed perfect or very good agreement in recording a majority of surgical procedures (κ coefficient range 0.82-1.0), but there was discordance in recording postoperative complications. When HES was investigated using text string or ICD-10 code, the κ coefficient range for nine postoperative complications was 0.00-0.56, indicating poor to moderate inter-rater agreement. Concordance was even less when searched by HES coder's recommended way to record postoperative complications. CONCLUSIONS: HES poorly registers postoperative complications. Suggested improvements include addition of dates when a condition is diagnosed, agreed criteria to identify postoperative complications, specifically trained coding staff for surgery and consistent use of the coding guidance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
BACKGROUND: Hospital Episode Statistics (HES) data are used to measure surgical outcomes, but its quality has been considered inferior to that of clinical databases. We compare the recording accuracy of HES, an administrative database used in the National Health Service (NHS), with that of ACS NSQIP (American College of Surgeons National Surgical Quality Improvement Program), a well-established clinical database. METHODS: 1323 patient records from our hospital, common to both databases were compared for ten surgical procedures (amputation, appendicectomy, cholecystectomy, femoral hernia repair, Hartmann's procedure, incisional hernia repair, inguinal hernia repair, long saphenous vein surgery, parathyroidectomy and umbilical hernia repair) and nine postoperative complications (acute renal failure, myocardial infarction, pneumonia, pulmonary embolism, urinary tract infection, blood transfusion, septic shock, surgical site infection and wound disruption) using text strings or ICD-10 (International Classification of Diseases) codes. κ coefficient was calculated as a measure of concordance between HES and ACS NSQIP databases. RESULTS: The databases showed perfect or very good agreement in recording a majority of surgical procedures (κ coefficient range 0.82-1.0), but there was discordance in recording postoperative complications. When HES was investigated using text string or ICD-10 code, the κ coefficient range for nine postoperative complications was 0.00-0.56, indicating poor to moderate inter-rater agreement. Concordance was even less when searched by HES coder's recommended way to record postoperative complications. CONCLUSIONS:HES poorly registers postoperative complications. Suggested improvements include addition of dates when a condition is diagnosed, agreed criteria to identify postoperative complications, specifically trained coding staff for surgery and consistent use of the coding guidance. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Entities:
Keywords:
Adverse events, epidemiology and detection; Clinical practice guidelines; Comparative effectiveness research; Healthcare quality improvement; Quality improvement
Authors: A C Murray; S Markar; H Mackenzie; O Baser; T Wiggins; A Askari; G Hanna; O Faiz; E Mayer; C Bicknell; A Darzi; R P Kiran Journal: Surg Endosc Date: 2018-01-08 Impact factor: 4.584
Authors: MacKenzie Landin; John C Kubasiak; Scott Schimpke; Jennifer Poirier; Jonathan A Myers; Keith W Millikan; Minh B Luu Journal: Surg Endosc Date: 2016-06-28 Impact factor: 4.584
Authors: Waleed Al-Khyatt; Jemma Mytton; Benjamin H L Tan; Christopher T Aquina; Felicity Evison; Fergal J Fleming; Sandro Pasquali; Ewen A Griffiths; Ravinder S Vohra Journal: World J Surg Date: 2017-08 Impact factor: 3.352
Authors: Thomas R Palser; Adam Ceney; Alex Navarro; Simon Swift; David J Bowrey; Ian J Beckingham Journal: Surg Endosc Date: 2018-01-24 Impact factor: 4.584
Authors: Linxin Li; Lucy E Binney; Samantha Carter; Sergei A Gutnikov; Sally Beebe; Karen Bowsher-Brown; Louise E Silver; Peter M Rothwell Journal: J Am Heart Assoc Date: 2019-07-03 Impact factor: 5.501