OBJECTIVE: Administrative databases of hospital admissions are increasingly being used, mostly without validation, for epidemiological and clinical outcomes studies. Although it has been difficult to assess the true accuracy of administrative databases, we have identified an opportunity to directly compare the State of Maryland administrative database against a prospectively maintained departmental database at The Johns Hopkins Hospital. METHODS: Data for patients with the diagnosis of an intracranial aneurysm treated at The Johns Hopkins Hospital over a 17-year period were compared in the State of Maryland administrative database and the neurosurgery departmental database. Discrepancies were clarified by review of the original medical records. The sensitivity, specificity, and positive predictive value of each database were calculated. RESULTS: The administrative database missed 16% of all cases and was significantly inaccurate in 10 of 12 categories. It had particularly low values in the specificity regarding surgical treatment (67%), the sensitivity regarding endovascular treatment (48%), and the positive predictive value regarding endovascular treatment (30%). By contrast, the lowest score of the departmental database in any category was 97%. CONCLUSION: We show that this representative administrative database is significantly flawed. Given the exponentially increasing number of research studies based on administrative databases, the pitfalls of research based solely on these need to be recognized. Strong criteria requiring accurate data validation are critical to justify the conclusions of these studies, regardless of their large numbers and complex statistics.
OBJECTIVE: Administrative databases of hospital admissions are increasingly being used, mostly without validation, for epidemiological and clinical outcomes studies. Although it has been difficult to assess the true accuracy of administrative databases, we have identified an opportunity to directly compare the State of Maryland administrative database against a prospectively maintained departmental database at The Johns Hopkins Hospital. METHODS: Data for patients with the diagnosis of an intracranial aneurysm treated at The Johns Hopkins Hospital over a 17-year period were compared in the State of Maryland administrative database and the neurosurgery departmental database. Discrepancies were clarified by review of the original medical records. The sensitivity, specificity, and positive predictive value of each database were calculated. RESULTS: The administrative database missed 16% of all cases and was significantly inaccurate in 10 of 12 categories. It had particularly low values in the specificity regarding surgical treatment (67%), the sensitivity regarding endovascular treatment (48%), and the positive predictive value regarding endovascular treatment (30%). By contrast, the lowest score of the departmental database in any category was 97%. CONCLUSION: We show that this representative administrative database is significantly flawed. Given the exponentially increasing number of research studies based on administrative databases, the pitfalls of research based solely on these need to be recognized. Strong criteria requiring accurate data validation are critical to justify the conclusions of these studies, regardless of their large numbers and complex statistics.
Authors: Christopher M Horvat; Henry Ogoe; Sajel Kantawala; Alicia K Au; Ericka L Fink; Eric Yablonsky; Patrick M Kochanek; Srinivasan Suresh; Robert S B Clark Journal: Pediatr Crit Care Med Date: 2019-08 Impact factor: 3.624
Authors: James Feghali; Jennifer Kim; Abhishek Gami; Sarah Rapaport; Justin M Caplan; Cameron G McDougall; Judy Huang; Rafael J Tamargo; Christopher M Jackson Journal: Neurosurg Rev Date: 2021-04-10 Impact factor: 3.042
Authors: Henry E Rice; Brian R Englum; Brian C Gulack; Obinna O Adibe; Elizabeth T Tracy; Susan G Kreissman; Jonathan C Routh Journal: Pediatr Blood Cancer Date: 2015-03-21 Impact factor: 3.167
Authors: Rachel Grossman; Debraj Mukherjee; David C Chang; Michael Purtell; Michael Lim; Henry Brem; Alfredo Quiñones-Hinojosa Journal: Ann Surg Oncol Date: 2010-08-31 Impact factor: 5.344
Authors: Hadie Adams; Kaisorn L Chaichana; Javier Avendaño; Brian Liu; Shaan M Raza; Alfredo Quiñones-Hinojosa Journal: World Neurosurg Date: 2013-02-06 Impact factor: 2.104