Neel M Butala1, Jordan B Strom2, Kamil F Faridi2, Dhruv S Kazi2, Yuansong Zhao3, J Matthew Brennan4, Jeffrey J Popma2, Changyu Shen2, Robert W Yeh5. 1. Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiovascular Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts; Cardiology Division, Department of Medicine, Massachusetts General Hospital, Boston, Massachusetts. 2. Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiovascular Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts. 3. University of Texas, Houston, Texas. 4. Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina. 5. Richard A. and Susan F. Smith Center for Outcomes Research in Cardiology, Division of Cardiovascular Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts. Electronic address: ryeh@bidmc.harvard.edu.
Abstract
OBJECTIVES: The aim of this study was to evaluate the performance of administrative claims in ascertaining trial clinical events committee-adjudicated outcomes in the U.S. CoreValve studies. BACKGROUND: Real-world data offer tremendous opportunity to improve outcome ascertainment in clinical trials. However, little is known about the validity of outcomes ascertained using real-world data to capture trial endpoints. METHODS: Patients enrolled in 3 pivotal trials and 2 pre-market continued-access studies evaluating transcatheter aortic valve replacement were linked to Medicare fee-for-service inpatient claims. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and kappa agreement statistic of claims to detect clinical endpoints and procedural complications in trial patients were calculated. RESULTS: Claims accurately identified trial-adjudicated deaths (sensitivity, specificity, PPV, and NPV all >99.6%; kappa 1.00). Claims had good performance in identifying trial-adjudicated permanent pacemaker implantation (sensitivity 92.2%, specificity 99.1%, PPV 96.1%, NPV 98.2%, kappa 0.93) and aortic valve reintervention (sensitivity 84.4%, specificity 99.6%, PPV 69.1%, NPV 99.8%, kappa 0.76). Claims had more modest performance in ascertaining trial-adjudicated myocardial infarction (sensitivity 63.6%, specificity 97.2%, PPV 29.9%, NPV 99.3%, kappa 0.39) and acute kidney injury (sensitivity 70.2%, specificity 85.4%, PPV 38.2%, NPV 95.7%, kappa 0.41) and the poorest performance for identifying trial-adjudicated bleeding events (sensitivity 86.4%, specificity 36.8%, PPV 35.0%, NPV 86.3%, kappa 0.16). CONCLUSIONS: Compared with trial-adjudicated outcomes, claims data performed well in ascertaining death and outcomes with procedural billing codes and more modestly in identifying other outcomes. Claims may be cautiously and selectively used to augment data collection in future cardiovascular device trials.
OBJECTIVES: The aim of this study was to evaluate the performance of administrative claims in ascertaining trial clinical events committee-adjudicated outcomes in the U.S. CoreValve studies. BACKGROUND: Real-world data offer tremendous opportunity to improve outcome ascertainment in clinical trials. However, little is known about the validity of outcomes ascertained using real-world data to capture trial endpoints. METHODS:Patients enrolled in 3 pivotal trials and 2 pre-market continued-access studies evaluating transcatheter aortic valve replacement were linked to Medicare fee-for-service inpatient claims. The sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and kappa agreement statistic of claims to detect clinical endpoints and procedural complications in trial patients were calculated. RESULTS: Claims accurately identified trial-adjudicated deaths (sensitivity, specificity, PPV, and NPV all >99.6%; kappa 1.00). Claims had good performance in identifying trial-adjudicated permanent pacemaker implantation (sensitivity 92.2%, specificity 99.1%, PPV 96.1%, NPV 98.2%, kappa 0.93) and aortic valve reintervention (sensitivity 84.4%, specificity 99.6%, PPV 69.1%, NPV 99.8%, kappa 0.76). Claims had more modest performance in ascertaining trial-adjudicated myocardial infarction (sensitivity 63.6%, specificity 97.2%, PPV 29.9%, NPV 99.3%, kappa 0.39) and acute kidney injury (sensitivity 70.2%, specificity 85.4%, PPV 38.2%, NPV 95.7%, kappa 0.41) and the poorest performance for identifying trial-adjudicated bleeding events (sensitivity 86.4%, specificity 36.8%, PPV 35.0%, NPV 86.3%, kappa 0.16). CONCLUSIONS: Compared with trial-adjudicated outcomes, claims data performed well in ascertaining death and outcomes with procedural billing codes and more modestly in identifying other outcomes. Claims may be cautiously and selectively used to augment data collection in future cardiovascular device trials.
Authors: Ole Fröbert; Bo Lagerqvist; Göran K Olivecrona; Elmir Omerovic; Thorarinn Gudnason; Michael Maeng; Mikael Aasa; Oskar Angerås; Fredrik Calais; Mikael Danielewicz; David Erlinge; Lars Hellsten; Ulf Jensen; Agneta C Johansson; Amra Kåregren; Johan Nilsson; Lotta Robertson; Lennart Sandhall; Iwar Sjögren; Ollie Ostlund; Jan Harnek; Stefan K James Journal: N Engl J Med Date: 2013-08-31 Impact factor: 91.245
Authors: E S Fisher; F S Whaley; W M Krushat; D J Malenka; C Fleming; J A Baron; D C Hsia Journal: Am J Public Health Date: 1992-02 Impact factor: 9.308
Authors: Erik Kjøller; Jørgen Hilden; Per Winkel; Søren Galatius; Niels Jørgen Frandsen; Gorm B Jensen; Jørgen Fischer Hansen; Jens Kastrup; Christian M Jespersen; Per Hildebrandt; Hans Jørn Kolmos; Christian Gluud Journal: Am Heart J Date: 2014-05-04 Impact factor: 4.749
Authors: Christoph B Olivier; Deepak L Bhatt; Sergio Leonardi; Gregg W Stone; C Michael Gibson; Ph Gabriel Steg; Christian W Hamm; Matthew D Wilson; Stacey Mangum; Matthew J Price; Jayne Prats; Harvey D White; Renato D Lopes; Robert A Harrington; Kenneth W Mahaffey Journal: Circ Cardiovasc Interv Date: 2019-07-12 Impact factor: 6.546
Authors: Patricia O Guimarães; Arun Krishnamoorthy; Lisa A Kaltenbach; Kevin J Anstrom; Mark B Effron; Daniel B Mark; Patrick L McCollam; Linda Davidson-Ray; Eric D Peterson; Tracy Y Wang Journal: JAMA Cardiol Date: 2017-07-01 Impact factor: 14.676
Authors: David H Adams; Jeffrey J Popma; Michael J Reardon; Steven J Yakubov; Joseph S Coselli; G Michael Deeb; Thomas G Gleason; Maurice Buchbinder; James Hermiller; Neal S Kleiman; Stan Chetcuti; John Heiser; William Merhi; George Zorn; Peter Tadros; Newell Robinson; George Petrossian; G Chad Hughes; J Kevin Harrison; John Conte; Brijeshwar Maini; Mubashir Mumtaz; Sharla Chenoweth; Jae K Oh Journal: N Engl J Med Date: 2014-03-29 Impact factor: 91.245
Authors: Arnold J Greenspon; Jasmine D Patel; Edmund Lau; Jorge A Ochoa; Daniel R Frisch; Reginald T Ho; Behzad B Pavri; Steven M Kurtz Journal: J Am Coll Cardiol Date: 2012-09-19 Impact factor: 24.094
Authors: Wayne D Rosamond; Lloyd E Chambless; Paul D Sorlie; Erin M Bell; Shimon Weitzman; J Clinton Smith; Aaron R Folsom Journal: Am J Epidemiol Date: 2004-12-15 Impact factor: 4.897
Authors: Jeffrey J Popma; David H Adams; Michael J Reardon; Steven J Yakubov; Neal S Kleiman; David Heimansohn; James Hermiller; G Chad Hughes; J Kevin Harrison; Joseph Coselli; Jose Diez; Ali Kafi; Theodore Schreiber; Thomas G Gleason; John Conte; Maurice Buchbinder; G Michael Deeb; Blasé Carabello; Patrick W Serruys; Sharla Chenoweth; Jae K Oh Journal: J Am Coll Cardiol Date: 2014-03-19 Impact factor: 24.094
Authors: Neel M Butala; Kamil F Faridi; Eric A Secemsky; Yang Song; Jeptha Curtis; Charles Michael Gibson; Dhruv Kazi; Changyu Shen; Robert W Yeh Journal: J Am Heart Assoc Date: 2021-03-06 Impact factor: 5.501
Authors: Enrico Longato; Barbara Di Camillo; Giovanni Sparacino; Lara Tramontan; Angelo Avogaro; Gian Paolo Fadini Journal: Cardiovasc Diabetol Date: 2021-11-13 Impact factor: 9.951
Authors: Niklas Schofer; Elke Jeschke; Janine Kröger; Henning Baberg; Volkmar Falk; Jan F Gummert; Christian W Hamm; Martin Möckel; Alina Goßling; Jürgen Malzahn; Christian Günster; Stefan Blankenberg Journal: Clin Res Cardiol Date: 2022-03-24 Impact factor: 6.138