Importance: Pragmatic clinical trial designs have proposed the use of medical claims data to ascertain clinical events; however, the accuracy of billed diagnoses in identifying potential events is unclear. Objectives: To compare the 1-year cumulative incidences of events when events were identified by medical claims vs by physician adjudication and to assess the accuracy of bill-identified events using physician adjudication as the criterion standard. Design, Setting, and Participants: This post hoc analysis of a clinical trial assessed the medical claims forms and records for all rehospitalizations at 233 US hospitals within 1 year of the index acute myocardial infarction (MI) of 12 365 patients enrolled in the Treatment With Adenosine Diphosphate Receptor Inhibitors: Longitudinal Assessment of Treatment Patterns and Events After Acute Coronary Syndrome (TRANSLATE-ACS) study between April 1, 2010, and October 31, 2012. Fourteen patients (0.1%) died during the index hospitalization and were excluded from analysis. Recurrent MI, stroke, and bleeding events were identified per the International Classification of Diseases, Ninth Revision, Clinical Modification diagnosis and procedural codes in medical bills. These events were independently adjudicated by study physicians through medical record reviews using the prespecified criteria of recurrent MI and stroke and the bleeding definition by the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries (GUSTO) scale. Medical claims were reported on a Uniform Bill-04 claims form; claims were collected from all hospitals visited by patients enrolled in TRANSLATE-ACS. Agreement between medical claims-identified events and physician-adjudicated events over the 12 months after discharge was assessed with the κ statistic. Data were analyzed from January 30, 2015, to March 2, 2017. Main Outcomes and Measures: Event rates within 1 year after MI. Results: Among 12 365 patients with acute MI, 8890 (71.9%) were men and mean (SD) age was 60 (11.6) years. The cumulative 1-year incidence of events identified by medical claims was 4.3% for MI, 0.9% for stroke, and 5.0% for bleeding. Incidence rates based on physician adjudication were 4.7% for MI, 0.9% for stroke, and 5.4% for bleeding. Agreement between medical claims-identified and physician-adjudicated events was modest, with a κ of 0.76 (95% CI, 0.73 to 0.79) for MI and 0.55 (95% CI, 0.41 to 0.68) for stroke events. In contrast, agreement between medical claims-identified and physician-adjudicated bleeding events was poor, with a κ of 0.24 (95% CI, 0.19 to 0.30) for any hospitalized bleeding event and 0.15 (95% CI, 0.11 to 0.20) for moderate or severe bleeding on the GUSTO scale. Conclusions and Relevance: Event rates at 1 year after MI were lower for MI, stroke, and bleeding when medical claims were used to identify events than when adjudicated by physicians. Medical claims diagnoses were only modestly accurate in identifying MI and stroke admissions but had limited accuracy for bleeding events. An alternative approach may be needed to ensure good safety surveillance in cardiovascular studies. Trial Registration: clinicaltrials.gov Identifier: NCT01088503.
Importance: Pragmatic clinical trial designs have proposed the use of medical claims data to ascertain clinical events; however, the accuracy of billed diagnoses in identifying potential events is unclear. Objectives: To compare the 1-year cumulative incidences of events when events were identified by medical claims vs by physician adjudication and to assess the accuracy of bill-identified events using physician adjudication as the criterion standard. Design, Setting, and Participants: This post hoc analysis of a clinical trial assessed the medical claims forms and records for all rehospitalizations at 233 US hospitals within 1 year of the index acute myocardial infarction (MI) of 12 365 patients enrolled in the Treatment With Adenosine Diphosphate Receptor Inhibitors: Longitudinal Assessment of Treatment Patterns and Events After Acute Coronary Syndrome (TRANSLATE-ACS) study between April 1, 2010, and October 31, 2012. Fourteen patients (0.1%) died during the index hospitalization and were excluded from analysis. Recurrent MI, stroke, and bleeding events were identified per the International Classification of Diseases, Ninth Revision, Clinical Modification diagnosis and procedural codes in medical bills. These events were independently adjudicated by study physicians through medical record reviews using the prespecified criteria of recurrent MI and stroke and the bleeding definition by the Global Utilization of Streptokinase and Tissue Plasminogen Activator for Occluded Coronary Arteries (GUSTO) scale. Medical claims were reported on a Uniform Bill-04 claims form; claims were collected from all hospitals visited by patients enrolled in TRANSLATE-ACS. Agreement between medical claims-identified events and physician-adjudicated events over the 12 months after discharge was assessed with the κ statistic. Data were analyzed from January 30, 2015, to March 2, 2017. Main Outcomes and Measures: Event rates within 1 year after MI. Results: Among 12 365 patients with acute MI, 8890 (71.9%) were men and mean (SD) age was 60 (11.6) years. The cumulative 1-year incidence of events identified by medical claims was 4.3% for MI, 0.9% for stroke, and 5.0% for bleeding. Incidence rates based on physician adjudication were 4.7% for MI, 0.9% for stroke, and 5.4% for bleeding. Agreement between medical claims-identified and physician-adjudicated events was modest, with a κ of 0.76 (95% CI, 0.73 to 0.79) for MI and 0.55 (95% CI, 0.41 to 0.68) for stroke events. In contrast, agreement between medical claims-identified and physician-adjudicated bleeding events was poor, with a κ of 0.24 (95% CI, 0.19 to 0.30) for any hospitalized bleeding event and 0.15 (95% CI, 0.11 to 0.20) for moderate or severe bleeding on the GUSTO scale. Conclusions and Relevance: Event rates at 1 year after MI were lower for MI, stroke, and bleeding when medical claims were used to identify events than when adjudicated by physicians. Medical claims diagnoses were only modestly accurate in identifying MI and stroke admissions but had limited accuracy for bleeding events. An alternative approach may be needed to ensure good safety surveillance in cardiovascular studies. Trial Registration: clinicaltrials.gov Identifier: NCT01088503.
Authors: Robert J Mentz; Adrian F Hernandez; Lisa G Berdan; Tyrus Rorick; Emily C O'Brien; Jenny C Ibarra; Lesley H Curtis; Eric D Peterson Journal: Circulation Date: 2016-03-01 Impact factor: 29.690
Authors: Kamakshi Lakshminarayan; Joseph C Larson; Beth Virnig; Candace Fuller; Norrina Bai Allen; Marian Limacher; Wolfgang C Winkelmayer; Monika M Safford; Dale R Burwen Journal: Stroke Date: 2014-02-13 Impact factor: 7.914
Authors: Hiraku Kumamaru; Suzanne E Judd; Jeffrey R Curtis; Rekha Ramachandran; N Chantelle Hardy; J David Rhodes; Monika M Safford; Brett M Kissela; George Howard; Jessica J Jalbert; Thomas G Brott; Soko Setoguchi Journal: Circ Cardiovasc Qual Outcomes Date: 2014-06-24
Authors: Bruce M Psaty; Joseph A Delaney; Alice M Arnold; Lesley H Curtis; Annette L Fitzpatrick; Susan R Heckbert; Barbara McKnight; Diane Ives; John S Gottdiener; Lewis H Kuller; W T Longstreth Journal: Circulation Date: 2015-11-04 Impact factor: 29.690
Authors: Mark A Hlatky; Roberta M Ray; Dale R Burwen; Karen L Margolis; Karen C Johnson; Anna Kucharska-Newton; JoAnn E Manson; Jennifer G Robinson; Monika M Safford; Matthew Allison; Themistocles L Assimes; Anthony A Bavry; Jeffrey Berger; Rhonda M Cooper-DeHoff; Susan R Heckbert; Wenjun Li; Simin Liu; Lisa W Martin; Marco V Perez; Hilary A Tindle; Wolfgang C Winkelmayer; Marcia L Stefanick Journal: Circ Cardiovasc Qual Outcomes Date: 2014-01-07
Authors: Kenneth W Mahaffey; Robert A Harrington; Martijn Akkerhuis; Neal S Kleiman; Lisa G Berdan; Brian S Crenshaw; Barbara E Tardiff; Christopher B Granger; Ingrid DeJong; Manju Bhapkar; Petr Widimsky; Ramón Corbalon; Kerry L Lee; Jaap W Deckers; Maarten L Simoons; Eric J Topol; Robert M Califf Journal: Curr Control Trials Cardiovasc Med Date: 2001-07-17
Authors: Arun Krishnamoorthy; Eric D Peterson; J David Knight; Kevin J Anstrom; Mark B Effron; Marjorie E Zettler; Linda Davidson-Ray; Brian A Baker; Patrick L McCollam; Daniel B Mark; Tracy Y Wang Journal: J Am Heart Assoc Date: 2016-01-25 Impact factor: 5.501
Authors: Jordan B Strom; Varsha K Tanguturi; Sherif F Nagueh; Allan L Klein; Warren J Manning Journal: J Am Soc Echocardiogr Date: 2019-09-25 Impact factor: 5.251
Authors: Jordan B Strom; Yuansong Zhao; Kamil F Faridi; Hector Tamez; Neel M Butala; Linda R Valsdottir; Jeptha Curtis; J Matthew Brennan; Changyu Shen; Mike Boulware; Jeffrey J Popma; Robert W Yeh Journal: Circ Cardiovasc Interv Date: 2019-11-07 Impact factor: 6.546
Authors: Neel M Butala; Jordan B Strom; Kamil F Faridi; Dhruv S Kazi; Yuansong Zhao; J Matthew Brennan; Jeffrey J Popma; Changyu Shen; Robert W Yeh Journal: JACC Cardiovasc Interv Date: 2020-07-15 Impact factor: 11.195
Authors: Jordan B Strom; Kamil F Faridi; Neel M Butala; Yuansong Zhao; Hector Tamez; Linda R Valsdottir; J Matthew Brennan; Changyu Shen; Jeffrey J Popma; Dhruv S Kazi; Robert W Yeh Journal: Circulation Date: 2020-05-21 Impact factor: 29.690
Authors: Angela Lowenstern; Steven J Lippmann; J Matthew Brennan; Tracy Y Wang; Lesley H Curtis; Ted Feldman; Donald D Glower; Bradley G Hammill; Sreekanth Vemulapalli Journal: Circ Cardiovasc Interv Date: 2019-05 Impact factor: 6.546
Authors: Emily C O'Brien; Shuang Li; Laine Thomas; Tracy Y Wang; Matthew T Roe; Eric D Peterson Journal: Clin Cardiol Date: 2018-09-22 Impact factor: 2.882
Authors: Jordan B Strom; Hector Tamez; Yuansong Zhao; Linda R Valsdottir; Jeptha Curtis; J Matthew Brennan; Changyu Shen; Jeffrey J Popma; Laura Mauri; Robert W Yeh Journal: Am Heart J Date: 2019-03-06 Impact factor: 4.749
Authors: Marc B Rosenman; Elissa Oh; Christopher T Richards; Scott Mendelson; Julia Lee; Jane L Holl; Andrew M Naidech; Shyam Prabhakaran Journal: Neurol Clin Pract Date: 2020-04