BACKGROUND: Meta-analysis of registries (comparative effectiveness research) shows that primary angioplasty and fibrinolysis have equivalent real-world survival. Yet, randomized, controlled trials consistently find primary angioplasty superior. Can unequal allocation of higher-risk patients in registries have masked primary angioplasty benefit? METHODS AND RESULTS: First, we constructed a model to demonstrate the potential effect of allocation bias. We then analyzed published registries (55022 patients) for allocation of higher-risk patients (Killip class ≥1) to determine whether the choice of reperfusion therapy was affected by the risk level of the patient. Meta-regression was used to examine the relationship between differences in allocation of high-risk patient to primary angioplasty or fibrinolysis and mortality. Initial modeling suggested that registry outcomes are sensitive to allocation bias of high-risk patients. Across the registries, the therapy receiving excess high-risk patients had worse mortality. Unequal distribution of high-risk status accounted for most of the between-registry variance (adjusted R(2)(meta)=83.1%). Accounting for differential allocation of higher-risk patients, primary angioplasty gave 22% lower mortality (odds ratio, 0.78; 95% confidence interval, 0.64-0.97; P=0.029). We derive a formula, called the number needed to abolish, highlighting situations in which comparative effectiveness studies are particularly vulnerable to this bias. CONCLUSIONS: In ST-segment elevation myocardial infarction, clinicians' preference for management of a few high-risk patients can shift mortality substantially. Comparative effectiveness research in any disease is vulnerable to this, especially diseases with an immediately identifiable high-risk subgroup that clinicians prefer to allocate to 1 therapy. For this reason, preliminary indications from registry-based comparative effectiveness research should be definitively tested by randomized, controlled trials.
BACKGROUND: Meta-analysis of registries (comparative effectiveness research) shows that primary angioplasty and fibrinolysis have equivalent real-world survival. Yet, randomized, controlled trials consistently find primary angioplasty superior. Can unequal allocation of higher-risk patients in registries have masked primary angioplasty benefit? METHODS AND RESULTS: First, we constructed a model to demonstrate the potential effect of allocation bias. We then analyzed published registries (55022 patients) for allocation of higher-risk patients (Killip class ≥1) to determine whether the choice of reperfusion therapy was affected by the risk level of the patient. Meta-regression was used to examine the relationship between differences in allocation of high-risk patient to primary angioplasty or fibrinolysis and mortality. Initial modeling suggested that registry outcomes are sensitive to allocation bias of high-risk patients. Across the registries, the therapy receiving excess high-risk patients had worse mortality. Unequal distribution of high-risk status accounted for most of the between-registry variance (adjusted R(2)(meta)=83.1%). Accounting for differential allocation of higher-risk patients, primary angioplasty gave 22% lower mortality (odds ratio, 0.78; 95% confidence interval, 0.64-0.97; P=0.029). We derive a formula, called the number needed to abolish, highlighting situations in which comparative effectiveness studies are particularly vulnerable to this bias. CONCLUSIONS: In ST-segment elevation myocardial infarction, clinicians' preference for management of a few high-risk patients can shift mortality substantially. Comparative effectiveness research in any disease is vulnerable to this, especially diseases with an immediately identifiable high-risk subgroup that clinicians prefer to allocate to 1 therapy. For this reason, preliminary indications from registry-based comparative effectiveness research should be definitively tested by randomized, controlled trials.
Authors: Graham D Cole; Matthew J Shun-Shin; Alexandra N Nowbar; Kevin G Buell; Faisal Al-Mayahi; David Zargaran; Saliha Mahmood; Bharpoor Singh; Michael Mielewczik; Darrel P Francis Journal: Int J Epidemiol Date: 2015-07-13 Impact factor: 7.196
Authors: Liza Chacko; James P Howard; Christopher Rajkumar; Alexandra N Nowbar; Christopher Kane; Dina Mahdi; Michael Foley; Matthew Shun-Shin; Graham Cole; Sayan Sen; Rasha Al-Lamee; Darrel P Francis; Yousif Ahmad Journal: Circ Cardiovasc Qual Outcomes Date: 2020-02-17