Georgios D Kitsios1, Issa J Dahabreh, Sean Callahan, Jessica K Paulus, Anthony C Campagna, James M Dargin. 1. 1Division of Pulmonary, Allergy, and Critical Care Medicine, University of Pittsburgh Medical Center, Pittsburgh, PA. 2Center for Evidence-Based Medicine, School of Public Health, Brown University, Providence, RI. 3Department of Health Services, Policy & Practice, School of Public Health, Brown University, Providence, RI. 4Division Pulmonary, Critical Care, Allergy, and Sleep, Medical University of South Carolina, Charleston, SC. 5Predictive Analytics and Comparative Effectiveness Center, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA. 6Department of Pulmonary and Critical Care Medicine, Lahey Hospital and Medical Center, Burlington, MA.
Abstract
OBJECTIVE: To assess the degree of agreement between propensity score studies and randomized clinical trials in critical care research. DATA SOURCES: Propensity score studies published in highly cited critical care or general medicine journals or included in a previous systematic review; corresponding randomized clinical trials included in Cochrane Systematic Reviews or published in PubMed. STUDY SELECTION: We identified propensity score studies of the effects of therapeutic interventions on short- or long-term mortality. We systematically matched propensity score studies to randomized clinical trials based on patient selection criteria, interventions, and outcomes. DATA EXTRACTION: We appraised the methods of included studies and extracted treatment effect estimates to compare the results of propensity score studies and randomized clinical trials. When multiple studies were identified for the same topic, we performed meta-analyses to obtain summary treatment effect estimates. DATA SYNTHESIS: We matched 21 propensity score studies with 58 randomized clinical trials in 18 distinct comparisons (median, one propensity score study and two randomized clinical trials per comparison), for short- and long-term mortality. We found one statistically significant difference between designs (hyperoncotic albumin vs crystalloid fluids) among these 18 comparisons. Propensity score studies did not produce systematically higher (or lower) treatment effect estimates compared with randomized clinical trials, but estimates from the two designs differed by more than 30% in one third of the comparisons examined. Observational studies in critical care met widely accepted methodological standards for propensity score analyses. CONCLUSIONS: Across diverse critical care topics, propensity score studies published in high-impact journals produced results that were generally consistent with the findings of randomized clinical trials. However, caution is needed when interpreting propensity score studies because occasionally their results contradict those of randomized clinical trials and there is no reliable way to predict disagreements.
OBJECTIVE: To assess the degree of agreement between propensity score studies and randomized clinical trials in critical care research. DATA SOURCES: Propensity score studies published in highly cited critical care or general medicine journals or included in a previous systematic review; corresponding randomized clinical trials included in Cochrane Systematic Reviews or published in PubMed. STUDY SELECTION: We identified propensity score studies of the effects of therapeutic interventions on short- or long-term mortality. We systematically matched propensity score studies to randomized clinical trials based on patient selection criteria, interventions, and outcomes. DATA EXTRACTION: We appraised the methods of included studies and extracted treatment effect estimates to compare the results of propensity score studies and randomized clinical trials. When multiple studies were identified for the same topic, we performed meta-analyses to obtain summary treatment effect estimates. DATA SYNTHESIS: We matched 21 propensity score studies with 58 randomized clinical trials in 18 distinct comparisons (median, one propensity score study and two randomized clinical trials per comparison), for short- and long-term mortality. We found one statistically significant difference between designs (hyperoncotic albumin vs crystalloid fluids) among these 18 comparisons. Propensity score studies did not produce systematically higher (or lower) treatment effect estimates compared with randomized clinical trials, but estimates from the two designs differed by more than 30% in one third of the comparisons examined. Observational studies in critical care met widely accepted methodological standards for propensity score analyses. CONCLUSIONS: Across diverse critical care topics, propensity score studies published in high-impact journals produced results that were generally consistent with the findings of randomized clinical trials. However, caution is needed when interpreting propensity score studies because occasionally their results contradict those of randomized clinical trials and there is no reliable way to predict disagreements.
Authors: Jason J Rose; Mehdi Nouraie; Marc C Gauthier; Anthony F Pizon; Melissa I Saul; Michael P Donahoe; Mark T Gladwin Journal: Crit Care Med Date: 2018-07 Impact factor: 7.598
Authors: Adeyinka Charles Adejumo; Donghee Kim; Umair Iqbal; Eric R Yoo; Brian C Boursiquot; George Cholankeril; Robert J Wong; Paul Y Kwo; Aijaz Ahmed Journal: J Palliat Med Date: 2019-08-09 Impact factor: 2.947
Authors: Brian M Fuller; Ian T Ferguson; Nicholas M Mohr; Anne M Drewry; Christopher Palmer; Brian T Wessman; Enyo Ablordeppey; Jacob Keeperman; Robert J Stephens; Cristopher C Briscoe; Angelina A Kolomiets; Richard S Hotchkiss; Marin H Kollef Journal: Ann Emerg Med Date: 2017-03-02 Impact factor: 5.721
Authors: Guowei Li; Anne Holbrook; Yanling Jin; Yonghong Zhang; Mitchell A H Levine; Lawrence Mbuagbaw; Daniel M Witt; Mark Crowther; Stuart Connolly; Chatree Chai-Adisaksopha; Zhongxiao Wan; Ji Cheng; Lehana Thabane Journal: Eur J Epidemiol Date: 2016-07-01 Impact factor: 8.082
Authors: Andrew Putnam; Kyle Carey; Alexandru Marginean; Anthony Serritella; Janet Friant; John Blair; Atman Shah; Sandeep Nathan; Matthew Churpek; Jonathan Paul Journal: J Thromb Thrombolysis Date: 2021-05-25 Impact factor: 2.300