Zhongheng Zhang1, Hongying Ni2, Xiao Xu3. 1. Department of Critical Care Medicine, Jinhua Municipal Central Hospital, Jinhua Hospital of Zhejiang University. Electronic address: zh_zhang1984@hotmail.com. 2. Department of Critical Care Medicine, Jinhua Municipal Central Hospital, Jinhua Hospital of Zhejiang University. Electronic address: nihongying2@163.com. 3. Department of Critical Care Medicine, Jinhua Municipal Central Hospital, Jinhua Hospital of Zhejiang University. Electronic address: xwqxx@163.com.
Abstract
BACKGROUND AND OBJECTIVES: Sepsis is a leading cause of mortality and morbidity in the intensive care unit, and many studies have been conducted aiming to improve its outcome. Randomized controlled trials (RCTs) and observational studies using propensity score (PS) method are commonly used for this purpose. However, the agreement between these two major methodological designs has never been investigated in this specific area. The present study aimed to compare the effect sizes between RCTs and PS-based studies. METHODS: Electronic databases including Pubmed, Scopus, and EBSCO were searched to obtain PS-based studies in the area of sepsis. The studies were matched to RCTs or systematic reviews and meta-analysis in terms of population, intervention, control, and outcome. When there were multiple PS-based studies or RCTs in one area, the effect sizes were pooled by using random-effects model and inverse variance method. The comparisons were performed by using differences in the effect size. RESULTS: A total of 8 topics were identified fulfilling the criterion that at least 1 pair of RCT and PS-based study could be matched. The interventions included activated protein C, low-dose steroid, antithrombin III, combination antibiotic therapy, fish oil supplementation, statin, etomidate for intubation, and recombinant human soluble thrombomodulin. The effect sizes were statistically different between RCTs and PS-based studies in most circumstances (6/8). The pooled mean difference in effect sizes was -0.16 (95% confidence interval, -0.33 to 0.01), indicating a trend towards larger treatment effect in PS studies than in RCTs. The result remains unaltered by restricting to RCTs and PS studies with the largest sample sizes. CONCLUSION: Our study shows that PS studies tend to report larger treatment effect than RCTs in the field of sepsis, indicating the difference between efficacy trials and effectiveness studies.
BACKGROUND AND OBJECTIVES:Sepsis is a leading cause of mortality and morbidity in the intensive care unit, and many studies have been conducted aiming to improve its outcome. Randomized controlled trials (RCTs) and observational studies using propensity score (PS) method are commonly used for this purpose. However, the agreement between these two major methodological designs has never been investigated in this specific area. The present study aimed to compare the effect sizes between RCTs and PS-based studies. METHODS: Electronic databases including Pubmed, Scopus, and EBSCO were searched to obtain PS-based studies in the area of sepsis. The studies were matched to RCTs or systematic reviews and meta-analysis in terms of population, intervention, control, and outcome. When there were multiple PS-based studies or RCTs in one area, the effect sizes were pooled by using random-effects model and inverse variance method. The comparisons were performed by using differences in the effect size. RESULTS: A total of 8 topics were identified fulfilling the criterion that at least 1 pair of RCT and PS-based study could be matched. The interventions included activated protein C, low-dose steroid, antithrombin III, combination antibiotic therapy, fish oil supplementation, statin, etomidate for intubation, and recombinant human soluble thrombomodulin. The effect sizes were statistically different between RCTs and PS-based studies in most circumstances (6/8). The pooled mean difference in effect sizes was -0.16 (95% confidence interval, -0.33 to 0.01), indicating a trend towards larger treatment effect in PS studies than in RCTs. The result remains unaltered by restricting to RCTs and PS studies with the largest sample sizes. CONCLUSION: Our study shows that PS studies tend to report larger treatment effect than RCTs in the field of sepsis, indicating the difference between efficacy trials and effectiveness studies.
Authors: Myura Nagendran; Daniel F McAuley; Peter S Kruger; Laurent Papazian; Jonathon D Truwit; John G Laffey; B Taylor Thompson; Mike Clarke; Anthony C Gordon Journal: Intensive Care Med Date: 2016-12-21 Impact factor: 17.440
Authors: Zhongheng Zhang; Yucai Hong; Nathan J Smischney; Han-Pin Kuo; Panagiotis Tsirigotis; Jordi Rello; Win Sen Kuan; Christian Jung; Chiara Robba; Fabio Silvio Taccone; Marc Leone; Herbert Spapen; David Grimaldi; Sven Van Poucke; Steven Q Simpson; Patrick M Honore; Stefan Hofer; Pietro Caironi Journal: J Thorac Dis Date: 2017-02 Impact factor: 2.895
Authors: Guowei Li; Anne Holbrook; Yanling Jin; Yonghong Zhang; Mitchell A H Levine; Lawrence Mbuagbaw; Daniel M Witt; Mark Crowther; Stuart Connolly; Chatree Chai-Adisaksopha; Zhongxiao Wan; Ji Cheng; Lehana Thabane Journal: Eur J Epidemiol Date: 2016-07-01 Impact factor: 8.082