James P A McCullough1,2, Jeffrey Lipman3, Jeffrey J Presneill4,5. 1. Department of Intensive Care, Gold Coast University Hospital, Gold Coast, QLD, Australia. 2. University of Queensland, Brisbane, QLD, Australia. 3. The George Institute for Global Health, University of Sydney, Sydney, NSW, Australia. 4. Intensive Care Unit, The Royal Melbourne Hospital, Melbourne, VIC, Australia. 5. University of Melbourne and Monash University, Melbourne, VIC, Australia.
Abstract
OBJECTIVES: Incomplete biostatistical knowledge among clinicians is widely described. This study aimed to categorize and summarize the statistical methodology within recent critical care randomized controlled trials. DESIGN: Descriptive analysis, with comparison of findings to previous work. SETTING: Ten high-impact clinical journals publishing trials in critical illness. SUBJECTS: Randomized controlled trials published between 2011 and 2015 inclusive. INTERVENTIONS: Data extraction from published reports. MEASUREMENTS AND MAIN RESULTS: The frequency and overall proportion of each statistical method encountered, grouped according to those used to generate each trial's primary outcome and separately according to underlying statistical methodology. Subsequent analysis compared these proportions with previously published reports. A total of 580 statistical tests or methods were identified within 116 original randomized controlled trials published between 2011 and 2015. Overall, the chi-square test was the most commonly encountered (70/116; 60%), followed by the Cox proportional hazards model (63/116; 54%) and logistic regression (53/116; 46%). When classified according to underlying statistical assumptions, the most common types of analyses were tests of 2 × 2 contingency tables and nonparametric tests of rank order. A greater proportion of more complex methodology was observed compared with trial reports from previous work. CONCLUSIONS: Physicians assessing recent randomized controlled trials in critical illness encounter results derived from a substantial and potentially expanding range of biostatistical methods. In-depth training in the assumptions and limitations of these current and emerging biostatistical methods may not be practically achievable for most clinicians, making accessible specialist biostatistical support an asset to evidence-based clinical practice.
OBJECTIVES: Incomplete biostatistical knowledge among clinicians is widely described. This study aimed to categorize and summarize the statistical methodology within recent critical care randomized controlled trials. DESIGN: Descriptive analysis, with comparison of findings to previous work. SETTING: Ten high-impact clinical journals publishing trials in critical illness. SUBJECTS: Randomized controlled trials published between 2011 and 2015 inclusive. INTERVENTIONS: Data extraction from published reports. MEASUREMENTS AND MAIN RESULTS: The frequency and overall proportion of each statistical method encountered, grouped according to those used to generate each trial's primary outcome and separately according to underlying statistical methodology. Subsequent analysis compared these proportions with previously published reports. A total of 580 statistical tests or methods were identified within 116 original randomized controlled trials published between 2011 and 2015. Overall, the chi-square test was the most commonly encountered (70/116; 60%), followed by the Cox proportional hazards model (63/116; 54%) and logistic regression (53/116; 46%). When classified according to underlying statistical assumptions, the most common types of analyses were tests of 2 × 2 contingency tables and nonparametric tests of rank order. A greater proportion of more complex methodology was observed compared with trial reports from previous work. CONCLUSIONS: Physicians assessing recent randomized controlled trials in critical illness encounter results derived from a substantial and potentially expanding range of biostatistical methods. In-depth training in the assumptions and limitations of these current and emerging biostatistical methods may not be practically achievable for most clinicians, making accessible specialist biostatistical support an asset to evidence-based clinical practice.
Authors: Katherine J Lee; Margarita Moreno-Betancur; Jessica Kasza; Ian C Marschner; Adrian G Barnett; John B Carlin Journal: Med J Aust Date: 2019-10-27 Impact factor: 7.738