Todd C Lee1, Andrew M Morris2, Ilan S Schwartz3, Emily G McDonald4. 1. Division of Infectious Diseases, McGill University, Montreal, QC H4A 3S1, Canada; Clinical Practice Assessment Unit, McGill University, Montreal, QC H4A 3S1, Canada; Department of Medicine and Royal Victoria Hospital, McGill University, Montreal, QC H4A 3S1, Canada. Electronic address: todd.lee@mcgill.ca. 2. Division of Infectious Diseases, Department of Medicine, Sinai Health System, Toronto, ON, Canada. 3. Division of Infectious Diseases, Department of Medicine, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, AB, Canada. 4. Clinical Practice Assessment Unit, McGill University, Montreal, QC H4A 3S1, Canada; Division of General Internal Medicine, McGill University, Montreal, QC H4A 3S1, Canada; Department of Medicine and Royal Victoria Hospital, McGill University, Montreal, QC H4A 3S1, Canada.
The RECOVERY Collaborative Group has provided timely, robust evidence for managing hospitalised patients with COVID-19, including their randomised controlled trial supporting the use of tocilizumab. However, results from other smaller randomised controlled trials of tocilizumab (and sarilumab), particularly those with a placebo control group, did not show a mortality benefit of interleukin-6 inhibition versus control. In seeking to understand the totality of the data, results of any meta-analysis will be heavily weighted by RECOVERY trials, the largest population studied. A complete and nuanced understanding of the trial results is thus crucial for accurate interpretation.Although an intention-to-treat analysis is important to preserve the prognostic balance that is reached through randomisation, in the open-label RECOVERY trial, one in six (317 [16%] of 1964) allocated patients did not receive tocilizumab. A further 3% were missing data on whether or not they received tocilizumab. The authors wrote that “the size of the effects of tocilizumab reported in this paper are therefore an underestimate of the true effects”, an assertion that was echoed in Shruti Gupta and David E Leaf's Comment. This interpretation assumes that people who were allocated to but not treated with tocilizumab were as or more likely to die than those who received the drug and, furthermore, that there is no possible harm from treatment. However, if mortality in the 16% of patients who did not receive tocilizumab was lower than in the control group or the patients who were treated with tocilizumab, then the result could be biased away from the null. Fortunately, given that the data exist, we do not need to pursue the academic exercise of debating bias towards or away from the null. We respectfully request the authors to contrast the demographics, baseline clinical status, and outcomes of patients allocated to but not treated with tocilizumab with those who did receive treatment.