Literature DB >> 35434582

Use of non-steroidal anti-inflammatory drugs and adverse outcomes during the COVID-19 pandemic: A systematic review and meta-analysis.

Qi Zhou1,2, Siya Zhao3, Lidan Gan4, Zhili Wang4, Shuai Peng4, Qinyuan Li4, Hui Liu3, Xiao Liu3, Zijun Wang1, Qianling Shi5, Janne Estill6,7, Zhengxiu Luo4, Xiaohui Wang3, Enmei Liu4, Yaolong Chen1,2,3,8,9.   

Abstract

Background: There are concerns that the use of non-steroidal anti-inflammatory drugs (NSAIDs) may increase the risk of adverse outcomes among patients with coronavirus COVID-19. This study aimed to synthesize the evidence on associations between the use of NSAIDs and adverse outcomes.
Methods: A systematic search of WHO COVID-19 Database, Medline, the Cochrane Library, Web of Science, Embase, China Biology Medicine disc, China National Knowledge Infrastructure, and Wanfang Database for all articles published from January 1, 2020, to November 7, 2021, as well as a supplementary search of Google Scholar. We included all comparative studies that enrolled patients who took NSAIDs during the COVID-19 pandemic. Data extraction and quality assessment of methodology of included studies were completed by two reviewers independently. We conducted a meta-analysis on the main adverse outcomes, as well as selected subgroup analyses stratified by the type of NSAID and population (both positive for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) or not). Findings: Forty comparative studies evaluating 4,867,795 adult cases were identified. Twenty-eight (70%) of the included studies enrolled patients positive to SARS-CoV-2 tests. The use of NSAIDs did not reduce mortality outcomes among people with COVID-19 (number of studies [N] = 29, odds ratio [OR] = 0.93, 95% confidence interval [CI]: 0.75 to 1.14, I2  = 89%). Results suggested that the use of NSAIDs was not significantly associated with higher risk of SARS-CoV-2 infection in patients with or without COVID-19 (N = 10, OR = 0.96, 95% CI: 0.86 to 1.07, I2  = 78%; N = 8, aOR = 1.01, 95% CI: 0.94 to 1.09, I2  = 26%), or an increased probability of intensive care unit (ICU) admission (N = 12, OR = 1.28, 95% CI: 0.94 to 1.75, I2  = 82% ; N = 4, aOR = 0.89, 95% CI: 0.65 to 1.22, I2  = 60%), requiring mechanical ventilation (N = 11, OR = 1.11, 95% CI: 0.79 to 1.54, I2  = 63%; N = 5, aOR = 0.80, 95% CI: 0.52 to 1.24, I2  = 66%), or administration of supplemental oxygen (N = 5, OR = 0.80, 95% CI: 0.52 to 1.24, I2  = 63%; N = 2, aOR = 1.00, 95% CI: 0.89 to 1.12, I2  = 0%). The subgroup analysis revealed that, compared with patients not using any NSAIDs, the use of ibuprofen (N = 5, OR = 1.09, 95% CI: 0.50 to 2.39; N = 4, aOR = 0.95, 95% CI: 0.78 to 1.16) and COX-2 inhibitor (N = 4, OR = 0.62, 95% CI: 0.35 to 1.11; N = 2, aOR = 0.73, 95% CI: 0.45 to 1.18) were not associated with an increased risk of death. Interpretation: Data suggests that NSAIDs such as ibuprofen, aspirin and COX-2 inhibitor, can be used safely among patients positive to SARS-CoV-2. However, for some of the analyses the number of studies were limited and the quality of evidence was overall low, therefore more research is needed to corroborate these findings. Funding: There was no funding source for this study.
© 2022 The Author(s).

Entities:  

Keywords:  COVID-19; Meta-analysis; NSAIDs; Systematic review

Year:  2022        PMID: 35434582      PMCID: PMC8989274          DOI: 10.1016/j.eclinm.2022.101373

Source DB:  PubMed          Journal:  EClinicalMedicine        ISSN: 2589-5370


Evidence before this study

We searched seven databases and resources from January 1, 2020, through November 7, 2021, with no restriction by language, for any systematic reviews comparing the clinical adverse outcomes between patients receiving NSAIDs. We used database-specific combinations of the following index terms and phrases: COVID-19, SARS-CoV-2, Coronavirus disease-19, 2019-novel coronavirus, 2019-nCoV, Nonsteroidal Anti-Inflammatory, Non-Steroidal Anti-Inflammatory, NSAID*, Antipyretic*, Ibuprofen*, Aspirin, Acetaminophen, and their derivatives. Previous related meta-analyses have only focused on a subset of NSAIDs and included indirect evidence on middle east respiratory syndrome-related coronavirus (MERS) and severe acute respiratory syndrome (SARS) and non-peer-reviewed preprints. Other meta-analyses did not perform subgroup analyses, nor did they grade the quality of evidence for their findings.

Added value of this study

We did a comprehensive systematic review and meta-analysis of forty observational studies across 14 countries and five continents. Our findings suggest that NSAIDs such as ibuprofen, aspirin, and COX-2 inhibitor can be used safely during the COVID-19 pandemic. The use of NSAIDs was not significantly associated with higher risk of SARS-CoV-2 infection, or an increased probability of intensive care unit (ICU) admission, requiring mechanical ventilation, or administration of supplemental oxygen.

Implications of all the available evidence

Our findings suggest that NSAIDs can be used safely in patients to relieve pain, inflammation, and fever during the COVID-19 pandemic. For future studies, there is a lack of high-quality multicenter cohort studies with a large sample size indicating NSAIDs' impact on the quality of life and long-term survival. Alt-text: Unlabelled box

Introduction

Since December 2019, a new infectious disease, coronavirus disease 2019 (COVID-19), caused by the SARS-CoV-2, has swept across the world and brought huge challenges to the public health and medical service systems worldwide. Current evidence suggests that fever is one of the main clinical symptoms of COVID-19, with 88.7% of hospitalized adults and 63.3% of hospitalized children with COVID-19 presenting fever. Therefore, symptomatic treatment with non-steroidal anti-inflammatory drugs (NSAIDs) such as ibuprofen is often used in COVID-19 patients.2, 3, 4 However, a study published on March 11, 2020, questioned the safety of ibuprofen in the treatment of COVID-19, suggesting that SARS-CoV-2 could invade human cells by combining with Angiotensin-Converting Enzyme 2 (ACE2), with the goal of infestation. Ibuprofen can strengthen the binding ability of ACE2 and SARS-CoV-2 and enhance the infection process of the virus. The possibility that ibuprofen use can deteriorate the course of COVID-19 should thus not be excluded, and ibuprofen should be used with caution in patients during the pandemic. Based on the above research results, Olivier Véran, the Minister of Solidarity and Health of France issued a warning via social media on 14 March 2020, stating that "the use of anti-inflammatory drugs (ibuprofen, cortisone, etc.) may aggravate the course of COVID-19, and paracetamol is recommended if fever symptoms occur". On March 17, 2020, the World Health Organization (WHO) also issued a statement that "it is recommended that patients with COVID-19 avoid taking ibuprofen". However, at the same time, the European Medicines Agency (EMA) issued a statement that there is no scientific evidence of an association between ibuprofen and COVID-19 deterioration. The EMA further noted that they would closely monitor the situation and review any new information. In France, the issuance of the above warnings led to an 80% drop in the prescription rate of ibuprofen in general. The evidence on the impact of ibuprofen and other NSAIDs for patients with COVID-19 is still controversial. The first prospective cohort study of ibuprofen and other NSAIDs for treating adults with COVID-19 showed that among 503 adults with confirmed SARS-CoV-2 infection, the use of ibuprofen during the acute phase was not associated with the risk of death (hazard ratio [HR]=0.63, 95% CI: 0.07 to 5.44) or the risk of hospital admission (OR = 1.27, 95% CI: 0.55 to 2.95), compared with no ibuprofen use. Long-term use of NSAIDs was also not found to be associated with a higher risk of death (HR=0.49, 95% CI: 0.18 to 1.36). However, another retrospective cohort study from South Korea showed that among 1824 hospitalized adult patients with COVID-19, there was an increased risk of adverse outcomes in patients who used NSAIDs (OR=1.54, 95% CI: 1.13 to 2.11) compared with patients who did not use NSAIDs (n = 87). Currently, the research results on whether NSAIDs can be safely used in patients with COVID-19 or not are inconsistent. To answer this question, we included all comparative studies which enrolled patients that took NSAIDs during the COVID-19 pandemic, to conducted this comprehensive systematic review and meta-analysis to explore the association between the use of NSAIDs and adverse outcomes among patients during the COVID-19 pandemic.

Methods

Our systematic review and meta-analysis were performed in accordance with the Cochrane Handbook. We report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement.

Data sources and searches

We performed a systematic literature search of the WHO COVID-19 Database, Medline (via PubMed), The Cochrane Library, Web of Science (WOS), China Biology Medicine disc (CBM), China National Knowledge Infrastructure (CNKI), and Wanfang Database for studies published from January 1, 2020, through November 7, 2021. We used database-specific combinations of the following index terms and phrases: COVID-19, SARS-CoV-2, Coronavirus disease-19, 2019-novel coronavirus, 2019-nCoV, Nonsteroidal Anti-Inflammatory, Non-Steroidal Anti-Inflammatory, NSAID*, Antipyretic*, Ibuprofen*, Aspirin, Acetaminophen, and their derivatives. Supplementary searches were conducted on Google Scholar (https://scholar.google.nl/). Finally, we reviewed the references from the included articles manually to identify any missed potentially relevant records. The inclusion of studies was not restricted by the publication status or language. An information retrieval specialist helped to develop the search strategy. Details of the search strategies are available in eTable 1 in Supplementary.

Inclusion and exclusion criteria

We included all comparative studies in comparing the clinical adverse outcomes during the COVID-19 pandemic (in the time period starting from the end of 2019) between patients receiving and not receiving any NSAIDs. All included studies must be conducted during the COVID-19 pandemic, but the patients could positive or negative to SARS-CoV-2 test. We made no restrictions on age, gender, ethnicity, region, other individual factors, or the COVID-19 status. We excluded multiple publications on the same population. Studies reporting insufficient details were also excluded unless we were able to retrieve the original data.

Study selection process

Study selection was conducted independently by two investigators. For this purpose, four investigators were divided into two groups (Siya Zhao and Shuai Peng; Zhili Wang and Lidan Gan), and the records were split randomly between these groups. The retrieval consisted of three phases. In phase one, we screened titles and abstracts of search results to exclude literature that obviously did not meet the inclusion and exclusion criteria. In phase two, full-text articles were obtained for articles identified by one or both investigators as potentially relevant. The full texts of eligible articles were reviewed independently by the same two investigators. In phase three, any disagreements in the decision to include or exclude the study were adjudicated through discussion or consultation with a third investigator (Qi Zhou).

Data extraction

Two investigators (Siya Zhao and Lidan Gan) independently extracted data from the included studies using a standardized Microsoft Excel collection form. Disagreements were resolved through discussion or consultation with a third investigator (Qi Zhou) if necessary. The following information was extracted: (1) Basic information: the first author, year of publication, country of origin, sample size, types of study design and complications; (2) Characteristics of the exposure: types of NSAIDs taken; (3) Information on outcomes: mortality, probability of SARS-CoV-2 infection, probability of ICU admission rate, probability of machine ventilation, probability of administration of respiratory support, a composite risk of adverse outcomes (defined as having at least one of the following: requirement for supplemental oxygen, mechanical ventilation, sepsis, ICU admission or death). Mortality was the primary outcome of our study. If sufficient data on characteristics or outcomes were not available, we contacted the authors of studies by email to request them or calculated from other reported data according to methods recommended by the Cochrane Handbook, if available.

Assessment of the methodological quality

Two investigators (Qi Zhou and Siya Zhao) independently assessed the risk of bias in each study included in the systematic review. We used the Newcastle-Ottawa Scale to assess the methodological quality. The tool consists of eight items: representativeness of the exposed cohort, selection of the non-exposed cohort, ascertainment of exposure, the demonstration that outcome of interest was not present at the start of study, comparability of cohorts on the basis of the design or analysis, assessment of outcome, sufficient follow-up for outcomes to occur, and adequacy of follow up of cohorts. Each item was rated as either none, one point or two points. We resolved disagreements by discussion or by consultation with another investigator (Yaolong Chen).

Assessment of the certainty of the evidence

We assessed the certainty of the evidence with the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach, for all outcomes. We rated the certainty of the evidence for each outcome based on considerations of five factors that may lead to rating down the quality of evidence (risk of bias, inconsistency, imprecision, indirectness, and publication bias), and three factors that may lead to rating up the quality of evidence (dose-response gradient, large magnitude of effect and plausible confounders or biases). The quality of evidence is initially assigned as high for randomized controlled trials (RCTs) without serious defects in methodology, and low for observational studies, after which the quality is gradually up- or downgraded based on the eight factors mentioned before. The quality of the evidence is finally rated as 'high', 'moderate', 'low' or 'very low'. We performed the assessment using the GRADEpro software and generated a summary of findings (SoF) table.,

Data analysis

I² statistic was used to quantify the amount of heterogeneity, with I² of greater than 50% representing substantial heterogeneity. We did our data analyses with RevMan 5.4 software and STATA15.0 (StataCorp, College Station, Texas). We used a random effects model and calculated odds ratios (OR) with 95% confidence intervals (CI) for dichotomous outcomes, and mean differences (MD) with 95% CI for continuous outcomes. We present the pooled results over all studies and performed subgroups analyses by the type of NSAID (ibuprofen vs. aspirin vs. COX-2 inhibitor vs. other drugs ) and population (C+:all patients tested positive for SARS-CoV-2 vs. C±/C-: part or no patients tested positive for SARS-CoV-2). We also performed a meta-analysis of adjusted OR, risk ratio (RR) and HR. If both unadjusted and adjusted ORs were reported from the same study, we extracted both and pooled the unadjusted estimates in the main analysis and the adjusted estimates in the secondary analysis. RR and HR from other studies were regarded as OR. If not available, ORs could be obtained through calculating events and total numbers of patients in two groups. If more than one adjusted ORs were reported, we used the one adjusted for the maximum number of covariables. We also performed a sensitivity analysis to assess the robustness of our findings by excluding one research every analysis. Publication bias was assessed by a funnel plot.

Role of the funding source

There was no funding source for this study.

Results

Characteristics of the included studies

A total of 2312 references were identified in our search. After screening on titles, abstracts and full texts, forty comparative studies involving 4867,795 individuals were included in this review, in which eight are from the United States of America (USA), six are from South Korea, and four are from the United Kingdom (UK) (Figure 1).,,22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59 Twenty-eight (70%) of the included studies enrolled patients positive to SARS-CoV-2 tests. All forty studies included only adult cases. Thirty-seven studies were retrospective and the remaining three prospective. Characteristics of the included studies are described in Table 1. Thirty-four (85%) of the included studies did not specify whether the assessment of the outcome was blinded. Moreover, we found a risk of bias in the ascertainment of the exposure in seven studies. Overall, the methodological quality of the included studies was good (eTable 2 in Supplementary).
Figure 1

Literature search and screening process from: Moher D, Liberati A, Tetzlaff J, Altman D G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement BMJ 2009; 339 :b2535 doi:10.1136/bmj.b2535.

Table 1

Characteristics of the included studies.

Study IDCountryStudy designPopulationType of drugsDosage (daily)Sample size
Age (year) *
Male (%)
Diabetes mellitus (%)
Hypertension (%)
COPD-Chronic pulmonary disease (%)
Cardiovascular disease (%)
Outcomes
ECECECECECECEC
Abdelwahab et al., 2021 aEgyptRSC+Aspirin81–162 mg313656.0 ± 16.144.0 ± 16.551.633.338.711.148.413.9NRNR25.80
Abdelwahab et al., 2021 bEgyptRSC+Aspirin81–162 mg3512361.0 ± 14.358.0 ± 14.748.646.348.643.162.945.5NRNR22.93.3
Abu Esba et al., 2020Saudi ArabiaPSC+UnspecifiedNR14635747.5(33.0–63.0)36.0 (27.0–49.0)52.159.441.114.834.914.6NRNR12.32.5①⑤⑦
Aghajani et al., 2021IranRSC+AspirinNR33665565.8 ± 14.358.5 ± 17.456.054.047.621.862.530.0NRNR40.88.7① ④
Alamdari et al., 2020IranRSC+UnspecifiedNR3742261.8 ± 11.969.7NRNRNRNRNRNRNRNR
Argenziano et al., 2020USARSC+UnspecifiedNR25075063.0 (50.0–75.0)59.637.260.16.6NRNR③⑦
Blanch-Rubió et al., 2020SpainRSUnspecifiedNR318178466.4 (13.3)19.5NRNRNRNRNRNRNRNR
Bruce et al., 2020UKRSC+UnspecifiedNR541168NRNR46.356.920.427.331.551.1NRNRNRNR
Chandan et al., 2021UKRS&OsteoarthritisUnspecifiedNR8595859568.4 ± 10.468.1 ± 10.534.834.217.015.9NRNR8.17.113.79.7①②
Chow et al., 2021USARSC+Aspirin81 mg9831461.0 (55.0–72.0)52.0 (37.0–65.0)62.258.355.129.078.652.5NRNR34.75.7①③④
Costantino et al., 2020FranceRSRheumatic diseasesUnspecifiedNR31833751.0 ± 13.438.2NRNRNRNRNRNRNRNR
Drake et al., 2021UKPS&C+UnspecifiedNR421167,96870.1 ± 18.770.2 ± 18.446.446.421.121.5NRNR18.716.535.130.3①③④⑤
Gianfrancesco et al., 2020AustraliaRSRAUnspecifiedNR111420NRNRNRNRNRNRNRNRNRNRNRNR
Gupta et al., 2020USAPSC+UnspecifiedNR191202460.5 (14.5)64.8NRNRNRNRNRNRNRNR
Hong et al., 2020ChinaPSC+COX-2 inhibitor200–400 mg36749.3 ± 14.849.5 ± 18.347.257.18.314.28.314.2NRNR5.614.2
Huh et al., 2021South KoreaRSUnspecifiedNR708036,966NRNR59.5NRNRNRNRNRNRNRNR
Hwang et al., 2020South KoreaRSC+UnspecifiedNR59867.6 ± 15.350.5NRNRNRNRNRNRNRNR
Imam et al., 2020USARSC+UnspecifiedNR46683961.0 ± 16.353.8NRNRNRNRNRNRNRNR
Jehi et al., 2020USARSC+UnspecifiedNR8923644NRNRNRNRNRNRNRNRNRNRNRNR
Jeong et al., 2020South KoreaRS&C+UnspecifiedNR354147054.1 ± 17.647.8 ± 19.141.541.017.011.028.019.020.015.0NRNR①③④⑥
Karruli et al., 2021ItalyRSC+AspirinLow dose527NRNRNRNRNRNRNRNRNRNRNRNR
Kim et al., 2021 aSouth KoreaRS&AspirinNR136136NRNR63.261.867.672.179.482.49.68.148.549.3①②③④⑤⑥
Kim et al., 2021 bSouth KoreaRS&AspirinNR526526NRNR58.056.850.849.875.576.29.77.236.335.0①②③④⑤⑥
Kragholm et al., 2020DenmarkRSC+IbuprofenNR264373858.0(46–68.0)57.0(45.0–73.0)44.747.413.311.124.221.86.45.32.72.5
Liu et al., 2021ChinaRS&C+Aspirin81 mg2820469.5 (61.0–77.0)54.0 (42.0–65.0)64.353.417.911.371.419.63.62.5NRNR
Lodigiani et al., 2021ItalyRSC+AspirinNR93286NRNRNRNRNRNRNRNRNRNRNRNR①③
Lund et al., 2020DenmarkRS&C+UnspecifiedNR22489654.0(43.0–64.0)54.0(41.0–66.0)40.241.9NRNRNRNR4.03.910.310.2①③④⑦
Mancia et al., 2020ItalyRSUnspecifiedNR561531,41668.0 ± 13.063.0NRNRNRNRNRNRNRNR
Martínez-Botía et al., 2021SpainRS&C+UnspecifiedNR366166966.4 ± 15.867.3 ± 16.261.259.813.112.9NRNRNRNRNRNR①③
Meizlish et al., 2021USARS&C+Aspirin81 mg9641821NRNRNRNRNRNRNRNRNRNRNRNR
Merzon et al., 2021IsraelRSAspirinLow dose16218856NRNRNRNRNRNRNRNRNRNRNRNR①②⑦
Ong et al., 2020SingaporeRSC+COX-2 inhibitor60–90 mg2214656.0 (53.8–61.0)62.0 (55.8–68.3)50.056.218.231.531.850.702.74.59.6①③④⑤⑥
Osborne et al., 2021USARS&C+AspirinNR6300630067.4 ± 10.867.3 ± 11.295.296.662.541.389.472.643.837.9NRNR
Park et al., 2021South KoreaRS&C+UnspecifiedNR397397NRNR41.836.816.615.928.727.72.50.8NRNR①④
Reilev et al., 2020DenmarkRSUnspecifiedNR47,503374,316NRNRNRNRNRNRNRNRNRNRNRNR①②③⑦
Rinott et al., 2020IsraelRSC+IbuprofenNR8731640.0(24.5–64.0)46.0(25.0–61.0)52.955.111.48.8NRNRNRNR13.712.6①③④⑤
Sahai et al., 2021 aUSARS&C+UnspecifiedNR44444458.1 ± 17.058.2 ± 18.151.148.635.735.962.766.110.912.1NRNR
Sahai et al., 2021 bUSARS&C+Aspirin81 mg24824868.5 ± 13.669.5 ± 14.156.559.550.45084.98518.713.6NRNR
Son et al., 2021South KoreaRSAspirinNR84410,631NRNRNRNRNRNRNRNRNRNRNRNR
Vahedian-Azimi et al., 2021IranRSC+AspirinNR237350NRNRNRNRNRNRNRNRNRNRNRNR①③
Vila-Corcoles et al., 2020SpainRSUnspecifiedNR165033,286NRNR48.128.1NRNRNRNRNRNR
Wong et al., 2021 aUKRSGeneral populationUnspecifiedNR536,4231,927,28453.0 (42.0–64.0)49.0 (36.0–60.0)40.843.311.09.023.918.42.92.2NRNR
Wong et al., 2021 bUKRSRheumatoid arthritisUnspecifiedNR175,4951,533,28663.0 (55.0–71.0)68.0 (58.0–76.0)37.037.914.715.437.740.84.85.6NRNR
Yuan et al., 2021ChinaRSC+Aspirin75–150 mg5213169.7 ± 1.171.8 ± 0.959.651.925.020.661.553.41.95.3NRNR

① Mortality; ② Risk of SARS-CoV-2 infection; ③ ICU admission; ④ Mechanical ventilation; ⑤ Supplemental oxygen; ⑥ Composite adverse outcome; ⑦ Hospital admission; C+: Patients positive to SARS-CoV-2 tests; C±: Partial or none patients positive to SARS-CoV-2 tests; E: Exposure group; C: Control group; NR: Not report; RS: Retrospective study; PS: Prospective study; *: Data are reported as mean ± SD or median (interquartile range); &: Propensity score–matched cohort study.

Literature search and screening process from: Moher D, Liberati A, Tetzlaff J, Altman D G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement BMJ 2009; 339 :b2535 doi:10.1136/bmj.b2535. Characteristics of the included studies. ① Mortality; ② Risk of SARS-CoV-2 infection; ③ ICU admission; ④ Mechanical ventilation; ⑤ Supplemental oxygen; ⑥ Composite adverse outcome; ⑦ Hospital admission; C+: Patients positive to SARS-CoV-2 tests; C±: Partial or none patients positive to SARS-CoV-2 tests; E: Exposure group; C: Control group; NR: Not report; RS: Retrospective study; PS: Prospective study; *: Data are reported as mean ± SD or median (interquartile range); &: Propensity score–matched cohort study.

Mortality

Twenty-nine studies with 4241,022 cases assessed the association between NSAID exposure and mortality in patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. The use of NSAIDs did not increase the odds of death (OR = 0.93, 95% CI: 0.75 to 1.14, I = 89%) (Figure 2). In the analysis of adjusted estimates, NSAID use was associated with better-adjusted mortality (aOR = 0.74, 95% CI: 0.61 to 0.90, I = 82%) (Figure 3).
Figure 2

The association between NSAID exposure and mortality among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. "Events" is the number of deaths; "Total" is population size; "Weight" is study weight in the analysis. "IV" is inverse variance statistical method of meta-analysis; "Random" is random effects model; "95% CI" is the 95% confidence intervals for the mortality; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of mortality, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of mortality; "I2″ represents the quantity of heterogeneity (0–100%); "Test for overall effect: Z = 0.70 (P = 0.49)" confirms no statistical difference illustrated by the diamond crossing the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article.).

Figure 3

Adjusted odds ratio of the association between NSAID and mortality among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Log[Odds Ratio]” is the natural logarithms (In) of odds ratio for each included study; “SE” is the standard error of Log[Odds Ratio]; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the adjusted mortality; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of adjusted mortality, and the red midpoint of the line symbolizes the point estimate of the adjusted odds ratio effect of mortality; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 2.99 (P = 0.003)” confirms the statistical difference illustrated by the diamond on the left side of the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

The association between NSAID exposure and mortality among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. "Events" is the number of deaths; "Total" is population size; "Weight" is study weight in the analysis. "IV" is inverse variance statistical method of meta-analysis; "Random" is random effects model; "95% CI" is the 95% confidence intervals for the mortality; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of mortality, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of mortality; "I2″ represents the quantity of heterogeneity (0–100%); "Test for overall effect: Z = 0.70 (P = 0.49)" confirms no statistical difference illustrated by the diamond crossing the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article.). Adjusted odds ratio of the association between NSAID and mortality among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Log[Odds Ratio]” is the natural logarithms (In) of odds ratio for each included study; “SE” is the standard error of Log[Odds Ratio]; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the adjusted mortality; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of adjusted mortality, and the red midpoint of the line symbolizes the point estimate of the adjusted odds ratio effect of mortality; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 2.99 (P = 0.003)” confirms the statistical difference illustrated by the diamond on the left side of the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article). The results of subgroup analysis of unadjusted mortality showed that significant associations were not found in the subgroup analyses stratified by the type of NSAID (ibuprofen: OR = 1.09, 95% CI: 0.50 to 2.39; aspirin: OR = 0.93, 95% CI: 0.58 to 1.48; COX-2 inhibitor: OR = 0.62, 95% CI: 0.35 to 1.11) and the population (C+: OR = 0.94, 95% CI: 0.74 to 1.20; C±/C-: OR = 0.91, 95% CI: 0.55 to 1.50). However, subgroup analysis showed that administration of aspirin (aOR = 0.55, 95% CI: 0.40 to 0.78), ibuprofen (aOR = 0.95, 95% CI: 0.78 to 1.16) and COX-2 inhibitor (aOR = 0.73, 95% CI: 0.45 to 1.18) were not statistically different in terms of mortality in patients with COVID-19. The results of the subgroup analysis of the population showed a statistical difference, which means that taking NSAIDs may reduce the mortality among patients positive to SARS-CoV-2 tests (N = 24, OR = 0.94, 95% CI: 0.74 to 1.20, I2=88%; N = 15, aOR=0.72, 95% CI: 0.56 to 0.82, I2=84%). However, the point estimate aORs from different populations (C+, aOR = 0.72, 95% CI: 0.56 to 0.92; C±/C-, aOR=0.87, 95% CI: 0.77 to 0.98) (eFigure 1 in Supplementary) all lied within the 95% CI for the total aOR of the association between NSAID and mortality (aOR = 0.74, 95% CI: 0.61 to 0.90) (Figure 3). Therefore, the adjusted mortality did not differ significantly across patients with or without COVID-19.

Risk of SARS-CoV-2 infection

Ten studies with 581,055 cases assessed the association between NSAID exposure and the risk of SARS-CoV-2 infection in patients who were negative to SARS-CoV-2 tests during the COVID-19 pandemic. The use of NSAIDs did not increase the odds of SARS-CoV-2 infection (OR = 0.96, 95% CI: 0.86 to 1.07, I=78%) (Figure 4). Similar results were found in the adjusted analysis (aOR = 1.01, 95% CI: 0.94 to 1.09, I=26%) (eFigure 2 in Supplementary).
Figure 4

The association between NSAID exposure and risk of SARS-CoV-2 infection among patients who were negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of SARS-CoV-2 infection; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the risk of SARS-CoV-2 infection; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of risk of SARS-CoV-2 infection, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of risk of SARS-CoV-2 infection; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 0.79 (P = 0.43)” confirms no statistical difference illustrated by the diamond crossing the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

The association between NSAID exposure and risk of SARS-CoV-2 infection among patients who were negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of SARS-CoV-2 infection; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the risk of SARS-CoV-2 infection; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of risk of SARS-CoV-2 infection, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of risk of SARS-CoV-2 infection; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 0.79 (P = 0.43)” confirms no statistical difference illustrated by the diamond crossing the line of effect (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

ICU admission

Twelve studies (n = 27,689) evaluated the association between NSAID exposure and ICU admission in patients who were positive or negative to SARS-CoV-2 tests during COVID-19 pandemic. The use of NSAIDs in patients was not associated with the probability of ICU admission (OR = 1.28, 95% CI: 0.94 to 1.75, I = 82%) (Figure 5). Similar results were found in the adjusted analysis (aOR = 0.89, 95% CI: 0.65 to 1.22, I = 60%) (eFigure 2 in Supplementary).
Figure 5

The association between NSAID exposure and ICU admission among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of ICU admission; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the ICU admission; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of risk of ICU admission, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of risk of ICU admission; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 1.56 (P = 0.12)” confirms no statistical difference illustrated by the diamond crossing the line of effect. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

The association between NSAID exposure and ICU admission among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of ICU admission; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the ICU admission; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of risk of ICU admission, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of risk of ICU admission; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 1.56 (P = 0.12)” confirms no statistical difference illustrated by the diamond crossing the line of effect. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

. Mechanical ventilation

Eleven studies (n = 14,717) evaluated the association between NSAID exposure and mechanical ventilation rate in patients who were positive or negative to SARS-CoV-2 tests. The use of NSAIDs did not increase the probability of requiring mechanical ventilation (OR = 1.11, 95% CI: 0.79 to 1.54, I = 63%), compared to those not taking NSAIDs (Figure 6). In the adjusted analysis, there was also no increase in the odds of mechanical ventilation with the use of NSAID (aOR = 0.80, 95% CI: 0.52 to 1.24, I = 66%), compared with no NSAID use (eFigure 2 in Supplementary).
Figure 6

The association between NSAID exposure and mechanical ventilation among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of patients mechanical ventilation; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the mechanical ventilation; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of mechanical ventilation, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of mechanical ventilation; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 0.59 (P = 0.55)” confirms no statistical difference illustrated by the diamond crossing the line of effect. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

The association between NSAID exposure and mechanical ventilation among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic. “Events” is the number of patients mechanical ventilation; “Total” is population size; “Weight” is study weight in the analysis. “IV” is inverse variance statistical method of meta-analysis; “Random” is random effects model; “95% CI” is the 95% confidence intervals for the mechanical ventilation; Each horizontal line in the graphical display represents a study, its width represents 95% CI of the interval estimation of the odds ratio effect of mechanical ventilation, and the blue midpoint of the line symbolizes the point estimate of the unadjusted odds ratio effect of mechanical ventilation; “I2” represents the quantity of heterogeneity (0–100%); “Test for overall effect: Z = 0.59 (P = 0.55)” confirms no statistical difference illustrated by the diamond crossing the line of effect. (For interpretation of the references to color in this figure legend, the reader is referred to the web version of this article).

Other outcomes

No association between NSAIDs exposure and administration of supplemental oxygen (OR = 0.80, 95% CI: 0.52 to 1.24, I = 57%), composite adverse outcome (OR = 1.32, 95% CI: 0.75 to 2.33, I = 75%), hospital admission (OR = 1.58, 95% CI: 1.06 to 2.36, I = 93%) among patients who were positive or negative to SARS-CoV-2 tests during the COVID-19 pandemic (see eFigure 3 in Supplementary). And the adjusted ORs between NSAIDs exposure and administration of supplemental oxygen (aOR = 1.00, 95% CI: 0.89 to 1.12, I = 0%), composite adverse outcome (aOR = 1.07, 95% CI: 0.66 to 1.73, I = 72%), hospital admission (aOR = 1.07, 95% CI: 0.74 to 1.55, I = 62%) also did not show association(see eFigure 2 in Supplementary).

Sensitivity analysis

We performed a sensitivity analysis on the mortality meta analysis by excluding one study at a time because of the high heterogeneity (I = 89%). A major cause of the high heterogeneity was the difference between the very precise estimates in the two sub-studies by Wong et al. and Osborne et al. (eFigure 4 in Supplementary). The sample size of Wong et al. and Osborne et al. were observed to be high as compared with other included studies, which might affect the results. Where the population included in the study of Wong et al. was non-COVID-19 patients and the drug administrated in the study of Osborne et al. was aspirin. Since the results of the sensitivity analysis found that type of NSAID were sources of heterogeneity between studies, so the sources of heterogeneity found in the sensitivity analysis were consistent with sources of heterogeneity found in subgroup analysis.

Quality of evidence and publication bias

Based on the pooled results, we downgraded the quality of evidence for some outcomes by one level due to imprecision (wide confidence interval) or inconsistency. Consequently, the quality of the evidence was classified as “Very low” and “Low” for unadjusted and adjusted mortality, respectively. The GRADE quality summary of findings for all outcomes is shown in eTable 3 in Supplementary. The funnel plot for the studies of mortality as an outcome is provided. It shows a lack of small studies showing lower or no risk with NSAIDs. There was no significant evidence of publication bias (eFigure 5 in Supplementary).

Discussion

This systematic review and meta-analysis included forty studies with a total of 4881,423 adult patients. We found that the use of NSAIDs did not aggravate mortality, ICU admission rate, mechanical ventilation rate, or any other adverse outcome, although the quality of evidence was low or very low. According to our results, there is no need for patients and clinicians to be concerned about the routine use of NSAIDs to relieve pain, inflammation and fever due to COVID-19. Fever induced by viral infection is usually self-limiting and does not require specific antiviral therapy. Symptomatic and supportive treatments are the main part of the management of patients with COVID-19 at present. The risk of hemodynamic instability caused by fever is high, and NSAIDs (in particular ibuprofen and acetaminophen) are one of the most commonly used antipyretic and analgesic drugs to reduce the body temperature of fever patients and treat acute pain worldwide. Therefore, the current recommendations of some guidelines indicate that the use of antipyretic drugs such as ibuprofen, acetaminophen or any other NSAIDs should not be contraindicated in patients with COVID-19., The WHO made a rapid systematic review based on 73 studies about SARS, MERS and COVID-19 and found no effect of NSAIDs on the risk of ischemic and hemorrhagic stroke and myocardial infarction in adults with acute respiratory infections. Moderate to high-quality evidence suggests that there is no significant association between ibuprofen or acetaminophen use and all-cause mortality, hospitalization, acute renal failure or acute gastrointestinal bleeding on febrile children. Most included studies found either no adverse events or only mild or moderate adverse events, and there was no evidence indicating that NSAIDs have an impact on the quality of life or long-term survival. In our study, both unadjusted and adjusted mortality were analyzed. When the results of the two analyze agreed, we drew conclusions based on the direction of agreement, and when the results of the two analyses did not agree, they were discussed and drew reasonable conclusions primarily based on the adjusted results and quality of the evidence. After the subgroup analysis, we found that ibuprofen, COX-2 inhibitor, and other NSAIDs all could not reduce the risk of death, and the results of analysis of unadjusted and adjusted mortality were consistent. While the adjusted analysis found that aspirin could reduce mortality in patients with COVID-19, however this was not confirmed by the unadjusted analysis. The results of our review were in line with these previous findings.63, 64, 65, 66, 67, 68 This is a comprehensive systematic review and meta-analysis of the correlation between the use of NSAIDs and unfavorable outcomes of COVID-19, and it thus can be expected to reflect the best available evidence on this topic. The study is reported according to the Cochrane guidelines and the PRISMA statement. We performed a meta-analysis of included studies and were thus able to draw quantitative conclusions. Our study has however also some limitations. The forty studies included were all observational studies, some of them had small sample sizes, and all studies presented with a risk of bias in the implementation of blinding methods of outcome evaluators. To get the pooled adjusted OR, HR and RR in the original research were deirectly merged with OR in the meta-analysis, so there are limitations in the results of the adjusted OR. The results of high quality multicenter cohort study with large sample size are therefore still lacking. The clinical heterogeneity among the studies was large and we could thus not draw conclusions or give specific recommendations for different sub-populations (based on e.g. age or severity of disease), or the timing of medication, dosage, or any other aspect, to conduct quantitative analysis. Due to the particularity and urgency of the public health situation, our study was not registered on the international registration platform PROSPERO. The participants of all included studies were all exclusively adults, so the results cannot necessarily be generalized for children. The use of NSAIDs (especially, ibuprofen, COX-2 inhibitor and low-dose aspirin) was not found to be associated with higher mortality, ICU admission rate, machine ventilation rate or administration of respiratory support. Despite the concerns that NSAID could enhance the ability of SARS-CoV-2 to invade human cells, there is no evidence to support that NSAID would worsen the prognosis of COVID-19.

Contributions

Qi Zhou and Siya Zhao had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Concept and design: Yaolong Chen, Enmei Liu and Xiaohui Wang. Acquisition, analysis, or interpretation of data: Qi Zhou, Siya Zhao, Lidan Gan, Zhili Wang, Shuai Peng, Yaolong Chen. Drafting of the manuscript: Qi Zhou, Siya Zhao, Lidan Gan, Zhili Wang, Shuai Peng. Critical revision of the manuscript for important intellectual content: Qiyuan Li; Zijun Wang, Xiao Liu; Hui Liu; Qianling Shi; Zhengxiu Luo; Janne Estill; Yaoliong Chen; Xiaohui Wang and Enmei Liu. Statistical analysis: Qi Zhou and Siya Zhao. Supervision: Enmei Liu; Yaolong Chen and Xiaohui Wang. The decision for the manuscript submission and publication: Yaolong Chen.

Declaration of interests

None.
  61 in total

Review 1.  Measuring inconsistency in meta-analyses.

Authors:  Julian P T Higgins; Simon G Thompson; Jonathan J Deeks; Douglas G Altman
Journal:  BMJ       Date:  2003-09-06

2.  The Novel Coronavirus Originating in Wuhan, China: Challenges for Global Health Governance.

Authors:  Alexandra L Phelan; Rebecca Katz; Lawrence O Gostin
Journal:  JAMA       Date:  2020-02-25       Impact factor: 56.272

3.  Mortality Risk Factors among Hospitalized COVID-19 Patients in a Major Referral Center in Iran.

Authors:  Nasser Malekpour Alamdari; Siamak Afaghi; Fatemeh Sadat Rahimi; Farzad Esmaeili Tarki; Sasan Tavana; Alireza Zali; Mohammad Fathi; Sara Besharat; Leyla Bagheri; Fatemeh Pourmotahari; Seyed Sina Naghibi Irvani; Ali Dabbagh; Seyed Ali Mousavi
Journal:  Tohoku J Exp Med       Date:  2020-09       Impact factor: 1.848

4.  Characteristics associated with hospitalisation for COVID-19 in people with rheumatic disease: data from the COVID-19 Global Rheumatology Alliance physician-reported registry.

Authors:  Milena Gianfrancesco; Kimme L Hyrich; Jinoos Yazdany; Pedro M Machado; Philip C Robinson; Sarah Al-Adely; Loreto Carmona; Maria I Danila; Laure Gossec; Zara Izadi; Lindsay Jacobsohn; Patricia Katz; Saskia Lawson-Tovey; Elsa F Mateus; Stephanie Rush; Gabriela Schmajuk; Julia Simard; Anja Strangfeld; Laura Trupin; Katherine D Wysham; Suleman Bhana; Wendy Costello; Rebecca Grainger; Jonathan S Hausmann; Jean W Liew; Emily Sirotich; Paul Sufka; Zachary S Wallace
Journal:  Ann Rheum Dis       Date:  2020-05-29       Impact factor: 19.103

5.  Ibuprofen and NSAID Use in COVID-19 Infected Patients Is Not Associated with Worse Outcomes: A Prospective Cohort Study.

Authors:  Laila Carolina Abu Esba; Rahaf Ali Alqahtani; Abin Thomas; Nour Shamas; Lolowa Alswaidan; Gahdah Mardawi
Journal:  Infect Dis Ther       Date:  2020-11-02

6.  Non-steroidal anti-inflammatory drug use and outcomes of COVID-19 in the ISARIC Clinical Characterisation Protocol UK cohort: a matched, prospective cohort study.

Authors:  Thomas M Drake; Cameron J Fairfield; Riinu Pius; Stephen R Knight; Lisa Norman; Michelle Girvan; Hayley E Hardwick; Annemarie B Docherty; Ryan S Thwaites; Peter J M Openshaw; J Kenneth Baillie; Ewen M Harrison; Malcolm G Semple
Journal:  Lancet Rheumatol       Date:  2021-05-07

7.  COVID-19 in French patients with chronic inflammatory rheumatic diseases: Clinical features, risk factors and treatment adherence.

Authors:  Félicie Costantino; Léa Bahier; Luis Coronel Tarancón; Ariane Leboime; François Vidal; Lamouri Bessalah; Maxime Breban; Maria-Antonietta D'Agostino
Journal:  Joint Bone Spine       Date:  2020-11-02       Impact factor: 4.929

8.  Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19.

Authors:  Lara Jehi; Xinge Ji; Alex Milinovich; Serpil Erzurum; Amy Merlino; Steve Gordon; James B Young; Michael W Kattan
Journal:  PLoS One       Date:  2020-08-11       Impact factor: 3.240

9.  Mortality and pre-hospitalization use of low-dose aspirin in COVID-19 patients with coronary artery disease.

Authors:  Shuai Yuan; Peng Chen; Huaping Li; Chen Chen; Feng Wang; Dao Wen Wang
Journal:  J Cell Mol Med       Date:  2020-12-18       Impact factor: 5.295

10.  Non-steroidal anti-inflammatory drugs in management of COVID-19; A systematic review on current evidence.

Authors:  Mahmoud Yousefifard; Alireza Zali; Afshin Zarghi; Arian Madani Neishaboori; Mostafa Hosseini; Saeed Safari
Journal:  Int J Clin Pract       Date:  2020-06-14       Impact factor: 3.149

View more
  2 in total

1.  Guidelines for the prevention and management of children and adolescents with COVID-19.

Authors:  Enmei Liu; Rosalind Louise Smyth; Qinyuan Li; Amir Qaseem; Ivan D Florez; Joseph L Mathew; Yasser Sami Amer; Janne Estill; Quan Lu; Zhou Fu; Xiaoxia Lu; Edwin Shih-Yen Chan; Jürgen Schwarze; Gary Wing-Kin Wong; Toshio Fukuoka; Hyeong Sik Ahn; Myeong Soo Lee; Detty Nurdiati; Bin Cao; Wenwei Tu; Yuan Qian; Shunying Zhao; Xiaoyan Dong; Xiaoping Luo; Zhimin Chen; Guobao Li; Xiaobo Zhang; Xiaodong Zhao; Hongmei Xu; Feng Xu; Yuan Shi; Ruiqiu Zhao; Yao Zhao; Junqiang Lei; Xianlan Zheng; Mengshu Wang; Shu Yang; Xixi Feng; Liqun Wu; Zhihui He; Shihui Liu; Qi Wang; Yang Song; Zhengxiu Luo; Qi Zhou; Gordon Guyatt; Yaolong Chen; Qiu Li
Journal:  Eur J Pediatr       Date:  2022-09-16       Impact factor: 3.860

Review 2.  Home as the new frontier for the treatment of COVID-19: the case for anti-inflammatory agents.

Authors:  Norberto Perico; Monica Cortinovis; Fredy Suter; Giuseppe Remuzzi
Journal:  Lancet Infect Dis       Date:  2022-08-25       Impact factor: 71.421

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.