Semagn Mekonnen Abate1, Siraj Ahmed Ali1, Bahiru Mantfardo2, Bivash Basu3. 1. Department of Anesthesiology, College of Health Sciences and Medicine, Dilla University, Dilla, Ethiopia. 2. Department of Internal Medicine, College of Health Sciences and Medicine, Dilla University, Dilla, Ethiopia. 3. Department of Anesthesiology, College of Medicine, University of Calcutta, Calcutta, India.
Abstract
BACKGROUND: The rate of ICU admission among patients with coronavirus varied from 3% to 100% and the mortality was as high as 86% of admitted patients. The objective of the systematic review was to investigate the rate of ICU admission, mortality, morbidity, and complications among patients with coronavirus. METHODS: A comprehensive strategy was conducted in PubMed/Medline; Science direct and LILACS from December 2002 to May 2020 without language restriction. The Heterogeneity among the included studies was checked with forest plot, χ2 test, I2 test, and the p-values. All observational studies reporting rate of ICU admission, the prevalence of mortality and its determinants among ICU admitted patients with coronavirus were included and the rest were excluded. RESULT: A total of 646 articles were identified from different databases and 50 articles were selected for evaluation. Thirty-seven Articles with 24983 participants were included. The rate of ICU admission was 32% (95% CI: 26 to 38, 37 studies and 32, 741 participants). The Meta-Analysis revealed that the pooled prevalence of mortality in patients with coronavirus disease in ICU was 39% (95% CI: 34 to 43, 37 studies and 24, 983 participants). CONCLUSION: The Meta-Analysis revealed that approximately one-third of patients admitted to ICU with severe Coronavirus disease and more than thirty percent of patients admitted to ICU with a severe form of COVID-19 for better care died which warns the health care stakeholders to give attention to intensive care patients. REGISTRATION: This Systematic review and Meta-Analysis was registered in Prospero international prospective register of systemic reviews (CRD42020177095) on April 9/2020.
BACKGROUND: The rate of ICU admission among patients with coronavirus varied from 3% to 100% and the mortality was as high as 86% of admitted patients. The objective of the systematic review was to investigate the rate of ICU admission, mortality, morbidity, and complications among patients with coronavirus. METHODS: A comprehensive strategy was conducted in PubMed/Medline; Science direct and LILACS from December 2002 to May 2020 without language restriction. The Heterogeneity among the included studies was checked with forest plot, χ2 test, I2 test, and the p-values. All observational studies reporting rate of ICU admission, the prevalence of mortality and its determinants among ICU admitted patients with coronavirus were included and the rest were excluded. RESULT: A total of 646 articles were identified from different databases and 50 articles were selected for evaluation. Thirty-seven Articles with 24983 participants were included. The rate of ICU admission was 32% (95% CI: 26 to 38, 37 studies and 32, 741 participants). The Meta-Analysis revealed that the pooled prevalence of mortality in patients with coronavirus disease in ICU was 39% (95% CI: 34 to 43, 37 studies and 24, 983 participants). CONCLUSION: The Meta-Analysis revealed that approximately one-third of patients admitted to ICU with severe Coronavirus disease and more than thirty percent of patients admitted to ICU with a severe form of COVID-19 for better care died which warns the health care stakeholders to give attention to intensive care patients. REGISTRATION: This Systematic review and Meta-Analysis was registered in Prospero international prospective register of systemic reviews (CRD42020177095) on April 9/2020.
The Coronavirus belongs to large groups of viruses that cause serious health problems affecting the respiratory, gastrointestinal, liver, and central nervous system of humans, livestock, Bats, mice, and other wild animals [1-6]. The infection mainly affects the respiratory system and manifested with fever, dry cough, and difficulty breathing. In the late stages of the infection, the patient may die due to pneumonia and acute respiratory distress syndrome [4, 7–10].The Severe acute respiratory syndrome (SARS-CoV-2) novel coronavirus was identified in Wuhan, Hubei province of China in December 2019 by the Chinese Center for Disease and Prevention from the throat swab of a patient and the virus is named severe acute respiratory distress COV-2 by WHO which causes Coronaviruses disease 2019 (COVID-19) [11, 12].The clinical manifestation of the current coronavirus infection is similar to Severe acute respiratory syndrome (SARS-CoV) outbreak that occurred in the Guangdong Province of China by the year 2002–2003 [13-16] and another novel human coronavirus called Middle East Respiratory Syndrome-CoV (MERS-CoV) which was identified in the Middle East and other Arabian regions in 2012 [17-20].The World Health Organization (WHO) is named the current virus as severe acute respiratory distress COV-2 which causes coronaviruses disease 2019 (COVID-19). The WHO has declared the novel coronavirus (COVID-19) outbreak as a global pandemic on March 11, 2020 [21].Globally, More than 5 million confirmed cases and 400, 000 deaths were reported by the World Health Organization (WHO) as of June 9, 2020 [22]. The American region accounted for the highest number of cases and deaths which was more than 3 million and 200,000 respectively. The European region accounted for the second-highest confirmed cases and death which were more than 2 million confirmed cases and 183 thousand deaths. The total number of confirmed cases and death in the Eastern Mediterranean region accounted for approximately 660, 000, and 15,000 respectively [22].The number of laboratory-confirmed cases and deaths in the African region was the lowest for the last couple of months but the rate of spreading in this region is increasing at an alarming rate and expected to be very high in the next couple of months if it continues as this rate. The current report in Ethiopia is very small which is 2500 confirmed cases and 27 deaths but there are many cases in short periods which is more than150 cases per day [22]. It is estimated that the number even may be very high because the diagnosis is limited only in the capital.The challenge of COVID-19 is very high globally due to a lack of proven treatment and the complexity of its transmission [12, 19, 23–28]. However, it will be more catastrophic for low and middle-income countries because of very poor health care system, high illiteracy and low awareness of the disease and its prevention, lack of skilled health personnel, scarce Intensive Care Unit, a limited number of mechanical ventilators and prevalence of co-morbidities/infection along with malnutrition.The severity of the disease is depending on several factors. Studies showed that patients with co-morbidities including (Asthma, COPD, Tuberculosis, Pneumonia, Acute respiratory distress syndrome (ARDS), Diabetes mellitus, hypertension, renal disease, hepatic disease, and cardiac disease), history of smoking, and history of substance use, male gender and age greater than 60 years were more likely to die or develop undesirable outcomes [25, 28–35].The outcomes of patients with coronavirus infection are very variable. Studies also showed that the rate of ICU admission among coronavirus infectedpatients was higher which ranged from 3% to 100% of confirmed cases [14, 17, 19, 26, 28, 36–39]. Studies also showed that the prevalence of mortality among intensive care patients with coronavirus infection was very high which ranged from 6% to 86% of admitted patients [14, 17, 19, 26, 28, 36–39].The global rate of ICU admission, the prevalence of mortality, comorbidities, complication, number of cases demanding mechanical ventilator, length of stay and independent risk factors for ICU mortality are very important variables to be determined to reduce patientmortality and morbidity through varies mitigating strategies including but not limited to increasing number of ICU beds, mechanical ventilator, skilled professionals, integrated monitors and reducing possible risk factors. Therefore, the objectives of this systematic review and Meta-Analysis was to provide global evidence on the rates of ICU admission, the prevalence of mortality, comorbidity, complications, and independent risk factors of mortality among patients with COVID-19 admitted in ICU.
2. Materials and methods
2.1. Protocol and registration
The systematic review and meta-analysis were conducted based on the Preferred Reporting Items for Systematic and Meta-analysis (PRISMA) protocols [40]. This Systematic Review and Meta-Analysis was registered in Prospero international prospective register of systemic reviews (CRD42020177095) on April 9/2020.
2.2. Inclusion and exclusion criteria
2.2.1. Inclusion criteria
All observational (case series, cross-sectional, cohort, and case-control) studies reporting rate of ICU admission, the prevalence of mortality, morbidity, complication, and its determinants among ICU admitted patients with coronavirus (SARS-COV, MERS and SARS-COV 2) were included.
2.2.2. Exclusion criteria
Studies that didn’t report the rate of ICU admission, the prevalence of ICU mortality, and risk factors among patients with coronavirus were excluded. Besides, Randomized controlled trials, case-control studies, Systemic reviews, and Case reports were excluded.
2.3. Outcomes of interest
2.3.1. Primary outcomes
The primary outcome of interest was rates of ICU admission and mortality among patients admitted with Coronaviruses during SARS, MERS, and COVID-19 pandemic.
2.3.2. Secondary outcomes
Prevalence of morbidity, the prevalence of complication, and its determinants among patients admitted with Coronaviruses during SARS, MERS, and COVID-19 pandemic.
2.4. Search strategy
The search strategy was intended to explore all available published and unpublished studies among Coronavirusesinfectedpatients admitted to ICU from December 2002 to May 2020 without language restrictions. A comprehensive initial search was employed in PubMed/Medline, Science direct, and LILACS followed by an analysis of the text words contained in Title/Abstract and indexed terms. A second search was undertaken by combining free text words and indexed terms with Boolean operators. The third search was conducted with the reference lists of all identified reports and articles for additional studies. Finally, an additional and grey literature search was conducted on Google scholars. The PubMed/Medline database was searched with the following terms: SARS[Title/Abstract]) OR (SARS-COV-2[Title/Abstract])) OR (COVID-19[Title/Abstract])) AND (MERS[Title/Abstract])) AND (mortality[Title/Abstract])) OR (morbidity[Title/Abstract])) AND (ICU[Title/Abstract])) OR (hospital[Title/Abstract])) AND (prevalence[Title/Abstract])) AND (risk factors[Title/Abstract])).
2.5. Data extraction
The data from each study were extracted with two independent authors with a customized format. The disagreements between the two independent authors were resolved by the other two authors. The extracted data included: Author names, country, date of publication, sample size, the rates of ICU admission, mortality, types of Coronavirus, types of comorbidity, complications, and risk factors. Finally, the data were then imported for analysis in R software version 3.6.1 and STATA 14.
2.6. Assessment of methodological quality
Articles identified for retrieval were assessed by two independent Authors for methodological quality before inclusion in the review using a standardized critical appraisal Tool adapted from the Joanna Briggs Institute [45,46] (S1 Table). The disagreements between the Authors appraising the articles were resolved through discussion with the other Two Authors. Articles with average scores greater than fifty percent were included for data extraction.
2.7. Data analysis
Data analysis was carried out in R statistical software version 3.6.1 and STATA 14. The pooled rates of ICU admission and prevalence of mortality, comorbidity, complication among corona virus-infectedpatients were determined with a random effect model as there was substantial heterogeneity between the included studies. The Heterogeneity among the included studies was checked with forest plot, χ2 test, I2 test, and the p-values. Subgroup analysis was conducted by Country, type of coronavirus, types of comorbidity, and complications. Publication bias was checked with a funnel plot and the objective diagnostic test was conducted with Egger’s correlation, Begg's regression tests, and Trim and fill method. Furthermore, moderator analysis was carried out to identify the independent predictors of ICU mortality among corona cases. The results were presented based on the Preferred Reporting Items for Systemic Reviews and Meta-Analysis (PRISMA) [40].
2.8. Ethics approval and consent to participate
Ethical clearance and approval were obtained from the ethical review board of the College of Health Science and Medicine.
3. Results
3.1. Selection of studies
A total of 646 articles were identified from different databases with an initial search. Fifty articles were selected for evaluation after the successive screening. Thirty-seven Articles with 24983 participants were included in the systematic review and Meta-Analysis while thirteen studies were excluded with reasons (Fig 1).
Fig 1
Prisma flow chart.
3.2. Characteristics of included studies
Thirty-seven studies conducted on Coronavirus reporting rates of ICU admission and patient outcomes with 24983 participants were included (Table 1). Thirteen studies were excluded with reasons (S1 Table). The methodological quality of included studies was moderate to high quality as depicted with the Joanna Briggs Appraisal tool for observational studies (S2 Table).
Table 1
Methodological quality of included studies.
Author(s)
Year
Event
Sample
Country
Types of Coronavirus
Quality Score
Prevalence (95% CI)
Liu et al[41]
2020
7
11
China
SARS-COV-2
8
64(31, 89)
Xu et al[42]
2020
1
2
China
SARS-COV-2
6
50(1, 99)
Arentz et al[37]
2020
11
17
USA
SARS-COV-2
5
65(38, 86)
Bhatraju et al[43]
2020
12
24
USA
SARS-COV-2
5
50(29, 71)
Bialek et al[44]
2020
55
121
USA
SARS-COV-2
5
45(36, 55)
Cao et al[45]
2020
3
4
China
SARS-COV-2
4
75(19, 99)
Chen et al[46]
2020
2
22
China
SARS-COV-2
6
9(1,29)
Chen et al[14]
2020
11
23
China
SARS-COV-2
8
48(27, 69)
Huang et al[47]
2020
6
13
China
SARS-COV-2
6
46(19, 75)
Petrilli et al[48]
2020
116
457
USA
SARS-COV-2
6
25(21, 30)
Richardson et al[49]
2020
18
373
USA
SARS-COV-2
7
5(3, 8)
Simonnet et al[50]
2020
18
124
France
SARS-COV-2
5
15(9, 22)
Wang et al[51]
2020
6
36
China
SARS-COV-2
6
17(6, 33)
Wu et al[52]
2020
44
53
China
SARS-COV-2
6
83(70,72)
Yang et al[28]
2020
32
52
China
SARS-COV-2
6
62(47, 75)
Young et al[6]
2020
1
2
Singapore
SARS-COV-2
6
50(1, 99)
Guan et al[53]
2020
15
1099
China
SARS-COV-2
6
1(1, 2)
Zhou et al[54]
2020
39
50
China
SARS-COV-2
6
78(64, 88)
Lodigiania et al[55]
2020
8
62
Italy
SARS-COV-2
7
13(6, 24)
Kloka et al[56]
2020
41
184
Holland
SARS-COV-2
5
22(16, 29)
Lei et al [57]
2020
7
15
China
SARS-COV-2
6
47(21, 73)
Docherty et al[58]
2020
3001
20133
UK
SARS-COV-2
6
15(14, 15)
Du et al [59]
2020
6
51
China
SARS-COV-2
5
12(4, 24)
Ling et al[60]
2020
8
49
China
SARS-COV-2
5
16(7, 30)
Zangrillo et al [61]
2020
14
61
Italy
SARS-COV-2
4
23(13, 35)
Grasselli et al [62]
2020
405
1591
Italy
SARS-COV-2
6
25(23, 28)
Chan et al[13]
2003
18
39
China
SARS-COV
7
46(30, 63)
Chen et al[12]
2005
21
33
Taiwan
SARS-COV
5
64(45, 80)
Choi et al[15]
2003
32
69
China
SARS-COV
8
46(34, 59)
Lew TW et al[63]
2003
20
46
Singapore
SARS-COV
8
43(29, 59)
Almekhlafie et al[64]
2016
23
27
Saudi Arabia
MERS-CoV
6
85(66, 96)
Al-Hameed et al[18]
2016
5
8
Saudi Arabia
MERS-CoV
6
63(24, 91)
Garbati et al[65]
2016
1
4
Saudi Arabia
MERS-CoV
8
25(1, 81)
Al Ghamdi et al[66]
2016
19
37
Saudi Arabia
MERS-CoV
5
51(34, 68)
Halim et al[26]
2016
14
32
Saudi Arabia
MERS-CoV
7
44(26, 62)
Saad et al[33]
2014
42
49
Saudi Arabia
MERS-CoV
8
86(73, 94)
Arabi YM et al[19]
2014
5
10
Saudi Arabia
MERS-CoV
6
50(19, 81)
Q: question; Y: yes; N: No
Q: question; Y: yes; N: NoTwenty-six of the included studies were conducted on a newly emerged Coronavirus (SARS-CoV-2), COVID-19. Seven studies were conducted during and after the aftermath of the Middle East respiratory syndrome epidemic in the Middle East and other Arabian regions in 2012 while the remaining four studies were conducted during the severe acute respiratory syndrome (SARS-CoV) outbreak in China in 2002.The included studies were conducted in different regions of the world. Sixteen studies were conducted in China, seven studies in Saudi Arabia, five studies in the United States of America, three studies in Italy, two studies in Singapore, one study in Holland, the United Kingdom, and France.All of the included studies reported rates of ICU admission and outcomes of patients while staying in ICU. The majority of the included studies reported the presence of comorbidities and complications in ICU such as death, acute respiratory distress syndrome, renal failure, shock, and discharge.
3.3. Meta-analysis
3.3.1. Rate of ICU admission
Thirty-seven studies reported ICU admission were included for Meta-analysis. The number of ICU admission was taken for estimation of pooled prevalence of mortality instead of the total sample size because we wanted to know the number of ICU deaths from those Admitted in ICU. However, the rates of ICU admission were estimated with the total sample size. The pooled rate of ICU admission was 32% (95% CI: 26 to 38, 37 studies and 32, 741 participants) (Fig 2).
Fig 2
Forest plot for the prevalence of ICU admission patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for the prevalence of ICU admission patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.The finding of the subgroup analysis by types of corona revealed that the rate of ICU admission with SARS-COV, MERS and SARS-COV-2 was 32% (95% CI, 23 to 40), 57% 95% CI, 37 to 76) and 26% 95% CI, 20 to 33) respectively (Fig 3).
Fig 3
Forest plot for subgroup analysis prevalence of ICU admission patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for subgroup analysis prevalence of ICU admission patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
3.3.2. Prevalence of ICU mortality
The Meta-Analysis showed that the prevalence of mortality among ICU admitted patients with Coronavirus was 39% (95% CI: 34 to 43, 37 studies and 24, 983 participants) (Fig 4).
Fig 4
Forest plot for the prevalence of ICU mortality among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for the prevalence of ICU mortality among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.The subgroup analysis of the pooled prevalence of mortality among ICU admitted patients with Coronavirus showed that mortality was higher in Saudi Arabia with the Middle East respiratory syndrome 61%(95% CI: 44 to 78) while the prevalence of ICU mortality among patients with the severe acute respiratory syndrome (SARS-CoV-2) was 31% (95% CI: 26to 36) (Fig 5).
Fig 5
Forest plot for subgroup analysis of the prevalence of ICU mortality among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for subgroup analysis of the prevalence of ICU mortality among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.The subgroup analysis by country revealed that ICU mortality with COVID-19 was 31% (95% CI: 44 to 78, 25 studies, 24677 participants) where the highest was in China 42% (95% CI: 23 to 61, 13 studies, 1480 participants) followed by USA 36% (95% CI: 18 to 53, 5 studies, 992 participants) (S1 Fig).
3.3.3. Prevalence of comorbidity
The prevalence of comorbidity among ICU patients with coronavirus was 66% (95% confidence interval (CI): 47 to 85, 12 studies, and 2614 participants) (Fig 6). The Meta-Analysis also revealed that the prevalence of comorbidity among COVID-19Patients admitted in ICU was 59% (95% confidence interval (CI): 39 to 79, 10 studies and 896 participants) (S2 Fig).
Fig 6
Forest plot for the prevalence of ICU Comorbidity among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for the prevalence of ICU Comorbidity among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.The subgroup analysis by the types of comorbidity showed that cardiovascular diseases were the most prevalent 55% (95% confidence interval (CI): 46 to 64) followed by hypertension and Diabetes Mellitus, 38% (95% confidence interval (CI): 26 to 55) and 31% (95% confidence interval (CI): 20 42) respectively (Fig 7).
Fig 7
Forest plot for subgroup analysis of the prevalence of ICU Comorbidity among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for subgroup analysis of the prevalence of ICU Comorbidity among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
3.4. Prevalence of complications
The Meta-Analysis showed that the prevalence of complications among ICU admitted patients with coronavirus was 68% (95% confidence interval (CI): 33 to 104) (Fig 8). The subgroup analysis by types of complication showed that ARDS was the most prevalent complication, 54% (95% confidence interval (CI): 26 to 82) followed by infection and sepsis, 47% (95% confidence interval (CI): 29 to 65) and 37% (95% confidence interval (CI): 26 to 49) respectively (S3 Fig).
Fig 8
Forest plot for of prevalence of ICU Complication among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
Forest plot for of prevalence of ICU Complication among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.
3.5. Regression analysis
The prevalence of mortality among patients with Coronavirus was greatly affected by several factors including the presence of co-morbidities, history of smoking, history of substance use, male gender, older age groups, ICU admission, nosocomial infection, and others. The regression analysis revealed that patients with ARDS were 2 times more likely to die as compared to those who didn’t develop ARDS, RR = 2.08 (95% confidence interval(CI): 1.48 to 2.93). The risk of mortality among patients who are older than 50 years increased by 13%, RR = 1.87(95% confidence interval (CI): 1.35 to 2.58). The presence of any comorbidity increased the risk of death by 39%, RR = 1.61(95% confidence interval (CI): 1.24 to 2.09) (S4 Fig).
3.6. Sensitivity analysis and publication bias
Sensitivity analysis was conducted to identify the most influential study on the pooled summary effect and we didn’t find significant influencing the summary effect.Publication bias was investigated with funnel plot asymmetry and egger’s regression and Begg’s rank correlation were run to investigate publication bias objectively. The funnel plot didn’t show significant publication bias. Neither egger’s regression nor Begg’s rank correlation showed significant publication bias (P-value < 0.1464) (Fig 9).
Fig 9
Funnel plot to assess publication bias.
The vertical line indicates the effect size whereas the diagonal line indicates the precision of individual studies with a 95% confidence interval.
Funnel plot to assess publication bias.
The vertical line indicates the effect size whereas the diagonal line indicates the precision of individual studies with a 95% confidence interval.
4. Discussion
The Meta-Analysis revealed that more than one-third of patients with coronavirus infection were admitted to ICU globally. The subgroup analysis showed that the rate of ICU admission was very high in patients with the Middle East respiratory syndrome (MERS-CoV), 57% (95% CI: 37to 76) as compared to severe acute respiratory syndrome (SARS-CoV-2 and SARS-CoV), 26% (95% CI: 20 to 33) and 32% (95% CI: 23 to 40) respectively. Currently, the total confirmed cases and the death of patients with the SARS-CoV-2 virus is unpredictably high as compared to the previous two outbreaks [13–15, 19, 20, 63, 64, 66–68]. The lower rate of ICU admission in patients with COVID-19 in this systematic review and Meta-Analysis might be due to a small number of studies assessing rates of admission compared to the number of cases and also the majority of studies were case series with small sample size.This systematic review and Meta-Analysis revealed that the prevalence of mortality among Coronavirus confirmed cases admitted in ICU were, 39% (95% CI: 34 to 43). This finding is interpreted as there is one mortality for every three cases of admission. This finding is in line with individual studies conducted among Coronavirus confirmed cases since the first outbreak in 2002, China [13–15, 19, 20, 63, 64, 66–68]. The possible explanation for a high number of deaths in ICU may be explained in terms of a limited number of mechanical ventilators, adequate laboratory investigation, integrated patient monitors, presence of co-morbidities, hospital-acquired infections, and some others.The subgroup analysis showed that the prevalence of mortality among COVID-19patients admitted in ICU was very higher, 31% (95% CI: 26 to 36). But, it is relatively low as compared to MERS-CoV and SARS-CoV, 61% (95% CI: 44 to 78), and 49% (95% CI: 41 to 57) respectively. The possible explanation for the lower prevalence of mortality among COVID-19patients might be due to better ICU supportive management, skilled ICU professionals, integrated patient monitors, and lessons from previous outbreaks in handling ICU cases.The pooled prevalence of comorbidity among patients with coronavirus was as high as sixty percent. The subgroup analysis revealed that the prevalence of comorbidity among COVID-19patients was 59% (95% confidence interval (CI): 39 to 79) which is consistent with findings of subgroup analysis of SARS-COV, MERS-COV, and individual included studies. The regression analysis revealed that presences of comorbidity, male gender, age greater than 50 years, and ARDS were independent predictors of mortality among patients admitted in ICU with coronaviruses.
4.1. Quality of evidence
The systematic review and meta-analysis included plenty of studies with adequate sample size. The methodological quality of included studies was moderate to high quality as depicted with Joanna Briggs Institute assessment tool for meta-analysis of observational studies. However, substantial heterogeneity associated with dissimilarities of included studies in sample size, design, and location could affect the allover quality of evidence.
4.2. Limitation of the study
The review incorporated plenty of studies with a large number of participants but the majority of studies included in this review didn’t report data on comorbidity and risk factors to investigate the independent predictors. Besides, there were a limited number of studies in some countries and it would be difficult to provide conclusive evidence with results pooled from fewer studies.
4.3. Implication for practice
Body of evidence revealed that rate of ICU admission; the prevalence of mortality; morbidity and complications were very high among patients with COVID-1. These could be a huge impact particularly for low and middle-income countries with a limited number of ICU beds, mechanical ventilator, integrated patient monitor, skilled professionals combined with malnutrition, and communicable disease. Therefore, a mitigating strategy is required by different stakeholders to combat the catastrophic impacts of COVID-19 pandemic through creating awareness about preventive measures, implementing ICU protocols for supportive management, management of comorbidities, and prevention of complications.
4.4. The implication for further research
The meta-analysis revealed that the prevalence of mortality among COVD-19 in ICU was very high and the major independent predictors of mortality were identified. However, the included studies were too heterogeneous, and cross-sectional studies also don’t show a temporal relationship between mortality and its determinants. Therefore, further observational and randomized controlled trials are in demand for a specific group of patients by stratifying the possible independent predictors.
5. Conclusion
The systematic review and Meta-Analysis revealed that approximately one-third of patients admitted to ICU with severe Coronavirus disease. The systematic review also showed that more than thirty percent of patients admitted in ICU with a severe form of COVID-19 for better care died which warns the health care stakeholders to give attention to intensive care patients admitted with COVID-19 through accessing mechanical ventilators, integrated patient monitors, skilled ICU staffs, creation of awareness about infection prevention and more others. Besides, the prevalence of mortality had a strong relation with comorbidity, age, gender, and complication.
Description of excluded studies with reasons.
(DOCX)Click here for additional data file.
Methodological quality of included studies.
(DOCX)Click here for additional data file.
Forest plot for subgroup analysis of prevalence of ICU mortality by country: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.(DOCX)Click here for additional data file.
Forest plot for subgroup analysis of prevalence of ICU comorbidity by types of coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.(DOCX)Click here for additional data file.
Forest plot for subgroup analysis of prevalence of ICU Complication among patients with coronavirus: The midpoint of each line illustrates the prevalence; the horizontal line indicates the confidence interval, and the diamond shows the pooled prevalence.
ICU: Intensive Care Unit.(DOCX)Click here for additional data file.
Forest plot showing pooled odds ratio (log scale) of the associations between Intensive Care Unit mortality and its determinants (A: Co-morbidities; B: Age greater than 50 years; C: Gender D: ARDS).
(DOCX)Click here for additional data file.
PRISMA checklist.
(DOC)Click here for additional data file.
Transfer Alert
This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.8 Jun 2020PONE-D-20-10711Rate of Intensive Care Unit admission and outcomes among patients with coronavirus: A systematic review and Meta-analysisPLOS ONEDear Dr. Mekonnen,Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.Please submit your revised manuscript by Jul 23 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.Please include the following items when submitting your revised manuscript:A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocolsWe look forward to receiving your revised manuscript.Kind regards,Chiara LazzeriAcademic EditorPLOS ONEJournal Requirements:When submitting your revision, we need you to address these additional requirements.1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf2. Please confirm that you have included all items recommended in the PRISMA checklist including details of reasons for study exclusions in the PRISMA flowchart and number of studies excluded for each reason.3. Please confirm that you have included all items recommended in the PRISMA checklist including the full electronic search strategy used to identify studies with all search terms and limits for at least one database.4. We suggest you thoroughly copyedit your manuscript for language usage, spelling, and grammar. If you do not know anyone who can help you do this, you may wish to consider employing a professional scientific editing service.Whilst you may use any professional scientific editing service of your choice, PLOS has partnered with both American Journal Experts (AJE) and Editage to provide discounted services to PLOS authors. Both organizations have experience helping authors meet PLOS guidelines and can provide language editing, translation, manuscript formatting, and figure formatting to ensure your manuscript meets our submission guidelines. To take advantage of our partnership with AJE, visit the AJE website (http://learn.aje.com/plos/) for a 15% discount off AJE services. To take advantage of our partnership with Editage, visit the Editage website (www.editage.com) and enter referral code PLOSEDIT for a 15% discount off Editage services. If the PLOS editorial team finds any language issues in text that either AJE or Editage has edited, the service provider will re-edit the text for free.Upon resubmission, please provide the following:The name of the colleague or the details of the professional service that edited your manuscriptA copy of your manuscript showing your changes by either highlighting them or using track changes (uploaded as a *supporting information* file)A clean copy of the edited manuscript (uploaded as the new *manuscript* file)5. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.We will update your Data Availability statement to reflect the information you provide in your cover letter.6. Thank you for stating the following in the Acknowledgments Section of your manuscript:'No funding was obtained from any organization'We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form.Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows:'No'7. Thank you for stating the following in your Competing Interests section:'No'Please complete your Competing Interests on the online submission form to state any Competing Interests. If you have no competing interests, please state "The authors have declared that no competing interests exist.", as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-nowThis information should be included in your cover letter; we will change the online submission form on your behalf.Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests8. Please amend either the abstract on the online submission form (via Edit Submission) or the abstract in the manuscript so that they are identical9. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.Additional Editor Comments (if provided):[Note: HTML markup is below.. Please do not edit.]Reviewers' comments:Reviewer's Responses to QuestionsComments to the Author1. Is the manuscript technically sound, and do the data support the conclusions?The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.Reviewer #1: YesReviewer #2: Yes**********2. Has the statistical analysis been performed appropriately and rigorously?Reviewer #1: YesReviewer #2: Yes**********3. Have the authors made all data underlying the findings in their manuscript fully available?The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.Reviewer #1: YesReviewer #2: Yes**********4. Is the manuscript presented in an intelligible fashion and written in standard English?PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.Reviewer #1: YesReviewer #2: Yes**********5. Review Comments to the AuthorPlease use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)Reviewer #1: In this systematic review, dr. Mekonnen and colleagues present results of a systematic review and meta-analysis of cohort studies investigating prevalence of ICU admission and ICU mortality among patients with coronavirus infection (SARS, MERS, and COVID-19). They found that prevalence of ICU admission is about 16% and mortality among ICU patients is about 50%Given the current COVID-19 pandemic and the few and sparse data available, the Authors’ work deals with an interesting an up-to-date topic. Nevertheless, I have a few comments that I hope will help the Authors to improve their work.1. Abstract. Please specify study objective in the background. Please specify primary outcome in the Methods, as well as date of the search.2. Abstract. Please explain what does “Google scholars up to ten pages” means. I suggest to explain this in the main text, and delete this from the abstract.3. Abstract. Please add inclusion/exclusion criteria to the abstract4. Abstract. Please specify the total number of studies identified from the Search strategy, and the total number of studies included5. Introduction. Please shorten the introduction. Detailed description of SARS, MERS and COVID-19mortality is not necessary and can be moved to the discussion. Similarly, incidence of COVID-19 in different areas can be moved to the discussion. Finally, also detailed description of various predictors identified can be moved to the discussion6. Methods. I believe that the Section “Eligibility criteria” contains redundant information. It could all be reported as a clear list of inclusion criteria/exclusion criteria.7. As a related point, please note that among exclusion criteria there is “studies that didn’t” followed by “traumatic brain injury”. Please correct8. Methods, study outcomes. Please leave a separate paragraph specifying primary and secondary outcomes9. As a related point, this reviewer was unable to find data on the secondary outcomes (length of ICU stay, duration of mechanical ventilation, secondary infections) in the meta-analysis. Please report these data or clearly state that no studies reported this information10. The description of the search strategy is unclear. In particular, it is unclear to me what does “Google scholar up to ten pages” means. Please report the keywords used for search strategy in the supplementary appendix11. Please specify in the methods which subgroup analyses were performed and which were pre-planned12. Please specify in the methods how was study quality assessed. Please clearly describe items evaluated when assessing study quality13. I suggest to perform a sensitivity analysis including only high-quality studies14. Results. I suggest to divide the Results section in clear subsections: 1) study characteristics including study quality 2) primary outcome (including meta-analysis), 3) secondary outcomes 4) subgroup analyses 5) effect of comorbidities on outcome15. As a related point, please leave comments on the results for the discussion (e.g. “mortality admitted to the ICU was very high”)16. Please note that Begg’s and Egger’s test should have p-values, while funnel plot is a figure. Please report p-values for Begg’s and Egger’s test17. Please expand the discussion, and divide it into the following sections: 1) key findings 2) relationship with previous studies 3) implications of study findings for current practice/literature 4) future studies/future directions 5) strength and limitations 6) conclusions18. Please double check the reference list, to ensure that references are in the journal’s style.Reviewer #2: This paper by Mekonnen et al attempts to do systematic review on ICU mortality rates among patients verified with infection of coronavirus. The review is organised in accordance to PRISMA criteria and follows as such guidelines for systematic review. Using on line search for relevant journal several papers have been identified. In accordance to PRISMA flow chart twenty two studies were included for review. The authors document average ICU mortality at 50% for patients with coronavirus infection.The study is nicely organised and authors deserve credit for the effort done to bring attention on the highly morbid disease when treated in ICU. In intro authors do great job to describe current status of covid pandemic although data already seems outdated. The aim seems relevant however this referee would prefer its focus being narrowed. Would it be possible to highlight the troubling low incidence of covid in africa? Discussion starts ok but it is rather thin just to nail high mortality rates without providing scientific arguments for why it is so. The knowledge on covid has expanded massively and what authors wrote yesterday is probably outdated tomorrow. However please provide info on why mortality in different parts of the world may be different. In addition it would be highly relevant for more focus on situation in african countries. I think such would bring the paper to PLOS One upper level.**********6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.If you choose “no”, your identity will remain anonymous but your review may still be made public.Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.Reviewer #1: NoReviewer #2: No[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.16 Jun 2020These part was uploaded in manuscript tracking labelled " response to reviewers."As it was pointed out by one of reviewer, we felt that the information provided about COVID-19 were outdated. We updated our search and additional 15 studies with a total of 37 studies were included. All the comments provided were very important and we took them as it is and tried to address section by section as we tried to display in response to reviewers document.however, we kept description of some epidemiology and mortality data in background section as we feel the background looked shallow and incomplete.We thank you very much for your valuable commentswishing you all the best!!!Submitted filename: response to reviewer comments.docxClick here for additional data file.22 Jun 2020Rate of Intensive Care Unit admission and outcomes among patients with coronavirus: A systematic review and Meta-analysisPONE-D-20-10711R1Dear Dr. Mekonnen,We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.Kind regards,Chiara LazzeriAcademic EditorPLOS ONEAdditional Editor Comments (optional):Reviewers' comments:24 Jun 2020PONE-D-20-10711R1Rate of Intensive Care Unit admission and outcomes among patients with coronavirus: A systematic review and Meta-analysisDear Dr. Mekonnen:I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.If we can help with anything else, please email us at plosone@plos.org.Thank you for submitting your work to PLOS ONE and supporting open access.Kind regards,PLOS ONE Editorial Office Staffon behalf ofDr. Chiara LazzeriAcademic EditorPLOS ONE
Authors: Lowell Ling; Christina So; Hoi Ping Shum; Paul K S Chan; Christopher K C Lai; Darshana H Kandamby; Eunise Ho; Dominic So; Wing Wa Yan; Grace Lui; Wai Shing Leung; Man Chun Chan; Charles D Gomersall Journal: Crit Care Resusc Date: 2020-04-06 Impact factor: 2.159
Authors: Thomas W K Lew; Tong-Kiat Kwek; Dessmon Tai; Arul Earnest; Shi Loo; Kulgit Singh; Kim Meng Kwan; Yeow Chan; Chik Foo Yim; Siam Lee Bek; Ai Ching Kor; Wee See Yap; Y Rubuen Chelliah; Yeow Choy Lai; Soon-Keng Goh Journal: JAMA Date: 2003-07-16 Impact factor: 56.272
Authors: Alberto Zangrillo; Luigi Beretta; Anna Mara Scandroglio; Giacomo Monti; Evgeny Fominskiy; Sergio Colombo; Federica Morselli; Alessandro Belletti; Paolo Silvani; Martina Crivellari; Fabrizio Monaco; Maria Luisa Azzolini; Raffaella Reineke; Pasquale Nardelli; Marianna Sartorelli; Carmine D Votta; Annalisa Ruggeri; Fabio Ciceri; Francesco De Cobelli; Moreno Tresoldi; Lorenzo Dagna; Patrizia Rovere-Querini; Ary Serpa Neto; Rinaldo Bellomo; Giovanni Landoni Journal: Crit Care Resusc Date: 2020-04-23 Impact factor: 2.159
Authors: Musa A Garbati; Shamsudeen F Fagbo; Vicky J Fang; Leila Skakni; Mercy Joseph; Tariq A Wani; Benjamin J Cowling; Malik Peiris; Ahmed Hakawi Journal: PLoS One Date: 2016-11-03 Impact factor: 3.240
Authors: Matthew J Cummings; Matthew R Baldwin; Darryl Abrams; Samuel D Jacobson; Benjamin J Meyer; Elizabeth M Balough; Justin G Aaron; Jan Claassen; LeRoy E Rabbani; Jonathan Hastie; Beth R Hochman; John Salazar-Schicchi; Natalie H Yip; Daniel Brodie; Max R O'Donnell Journal: Lancet Date: 2020-05-19 Impact factor: 79.321
Authors: Wei Liu; Zhao-Wu Tao; Lei Wang; Ming-Li Yuan; Kui Liu; Ling Zhou; Shuang Wei; Yan Deng; Jing Liu; Hui-Guo Liu; Ming Yang; Yi Hu Journal: Chin Med J (Engl) Date: 2020-05-05 Impact factor: 2.628
Authors: Jonathan A C Sterne; Srinivas Murthy; Janet V Diaz; Arthur S Slutsky; Jesús Villar; Derek C Angus; Djillali Annane; Luciano Cesar Pontes Azevedo; Otavio Berwanger; Alexandre B Cavalcanti; Pierre-Francois Dequin; Bin Du; Jonathan Emberson; David Fisher; Bruno Giraudeau; Anthony C Gordon; Anders Granholm; Cameron Green; Richard Haynes; Nicholas Heming; Julian P T Higgins; Peter Horby; Peter Jüni; Martin J Landray; Amelie Le Gouge; Marie Leclerc; Wei Shen Lim; Flávia R Machado; Colin McArthur; Ferhat Meziani; Morten Hylander Møller; Anders Perner; Marie Warrer Petersen; Jelena Savovic; Bruno Tomazini; Viviane C Veiga; Steve Webb; John C Marshall Journal: JAMA Date: 2020-10-06 Impact factor: 56.272
Authors: Saad Alhumaid; Abbas Al Mutair; Zainab Al Alawi; Khulud Al Salman; Nourah Al Dossary; Ahmed Omar; Mossa Alismail; Ali M Al Ghazal; Mahdi Bu Jubarah; Hanan Al Shaikh; Maher M Al Mahdi; Sarah Y Alsabati; Dayas K Philip; Mohammed Y Alyousef; Abdulsatar H Al Brahim; Maitham S Al Athan; Salamah A Alomran; Hatim S Ahmed; Haifa Al-Shammari; Alyaa Elhazmi; Ali A Rabaan; Jaffar A Al-Tawfiq; Awad Al-Omari Journal: Eur J Med Res Date: 2021-05-24 Impact factor: 2.175
Authors: Abdullah A Alharbi; Ahmad Y Alqassim; Ahmad A Alharbi; Ibrahim M Gosadi; Abdulwahab A Aqeeli; Mohammed A Muaddi; Anwar M Makeen; Osama A Alharbi Journal: Saudi J Biol Sci Date: 2021-07-20 Impact factor: 4.219