Literature DB >> 31188977

Effects of the implementation of a hand hygiene education program among ICU professionals: an interrupted time-series analysis.

Diana Marcela Prieto Romero1, Maycon Moura Reboredo1,2, Edimar Pedrosa Gomes1,2, Cristina Martins Coelho1, Maria Aparecida Stroppa de Paula1, Luciene Carnevale de Souza1, Fernando Antonio Basile Colugnati2, Bruno Valle Pinheiro1,2.   

Abstract

OBJECTIVE: To evaluate the effects that a hand hygiene education program has on the compliance of health professionals in an ICU.
METHODS: This was a quasi-experimental study with an interrupted time-series design, conducted over a 12-month period: the 5 months preceding the implementation of a hand hygiene education program (baseline period); the 2 months of the intensive (intervention) phase of the program; and the first 5 months thereafter (post-intervention phase). Hand hygiene compliance was monitored by one of the researchers, unbeknownst to the ICU team. The primary outcome measure was the variation in the rate of hand hygiene compliance. We also evaluated the duration of mechanical ventilation (MV), as well as the incidence of ventilator-associated pneumonia (VAP) at 28 days and 60 days, together with mortality at 28 days and 60 days.
RESULTS: On the basis of 959 observations, we found a significant increase in hand hygiene compliance rates-from 31.5% at baseline to 65.8% during the intervention phase and 83.8% during the post-intervention phase, corresponding to prevalence ratios of 2.09 and 2.66, respectively, in comparison with the baseline rate (p < 0.001). Despite that improvement, there were no significant changes in duration of MV, VAP incidence (at 28 or 60 days), or mortality (at 28 or 60 days).
CONCLUSIONS: Our findings indicate that a hand hygiene education program can increase hand hygiene compliance among ICU professionals, although it appears to have no impact on VAP incidence, duration of MV, or mortality.

Entities:  

Mesh:

Year:  2019        PMID: 31188977      PMCID: PMC6715164          DOI: 10.1590/1806-3713/e20180152

Source DB:  PubMed          Journal:  J Bras Pneumol        ISSN: 1806-3713            Impact factor:   2.624


INTRODUCTION

Healthcare-associated infections (HAIs) are recognized as a major problem among inpatients, prevalence rates of 6.4-8.7% having been reported in North America and Europe. , Ventilator-associated pneumonia (VAP) is one of the most common HAIs, being the most common among ICU patients. VAP increases the duration of mechanical ventilation (MV) and the length of hospital stay, resulting in increased costs. Mortality rates are high among patients with VAP, ranging from 20% to 50%, although it is impossible to determine the extent to which VAP alone accounts for these rates. , Measures to prevent VAP include the use of noninvasive ventilation in an attempt to avoid endotracheal intubation; the use of protocols to evaluate the possibility of daily sedation interruption and ventilator weaning; keeping the head of the bed elevated; the use of silver nitrate-coated catheters or tubes with increased sealing capacity to allow subglottic secretion drainage; and providing oral care with chlorhexidine, selective oropharyngeal/digestive decontamination, or a combination of the two. , Although none of the care bundles specifically designed to prevent VAP include proper hand hygiene by health care workers, it is generally recommended for infection prevention, given that transmission of pathogens from one patient to another via the hands of health care workers plays an important role in the pathogenesis of HAIs (including VAP). Although the importance of proper hand hygiene has been established, compliance rates remain low. Studies have shown that educational measures are effective in increasing compliance rates and reducing infection rates. , However, these results are difficult to extrapolate because interventions, observation periods, ICU characteristics, and ICU staff characteristics vary across studies. In addition, few studies have evaluated the impact that a hand hygiene education program alone has on VAP incidence. We hypothesized that such a program might increase hand hygiene compliance and, consequently, reduce the incidence of VAP. To test this hypothesis, we conducted the present study in the ICU of a teaching hospital.

METHODS

This was a quasi-experimental study with an interrupted time-series design, conducted between January and December of 2016 in the ICU of the Hospital Universitário da Universidade Federal de Juiz de Fora (HU-UFJF, Federal University of Juiz de Fora University Hospital), located in the city of Juiz de Fora, Brazil. The HU-UFJF is a 150-bed teaching hospital, and the HU-UFJF ICU is a 9-bed medical-surgical ICU for adult patients. The present study was approved by the Research Ethics Committee of the HU-UFJF. Nosocomial infection control measures already in place in the HU-UFJF ICU included contact isolation (masks, caps, and gowns being worn for contact with patients from whom methicillin-resistant Staphylococcus aureus [MRSA], vancomycin-resistant Enterococcus faecalis, or multidrug-resistant gram-negative bacilli were isolated) and implementation of a VAP prevention bundle including the following: keeping the head of the bed elevated; evaluating the possibility of daily sedation interruption and ventilator weaning; providing oral care with chlorhexidine; and prophylaxis of acute gastroduodenal mucosal injury and deep vein thrombosis.

Procedures

From June to July of 2016, all health care workers and students in the HU-UFJF ICU participated in a hand hygiene education program. The program consisted of weekly sessions attended by groups of up to eight individuals. During the sessions, the following topics were discussed: the importance of HAIs; the incidence of HAIs in the HU-UFJF ICU; the importance of cross-transmission of HAIs; the role of proper hand hygiene as a preventive measure; and how often health care workers and students in the ICU performed hand hygiene, as well as when they should do it and how to do it correctly. After the first two months, monthly sessions were held from August to December of 2016). During the sessions, the aforementioned topics were discussed again and data on hand hygiene compliance and HAI incidence rates were presented and discussed with participants.

Hand hygiene compliance monitoring

Hand hygiene compliance was monitored by one of the researchers, unbeknownst to the ICU team. The following hand hygiene practices were surveyed: 1. hand hygiene before direct contact with patients (even when gloves are worn); 2. hand hygiene after direct contact with patients (including hand hygiene after glove removal); 3. hand hygiene before performing aseptic procedures (before handling an invasive device for patient care, with or without gloves); 4. hand hygiene after body fluid exposure risk (after contact with body fluids/excretions, mucous membranes, nonintact skin, or wound dressings and if moving from a contaminated body site to another body site during care of the same patient); and 5. hand hygiene after contact with inanimate surfaces and objects (including medical equipment) in the immediate vicinity of the patient. The observer recorded all hand hygiene opportunities (defined by the presence of one or more of the aforementioned indications for hand hygiene) and whether or not it was performed. Hand hygiene was performed by washing hands with soap and water or by using an alcohol-based hand rub. Compliance rates were calculated by dividing the number of times ICU personnel performed hand hygiene by the number of hand hygiene opportunities. The quality of hand hygiene (performed by washing hands with soap and water or by using an alcohol-based hand rub) was not evaluated. Hand hygiene opportunities were recorded for each staff category, including physicians, nurses, physiotherapists, nursing technicians, students, and other health care workers. Hand hygiene compliance was monitored by one of the researchers over 2-h periods randomly distributed through the week. Hand hygiene compliance was monitored over a 12-month period: the 5 months preceding the implementation of the hand hygiene education program (baseline period); the 2 months of the intensive (intervention) phase of the program; and the first 5 months thereafter (post-intervention phase).

Outcomes

The primary outcome measure was the variation in the rate of hand hygiene compliance. A secondary outcome measure was the variation in the rate of hand hygiene compliance by staff category (physicians, nurses, physiotherapists, nursing technicians, students, and other health care workers). We also evaluated the incidence of VAP (expressed as the number of episodes per 1,000 ventilator-days), the proportion of patients who developed VAP, and the duration of MV (number of days off MV over a 28-day period), as well as 28-day and 60-day mortality rates for the baseline period and the post-intervention phase. In patients who had been on MV for at least 48 h, VAP was diagnosed on the basis of a chest X-ray finding of a new or progressive infiltrate, accompanied by at least two of the following findings: fever or hypothermia (i.e., a body temperature above 37.8°C or below 36.0°C); leukocytosis or leukopenia (i.e., leukocytes > 12,000/mm3 or < 4,000/mm3); and purulent tracheal secretions, confirmed by semiquantitative culture of tracheal aspirate showing growth of potentially pathogenic bacteria.

Statistical analysis

Data are presented as means and standard deviations, medians and interquartile ranges, or proportions, depending on their characteristics and distribution (Shapiro-Wilk test and visual analysis of the distribution histogram). Between-group differences were assessed by the independent sample t-test, the Mann-Whitney U test, the chi-square test, or Fisher’s exact test, as appropriate. Kaplan-Meier analysis was performed in order to compare mortality and VAP incidence at 60 days between the baseline period and the post-intervention phase, distribution differences being assessed by the log-rank test. Generalized estimating equation models adjusted for correlated data were used in order to estimate prevalence ratios, with opportunities × bed as clusters, a Poisson family distribution, and a log link function. Robust variance estimation was used, an independent correlation structure being assumed. For compliance rates by staff category and for prevalence rates (presented as a graph), the same type of model was used with an interaction term for professionals × observation period (baseline, intervention, and post-intervention). All statistical estimates and tests performed by this model are presented in graph form. All tests were performed with the Statistical Package for the Social Sciences, version 13 (SPSS Inc., Chicago, IL, USA), and MedCalc, version 17.8.6 (MedCalc Software, Mariakerke, Belgium).

RESULTS

During the study period, 324 patients were admitted to the HU-UFJF ICU: 142 at baseline, 51 during the intervention phase, and 131 during the post-intervention phase. Of those 324 patients, 130 required MV and were therefore at risk of developing VAP: 57 at baseline, 17 during the intervention phase, and 56 during the post-intervention phase. Table 1 shows the baseline demographic and clinical characteristics of the patients on MV admitted before and after the implementation of the hand hygiene education program.
Table 1

Baseline and post-intervention characteristics of admitted patients.a

CharacteristicBaselinePost-interventionp
(n = 57)(n = 56)
Age, years63.0 [28.5]57.0 [17.0]0.73
Male sex31 (54.4)35 (62.5)0.38
SAPS II50.3 ± 19.851.9 ± 18.40.65
SOFA9 [9]9 [5]0.94
Indication for ICU admission, N (%) 0.20
Clinical indication32 (57.1)26 (46.4)
Elective surgery22 (38.6)26 (46.4)
Urgent surgery3 (5.3)4 (7.2)
Comorbidities
Hypertension27 (47.4)28 (50.0)0.78
Diabetes13 (22.8)8 (14.3)0.24
COPD7 (12.3)8 (14.3)0.75
Heart failure9 (15.8)7 (12.5)0.62
Kidney failure6 (10.5)11 (19.6)0.17
Active cancer14 (24.6)13 (23.2)0.87
Immunodeficiency13 (22.8)12 (21.4)0.86

SAPS: Simplified Acute Physiology Score; and SOFA: Sequential Organ Failure Assessment. aValues expressed as median [interquartile range], n (%), or mean ± SD.

SAPS: Simplified Acute Physiology Score; and SOFA: Sequential Organ Failure Assessment. aValues expressed as median [interquartile range], n (%), or mean ± SD. A total of 959 hand hygiene opportunities were observed over the course of 42 2-h periods. Of those 959 opportunities, 419 (43.7%) were observed before the implementation of the program, 114 (11.9%) were observed during the program, and 426 (44.4%) were observed after the implementation of the program. Nursing technicians accounted for 41.2% of all opportunities; physicians, nurses, students, physiotherapists, and other health care workers accounted for 24.5%, 14.3%, 6.5%, 6.3%, and 7.3%, respectively. There was a progressive and significant increase in hand hygiene compliance rates-from 31.5% at baseline to 65.8% during the intervention phase and 83.8% during the post-intervention phase, corresponding to prevalence ratios of 2.09 and 2.66, respectively, in comparison with the baseline rate (Table 2). Although sample size was not calculated, the statistical power of the study was 100% for a significance level of 5% and an 84% increase in compliance. However, this should be interpreted with caution because of the possibility of type II errors (even with a null probability).
Table 2

Prevalence ratios for hand hygiene compliance during the observation periods.

Observation periodPR95% CIp
Baseline1
Intervention phase2.092.22-3.19< 0.0001
Post-intervention phase2.661.52-2.86< 0.0001

PR: prevalence ratio. Results obtained by a repeated-measures Poisson model.

PR: prevalence ratio. Results obtained by a repeated-measures Poisson model. The same behavior was observed when we analyzed the rates for each staff category. Post-intervention compliance rates were significantly higher than baseline compliance rates for all health care workers in the ICU except physiotherapists; however, their baseline compliance rates were already high (Figure 1).
Figure 1

Prevalence rates for hand hygiene compliance in the ICU during the observation periods. *p < 0.05 vs. baseline.

There were no significant differences between the baseline period and the post-intervention phase regarding VAP incidence, VAP at 28 days, or VAP at 60 days. In addition, there were no significant differences between the baseline period and the post-intervention phase regarding mortality at 28 days, mortality at 60 days, or the number of days off MV over a 28-day period in the ICU (Table 3). The Kaplan-Meier curves for mortality and VAP incidence showed no differences between the two observation periods (Figure 2).
Table 3

Outcomes for patients on mechanical ventilation.a

OutcomeBaselinePost-interventionp
(n = 57)(n = 56)
VAP IDR0.0110.0120.39
VAP at 28 days4 (7.0)7 (12.5)0.33
VAP at 60 days8 (14.0)11 (19.6)0.42
Mortality at 28 days31 (54.4)25 (44.6)0.30
Mortality at 60 days34 (59.6)33 (58.9)0.94
Days off MV over a 28-day period5.9 [9.9]6.1 [10.0]0.94

IDR: incidence density rate (per 1,000 ventilator-days); VAP: ventilator-associated pneumonia; and MV: mechanical ventilation. aValues expressed as absolute value (proportion) or median [interquartile range].

Figure 2

Kaplan-Meier curves for ventilator-associated pneumonia (VAP) and mortality at 60 days.

IDR: incidence density rate (per 1,000 ventilator-days); VAP: ventilator-associated pneumonia; and MV: mechanical ventilation. aValues expressed as absolute value (proportion) or median [interquartile range].

DISCUSSION

Our hand hygiene education program resulted in a significant increase in hand hygiene compliance during the study period. However, it had no impact on VAP incidence, duration of MV, or mortality. Transmission of pathogens from one patient to another via the hands of health care workers plays an important role in the pathogenesis of HAIs. , For this reason (and because hand hygiene compliance rates are low), the World Health Organization (WHO) published in 2009 guidelines for implementing and evaluating hand hygiene education programs in health care facilities. The 2009 WHO guidelines recommend five strategies: availability of hand hygiene products at the bedside or for health care professionals to carry with them; educational programs for health care professionals; (verbal and written) reminders in the workplace; performance feedback; and support from the hospital administration in order to encourage staff involvement. Several studies have evaluated the efficacy of the 2009 WHO guidelines or the effects of some of the guideline components on different outcomes. In 2017, Gould et al. published a systematic review of 26 studies, including randomized and uncontrolled studies, examining the effects of strategies to improve adherence to hand hygiene recommendations. They concluded that programs including all five strategies recommended in the WHO guidelines and those including some but not all of the recommended strategies can increase hand hygiene compliance, the level of evidence being low. Of the studies evaluating programs including all five strategies recommended in the WHO guidelines, only 1 was a randomized study, having shown a 6.3% difference in hand hygiene compliance between the intervention and control groups. Four other randomized studies evaluated programs including some but not all of the strategies recommended in the WHO guidelines, and a meta-analysis of the results of those studies showed increased hand hygiene compliance in the intervention groups (OR = 1.19; 95% CI: 1.01-1.42). In a systematic review employing less stringent inclusion criteria, Luangasanatip et al. found 6 randomized studied and 25 uncontrolled studies. Of the 6 randomized studies, 2 were included in a meta-analysis, an OR of 1.35 (95% CI: 1.04-1.76) for adherence to hand hygiene practices having been found in the intervention groups. Of the uncontrolled before-and-after studies, 18 were included in the meta-analysis, which showed a similar result, although with a wider confidence interval (OR = 1.82; 95% CI: 0.2-12.2). Our study consisted of educational sessions, during which participants received feedback on hand hygiene compliance and ICU infection rates. One of the strategies recommended in the 2009 WHO guidelines, i.e., availability of hand hygiene products at the bedside, had been implemented in our facility before the beginning of the study. The prevalence ratios for hand hygiene compliance during and after the intervention (i.e., 2.09 and 2.66, respectively) in the present study are consistent with those found in previous studies, , which also consisted of implementing educational measures. In a randomized study conducted over the course of 12 months in 30 ICUs in Canada, implementation of an educational program resulted in an increase in hand hygiene compliance in the intervention and control groups (from 15.8% to 48.2% in the former and from 15.9% to 42.6% in the latter), corresponding to a 6.3% difference (95% CI: 4.3-8.4%). In a study conducted in 100 hospitals in China and involving a hand hygiene education program, there was an absolute increase of 32.7% (95% CI: 15.6-49.7%) in the rate of compliance for hand hygiene opportunities before patient contact and of 20.4% (95% CI: 5.6-35.2%) for hand hygiene opportunities after patient contact. It is difficult to compare the aforementioned results because of the specific characteristics of the ICUs evaluated in the studies, including different profiles of patients and health care professionals, with different views of hygiene practices. Therefore, interventions to increase hand hygiene compliance should be tailored to local needs and available resources. In our case, an education-based (and therefore low-cost) intervention was effective in increasing hand hygiene compliance. Most studies evaluating clinical outcomes of strategies to increase hand hygiene compliance have found reductions in MRSA infection and colonization rates, as well as a reduction in Clostridium difficile infections. - Few studies have evaluated the effects of such strategies on VAP incidence. In one such study, conducted in two cardiovascular surgery ICUs, an educational program combined with hand hygiene compliance monitoring and oral care resulted in a 59% reduction in VAP incidence. Although it was impossible to establish the individual impact of each measure (hand hygiene compliance monitoring and oral care), the authors found a negative correlation between hand hygiene compliance and VAP incidence (r2 = 0.878; p < 0.001), a finding that suggests the importance of hand hygiene compliance. In another study, a program to increase hand hygiene compliance was implemented in 150 inpatient units in 12 hospitals. In addition to increasing compliance rates (from 58.1% to 94.7% over the course of two years), the program reduced the incidence of VAP (from 49% to 45%; p = 0.045). Likewise, a 12-month educational program conducted in the ICU of a tertiary hospital resulted in a 75% increase in hand hygiene compliance rates and a reduction in VAP incidence (from 6.9 episodes per 1,000 ventilator-days to 3.7 episodes per 1,000 ventilator-days; p < 0.01). In our study, we found no association between improved hand hygiene compliance and reduced VAP incidence. This might be due to the low incidence of MRSA VAP in our ICU, hand hygiene being most effective in reducing MRSA infections. Given that gram-negative bacteria (particularly Pseudomonas aeruginosa and Acinetobacter baumannii) are the most common causes of VAP in our ICU, improved hand hygiene compliance might have had no impact on VAP incidence. Our study has limitations that might explain why improved hand hygiene compliance had no impact on VAP incidence. First, the magnitude of improvement might have been insufficient to reduce VAP incidence. Second, the periods of hand hygiene compliance monitoring and the number of patients observed might have been insufficient, resulting in limited statistical power to detect the clinical effect. Third, the observer recorded whether or not hand hygiene was performed; hand hygiene technique was not recorded. Finally, because VAP is multifactorial, the fact that only one of the factors involved in its pathogenesis was addressed might have been insufficient to reduce VAP incidence. In addition to having had no impact on VAP incidence, improved hand hygiene compliance had no impact on mortality, duration of MV, or length of ICU stay in the present study. This might be due to the fact that our educational program had no impact on VAP incidence, as well as to the fact that the aforementioned outcomes are more closely related to the condition that led to hospitalization than to hospital-acquired infections. The present study has other limitations that should be considered. Because our study was not a randomized controlled trial, factors other than the educational program itself might have contributed to improved hand hygiene compliance. The ICU team might have noticed the presence of the observer during the periods of hand hygiene compliance monitoring, despite the fact that the observer made an effort to go unnoticed. This might have resulted in improved hand hygiene compliance during the observation periods. Given that the present study was conducted in a single ICU, with its own epidemiological characteristics, the results obtained cannot be necessarily extrapolated to other ICUs. In conclusion, our findings indicate that a hand hygiene education program can improve hand hygiene compliance in the ICU, although it appears to have no impact on VAP incidence, mortality, duration of MV, or length of ICU stay.
  22 in total

1.  A point prevalence survey of health care-associated infections in Canadian pediatric inpatients.

Authors:  Katie Rutledge-Taylor; Anne Matlow; Denise Gravel; Joanne Embree; Nicole Le Saux; Lynn Johnston; Kathryn Suh; John Embil; Elizabeth Henderson; Michael John; Virginia Roth; Alice Wong; Jayson Shurgold; Geoff Taylor
Journal:  Am J Infect Control       Date:  2011-11-12       Impact factor: 2.918

2.  Effect of a multifaceted intervention on adherence to hand hygiene among healthcare workers: a cluster-randomized trial.

Authors:  Dominik Mertz; Nancy Dafoe; Stephen D Walter; Kevin Brazil; Mark Loeb
Journal:  Infect Control Hosp Epidemiol       Date:  2010-11       Impact factor: 3.254

3.  Using the Targeted Solutions Tool® to Improve Hand Hygiene Compliance Is Associated with Decreased Health Care-Associated Infections.

Authors:  M Michael Shabot; Mark R Chassin; Anne-Claire France; Juan Inurria; Jan Kendrick; Stephen P Schmaltz
Journal:  Jt Comm J Qual Patient Saf       Date:  2016-01

4.  Management of Adults With Hospital-acquired and Ventilator-associated Pneumonia: 2016 Clinical Practice Guidelines by the Infectious Diseases Society of America and the American Thoracic Society.

Authors:  Andre C Kalil; Mark L Metersky; Michael Klompas; John Muscedere; Daniel A Sweeney; Lucy B Palmer; Lena M Napolitano; Naomi P O'Grady; John G Bartlett; Jordi Carratalà; Ali A El Solh; Santiago Ewig; Paul D Fey; Thomas M File; Marcos I Restrepo; Jason A Roberts; Grant W Waterer; Peggy Cruse; Shandra L Knight; Jan L Brozek
Journal:  Clin Infect Dis       Date:  2016-07-14       Impact factor: 9.079

5.  Attributable mortality of ventilator-associated pneumonia: a meta-analysis of individual patient data from randomised prevention studies.

Authors:  Wilhelmina G Melsen; Maroeska M Rovers; Rolf H H Groenwold; Dennis C J J Bergmans; Christophe Camus; Torsten T Bauer; Ernst W Hanisch; Bengt Klarin; Mirelle Koeman; Wolfgang A Krueger; Jean-Claude Lacherade; Leonardo Lorente; Ziad A Memish; Lee E Morrow; Giuseppe Nardi; Christianne A van Nieuwenhoven; Grant E O'Keefe; George Nakos; Frank A Scannapieco; Philippe Seguin; Thomas Staudinger; Arzu Topeli; Miquel Ferrer; Marc J M Bonten
Journal:  Lancet Infect Dis       Date:  2013-04-25       Impact factor: 25.071

6.  Reduction in ventilator associated pneumonia in a mixed intensive care unit after initiation of a novel hand hygiene program.

Authors:  Matthew D Koff; Howard L Corwin; Michael L Beach; Steven D Surgenor; Randy W Loftus
Journal:  J Crit Care       Date:  2011-03-24       Impact factor: 3.425

Review 7.  The Lowbury lecture: behaviour in infection control.

Authors:  D Pittet
Journal:  J Hosp Infect       Date:  2004-09       Impact factor: 3.926

8.  Changing knowledge, behavior, and practice related to universal precautions among hospital nurses in China.

Authors:  Jin Huang; Dongju Jiang; Xianglian Wang; Yuyuan Liu; Kristopher Fennie; Jane Burgess; Ann B Williams
Journal:  J Contin Educ Nurs       Date:  2002 Sep-Oct       Impact factor: 1.224

Review 9.  Interventions to improve hand hygiene compliance in patient care.

Authors:  Dinah J Gould; Donna Moralejo; Nicholas Drey; Jane H Chudleigh; Monica Taljaard
Journal:  Cochrane Database Syst Rev       Date:  2017-09-01

Review 10.  Comparative efficacy of interventions to promote hand hygiene in hospital: systematic review and network meta-analysis.

Authors:  Nantasit Luangasanatip; Maliwan Hongsuwan; Direk Limmathurotsakul; Yoel Lubell; Andie S Lee; Stephan Harbarth; Nicholas P J Day; Nicholas Graves; Ben S Cooper
Journal:  BMJ       Date:  2015-07-28
View more
  1 in total

1.  Posters as a Tool to Improve Hand Hygiene among Health Science Students: Case-Control Study.

Authors:  María Gázquez-López; Encarnación Martínez-García; Adelina Martín-Salvador; María Adelaida Álvarez-Serrano; Inmaculada García-García; Rafael A Caparros-Gonzalez; María Ángeles Pérez-Morente
Journal:  Int J Environ Res Public Health       Date:  2021-10-22       Impact factor: 3.390

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.