Literature DB >> 21276217

Impact on the Quality of Life of an Educational Program for the Prevention of Work-Related Musculoskeletal Disorders: a randomized controlled trial.

Antonio C Santos1, Markus Bredemeier, Karen F Rosa, Vinicius A Amantéa, Ricardo M Xavier.   

Abstract

BACKGROUND: Work-related musculoskeletal disorders (WMSD) are a major cause for concern in public health and the main causes of sick leave. Treatments for WMSD have given disappointing results; prevention is the best strategy, but results of preventive measures have not been consistent. To the best of our knowledge there are few studies in literature that evaluated the impact of a specific program aimed at preventing WMSD on the quality of life of employed persons.
METHODS: One hundred and one clerical and production workers in a steel trading company were enrolled in an open-label randomized controlled clinical trial (parallel groups) to compare the efficacy of an educational program for primary prevention of WMSD with control intervention. The primary outcome was a change in the physical functioning domain of the quality of life (QL) measured by Medical Outcomes Study Short Form 36 Health Survey (SF-36). The intervention group underwent six consecutive weekly sessions concerning specific orientations for the prevention of WMSD, while the control group received general health education in an identical schedule. The SF-36 and theses Work Limitation Questionnaire (WLQ) were evaluated at weeks zero, five and 26.
RESULTS: Baseline characteristics of the interventions groups were comparable, and both groups comprised predominantly young healthy individuals. No significant differences in the variation of the SF-36 and WLQ between the groups were observed at weeks five and 26. However, both groups demonstrated improvement in some aspects of SF-36, suggesting that both educational interventions have beneficial impacts on QL.
CONCLUSIONS: A specific educational program aimed at the preventing of WMSD was comparable with general health orientation for the improvement of QL and work capacity in a sample of healthy workers during a six month period. TRIAL REGISTRATION: ClinicalTrials.gov: NCT00874718

Entities:  

Mesh:

Year:  2011        PMID: 21276217      PMCID: PMC3037313          DOI: 10.1186/1471-2458-11-60

Source DB:  PubMed          Journal:  BMC Public Health        ISSN: 1471-2458            Impact factor:   3.295


Background

Work-related musculoskeletal disorders (WMSD) are a major concern for public health and frequently lead to temporary or permanent work incapacity [1,2]. The etiology of WMSD is complex, and includes ergonomic, individual, psychological and social factors [3-5]. In the USA, 4.26 million nonfatal work-related injuries and illnesses were reported in private industry during 2004, representing an incidence of 4.8 cases per 100 equivalent full-time workers. A significant portion of all events (1.26 million, 29.6%) were related to days spent away from work, and approximately 0.4 million of these were attributed to musculoskeletal disorders [1]. In specific working populations, the prevalence of WMSD can be as high as 22-40%, according to a recent review [6]. In a cohort study concerning industrial and clerical American workers the cumulative incidence rate of upper extremity tendonitis was 24.3% during an average follow-up of 5.4 years [7]. In Brazil, accurate statistical data are scant, but according to the National Institute of Social Security (INSS), WMSD is the second most frequent cause of sick leave [2]. Treatment for WMSD has frequently shown disappointing results and prevention is regarded as the best strategy to avoid economic and social consequences [6,8-11]. Interventional preventive measures have been tested in randomized controlled trials, but results have been mixed [12-20], and the effectiveness of these programs has not been consistent. This variability could be related to the type of work, differences in training and/or educational programs, and methodological issues related to study design. To our knowledge, no previous study has evaluated the effect of a specific program aimed at the prevention of WMSD on the quality of life (QL). It may be the case that an effective educational program could improve QL for workers through teaching techniques of avoidance and controlling risk factors for WMSD. Therefore, we designed a randomized controlled trial to evaluate the impact of a specific educational program for the prevention of WMSD on measures of QL, particularly physical functioning, on a sample of workers from a steel trading company.

Methods

Study Design

This was an open label randomized controlled trial of parallel groups comparing the effect on QL of a specific educational program designed for the prevention of WMSD versus a general health orientation program.

The study population, recruitment and randomization

The study population included clerical staff and production workers from a steel trading company located in Porto Alegre/RS/Brazil (Aços Favorit Ltda ™). All workers were involved in a routine of overcharge tasks and/or repetitive movements. The company had a total of 131 active employees (May/2008). Workers less than 18 years old, on sick leave, working night shift, on vacation or those that could not be released from their activities (most of these were supervisors), were excluded. One hundred and twenty employees were eligible for randomization, and 101 agreed to participate in the study. The company presented two lists of workers organized in alphabetic order (one list consisting of clerical workers and other consisting of production workers). Using WINPEPI software [21], both lists were reorganized in an aleatory sequence, and the workers were invited to participate following this sequence. Individuals that were considered eligible for randomization (after written informed consent) were included in a numbered sequential list for randomization. Therefore, two numerically ordered lists (one for clerical and other for production workers) were produced. Using the WINPEPI software, the workers within each list were randomly allocated to one of two groups (intervention or control group) (Figure 1).
Figure 1

Flow diagrams of subjects through the trial.

Flow diagrams of subjects through the trial.

Interventions

Subjects allocated to the intervention group attended six consecutive weekly training sessions of one hour duration at the worksite (during the working period) administered by the main investigator (ACS). The number of participants in each session was limited to 25 individuals [18], and the structure of "group dynamics" (involving interaction, discussion, dramatization of daily living and work related activities) was used. The educational program was applied using flip-charts and printed material (no computer-based resources were used during the sessions). The training sessions followed the schedule as described below: - First meeting: discussion of the importance of work for QL. Debate about the objectives and elements of the educational program for prevention of WMSD, the body as a major work tool, work-related and daily living overload of the musculoskeletal system, and the importance and duration of breaks. Demonstration of some specific stretching exercises for the neck and upper extremity muscles. Distribution of didactic material (to be read as homework) reinforcing the issues discussed in the first meeting and introducing the topics of the next meeting. - Second meeting: review of issues discussed in the previous meeting. Demonstration and practice of breaks. Discussion of psychological and emotional stress. Orientation for the identification of risk situations for WMSD in specific task jobs. Distribution of didactic material concerning strategies to identify and control stress, and pictures concerning overload tasks and bad postures. - Third meeting: discussion concerning the main objectives of ergonomics, bad postures, and overload tasks. Debate about stress and interpersonal relationships. Distribution of didactic material for the fourth and fifth meetings. - Fourth meeting: an interactive training with the aim to stimulating an attitude in which each worker observes and warns his colleagues (subgroups consisting of two or three individuals) about breaks, relaxation, stretching exercises, and good posture. - Fifth meeting: debate of physiological responses to emotional stress. Training in exercises for relaxation and stretching of the upper extremities, neck, lower back and lower extremities. - Sixth meeting: review of the subjects discussed in previous meetings and general health orientations concerning sleep, alimentation, hygiene, physical activities and well-being. Individuals allocated to the control group participated in six consecutive weekly meetings of one hour duration at the worksite, during working hours, and up to 25 individuals participated in each meeting. The entire sequence of control group meetings began in the week following the end of the series of intervention group sessions. Both groups were conducted in same season (winter). The educational program was delivered by a general practitioner (KFR) using "group dynamics" techniques (involving interaction, discussion, dramatization of daily living and work related activities) with flip-charts and printed material (no computer-based resources were used during the sessions). This program consisted of explanations and debates about important general health themes, as described below. - First meeting: discussion concerning nutrition and avoiding obesity. - Second meeting: techniques for the control and reduction of stress. - Third meeting: hygiene and prevention of diseases. - Fourth meeting: the importance of adequate sleep and practices to reduce insomnia. - Fifth and sixth meetings: changing lifestyle and tips for a safe and healthy life. For both study groups, the themes discussed in the meetings were reinforced through the distribution of new didactic material three and five months after the end of the educational programs.

Measurements

Demographic and work-related data for all workers were obtained and recorded at entry into the study. The physical functioning domain measured by the Medical Outcomes Study Short Form 36 Health Survey (SF-36) was the primary outcome. This questionnaire is a general, widely used tool to evaluate QL, with eight scales: physical functioning, role physical, bodily pain, general health, vitality, social functioning, role emotional, mental health, and two summaries: the physical component and the mental component. The scales ranges from 0 (worst condition) up to 100 (best condition) [22]. The secondary outcomes were the other domains of SF-36 and the work capacity evaluated by the Work Limitation Questionnaire [WLQ]. WLQ is a tool with four scales: time management, physical demands, mental-interpersonal demands, output demands and a percentage index. The scales ranges from 0 (without limitation) up to 100 (limitations all the time) and it is possible to calculate a WLQ index using a table to define the loss of productivity. For example a 5.0 WLQ index represents a 4.9% loss in productivity when compared with healthy people [23]. Both questionnaires, the SF-36 and WLQ were well designed and easy to administer, and validated for the Brazilian-Portuguese language [22,23]. The questionnaires were self-administered before the interventions and five and 26 weeks after completion of the educational programs.

Sample size calculation

Estimating that a difference of 10 points in variation of the physical functioning SF-36 score would be clinically relevant, and considering a standard deviation of 14.0 for this variation in both groups [24], 32 patients in each experimental group would provide 80.0% statistical power to detect a significant difference (P ≤ 0.05). However, considering the possibility of loss to follow up of some individuals, a total of 101 employees underwent stratified randomization.

Ethical aspects

After being invited to participate and accepting, workers signed a written informed consent before randomization. The study project was approved by the Research Ethics Committee of the Universidade Federal do Rio Grande do Sul (registration number: 2007755). The study was also registered at ClinicalTrials.gov (number NCT00874718).

Statistical Methods

The data were analyzed using Epi Info, version 6 and SPSS for Windows, version 14.0. Quantitative variables were graphically and statistically tested (with the Kolmogorov-Smirnov goodness-of-fit test) for normality of distribution. Student's t-test was used to evaluate differences in the primary and secondary outcomes. Other variables with a normal distribution were presented as the mean ± SD, and the intra-group and inter-group comparisons were performed using paired and unpaired Student's t-tests, respectively. Baseline non-normal quantitative variables were presented as the median (25th, 75th percentiles). A chi-square goodness-of-fit test was used to compare observed and expected frequencies of sick-leaves. A two-tailed P value less than or equal to 0.05 was considered statistically significant.

Results

Of 50 patients allocated to the intervention group, two did not fill in baseline questionnaires, one was transferred to the night shift, and four were dismissed. Among the 51 patients allocated to control group, three did not fill in baseline questionnaires, one did not attend the educational meetings, and one was dismissed. The demographic and work-related features of the subjects included in the analysis are presented in Table1. Demographic and work-related characteristics of the study subjects* † Number of patients was 37 for the intervention group and 42 for the control group owing to missing data. Abbreviations: ES = elementary school; HS= high school. * Values are numbers (percentages), except where indicated otherwise. ** Student's t test, Yates corrected chi-square, Fisher's exact test or Mann-Whitney test was utilized according to the nature and distribution of data. Table 1 demonstrates that both groups had a similar distribution of age, gender, race, marital status, sector of job, medical condition, and current use of medications, body mass index, physical activity and years in work. The intervention group tended to have a higher median baseline physical functioning (table 1) and bodily pain score of SF-36 (median, percentiles 25-75: 72.0, 51.0-84.0 versus 61.5, 41.0-84 in controls; P = 0.043).
Table 1

Demographic and work-related characteristics of the study subjects*

Intervention Group (n = 43)Control Group (n = 46)
Age - mean (SD)30.6 (10.2)31.2 (8.8)

Male26 (60.5)34 (73.9)

Caucasians36 (83.7)42 (91.3)

Married20 (46.5)26 (56.5)

Educational status †:
complete ES2 (5.4)6 (14.3)
complete HS32 (86.5)32 (76.2)
complete university3 (8.1)4 (9.5)

Sector:
administrative20 (46.5)18 (39.1)
productive23 (53.5)28 (60.9)

Medical condition7 (16.3)12 (26.1)

Current use of medications7 (16.3)7 (15.2)

Body Mass Index - mean (SD)25.0 (3.0)26.0 (2.9)

Physical activity26 (63.4)28 (60.9)

Years of work - median (percentiles 25, 75)7.0 (3.0, 14.0)10.5 (3.88, 19.0)

Number of presences in the educational meetings - median (percentiles 25, 75)6.0 (5.0, 6.0)6.0 (5.0, 6.0)

Baseline Physical functioning score - median (percentiles 25, 75)95.0 (85.0, 100.0)90.0 (85.0, 95.0)

Baseline Work limitation questionnaire index (percent) - median (percentiles 25, 75)2.76 (1.67, 3.63)2.88 (1.10, 5.03)

† Number of patients was 37 for the intervention group and 42 for the control group owing to missing data. Abbreviations: ES = elementary school; HS= high school.

* Values are numbers (percentages), except where indicated otherwise.

** Student's t test, Yates corrected chi-square, Fisher's exact test or Mann-Whitney test was utilized according to the nature and distribution of data.

Primary analysis

At week 26 no significant differences in the variation of the physical functioning domain of the SF-36 were evident: -1.49 in the intervention group and 0.92 in the control group, mean difference of -2.41 (95% confidence interval, -11.8, 2.32) (Table 2). The results remained comparable when clerical and production workers were analyzed separately.
Table 2

Comparison of the variation of the SF-36 and WLQ scores (between baseline and week 26) in the experimental groups.

Intervention GroupControl GroupMean difference95% CIP Value*
nMean (SD)nMean (SD)

SF-36 scores

Physical functioning37-1.49 (21.5)380.92 (19.4)-2.41-11.8, 7.00.613

Role physical386.58 (24.4)385.49 (34.6)1.09-12.6, 14.80.874

Bodily pain3910.9 (21.1)†389.63 (22.4)†1.27-8.6, 11.20.800

General health364.94 (10.4)†362.64 (13.9)2;31-3.5, 8.10.428

Vitality367.78 (16.2)†376.76 (20.2)1.02-7.5, 9.60.813

Social functioning356.43 (21.9)3611.11 (23.9)†-4.68-15.5, 6.20.393

Role emotional387.89 (39.8)3814.04 (35.2)-6.14-23.3, 11.00.479

Mental health398.37 (16.0)†374.32 (16.5)4.05-3.4, 11.50.281

Physical component summary345.04 (10.1)†364.64 (16.2)0.41-6.1, 6.90.900

Mental component summary318.55 (17.2)†349.52 (19.4)†-0.97-10.1, 8.10.832

WLQ scores

Time management360.56 (13.5)35-0.11 (14.3)0.66-5.9, 7.20.841

Physical demands374.62 (32.5)383.35 (38.3)1.27-15.1, 17.60.877

Mental-interpersonal demands37-2.10 (6.3)37-1.70 (11.6)-0.41-4.8, 3.90.853

Output demands38-0.92 (9.4)37-5.95 (12.8)†5.02-0.2,10.20.057

WLQ index (percent)34-0.18 (2.4)34-0.72 (3.2)0.54-0.8,1.80.435

* Student's t test. † P ≤ 0.01 by paired Student's t comparing baseline and week 26 scores within the group.

Abbreviations: SF-36 = Medical Outcomes Study 36 - Item short-form health survey; WLQ = Work Limitation Questionnaire.

Comparison of the variation of the SF-36 and WLQ scores (between baseline and week 26) in the experimental groups. * Student's t test. † P ≤ 0.01 by paired Student's t comparing baseline and week 26 scores within the group. Abbreviations: SF-36 = Medical Outcomes Study 36 - Item short-form health survey; WLQ = Work Limitation Questionnaire.

Secondary analysis

No significant differences between the intervention and control groups were observed in the secondary outcomes (Table 2). The intra-group variations of the SF-36 and WLQ scores showed significant improvements in bodily pain scores, general health, vitality, mental health, Physical Component Summary (PCS), and Mental Component Summary (MCS) in the intervention group (Table 2). The control group presented statistically significant improvements in bodily pain, social functioning, MCS and output demands (Table 2). In this study, the incidence of WMSD with days away from work was very low during, before and after the study period. In the 10 months prior to the study, during the three months of the educational program, and in the seven months after completion, there were only four, one and one occurrences, respectively (goodness-of-fit test, P = 0.631).

Discussion

The present study was designed to compare the effects on QL measured by SF-36, of a specific educational program aimed at preventing WMSD and a program of general health orientation, in workers from a steel trading company. No significant differences in the outcomes were observed between the groups. However, both groups presented with improvements in some physical and emotional aspects. Previous RTC studies evaluating interventions for the prevention of WMSD have yielded inconsistent results. This may be related to differences in the kinds of jobs and tasks, the focus on different WMSDs, differences in the prevention programs, and methodological issues, making comparisons between studies difficult. Andersen et al [25], compared the effect of specific exercises training, general exercises, and general health counseling in office workers, and demonstrated reductions in neck and shoulder pain with both types of exercises, but no effect of general health education. In a re-analysis of the same data, the authors observed that asymptomatic individuals at the baseline were more likely to be free of neck-shoulder pain when allocated to the specific training group [26]. Two studies that tested interventions for the prevention of back pain using a back school based education program in the occupational setting (post office) [12,14] and companies involving physically demanding jobs [14] in comparison to usual care, demonstrated no benefit from a training program. Pillastrini et al compared the effect of an informative brochure (concerning self-care at the work station) and ergonomic intervention with an informative brochure alone for video display terminal users. In the group that received the ergonomic intervention there was evidence of lower overload in tasks, and a reduction in lower back, neck, and shoulder symptoms [15]. In the present study, the absence of significant differences between the intervention and control groups may be due to several possible factors. Both groups received educational health orientations and subjects allocated to different groups were working in the same environment, so it is possible that the motivation for the prevention of WMSD also increased in the control group by "contamination" from the experimental group. The observation that both groups demonstrated significant improvements in some aspects of the SF36 and WLQ may be related to a placebo effect and/or the fact of being part of a clinical trial ("Hawthorne effect") [27]. Additionally, the orientation about a health promoting behavior in the control group may have had a beneficial effect on QL. Given that the final evaluation was performed at six months, an effect of intervention in the long term cannot be ruled out. In addition, considering that the differences between the intervention and control groups are not clinically or statistically significant (and no consistent numerical trend in favor of one groups was evident), lack of statistical power is not a likely explanation. However, some confidence intervals were wide (some including a difference of 10 points in the variation of scores) and a clinically significant difference between the groups cannot be excluded. Another possible explanation for the absence of a difference in results is the "ceiling effect", which occurs when the preventing effect is diluted by the good health condition of the sample under study. The company where the study took place had a low incidence of sick-leave, and the mean age and the mean number of years of labor activity in the sample were relatively low. The mean baseline values of all domains of the SF-36 and the WLQ were within the normal range. In addition, baseline values in the control group for the domains of physical functioning (table 1) and bodily pain of the SF-36 were worse than in the experimental group. Furthermore, a negative correlation was observed between the baseline physical functioning score and variation of this score between baseline and week 26 (figure 2). Therefore, subjects with lower baseline scores presented with significantly greater improvements at the 26 week evaluation. It is possible that the control group was subjected to a more intense "regression to the mean" effect, thus reducing differences with the intervention group.
Figure 2

Correlation between baseline physical functioning score of SF-36 and variation of this score between baseline and week 26 (n = 75, rS = -0.393, p < 0.001)

Correlation between baseline physical functioning score of SF-36 and variation of this score between baseline and week 26 (n = 75, rS = -0.393, p < 0.001)

Conclusion

This study failed to demonstrate a beneficial impact on the quality of life of an educational program aimed to prevent WMSD in comparison with general health education, in a sample of healthy workers with a low incidence of sick-leave. However, both groups demonstrated improvements in some aspects of quality of life, suggesting that educational interventions improve workers' health conditions. Further studies are necessary to determinate the value of education on long term outcomes and in populations at higher risk of WMSD.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

ACS was the principal investigator, and participated in the protocol development, study design, conduct of the study, analysis of the data, writing up and revision of drafts of the manuscript. KFR participated in the program conducted for the control group, and VAA participated in data organization. MB participated in the analysis of data, writing up and revision of drafts of the manuscript. RMX participated in the study design, co-ordination and conduct of the study. All authors read and approved the the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here: http://www.biomedcentral.com/1471-2458/11/60/prepub
  24 in total

1.  Effects of an active ergonomics training program on risk exposure, worker beliefs, and symptoms in computer users.

Authors:  Brenda L Greene; David M DeJoy; Stephen Olejnik
Journal:  Work       Date:  2005

2.  Group training with healthy computing practices to prevent repetitive strain injury (RSI): a preliminary study.

Authors:  Erik Peper; Katherine H Gibney; Vietta E Wilson
Journal:  Appl Psychophysiol Biofeedback       Date:  2004-12

3.  Consulting in industry: Moving beyond traditional interventions.

Authors:  Scott C Ege
Journal:  Work       Date:  2006

4.  A randomised controlled trial evaluating the effects of two workstation interventions on upper body pain and incident musculoskeletal disorders among computer operators.

Authors:  D M Rempel; N Krause; R Goldberg; D Benner; M Hudes; G U Goldner
Journal:  Occup Environ Med       Date:  2006-05       Impact factor: 4.402

Review 5.  Systematic review of back schools, brief education, and fear-avoidance training for chronic low back pain.

Authors:  J I Brox; K Storheim; M Grotle; T H Tveito; A Indahl; H R Eriksen
Journal:  Spine J       Date:  2007-11-19       Impact factor: 4.166

Review 6.  Repetitive strain injury.

Authors:  Maurits van Tulder; Antti Malmivaara; Bart Koes
Journal:  Lancet       Date:  2007-05-26       Impact factor: 79.321

7.  One-year randomized controlled trial with different physical-activity programs to reduce musculoskeletal symptoms in the neck and shoulders among office workers.

Authors:  Anne Katrine Blangsted; Karen Søgaard; Ernst A Hansen; Harald Hannerz; Gisela Sjøgaard
Journal:  Scand J Work Environ Health       Date:  2008-02       Impact factor: 5.024

Review 8.  Ergonomics and musculoskeletal disorders: overview.

Authors:  Peter Buckle
Journal:  Occup Med (Lond)       Date:  2005-05       Impact factor: 1.611

9.  The impact of workplace risk factors on the occurrence of neck and upper limb pain: a general population study.

Authors:  Julius Sim; Rosie J Lacey; Martyn Lewis
Journal:  BMC Public Health       Date:  2006-09-19       Impact factor: 3.295

10.  WINPEPI (PEPI-for-Windows): computer programs for epidemiologists.

Authors:  Joseph H Abramson
Journal:  Epidemiol Perspect Innov       Date:  2004-12-17
View more
  6 in total

1.  Importance of musculoskeletal pain in work activities in obese individuals.

Authors:  C F Caberlon; A V Padoin; C C Mottin
Journal:  Obes Surg       Date:  2013-12       Impact factor: 4.129

2.  Assessing the effects of an educational program for the prevention of work-related musculoskeletal disorders among school teachers.

Authors:  Jian Shuai; Pengying Yue; Liping Li; Fengying Liu; Sheng Wang
Journal:  BMC Public Health       Date:  2014-11-24       Impact factor: 3.295

Review 3.  Effects of exercise on pain of musculoskeletal disorders: a systematic review.

Authors:  Elisângela Valevein Rodrigues; Anna Raquel Silveira Gomes; Aldre Izabel Pchevozniki Tanhoffer; Neiva Leite
Journal:  Acta Ortop Bras       Date:  2014       Impact factor: 0.513

4.  Effects of workplace upper extremity resistance exercises on function and symptoms of workers at a tertiary hospital: a randomized controlled trial protocol.

Authors:  Natália Claro da Silva; Flávia Pessoni Faleiros Macedo Ricci; Vinícius Restani de Castro; Alessandra Cristina Ramos de Lima; Ester R do Carmo Lopes; Leonardo Dutra de Salvo Mauad; Karen A Kawano Suzuki; Maria Eloísa de Oliveira Medeiros; Joyce Silva de Santana; Fernanda Ludmilla Rossi Rocha; Marisa de Cássia Registro Fonseca
Journal:  BMC Musculoskelet Disord       Date:  2022-02-05       Impact factor: 2.362

5.  Impact of two ergonomics training on prevalence of upper and lower extremity complaints among nurses.

Authors:  Amir Bahrami-Ahmadi; Hamid Reza Hoseini; Elaheh Kabir-Mokamelkhah; Naser Dehghan; Mashallah Aghilinejad
Journal:  J Educ Health Promot       Date:  2021-11-30

6.  Impact on quality of life in teachers after educational actions for prevention of voice disorders: a longitudinal study.

Authors:  Raquel Aparecida Pizolato; Maria Inês Beltrati Cornacchioni Rehder; Marcelo de Castro Meneghim; Glaucia Maria Bovi Ambrosano; Fábio Luiz Mialhe; Antonio Carlos Pereira
Journal:  Health Qual Life Outcomes       Date:  2013-02-27       Impact factor: 3.186

  6 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.