Literature DB >> 33121466

The translation and validation of the Arabic Version of the Polycystic Ovary Syndrome Health-Related Quality of Life Questionnaire (AR-PCOSQ).

Sultan Alghadeer1,2, Alhanouf Algarawi3, Faten Abu-Rkybah3, Mashael M Alshebly4,5, Yazed Alruthia3.   

Abstract

BACKGROUND: Polycystic ovarian syndrome (PCOS) is a hormonal disorder that is prevalent in females of reproductive age with signs and symptoms that significantly reduce self-esteem and have a negative impact on their quality of life. The management of PCOS signs and symptoms should result in an improvement in the health-related quality of life (HRQoL) of patients. Polycystic ovarian syndrome questionnaire (PCOSQ) is a disease-specific scale. The PCOSQ has been translated into different languages and assessed in different populations. The validity and reliability of PCOSQ varied depending on the ethnicity and culture of the respondents. The objective of the study was to establish a valid and reliable version of the PCOSQ (AR-PCOSQ) in Arabic.
METHODS: A cross-sectional study using the translated and validated AR-PCOSQ questionnaire was conducted by interviewing 117 women with PCOS.
RESULTS: The mean age (years) and BMI (kg/m2) of subjects were 29.90 ± 6.33 and 27.21 ± 5.54, respectively. Most of the patients had ≥ 1-year long history of PCOS (73.5%) and a post-school degree (64.96%). The content validity index (CVI) for the AR-PCOSQ from 10 gynecologists was 0.9, indicating satisfactory validity content. The internal consistency for reliability confirmation measured by Cronbach's alpha coefficient was applied. Alpha coefficients for all items together was 0.863, indicating good reliability. The intraclass correlation coefficients for each item for 30 participants were also acceptable, ranging from 0.911 to 0.986 with p value < 0.001. As far as the factor analysis is concerned, the overall Kaiser-Meyer-Olkin sampling adequacy measure was 0.772. The Bartlett sphericity test was significant (p ≤ 0.001), Indicating that there were interrelated variables.
CONCLUSION: Our results demonstrated the initial reliability and validity of the Arabic version of the PCOSQ as a measure of specific HRQoL in Saudi women with PCOS. This will fill an important gap in measuring the HRQoL for patients with PCOS in research and community settings in Saudi Arabia. The AR-PCOSQ can be used to help prioritize health-related concerns from the patient's perspective.

Entities:  

Keywords:  Arabic; Polycystic ovarian syndrome; Questionnaire; Reliability; Translation; Validity

Year:  2020        PMID: 33121466      PMCID: PMC7596927          DOI: 10.1186/s12905-020-01108-0

Source DB:  PubMed          Journal:  BMC Womens Health        ISSN: 1472-6874            Impact factor:   2.809


Background

One of the prevalent endocrine disorders among women of reproductive age is polycystic ovarian syndrome (PCOS). The global prevalence of PCOS is estimated to range between 5 and 10%; however, its prevalence in Saudi Arabia is largely unknown [1, 2]. This syndrome includes a myriad of signs and symptoms such as amenorrhea or oligomenorrhea, obesity, infertility, anovulation, acne, and hirsutism [3, 4]. These signs and symptoms can significantly lower patients’ self-esteem and negatively impact their physical quality of life [4, 5]. Furthermore, PCOS negatively affects the mental well-being of the affected patients resulting in both depression and anxiety [6]. Therefore, managing PCOS signs and symptoms should result in an improvement in patients’ health-related quality of life (HRQoL) [7]. Measuring HRQoL for PCOS patients at baseline as well as after the impact of different treatment approaches is informative and helpful to clinicians and patients alike to determine the value of each treatment approach from the patients’ perspective [8]. Today, many clinicians, health care policy makers, and regulators are interested in Patient-Reported Outcomes (PROs) to assess the quality of provided care. Of those PROs, HRQoL is considered one of most important measures in assessing the quality of care. Therefore, to evaluate the HRQoL among different patient populations, several scales have been developed These scales can be generic (whereby they are used to assess the HRQoL among patients with different medical conditions) or disease-specific [9]. Generic HRQoL scales such as the Short Form Health Survey (SF-36) or abbreviated version of World Health Organization Quality of Life (WHOQOL-BREF) scale may not be as accurate as the disease-specific HRQoL scales in measuring the HRQoL among patients with specific health care conditions such as PCOS [10]. PCOS-specific HRQoL scales such as the polycystic ovarian syndrome questionnaire (PCOSQ) have been developed to address different domains in patient HRQoL relevant to PCOS, since there is no specific HRQoL instrument to use in women with PCOS. Despite its specificity, different HRQoL outcomes among women with PCOS from different backgrounds confirm that in women with PCOS, ethnicity and culture play an important role in evaluating the quality of life. Chinese, Korean, South African, and Swedish versions of the PCOSQ were found to be reliable, valid, and culturally acceptable [11-14]. In the UK, PCOSQ was found to be reliable, but its validity needs to be improved by incorporating a dimension on acne [15]. In Iran, except for menstrual issues, the questionnaire was found to be accurate and valid in all aspects [16, 17]. The PCOSQ could be used to identify issues associated with the HRQoL in women with PCOS, evaluate the full effectiveness of treatment regimes, identify and report changes in patients' health status over time, and generate more understanding of the impact that the symptoms and treatments of PCOS could have against HRQoL. However, a variation in validity and reliability of PCOSQ was noticed among women from different ethnicities and cultures. The aim of this study was to establish a valid and reliable Arabic version of the PCOSQ.

Methods

Study design and participants

A cross-sectional study using the translated questionnaire (AR-PCOSQ) was conducted by interviewing 117 PCOS women who attended King Khalid University Hospital (KKUH) obstetrics and gynecology clinics during the period from November to December 2017. The institutional review board (IRB) at KKUH granted ethical approval (IRB Project No. E-17-2545). The criteria for inclusion were 18–45 years of age, married, Arabic-speaking women with no verbal communication difficulties. Non-classic adrenal hyperplasia, thyroid dysfunction, hyperprolactinemia, previously diagnosed diabetes, any drug with an effect on insulin levels, or hormonal drugs (including contraceptive pills) were excluded at least two months before participating.

Measurement

A specific tool to evaluate the HRQoL of women with PCOS is PCOSQ. It is composed of 26 items categorized into five sections: emotions (eight items), body hair (five items), weight concerns (five items), infertility concerns (four items), and menstrual irregularities (four items). Each item is scored with a seven-point Likert rating system where seven represents the best situation and 1 represents the worst situation. The emotions section asks questions related to mental illness, depression, mood, self-esteem, and fear of cancer as consequence of PCOS diagnosis. The body hair section contains items concerning noticeable hair in face and overabundance of hair throughout the body. The issues of gaining weight or being overweight and infertility issues such as inability to conceive and having children are included in the weight and infertility concerns sections, respectively. The menstrual irregularities section includes items regarding abnormalities in menstrual periods and body discomforts secondary to menstrual abnormalities. The mean score for all items in a section indicates the score for each woman [18].

Procedure

Two interviews were conducted to assess the face validity and test–retest reliability. The first interview was face-to-face interview while the second interview was conducted subsequently via the phone during an interval period of 5 days to 2 weeks post the face-to-face interview. This interval was selected in order to maintain the consistency and similarity of PCOS condition as the quality of life changes when PCOS condition changes with time progress. Use of the Polycystic Ovary Syndrome Questionnaire, authored by Dr. Gordon Guyatt, et al. was made under license from University, Hamilton, Canada, with the permission of the copyright owner, The Endocrine Society, Maryland, USA. A forward–backward process has been used to translate the English version of the PCOSQ into Arabic. Two bilingual translators (one with a medical experience and one without) proficiently fluent in English each independently translated the complete English version of the PCOSQ into Arabic, including item content, response options, and instructions. The two forward translations were merged into one version by primary investigators after the expert panel discussions that consist of gynecologists, professional translators, and experts in public health. Any discrepancies between the forward translations will be identified and resolved by the expert panel. Two translators independently later translated the single forward translation back into English in the backward translation while totally blinded to the PCOSQ's original English version.

Statistical analysis

Using IBM SPSS Statistics, statistical analysis was carried out. To test the validity of the Arabic translated version of PCOSQ, face and content validity was used. Reliability analysis of reliability of the test–retest as well as internal consistency were carried out.

Content validity

The content validity index (CVI) of the items was calculated based on individual consideration or feedback on our scale relevancy by a group of 10 gynecologists. The relevancy of the items was assessed using a four-point Likert scale: (1) not relevant, (2) somewhat relevant, (3) relevant, (4) very relevant. The recommended acceptable lower limit for CVI is 0.80 [19].

Face validity

To test validity, to ensure the linguistic and conceptual equivalence of the translation, and to confirm the accuracy, appropriateness, and interpretation of the translated questionnaire, AR-PCOSQ was given to 30 patients with PCOS [20].

Internal consistency

Internal consistency relates to a tool homogeneity. Cronbach's alpha coefficient value from 0 to 1 was utilized to evaluate the internal consistency. High value means that used tool is more reliable with low predictable errors. Cronbach's alpha coefficient value of ≥ 0.7 indicates acceptable internal consistency for the used tool [21].

Test–retest reliability

Intraclass correlation-coefficient (ICC) value from 0 to 1 was utilized to evaluate the test–retest reliability that aims to determine the consistency of used tool when the same tool it is applied to the same participants at two different times. The following categories were selected to interpret the agreement levels: 00–0.2 as small, 0.21–0.40 as fair, 0.41–0.60 as moderate, 0.61–0.80 as substantial and 0.81–1 as almost perfect [22].

Factor analysis

Factor analysis is a statistical tool to explain the AR-PCOSQ subscale factor structure variability. It is used to simplify the interpretation of factors and minimize the number of variables affected by each factor. The factor structure of the AR-PCOSQ was extracted by utilizing exploratory factor analysis (EFA) [23]. Kaiser–Mayer–Olkin (KMO) measure of adequacy in sampling and Bartlett’s test were used as well. KMO value greater than 0.6 indicates the sample is adequate [24, 25].

Results

A total of 117 women with PCOS have been enrolled in the study. The mean age (years) and BMI (kg/m2) of subjects were 29.9 ± 6.33 and 27.21 ± 5.54, respectively. Most of the patients had ≥ 1 year long history of PCOS (73.5%) and a post-school degree (64.96%) (Table 1).
Table 1

Socio-demographic and clinical characteristic (n = 117)

Characteristics
Age (years), mean ± SD29.90 ± 6.33
BMI (kg/m2), mean ± SD27.21 ± 5.54
History of PCOS (years), n (%)
< 1 year31 (26.5%)
≥ 1 year86 (73.5%)
Education level, n (%)
Pre-secondary school3 (2.56%)
Secondary school38 (32.48%)
Post-secondary school76 (64.96%)

SD standard deviation

Socio-demographic and clinical characteristic (n = 117) SD standard deviation Ten gynecologists (4 males; and 6 females) whose ages range from 40 to 62 with at least 10 years of experience were contacted. The content validity index (CVI) for the AR-PCOSQ from 10 gynecologists was 0.9, indicating satisfactory validity content. The ten gynecologists rated almost all the translated items as relevant clinically and culturally with very few comments on some items that were slightly modified. Thirty patients were interviewed for content validity. Their mean ages (years) and BMI (kg/m2) were 29 ± 7.08 and 26.7 ± 5.51, respectively. Most of the thirty patients had ≥ 1 year long history of PCOS (21 patients; 70%) and a post-school degree (17 patients; 56.7%). After the interview, it was ensured that the AR-PCOSQ was appropriate and relevant clinically and culturally, and that it was simple and understandable linguistically with no changes in wording required.

Reliability

The internal consistency for reliability confirmation measured by Cronbach’s alpha coefficient was applied to all participants (n = 117). For each subscale and over all items, Cronbach's alpha Reliability coefficient was calculated. As shown in Table 2, all alpha coefficients (except that for menstrual problems) exceeded the recommended value of 0.70. Also, the alpha coefficients for all items together was 0.863, indicating good reliability. The intraclass correlation coefficients for each item for the 30 participants were also acceptable, ranging from 0.911 to 0.986 with p value < 0.001 (Table 3).
Table 2

Cronbach’s alpha of the AR-PCOSQ subscales and over all items (n = 117)

SubscalesCronbach’s alphaMeanSD
Emotion and feelings0.7233.701.28
Body hair0.8884.012.08
Weight0.8493.651.88
Infertility0.7194.051.72
Menstrual problem0.6973.021.40
Over all items0.8633.671.08

SD standard deviation

Table 3

Intraclass correlation-coefficient (ICC) of the AR-PCOSQ subscales (n = 30)

SubscalesICCMean testSD test
Mean re-testSD re-test
Emotion and feelings0.986*23.6710.08
23.179.11
Body hair0.986*18.8710.31
18.379.43
Weight0.951*16.879.50
16.608.06
Infertility0.979*16.907.56
16.677.44
Menstrual problem0.911*12.707.79
10.836.86

SD standard deviation

*p value < 0.001

Cronbach’s alpha of the AR-PCOSQ subscales and over all items (n = 117) SD standard deviation Intraclass correlation-coefficient (ICC) of the AR-PCOSQ subscales (n = 30) SD standard deviation *p value < 0.001 The AR-PCOSQ was studied by conducting the key component analysis. The overall Kaiser–Meyer–Olkin sampling adequacy test was 0.772. The sphericity test of the Bartlett was significant (p ≤ 0.001) indicating that the variables correlated with one another. The AR-PCOSQ was found to have six factors. The number of explained variances ranged from 4.57 to 24.22%, with 64.44% of the overall variance explained (Table 4). Table 5 shows the factor loading from the AR-PCOSQ principal component analysis. The loading factor of the items is all greater than 0.514. In the last six items, different items were loaded in different factors.
Table 4

Total variance explained

Factor% of variance
124.22
212.92
38.79
48.26
55.68
64.57
Total variance explained64.44
Table 5

Factor loadings from the AR-PCOSQ principal component analysis

Q# and belonged subscale in the original questionnaireItemFactor
123456
Q16: HEmbarrassment about excessive body hair0.8890.039− 0.0360.1740.089− 0.024
Q26: HGrowth of visible hair0.8660.030− 0.0770.1840.1580.013
Q15: HGrowth of visible hair on face0.8570.088− 0.0240.0330.0650.019
Q9: HGrowth of visible hair on upper lip0.7480.056− 0.0040.0600.1200.222
Q1: HGrowth of visible hair on chin0.6910.1100.051− 0.048− 0.1360.399
Q10: WTrouble dealing with weight0.1710.7990.0100.068− 0.0530.117
Q3: WConcern of being overweight− 0.0460.791− 0.0450.0700.1580.122
Q12: WFelt frustration in trying to lose weight− 0.0090.7880.0730.2450.0200.030
Q24: WHave difficulty staying at your ideal weight0.1670.7700.1650.0000.1000.133
Q22: WFeel like not sexy as result of overweight0.0290.6410.0640.4610.110− 0.057
Q13: IFelt afraid of not being able to have children0.0000.0500.9070.0760.0120.021
Q5: IConcerned with infertility problems− 0.0920.0090.9030.0770.0120.034
Q25: IFeel sad because of infertility problems− 0.0100.1130.8240.0540.011− 0.109
Q6: EMoody as result of PCOS0.1240.1830.0460.7360.1270.079
Q2: EDepressed for having PCOS0.1210.0780.1080.7040.1950.278
Q11: ELow self-esteem as result of PCOS− 0.0060.1890.1930.586− 0.251− 0.017
Q4: EEasily tired0.3090.084− 0.1100.5800.4560.016
Q7: MHeadaches0.0010.016− 0.0310.0930.6950.112
Q21: MMenstrual cramps0.1320.054− 0.1150.1000.6120.148
Q19: MAbdominal bloating0.2260.2650.2330.0730.5510.093
Q14: EFelt frightened of getting cancer− 0.0490.0470.3380.0190.5140.092
Q18: ESelf-conscious as result of PCOS0.0390.2210.0450.249− 0.0320.671
Q20: MLate menstrual period0.2660.095− 0.126− 0.0490.2670.664
Q8: MIrregular menstrual problems0.113− 0.024− 0.078− 0.0050.4560.598
Q17: EWorried about having PCOS0.0740.0930.4240.3640.2740.544
Q23: IFeel lack of control over the situation with PCOS0.1020.122− 0.0060.5110.2710.521

The factor loadings of the items all exceed 0.514 (given in bold font)

H hirsutism, W weight, I infertility, E emotional and feelings, M menstrual

Total variance explained Factor loadings from the AR-PCOSQ principal component analysis The factor loadings of the items all exceed 0.514 (given in bold font) H hirsutism, W weight, I infertility, E emotional and feelings, M menstrual

Discussion

According to our findings of the PCOSQ in Arabic-speaking women, the Arabian PCOSQ version was culturally acceptable, applicable, and seemed relevant to their conditions. It has shown that the AR-PCOSQ version was overall relevant to all PCOS-related concerns as it expressed by our subjects. Despite of the fact that no item was recognized as missing, some items may be introduced or amended with further studies. In previous studies, acne domain was introduced as an essential domain to be involved into the PCOSQ as important factor to consider for assessing the wellbeing of women with PCOS [8, 17]. The satisfied internal consistency of our translated questionnaire (AR-PCOSQ) was obtained in almost all domains (body hair, emotions, weight, and infertility problems) as each domain scored above 0.7 on Cronbach's alpha correlation coefficient. However, the menstrual domain of the AR-PCOSQ scored 0.69 which is considered acceptable internal correlation coefficient according to George and Marley [26]. Similar studies among women from the United Kingdom, Canada, and Iran found similar results in achieving the reliability and validity in all domains with low value of correlation coefficient in the menstrual domains [8, 16, 18]. These low levels of achievement in the reliability and validity of the menstrual problem domain have been clarified differently. Guyatt et al. in Canada believes that the question regarding to headaches in the menstruation domain seemed not appropriate [18]. Bazarganipour et al. in Iran stated that relocating the question pointing to an irregular menstrual period (Question 8) from the emotional domain to the menstrual domain will significantly improved the reliability of both domains [17]. The menstrual domain in AR-PCOSQ will be assessed with more studies and utilization. Test–retest reliability of the PCOSQ presented intra-class correlations above 0.9 in all the domains with p value < 0.001 (Table 3). That proved the stability and consistency of the PCOSQ over time. The period of two days to a week between the interviews was adopted to reduce recall bias while remaining within two weeks as stated by the questionnaires. Despite the fact that the second interview was done in another environment (at home through phone calls) while the initial assessment was in the obstetrics and gynecology clinics at KKUH, both were done by interviewing the participants to minimize the recall bias. Similar results of satisfactory intra-class correlation (ICC ranges from 0.71 to 0.92; p value > 0.05) were reported in the Iranian version of PCOSQ [27]. Different items of PCOSQ loaded in different factors were noticed when the original English version of PCOSQ was translated to other languages or performed in various societies [8, 12, 27]. Our factor analysis of the AR-PCOSQ revealed six factors: emotions and feelings, body hair, weight, infertility, menstrual problems, and new factor. Two factors in our study (weight and body hair) were similar to the original scale of PCOSQ, with the same items loading on each factor. The infertility factor was identical except for one item ("feel a lack of control over the situation with PCOS") that loaded on a new factor. One item ("felt frightened of getting cancer) and other two items ("self-conscious as result of PCOS", and "Worried about having PCOS”) of emotions and feeling factor were loaded on menstrual problems and the new factor, respectively. Two items ("late menstrual period" and "irregular menstrual problems") of menstrual problems factor were loaded into the new factor. These results are very similar to a study conducted by Jones et al. in the United Kingdom [8]. Therefore, moving some items from one factor to another may be considered. Bazarganipour et al. in the Iranian PCOSQ version moved the item "irregular menstrual problems" from the emotional factor to the menstrual factor, and the reliability of both factors improved significantly [27]. Therefore, we assume that classifying items such as "headaches", "menstrual cramps", "abdominal bloating”, and "felt frightened of getting cancer" under the psychosomatic characteristics factor, and moving the other unmatched item to menstrual problems may improve the reliability of our study; especially the reliability of the menstrual problems factor. Although the adequate sample size was sufficient to enable factor analysis and test–retest reliability, several limitations of our study need to be mentioned. First, all the participants were from one medical center and one nationality (Saudi Arabia). Most of them had a high educational level, [64.96%, (Table 1)] and might have had good health literacy regarding their self-care and health-seeking behaviors. It is crucial for future researchers to validate the AR-PCOSQ using a sample from different regions and with subjects of various educational levels. Second, the responsiveness of the AR-PCOSQ was not assessed in this study due to the limited study period. Future research, along with sufficient follow-up time, should evaluate the ability of the AR-PCOSQ to describe the patient’s health status over time and its sensitivity to detect changes in HRQoL because of the intervention, and to determine the minimal clinical importance score to justify whether changes are clinically relevant.

Conclusions

Our findings show the objective of establishing the initial reliability and validity of the Arabic version of the PCOSQ as a measure of the specific HRQoL in Saudi patients with PCOS. This will fill an important gap in measuring the HRQoL for patients with PCOS in research and community settings in Saudi Arabia. The PCOSQ is an excellent screening tool which health-care providers can be used to help prioritize health-related concerns from the patients’ perspective.
  17 in total

1.  A Study Of A Measure Of Sampling Adequacy For Factor-Analytic Correlation Matrices.

Authors:  B A Cerny; H F Kaiser
Journal:  Multivariate Behav Res       Date:  1977-01-01       Impact factor: 5.923

Review 2.  Polycystic ovary syndrome.

Authors:  David A Ehrmann
Journal:  N Engl J Med       Date:  2005-03-24       Impact factor: 91.245

3.  Clinical and psychological correlates of quality-of-life in polycystic ovary syndrome.

Authors:  Susanne Hahn; Onno E Janssen; Susanne Tan; Katja Pleger; Klaus Mann; Manfred Schedlowski; Rainer Kimmig; Sven Benson; Efthimia Balamitsa; Sigrid Elsenbruch
Journal:  Eur J Endocrinol       Date:  2005-12       Impact factor: 6.664

4.  Depression in women with polycystic ovary syndrome: clinical and biochemical correlates.

Authors:  Natalie L Rasgon; Rekha C Rao; Sun Hwang; Lori L Altshuler; Shana Elman; Joni Zuckerbrow-Miller; Stanley G Korenman
Journal:  J Affect Disord       Date:  2003-05       Impact factor: 4.839

5.  Development of a health-related quality-of-life questionnaire (PCOSQ) for women with polycystic ovary syndrome (PCOS).

Authors:  L Cronin; G Guyatt; L Griffith; E Wong; R Azziz; W Futterweit; D Cook; A Dunaif
Journal:  J Clin Endocrinol Metab       Date:  1998-06       Impact factor: 5.958

6.  The Polycystic Ovary Syndrome Health-Related Quality of Life Questionnaire (PCOSQ): a validation.

Authors:  G L Jones; K Benes; T L Clark; R Denham; M G Holder; T J Haynes; N C Mulgrew; K E Shepherd; V H Wilkinson; M Singh; A Balen; H Lashen; W L Ledger
Journal:  Hum Reprod       Date:  2004-02       Impact factor: 6.918

7.  Iranian version of modified polycystic ovary syndrome health-related quality of Life questionnaire: Discriminant and convergent validity.

Authors:  Fatemeh Bazarganipour; Saeide Ziaei; Ali Montazeri; Fatemeh Foroozanfard; Soghrat Faghihzadeh
Journal:  Iran J Reprod Med       Date:  2013-09

8.  Diagnosis and treatment of polycystic ovary syndrome: an Endocrine Society clinical practice guideline.

Authors:  Richard S Legro; Silva A Arslanian; David A Ehrmann; Kathleen M Hoeger; M Hassan Murad; Renato Pasquali; Corrine K Welt
Journal:  J Clin Endocrinol Metab       Date:  2013-10-22       Impact factor: 5.958

9.  Development of Chinese Version of Polycystic Ovary Syndrome Health-Related Quality of Life Questionnaire (Chi-PCOSQ).

Authors:  Huang-tz Ou; Meng-Hsing Wu; Chung-Ying Lin; Pei-Chi Chen
Journal:  PLoS One       Date:  2015-10-09       Impact factor: 3.240

10.  Hirsutism in Saudi females of reproductive age: a hospital-based study.

Authors:  Atallah D Al-Ruhaily; Usman H Malabu; Riad A Sulimani
Journal:  Ann Saudi Med       Date:  2008 Jan-Feb       Impact factor: 1.526

View more
  1 in total

1.  The Reliability and Validity of the Malay Version of Polycystic Ovarian Syndrome Health-Related Quality of Life Questionnaire.

Authors:  Lim Leek Mei; Muhammad Azrai Abu; Kah Teik Chew; Aniza Ismail; Ani Amelia Zainuddin; Abdul Ghani Nur Azurah
Journal:  Front Endocrinol (Lausanne)       Date:  2022-05-26       Impact factor: 6.055

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.