Literature DB >> 28089510

A novel computer-based method for measuring the acetabular angle on hip radiographs.

Seda Sahin1, Emin Akata1, Orcun Sahin2, Cengiz Tuncay3, Hüseyin Özkan4.   

Abstract

OBJECTIVE: The aim of this study was to propose a new computer based method for measuring acetabular angles on hip radiographs and to assess its practicality, sensitivity and reliability for acetabular angle measurement.
METHODS: A total of 314 acetabulum were assessed on 157 pelvic X-ray images. Acetabular angles were measured with both the conventional method (Method 1) and our proposed method (Method 2). All the Acetabular Index (AI) angle, Acetabular Angle (AA) and Acetabular Center (ACM) angle were measured with both methods.
RESULTS: The mean AI angle for Method 1 is 11.02° ± 2.7° and the mean AI angle for Method 2 is 10.08° ± 1.88°, the mean AA angle for Method 1 is 39.5° ± 5.3° and the mean AA angle for Method 2 is 39.36° ± 4.68°, the mean ACM angle for Method 1 is 50.5° ± 6.01° and the mean ACM angle for Method 2 is 55.42° ± 12.43°.
CONCLUSION: Our novel automated method appear to be reliable and practical for acetabular angle measurement on hip radiographs. LEVEL OF EVIDENCE: Level III, Diagnostic study.
Copyright © 2017 Turkish Association of Orthopaedics and Traumatology. Production and hosting by Elsevier B.V. All rights reserved.

Entities:  

Keywords:  Acetabular angle; Computer-based measurement; Hip radiograph; Obturator foramen; Pelvic X-ray; Pelvic angle

Mesh:

Year:  2017        PMID: 28089510      PMCID: PMC6197581          DOI: 10.1016/j.aott.2016.09.002

Source DB:  PubMed          Journal:  Acta Orthop Traumatol Turc        ISSN: 1017-995X            Impact factor:   1.511


Anteroposterior (AP) pelvic X-ray imaging is one of the most commonly used radiographic projections of the pelvis. Assessment of the acetabular morphology and the femoral head-acetabulum congruency with angular measurements is one of the basic steps of AP pelvis radiographical analysis.1, 2 For this reason, an easy, reliable and accurate measurement of the acetabular angle is very important. In the literature, various techniques have been proposed for acetabular angle measurements, including the acetabular index (AI), defined by Hilgenreiner and Tönnis; acetabular angle (AA), defined by Sharp; and acetabular center–margin (ACM) angle, defined by Idelberger and Frank. The AI and AA angles provide information about the slope of the acetabulum while the ACM angle measures its depth. These angles are the most preferable ‘conventional manual angle measurement methods’. Nevertheless, there is still an ongoing debate in the literature about the gold standard measurement method, since the manual measurement of the acetabular angle is very dependent on the experience of the observer and the quality of the AP radiograph. To overcome these controversies, methods about the computer-assisted extraction of new anatomical landmarks and calculation of angles automatically on hip radiographs have been recently developed.8, 9, 10, 11, 12, 13, 14 In this paper, we aimed to describe new anatomical landmarks and reference lines in regards to establishing a fully automated acetabular angle measurement method which is based on the obturator foramen.

Patients and methods

Between January 2014 and December 2014 and between June 2011 and May 2012, all patients who were admitted to Orthopedics Department in outpatient clinics in two different hospitals (one university hospital, one military hospital), and who were scheduled to undergo pelvic X-ray evaluation, were considered for this study. This study was approved by the Institutional Review Board of Başkent University (November 28, 2013) and ethical approval was received from Gülhane Military Medical Academy Hospital Ethics Committee (May 25, 2011). In order to prevent any bias and to acquire a homogenous study population, all X-rays were taken under a standard procedure. As an inclusion criterion, only ‘mature pelvic X-rays’ without obvious osteophyte formation, bone defects or other pathological changes on the acetabular rim were accepted. Patients who had a previous pelvic or lumbosacral surgery, previous fracture history regarding the acetabulum, or patients with coxarthrosis, severe bone deformities and metabolic bone disorders, radiographs of suboptimal quality, and an excessive pelvic rotation as assessed by an obturator foramen index beyond the range of 0.6–1.8 were excluded from the analyses. Eventually, a total of 157 pelvic X-rays (314 hips) were found eligible. The study group consisted of 123 male and 43 female patients with a mean age of 56.7 ± 13.3 years. All X-rays were digitally recorded in the Orthopedics Department and the PACS v.2.0 (picture archiving and communications systems) software was used to store the DICOM (Digital Imaging and Communications in Medicine) images. All conventional manual measurements (Method 1) were done with two experienced observers after printing the high-quality pelvic X-ray images. In order to perform the standardized measurements as precisely as possible, a detailed common understanding of important pelvic landmarks of all the measurements was ensured prior to the analyses. Three previously mentioned acetabular measurement methods were used for the conventional radiographic evaluation: Acetabular index (AI) defined by Hilgenreiner and Tönnis. AI is the angle between the horizontal teardrop line and a line drawn through the medial point of the sourcil and the lateral acetabular rim. Acetabular angle (AA) defined by Sharp. AA is the angle between the horizontal teardrop line and a line through the inferior teardrop point and the lateral rim of the acetabulum. Acetabular center–margin (ACM) angle defined by Idelberger and Frank. The ACM is defined as the angle between the MC and CA lines constructed on the acetabulum. (A: the upper point of acetabulum, B: the lower point of the acetabulum, C: the intersection point of the acetabulum with the orthogonal line drawn from the center of the AB line, MC: the line which was passed through the center of the AB line, CA: the line that connects the A and C points.) Our proposed method (Method 2) is a novel, geometric method which uses the AutoCAD 2013 (Autodesk Inc., San Rafael, CA, USA) and MATLAB 7.13.0 (The MathWorks Inc., Natick, MA, USA) softwares. First, a reference image was determined by clinicians as a gold standard image and it was used to present the proposed novel geometric angle measurement method drawings. The image was transferred to AutoCAD and was opened on the user interface. Then, a hand drawn template was designed on this interface based on the reference image. After that, the fully automated angle measurement algorithm framework was developed on MATLAB. 157 images were executed for each run of this algorithm and angle measurement results were produced as an output. The template was operated on a sample image (x1) row by row (Fig. 1) to find the best fitting sub-image as the obturator foramen, by using some image processing techniques whose descriptions are beyond the scope of this paper. After the obturator foramen was detected, its center of mass was determined as the major reference point for all subsequent measurements. The measurements of acetabular angles were based on the four reference lines which were drawn automatically, as the second step of the proposed method (Fig. 2).
Fig. 1

Identifying the starting reference point (center of mass of the obturator foramen). Note that, first, a hand-drawn template is designed on AutoCAD. Then, it is operated on the hip radiograph (x1) to detect similarities between the sub-images and this is used to decide the most similar sub-image to the template image as the obturator foramen. Then, the center of mass of the obturator foramen is identified.

Fig. 2

Reference lines are drawn automatically after detection of the center of mass of the obturator foramen. X1 line: The line parallel to the X-axis and passes through the center of mass of the obturator foramen (Point A) and intersects with the Y-axis. X2 line: The reference line parallel to the X1-axis and passes through the superior margin of the obturator foramen and intersects with the Y-axis. The distance between these two lines are referred as “t” distance. X3 line: The line parallel to the X2-axis and passes through 3t above the center of mass of the obturator foramen and intersects with the Y-axis. X4 line: The reference line which is parallel to the X3-axis and passes through the lateral margin of the acetabular roof (Point C) and intersects with the Y-axis. After establishing these reference lines, the angular measurements are performed by the computerized method.

Identifying the starting reference point (center of mass of the obturator foramen). Note that, first, a hand-drawn template is designed on AutoCAD. Then, it is operated on the hip radiograph (x1) to detect similarities between the sub-images and this is used to decide the most similar sub-image to the template image as the obturator foramen. Then, the center of mass of the obturator foramen is identified. Reference lines are drawn automatically after detection of the center of mass of the obturator foramen. X1 line: The line parallel to the X-axis and passes through the center of mass of the obturator foramen (Point A) and intersects with the Y-axis. X2 line: The reference line parallel to the X1-axis and passes through the superior margin of the obturator foramen and intersects with the Y-axis. The distance between these two lines are referred as “t” distance. X3 line: The line parallel to the X2-axis and passes through 3t above the center of mass of the obturator foramen and intersects with the Y-axis. X4 line: The reference line which is parallel to the X3-axis and passes through the lateral margin of the acetabular roof (Point C) and intersects with the Y-axis. After establishing these reference lines, the angular measurements are performed by the computerized method. The angle formed between the X3 line and the line drawn from point F to point C was accepted as AI (Fig. 3).
Fig. 3

Geometrical-based measurement method for the acetabular index (AI). The AI is the angle formed between the CF and X3 lines.

Geometrical-based measurement method for the acetabular index (AI). The AI is the angle formed between the CF and X3 lines. The angle formed between the X1 line and the line drawn from point A to point C was accepted as AA (Fig. 4).
Fig. 4

Geometrical-based measurement method for the acetabular angle (AA). The AA is the angle formed between the CA and X1 lines.

Geometrical-based measurement method for the acetabular angle (AA). The AA is the angle formed between the CA and X1 lines. The angle formed between the LR line and the CL line was accepted as ACM angle. The method of measurement is summarized in Fig. 5.
Fig. 5

Geometrical-based measurement method for the acetabular center–margin (ACM) angle. The ACM angle is formed between the LR and the CL lines. A distance: The distance which is between Point R and Point N. T: The reference point located on the middle of the A distance. L: The reference point located on A/2 unit above Point T. R: The reference point located on the line between Point L and the point of intersection of the X2 line.

Geometrical-based measurement method for the acetabular center–margin (ACM) angle. The ACM angle is formed between the LR and the CL lines. A distance: The distance which is between Point R and Point N. T: The reference point located on the middle of the A distance. L: The reference point located on A/2 unit above Point T. R: The reference point located on the line between Point L and the point of intersection of the X2 line. All measurements with the conventional (Method 1) and proposed (Method 2) methods were recorded in a database and their mean values and standard deviations were calculated. Angular measurements were also analyzed to see if there are any differences based on gender. Then, all the data derived from the conventional and proposed methods were statistically compared. Compliance with the normal distribution of continuous variables was checked with the Shapiro–Wilk test. Homogeneity of groups' variances was checked by Levene's test. After the distribution of data and homogeneity of variances in these data were found normal, a paired sample t-test which was based on the comparative results for the two different angle measurement methods on same images was used. The SPSS v.17.0 (SPSS Inc., Chicago, IL, USA) and MedCalc 13.1.0.0 (MedCalc Software, Ostend, Belgium) statistical package programs were used for the analysis of the data set. The level of statistical significance was set at p < 0.05.

Results

A total of 157 pelvic X-rays (314 hips) were analyzed. The homogeneity of age and gender variances within the study group was normal. For Method 1, the mean AI values for the hips in males and females were 10.85°±2.44° and 11.12°±3.01°, respectively, and there was no statistically significant difference (p = 0.52). For Method 2, the mean AI values for the hips in males and females were 10.03°±1.96° and 10.14°±1.80°. Again, no statistically significant difference was detected between males and females in comparison to the proposed method (p = 0.66). Using Method 1 and Method 2, the mean AI values were 11.02°±2.7° and 10.08°±1.88°, respectively. There was a statistically significant difference between Method 1 and Method 2 (p = 0.01). The mean AI values for the two methods regarding each side, gender, and statistical p values are summarized in Table 1, Table 2, Table 3.
Table 1

The mean and standard deviation values of the acetabular angles for Method 1 and 2 and their statistical p values.

AnglesMethod 1 (Mean ± SD)Method 2 (Mean ± SD)p
AI11.02°±2.70°10.08°±1.88°0.01
AA39.50°±5.30°39.36°±4.68°0.37
ACM50.50°±6.01°55.42°±12.43°0.01

AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation.

Table 2

The mean and standard deviation values of the acetabular angles for the right and left hips and their statistical p values.

AnglesMethod 1 (Mean ± SD)
Method 2 (Mean ± SD)
RightLeftpRightLeftp
AI11.06°±6.3°10.91°±6.07°0.31810.25°±2.10°9.92°±1.74°0.492
AA38.66°±4.59°39.44°±4.41°0.51039.60°±4.70°39.12°±4.50°0.096
ACM52.35°±12°48.65°±12.79°<0.00156.43°±12.06°54.42°±11.52°0.110

AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation.

Table 3

The mean and standard deviation values of the acetabular angles for male and female patients and their statistical p values.

AnglesMethod 1 (Mean ± SD)
Method 2 (Mean ± SD)
MaleFemalepMaleFemalep
AI10.85°±2.44°11.12°±3.01°0.5210.03°±1.96°10.14°±1.80°0.66
AA38.55°±5.28°39.55°±5.32°0.2339.04°±4.53°39.68°±4.83°0.39
ACM50.26°±5.2°50.74°±6.83°0.6454.5°±11.24°56.35°±13.63°0.38

AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation.

The mean and standard deviation values of the acetabular angles for Method 1 and 2 and their statistical p values. AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation. The mean and standard deviation values of the acetabular angles for the right and left hips and their statistical p values. AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation. The mean and standard deviation values of the acetabular angles for male and female patients and their statistical p values. AA: acetabular angle, ACM angle: acetabular center–margin angle, AI: acetabular index, SD: standard deviation. Using Method 1, the mean AA values for the hips in males and females were 38.55°±5.28° and 39.55°±5.32°, respectively. There was no statistically significant difference between male and female patients in comparison to the conventional method (p = 0.23). For Method 2, the mean AA values for male and female patients were 39.04°±4.53° and 39.68°±4.83°, respectively. Again no statistically significant difference was found between male and female patients in comparison to the proposed method (p = 0.39). Using Method 1 and Method 2, mean AA measurements were 39.50°±5.30° and 39.36°±4.68°, respectively. No statistically significant difference was detected between Method 1 and Method 2 (p = 0.37). The mean AA values for the two methods regarding each side, gender and statistical p values are summarized in Table 1, Table 2, Table 3. Using Method 1, the mean ACM values in males and females were 50.26°±5.20° and 50.74°±6.83°, respectively. There was no statistically significant difference between males and females in comparison to the conventional method (p = 0.64). Using Method 2, the mean ACM angle values in male and female hips were 54.50°±11.24° and 56.35°±13.63°, respectively. There was also no statistically significant difference between male and female patients in comparison to the proposed method (p = 0.38). Using Method 1 and Method 2, the mean ACM angle values were noted as 50.50°±6.01° and 55.42°±12.43°, respectively. There was a significant difference between Method 1 and Method 2 (p < 0.01). The mean ACM values for the two methods regarding each side, gender and statistical p values are summarized in Table 1, Table 2, Table 3.

Discussion

Reliable orthopedic measurements have significant importance in correctly detecting and diagnosing different types of orthopedic diseases. The automated angle measurement system can utilize clinicians' studies and offers an objective evaluation for these measurements. In this study, the main purpose was to develop a new computer-based angle measurement system whose measurements on an optimal level approximate to the clinician's manual measurements. This study is one of the first multidisciplinary studies in the literature which gives us a new perspective for some of the most commonly used acetabular angle measurement methods. In this study, a collaboration of orthopedic medicine and computer sciences has been achieved to define a novel acetabular angle measurement method based on a fully automated computer-based technique. In the literature, it is very well-known that the acetabular angle measurements are very crucial for the detection of some major hip pathologies, including hip dysplasia.1, 2, 7, 9, 11, 15, 16 Nevertheless, the gold standard method for the measurement of the acetabulum, the femoral head and its relationship with the pelvis on plain radiographs is still a matter of discussion.17, 18 We believe that, to have precise measurements of the acetabular angles, the method should be easy-to-use, reliable and consistent. A computer-based technique can provide these features with the advantage of prevention of any observer bias. Although, the computer-based measurements were previously published in the literature in orthopedics research field, including computer-assisted surgeries and radiographic measurements,19, 20 there is no study that solely analyzes the acetabular angle measurements on pelvic X-ray images to diagnose pelvic diseases for different age groups, via a fully automated and specifically designed computer-based approach. Thus, for this study, we have developed a specific computer-based technique, in order to measure the most commonly used acetabular angles in an automatic manner, and compared our new method to the classic manual measurement techniques. The detailed description of the computing techniques and algorithms are left beyond the scope of this paper. There are several angular measurement methods in the literature, which define different aspects of hip dysplasia, including acetabular depth, acetabular inclination, femoral head-acetabular congruency, and femoral anteversion.1, 2, 7, 11, 12, 16 These angles are required for the identification of radiographic quantitative factors predictive of long-term outcome for hip dysplasia, since a poor anatomic result is often detectable long before clinical symptoms appear. Nevertheless, most of these manual angular measurements are highly observer-dependent, need experience, technically demanding and have low interobserver reliability. In order to overcome these controversies, many reliability and reproducibility studies have been reported in the literature.10, 11, 12, 13, 21, 22 In a study by Nelitz et al, 100 hip radiographs of adult patients with hip dysplasia were analyzed for the reliability of the most common radiographic measurement methods and the authors concluded that the AI and the ACM angle have low inter- and intraobserver reliability. In another study by Kay et al, 24 anteroposterior pelvis radiographs were evaluated for manual AI measurements by five observers, including three senior orthopedic residents and two attending pediatric orthopedic surgeons. As a result, it was concluded that manual AI measurements had large inter- and intraobserver variability. In the last decade, with the advancement in computer science and technology, there is an increasing demand for the development of digitalized and/or computer-based measurement methods. At the beginning, the technical development in digital photo technology and establishment of PACS have provided better ways for dealing with these issues. Although this rapid progress of digital imaging modalities have led to more systematic, automated measurements in radiographic studies, the development of computer-based techniques, which provides a fully automated calculation of acetabular angles, is still lagging behind. In a study by Pedersen et al, the results of a digitizing program which determines 12 anatomic locations on AP pelvic radiographs were analyzed, and the authors concluded that the method demonstrated very good reliability coefficients. The limitation with Pedersen's study is that, the method does not have a fully automated manner, i.e. after detection of the landmarks, the measurements are done by observers, not by the program itself. In another study by Engesaeter et al, manual versus digital measurement techniques were compared for hip dysplasia in skeletal maturity. Pelvic radiographs from 95 participants were included and three observers measured the radiographs using both a digital measurement program and manually. Thus, it was concluded that, regardless of the measurement technique, there was a large variation between observers. The major drawback for Engesaeter's study is also the digital measurement technique which is mainly observer-dependent. We believe that, although these previously defined different digital measurement techniques enable us to determine the anatomic landmarks and draw the angular lines definitely, the final angle measurements are done by the observers which may lead to variability. To overcome this issue, a digital program should measure the angles in a fully automated manner to prevent any observer bias, and to have a more standardized and reliable angle measurement. In this study, a fully automated computer-based technique was designed for the calculation of the acetabular angles on digital AP pelvic radiographs. The approach accepts the obturator foramen as the major landmark for the calculations. For this reason, the pelvic X-ray used for the measurements should have no pelvic rotation, and the obturator foramen must be clearly visible in order to have the most accurate results. The major drawback of this approach is the distorted shape of the obturator foramen. Pelvic X-rays from patients who had previous fractures of the ischium or pubis, leading to distorted shape of the obturator foramen, are not suitable for this approach. In our study, we compared our proposed method with the conventional manual measurement. We believe that, due to its fully automatic characteristics, our new approach has reliable, consistent and close results with the classic manual measurement method. The clinical importance of this automated radiographic evaluation is to understand the anatomy and disease patterns seen in the pelvis, which improve the clinician's ability to make the correct diagnosis. Some of the limitations of our study must be acknowledged. First, a study population with a larger number of X-rays must be analyzed in order to have more accurate results. Second, although the angles obtained by the proposed method had comparable results with those in the literature, reliability tests should be performed in computer sciences. And finally, we studied only three acetabular angles; more and various angular measurements must be also evaluated in order to broaden the application of our approach in orthopedic medicine. In conclusion, this new approach enables us to calculate the acetabular angles without any need for manual measurements. Our method is easy-to-use, reliable and efficient. We believe that, with the use of this proposed method, physicians can give objective results which provide a consistent prognostic factor for patients who had acetabular dysplasia and other orthopedic diseases. Additionally, the angle measurement tables are constructed to determine the angle intervals for normal cases in this study; thus, future studies featuring different acetabular angles with larger study populations for different bone diseases are required.

Conflict of interests

The authors declare that they have no conflict of interest related to the study.
  24 in total

1.  [Normal values of several acetabular angles on hip radiographs obtained from individuals living in the Eskişehir region].

Authors:  Abdurrahman Ozçelik; Hakan Omeroğlu; Ulukan Inan; Bülent Ozyurt; Sinan Seber
Journal:  Acta Orthop Traumatol Turc       Date:  2002       Impact factor: 1.511

2.  [A new method for determination of the angle of the pevic acetabulum in child and in adult].

Authors:  K IDELBERGER; A FRANK
Journal:  Z Orthop Ihre Grenzgeb       Date:  1952

3.  Reliability and agreement of measures used in radiographic evaluation of the adult hip.

Authors:  Nicholas H Mast; Franco Impellizzeri; Stephan Keller; Michael Leunig
Journal:  Clin Orthop Relat Res       Date:  2010-07-02       Impact factor: 4.176

4.  The reliability of measurements of pelvic radiographs in infants.

Authors:  F G Boniforti; G Fujii; R D Angliss; M K Benson
Journal:  J Bone Joint Surg Br       Date:  1997-07

5.  A systematic approach to the plain radiographic evaluation of the young adult hip.

Authors:  John C Clohisy; John C Carlisle; Paul E Beaulé; Young-Jo Kim; Robert T Trousdale; Rafael J Sierra; Michael Leunig; Perry L Schoenecker; Michael B Millis
Journal:  J Bone Joint Surg Am       Date:  2008-11       Impact factor: 5.284

6.  Reproducibility of radiographic hip measurements in adults.

Authors:  Ronan Bouttier; Johanne Morvan; Bernard Mazieres; Anne-Christine Rat; Liana Euller Ziegler; Patrice Fardellone; Bruno Fautrel; Francis Guillemin; Jacques Pouchot; Christian Roux; Joël Coste; Alain Saraux
Journal:  Joint Bone Spine       Date:  2012-03-23       Impact factor: 4.929

7.  Radiological findings for hip dysplasia at skeletal maturity. Validation of digital and manual measurement techniques.

Authors:  Ingvild Øvstebø Engesæter; Lene Bjerke Laborie; Trude Gundersen Lehmann; Francesco Sera; Jonas Fevang; Douglas Pedersen; José Morcuende; Stein Atle Lie; Lars Birger Engesæter; Karen Rosendahl
Journal:  Skeletal Radiol       Date:  2011-09-25       Impact factor: 2.199

Review 8.  Radiographic assessment of osteoarthritis.

Authors:  D L Swagerty; D Hellinger
Journal:  Am Fam Physician       Date:  2001-07-15       Impact factor: 3.292

9.  Quantification of the radiographic joint space width of the ankle.

Authors:  Berna Goker; Emel Gonen; Mehmet D Demirag; Joel A Block
Journal:  Clin Orthop Relat Res       Date:  2009-04-21       Impact factor: 4.176

10.  Reproducibility and sensitivity to change of a new method of computer measurement of joint space width in hip osteoarthritis. Performance of three radiographic views obtained at a 3-year interval.

Authors:  T Conrozier; K Brandt; M Piperno; P Mathieu; F Merle-Vincent; E Vignon
Journal:  Osteoarthritis Cartilage       Date:  2008-12-24       Impact factor: 6.576

View more
  2 in total

1.  Diagnostic Performance of a New Convolutional Neural Network Algorithm for Detecting Developmental Dysplasia of the Hip on Anteroposterior Radiographs.

Authors:  Hyoung Suk Park; Kiwan Jeon; Yeon Jin Cho; Se Woo Kim; Seul Bi Lee; Gayoung Choi; Seunghyun Lee; Young Hun Choi; Jung Eun Cheon; Woo Sun Kim; Young Jin Ryu; Jae Yeon Hwang
Journal:  Korean J Radiol       Date:  2020-11-26       Impact factor: 3.500

2.  Detection of developmental dysplasia of the hip in X-ray images using deep transfer learning.

Authors:  Mohammad Fraiwan; Noran Al-Kofahi; Ali Ibnian; Omar Hanatleh
Journal:  BMC Med Inform Decis Mak       Date:  2022-08-13       Impact factor: 3.298

  2 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.