Literature DB >> 33970578

Which Nonsurgical Treatments Do Patients Believe Are Most Effective for Hip and Knee Arthritis?

Cindy R Nahhas1, Brian C Fuller, Charles P Hannon, Tad L Gerlinger, Denis Nam, Craig J Della Valle.   

Abstract

BACKGROUND: The purpose of this study was to determine which nonsurgical treatments patients believe are most effective for managing pain secondary to hip and knee arthritis.
METHODS: Five hundred sixty-five consecutive patients were administered an anonymous questionnaire developed in consultation with a center with expertise in survey design. Statistical analyses included Student t-test, Fisher Exact, Wilcoxon Rank-Sum test, and generalized cost-effectiveness analysis.
RESULTS: Four hundred thirty-six patients completed the questionnaire (response rate 77.2%). Opioids (52 of 118; 44.1%), prescription nonsteroidal anti-inflammatory drugs (NSAIDs) (67 of 200; 33.5%), and corticosteroid injections (87 of 260; 33.5%) were reported as most effective. Stem cell and platelet-rich plasma injections were selected by three of 12 (25.0%) and three of 15 patients (19.5%), respectively, and physical therapy (PT) by 50 of 257 patients (19.5%). Twenty-five percent of respondents received opioids, commonly prescribed by primary care providers (48.2%) and orthopaedic surgeons (39.5%). Opioid use correlated with lower patient-reported effectiveness of PT, NSAIDs, and corticosteroid injections (P < 0.05). The highest cost-effectiveness ratios were NSAIDs, opioids, and acetaminophen (2.2, 3.7, 4.0, and 5.4, respectively). The lowest cost-effectiveness ratios were stem cell injections, platelet-rich plasma injections, and PT (1966.7, 520.8, and 138.6, respectively).
CONCLUSIONS: The nonsurgical treatments that are reported by patients to be most effective are oftentimes the least expensive.

Entities:  

Year:  2020        PMID: 33970578      PMCID: PMC7434029          DOI: 10.5435/JAAOSGlobal-D-20-00046

Source DB:  PubMed          Journal:  J Am Acad Orthop Surg Glob Res Rev        ISSN: 2474-7661


The pain associated with osteoarthritis can have a detrimental impact on a patient's function and quality of life.[1,2] Total joint arthroplasty is an effective treatment option for end-stage osteoarthritis,[3,4] but a trial of conservative management is prudent and should be tried before surgical intervention. There are many nonsurgical treatment options available to patients for the treatment of hip and knee osteoarthritis.[2,5,6] The American Academic of Orthopaedic Surgeons (AAOS) published the guidelines to assist in making evidence-based decisions in the conservative management of hip and knee osteoarthritis.[7,8] Studies support the use of strengthening, low impact aerobic exercise, weight loss, nonsteroidal anti-inflammatory drugs (NSAIDs), and tramadol in the management of knee osteoarthritis.[1,9101112] Physical therapy (PT), NSAIDs, and intraarticular corticosteroids are recommended for conservative treatment of hip osteoarthritis.[13-15] Inconclusive evidence exists regarding the use of acetaminophen, opioids, and platelet-rich plasma (PRP) injections, and hyaluronic acid injections.[7,8] In addition, the literature largely consists of studies comparing the effectiveness of one or two treatment options and lacks a study of patients' attitudes toward which conservative treatments are most effective. Despite AAOS recommendations, many patients undergo conservative treatment modalities that are either not endorsed or have inconclusive evidence.[2,16,17] A recent study by Bedard et al.[16] demonstrated that if only AAOS-recommended treatment modalities were used, the cost associated with treatment of osteoarthritis of the knee could be decreased by 45% in the year before arthroplasty. With the contemporary emphasis on minimizing healthcare costs, careful consideration should be given to the cost benefit ratio of conservative treatments for osteoarthritis of the hip and knee. The purpose of this study was to determine which nonsurgical treatments that patients reported are most effective for managing pain secondary to hip and knee arthritis and to determine the cost-effectiveness of each treatment modality.

Methods

Study Population and Questionnaire Administration

A consecutive series of 565 new patients presenting to one of three arthroplasty surgeons at a single academic medical center were invited to participate in this study. All patients were undergoing their initial visit for arthroplasty evaluation. All patients must have been diagnosed with arthritis by a physician before being eligible to schedule an appointment with any of the three surgeons. An anonymous questionnaire was given to patients at the start of their first clinical appointment. The survey was administered only once to patients presenting to clinic over a 5-month period from November 1, 2018, to April 1, 2019. The 32-question survey was distributed by a single mode (paper) and was self-administered (Appendix 1, http://links.lww.com/JG9/A75). The voluntary and anonymous nature of the questionnaire was outlined to patients in a cover letter attached to the survey. Patients were given sufficient time to complete the questionnaire in addition to the standard new patient registration forms. The institutional review board granted exemption of this study.

Questionnaire Design

A survey of 32 questions was created in collaboration with the University of Wisconsin Survey Center.[18,19] Before commencement of this study, a small sample of patients were asked to partake in cognitive interviewing, a process in which a participant reads the questionnaire aloud and explains their reasoning as they answer questions.[20] This methodology helped to identify any words or sentences that might have been misunderstood by patients. The survey was revised accordingly to address the concerns raised by cognitive interviewing. The administered questionnaire is available in Appendix 1, http://links.lww.com/JG9/A75.

Questionnaire Content

The questionnaire asked the respondents to think only about the hip or knee that was causing the most pain at the time they took the survey. The question items inquired about whether a patient had tried a particular nonsurgical treatment as a way to reduce pain in their hip or knee. If they indicated that they had tried a particular treatment, they were then asked how effective it was in reducing their pain on a scale (five point Likert scale: one not at all, two a little, three somewhat, four very, and five extremely).[21] Some items had additional follow-up questions, including which type of physician prescribed a particular treatment. The nonsurgical treatments survey included PT, acetaminophen, over-the-counter (OTC) NSAIDs, prescription NSAIDs, opioids, corticosteroid injections, hyaluronic acid injections, PRP injections, stem cell injections, and assistive walking devices. Each pharmaceutical treatment type listed examples of generic and brand names to assist respondents in recognizing the pharmaceutical in question. After step-wise questioning of each treatment type, respondents were then asked to choose the single most effective treatment in reducing the pain in their hip or knee. The final portion of the questionnaire inquired about demographic information including age, joint (hip or knee), sex, race and ethnicity, education level, and insurance type.

Statistical Analyses

Descriptive statistics were used to provide the raw survey results. Statistical analyses included the Student t-test and Fisher exact test for categorical variables and the Wilcoxon Rank-Sum test for continuous variables. A generalized cost-effectiveness analysis[22] was performed using each recipient's individual rating of effectiveness on the Likert scale, and dollar amounts were derived from the previously published data on cost[16] and institutional data on the mean cost for treatment event at the site this study was performed. All analyses were performed with Stata 14.2 (Stata Corp, College Station, TX) using alpha = 0.05.

Results

Four hundred thirty-six patients completed the questionnaire (response rate 77.2%). Respondents were a mean age of 61.6 ± 10.9 years (range, 24 to 90 years old). Respondents were 45.2% men, 75.5% white, and 77.8% had at least some college education. The questionnaire enabled respondents to identify more than one insurance type with Medicare or Medicaid being most common, followed by insurance through an employer (Table 1).
Table 1

Respondent Demographics

DemographicNumber (percent)
Age at survey (years)61.6 ± 10.92
Sex, male191 (45.2)
Insurance type
 Employer163 (43.1)
 Spouse's employer76 (20.8)
 Veteran's association5 (1.4)
 Purchased directly45 (12.4)
 Medicaid and/or Medicare171 (44.8)
 Other46 (13)
Racial identity
 White329 (75.5)
 Hispanic or Latino39 (8.9)
 Black or African American48 (11)
 Asian10 (2.3)
 Other3 (0.7)
 American Indian or Alaskan Native2 (0.5)
 Native Hawaiian or Pacific Islander1 (0.2)
Highest education level
 Some high school16 (3.9)
 High school diploma59 (14.5)
 Trade school15 (3.7)
 Some college74 (18.2)
 Associate's degree28 (6.9)
 Bachelor's degree106 (26.1)
 Master's degree74 (18.2)
 Advanced degree34 (8.4)
Respondent Demographics Before presenting for arthroplasty evaluation, respondents tried a mean of 4.1 ± 1.9 (range, 0 to 9) nonsurgical treatments for their pain. The most commonly used treatments were OTC NSAIDs (75.9%), acetaminophen (69.4%), intra-articular corticosteroid injections (59.8%), and PT (59.0%) (Table 2 and Figure 1). When asked to pick the most effective of treatments of the ones they have tried and adjusting for only the treatments each patient had tried, patients preferred opioids (44.1%), corticosteroid injections (33.5%), and prescription NSAIDs (33.5%). PRP was preferred by three of the 15 patients who received it. Stem cell injections were also preferred by three of 12 patients (25.0%) who tried the treatment. PT was the preferred treatment of 50 of 257 patients who received PT (19.5%) (Table 3). No differences were observed between hip and knee patients.
Table 2

Proportion of Respondents Who Tried Each Treatment and Corresponding Rated Effectiveness[a]

TreatmentNumber (percent) (n = 435)Mean Reported Effectiveness
Over-the-counter NSAIDs330 (75.9%)2.56 ± 0.91
Acetaminophen302 (69.4%)2.14 ± 0.90
Corticosteroid injection260 (59.8%)2.64 ± 1.20
Physical therapy257 (59.0%)2.25 ± 0.98
Prescription NSAIDs200 (46.0%)2.61 ± 1.00
Gel injection156 (35.9%)2.33 ± 1.19
Assistive walking device147 (33.8%)2.49 ± 0.91
Opioids118 (27.1%)3.11 ± 1.11
Platelet-rich plasma injection15 (3.4%)1.52 ± 1.04
Stem cell injection12 (2.8%)1.50 ± 1.00

NSAID = nonsteroidal anti-inflammatory drug; PT = physical therapy

As rated on a five point Likert scale

Figure 1

The proportion of survey participants who tried each nonsurgical treatment is represented concurrently with the mean rated effectiveness of that treatment, as rated on a five-point Likert scale. NSAID = nonsteroidal anti-inflammatory drug; OTC = over the counter; PT = physical therapy; PRP = platelet-rich plasma; Rx = prescription.

Table 3

Nonsurgical Treatment Selected as Most Effective

Nonsurgical TreatmentNumber Selected (Percent of Total)Percent, Adjusted for Respondents Who Used the TreatmentMean CER (SD)
Opioids52 (11.9%)44.1%4.0 (7.3)
Corticosteroid injection87 (20.0%)33.5%22.7 (31.4)
Prescription NSAID67 (15.4%)33.5%3.7 (5.6)
Gel injection41 (9.4%)26.3%104.0 (122.7)
Stem cell injection3 (0.7%)25.0%1966.7 (1428.1)
Over-the-counter NSAID77 (17.7%)23.3%2.2 (3.4)
Physical therapy50 (11.5%)19.5%138.6 (166.1)
Platelet-rich plasma injection3 (0.7%)19.5%520.8 (333.9)
Assistive walking device22 (5.0%)15.0%9.2 (13.3)
Acetaminophen32 (7.3%)10.6%5.4 (6.3)

CER = Cost-effectiveness Ratio; NSAID = nonsteroidal anti-inflammatory drug

Proportion of Respondents Who Tried Each Treatment and Corresponding Rated Effectiveness[a] NSAID = nonsteroidal anti-inflammatory drug; PT = physical therapy As rated on a five point Likert scale The proportion of survey participants who tried each nonsurgical treatment is represented concurrently with the mean rated effectiveness of that treatment, as rated on a five-point Likert scale. NSAID = nonsteroidal anti-inflammatory drug; OTC = over the counter; PT = physical therapy; PRP = platelet-rich plasma; Rx = prescription. Nonsurgical Treatment Selected as Most Effective CER = Cost-effectiveness Ratio; NSAID = nonsteroidal anti-inflammatory drug The most cost-effective treatments were OTC and prescription NSAIDs, narcotics, and acetaminophen (mean cost-effectiveness ratio were 2.2, 3.7, 4.0, and 5.4, respectively). The least cost-effective treatment by far was stem cell injections, followed by PRP injections and PT (mean cost-effectiveness ratios were 1966.7, 520.8, and 138.6, respectively) (Table 3). Twenty-seven percent of respondents received opioids, and these patients were significantly younger and less educated compared with patients who did not try them (Table 4). Respondents who tried opioids as a nonsurgical treatment had significantly lower patient-reported effectiveness of other treatment modalities, including PT, acetaminophen, corticosteroid injections, and gel injections, compared with patients who did not try opioids (P < 0.05 for all) (Table 4). These were most commonly prescribed by primary care providers (48.2%) and orthopaedic surgeons (39.5%) (Table 5).
Table 4

Reported Effectiveness[a] of Nonsurgical Treatments Compared Among Patients Who Did and Did Not try Opioids

DemographicTried NarcoticPDid Not Try Narcotic
Age (years)58.25 ± 11.7<0.001[b]62.88 ± 10.42
College educated28 (24.2%)0.047[c]108 (34.4%)

NSAID = nonsteroidal anti-inflammatory drug; PT = physical therapy.

As rated on a five point Likert scale.

Student t-test.

Fisher Exact.

Wilcoxon Rank-Sum test, used when a Student t-test was invalid because of the departures from normality.

Table 5

Opioid Prescribing Doctor

Physician TypeTotal Reported (Percent[a])
Primary care doctor (family medicine or internal medicine doctor)55 (48.2%)
Orthopaedic surgeon45 (39.5%)
Pain management specialist21 (18.4%)
Other type of doctor (emergency medicine or leftover from previous surgery)10 (8.8%)
Rheumatologist7 (6.1%)
Primary care sports medicine doctor3 (2.6%)

Percent totals to more than 100% because patients could report more than one prescribing doctor. One hundred fourteen patients answered this question when surveyed and percentages are of total.

Reported Effectiveness[a] of Nonsurgical Treatments Compared Among Patients Who Did and Did Not try Opioids NSAID = nonsteroidal anti-inflammatory drug; PT = physical therapy. As rated on a five point Likert scale. Student t-test. Fisher Exact. Wilcoxon Rank-Sum test, used when a Student t-test was invalid because of the departures from normality. Opioid Prescribing Doctor Percent totals to more than 100% because patients could report more than one prescribing doctor. One hundred fourteen patients answered this question when surveyed and percentages are of total.

Discussion

The results from this study demonstrated that opioids, intra-articular corticosteroid injections, and NSAIDs are reported by patients as the most effective nonsurgical modalities for reducing pain from hip and knee arthritis. These three treatments were also among the most cost-effective treatments surveyed. PRP injections, stem cell injections, and PT were reported by patients to be the least effective treatments for reducing pain and were the least cost-effective treatments surveyed. These findings are reassuring because the use of NSAIDs is supported by the AAOS Clinical Practice Guidelines for both the hip and knee, whereas the use of intra-articular corticosteroids for the hip is also supported.[7,8] It is well established that NSAIDs improve pain and function for the treatment of osteoarthritis and are generally considered safe and effective drugs.[12,23] Before recommending NSAIDs physicians should assess the patients' comorbidities and tolerance to these medications because there is potential for adverse effects including renal toxicity and peptic ulcers.[12] Similarly, intra-articular corticosteroid injections have demonstrated improvement in pain and function in osteoarthritis knees[24,25] and hips.[13-15] Opioids were used by 27% of respondents and were considered highly effective by patients in this study. AAOS Clinical Practice Guidelines are inconclusive regarding opioid use as a conservative treatment of arthritis; however, more recent evidence suggests that the risks may outweigh the benefits. Opioids are often prescribed to patients who are either intolerant to or have failed other pharmacologic options. Although a significant portion of patients preferred opioids in our study, a systematic review of randomized controlled trials by da Costa et al.[26] found that opioids provide a small clinical benefit but are associated with significant adverse events. Opioids also pose significant risks to patients and their families because of the risk of diversion and addiction. There are also specific risks of opioid use and arthroplasty with strong evidence suggesting that patients on preoperative opioids do poorly after arthroplasty compared with opioid naïve patients.[27-29] Patients using opioids before total joint arthroplasty have worse outcomes after surgery, including less pain relief and greater risk of periprosthetic joint infection.[29-31] Interestingly, our study found that patients who tried opioids as a conservative treatment also had significantly lower rated effectiveness of other treatments including NSAIDs, corticosteroid injections, and PT. Although no conclusions can be drawn regarding causation or temporality, it is concerning that having tried opioids correlates with lower effectiveness of other treatment modalities. The American Association of Hip and Knee Surgeons' position is that opioids should only be used to treat osteoarthritis in exceptional circumstances.[32] Patient and physician education regarding the risks associated with opioids for the treatment of arthritis is necessary to help mitigate adverse effects and improve outcomes after total joint arthroplasty (TJA). Intra-articular PRP injections and stem cell injections were not commonly used by respondents in our study and had the lowest rated clinical efficacies of all treatments surveyed. The AAOS Clinical Practice Guidelines report inconclusive evidence on the use of PRP injections and have no statement on stem cell injections. Current evidence on the clinical effectiveness of PRP for treatment of osteoarthritis is inconclusive.[33] Most studies have compared PRP with hyaluronic acid, with some demonstrating superiority of PRP[34,35] with others concluding no difference.[36,37] Hyaluronic acid itself is not recommended by the AAOS Clinical Practice Guidelines, and thus, even if PRP has shown superiority over hyaluronic acid, it is difficult to draw conclusions regarding whether it should be used in this context. In addition, there is a paucity of level I evidence on the use of stem cell injections for the treatment of osteoarthritis. The few studies published on stem cells for arthritis demonstrated favorable outcomes, but their the methodology has been questioned.[38] In addition to the questionable clinical effectiveness of PRP and stem cells, there are safety and cost concerns with these treatments. Although both treatments are generally considered to be safe, any injection into the knee poses a risk for infection to patients. Both PRP and stem cell treatments are also not covered by most commercial insurances including Medicare leading to significant out of pocket expenses for patients. Given these concerns, the American Association of Hip and Knee Surgeons (AAHKS) released a position statement in June 2019 recommending against the use of PRP and stem cells for treatment of advanced hip or knee arthritis.[39] Further prospective randomized controlled trials examining both the clinical and cost efficacy of these treatments are necessary before they should be routinely used for the conservative treatment of hip and knee osteoarthritis. With increases in healthcare utilization and subsequently healthcare costs, a critical evaluation of how healthcare dollars are spent is necessary. Innovative new alternative payment models, such as bundle payments, have been developed to emphasize value, defined as the ratio of the clinical benefit of a treatment over the costs associated with that treatment, when making treatment decisions.[40] Bundling of payments has to date been at the procedure level, but recent models have bundled payments for treatment of diseases, such as arthritis, to encourage value-based care throughout the care pathway. A recent study reported that the outpatient cost of knee osteoarthritis in the year before total knee arthroplasty was over $43 million.[16] Our study found that AAOS-recommended treatment modalities, namely NSAIDs and intra-articular corticosteroid injections, were preferred by patients and were also of the most cost-effective treatments. Stem cell injections had the lowest rated clinical efficacy in our study and were by far the least cost-effective treatment. Similarly, hyaluronic acid injections are not recommended by the AAOS Clinical Practice Guidelines, yet it has been found that these injections alone account for 29% of the cost of nonsurgical treatment of the knee in the year before total knee arthroplasty.[16] The value of nonsurgical treatment modalities in combination with AAOS Clinical Practice Guidelines should be considered when choosing a treatment plan for patients with symptomatic arthritis. The results from our study suggest that for conservative treatment of arthritis NSAIDs and intra-articular steroid injections are of the most clinical efficacious treatments and also most cost-effective. These treatments should be the first-line treatments for conservative management of arthritis. Several limitations should be considered when interpreting the results from this study. First, all survey participants were presenting to an arthroplasty clinic and thus had likely already failed conservative treatment of their arthritis. This may result in recall bias. In addition, there may be selection bias associated with our response rate of 77.2%. Third, the study was performed at a single academic institution, and the respondents were relatively homogenous. Most patients identified as Caucasian with at least some college education and the results should be considered in this context. Furthermore, because of the anonymous nature of the study, the severity of arthritis for each respondent cannot be assessed, and conclusions cannot be drawn regarding which treatment may be superior at different stages of disease severity. Our study focuses on treatment modalities in isolation, but patients may have used multiple treatment modalities concomitantly and we were not able to control for this occurrence. Finally, the questionnaire item regarding the single most effective treatment emphasized that patients should choose one and only one treatment, but many respondents failed to select an answer, whereas others chose more than one response. Each chosen response was considered in our results, as to not exclude patients who did not fully follow the instructions. Intra-articular corticosteroids, NSAIDs, and opioids were reported to be the most effective and were among the most cost-effective treatments surveyed. PRP, stem cells, and PT were the least effective and were the least cost-effective treatments surveyed. Clinical practice guidelines support the use of exercise, weight loss, and anti-inflammatory drugs in the knee and exercise, anti-inflammatory drugs, and corticosteroid injections in the hip. A strikingly high number of patients received opioids for nonsurgical treatment, many given by orthopaedic surgeons. Given the deleterious effects of opioids on perioperative outcomes and the decreased efficacy of other nonsurgical treatments once opioids were given, greater education is needed to discourage their use preoperatively.
  37 in total

Review 1.  Platelet-Rich Plasma for the Management of Hip and Knee Osteoarthritis.

Authors:  Kim L Bennell; David J Hunter; Kade L Paterson
Journal:  Curr Rheumatol Rep       Date:  2017-05       Impact factor: 4.592

2.  Impact of Preoperative Opioid Use on Total Knee Arthroplasty Outcomes.

Authors:  Savannah R Smith; Jennifer Bido; Jamie E Collins; Heidi Yang; Jeffrey N Katz; Elena Losina
Journal:  J Bone Joint Surg Am       Date:  2017-05-17       Impact factor: 5.284

3.  What Do Our Respondents Think We're Asking? Using Cognitive Interviewing to Improve Medical Education Surveys.

Authors:  Gordon B Willis; Anthony R Artino
Journal:  J Grad Med Educ       Date:  2013-09

Review 4.  Safety and efficacy of paracetamol and NSAIDs in osteoarthritis: which drug to recommend?

Authors:  Pascal Richette; Augustin Latourte; Aline Frazier
Journal:  Expert Opin Drug Saf       Date:  2015-07-01       Impact factor: 4.250

5.  The AAHKS Clinical Research Award: What Are the Costs of Knee Osteoarthritis in the Year Prior to Total Knee Arthroplasty?

Authors:  Nicholas A Bedard; Spencer B Dowdle; Christopher A Anthony; David E DeMik; Michael A McHugh; Kevin J Bozic; John J Callaghan
Journal:  J Arthroplasty       Date:  2017-01-18       Impact factor: 4.757

Review 6.  Opioids for osteoarthritis? Weighing benefits and risks: a Cochrane Musculoskeletal Group review.

Authors:  Faline Howes; Rachelle Buchbinder; Tania B Winzenberg
Journal:  J Fam Pract       Date:  2011-04       Impact factor: 0.493

7.  Platelet-Rich Plasma Intra-articular Knee Injections Show No Superiority Versus Viscosupplementation: A Randomized Controlled Trial.

Authors:  Giuseppe Filardo; Berardo Di Matteo; Alessandro Di Martino; Maria Letizia Merli; Annarita Cenacchi; PierMaria Fornasari; Maurilio Marcacci; Elizaveta Kon
Journal:  Am J Sports Med       Date:  2015-05-07       Impact factor: 6.202

8.  Steroid injection for osteoarthritis of the hip: a randomized, double-blind, placebo-controlled trial.

Authors:  Robert G W Lambert; Edna J Hutchings; Michael G A Grace; Gian S Jhangri; Barbara Conner-Spady; Walter P Maksymowych
Journal:  Arthritis Rheum       Date:  2007-07

9.  Quality-Adjusted Life Years Gained by Hip and Knee Replacement Surgery and Its Aftercare.

Authors:  Thoralf R Liebs; Wolfgang Herzberg; Wolfgang Rüther; Martin Russlies; Joachim Hassenpflug
Journal:  Arch Phys Med Rehabil       Date:  2016-01-11       Impact factor: 3.966

Review 10.  Intra-articular corticosteroid for knee osteoarthritis.

Authors:  Peter Jüni; Roman Hari; Anne W S Rutjes; Roland Fischer; Maria G Silletta; Stephan Reichenbach; Bruno R da Costa
Journal:  Cochrane Database Syst Rev       Date:  2015-10-22
View more
  1 in total

Review 1.  Overview of First-Line and Second-Line Pharmacotherapies for Osteoarthritis with Special Focus on Intra-Articular Treatment.

Authors:  Alicja Nowaczyk; Dawid Szwedowski; Ignacio Dallo; Jacek Nowaczyk
Journal:  Int J Mol Sci       Date:  2022-01-29       Impact factor: 5.923

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.