Literature DB >> 32791716

Effect of depth of anesthesia on the phase lag entropy in patients undergoing general anesthesia by propofol: A STROBE-compliant study.

Jae Hong Park1, Sang Eun Lee1, Eunsu Kang1, Yei Heum Park1, Hyun-Seong Lee1, Soo Jee Lee1, Dongju Shin1, Gyu-Jeong Noh2, Il Hyun Lee3, Ki Hwa Lee1.   

Abstract

The PLEM100 (Inbody Co., Ltd., Seoul, Korea) is a device for measuring phase lag entropy (PLE), a recently developed index for the quantification of consciousness during sedation and general anesthesia. In the present study, we assessed changes in PLE along with the level of consciousness during the induction of general anesthesia using propofol. PLE was compared with the bispectral index (BIS), which is currently the most commonly used index of consciousness.After obtaining Institutional Review Board approval and written informed consent, we enrolled 15 patients (8 men, 7 women; mean age: 37 ± 9 years; mean height: 168 ± 8 cm; mean weight; 68 ± 11 kg) undergoing nasal bone reduction. PLE and BIS sensors were attached simultaneously, and general anesthesia was induced via target-controlled infusion (TCI) of propofol. PLE and BIS scores were recorded when the calculated effect site concentration shown on the TCI pump was equal to the target concentrations of 1.5, 2.0, 2.5, 2.8, 3.0, 3.2, 3.4, and 3.5 μg/mL (and at each 0.1 μg/mL increase, thereafter). Observer's Assessment of Alertness/Sedation (OAA/S) scores were also recorded until unconsciousness was achieved. Throughout the anesthesia period, all pairs of PLE and BIS data were collected using data acquisition software.The partial correlation coefficients between OAA/S scores and PLE, and between OAA/S scores and BIS were 0.778 (P < .001) and 0.846 (P < .001), respectively. Throughout the period of anesthesia, PLE and BIS exhibited a significant positive correlation. The partial correlation coefficient prior to the loss of consciousness was 0.838 (P < .001), and 0.669 (P < .001) following the loss of consciousness. Intra-class correlation between the 2 indices was 0.889 (P < .001) and 0.791 (P < .001) prior and following the loss of consciousness, respectively.PLE exhibited a strong and predictable correlation with both BIS and OAA/S scores. These results suggest that PLE is reliable for assessing the level of consciousness during sedation and general anesthesia.

Entities:  

Mesh:

Substances:

Year:  2020        PMID: 32791716      PMCID: PMC7387050          DOI: 10.1097/MD.0000000000021303

Source DB:  PubMed          Journal:  Medicine (Baltimore)        ISSN: 0025-7974            Impact factor:   1.817


Introduction

The bispectral index (BIS), a quantitative index obtained from processed electroencephalography (EEG) data, is the most commonly used indicator of consciousness in patients under general anesthesia. The BIS is determined based on scalp EEG signals acquired from frontal electrode arrays using multiple regression analysis techniques.[ The use of BIS during surgery has been reported to reduce the use of anesthetics, shorten recovery time, and reduce the incidence of side effects.[ Ibrahim et al[ reported that the BIS has drug-specific properties and predicts sedation with propofol slightly better than sevoflurane or midazolam. The BIS has a unitless value between 0 and 100. The value of 100 represents a fully awake state and 0 corresponds to electroencephalographic silence; values between 40 and 60 are suggested for general anesthesia.[ Recently, new indicators have been developed in an attempt to more accurately evaluate the level of consciousness of patients under anesthesia. One such indicator is phase lag entropy (PLE).[ Neural communication exhibits a non-stationary and transient nature, and the functional connectivity of the brain in mammals continues to fluctuate even at rest.[ Modern theories of consciousness support the notion that the brain exhibits various functional patterns during the waking state, while a lack of such patterns is observed in the unconscious state.[ Previous EEG and functional magnetic resonance imaging (fMRI) studies have reported fluctuating patterns of functional connectivity in the resting state.[ In order to quantify the diversity of brain functional patterns, PLE extracts the temporal characteristics of the phase relationship between 2 EEG signals.[ Like BIS, PLE has a value from 0 to 100. The range of values suitable for anesthesia is expected to be from 40 to 60, but this is likely to change as its utility continues to be studied. Ki et al[ reported that PLE was useful in predicting hypnotic depth in propofol sedation, while Seo et al[ reported that PLE may represent an alternative to BIS in monitoring the depth of anesthesia. In the present study, we investigated the effect of propofol-induced changes in the level of consciousness on PLE in patients undergoing general anesthesia. To confirm the clinical usefulness of this index, we also compared PLE values with BIS values.

Methods

Participants

This prospective clinical trial was conducted between July 25, 2017 and June 30, 2018, at Haeundae Paik Hospital (Busan, Korea). The study was approved by the Institutional Review Board of Haeundae Paik Hospital (HPIRB 2017-06-006-002) and the National Research Institute of Health (KCT0002727, https://cris.nih.go.kr/cris/en/). Written informed consent was obtained from all participants in this study. Inclusion criteria were as follows: age over 20 years; American Society of Anesthesiologists (ASA) physical status I–II; scheduled to undergo reduction surgery for nasal bone fractures. Exclusion criteria were as follows: patient refusal; ASA physical status III or higher; previous hypersensitivity to propofol; history of neurologic disease including epilepsy; history of psychiatric disorders or psychiatric drug use; history of cardiovascular disease, respiratory disease, renal impairment, or hepatic dysfunction. The sample size was calculated based on a previous study by Yu et al,[ which reported a correlation coefficient of 0.66 between BIS and Observer's Assessment of Alertness/Sedation (OAA/S) scores (5 = responds readily to name spoken in normal tone; 4 = lethargic response to name spoken in normal tone, 3 = responds only after name is called loudly or repeatedly, 2 = responds only after mild prodding or shaking, 1 = does not respond to mild prodding or shaking). Using an alpha error of 0.05 and a statistical power of 80%, a sample size of 15 patients was calculated. This study was conducted by an anesthesiologist (JHP, corresponding author). Unilateral sensors of BIS VISTA (BISx Revision 1.05, Aspect Medical System, Inc., Norwood, MA, USA) were attached to the left temporo-frontal area. PLE (PLEM100 Version 1.0; Inbody Co., Ltd.) sensors were placed on bilateral temporo-frontal area simultaneously with the BIS sensor. Vital signs were monitored, and data were collected automatically using data acquisition software (Vital Recorder version 1.8.1.2, Seoul National University College of Medicine, Seoul, Korea). Data collected included noninvasive blood pressure, heart rate, peripheral pulse oximetry (SpO2), end-tidal carbon dioxide, body temperature, infused dose, and effect site concentration of propofol delivered via a target-controlled infusion (TCI) pump (Orchestra Base Primea, Fresenius Kabi, Brezins, France), and BIS scores. PLE values were collected simultaneously by the PLE device. Data collected by the data acquisition program and the PLE device were synchronized by recording time later. Patients were requested to close their eyes and remain calm during preparation. They were told to open their eyes and answer only if the experimenter called their names or gave a gentle shake. Ketorolac (30 mg) was intravenously injected prior to the induction of anesthesia for perioperative pain control. General anesthesia was induced via TCI of propofol. The first target effect site concentration of propofol was set to 1.5 μg/mL using the Schnider model.[ When the calculated effect site concentration shown on the TCI pump was equal to the target concentration, mental status was assessed using OAA/S scores, and BIS and PLE scores were recorded. The target effect site concentration was increased to 2.0, 2.5, 2.8, 3.0, 3.2, 3.4, and 3.5 μg/mL (0.1 μg/mL increases thereafter), and the OAA/S, BIS, and PLE scores were recorded for each concentration until loss of consciousness had occurred (i.e., OAA/S score of 1). After loss of consciousness, rocuronium bromide (0.6 mg/kg) was administered intravenously, and patients were intubated after 2 minutes. The target effect site concentration of propofol was controlled during the operation to maintain adequate depth of anesthesia. BIS and PLE values were observed during anesthetic management but were not used as guidelines for anesthetic management.[ Anesthesia was maintained based on vital signs and clinical signs. Baseline systolic arterial pressure was defined as the measurement obtained just before induction of anesthesia. Signs of inadequate anesthesia were defined as hypertension (systolic arterial pressure >40 mmHg), tachycardia (heart rate >100 beats/min), facial grimacing, lacrimation, and sweating.[ In addition, we monitored for hypotension (systolic arterial pressure <40 mmHg) and bradycardia (heart rate <45 beats/min) during maintenance anesthesia. Using these signs and the signs for inadequate anesthesia, the effect site concentration of propofol was increased or decreased according to the anesthesiologist's judgment. Persistent hypotension was corrected with intravenous fluid replacement and a bolus of intravenous vasopressor (phenylephrine 100 mcg). Once the nasal bone reduction had been completed, TOF-watch SX (Organon, Ireland) was used to determine the adequacy of recovery from rocuronium. Intravenous sugammadex (4 mg/kg) was administered to patients with post-tetanic counts of 1 to 2, while 2 mg/kg of sugammadex was injected following the appearance of T2. Following sugammadex administration, the target concentration of propofol was set to the concentration at which the patient had lost consciousness. The effect site concentration was decreased to the minimum required to maintain anesthesia, and infusion was discontinued when the dressing was completed. Following adequate recovery from rocuronium, BIS and PLE values were recorded. Patients were extubated when OAA/S scores reached 3. Apart from assessing consciousness levels using the OAA/S score, BIS, and PLE, data pairs of BIS and PLE were acquired over the entire period of anesthesia. Since PLE and BIS values are updated every 4 and 1 second, respectively, every 4th value of BIS was taken and data pairs were extracted at intervals of 4 seconds.

Electroencephalographic analysis

EEG data were recorded continuously with a preamplifier bandwidth of 0.5 to 45 Hz and a sampling frequency (f) of 128 Hz at frontal (AF3, AF4) and prefrontal (FP1, FP2) montages (PLEM100). PLE was calculated between 2 EEG signals from frontal and prefrontal montages (AF3–FP1, AF3–FP2, AF4–FP1, AF4–FP2).[ Direct current offset was performed by subtracting the average amplitude of data from every 4-second epoch. High-amplitude (>75 μV) eye blink artifacts were removed from the EEG signals, as previously described.[ In the pre-processed data, the temporal phase difference between 2 EEG signals (Δ, t = 1, 2, …, N) was binarized, where N represents the number of data points acquired from 4- or 8-second epochs. The vector, Φ, which denotes the temporal pattern of the phase relationship between 2 EEG signals, was given as follows: In the above equation, τ represents time lag with a resolution of 1/f, while m represents the number of dimensions for extracting the temporal pattern of the phase relationship. If the phase of the first signal precedes the second signal, the temporal phase difference is positive, and Δ = 1. If the phase of the first signal lags behind the second signal, the temporal difference becomes negative, and Δ = 0. For example, when m = 3, 2 patterns of Φ can be generated: {0, 0, 0}, {0, 0, 1}, {0, 1, 0}, {1, 0, 0}, {0, 1, 1}, {1, 0, 1}, {1, 1, 0}, and {1, 1, 1}. PLE was calculated by applying the standard Shannon entropy formula to the distribution of the phase patterns.

Statistical analysis

Since the data contained ordinal scales or did not meet the normality test, correlation analysis was performed using Spearman test. In order to evaluate whether the 2 indices reflect the level of consciousness properly during the induction period, the partial correlation coefficients controlling for study participants between OAA/S scores, BIS, and PLE were used. In addition, Steiger Z-test was performed to examine the difference between 2 dependent correlation coefficients: those between OAA/S scores and PLE, and those between OAA/S scores and BIS.[ During the entire period of anesthesia, partial correlation coefficient and intraclass correlation coefficient (ICC) were calculated to evaluate the correlation and agreement between BIS and PLE. The lowest acceptable ICC was set to ≥0.70. Scatter and box plots were also generated to display the data. All statistical analyses were performed using SPSS version 25.0 (IBM Corp., Armonk, NY), Excel (Microsoft Office 365, Microsoft, WA), and R version 3.5.1 (R Foundation for Statistical Computing, Vienna, Austria). P values (P) <.05 were considered statistically significant.

Results

A total of 15 patients participated in the present study. The demographic and clinical characteristics of the included patients are shown in Table 1.
Table 1

Baseline characteristics of the patients who met the inclusion criteria.

Baseline characteristics of the patients who met the inclusion criteria. A total of 7757 data pairs were obtained after removing samples with a signal quality index <40, from the extracted data. Prior to the loss of consciousness, we obtained 2154 data pairs, while 5603 pairs were obtained following the loss of consciousness. A total of 108 OAA/S scores were obtained during the induction period, matching the data pairs obtained during that time. The median [25%–75%] BIS values were 90.5 [83.0; 93.0] in the awake state, with an OAA/S score of 5, and 59.0 [56.0; 61.0] at the exact point of unconsciousness, with an OAA/S score of 1. Likewise, the median PLE values were 85.0 [82.0; 89.0] in the awake state and 55.0 [47.5; 61.5] at the exact point of unconsciousness (Table 2).
Table 2

Descriptive statistics of BIS and PLE by OAA/S score.

Descriptive statistics of BIS and PLE by OAA/S score. The partial correlation coefficients between OAA/S scores and PLE, and between OAA/S scores and BIS were 0.778 (P < .001) and 0.846 (P < .001), respectively (Table 3). The P value calculated by Steiger Z-test was .360, indicating that there was no significant difference between the 2 correlation coefficients.
Table 3

The partial correlation coefficients controlling for study subjects.

The partial correlation coefficients controlling for study subjects. For PLE/BIS pairs measured throughout the period of anesthesia, median PLE values corresponding to BIS values of 40, 50, and 60 were 41.0 [38.5; 48.0], 48.0 [46.0; 53.0], and 57.0 [53.0; 61.0], respectively. Median BIS values corresponding to PLE values of 40, 50, and 60 were 45.0 [40.0; 49.0], 50.5 [47.0; 56.0], and 61.0 [57.0; 65.0], respectively (Fig. 1).
Figure 1

Box plots showing distributions of BIS and PLE during general anesthesia. (A) PLE distribution across BIS group, (B) BIS distribution across PLE group. Triangles represent means of the data. BIS = bispectral index; PLE = phase lag entropy.

Box plots showing distributions of BIS and PLE during general anesthesia. (A) PLE distribution across BIS group, (B) BIS distribution across PLE group. Triangles represent means of the data. BIS = bispectral index; PLE = phase lag entropy. Throughout the period of anesthesia, PLE and BIS exhibited a significant positive correlation (Table 4). The partial correlation coefficient prior to the loss of consciousness was 0.838 (P < .001), and 0.669 (P < .001) following the loss of consciousness (Fig. 2).
Table 4

The partial correlation coefficients between PLE and BIS controlling for study subjects according to the periods of general anesthesia.

Figure 2

Simple linear regression analysis showing the relationship between PLE and BIS according to the periods of general anesthesia. (A) Before consciousness loss, (B) after loss of consciousness. The correlation coefficient shows a significant decrease following loss of consciousness.BIS = bispectral index; PLE = phase lag entropy.

The partial correlation coefficients between PLE and BIS controlling for study subjects according to the periods of general anesthesia. Simple linear regression analysis showing the relationship between PLE and BIS according to the periods of general anesthesia. (A) Before consciousness loss, (B) after loss of consciousness. The correlation coefficient shows a significant decrease following loss of consciousness.BIS = bispectral index; PLE = phase lag entropy. The reliability between BIS and PLE values, calculated using the ICC before and after the loss of consciousness, was 0.889 (P < .001) and 0.791 (P < .001), respectively (Table 5).
Table 5

Inter-rater reliability between bispectral index and phase lag entropy.

Inter-rater reliability between bispectral index and phase lag entropy.

Discussion

In the present study, we assessed changes in PLE along with the level of consciousness during the induction of general anesthesia using propofol in patients undergoing nasal bone reduction. Participants were patients undergoing nasal bone reduction. Because this procedure is non-invasive and does not require electrocautery, the possibility of EEG contamination is expected to be minimal. Ketorolac (30 mg) was administered prior to the induction of anesthesia to control perioperative pain, following which anesthesia was induced by propofol alone. Therefore, nasal bone reduction surgery was thought to be a good option for monitoring the change of consciousness following propofol administration while minimizing the influence of external factors such as opioid and electrocautery. PLE and BIS decreased proportionally and predictably with decreasing OAA/S scores, which reflect the level of consciousness during general anesthesia. Furthermore, Steiger Z-test revealed no significant differences in the correlation between OAA/S scores and PLE, and the correlation between OAA/S scores and BIS.[ When OAA/S scores reached 1, the criterion for endotracheal intubation with muscle relaxants, PLE and BIS values were 54.0 [47.0; 61.5] and 59.0 [56.0; 61.0], respectively. These values were within the range commonly used for each device (i.e., 40 to 60). PLE and BIS values at 40, 50, and 60, which correspond to both extremes, and the median value of the range considered appropriate for general anesthesia, were largely similar to each other. In addition, we observed a significant correlation between PLE and BIS. These results suggest that, both indices should be in close range with each other; for example, when one index is within the range of 40 to 60, the other should be within a similar range. Here, the partial correlation coefficient between the 2 indices was strong (0.838; P < .001) prior to the loss of consciousness, yet somewhat weaker (0.669; P < .001) following the loss of consciousness. In addition, the ICCs between the 2 indices were 0.889 (P < .001) and 0.791 (P < .001) before and after the loss of consciousness, respectively. These changes may have been caused by differences in the algorithms used for each device. The BIS is calculated via a combination of sub-parameters, including burst-suppression ratio, QUAZI suppression, relative β ratio, and SynchFastSlow.[ Among these, relative β ratio is regarded as a good indicator for detecting the transition between consciousness and unconsciousness in patients who have not been given muscle relaxants.[ Generally, within the frequency band in which the BIS subparameter is calculated, EMG signals are much stronger than EEG signals, although they gradually decrease as the level of consciousness decreases.[ Previous studies have indicated that sole administration of muscle relaxants eliminates EMG activity without altering consciousness.[ Schuller et al[ reported that the BIS decreases to the level of deep sedation or general anesthesia when muscle relaxants are administered without anesthetic agents. Therefore, decreases in EMG signals due to the use of muscle relaxants may have caused changes in BIS by altering the weights of the subparameters. In contrast, PLE is calculated from the phase difference between the 2 channels. If a noise signal such as EMG flows into 2 channels at the same time, it does not significantly affect the positive or negative directionality of the phase relationship. Therefore, it is ignored in calculating and patterning the phase difference. Thus, in theory, changes in EMG following muscle relaxants do not affect the level of PLE. Contrary to what might be expected, PLE levels in the induction period tended to be generally lower than in BIS. BIS and PLE have completely different algorithms for numerical computation, and the range of values that appear for the same level of consciousness can be partially different. More important point to note than the relatively high or low level is, as with the BIS study by Schuller et al,[ whether there is a change in PLE levels following administration of muscle relaxants in awake state. Since this study is an observational study conducted under common general anesthesia, this issue was not directly addressed. Further well-designed studies are needed. As muscle relaxants were administered immediately after the loss of consciousness, a sharp change in EMG signals may also have occurred during this time. In addition, changes in EEG signals due to noxious stimuli may have influenced the correlation between the 2 indicators, since the period after the loss of consciousness includes intubation, surgical procedures, and extubation. Both the sources and algorithms used for EEG signals differ. Prior to the loss of consciousness, the fit of the algorithm may have been optimized for detecting changes in the level of consciousness, resulting in high correlation/agreement between the 2 indices. However, since it was not possible to receive feedback from patients after the loss of consciousness, algorithms that quantify various types of stimuli and cerebral activity during this period may have yielded different results. Our results indicated that the correlation coefficients and ICCs between the 2 indices decreased following the loss of consciousness. However, since patients are unconscious during anesthesia, it is difficult to define which index better reflects the “real” depth of anesthesia. Therefore, these results indicate that the output values of the 2 indices differ slightly more depending on the algorithms used in the anesthetic state, not that 1 index is superior to the other. Nonetheless, the ICCs between the 2 indices suggested high reliability (>0.7), both before and after the loss of consciousness. The ICC is considered superior to the correlation coefficient for evaluating reliability because it includes information regarding both the correlation and the bias between the measured values.[ These results suggest that the 2 indices are interchangeable, in accordance with the findings of the recent studies.[ Although we observed a positive correlation between the 2 indices, further research is required to address the limitations of the present study. First, as mentioned above, the present study could not confirm the pure effect of EMG on PLE. It is necessary to observe the changes in PLE following muscle relaxant administration in the absence of anesthetics. Second, we did not determine the time at which strong noxious stimulation (e.g., tracheal intubation or surgical stimulation) occurred after the loss of consciousness. The correlation between the 2 indices may vary depending on the intensity of the stimulus. More detailed studies are required to determine whether the correlation differs based on the presence or absence of harmful stimuli. Third, the anesthetics used in PLE studies are still limited to propofol. Because different anesthetics may cause different responses, it is necessary to confirm that the PLE reliably reflects the level of consciousness following administration of other intravenous or inhalation anesthetics. In conclusion, our findings demonstrated that PLE exhibited a strong correlation with the level of consciousness and high agreement with the BIS, which is currently used as the gold standard for monitoring the level of consciousness during surgery. These results suggest that PLE is a reliable indicator of sedation during the propofol-induced anesthesia.

Author contributions

Concepts: Noh, Gyu-Jeong. Design: Park, Jae Hong. Literature search: Lee, Ki Hwa. Clinical studies: Park, Jae Hong. Data acquisition: Kang, Eunsu. Data analysis: Lee, Hyun-seong; Park, Yei Heum. Statistical analysis: Lee, Il Hyun. Manuscript preparation: Lee, Soo Jee; Shin, Dongju. Manuscript editing: Lee, Ki Hwa. Manuscript review: Lee, Sang Eun.
  30 in total

Review 1.  The brainweb: phase synchronization and large-scale integration.

Authors:  F Varela; J P Lachaux; E Rodriguez; J Martinerie
Journal:  Nat Rev Neurosci       Date:  2001-04       Impact factor: 34.870

2.  Does bispectral analysis add anything but complexity? BIS sub-components may be superior to BIS for detection of awareness.

Authors:  G Schneider; S Schöniger; E Kochs
Journal:  Br J Anaesth       Date:  2004-10       Impact factor: 9.166

3.  Self-organized criticality and the development of EEG phase reset.

Authors:  Robert Wayne Thatcher; Duane Michael North; Carl John Biver
Journal:  Hum Brain Mapp       Date:  2009-02       Impact factor: 5.038

4.  Phase lag entropy as a hypnotic depth indicator during propofol sedation.

Authors:  S Ki; K M Kim; Y H Lee; J Y Bang; B M Choi; G J Noh
Journal:  Anaesthesia       Date:  2019-05-20       Impact factor: 6.955

5.  An introduction to bispectral analysis for the electroencephalogram.

Authors:  J C Sigl; N G Chamoun
Journal:  J Clin Monit       Date:  1994-11

6.  Scale-free dynamics of global functional connectivity in the human brain.

Authors:  Cornelis Jan Stam; Eveline Astrid de Bruin
Journal:  Hum Brain Mapp       Date:  2004-06       Impact factor: 5.038

7.  Efficacy of bispectral index monitoring during balanced propofol sedation for colonoscopy: a prospective, randomized controlled trial.

Authors:  Yeon Hwa Yu; Dong Soo Han; Hyun Soo Kim; Eun Kyung Kim; Chang Soo Eun; Kyo-Sang Yoo; Woo Jong Shin; Seungho Ryu
Journal:  Dig Dis Sci       Date:  2013-08-28       Impact factor: 3.199

Review 8.  Bispectral Index and non-Bispectral Index anesthetic protocols on postoperative recovery outcomes.

Authors:  Min-Hsien Chiang; Shao-Chun Wu; Shih-Wei Hsu; Jo-Chi Chin
Journal:  Minerva Anestesiol       Date:  2017-10-12       Impact factor: 3.051

9.  From the phenomenology to the mechanisms of consciousness: Integrated Information Theory 3.0.

Authors:  Masafumi Oizumi; Larissa Albantakis; Giulio Tononi
Journal:  PLoS Comput Biol       Date:  2014-05-08       Impact factor: 4.475

10.  Comparative Analysis of Phase Lag Entropy and Bispectral Index as Anesthetic Depth Indicators in Patients Undergoing Thyroid Surgery with Nerve Integrity Monitoring.

Authors:  Kwon Hui Seo; Kyung Mi Kim; Soo Kyung Lee; Hyunji John; Junsuck Lee
Journal:  J Korean Med Sci       Date:  2019-05-27       Impact factor: 2.153

View more
  1 in total

1.  Alpha-power in electroencephalography as good outcome predictor for out-of-hospital cardiac arrest survivors.

Authors:  Min-Jee Kim; Youn-Jung Kim; Mi-Sun Yum; Won Young Kim
Journal:  Sci Rep       Date:  2022-06-28       Impact factor: 4.996

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.