Literature DB >> 28602060

Diagnostic accuracy of manual office blood pressure measurement in ambulatory hypertensive patients in Korea.

Sehun Kim1, Jin Joo Park1, Seung-Ah Lee2, Youngjin Cho1, Yeonyee E Yoon1, Il-Young Oh1, Chang-Hwan Yoon1, Jung-Won Suh1, Young-Seok Cho1, Tae-Jin Youn1, Goo-Yeong Cho1, In-Ho Chae1, Hae-Young Lee3, Jinho Shin4, Sungha Park5, Dong-Ju Choi1.   

Abstract

BACKGROUND/AIMS: Currently, office blood pressure (OBP) is the most widely used method of measuring blood pressure (BP) in daily clinical practice. However, data on the diagnostic accuracy of OBP in reference to ambulatory blood pressure (ABP) are scarce in Korea.
METHODS: In retrospective and prospective cohorts, manual OBP and ABP measurements were compared among ambulatory hypertensive patients. Hypertension was defined as systolic OBP ≥ 140 mmHg and/or diastolic OBP ≥ 90 mmHg, and systolic ABP ≥ 130 mmHg and/or diastolic ABP ≥ 80 mmHg.
RESULTS: In the retrospective cohort (n = 903), the mean OBP1 (before ABP measurement) was higher than ABP in both systolic (138 ± 17 mmHg vs. 123 ± 13 mmHg, p < 0.001) and diastolic (84 ± 12 mmHg vs. 78 ± 11 mmHg, p < 0.001) measurements. Interestingly, there was only a weak correlation between OBP and ABP (r2 = 0.038, p < 0.001). The overall discordance rate of OBP compared to ABP, which is the reference method for measuring BP, was 43.9%. The prospective cohort (n = 57) showed similar results. In a subgroup analysis, male patients had higher false negative results (masked or under-treated hypertension) than did female patients (26.1% vs. 17.8%, p = 0.003), whereas female patients had a higher false positive rate (white-coat or over-treated hypertension) than did male patients (28.7% vs. 15.2%, p < 0.001).
CONCLUSIONS: The diagnostic accuracy of manual OBP is low in reference to ABP. Men and women have different patterns of discordance. These findings indicate that management of hypertensive patients with manual OBP measurements may be suboptimal and encourages the use of ABP in ambulatory hypertensive patients.

Entities:  

Keywords:  Ambulatory blood pressure; Diagnostic accuracy; Manual office blood pressure; Sex

Mesh:

Year:  2017        PMID: 28602060      PMCID: PMC5768545          DOI: 10.3904/kjim.2016.161

Source DB:  PubMed          Journal:  Korean J Intern Med        ISSN: 1226-3303            Impact factor:   2.884


INTRODUCTION

Hypertension is common and, is increasing in prevalence and is an important risk factor for cardiovascular disease [1,2]. Previous epidemiological studies have demonstrated a strong relationship between blood pressure (BP) and coronary artery disease, stroke, heart failure, renal failure, and death, making correct management of BP essential [3,4]. Therefore, a reliable assessment of BP is central to optimal hypertension treatment. Manual BP measurement is the most widely used method of measuring BP in the clinic [5]. However, measuring BP according to the best practice guidelines can be challenging due to the complexity of the measuring technique and the circumstances in the outpatient clinic [6]. In addition, masked and nocturnal hypertension, as well as the white coat phenomenon can limit the use of the office blood pressure (OBP) measurement [7,8]. Consequently, there may be differences between OBP and ambulatory blood pressure (ABP) measurement [9,10]. Thus, recent guidelines recommend the implementation of ABP in clinical practice [7,11-15]. However, there have been few studies on the relationship between OBP and ABP in Korean populations [16,17]. In the present study, we evaluated the diagnostic accuracy of manual OBP in reference to ABP in both prospective and retrospective cohorts of ambulatory hypertensive patients.

METHODS

In the retrospective cohort, we examined all ambulatory patients who underwent both manual OBP and ABP measurements from January to December 2013. In the prospective cohort, we consecutively enrolled patients who were on treatment for, or newly diagnosed with, hypertension in the outpatient clinic from January through May 2014. The study was approved by the Institutional Review Board of Seoul National University Bundang Hospital (IRB No: B-1308/216-004). The patients in the prospective cohort provided written informed consent, while the requirement for informed consent was waived for patients in the retrospective cohort by the Institutional Review Board. Hypertension was defined as systolic OBP ≥ 140 mmHg and/or diastolic OBP ≥ 90 mmHg and 24-hour average systolic ABP ≥ 130 mmHg and/or diastolic ABP ≥ 80 mmHg, according to the current hypertension guidelines [4,18,19]. Agreement between OBP and ABP was defined as concordance, and disagreement as discordance. White-coat hypertension was defined as untreated patients with OBP ≥ 140/90 mmHg and 24-hour average ABP < 130/80 mmHg and awake average ABP < 135/85 mmHg and sleep measurement < 120/70 mmHg. Over-treated hypertension was defined as patients undergoing hypertension treatment despite exhibiting BP levels above the normal range in a clinical setting (patient’s OBP was > 140/90 mmHg), but not in other settings (patient’s ABP was in the normal range). Masked hypertension was defined as untreated patients with OBP < 140/90 mmHg and 24-hour average ABP ≥ 130/80 mmHg and an awake average ABP ≥ 135/85 mmHg and sleep measurement ≥ 120/70 mmHg. Under-treated hypertension was defined as the treatment of patients with hypertension despite exhibiting normal BP level in a clinical setting (patient’s OBP was < 140/90 mmHg), but exhibit above the normal range during daily living (patient’s ABP was above the normal range). OBP1 and OBP2 were defined as BP measured before and after ABP measurement, respectively. Data regarding variables including baseline characteristics, medical history, and medication were obtained. The primary endpoint of this study was the diagnostic accuracy of OBP1 in reference to ABP as the reference method for measuring BP. OBP was measured with a mercury sphygmomanometer (Baumanometer Desk model, W.A. Baum Co. Inc., Copiague, NY, USA) after the patients had rested for at least 5 minutes in a sitting position. ABP monitoring was performed according to the European Society of Hypertension recommendations [20]. We used ABP monitors from two manufacturers (DELMAR-P6, Del Mar Reynolds Medical, Hertford, UK; Mobil-O-Graph NG, I.E.M, Stolberg, Germany). Each BP measurement was performed every 30 minutes during the day and every 60 minutes at night. Data were expressed as the mean ± SD for continuous variables and as percentages for categorical variables. Pearson correlation was used to calculate the association between OBP and ABP. A paired t test was used to analyze the difference between OBP1 and OBP2. Receiver operating characteristic (ROC) curve analysis was used to determine the diagnostic power of OBP1 and OBP2. Two-sided p values less than 0.05 were considered statistically significant. Statistical tests were performed using SPSS version 22 (IBM Co., Armonk, NY, USA) and Matlab (Mathworks Inc., Natick, MA, USA).

RESULTS

In the retrospective cohort, 903 patients had both OBP and ABP measurements. Among these, 565 patients (62.6%) were newly diagnosed with hypertension (newly diagnosed group), whereas 338 patients (37.4%) were previously on hypertensive medication (on-treatment group). Patients in the on-treatment group were older (62.3 ± 12.4 years vs. 56.7 ± 14.6 years, p < 0.001) and were more likely to have diabetes mellitus (21% vs. 11.5%, p < 0.001) and coronary artery disease (39.1% vs. 16.5%, p < 0.001) than those in the newly diagnosed group. OBP1 was higher than ABP for both systolic (138.4 ± 17.8 mmHg vs. 123.0 ± 12.8 mmHg, p < 0.001) and diastolic (83.7 ± 11.8 mmHg vs. 77.7 ± 10.5 mmHg, p < 0.001) measurements. The most commonly prescribed anti-hypertensive agents were calcium-channel blocking agents (23.9%), followed by angiotensin-receptor blockers (16.5%) and β-blockers (15.0%) (Table 1).
Table 1.

Baseline characteristics of retrospective and prospective cohorts

CharacteristicRetrospective cohort
Prospective cohort
All patients (n = 903)On treatment (n = 338)Newly diagnosed (n = 565)p value[a]All patients (n = 57)On treatment (n = 43)Newly diagnosed (n = 14)p value[a]
Age58.8 ± 14.162.3 ± 12.456.7 ± 14.6< 0.00158.6 ± 15.260.3 ± 15.353.5 ± 14.20.137
Male sex50.250.350.10.99949.148.8500.999
Diabetes mellitus15.12111.5< 0.00115.820.900.095
Coronary artery disease24.939.116.5< 0.00122.827.97.10.152
Cerebrovascular disease6.47.16.00.3055.37.000.568
OBP1[b] SBP, mmHg138.4 ± 17.8138.6 ± 18.5138.3 ± 17.40.839141.3 ± 21.2139.4 ± 21.4147.1 ± 20.10.233
OBP1[b] DBP, mmHg83.7 ± 11.883.0 ± 11.484.1 ± 12.00.17382.0 ± 12.279.4 ± 10.390.2 ± 14.20.017
ABP mean SBP, mmHg123.0 ± 12.8120.8 ± 12.5124.3 ± 12.8< 0.001125.0 ± 14.0122.7 ± 13.3132.2 ± 14.10.039
ABP mean DBP, mmHg77.7 ± 10.575.4 ± 9.679.1 ± 10.8< 0.00180.6 ± 11.777.6 ± 9.588.7 ± 13.60.007
OBP2[b] SBP, mmHg134.3 ± 16.5133.4 ± 16.6134.9 ± 16.50.213135.3 ± 18.4133.0 ± 18.9143.0 ± 14.90.060
OBP2[b] DBP, mmHg82.0 ± 11.280.7 ± 10.982.8 ± 11.30.00679.5 ± 13.176.1 ± 11.590.8 ± 12.10.001
Medication
 ACEI2.36.2--1.86.2--
 ARB16.544.1--45.644.1--
 β-Blocker15.039.9--26.339.9--
 CCB23.963.9--56.163.9--
 Diuretics6.918.3--718.3--

Values are presented as mean ± SD or percentage.

OBP, office blood pressure; SBP, systolic blood pressure; DBP, diastolic blood pressure; ABP, ambulatory blood pressure; ACEI, angiotensin converting enzyme inhibitor; ARB, angiotensin receptor blocker; CCB, calcium channel blocker.

p values for association between patients in on treatment group and newly diagnosed group.

OBP1 and OBP2 defined as OBP measured before and after ABP measurement.

In the on-treatment group, OBP1 was higher than OBP2 in both systolic (138.6 ± 18.6 mmHg vs. 134.4 ± 16.6 mmHg, p < 0.001) and diastolic (83.0 ± 11.4 mmHg vs. 80.7 ± 10.9 mmHg, p < 0.001) measurements. In 41.7% of patients, the hypertensive medication was changed between OBP1 and OBP2, and as expected, OBP2 was lower than OBP1 in these patients. Interestingly, in patients without medication changes (58.3%), OBP2 was also lower than was OBP1. In the newly diagnosed group, 38.8% of patients started taking hypertensive medication between OBP1 and OBP2. Similar to patients in the on-treatment group, OBP2 was lower than OBP1 in both patients with and without new hypertensive medication (Table 2).
Table 2.

The correlation of OBP1 and OBP2 in retrospective and prospective cohorts

VariableSBP
DBP
OBP1[a]OBP2[a]p value[b]OBP1[a]OBP2[a]p value[b]
Retrospective cohort
 Whole patients138.5 ± 17.9134.4 ± 16.6< 0.00183.7 ± 11.982.1 ± 11.2< 0.001
 On-treatment group (n = 338)
  Medication change (41.7%)139.5 ± 20.9133.9 ± 17.20.00184.2 ± 12.881.5 ± 11.90.007
  No medication change (58.3%)137.9 ± 16.6133.1 ± 16.3< 0.00182.1 ± 10.281.5 ± 10.10.004
 Newly diagnosed group (n = 565)
  Medication start (38.8%)142.0 ± 17.4138.9 ± 15.80.00386.9 ± 12.185.5 ± 11.60.030
  Not on medication (61.2%)136.1 ± 17.2132.4 ± 16.5< 0.00182.3 ± 11.781.2 ± 10.90.037
Prospective cohort
 Whole patients141.3 ± 21.2136.1 ± 19.20.07382.1 ± 12.379.5 ± 13.00.053
 On-treatment group (n = 43)
  Medication change (39.5%)136.5 ± 26.8139.0 ± 20.90.60578.0 ± 13.378.3 ± 13.80.874
  No medication change (60.5%)141.3 ± 17.5129.2 ± 16.80.00680.3 ± 8.174.6 ± 9.8< 0.001
 Newly diagnosed group (n = 14)
  Medication start (64%)148.8 ± 9.3143.2 ± 12.20.20590.3 ± 10.289.9 ± 9.60.883
  Not on medication (36%)144.0 ± 33.6150.0 ± 25.50.71090.0 ± 21.390.4 ± 16.80.969

Values are presented as mean ± SD.

OBP, office blood pressure; SBP, systolic blood pressure; DBP, diastolic blood pressure.

OBP1 and OBP2 defined as OBP measured before and after ambulatory blood pressure measurement.

p values for paired t test between OBP1 and OBP2.

The overall discordance rate was 43.9%, 43.5%, and 44.5% in all, newly diagnosed and on-treatment patients, respectively. In the newly diagnosed group, the rate of white coat hypertension was 20.1%, while that of masked hypertension was 23.4%. In the on-treatment group, the rate of over-treatment was 24.9%, while that of under-treatment was 19.6% (Fig. 1). The correlation was weak between systolic OBP1 and ABP (r2 = 0.038, p < 0.001) and systolic OBP2 and ABP (r2 = 0.079, p < 0.001). In identifying hypertension, the area under the curves (AUCs) of OBP1 and OBP2 were 0.57 (95% confidence interval [CI], 0.53 to 0.60) and 0.64 (95% CI, 0.60 to 0.68), respectively (Fig. 2). The overall diagnostic accuracy of OBP1 was 56.1%, with a sensitivity of 51.1% and a specificity of 60.2%, and that of OBP2 was 62.7%, with a sensitivity of 47.4% and a specificity of 75% (Table 3).
Figure 1.

Correlation between office blood pressure (OBP) and ambulatory blood pressure (ABP) in (A) all patients in the retrospective cohort, (B) patients in the newly-diagnosed group in the retrospective cohort, (C) patients in the on-treatment group in the retrospective cohort, and (D) all patients in the prospective cohort. BP, blood pressure; OBP1, before ABP measurement.

Figure 2.

The diagnostic value of office blood pressure (OBP) in all patients in the retrospective cohort. OBP1 and OBP2 defined as OBP measured before and after ambulatory blood pressure measurement. AUC, area under the curve.

Table 3.

The diagnostic accuracy of office blood pressure

Sensitivity, %Specificity, %PPV, %NPV, %PLRNLROverall accuracy, %
OBP1[a]51.160.251.160.21.290.8156.1
OBP2[a]47.47560.763.61.90.762.7

PPV, positive predictive value; NPV, negative predictive value; PLR, positive likelihood ratio; NLR, negative likelihood ratio; OBP, office blood pressure.

OBP1 and OBP2 defined as OBP measured before and after ambulatory blood pressure measurement.

A total of 57 patients were included in the prospective cohort: 43 patients (75%) were in the on-treatment group and 14 patients (24.5%) were in the newly diagnosed group. The baseline characteristics were comparable between both groups (Table 1). The correlation between OBP1 and OBP2 was similar to that of the retrospective cohort. The overall systolic (141.3 ± 21.2 vs. 135.3 ± 18.4, p = 0.073) and diastolic (82.0 ± 12.2 vs. 79.5 ± 13.1, p = 0.053) OBP1 tended to be higher than did OBP2 (Table 2). The correlation between OBP1 and ABP (r2 = 0.046, p = 0.108) was weak. The discordance rate between OBP1 and ABP was 68.4%, of which 43.8% were false positive and 24.6% were false negative results. In identifying hypertension, the AUCs of OBP1 and OBP2 were 0.51 (95% CI, 0.36 to 0.67; p = 0.88) and 0.67 (95% CI, 0.53 to 0.81; p = 0.03), respectively. When stratifying according to sex, the proportion of false negative results (i.e., masked and under-treated hypertension) was higher in men than in women (26.1% vs. 17.8%, p = 0.003), whereas that of false positive results (i.e., white-coat or over-treated hypertension) was higher in female than in male patients (28.7% vs. 15.2%, p < 0.001) (Fig. 3).
Figure 3.

Correlation between office blood pressure (OBP) and ambulatory blood pressure (ABP) according to sex in (A) male patients and (B) female patients. BP, blood pressure; OBP1, before ABP measurement.

DISCUSSION

In this study, we evaluated the diagnostic accuracy of manual OBP measurements in reference to ABP in ambulatory hypertensive patients. We showed that there is only a weak correlation between OBP and ABP, and that OBP has a low diagnostic accuracy. We also showed that OBP2 was lower than OBP1 regardless of medication use, and that male patients were prone to masked hypertension, whereas female patients were susceptible to white coat hypertension. The most important finding was the low diagnostic accuracy of OBP in identifying hypertension in ambulatory patients. With regard to ABP as a reference in BP measuring methods, hypertension diagnosed using OBP1 was incorrect in almost half of the patients (discordance rate, 43.9%). Moreover, OBP1 had a low AUC of 0.57 (95% CI, 0.53 to 0.60), thereby suggesting that OBP may have limited value in accurately diagnosing hypertension and reliable treatment monitoring [21-23]. We observed similar results in the prospective cohorts. Therefore, we believe that this finding represents true practice and strengthens our study results. A possible explanation for the low diagnostic accuracy of OBP may be the complexity of the measuring technique and variations in BP due to underlying circumstances in the outpatient clinic [6]. Another interesting finding was that OBP2 was lower than OBP1 in all circumstances. Furthermore, OBP2 had a slightly higher AUC 0.64 (95% CI, 0.60 to 0.67) and better correlation with ABP (r2 = 0.079, p < 0.001) than did OBP1. By definition, OBP2 for all patients was measured after ABP and physicians were aware of ABP results. Therefore, it is possible that the physician’s manual BP measurement was influenced by the ABP results. The physician may take BP values that are closer to ABP results, which is a potential bias in manual OBP measurement. The rate of false negative results (i.e., masked or under-treated hypertension) was 21.9% in this study. It was higher in men (26.1%) than in women (17.8%) [24,25]. Masked and under-treated hypertension are both clinical conditions in which the patient receives suboptimal treatment and, consequently, has an increased risk for cardiovascular complications [26]. In contrast, female patients had higher false positive results (i.e., white-coat or over-treated hypertension) [24]. The reason for this sex difference in susceptibility to false positive and negative results is presently unclear. The high discordance rate has an essential impact on health care policy. Patients with false positive results take unnecessary antihypertensive drugs, not only causing financial burden, but also exposing patients to the risk of hypotension. Similarly, false negative results are a potential risk for increased cardiovascular events. The manual BP measurement is the most widely used BP measuring method in daily practice [5]; however, our current finding encourages the use of ABP for diagnosis and treatment monitoring in ambulatory hypertensive patients. Although we showed that the discordance rate in both retrospective and prospective cohorts is high, we did not provide data on clinical outcome. While ABP and cardiovascular events have been highly correlated [25,27], and ABP has been shown to predict cardiovascular outcomes better than does OBP in high-risk patients with type 2 diabetes mellitus [28], it is unknown whether patients with OBP-guided hypertension treatment have worse outcomes than do those with ABP-guided management. Since patients were enrolled at a tertiary referral center, it is unknown whether the study results can be directly extrapolated to all patients, especially to those treated in the primary care setting. Finally, there was a significant difference in time interval between OBP1 and ABP versus ABP and OBP2 (49.2 ± 87.0 days vs. 10.0 ± 10.6 days, p = 0.001). This may partly account for the higher AUC of OBP2 compared with OBP1, regardless of the medication change. 1. There is only a weak correlation between office blood pressure (OBP) and ambulatory blood pressure (ABP) (r2 = 0.038, p < 0.001). The overall discordance rate of OBP compared with ABP, the reference methods for measuring blood pressure, was 43.9%, while manual OBP has a low diagnostic accuracy of 56%. 2. In subgroup analysis, male patients were prone to masked hypertension, whereas female patients were susceptible to white coat hypertension. 3. Our findings encourage the use of ABP for diagnosis and treatment monitoring of ambulatory hypertensive patients.
  28 in total

1.  European Society of Hypertension position paper on ambulatory blood pressure monitoring.

Authors:  Eoin O'Brien; Gianfranco Parati; George Stergiou; Roland Asmar; Laurie Beilin; Grzegorz Bilo; Denis Clement; Alejandro de la Sierra; Peter de Leeuw; Eamon Dolan; Robert Fagard; John Graves; Geoffrey A Head; Yutaka Imai; Kazuomi Kario; Empar Lurbe; Jean-Michel Mallion; Giuseppe Mancia; Thomas Mengden; Martin Myers; Gbenga Ogedegbe; Takayoshi Ohkubo; Stefano Omboni; Paolo Palatini; Josep Redon; Luis M Ruilope; Andrew Shennan; Jan A Staessen; Gert vanMontfrans; Paolo Verdecchia; Bernard Waeber; Jiguang Wang; Alberto Zanchetti; Yuqing Zhang
Journal:  J Hypertens       Date:  2013-09       Impact factor: 4.844

2.  Prognostic impact of clinic and ambulatory blood pressure components in high-risk type 2 diabetic patients: the Rio de Janeiro Type 2 Diabetes Cohort Study.

Authors:  Gil F Salles; Nathalie C Leite; Basílio B Pereira; Emilia M Nascimento; Claudia R L Cardoso
Journal:  J Hypertens       Date:  2013-11       Impact factor: 4.844

3.  Misclassification of blood pressure by usual measurement in ambulatory physician practices.

Authors:  Norm R C Campbell; Bruce W Culleton; Donald W McKay
Journal:  Am J Hypertens       Date:  2005-12       Impact factor: 2.689

4.  Assessing accurate BP measurement: size and technique matter!

Authors:  Neil Coogan; April Marra; Elizabeth A Lomonaco
Journal:  Nursing       Date:  2015-04

5.  Prognosis of "masked" hypertension and "white-coat" hypertension detected by 24-h ambulatory blood pressure monitoring 10-year follow-up from the Ohasama study.

Authors:  Takayoshi Ohkubo; Masahiro Kikuya; Hirohito Metoki; Kei Asayama; Taku Obara; Junichiro Hashimoto; Kazuhito Totsune; Haruhisa Hoshi; Hiroshi Satoh; Yutaka Imai
Journal:  J Am Coll Cardiol       Date:  2005-08-02       Impact factor: 24.094

6.  Clinical implications of ambulatory and home blood pressure monitoring.

Authors:  Soon-Gil Kim
Journal:  Korean Circ J       Date:  2010-09-30       Impact factor: 3.243

7.  Prevalence of masked uncontrolled hypertension according to the number of office blood pressure measurements.

Authors:  E Vinyoles; M Camafort; M Domenech; A Coca; J Sobrino
Journal:  Rev Clin Esp (Barc)       Date:  2015-07-30

Review 8.  The Korean Society of Hypertension Guidelines for the Management of Hypertension in 2013: Its Essentials and Key Points.

Authors:  Hae-Young Lee; Jeong Bae Park
Journal:  Pulse (Basel)       Date:  2015-04-29

9.  Age-specific differences between conventional and ambulatory daytime blood pressure values.

Authors:  David Conen; Stefanie Aeschbacher; Lutgarde Thijs; Yan Li; José Boggia; Kei Asayama; Tine W Hansen; Masahiro Kikuya; Kristina Björklund-Bodegård; Takayoshi Ohkubo; Jørgen Jeppesen; Yu-Mei Gu; Christian Torp-Pedersen; Eamon Dolan; Tatiana Kuznetsova; Katarzyna Stolarz-Skrzypek; Valérie Tikhonoff; Tobias Schoen; Sofia Malyutina; Edoardo Casiglia; Yuri Nikitin; Lars Lind; Edgardo Sandoya; Kalina Kawecka-Jaszcz; Luis Mena; Gladys E Maestre; Jan Filipovský; Yutaka Imai; Eoin O'Brien; Ji-Guang Wang; Lorenz Risch; Jan A Staessen
Journal:  Hypertension       Date:  2014-09-02       Impact factor: 10.190

10.  High prevalence of masked uncontrolled hypertension in people with treated hypertension.

Authors:  José R Banegas; Luis M Ruilope; Alejandro de la Sierra; Juan J de la Cruz; Manuel Gorostidi; Julián Segura; Nieves Martell; Juan García-Puig; John Deanfield; Bryan Williams
Journal:  Eur Heart J       Date:  2014-02-03       Impact factor: 29.983

View more
  1 in total

1.  Comparison of multiple blood pressure frequency methods with optimum blood pressure measurement among Iranian individuals.

Authors:  Alireza Mohammadi-Dolatabadi; Mehrbod Vakhshoori; Maryam Eghbali-Babadi; Maryam Heidarpour; Davood Shafie; Mohammad Garakyaraghi; Alireza Khosravi
Journal:  J Res Med Sci       Date:  2020-04-13       Impact factor: 1.852

  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.