Literature DB >> 24376511

HIV viremia and T-cell activation differentially affect the performance of glomerular filtration rate equations based on creatinine and cystatin C.

Bhavna Bhasin1, Bryan Lau2, Mohamed G Atta1, Derek M Fine1, Michelle M Estrella1, George J Schwartz3, Gregory M Lucas1.   

Abstract

BACKGROUND: Serum creatinine and cystatin C are used as markers of glomerular filtration rate (GFR). The performance of these GFR markers relative to exogenously measured GFR (mGFR) in HIV-positive individuals is not well established.
METHODS: We assessed the performance of the chronic kidney disease epidemiology collaboration equations based on serum concentrations of creatinine (eGFRcr), cystatin C (eGFRcys) and both biomarkers combined (eGFRcr-cys) in 187 HIV-positive and 98 HIV-negative participants. Measured GFR was calculated by plasma iohexol clearance. Bias and accuracy were defined as the difference between eGFR and mGFR and the percentage of eGFR observations within 30% of mGFR, respectively. Activated CD4 and CD8 T-cells (CD38+ HLA-DR+) were measured by flow cytometry.
RESULTS: The median mGFR was >100 ml/min/1.73 m(2) in both groups. All equations tended to be less accurate in HIV-positive than in HIV-negative subjects, with eGFRcr-cys being the most accurate overall. In the HIV-positive group, eGFRcys was significantly less accurate and more biased than eGFRcr and eGFRcr_cys. Additionally eGFRcys bias and accuracy were strongly associated with use of antiretroviral therapy, HIV RNA suppression, and percentages of activated CD4 or CD8 T-cells. Hepatitis C seropositivity was associated with larger eGFRcys bias in both HIV-positive and HIV-negative groups. In contrast, eGFRcr accuracy and bias were not associated with HIV-related factors, T-cell activation, or hepatitis C.
CONCLUSIONS: The performance of eGFRcys relative to mGFR was strongly correlated with HIV treatment factors and markers of T-cell activation, which may limit its usefulness as a GFR marker in this population.

Entities:  

Mesh:

Substances:

Year:  2013        PMID: 24376511      PMCID: PMC3871673          DOI: 10.1371/journal.pone.0082028

Source DB:  PubMed          Journal:  PLoS One        ISSN: 1932-6203            Impact factor:   3.240


Introduction

Early detection of renal disease is important in HIV-positive individuals to implement appropriate interventions and remove potentially nephrotoxic drugs. In clinical practice, serum creatinine is widely used as an intrinsic glomerular filtration rate (GFR) marker. Cystatin C, a constitutively-produced cysteine proteinase, has been proposed as an alternative and potentially superior GFR marker [1], [2]. However, cystatin C concentrations may be affected by inflammation [3], which could be relevant in HIV-infected persons. The Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equations (one based on creatinine, one based on cystatin C, and one based on both biomarkers) have been shown to be more accurate than the Modification of Diet in Renal Disease (MDRD) equation (which uses creatinine), particularly in persons with GFR >60 ml/min/1.73 m2 [4], [5]. Two recent studies that measured GFR with an exogenous marker in HIV-infected individuals found no evidence that cystatin C-based estimates were more accurate or precise than creatinine-based estimates [6], [7]. Additional data are needed to elucidate the strengths and limitations of GFR equations based on creatinine, cystatin C, or both biomarkers in this population, considering HIV-related immune activation. Using iohexol clearance from plasma to exogenously measure GFR, we assessed the performance of the CKD-EPI equations and clinical factors affecting performance, in HIV-positive participants and a demographically similar HIV-negative comparison group.

Methods

Study design and population

We recruited HIV-positive subjects from the Johns Hopkins HIV Clinic and HIV-negative subjects from the community and from the AIDS Link to IntraVenous Experience (ALIVE) cohort [8], the latter to oversample HIV-negative individuals with a history of injection drug use and hepatitis C infection. Participants were screened for eligibility at two screening visits. Inclusion criteria were age 18 years or older and estimated GFR ≥60 ml/min/1.73 m2 (by MDRD equation [9]), the latter because the primary objective of the cohort was to assess measured GFR change over time in subjects with initially normal estimated kidney function. Exclusion criteria included history of radiocontrast allergy, pregnancy, diabetes mellitus (history of diabetes diagnosis or treatment for diabetes, or random serum glucose >130 mg/dL or glycosylated hemoglobin >6.5% at screening), uncontrolled hypertension (systolic blood pressure >160 mm Hg or diastolic blood pressure >100 mm Hg), collagen vascular disease, and severe or life-threatening comorbid conditions.

Ethics statement

Participants provided written informed consent and the study was approved by the Johns Hopkins Medicine Institutional Review Board.

Data collection and laboratory measurements

We collected demographic, behavioral, and pharmacologic data by interview and medical record review, and measured height, weight, and blood pressure. Laboratory data included hepatitis C serostatus and plasma concentrations of creatinine, cystatin C, and high-sensitivity C-reactive protein (hsCRP). Creatinine was measured with an enzymatic assay (Creatinine Plus, Roche Diagnostics, Basel, Switzerland) that was traceable to an isotope dilution mass spectrometry reference method [10]. Cystatin C was measured using a particle enhanced turbidimetric immunoassay (Gentian AS, Norway), with values standardized to a certified reference material from the Institute for Reference Materials and Measurements [11]. We used flow cytometry to measure the percentages of activated CD4 and CD8 cells, defined by the presence of CD38 and HLA-DR surface markers [12], [13]. We also measured urine concentrations of albumin and creatinine. In the HIV-positive group we measured CD4 cell count by flow cytometry and HIV RNA level with Amplicor HIV-1 MONIOTR Test, v1.5 (Roche Molecular Diagnostics), which had a lower limit of detection of 400 copies/mL. Iohexol clearance was measured by placing two peripheral intravenous catheters and infusing a weighed dose of iohexol (5 mL; GE Healthcare, Amersham Division, Princeton, NJ) into one catheter. Blood samples were drawn at 10, 30, 120, and 240 minutes from the second catheter. Serum iohexol concentrations were measured by high performance liquid chromatography. Measured GFR (mGFR) was calculated using a 2-compartment model described by Schwartz and colleagues [14].

Definitions and statistical analysis

Estimated GFR was calculated using CKD-EPI equations based on plasma creatinine (eGFRcr), cystatin C (eGFRcys), or both markers (eGFRcr-cys) [15]. We used three parameters to assess the performance of GFR estimating equations relative to mGFR. Accuracy was defined as the percent of eGFR observations within 30% of mGFR, with 95% confidence intervals (CI) determined by exact methods. Supplemental accuracy estimates were calculated for percent of values within 10% of mGFR. Bias was defined as the difference between eGFR and mGFR, where values above and below 0 corresponded to overestimation and underestimation of mGFR, respectively. Precision was defined as the interquartile range (IQR) for bias, with 95% CI determined by bootstrapping. We compared the accuracy, bias and precision of each estimating equation between the HIV-positive and HIV-negative groups, and compared the performance of the equations with one another, separately in the HIV-positive and HIV-negative groups. We used Fisher's exact and Wilcoxon rank sum tests to compare categorical and continuous variables between groups, respectively. We determined the statistical significance of differences between equations in each group with McNemar's test for accuracy, Wilcoxon sign rank test for bias, and bootstrapping for precision. We assessed the association of clinical factors with accuracy and bias of the single biomarker equations, eGFRcr and eGFRcys. We stratified age, body mass index (BMI), and hsCRP at the median values for the complete study sample, and used group-specific medians for activated CD4 and CD8 cells, due to large differences in these variables between HIV-positive and HIV-negative subjects. There were too few non-African American subjects for meaningful comparisons by race. Because our analysis included a large number of statistical comparisons, we used the method of Benjamini and Hochberg to reduce the likelihood of making type-1 errors [16]. In this method, the P value thresholds for rejecting null hypotheses are adjusted downward (e.g., <0.05) according to the total number of comparisons and the position of a given test in the ascending rank order of all test-based P values. We adjusted P values to maintain a false discovery rate of 0.05, meaning that of the tests deemed to be statistically significant by the revised P value thresholds, only 5% would be anticipated to be ‘false discoveries’. P value thresholds for baseline comparisons between HIV-positive and HIV-negative subjects (Table 1) were not modified for false discovery. However, in Tables 2,3, 4, actual P values are shown and bold font was used to indicate statistical significance using the false discovery approach.
Table 1

Clinical characteristics of HIV-positive and HIV-negative participants.

Clinical characteristicsHIV-positive (n = 187)HIV-negative (n = 98)P value
Age, years, median (P25, P75)49 (45, 53)49 (45, 54)0.58
Body mass index, kg/m2, median (P25, P75)26 (23, 31)27 (23, 33)0.21
SexFemale, n (%)66 (35)18 (18)0.0027
Male, n (%)121 (65)80 (82)
RaceWhite, n (%)11 (6)8 (8)0.46
Black, n (%)176 (94)90 (92)
Current smoker, n (%)124 (66)60 (61)0.44
History of hypertension, n (%)65 (35)21 (21)0.021
History of cardiovascular disease, n (%)21 (11)4 (4)0.048
Hepatitis C seropositive, n (%)100 (54)28 (29)0.0001
Systolic blood pressure, mm Hg, median (P25, P75)120 (108, 131)126 (113, 135)0.0074
Diastolic blood pressure, mm Hg, median (P25, P75)71 (65, 77)73 (66, 82)0.058
Glycosylated hemoglobin, %, median (P25, P75)5.4 (5.1, 5.7)5.5 (5.3, 5.8)0.038
High-sensitivity C-reactive protein, mg/dL, median (P25, P75)1.7 (0.6, 4.2)1.9 (0.7, 5.5)0.43
Percentage activateda CD4 cells, median (P25, P75)8.3 (5.4, 14.1)3.8 (3.1–5.9)<0.0001
Percentage activateda CD8 cells, median (P25, P75)30.7 (19.2, 46.9)10.8 (7.7, 20.5)<0.0001
Urine albumin-creatinine ratio, mg/g, median (P25, P75)7 (3, 19)5 (3,11)0.18
Urine albumin-creatinine ratio >30 mg/g, n (%)36 (19)9 (9)0.027
Serum creatinine, mg/dL, median (P25, P75)0.9 (0.8, 1.1)1.0 (0.8, 1.1)0.19
Serum cystatin C, mg/L, median (P25, P75)0.93 (0.82,1.10)0.84 (0.76, 1.10)0.0002
Measured glomerular filtration rate, ml/min/1.73 m2, median (P25, P75)101 (85, 116)109 (95, 125)0.0034
eGFRcr, ml/min/1.73 m2, median (P25, P75)103 (85, 118)103 (92, 114)0.84
eGFRcys, ml/min/1.73 m2, median (P25, P75)87 (70,103)101 (81, 112)0.0001
eGFRcr-cys, ml/min/1.73 m2, median (P25, P75)95 (81, 109)100 (89, 114)0.012
Taking antiretroviral therapy, n (%)171 (91)--
Taking tenofovir, n (%)127 (68)--
Nadir CD4 count, cells/mm3, median (P25, P75)145 (42, 301)--
Current CD4 count, cells/mm3, median (P25, P75)464 (248, 627)--
HIV RNA >400 copies/mL, n (%)38 (20)--
HIV RNA in subjects with values >400 copies/mL, median (P25, P75)11,680 (4,562, 62,084)--

P25 and P75, 25th and 75th percentiles, respectively; eGFRcr, eGFRcys, and eGFRcr-cys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine, cystatin C, and both biomarkers, respectively.

Activated CD4 or CD8 T-cells defined as expressing both CD38 and HLA-DR surface markers.

Table 2

Performance of glomerular filtration rate estimating equations in HIV-positive and HIV-negative participants.

Performance measureHIV-positiveHIV-negativeP valuea
Accuracyb (95% CI)eGFRcr 89 (83, 93)96 (90, 99)0.048
eGFRcys 79 (72, 85)88 (80, 94)0.075
eGFRcr-cys 91 (85, 94)97 (91, 99)0.055
P valuec eGFRcr vs. eGFRcys 0.0044 0.046-
eGFRcr vs. eGFRcr-cys 0.510.71-
eGFRcys vs eGFRcr-cys <0.0001 0.0027 -
Biasd (P25, P75)eGFRcr −1.1 (−12.4, 10.4)−8.8 (−18.0, 2.9) 0.0013
eGFRcys −16.3 (−27.8, −1.8)−12.9 (−23.8, 0.8)0.19
eGFRcr-cys −7.2 (−19.8, 2.2)−9.7 (−19.1, 0.7)0.56
P valuec eGFRcr vs. eGFRcys <0.0001 0.014-
eGFRcr vs. eGFRcr-cys <0.0001 0.23-
eGFRcys vs eGFRcr-cys <0.0001 0.0002 -
Precisione (95% CI)eGFRcr 22.8 (18.4, 27.3)20.9 (15.1, 26.7)0.50
eGFRcys 25.9 (22.1, 29.7)24.5 (18.9, 30.2)0.61
eGFRcr-cys 22.0 (18.1, 25.9)19.8 (13.2, 26.4)0.49
P valuec eGFRcr vs. eGFRcys 0.430.65-
eGFRcr vs. eGFRcr-cys 0.430.27-
eGFRcys vs eGFRcr-cys 0.120.10-

CI, confidence interval; eGFRcr, eGFRcys, and eGFRcr-cys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine, cystatin C, and both biomarkers, respectively; P25 and P75, 25th and 75th percentiles, respectively.

Comparisons of a single equation between the HIV-positive and HIV-negative groups. P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text).

Accuracy defined as percentage of estimated GFR values within 30% of measured GFR.

Comparisons of a different equations within the HIV-positive or HIV-negative group. P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text).

Bias defined as difference between estimated GFR and measured GFR (mL/min/1.73 m2).

Precision defined as interquartile range of bias.

Table 3

Factors associated with glomerular filtration rate estimating equation accuracya in HIV-positive and HIV-negative participants.

FactorHIV-positiveHIV-negative
eGFRcr eGFRcys eGFRcr eGFRcys
Age, years≤4987 (79, 93)80 (70, 87)92 (81, 98)94 (84, 99)
>4990 (82, 95)79 (69, 87)100 (92, 100)81 (67, 91)
P valueb 0.641.000.120.064
Body mass index, kg/m2 ≤2688 (79, 93)77 (67, 85)96 (85, 99)84 (70, 93)
>2690 (82, 95)82 (72, 89)96 (87, 99)91 (79, 97)
P valueb 0.650.471.000.38
SexFemale83 (72, 91)78 (66, 87)89 (65, 99)100 (81, 100)
Male92 (85, 96)80 (71, 86)97 (91, 100)85 (75, 92)
P valueb 0.0930.850.150.12
mGFR, mL/min/1.73 m2 <9080 (68, 89)70 (57, 82)94 (71, 99)88 (64, 99)
≥9093 (87, 97)83 (75, 89)96 (90, 99)88 (78, 94)
P valueb 0.0140.0510.541.00
Hepatitis C serostatusNegative88 (80, 94)85 (76, 92)94 (86, 98)91 (82, 97)
Positive89 (81, 94)73 (64, 82)100 (88, 100)79 (59, 92)
P valueb 1.000.0660.320.10
High-sensitivity C-reactive protein, mg/dL≤1.891 (83, 96)79 (70, 87)98 (89, 100)82 (68, 91)
>1.888 (79, 94)80 (70, 88)94 (83, 99)94 (83, 99)
P valueb 0.640.860.620.12
Percentage activated CD4 cells≤Medianc 90 (82, 95)92 (84, 97)92 (80, 98)90 (78, 97)
>Medianc 88 (79, 94)69 (58, 78)100 (93,100)86 (73, 94)
P valueb 0.81 0.0001 0.120.76
Percentage activated CD8 cells≤Mediand 91 (83, 96)92 (84, 97)94 (83, 99)87 (75, 95)
>Mediand 87 (78, 93)69 (58, 78)98 (89, 100)88 (76, 95)
P valueb 0.48 0.0001 0.361.00
Taking antiretroviral therapyYes89 (84, 94)82 (75, 87)
No81 (54, 96)50 (25, 75)
P valueb 0.40 0.0064
Nadir CD4, cells/mm3 >15086 (77, 92)80 (71, 88)
≤15092 (84, 96)78 (68, 86)
P valueb 0.250.72
Current CD4, cells/mm3 >45089 (81, 94)88 (80, 94)
≤45089 (80, 94)70 (59, 79)
P valueb 1.00 0.0032
HIV RNA, copies/ml≤40091 (85, 95)87 (80, 92)
>40079 (63, 90)50 (33, 67)
P valueb 0.043 <0.0001

eGFRcr and eGFRcys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine and cystatin C, respectively; mGFR, measured glomerular filtration rate by iohexol clearance.

Accuracy shown as percent of estimated GFR values within 30% of measured GFR values (95% confidence interval).

P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text).

Medians 8.3% and 3.8% in HIV-positive and HIV-negative groups, respectively.

Medians 30.7% and 10.7% in HIV-positive and HIV-negative groups, respectively.

Table 4

Factors associated with glomerular filtration rate equation biasa in HIV-positive and HIV-negative participants.

FactorHIV-positiveHIV-negative
eGFRcr eGFRcys eGFRcr eGFRcys
Age, years≤49−1.9 (−16.2, 10.7)−16.4 (−24.9, 1.3)−9.9 (−23.2, 3.8)−12.6 (−21.6, 2.0)
>490.7 (−7.9, 9.5)−14.2 (−29.2, 2.0)−5.8 (−17.6, 1.6)−13.9 (−25.9, 0.7)
P valueb 0.300.760.500.44
Body mass index, kg/m2 ≤26−2.6 (−12.6, 10.4)−17.7 (−30.7, −1.8)−8.9 (−23.0, 1.4)−13.0 (−21.6, 0.1)
>260.9 (−11.3, 10.3)−12.3 (−24.3, −1.6)−8.0 (−15.6, 3.8)−12.6 (−25.9, 1.9)
P valueb 0.610.330.180.84
SexFemale6.5 (−5.3, 17.5)−12.8 (−26.2, −1.6)−1.4 (−8.0, 13.2)−13.3 (−17.8, −4.5)
Male−4.6 (−14.5, 7.0)−17.1 (−28.8, −1.9)−10.3 (−20.4, −1.4)−12.3 (−24.5, 3.1)
P valueb 0.0011 0.66 0.0049 0.78
mGFR, mL/min/1.73 m2 <904.5 (−5.0, 18.7)−7.9 (−21.7, 0.4)6.0 (−5.2, 16.3)−7.5 (−13.9, 8.0)
≥90−4.5 (−16.2, 7.5)−19.9 (−30.9, −3.4)−10.3 (−20.6, −1.0)−13.5 (−26.0, −2.5)
P valueb 0.0001 0.0039 0.0002 0.0080
Hepatitis C serostatusNegative−0.9 (−12.4, 13.8)−6.8 (−24.2, 2.1)−9.9 (−19.6, 4.2)−8.0 (−20.3, 5.0)
Positive−1.7 (−11.7, 9.1)−21.1 (−28.8, −6.0)−8.8 (−15.9, 1.2)−21.6 (−33.4, −12.9)
P valueb 0.67 0.0012 0.97 0.0006
High-sensitivity C-reactive protein, mg/dl≤1.8−1.4 (−10.3, 10.3)−16.3 (−30.2, 2.0)−9.7 (−20.2, 1.6)−13.5 (−25.0, 1.9)
>1.8−0.2 (−12.6, 10.7)−15.9 (−25.0, 1.1)−7.0 (−15.8, 3.8)−10.4 (−22.4, −3.3)
P valueb 0.960.720.480.79
Percentage activated CD4 cells≤Medianc −2.0 (−13.5, 8.0)−6.4 (−22.6, 0.3)−8.8 (−18.9, 5.5)−11.1 (−18.3, 1.9)
>Medianc −1.1 (−11.0, 13.0)−21.6 (−33.6, −8.4)−8.9 (−16.7, 0.6)−16.3 (−25.2, 2.5)
P valueb 0.53 <0.0001 0.870.12
Percentage activated CD8 cells≤Medianc −3.9 (−14.5, 9.2)−7.6 (−21.7, 0.7)−6.1 (−19.0, 5.3)−11.4 (−22.6, 4.5)
>Medianc 1.0 (−9.7, 12.8)−21.7 (−31.9, −5.9)−10.0 (−17.6, −1.2)−13.0 (−25.2, 3.3)
P valueb 0.20 0.0003 0.340.25
Taking antiretroviral therapyYes−1.0 (−12.4, 10.7)−14.2 (−27.4, −1.1)
No−3.0 (−16.5, 8.3)−25.7 (−47.0, −21.0)
P valueb 0.61 0.0014
Nadir CD4 count, cells/mm3 >150−5.3 (−19.8, 7.0)−20.3 (−30.7, −3.3)
≤1504.0 (−7.2, 12.9)−11.5 (−25.0, 0)
P valueb 0.0009 0.056
CD4 count, cells/mm3 >450−2.0 (−14.5, 8.0)−12.2 (−24.2, −0.4)
≤450−0.1 (−9.5, 13.6)−19.8 (−31.6, −4.8)
P valueb 0.200.032
HIV RNA, copies/ml≤400−0.2 (−12.0, 9.5)−10.0 (−24.1, −0.6)
>400−3.6 (−12.4, 12.9)−28.0 (−45.4, −18.7)
P valueb 0.63 <0.0001

eGFRcr and eGFRcys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine and cystatin C, respectively; mGFR, measured glomerular filtration rate by iohexol clearance.

Bias defined as median difference between estimated glomerular filtration rate (GFR) and measured GFR (25th percentile, 75th percentile).

P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text).

Medians 8.3% and 3.8% in HIV-positive and HIV-negative groups, respectively.

Medians 30.7% and 10.7% in HIV-positive and HIV-negative groups, respectively.

P25 and P75, 25th and 75th percentiles, respectively; eGFRcr, eGFRcys, and eGFRcr-cys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine, cystatin C, and both biomarkers, respectively. Activated CD4 or CD8 T-cells defined as expressing both CD38 and HLA-DR surface markers. CI, confidence interval; eGFRcr, eGFRcys, and eGFRcr-cys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine, cystatin C, and both biomarkers, respectively; P25 and P75, 25th and 75th percentiles, respectively. Comparisons of a single equation between the HIV-positive and HIV-negative groups. P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text). Accuracy defined as percentage of estimated GFR values within 30% of measured GFR. Comparisons of a different equations within the HIV-positive or HIV-negative group. P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text). Bias defined as difference between estimated GFR and measured GFR (mL/min/1.73 m2). Precision defined as interquartile range of bias. eGFRcr and eGFRcys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine and cystatin C, respectively; mGFR, measured glomerular filtration rate by iohexol clearance. Accuracy shown as percent of estimated GFR values within 30% of measured GFR values (95% confidence interval). P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text). Medians 8.3% and 3.8% in HIV-positive and HIV-negative groups, respectively. Medians 30.7% and 10.7% in HIV-positive and HIV-negative groups, respectively. eGFRcr and eGFRcys are glomerular filtration rates estimated by CKD-EPI equations using plasma creatinine and cystatin C, respectively; mGFR, measured glomerular filtration rate by iohexol clearance. Bias defined as median difference between estimated glomerular filtration rate (GFR) and measured GFR (25th percentile, 75th percentile). P values in bold font indicate difference is statistically significant accounting for multiple comparisons (see text). Medians 8.3% and 3.8% in HIV-positive and HIV-negative groups, respectively. Medians 30.7% and 10.7% in HIV-positive and HIV-negative groups, respectively. As a supplemental analysis, we evaluated HIV-related factors associated with eGFRcys accuracy in HIV-positive subjects in a multivariate logistic regression model. Factors significantly associated with eGFRcys accuracy in univariate analysis were selected for inclusion in the multivariate model by stepwise backward selection, where factors with P>0.05 were removed from the model, with the covariate for use of antiretroviral therapy forced into the final model. Additionally, we explored the association between activated CD8 cells and bias for eGFRcr and eGFRcys using scatterplots, Spearman correlation coefficients, and linear regression. We used REDCap for data collection and management [17] and Stata version 10 (Stata Corp, College Station, TX) for the statistical analysis.

Results

Table 1 summarizes the clinical characteristics of the study participants. HIV-positive and HIV-negative groups were similar in age, BMI, race, and smoking status. The HIV-positive group had higher proportions of women and hepatitis C seropositive subjects. HIV-positive subjects were more likely HIV-negative subjects to have a history of hypertension and cardiovascular disease, although systolic blood pressure and glycosylated hemoglobin levels were higher in HIV-negative subjects. There was no significant difference in hsCRP between the two groups, although levels of activated CD4 and CD8 cells were substantially higher in the HIV-positive participants. The median urine albumin-creatinine ratio was similar in the two groups, although HIV-positive subjects were significantly more likely to have an albumin-creatinine ratio >30 mg/g. mGFR was significantly lower in HIV-positive than HIV-negative subjects. Creatinine and eGFRcr were similar in the two groups. In contrast, cystatin C was significantly higher and eGFRcys and eGFRcr-cys were significantly lower in HIV-positive subjects. Most HIV-positive subjects were taking antiretroviral therapy and had HIV RNA <400 copies/mL. Sixty eight percent of HIV-positive subjects were taking tenofovir, but no participant was taking a cobicistat-containing preparation. CD4 and CD8 activation in HIV- positive participants was strongly associated with HIV RNA suppression, as has been reported previously [18], [19]. In HIV-positive participants with HIV RNA >400 copies/mL the median value for activated CD4 T-cells was 18% compared with 7% in those with HIV RNA ≤400 copies/mL (P<0.0001). Similarly, the median values of activated CD8 T-cells were 54% and 27% in HIV-positive subjects with HIV RNA >400 or ≤400 copies/mL, respectively (P<0.0001). Table 2 shows performance measures of the three estimating equations. All three equations tended to be less accurate in HIV-positive than HIV-negative subjects, although differences were not statistically significant when accounting for multiple comparisons. Additionally, all three equations tended to underestimate mGFR. The eGFRcr equation was significantly less biased in HIV-positive than HIV-negative subjects. The precision of the three equations was similar in both groups. Bland-Altman plots of the three equations in HIV-positive and HIV-negative subjects are shown in Figures 1 and 2.
Figure 1

Bland-Altman plots for estimated and measured glomerular filtration rate (GFR) in HIV-positive participants using the CKD-EPI equations for serum creatinine (A), cystatin C (B), or both biomarkers (C).

The average GFR (measured and estimated) is shown on the X axes. Bias, defined as the difference between estimated and measured GFR, is displayed on the Y axes. The average biases are represented by the horizontal solid lines and the horizontal dashed lines represent 2 standard deviations above and below the averages.

Figure 2

Bland-Altman plots for estimated and measured glomerular filtration rate (GFR) in HIV-negative participants using the CKD-EPI equations for serum creatinine (A), cystatin C (B), or both biomarkers (C).

The average GFR (measured and estimated) is shown on the X axes. Bias, defined as the difference between estimated and measured GFR, is displayed on the Y axes. The average biases are represented by the horizontal solid lines and the horizontal dashed lines represent 2 standard deviations above and below the averages.

Bland-Altman plots for estimated and measured glomerular filtration rate (GFR) in HIV-positive participants using the CKD-EPI equations for serum creatinine (A), cystatin C (B), or both biomarkers (C).

The average GFR (measured and estimated) is shown on the X axes. Bias, defined as the difference between estimated and measured GFR, is displayed on the Y axes. The average biases are represented by the horizontal solid lines and the horizontal dashed lines represent 2 standard deviations above and below the averages.

Bland-Altman plots for estimated and measured glomerular filtration rate (GFR) in HIV-negative participants using the CKD-EPI equations for serum creatinine (A), cystatin C (B), or both biomarkers (C).

The average GFR (measured and estimated) is shown on the X axes. Bias, defined as the difference between estimated and measured GFR, is displayed on the Y axes. The average biases are represented by the horizontal solid lines and the horizontal dashed lines represent 2 standard deviations above and below the averages. Comparing equations with one another in the subgroups, eGFRcys was significantly less accurate within 30% of mGFR than both eGFRcr and eGFRcr-cys in the HIV-positive group (accuracy of 79% compared to 89% and 91%, respectively), and eGFRcys was significantly less accurate than eGFRcr-cys in the HIV-negative group. Assessment of accuracy within 10% of mGFR showed a similar pattern. Specifically, among HIV-positive subjects accuracies within 10% were 31%, 45%, and 42% for eGFRcys, eGFRcr, and eGFRcr-cys. Among HIV-negative subjects, accuracies within 10% were 31%, 41%, and 43% for eGFRcys, eGFRcr, and eGFRcr-cys, respectively. In the HIV-positive group eGFRcys was significantly more biased than both eGFRcr and eGFRcr-cys (median bias of −16.3 compared to −1.1 and −7.2 mL/min/1.73 m2, respectively), and eGFRcr-cys was significantly more biased than eGFRcr. In the HIV-negative group, eGFRcys was significantly more biased than eGFRcr-cys. eGFRcys tended to be the least precise of the estimating equations however, there were no statistically significant differences between equations in either group. Table 3 shows the associations of clinical factors with the accuracy of eGFRcr and eGFRcys in the HIV-positive and HIV-negative groups. In the HIV-positive group, lower eGFRcys accuracy was significantly associated with activated CD4 and CD8 percentages above the medians, not taking antiretroviral therapy, current CD4 count <450 cells/mm3, and HIV RNA >400 copies/mL. eGFRcys accuracy was not significantly associated with age, BMI, sex, mGFR strata, hepatitis C serostatus, hsCRP, or nadir CD4 count. No factors were significantly associated with the accuracy of eGFRcr in either group and no factors were significantly associated with eGFRcys accuracy in the HIV-negative group, accounting for multiple comparisons. Table 4 shows the associations of clinical factors with eGFRcr and eGFRcys bias. Sex was significantly associated with eGFRcr bias in both groups. mGFR stratum was significantly associated with eGFRcr and eGFRcys bias in both groups, with larger underestimation at mGFR ≥90 versus <90 mL/min/1.73 m2. Hepatitis C serostatus was associated with eGFRcys bias in both the HIV-positive and HIV-negative groups, with larger underestimation in hepatitis C seropositive than seronegative subjects. In the HIV-positive group, eGFRcys bias was significantly associated with not taking antiretroviral therapy, activated CD4 and CD8 percentages above the medians, and HIV RNA >400 copies/mL. Finally, nadir CD4 count was significantly associated with eGFRcr bias, with modest underestimation and overestimation at nadir CD4 counts >150 and ≤150 cells/mm3, respectively. Age, BMI, hsCRP, and current CD4 cell count were not significantly associated with eGFRcr or eGFRcys bias in either group, accounting for multiple comparisons. In a supplemental analysis, we assessed factors associated with eGFRcys accuracy in a multivariate logistic regression model, in which the covariate for antiretroviral therapy use was forced into the model and other candidate variables (HIV RNA >400 copies/mL, current CD4 count, activated CD8 cells, and activated CD4 cells) were selected by backward stepwise selection. Current CD4 count and activated CD4 were dropped from the model. Use of antiretroviral therapy, which was significantly associated with an increased odds of eGFRcys accuracy in unadjusted analysis (odds ratio [OR], 4.5; 95% confidence interval [CI] 1.6, 13.0), was not significantly associated with accuracy in the multivariate model (OR, 1.2; 95% CI 0.3, 4.2). Both HIV RNA >400 copies/mL (OR, 0.2; 95% CI 0.1, 0.7) and activated CD8 percentage above the median (OR, 0.3, 95% CI 0.1, 0.9) were significantly associated with lower likelihood of eGFRcys accuracy in the multivariate model. Figure 3 shows the relationships between activated CD8 T-cells and the bias of eGFRcr and eGFRcys in HIV-positive and HIV-negative participants. The percentage activated CD8 T-cells was not significantly correlated with eGFRcr bias in either group. In contrast, activated CD8 T-cells were significantly negatively correlated with eGFRcys bias in HIV-positive (rho = −0.35, P<0.0001) but not HIV-negative subjects. In HIV-positive subjects, each 20% increase in activated CD8 cells was associated a significant bias difference of −7.5 mL/min/1.73 m2 (95% CI, −10.6, −4.5) for eGFRcys, but no significant bias difference for eGFRcr (1.5 mL/min/1.73 m2; 95% CI −1.5, 4.5). In HIV-negative subjects, each 20% increase in activated CD8 cells was associated a borderline significant bias difference of −5.7 mL/min/1.73 m2 (95% CI, −12.2, 0.6) for eGFRcys, but no bias difference for eGFRcr (0.4 mL/min/1.73 m2; 95% CI −5.4, 6.2).
Figure 3

Correlation of estimated glomerular filtration rate (eGFR) bias, defined as the difference between eGFR and measured GFR, with percentage of activated CD8 T cells (CD38+ and HLA-DR+) using the creatine-based CKD-EPI equation in HIV-negative (A) and HIV-positive (B) subjects, and the cystatin C-based CKD-EPI equation in HIV negative (C) and HIV-positive (D) subjects.

The percentage of CD8+ T cells with an activated phenotype is shown on the X axes (note, different scales for HIV-positive and HIV-negative groups). Rho is the spearman rank correlation coefficient, which may vary between −1 and 1. The dashed lines represent least-squares regression lines.

Correlation of estimated glomerular filtration rate (eGFR) bias, defined as the difference between eGFR and measured GFR, with percentage of activated CD8 T cells (CD38+ and HLA-DR+) using the creatine-based CKD-EPI equation in HIV-negative (A) and HIV-positive (B) subjects, and the cystatin C-based CKD-EPI equation in HIV negative (C) and HIV-positive (D) subjects.

The percentage of CD8+ T cells with an activated phenotype is shown on the X axes (note, different scales for HIV-positive and HIV-negative groups). Rho is the spearman rank correlation coefficient, which may vary between −1 and 1. The dashed lines represent least-squares regression lines.

Discussion

Our first objective in this analysis was to compare the performance of CKD-EPI GFR equations in HIV-positive and HIV-negative participants. All equations tended to be less accurate in the HIV-positive group, although no differences were statistically significant when accounting for multiple comparisons. Our second objective was to compare the performance of equations with one another, with a focus on the HIV-positive group. We found that eGFRcys was significantly less accurate than eGFRcr or eGFRcr-cys in HIV-positive subjects, and that eGFRcys underestimated mGFR by a median of 16.3 ml/min/1.73 m2 in HIV-positive subjects, a significantly larger bias than either eGFRcr or eGFRcr-cys. Our third objective was to assess factors associated with the accuracy and bias of eGFRcr and eGFRcys, in order to identify factors that might differentially affect the performance of these intrinsic GFR biomarkers. Markers of uncontrolled HIV-infection (non-use of antiretroviral therapy, lower current CD4 cell count, HIV RNA >400 copies/mL, and higher T-cell activation) were strongly associated with lower accuracy and larger bias of eGFRcys. In a multivariate model, the association between use of antiretroviral therapy and eGFRcys accuracy appeared to be completely explained by HIV RNA suppression and percentage of activated CD8 cells. Additionally, we found that hepatitis C seropositivity was associated with a larger eGFRcys bias in both HIV-positive and HIV-negative subjects. In contrast, none of these HIV-related factors was significantly associated with eGFRcr performance. Our results should be considered in context of other studies that have examined the performance of GFR estimating equations in HIV-positive individuals. First, we found that all three CKD-EPI equations tended to be less accurate in HIV- positive than in HIV-negative subjects. To date there are few published data directly comparing equation performance in HIV-positive and HIV-negative subjects, although two studies [6], [7] noted lower CKD-EPI equation accuracy in HIV-positive subjects compared to historical data from the general population [15]. Second, among HIV-positive subjects, we found that the eGFRcr and eGFRcr-cys equations had similar accuracy and were both significantly more accurate than eGFRcys. Additionally, eGFRcr was significantly less biased than both eGFRcys and eGFRcr-cys. A study of 203 HIV-positive European subjects, in with mGFR measurements by iohexol clearance, found that eGFRcys accuracy was slightly lower than eGFRcr or eGFRcr-cys, although differences were not statistically significant, and bias was similar in the three equations. In contrast, Inker and colleagues evaluated CKD-EPI equations in 200 HIV-positive participants [6] and found that eGFRcr and eGFRcys had similar accuracy and bias, while eGFRcr-cys was significantly more accurate than eGFRcys and non-significantly more accurate than eGFRcr. Two other studies that used earlier cystatin C equations variably found cystatin C-based GFR to be more accurate [20] and less accurate [21] than creatinine-based equations. In aggregate, these studies provide little support for the use of cystatin C to improve GFR estimation in HIV-positive individuals, particularly when used alone. Our study and that of Inker and colleagues found eGFRcr-cys to have the highest accuracy, although the differences between eGFRcr-cys and eGFRcr were small and not statistically significant in either study. Third, a substantive finding in our study was that accuracy and bias of eGFRcys were strongly associated with HIV-related factors, notably HIV RNA suppression, while eGFRcr performance had no association with these factors. Prior studies have described correlations between cystatin C and antiretroviral therapy, HIV RNA, and CD4 counts [22]–[25]. For example, in the Strategies for Management of Antiretroviral Therapy (SMART) study, subjects randomized to discontinue or defer antiretroviral therapy were significantly more likely to have an increase in serum cystatin C from baseline than those randomized to continuous therapy, while creatinine changes were not significantly different in the two arms [24]. However, it has been uncertain if cystatin C was reflecting true reductions in GFR, or if cystatin C was confounded by HIV-related non-GFR factors. Our results support the latter hypothesis. A recent European study also observed a trend for higher accuracy with eGFRcr as compared to eGFRcys in subjects with a detectable HIV RNA, lending support to our findings [7]. However, Inker and colleagues reported no significant differences in eGFRcys accuracy or bias according to HIV RNA strata, although this study had only 14 HIV-positive subjects with HIV RNA >1,000 copies/mL, limiting their ability to detect a difference in the subset without viral suppression [6]. A novel finding in our study was the strong association between markers of T-cell activation and eGFRcys accuracy and bias. Compared to HIV-negative persons, HIV-positive individuals have a higher prevailing state of immune activation - as measured by the percentages of activated CD4 and CD8 cells - which may be driven by microbial translocation resulting from disruption of the gut-associated lymphoid tissue in HIV infection [13]. T-cell activation markers have long been recognized as predictors of HIV disease progression and mortality, independent of CD4 and viral load [26]. Levels of T-cell activation has been found to decline markedly with antiretroviral therapy and viral suppression, although not to levels seen in HIV-negative persons. Our results imply a strong positive correlation between levels of activated CD4 and CD8 cells and cystatin C that was independent of GFR. In particular, we found that underestimation bias of eGFRcys increased linearly with increasing percentage of activated CD8 cells in HIV-positive subjects. To our knowledge, no prior studies have assessed associations between T-cell activation markers and cystatin C or eGFRcys performance. The association between cystatin C and inflammation or immune activations in HIV-positive individuals may explain the stronger observed association of cystatin C and mortality than creatinine and mortality in HIV-positive persons [27], [28], and in the general population [29]. In contrast, we found no association between the inflammation marker, hsCRP, and eGFRcys performance. This suggests that the mechanism by which HIV-related T-cell activation affects plasma cystatin C is distinct from inflammatory pathways reflected by hsCRP. Our results have clinical implications. First, all three CKD-EPI equations tended to be less accurate in HIV-positive than HIV-negative subjects. Although these differences were not statistically significant when accounting for multiple comparisons, they may be clinically relevant and evaluation in larger comparative studies is indicated. Second, among the CKD-EPI equations, there was no evidence that cystatin C, either alone or in combination with creatinine, appreciably improved GFR estimation compared to using creatinine alone. Third, we found that antiretroviral therapy use, detectable HIV RNA, and lower CD4 counts were strongly associated with the accuracy and bias of eGFRcys, but not with eGFRcr. Moreover, these associations may be mediated by T-cell activation, although additional research is needed to confirm this association. This implies that cystatin C may be a suboptimal GFR index in HIV-positive persons, particularly in those not taking antiretroviral therapy or with uncontrolled viremia. The strengths of our study include use of iohexol clearance – an exogenous gold-standard GFR measurement method, use of standardized plasma creatinine and cystatin C measurements, and inclusion of a demographically similar HIV-negative comparison group. Our study also has limitations. First, the sample size was relatively small, and we may have insufficient power to detect potentially clinically significant differences. Second, over 90% of our study population was African American, which precluded comparisons by racial groups. Our results may not be generalizable to HIV-positive individuals of other racial backgrounds. Third, our cohort was restricted to individuals with MDRD GFR >60 ml/min/1.73 m2 and equation performance could not be assessed in persons with poorer kidney function. In conclusion, we found that CKD-EPI equations based on creatinine and cystatin C tended to be less accurate in HIV-positive than HIV-negative subjects. eGFRcys was significantly less accurate and more biased than both the widely-used eGFRcr equation and the combined eGFRcr-cys equation in HIV-positive individuals. Moreover, eGFRcys performance was strongly affected by uncontrolled HIV disease and T-cell activation indices. In contrast, eGFRcr performance was not modified by HIV-related factors or T-cell activation.
  28 in total

1.  First certified reference material for cystatin C in human serum ERM-DA471/IFCC.

Authors:  Anders Grubb; Søren Blirup-Jensen; Veronica Lindström; Camilla Schmidt; Harald Althaus; Ingrid Zegers
Journal:  Clin Chem Lab Med       Date:  2010-10-29       Impact factor: 3.694

Review 2.  Estimating equations for glomerular filtration rate in the era of creatinine standardization: a systematic review.

Authors:  Amy Earley; Dana Miskulin; Edmund J Lamb; Andrew S Levey; Katrin Uhlig
Journal:  Ann Intern Med       Date:  2012-02-06       Impact factor: 25.391

3.  Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support.

Authors:  Paul A Harris; Robert Taylor; Robert Thielke; Jonathon Payne; Nathaniel Gonzalez; Jose G Conde
Journal:  J Biomed Inform       Date:  2008-09-30       Impact factor: 6.317

4.  Detection of chronic kidney disease with creatinine, cystatin C, and urine albumin-to-creatinine ratio and association with progression to end-stage renal disease and mortality.

Authors:  Carmen A Peralta; Michael G Shlipak; Suzanne Judd; Mary Cushman; William McClellan; Neil A Zakai; Monika M Safford; Xiao Zhang; Paul Muntner; David Warnock
Journal:  JAMA       Date:  2011-04-11       Impact factor: 56.272

5.  Cystatin C in HIV-infected patients: promising but not yet ready for prime time.

Authors:  Amandine Gagneux-Brunon; Christophe Mariat; Pierre Delanaye
Journal:  Nephrol Dial Transplant       Date:  2012-03-06       Impact factor: 5.992

6.  Chronic kidney disease and estimates of kidney function in HIV infection: a cross-sectional study in the multicenter AIDS cohort study.

Authors:  Michelle M Estrella; Rulan S Parekh; Brad C Astor; Robert Bolan; Rhobert W Evans; Frank J Palella; Lisa P Jacobson
Journal:  J Acquir Immune Defic Syndr       Date:  2011-08-15       Impact factor: 3.731

7.  Cystatin C, albuminuria, and 5-year all-cause mortality in HIV-infected persons.

Authors:  Andy Choi; Rebecca Scherzer; Peter Bacchetti; Phyllis C Tien; Michael S Saag; Cynthia L Gibert; Lynda A Szczech; Carl Grunfeld; Michael G Shlipak
Journal:  Am J Kidney Dis       Date:  2010-08-14       Impact factor: 8.860

8.  Interruption of antiretroviral therapy is associated with increased plasma cystatin C.

Authors:  Amanda Mocroft; Christina Wyatt; Lynda Szczech; Jacquie Neuhaus; Wafaa El-Sadr; Russell Tracy; Lewis Kuller; Michael Shlipak; Brian Angus; Harting Klinker; Michael Ross
Journal:  AIDS       Date:  2009-01-02       Impact factor: 4.177

9.  A comparison of the predictive performance of different methods of kidney function estimation in a well-characterized HIV-infected population.

Authors:  Katherine Barraclough; Lee Er; Francisco Ng; Marianne Harris; Julio Montaner; Adeera Levin
Journal:  Nephron Clin Pract       Date:  2008-12-03

10.  A new equation to estimate glomerular filtration rate.

Authors:  Andrew S Levey; Lesley A Stevens; Christopher H Schmid; Yaping Lucy Zhang; Alejandro F Castro; Harold I Feldman; John W Kusek; Paul Eggers; Frederick Van Lente; Tom Greene; Josef Coresh
Journal:  Ann Intern Med       Date:  2009-05-05       Impact factor: 25.391

View more
  19 in total

Review 1.  Kidney Disease and HIV Infection.

Authors:  Christina M Wyatt
Journal:  Top Antivir Med       Date:  2017 Feb/Mar

2.  Plasma Cystatin C Associates With HIV-Associated Neurocognitive Disorder but Is a Poor Diagnostic Marker in Antiretroviral Therapy-Treated Individuals.

Authors:  Robert C Kalayjian; Kevin R Robertson; Jeffrey M Albert; Carl J Fichtenbaum; Todd T Brown; Babafemi O Taiwo
Journal:  J Acquir Immune Defic Syndr       Date:  2019-06-01       Impact factor: 3.731

3.  Longitudinal Assessment of Proximal Tubular Dysfunction in HIV Seropositive and Seronegative Persons: Correlates and Implications.

Authors:  Kerry M Sheets; Mohamed G Atta; Derek M Fine; Katie Zook; Allison M Mcfall; Michelle M Estrella; George J Schwartz; Gregory M Lucas
Journal:  J Acquir Immune Defic Syndr       Date:  2017-05-01       Impact factor: 3.731

4.  Reductions in Plasma Cystatin C After Initiation of Antiretroviral Therapy Are Associated With Reductions in Inflammation: ACTG A5224s.

Authors:  Chris T Longenecker; Douglas Kitch; Paul E Sax; Eric S Daar; Camlin Tierney; Samir K Gupta; Grace A McComsey
Journal:  J Acquir Immune Defic Syndr       Date:  2015-06-01       Impact factor: 3.731

5.  Clinical practice guideline for the management of chronic kidney disease in patients infected with HIV: 2014 update by the HIV Medicine Association of the Infectious Diseases Society of America.

Authors:  Gregory M Lucas; Michael J Ross; Peter G Stock; Michael G Shlipak; Christina M Wyatt; Samir K Gupta; Mohamed G Atta; Kara K Wools-Kaloustian; Paul A Pham; Leslie A Bruggeman; Jeffrey L Lennox; Patricio E Ray; Robert C Kalayjian
Journal:  Clin Infect Dis       Date:  2014-09-17       Impact factor: 9.079

6.  Cross-Sectional and Longitudinal Performance of Creatinine- and Cystatin C-Based Estimating Equations Relative to Exogenously Measured Glomerular Filtration Rate in HIV-Positive and HIV-Negative Persons.

Authors:  Gregory M Lucas; Mohamed G Atta; Katie Zook; Dhananjay Vaidya; Xueting Tao; Paula Maier; George J Schwartz
Journal:  J Acquir Immune Defic Syndr       Date:  2020-12-01       Impact factor: 3.731

7.  Kidney disease in antiretroviral-naïve HIV-positive adults with high CD4 counts: prevalence and predictors of kidney disease at enrolment in the INSIGHT Strategic Timing of AntiRetroviral Treatment (START) trial.

Authors:  A C Achhra; A Mocroft; M J Ross; L Ryom; G M Lucas; H Furrer; J Neuhaus; C Somboonwit; M Kelly; J M Gatell; C M Wyatt
Journal:  HIV Med       Date:  2015-04       Impact factor: 3.180

8.  Tenofovir alafenamide as part of a salvage regimen in a patient with multi-drug resistant HIV and tenofovir-DF-associated renal tubulopathy.

Authors:  James M Mikula; Maura M Manion; Frank Maldarelli; Lucila M Suarez; Jaha F Norman-Wheeler; Alex G Ober; Robin L Dewar; Jeffrey B Kopp; H Clifford Lane; Alice K Pau
Journal:  Antivir Ther       Date:  2016-03-08

9.  Rosuvastatin preserves renal function and lowers cystatin C in HIV-infected subjects on antiretroviral therapy: the SATURN-HIV trial.

Authors:  Chris T Longenecker; Corrilynn O Hileman; Nicholas T Funderburg; Grace A McComsey
Journal:  Clin Infect Dis       Date:  2014-07-11       Impact factor: 9.079

10.  Factors associated with iohexol-based glomerular filtration rate slope over 36 months in HIV-negative and HIV-positive individuals.

Authors:  Gregory M Lucas; Mohamed G Atta; Katie Zook; Allison M McFall; Shruti H Mehta; Derek M Fine; James H Stein; George J Schwartz
Journal:  AIDS       Date:  2016-02-20       Impact factor: 4.177

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.