Literature DB >> 23943774

Endogenous testosterone level and testosterone supplementation therapy in chronic obstructive pulmonary disease (COPD): a systematic review and meta-analysis.

Evan Atlantis1, Paul Fahey, Belinda Cochrane, Gary Wittert, Sheree Smith.   

Abstract

OBJECTIVE: Low testosterone level may be a reversible risk factor for functional disability and deterioration in patients with chronic obstructive pulmonary disease (COPD). We sought to systematically assess the endogenous testosterone levels and effect of testosterone therapy on exercise capacity and health-related quality of life (HRQoL) outcomes in COPD patients, as well as to inform guidelines and practice.
DESIGN: Systematic review and meta-analysis. DATA SOURCES: We searched PubMed, Scopus, Cochrane Library, CINAHL, Health Source Nursing and PsychINFO and the reference lists of retrieved articles published before May 2012. INCLUSION CRITERIA: Observational studies on endogenous testosterone levels in people with chronic lung disease compared with controls, or randomised controlled trials (RCTs) on testosterone therapy for exercise capacity and/or HRQoL outcomes in COPD patients were eligible. DATA EXTRACTION AND ANALYSIS: Data on the mean difference in endogenous total testosterone (TT) values, and the mean difference in exercise capacity and HRQoL values were extracted and pooled using random effects meta-analysis.
RESULTS: Nine observational studies in 2918 men with COPD reported consistently lower levels of TT compared with controls (weighted mean difference was -3.21 nmol/L (95% CI -5.18 to -1.23)). Six RCTs in 287 participants yielded five studies on peak muscle strength and peak cardiorespiratory fitness outcomes (peak oxygen uptake (VO2) and workload) and three studies on HRQoL outcomes. Testosterone therapies significantly improved peak muscle strength (standardised mean difference (SMD) was 0.31 (95% CI 0.05 to 0.56)) and peak workload (SMD was 0.27 (95% CI 0.01 to 0.52)) compared with control conditions (all but one used placebo), but not peak VO2 (SMD was 0.21 (95% CI -0.15 to 0.56)) or HRQoL (SMD was -0.03 (95% CI -0.32 to 0.25)).
CONCLUSIONS: Men with COPD have clinically relevant lower than normal TT levels. Insufficient evidence from short-term studies in predominately male COPD patients suggests that testosterone therapy improves exercise capacity outcomes, namely peak muscle strength and peak workload.

Entities:  

Keywords:  Epidemiology

Year:  2013        PMID: 23943774      PMCID: PMC3740247          DOI: 10.1136/bmjopen-2013-003127

Source DB:  PubMed          Journal:  BMJ Open        ISSN: 2044-6055            Impact factor:   2.692


To systematically assess the mean endogenous testosterone level in people with chronic lung disease compared with controls from observational studies. To systematically assess the effect of testosterone therapy on exercise capacity and health-related quality of life outcomes in chronic obstructive pulmonary disease (COPD) patients from randomised controlled trials (RCTs). Men with COPD have clinically relevant lower than normal total testosterone levels compared with controls. Limited evidence from short-term RCT studies in predominately male COPD patients suggest that testosterone therapy improves exercise capacity outcomes, namely peak muscle strength and peak workload. Key findings were based on a high-quality systematic review and meta-analysis level of evidence. Since only a small number of studies conducted in specific populations were included, the findings of this review may not be relevant to other countries and key groups, which will require further research.

Introduction

Chronic obstructive pulmonary disease (COPD) is currently ranked the fifth leading cause of global disability (health loss).1 Health status or health-related quality of life (HRQoL) is a clinically important measurement of disability among patients with COPD for prognostic studies and trials.2–4 Exercise capacity, one of the main determinants of HRQoL, is significantly impaired in COPD patients.3 5 Dyspnoea and fatigue due to skeletal muscle dysfunction, among other physiological abnormalities, are cardinal symptoms that limit exercise capacity in COPD patients.6 This is partly due to decreases in muscle strength and mass (often called ‘cachexia’), since they are characteristic features of skeletal muscle dysfunction contributing to exercise intolerance and consequential deterioration in HRQoL.5 6 Conversely, pulmonary rehabilitation (PR) including exercise (namely resistance training (RT)) leads to clinically relevant improvements in muscle strength and HRQoL,7 8 indicating that skeletal muscle dysfunction should be a primary therapeutic target for intervention in patients with COPD. Since the testosterone level has been shown to be positively associated with muscle strength and cardiorespiratory fitness accounting for physical activity and muscle mass,9 10 a low testosterone level may be an independent risk factor for functional disability and deterioration in COPD. For example, the levels of testosterone and other androgenic hormones were decreased in male and female COPD patients compared with controls in a few studies.11–13 The potential mechanisms for this endocrine dysfunction most likely involve hypoxaemia, hypercapnia, systemic inflammation and the use of glucocorticoids.14 Thus, it is important to reliably establish whether the mean endogenous testosterone level is decreased in patients with COPD, because this condition is reversible with testosterone supplementation therapy. Indeed, a small but promising body of randomised controlled trial (RCT) evidence suggests that testosterone therapy improves exercise capacity and HRQoL without increasing serious adverse events.15–17 While it is difficult to explain this apparent therapeutic benefit, increased cardiac output,18 haemoglobin and haematocrit,19 baroreflex sensitivity20 and exercise tolerance due to improvements in peak oxygen uptake (peak VO2) and muscle strength20 are all plausible mechanisms. However, our initial analysis of the available published literature indicates an absence of a systematic review of relevant studies on endogenous testosterone levels and testosterone therapy in patients with COPD. We therefore sought to systematically review previous research to assess the mean endogenous testosterone level in people with chronic lung disease compared with controls, and the effects of testosterone therapies on exercise capacity and HRQoL outcomes in COPD patients, to inform guidelines and practice.

Methods

Search strategy

We searched PubMed, Scopus, Cochrane Library, CINAHL, Health Source Nursing and the PsychINFO electronic databases for articles published before May 2012. Search syntaxes were developed in consultation with an experienced university research librarian taking into account a broad range of terms and phrases used in definitions of testosterone and COPD (full electronic search strategies for the PubMed, Scopus and Cochrane Library databases in online supplementary appendix pages 1 and 2). Reference lists of potentially eligible articles were searched by hand to identify additional studies missed by our search strategy.

Study selection

One reviewer (EA) identified potentially relevant studies for inclusion by screening titles and/or abstracts of all citations identified with our database searches. A second screening was performed on the full text of these articles. Observational studies in adult populations that reported endogenous testosterone levels in men and/or women (separately) with chronic lung disease (cases) compared with controls, or RCTs that reported the effects of testosterone treatment on exercise capacity and HRQoL outcomes in COPD patients were eligible. There were no language restrictions for articles.

Data extraction

Data extraction and quality assessment of included studies were performed and/or verified independently by three reviewers (EA, BC and SS). Discrepancies were resolved through discussion. Authors of relevant studies were contacted, where possible, for data that could not be extracted from the published articles.

Quality assessment

For methodology and quality assessment, quality checklists were developed to identify potential sources of bias (tables in online supplementary appendix pages 3 and 4). Quality items for observational studies reviewed were (each worth 1 numerical point) as follows: (1) COPD or chronic lung disease was reported to have been clinically diagnosed or categorised according to the WHO International Statistical Classification of Diseases and Related Health Problems (ICD) system, (2) endogenous testosterone level was measured by radioimmunoassay or liquid chromatography-tandem mass spectrometry, (3) the study population was representative of the clinical setting or community (ie, demographic characteristics of cases and hospital controls were typical and community cases or controls were randomly selected) and (4) there was adequate adjustment or exclusion or matching for covariates known to be associated with COPD and hypogonadism in men (each worth 0.2 numerical point): (a) age, (b) socioeconomic or partner status, (c) central or general obesity, (d) smoking status, (e) alcohol intake, (f) physical activity, (g) depression or anxiety (or medications), (h) metabolic syndrome or cardiovascular disease (or medications), (i) systemic inflammation (or glucocorticoids) and (j) sleep apnoea (or treatments). Quality items for RCT studies reviewed were (each worth 1.0 numerical point) as follows: (1) study eligibility criteria were adequately described, (2) randomisation methodology was adequate (ie, evidence suggesting that the ‘random’ method was used to generate and implement random allocation sequence), (3) allocation concealment was adequate (ie, evidence to suggest that a robust method was used for concealing the sequence of treatment allocation (eg, independent IT or telephone service or sealed opaque envelopes only opened in front of the participant), (4) between-group prognostic indicators were balanced (ie, evidence showing that groups were similar at the outset for these prognostic indicators), (5) care providers were blinded to treatment allocation, (6) between-group drop-out rates were balanced, (7) intention-to-treat analysis was included and (8) adverse events were reported. Our quality checklist scales were designed based on criteria for assessment of observational studies21 and RCTs21 22 and allowed summed scores to range from 0 to 5 points and from 0 to 8 points, respectively, reflecting lowest to highest quality. Studies were considered ‘better quality’ if they received a score of 3 or higher for observational studies and of 5 or higher for RCTs, since that meant that they had most of our quality items.

Primary outcomes

The primary outcomes were the mean difference in endogenous total testosterone (TT) values between the case and control groups for observational studies (the most frequently reported testosterone outcome in relevant studies), and the mean difference in exercise capacity and HRQoL values after intervention (post-treatment) between the treatment and control groups for RCTs. Where necessary for observational studies, we estimated the mean and variance from the median, range and sample size using methods which have been shown to be reasonably robust in non-extreme circumstances.23 Where necessary for RCTs, the post-treatment means were derived from the within-group changes and the control group SD carried forward from the baseline values.24 Standardised mean differences (SMDs) were calculated using Glass’ Delta method. Exercise capacity outcomes included any assessment of cardiorespiratory fitness and peripheral skeletal muscle strength. Where multiple cardiorespiratory fitness outcomes were reported, we first chose peak VO2 measures and then prioritised peak workload (power output) laboratory assessments of cardiorespiratory fitness over field tests. Where multiple muscle strength outcomes were reported, we prioritised peak isometric measures over peak dynamic measures and knee extension over other joint movements. HRQoL outcomes included any patient-reported assessment of health status or functional disability. Where multiple HRQoL outcomes/scales were reported, we first chose summed score scales, and then prioritised subscales that measure ‘fatigue’ symptoms, and the most frequently reported HRQoL outcome in the other studies reviewed.

Data synthesis

Three reviewers (EA, BC and SS) independently collated and/or verified extracted data to present a descriptive synthesis of important study characteristics and a quantitative synthesis of effect estimates.

Secondary outcomes

The secondary outcomes were data about adverse events reported in RCTs for a descriptive synthesis.

Statistical methods

We pooled and weighted studies first using random effects meta-analysis models, and second using fixed effects models for verification.25 Where necessary, we standardised laboratory values for endogenous TT levels between observational studies using the International System of Units (SI units), expressed in nanomoles per litre (nmol/L). These studies were then pooled to estimate the inverse variance weighted mean difference (WMD), including the DerSimonian and Laird 95% CI, between cases and controls. Where papers presented medians without means, we estimated the missing mean as being equal to the median for meta-analysis.23 In examining the effects of testosterone treatment on exercise capacity and HRQoL outcomes, the SMD from each RCT was pooled to produce an overall estimate of effect, and associated 95% CI, between the treatment and control groups. For each meta-analysis model, the degree of heterogeneity in SMDs was assessed by visual inspection, the I2 statistic (moderate being <50%26) and the χ2 test of goodness of fit.27 Where evidence of heterogeneity was observed, we checked data extracted from individual outlier studies, qualitatively investigated reasons for their different results and explored the effects of study exclusion in sensitivity analyses. We also used sensitivity analysis to investigate the robustness of the meta-analyses models. We variously excluded RCTs in men and women, placebo only (rather than placebo with exercise) controlled trials, longer duration trials (≥12 weeks) and studies of lower quality (score <3 for observational studies; score <5 for RCTs). And we repeated the meta-analysis models using different cardiorespiratory fitness outcomes. Publication bias, which reflects the tendency for smaller studies to be published in the literature only when the findings are positive, was assessed visually using funnel plots.28 All calculations were performed in Stata V.12 (StataCorp, College Station, Texas, USA) using the ‘metan’ and ‘metafunnel’ commands. A two-tailed p value <0.05 was considered statistically significant throughout the analyses.

Results

Figure 1 presents a flow chart summarising the identification of potentially relevant studies, as well as those included and excluded (see online supplementary appendix page 8). Our search strategy identified 906 citations after the duplicates were removed. Of these, 865 citations were excluded after the first screening of titles and/or abstracts for inclusion and exclusion criteria, leaving 41 citations for a second full text screening. Hand searching the reference lists of these articles identified two additional potentially relevant citations. After further assessment of these 43 citations, 28 were excluded for reasons listed in figure 1, leaving 15 for final inclusion in the systematic review. Most studies were excluded for inadequate predictor or outcome variables, or for not having a control group (list of excluded citations; see online supplementary appendix pages 5–7).
Figure 1

Flow chart summarising identification of studies included for review.

Flow chart summarising identification of studies included for review.

Descriptive data synthesis

Table 1 presents the study characteristics of nine observational studies included for review, which were published between 1981 and 2011. Studies were conducted in Scotland,29 30 Sweden,31 the USA,32 Taiwan,33 Greece,12 Turkey,13 Norway34 and Belgium.35 The degree of severity of airflow limitation in COPD cases ranged from mild-to-very severe, assessed according to the Global Initiative for Chronic Obstructive Lung Disease criteria36 in four studies,12 13 33 35 and by various spirometry criteria in four29 30 32 34 of the five remaining studies. Control participants were recruited from primary care settings in six studies.12 29 30 32 33 35 The sample sizes ranged from 16 to 213, resulting in a total of 2918 participants across studies. The mean age of the samples ranged from 50 to 71 years. All the observational studies were conducted in men. The mean quality scores ranged from 2.2 to 4, and four studies received a score of 3 or higher.12 13 32 34
Table 1

Characteristics of observational studies reviewed

Participants
Mean (SD) or median* (range) total testosterone (nmol/L)
Study identificationCountryCases, assessmentControlsSample sizeSexMean age (years)Cases
Controls
Covariate considerations (adjusted/excluded/matched)Quality score (out of 5)
Bratel et al31SwedenCOPD with severe airway obstruction and daytime hypoxaemia, not reportedAge-matched ‘healthy’ participants32M6914.36.917.96.9Age1.2
Gow et al29ScotlandCOPD, spirometry FEV1 <40% and FVC <65% predictedInpatients ready for discharge26M7010.73.0–19.511.01.8–21.9Age, thyroid disease, oral corticosteroids2.9
Iqbal et al32USAChronic lung disease, predominantly spirometry FEV1/FVC <80% predictedPrimary care clinic patients without history of chronic lung disease or corticosteroid treatments85M6211.19.814.08.6Age, ethnicity, BMI, physical activity, smoking status, caffeine and alcohol consumption, thyroid and rheumatologic conditions, medications including glucocorticoids, testosterone, and for osteoporosis4.0
Hsu et al33TaiwanChronic bronchitis and COPD, GOLD criteria stage 1–4Outpatients with stable urolithiasis or prostatitis213M7114.77.715.36.4Age, chronic diseases including treated benign prostate hyperplasia, other chronic lung disease, exacerbation2.9
Kaparianos et al12GreeceCOPD, GOLD criteria mean FEV1 54%, mean FEV1/FVC 59%Outpatient smokers125M6111.24.418.44.5Age, ethnicity, BMI, smoking, chronic diseases, endothelin-1 pro-inflammatory allele, other chronic lung diseases, medications including β2-adrenergic agonists, corticosteroids, follicle stimulating hormone, erythrocyte sedimentation rate3.5
Karadag et al13TurkeyCOPD, GOLD criteria stage 2–3Age-matched participants125M6313.25.516.65.5Age, sexual partner status, BMI, medications that interfere with sex hormones, chronic diseases, treated urogenital disease, aged ≥75 years, regular systemic corticosteroids, oestradiol, tumour necrosis factor-α3.0
Semple et al30ScotlandCOPD, spirometry FEV1 and FEV1/FVC <70%Age-matched inpatients16M5013.14.420.35.4Age2.7
Svartberg et al34NorwayRepresentative population with COPD, spirometry FEV1 <50% predicted with FEV1/FVC <70% predictedRepresentative population with spirometry FEV1 ≥50% predicted2197M6612.75.314.05.5Age, waist circumference, smoking status3.6
Van Vliet et al35BelgiumCOPD, GOLD criteria stage 1–4Outpatients with normal lung function99M659.0*6.8–12.912.3*8.8–16.2Age, BMI, calculated low free testosterone, sex hormone binding globulin2.9

BMI, body mass index; BTS, British Thoracic Society; COPD, chronic obstructive pulmonary disease; FEV1, forced expiratory volume in1 s; FVC, forced vital capacity; GOLD, Global Initiative for Chronic Obstructive Lung Disease; M, men; matched, considered if between-group difference in characteristic was not likely statistically significant (p<0.05).

Characteristics of observational studies reviewed BMI, body mass index; BTS, British Thoracic Society; COPD, chronic obstructive pulmonary disease; FEV1, forced expiratory volume in1 s; FVC, forced vital capacity; GOLD, Global Initiative for Chronic Obstructive Lung Disease; M, men; matched, considered if between-group difference in characteristic was not likely statistically significant (p<0.05). Table 2 presents the study characteristics of six RCTs included for review, which were published between 2003 and 2011. Studies were conducted in the USA,37 The Netherlands,38 Brazil,39 France,16 Canada40 and Norway.41 Major inclusion criteria were stable COPD or chronic respiratory failure in all studies, various spirometry criteria in all but one study,16 low TT in only one study37 and low body mass index in only two studies.16 39 Major exclusion criteria were a range of chronic conditions in all studies, prostatic conditions in four studies16 37 39 40 and elevated haemoglobin in one study.37 The sample sizes ranged from 16 to 122, resulting in a total of 287 participants across studies. The mean age of the samples ranged from 66 to 69 years. All but two studies16 40 were conducted in men only. The baseline mean TT levels ranged from 9.6 to 21.6 nmol/L for men, and from 0.42 to 0.45 nmol/L for women as reported in one study.16 The testosterone therapies used were oral testosterone undecanoate in one study,16 oral stanozolol after a baseline intramuscular injection of testosterone in another study39 and intramuscular injections (testosterone enanthate37 41 and nandrolone decanoate38) in all the remaining studies. Four studies investigated the combined effects of testosterone therapy with RT37 or PR.16 39 40 All but one study16 used placebo control conditions. Trial durations ranged from 8 to 27 weeks. Primary outcomes were peak muscle strength in five studies (from four citations16 37 38 40), peak VO2 in five studies (from four citations37–40), peak workload in five studies (from four citations16 37 38 40), 6 min walking test (6MWT) in four studies16 39–41 and HRQoL in three studies.16 38 40 The mean quality scores ranged from 4.5 to 6, and all but one study40 received a score of 5 or higher.
Table 2

Characteristics of randomised controlled trials reviewed

Population
Baseline mean total testosterone (nmol/L)
Study identificationCountrySample sizeMajor inclusion criteriaMajor exclusion criteriaSex (M/W)Mean age (years)TreatedControls
Casaburi et al37USA47Stable COPD, spirometry FEV1 ≤60% predicted and FEV1/VC ≤60%; total testosterone ≤13.9 nmol/LCVD, low or high bodyweight, prostatic indications, haemoglobin ≥16 g/dL, orthopaedic impairmentsM67(a) 10.5; (b) 14.1(a) 10.5; (b) 9.6
Creutzberg et al38The Netherlands56Stable COPD, ATS criteria, spirometry FEV1 <70% predicted and increase in FEV1 <10% postbronchodilationObesity, malignancies, CVD, gastrointestinal inflammatory disorders, type 1 diabetes, oxygen dependency at restM6613.414.6
Ferreira et al39Brazil17Ambulatory and stable COPD, spirometry maximal inspiratory pressure <60% predicted and BMI <20 kg/m2CVD, prostatic indicationsM6914.417.2
Pison et al16France122Stable CRF, >18 years, PaO2 ≤8 kPa, long-term oxygen therapy and/or home mechanical ventilation >3 months, BMI ≤21 kg/m2 or fat-free mass index <25th centilePulmonary hypertension, sleep apnoea, prostatic indications, neuromuscular diseases, cystic fibrosis, conditions compromising 6-month survival, hormone-dependent cancer, women of childbearing age, elevated aminotransferaseM/W66M 12.7; W 0.45M 13.6; W 0.42
Sharma et al40Canada16Stable COPD, GOLD criteria stage 3–4, spirometry FEV1 <50% predicted and FEV1/FVC <0.7History of asthma, obesity, malignancy, CVD, prostatic indications, renal, hepatic, gastrointestinal or endocrine disease, recent surgery ≤2 monthsM/W68M NRW NR
Svartberg et al41Norway29Stable COPD, moderate to severe, spirometry FEV1 <60% predictedAsthma, malignancies, CVD, hepatic or endocrine diseaseM6621.620.5

1RM, one repetition maximum; 6MWT, 6 min walking test; ATS, American Thoracic Society; BMI, body mass index; COPD, chronic obstructive pulmonary disease; CRF, chronic respiratory failure; CRQ, chronic respiratory questionnaire; CVD, cardiovascular diseases; FEV1, forced expiratory volume in 1 s; FVC, forced vital capacity; GOLD, Global Initiative for Chronic Obstructive Lung Disease; HRQoL, health-related quality of life; IM, intramuscular injection; M, men; NR, not reported; PR, pulmonary rehabilitation; RT, resistance training; VO2, volume of oxygen uptake; W, women.

Characteristics of randomised controlled trials reviewed 1RM, one repetition maximum; 6MWT, 6 min walking test; ATS, American Thoracic Society; BMI, body mass index; COPD, chronic obstructive pulmonary disease; CRF, chronic respiratory failure; CRQ, chronic respiratory questionnaire; CVD, cardiovascular diseases; FEV1, forced expiratory volume in 1 s; FVC, forced vital capacity; GOLD, Global Initiative for Chronic Obstructive Lung Disease; HRQoL, health-related quality of life; IM, intramuscular injection; M, men; NR, not reported; PR, pulmonary rehabilitation; RT, resistance training; VO2, volume of oxygen uptake; W, women.

Quantitative data synthesis

Effect of COPD exposure on an endogenous TT level

Figure 2 presents WMD on an endogenous TT level between the case and control groups for observational studies (see online supplementary appendix page 9). Men with COPD had significantly lower levels of TT compared with controls (pooled WMD was –3.21 nmol/L (−5.18 to −1.23)). There was a high degree of heterogeneity between studies (I2=81.9%, p<0.001) that was mostly a result of variation in the degree of deference rather than an unfavourable direction towards the null. The sensitivity analyses presented in table 3 show that the pooled WMD was substantially changed after exclusion of lower quality studies (increased to –3.68 (−7.00 to −0.36)) and one large sample size study34 (increased to –3.56 (−5.63 to −1.49)). Finally, for the one study33 which provided unadjusted mean differences and mean differences adjusted for age, waist circumference and smoking status, a model using unadjusted rather than adjusted values decreased the pooled WMD to −2.95 (−4.63 to −1.27). In addition, a funnel plot was produced which showed only slight evidence of publication bias, since WMD in TT was small (−0.6033 and −1.10 nmol/L34) for two of the largest studies (figure 3; see online supplementary appendix page 10).
Figure 2

Weighted mean difference in the endogenous total testosterone level between the case and control groups for observational studies.

Table 3

Sensitivity analysis of observational studies on COPD exposure → total testosterone outcome meta-analysis

N studiesN sampleTotal testosterone WMD(95% CI)p Value for heterogeneity
Fixed effects model92918−3.00(−3.75 to −2.26)<0.001
Exclusion of five lower quality studies (score <3)42532−3.68(−7.00 to −0.36)<0.001
Model using unadjusted rather than adjusted values in one study92918−2.95(−4.63 to −1.27)<0.001
Exclusion of a large sample size study8721−3.56(−5.63 to −1.49)<0.001

COPD, chronic obstructive pulmonary disease; N, number; WMD, weighted mean difference.

Figure 3

Funnel plot assessing symmetry of the weighted mean difference in the total testosterone level between the case and control groups for observational studies.

Weighted mean difference in the endogenous total testosterone level between the case and control groups for observational studies. Sensitivity analysis of observational studies on COPD exposure → total testosterone outcome meta-analysis COPD, chronic obstructive pulmonary disease; N, number; WMD, weighted mean difference. Funnel plot assessing symmetry of the weighted mean difference in the total testosterone level between the case and control groups for observational studies.

Effect of testosterone therapy on exercise capacity and HRQoL outcomes

Figure 4 presents SMD in peak muscle strength outcomes after testosterone therapy between the treatment and control groups for RCTs (see online supplementary appendix page 11). Testosterone therapies significantly improved standardised peak muscle strength outcomes compared with control conditions (pooled SMD was 0.31 (0.05 to 0.56)), and there was little evidence of statistical heterogeneity between studies (I2=0%, p=0.839). The sensitivity analyses presented in table 4 shows that the pooled SMD was similar after exclusion of one lower quality study40 (0.31 (0.04 to 0.57)), but was substantially changed after exclusion of two placebo only controlled studies (no longer statistically significant 0.30 (−0.01 to 0.62)), and the two studies in men and women that were also the two longer duration studies16 40 (decreased to 0.21 (−0.18 to 0.60)). In addition, a funnel plot was produced which showed only slight evidence of publication bias, since SMD in peak muscle strength outcomes was consistent in all but one treatment arm in one study37 (figure 5; see online supplementary appendix page 12).
Figure 4

Standardised mean difference in peak muscle strength outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials.

Table 4

Sensitivity analysis of randomised controlled trials on testosterone treatment → muscle strength outcomes meta-analysis

N studiesN sampleSMD(95% CI)p Value for heterogeneity
Fixed effects model52410.31(0.05 to 0.56)0.839
Exclusion of one lower quality study (score <5.0)42250.31(0.04 to 0.57)0.699
Exclusion of two placebo only control studies31610.30(−0.01 to 0.62)0.491
Exclusion of two studies in men and women31030.21(−0.18 to 0.60)0.611
Exclusion of two longer duration studies (≥12 weeks)31030.21(−0.18 to 0.60)0.611

N, number; SMD, standardised mean difference.

Figure 5

Funnel plot assessing symmetry of standardised mean difference in peak muscle strength outcomes after testosterone treatment between the treatment and control groups for randomised controlled trials.

Standardised mean difference in peak muscle strength outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials. Sensitivity analysis of randomised controlled trials on testosterone treatment → muscle strength outcomes meta-analysis N, number; SMD, standardised mean difference. Funnel plot assessing symmetry of standardised mean difference in peak muscle strength outcomes after testosterone treatment between the treatment and control groups for randomised controlled trials. Figure 6 presents SMD in peak VO2 outcomes after testosterone therapy between the treatment and control groups for RCTs (see online supplementary appendix page 13). Testosterone therapies consistently failed to show significant improvements in standardised peak VO2 outcomes compared with control conditions (pooled SMD was 0.21 (−0.15 to 0.56); I2=4.8%, p=0.379). The sensitivity analyses presented in table 5 shows that this null effect was similar after exclusion of one lower quality study40 (0.13 (−0.27 to 0.54)), two placebo only controlled studies (0.03 (−0.60 to 0.66)), one study in men and women40 (0.13 (−0.27 to 0.54)), and two longer duration studies39 40 (0.27 (−0.12 to 0.67)), and in the model using 6MWT outcomes (0.10 (−0.34 to 0.53)). Conversely, testosterone therapies significantly improved cardiorespiratory fitness in the model using peak workload rather than peak VO2 outcomes (pooled SMD was 0.27 (0.01 to 0.52)), and there was little evidence of statistical heterogeneity between studies (I2=0%, p=0.741).
Figure 6

Standardised mean difference in peak VO2 outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials.

Table 5

Sensitivity analysis of randomised controlled trials on testosterone treatment → cardiorespiratory fitness outcomes meta-analysis

N studiesN sampleSMD(95% CI)p Value for heterogeneity
Fixed effects model51360.21(−0.13 to 0.56)0.379
Exclusion of one lower quality study (score <5)41200.13(−0.27 to 0.54)0.315
Exclusion of two placebo only control studies3560.03(−0.60 to 0.66)0.269
Exclusion of one study in men and women41200.13(−0.27 to 0.54)0.315
Exclusion of two longer duration study (≥12 weeks)31030.27(−0.12 to 0.67)0.553
Model using peak workload rather than peak VO2 outcomes52410.27(0.01 to 0.52)0.741
Model using 6MWT rather than peak VO2 outcomes41840.10(−0.34 to 0.53)0.210

6MWT, 6 min walking test; N, number; SMD, standardised mean difference.

Standardised mean difference in peak VO2 outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials. Sensitivity analysis of randomised controlled trials on testosterone treatment → cardiorespiratory fitness outcomes meta-analysis 6MWT, 6 min walking test; N, number; SMD, standardised mean difference. Figure 7 presents SMD in peak HRQoL outcomes after testosterone therapy between the treatment and control groups for RCTs (see online supplementary appendix page 14). Testosterone therapies consistently failed to show better standardised HRQoL outcomes compared with control conditions (pooled SMD was –0.03 (−0.32 to 0.25); I2=0%, p=0.934). The sensitivity analyses showed that this null effect was comparable in the fixed effects model (−0.03 (−0.32 to 0.25)) and after exclusion of one lower quality study40 (−0.04 (−0.34 to 0.25)).
Figure 7

Standardised mean difference in peak health-related quality of life outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials.

Standardised mean difference in peak health-related quality of life outcomes after testosterone therapy between the treatment and control groups for randomised controlled trials.

Adverse events

Two RCTs showed that testosterone therapy was associated with more serious adverse events compared with the control group. One study reported an increased number of exacerbations during short-term, but not long-term, follow-up,16 and another study reported that two of three COPD patients with respiratory failure in the treatment group had died.38 Conversely, one study reported that more patients died of respiratory failure in the control group.39 Four studies showed that testosterone therapies decreased gonadotrophin levels compared with controls, as can be expected.16 37 39 41 Compared with controls, testosterone therapy was associated with a decrease in the sex hormone-binding globulin level in two studies,16 41 and a decrease in the oestradiol level in men in another study.16 Finally, few studies showed that testosterone therapy was associated with relative increases in haemoglobin or haematocrit;16 37 38 creatinine, aspartate aminotransferase and lactate dehydrogenase values.38

Discussion

Summary of evidence

We have established that men with COPD have significantly lower levels of endogenous TT compared with controls (WMD was −3.21 nmol/L (−5.18 to −1.23)). The size of the mean difference in TT level, which ranks men with COPD in the second quartile (below average) compared with age-matched population norms,9 is likely to be clinically relevant. For instance, comparable or greater differences in TT levels between cases and controls have been reported in studies on risk of type 2 diabetes (WMD was −2.66 nmol/L (−3.45 to −1.86)),42 metabolic syndrome (WMD was −2.64 nmol/L (−2.95 to −2.32))43 and clinically significant depression (median difference was –1.21 nmol/L, p<0.001 for Mann-Whitney test).44 These comorbidities have been shown to adversely affect COPD prognosis,45–47 and would further complicate COPD management. As the effect of COPD exposure on TT level increased in size after exclusion of lower quality studies and one large sample size study, future higher quality studies will most likely strengthen rather than weaken this evidence base. Collectively, our results and the existing literature indicate that testosterone deficiency should be considered in men with COPD. On the basis of the limited short-term RCT evidence in predominately male COPD patients, our results suggest that testosterone therapy significantly improves several exercise capacity outcomes. The size of the effect of testosterone therapy that can be expected in practice is small to moderate, but comparable to exercise or PR therapies alone.7 8 The effect of testosterone therapy on standardised muscle strength outcomes remained robust after exclusion of one lower quality study, but weakened after exclusion of two placebo only studies. This supports the hypothesis that testosterone therapy with exercise is more effective than testosterone therapy alone for functional improvements.48 In addition, our results suggest that the mechanism for improvement in cardiorespiratory fitness assessed by peak workload is most likely explained by better exercise tolerance due to testosterone-induced increases in muscle strength rather than changes in VO2.

Limitations

Several limitations require careful consideration. Since only a small number of studies conducted in specific populations were included, the findings of this review may not be relevant to other countries and key groups, which will require further research. In particular, most of the RCTs were conducted in COPD patients without cardiovascular disease and/or diabetes or endocrine disease, which are highly prevalent in this population group.46 Second, we replaced missing data points with estimates in some instances, which introduced further uncertainty. This includes estimating the mean from the median and range and carrying forward the preintervention SD of control groups where the postintervention statistic was not available. Third, because only a few RTCs targeted COPD patients who would have theoretically benefited most from testosterone therapy such as those with low testosterone or body weight,16 37 39 our estimated effect size for improvement in standardised exercise capacity may have been underestimated. Finally, the reviewer-level limitations include incomplete retrieval of information for several of the 28 citations excluded, as well as the existence of other relevant studies not identified with our search strategy, resulting in selection bias. However, the results and conclusions reported in most of the excluded studies were in line with those reported here, and selection bias was unlikely. Nevertheless, our systematic analysis of the existing literature revealed that there is an absence of sufficient RCT evidence to draw firm conclusions about the long-term benefits and risks of testosterone therapies for exercise capacity and HRQoL outcomes in male or female COPD patients, or about the pharmacological dosing for specific testosterone therapies needed for effectiveness. Reliable information on the efficacy and safety, as well as cost-effectiveness, of specific testosterone therapies is required to inform clinical practice guidelines for COPD. In addition, future high-quality epidemiological research is needed to determine which subgroups of COPD patients are most vulnerable to testosterone deficiency, and to reliably establish whether women with COPD likewise present with significantly lower levels of TT than controls.

Conclusions

Men with COPD have clinically relevant lower than normal endogenous TT levels, and we believe that our meta-analytic results are sufficiently reliable to recommend that clinicians should consider testosterone deficiency in these patients. Although our results also suggest that testosterone therapy improves several exercise capacity outcomes, there is an absence of sufficient RCT evidence to draw firm conclusions about the long-term benefits and risks of testosterone therapy for exercise capacity and HRQoL outcomes in male or female COPD patients.
  45 in total

1.  Acute haemodynamic effects of testosterone in men with chronic heart failure.

Authors:  Peter J Pugh; T Hugh Jones; Kevin S Channer
Journal:  Eur Heart J       Date:  2003-05       Impact factor: 29.983

2.  Sex hormone alterations and systemic inflammation in a group of male COPD smokers and their correlation with the +138 insA/delA endothelin-1 gene polymorphism. A case-control study.

Authors:  A Kaparianos; E Argyropoulou; G Efremidis; K Spiropoulos
Journal:  Eur Rev Med Pharmacol Sci       Date:  2011-10       Impact factor: 3.507

3.  Quantifying heterogeneity in a meta-analysis.

Authors:  Julian P T Higgins; Simon G Thompson
Journal:  Stat Med       Date:  2002-06-15       Impact factor: 2.373

Review 4.  Endocrinological derangements in COPD.

Authors:  F Laghi; N Adiguzel; M J Tobin
Journal:  Eur Respir J       Date:  2009-10       Impact factor: 16.671

5.  Multimodal nutritional rehabilitation improves clinical outcomes of malnourished patients with chronic respiratory failure: a randomised controlled trial.

Authors:  Christophe M Pison; Noël J Cano; Cécile Chérion; Fabrice Caron; Isabelle Court-Fortune; Marie-Thérèse Antonini; Jésus Gonzalez-Bermejo; Lahouari Meziane; Luis Carlos Molano; Jean-Paul Janssens; Frédéric Costes; Bernard Wuyam; Thomas Similowski; Boris Melloni; Maurice Hayot; Julie Augustin; Catherine Tardif; Hervé Lejeune; Hubert Roth; Claude Pichard
Journal:  Thorax       Date:  2011-06-23       Impact factor: 9.139

6.  Muscle strength, symptom intensity, and exercise capacity in patients with cardiorespiratory disorders.

Authors:  A L Hamilton; K J Killian; E Summers; N L Jones
Journal:  Am J Respir Crit Care Med       Date:  1995-12       Impact factor: 21.405

7.  Impact of hypoxaemia on neuroendocrine function and catecholamine secretion in chronic obstructive pulmonary disease (COPD). Effects of long-term oxygen treatment.

Authors:  T Bratel; A Wennlund; K Carlström
Journal:  Respir Med       Date:  2000-12       Impact factor: 3.415

8.  Metabolic syndrome is associated with increased risk of acute exacerbation of COPD: a preliminary study.

Authors:  Elif Küpeli; Gaye Ulubay; Sevinc Sarinc Ulasli; Tugce Sahin; Zeynep Erayman; Alptekin Gürsoy
Journal:  Endocrine       Date:  2010-06-09       Impact factor: 3.633

Review 9.  Anabolic steroids in COPD: a review and preliminary results of a randomized trial.

Authors:  S Sharma; A Arneja; L McLean; D Duerksen; W Leslie; D Sciberras; M Lertzman
Journal:  Chron Respir Dis       Date:  2008       Impact factor: 2.444

10.  Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010.

Authors:  Theo Vos; Abraham D Flaxman; Mohsen Naghavi; Rafael Lozano; Catherine Michaud; Majid Ezzati; Kenji Shibuya; Joshua A Salomon; Safa Abdalla; Victor Aboyans; Jerry Abraham; Ilana Ackerman; Rakesh Aggarwal; Stephanie Y Ahn; Mohammed K Ali; Miriam Alvarado; H Ross Anderson; Laurie M Anderson; Kathryn G Andrews; Charles Atkinson; Larry M Baddour; Adil N Bahalim; Suzanne Barker-Collo; Lope H Barrero; David H Bartels; Maria-Gloria Basáñez; Amanda Baxter; Michelle L Bell; Emelia J Benjamin; Derrick Bennett; Eduardo Bernabé; Kavi Bhalla; Bishal Bhandari; Boris Bikbov; Aref Bin Abdulhak; Gretchen Birbeck; James A Black; Hannah Blencowe; Jed D Blore; Fiona Blyth; Ian Bolliger; Audrey Bonaventure; Soufiane Boufous; Rupert Bourne; Michel Boussinesq; Tasanee Braithwaite; Carol Brayne; Lisa Bridgett; Simon Brooker; Peter Brooks; Traolach S Brugha; Claire Bryan-Hancock; Chiara Bucello; Rachelle Buchbinder; Geoffrey Buckle; Christine M Budke; Michael Burch; Peter Burney; Roy Burstein; Bianca Calabria; Benjamin Campbell; Charles E Canter; Hélène Carabin; Jonathan Carapetis; Loreto Carmona; Claudia Cella; Fiona Charlson; Honglei Chen; Andrew Tai-Ann Cheng; David Chou; Sumeet S Chugh; Luc E Coffeng; Steven D Colan; Samantha Colquhoun; K Ellicott Colson; John Condon; Myles D Connor; Leslie T Cooper; Matthew Corriere; Monica Cortinovis; Karen Courville de Vaccaro; William Couser; Benjamin C Cowie; Michael H Criqui; Marita Cross; Kaustubh C Dabhadkar; Manu Dahiya; Nabila Dahodwala; James Damsere-Derry; Goodarz Danaei; Adrian Davis; Diego De Leo; Louisa Degenhardt; Robert Dellavalle; Allyne Delossantos; Julie Denenberg; Sarah Derrett; Don C Des Jarlais; Samath D Dharmaratne; Mukesh Dherani; Cesar Diaz-Torne; Helen Dolk; E Ray Dorsey; Tim Driscoll; Herbert Duber; Beth Ebel; Karen Edmond; Alexis Elbaz; Suad Eltahir Ali; Holly Erskine; Patricia J Erwin; Patricia Espindola; Stalin E Ewoigbokhan; Farshad Farzadfar; Valery Feigin; David T Felson; Alize Ferrari; Cleusa P Ferri; Eric M Fèvre; Mariel M Finucane; Seth Flaxman; Louise Flood; Kyle Foreman; Mohammad H Forouzanfar; Francis Gerry R Fowkes; Richard Franklin; Marlene Fransen; Michael K Freeman; Belinda J Gabbe; Sherine E Gabriel; Emmanuela Gakidou; Hammad A Ganatra; Bianca Garcia; Flavio Gaspari; Richard F Gillum; Gerhard Gmel; Richard Gosselin; Rebecca Grainger; Justina Groeger; Francis Guillemin; David Gunnell; Ramyani Gupta; Juanita Haagsma; Holly Hagan; Yara A Halasa; Wayne Hall; Diana Haring; Josep Maria Haro; James E Harrison; Rasmus Havmoeller; Roderick J Hay; Hideki Higashi; Catherine Hill; Bruno Hoen; Howard Hoffman; Peter J Hotez; Damian Hoy; John J Huang; Sydney E Ibeanusi; Kathryn H Jacobsen; Spencer L James; Deborah Jarvis; Rashmi Jasrasaria; Sudha Jayaraman; Nicole Johns; Jost B Jonas; Ganesan Karthikeyan; Nicholas Kassebaum; Norito Kawakami; Andre Keren; Jon-Paul Khoo; Charles H King; Lisa Marie Knowlton; Olive Kobusingye; Adofo Koranteng; Rita Krishnamurthi; Ratilal Lalloo; Laura L Laslett; Tim Lathlean; Janet L Leasher; Yong Yi Lee; James Leigh; Stephen S Lim; Elizabeth Limb; John Kent Lin; Michael Lipnick; Steven E Lipshultz; Wei Liu; Maria Loane; Summer Lockett Ohno; Ronan Lyons; Jixiang Ma; Jacqueline Mabweijano; Michael F MacIntyre; Reza Malekzadeh; Leslie Mallinger; Sivabalan Manivannan; Wagner Marcenes; Lyn March; David J Margolis; Guy B Marks; Robin Marks; Akira Matsumori; Richard Matzopoulos; Bongani M Mayosi; John H McAnulty; Mary M McDermott; Neil McGill; John McGrath; Maria Elena Medina-Mora; Michele Meltzer; George A Mensah; Tony R Merriman; Ana-Claire Meyer; Valeria Miglioli; Matthew Miller; Ted R Miller; Philip B Mitchell; Ana Olga Mocumbi; Terrie E Moffitt; Ali A Mokdad; Lorenzo Monasta; Marcella Montico; Maziar Moradi-Lakeh; Andrew Moran; Lidia Morawska; Rintaro Mori; Michele E Murdoch; Michael K Mwaniki; Kovin Naidoo; M Nathan Nair; Luigi Naldi; K M Venkat Narayan; Paul K Nelson; Robert G Nelson; Michael C Nevitt; Charles R Newton; Sandra Nolte; Paul Norman; Rosana Norman; Martin O'Donnell; Simon O'Hanlon; Casey Olives; Saad B Omer; Katrina Ortblad; Richard Osborne; Doruk Ozgediz; Andrew Page; Bishnu Pahari; Jeyaraj Durai Pandian; Andrea Panozo Rivero; Scott B Patten; Neil Pearce; Rogelio Perez Padilla; Fernando Perez-Ruiz; Norberto Perico; Konrad Pesudovs; David Phillips; Michael R Phillips; Kelsey Pierce; Sébastien Pion; Guilherme V Polanczyk; Suzanne Polinder; C Arden Pope; Svetlana Popova; Esteban Porrini; Farshad Pourmalek; Martin Prince; Rachel L Pullan; Kapa D Ramaiah; Dharani Ranganathan; Homie Razavi; Mathilda Regan; Jürgen T Rehm; David B Rein; Guiseppe Remuzzi; Kathryn Richardson; Frederick P Rivara; Thomas Roberts; Carolyn Robinson; Felipe Rodriguez De Leòn; Luca Ronfani; Robin Room; Lisa C Rosenfeld; Lesley Rushton; Ralph L Sacco; Sukanta Saha; Uchechukwu Sampson; Lidia Sanchez-Riera; Ella Sanman; David C Schwebel; James Graham Scott; Maria Segui-Gomez; Saeid Shahraz; Donald S Shepard; Hwashin Shin; Rupak Shivakoti; David Singh; Gitanjali M Singh; Jasvinder A Singh; Jessica Singleton; David A Sleet; Karen Sliwa; Emma Smith; Jennifer L Smith; Nicolas J C Stapelberg; Andrew Steer; Timothy Steiner; Wilma A Stolk; Lars Jacob Stovner; Christopher Sudfeld; Sana Syed; Giorgio Tamburlini; Mohammad Tavakkoli; Hugh R Taylor; Jennifer A Taylor; William J Taylor; Bernadette Thomas; W Murray Thomson; George D Thurston; Imad M Tleyjeh; Marcello Tonelli; Jeffrey A Towbin; Thomas Truelsen; Miltiadis K Tsilimbaris; Clotilde Ubeda; Eduardo A Undurraga; Marieke J van der Werf; Jim van Os; Monica S Vavilala; N Venketasubramanian; Mengru Wang; Wenzhi Wang; Kerrianne Watt; David J Weatherall; Martin A Weinstock; Robert Weintraub; Marc G Weisskopf; Myrna M Weissman; Richard A White; Harvey Whiteford; Steven T Wiersma; James D Wilkinson; Hywel C Williams; Sean R M Williams; Emma Witt; Frederick Wolfe; Anthony D Woolf; Sarah Wulf; Pon-Hsiu Yeh; Anita K M Zaidi; Zhi-Jie Zheng; David Zonies; Alan D Lopez; Christopher J L Murray; Mohammad A AlMazroa; Ziad A Memish
Journal:  Lancet       Date:  2012-12-15       Impact factor: 79.321

View more
  12 in total

1.  17β-Estradiol affects lung function and inflammation following ozone exposure in a sex-specific manner.

Authors:  Nathalie Fuentes; Marvin Nicoleau; Noe Cabello; Deborah Montes; Naseem Zomorodi; Zissis C Chroneos; Patricia Silveyra
Journal:  Am J Physiol Lung Cell Mol Physiol       Date:  2019-09-25       Impact factor: 5.464

Review 2.  Interventions for sexual dysfunction in people with chronic obstructive pulmonary disease (COPD).

Authors:  William Mm Levack; Betty Poot; Mark Weatherall; Justin Travers
Journal:  Cochrane Database Syst Rev       Date:  2015-09-30

3.  [The role of counterinsular hormones in the regulation of glucose homeostasis and the pathogenesis of type 2 diabetes mellitus in COPD].

Authors:  V I Kobylyansky
Journal:  Probl Endokrinol (Mosk)       Date:  2021-02-17

Review 4.  Musculoskeletal disorders in chronic obstructive pulmonary disease.

Authors:  Nele Cielen; Karen Maes; Ghislaine Gayan-Ramirez
Journal:  Biomed Res Int       Date:  2014-03-25       Impact factor: 3.411

5.  Scalp hair cortisol and testosterone levels in patients with sarcoidosis.

Authors:  M J G van Manen; V L Wester; E F C van Rossum; L M van den Toorn; K Y Dorst; Y B de Rijke; M S Wijsenbeek
Journal:  PLoS One       Date:  2019-06-14       Impact factor: 3.240

6.  Testosterone attenuates pulmonary epithelial inflammation in male rats of COPD model through preventing NRF1-derived NF-κB signaling.

Authors:  Xueting Wang; Linlin Huang; Shan Jiang; Kang Cheng; Dan Wang; Qianqian Luo; Xiaomei Wu; Li Zhu
Journal:  J Mol Cell Biol       Date:  2021-05-07       Impact factor: 6.216

Review 7.  Worse progression of COVID-19 in men: Is testosterone a key factor?

Authors:  Vito A Giagulli; Edoardo Guastamacchia; Thea Magrone; Emilio Jirillo; Giuseppe Lisco; Giovanni De Pergola; Vincenzo Triggiani
Journal:  Andrology       Date:  2020-06-28       Impact factor: 4.456

8.  Testosterone replacement therapy and hospitalization rates in men with COPD.

Authors:  Jacques Baillargeon; Randall James Urban; Wei Zhang; Mohammed Fathi Zaiden; Zulqarnain Javed; Melinda Sheffield-Moore; Yong-Fang Kuo; Gulshan Sharma
Journal:  Chron Respir Dis       Date:  2018-09-11       Impact factor: 2.444

9.  Androgens In Men Study (AIMS): protocol for meta-analyses of individual participant data investigating associations of androgens with health outcomes in men.

Authors:  Bu Beng Yeap; Ross James Marriott; Robert J Adams; Leen Antonio; Christie M Ballantyne; Shalender Bhasin; Peggy M Cawthon; David John Couper; Adrian S Dobs; Leon Flicker; Magnus Karlsson; Sean A Martin; Alvin M Matsumoto; Dan Mellström; Paul E Norman; Claes Ohlsson; Eric S Orwoll; Terence W O'Neill; Molly M Shores; Thomas G Travison; Dirk Vanderschueren; Gary A Wittert; Frederick C W Wu; Kevin Murray
Journal:  BMJ Open       Date:  2020-05-11       Impact factor: 2.692

10.  Lung function changes over 8 years and testosterone markers in both sexes: UK Biobank.

Authors:  Alexandra Lenoir; Elaine Fuertes; Francisco Gómez-Real; Benedicte Leynaert; Diana A van der Plaat; Debbie Jarvis
Journal:  ERJ Open Res       Date:  2020-09-28
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.