Literature DB >> 29221453

The extra cost of comorbidity: multiple illnesses and the economic burden of non-communicable diseases.

Sébastien Cortaredona1,2, Bruno Ventelou3,4.   

Abstract

BACKGROUND: The literature offers competing estimates of disease costs, with each study having its own data and methods. In 2007, the Dutch Center for Public Health Forecasting of the National Institute for Public Health and the Environment provided guidelines that can be used to set up cost-of-illness (COI) studies, emphasising that most COI analyses have trouble accounting for comorbidity in their cost estimations. When a patient has more than one chronic condition, the conditions may interact such that the patient's healthcare costs are greater than the sum of the costs for the individual diseases. The main objective of this work was to estimate the costs of 10 non-communicable diseases when their co-occurrence is acknowledged and properly assessed.
METHODS: The French Echantillon Généraliste de Bénéficiaires (EGB) database was used to assign all healthcare expenses for a representative sample of the population covered by the National Health Insurance. COIs were estimated in a bottom-up approach, through regressions on individuals' healthcare expenditure. Two-way interactions between the 10 chronic disease variables were included in the expenditure model to account for possible effect modification in the presence of comorbidity(ies).
RESULTS: The costs of the 10 selected chronic diseases were substantially higher for individuals with comorbidity, demonstrating the pattern of super-additive costs in cases of diseases interaction. For instance, the cost associated with diabetes for people without comorbidity was estimated at 1776 €, whereas this was 2634 € for people with heart disease as a comorbidity. Overall, we detected 41 cases of super-additivity over 45 possible comorbidities. When simulating a preventive action on diabetes, our results showed that significant monetary savings could be achieved not only for diabetes itself, but also for the chronic diseases frequently associated with diabetes.
CONCLUSIONS: When comorbidity exists and where super-additivity is involved, a given preventive policy leads to greater monetary savings than the costs associated with the single diagnosis, meaning that the returns from the action are generally underestimated.

Entities:  

Keywords:  Chronic diseases; Comorbidity; Cost of illness; Prevention policies

Mesh:

Year:  2017        PMID: 29221453      PMCID: PMC5723100          DOI: 10.1186/s12916-017-0978-2

Source DB:  PubMed          Journal:  BMC Med        ISSN: 1741-7015            Impact factor:   8.775


Background

The Organisation for Economic Co-operation and Development [1] predicts that healthcare expenditure will continue to rise, putting pressure on public budgets over the next decades. European countries are probably the most exposed to this risk given the factors of population aging and comprehensive public health insurance coverage. However, Europe has no coherent (i.e. using consistent concepts and methods) or comprehensive empirically based framework that can provide measures and forecasts of the burden of healthcare in a disease-oriented approach. As a result, policy-makers are confronted with competing estimates of healthcare costs for particular diseases or risk factors, with each study having its own data and methods [2-7]. In 2007, the Dutch Center for Public Health Forecasting of the National Institute for Public Health and the Environment summarised the methodology for general cost-of-illness (COI) studies and provided guidelines that can be used to set up such studies [8]. They emphasised the fact that a common problem in COI analyses is how to deal with patients’ comorbidities. Top-down analyses, in which costs for a given disease are calculated by multiplying aggregate health expenditure by the suspected proportion of the ‘top’ amount spent on that disease, require costs to be attributed to a single diagnosis. Thus, comorbidity is basically not taken into account. On the other hand, a bottom-up approach, in which each unit of healthcare used on a patient is attributed to a disease, still has trouble accounting for comorbidity. A classic example is a consultation for diabetes, which is also a major risk factor for cardiovascular disease. In an ideal bottom-up approach, the costs of this consultation should be applied both to heart disease and to diabetes, with – still ideally – the relative shares reflecting the importance of the consultation in the treatment of each disease, which becomes rapidly unattainable. We therefore aimed to develop a comprehensive ‘bottom-up’ approach using person-level data to estimate the costs of chronic diseases using a medico-administrative database. One of the main strengths of our approach is that it takes into account the comorbidity issue, a key factor with the older population. Recent strategies using regression-based frameworks [9-11], have also been developed to account for excess spending caused by the presence of comorbidities. Compared to top-down approaches, these types of person-level costing may produce more valid estimates in patients with multiple chronic diseases, as expenditures for comorbidities and complications are better captured [9]. For this study, we focused on 10 chronic disease groups, namely heart disease, stroke, diabetes, cancers (with a focus on breast, liver, lung, colorectal, stomach, oesophageal, kidney and pancreatic cancers), alcohol use disorders, cirrhosis, neurological disorders, major depression, respiratory illness (chronic obstructive pulmonary disease, asthma), and chronic kidney disease (CKD). Our cost-calculation methods address the possible coexistence of these 10 chronic diseases within the same subject, which may interact in the selection of treatments, potentially making costs of diseases ‘super-additive’. A ‘simulation exercise’ estimates the cost savings by a health system upon elimination of one disease, e.g. diabetes. Where there is super-additivity, there are far greater cost savings than with simply additive costs, meaning that the calculations performed to estimate the benefits (returns) of preventive action generally underestimate them.

Methods

Study population

We used the Echantillon Généraliste des Bénéficiaires (EGB) database, a permanent, representative and anonymised sample of people affiliated with the three major National Health Insurance funds [12]. These funds cover more than 90% of the French general population, divided into salaried workers, agricultural workers and farmers, and self-employed workers. The EGB was created in 2005 by a national random sampling of 1/97th of the French population, stratified for age and sex; it records information on their healthcare consumption and includes data on reimbursement claims for drugs purchased in the community, classified according to the Anatomical Therapeutic Chemical (ATC) index. The EGB is a dynamic cohort, where every 3 months, registered births and foreign immigrants taking up employment in France and their eligible dependents are added to the sample. Conversely, deaths and people withdrawing from the insurance funds covered by the EGB are extracted from the sample [12]. For this study, we selected people aged 18 or above and listed in the EGB on January 1, 2014, and monitored them until the end of 2014. Those who died or withdrew from the insurance funds covered by the EGB during the monitoring period were excluded from the analysis.

Identification of people with chronic diseases

The list of the 10 chronic diseases selected for this study, with assigned International Classification of Disease (ICD version 10) codes, is provided in Table 1.
Table 1

The 10 chronic diseases and assigned International Classification of Disease version 10 (ICD-10) codes

Disease groupDiseaseICM-10 codes
StrokeAcute haemorrhagic strokeI60 Subarachnoid haemorrhage
I61 Intracerebral haemorrhage
Acute ischemic strokeI63 Cerebral infarction
Chronic stroke (any type)I69 Sequelae of cerebrovascular disease
Heart diseaseAcute myocardial infarctionI21 Acute myocardial infarction
I22 Subsequent myocardial infarction
Chronic ischaemic heart diseaseI20 Angina pectoris
I23 Certain current complications following acute myocardial infarction
I25 Chronic ischaemic heart disease
CancerStomachC16 Malignant neoplasm of stomach
ColorectalC18 Malignant neoplasm of colon
C19 Malignant neoplasm of rectosigmoid junction
C20 Malignant neoplasm of rectum
C21 Malignant neoplasm of anus and anal canal
LungC33 Malignant neoplasm of trachea
C34 Malignant neoplasm of bronchus and lung
LiverC22 Malignant neoplasm of liver and intrahepatic bile ducts
BreastC50 Malignant neoplasm of breast
OesophagealC15 Malignant neoplasm of oesophagus
KidneyC64 Malignant neoplasm of kidney, except renal pelvis
PancreaticC25 Malignant neoplasm of pancreas
DiabetesE10–E14 Diabetes mellitus
Chronic kidney diseaseN18 Chronic kidney disease
Respiratory illnessJ41 Simple and mucopurulent chronic bronchitis
J42 Unspecified chronic bronchitis
J43 Emphysema
J44 Other chronic obstructive pulmonary disease
J45 Asthma
J47 Bronchiectasis
CirrhosisI85 Oesophageal varices
K70–K77 Diseases of liver
Alcohol use disordersF10 Alcohol related disorders
DepressionF32 Depressive episode
F33 Recurrent depressive disorder
Neurological disordersF00–F03, G30–G31
The 10 chronic diseases and assigned International Classification of Disease version 10 (ICD-10) codes This study was performed as part of the FRESHER research consortium (FoResight and Modelling for European Health policy and Regulation). We selected non-communicable diseases that contribute to the bulk of deaths worldwide, namely cardiovascular diseases, cancers, diabetes, and chronic lung disease [13]. To these, we added four other health conditions, namely (1) depression, due to its co-morbid status with all of the chronic diseases outlined above, (2) chronic kidney disease, (3) alcohol-related diseases, and (4) chronic neurological disorders, due to their increasing importance in ageing societies. Most of these conditions share commonalities in pathogenesis, aetiology, and risk factors, which are potentially modifiable. With no intervention, their cumulative financial burden is projected to greatly increase in the next decades [14]. Administrative databases, such as drug prescription data, have frequently been used to identify people with chronic diseases in prevalence estimates [15] or epidemiological studies for comorbidity adjustments [16]. In the EGB database, three types of data can be used to identify patients with chronic diseases. In 2013, Huber et al. [17] developed an updated approach with a special focus on the unambiguous assignment of drug prescriptions to chronic diseases. For chronic diseases, they only included ATC codes, which are exclusively used for the treatment of specific diseases. From 2009 to 2014, we considered that a person had a chronic disease if they had been dispensed at least three drugs in the corresponding ATC category at different times over the calendar year (this threshold of three dispensations was used on various French studies on diabetes [18] and other chronic diseases [19]). Since 2006, data from the French Medical Information System (Programme de Médicalisation des Systèmes d'information), which covers all French public and private hospitals except military and psychiatric hospitals, have been available for all individuals included in the EGB. In France, each hospital stay is registered in a hospital discharge database from the French Medical Information System and diagnoses are coded using the International Classification of Diseases (ICD-10 [20]) codification either as a primary, related, or significant associated diagnosis. Cchronic diseases were identified using these diagnosis data from 2009 to 2014. We used long-term illness (LTI) status data from the French social insurance system to identify people with chronic diseases. LTI status is granted to people with long-term and costly diseases, exempting them from co-payments for any associated medical treatment [21]. As with hospital discharge data, chronic diseases were identified from 2009 to 2014 using the ICD-10 classification. These three sources of data (drug dispensing, hospital discharge and LTI) are available in the EGB database and linked with a unique individual identifier. They were combined to identify prevalent and incident cases for our 10 chronic disease groups.

Healthcare expenditure data

We used reimbursement data to calculate, for each individual in the database, an aggregate healthcare expenditure in 2014, including primary care and consultations with specialists, (reimbursed) medicines, medical procedures, biological tests, medical devices, emergency care, and hospital inpatient care. This pricing of ambulatory care also takes into account possible co-payment from the patient, except for over-the-counter drugs which are not available in the EGB database. Regarding the hospital sector, this cost-evaluation only takes into account the part of the cost which is reimbursed to hospitals through the diagnosis-related group payment system (through which we can clearly assign a diagnosis using the reason of admission). Diagnosis-related group rates were used as proxies of case costs for public and private not‐for‐profit hospital stays. Some specific costs supported by the hospitals are not included in our modelling, e.g.: costs of clinical research; innovative drugs, etc.

Estimating the cost of chronic diseases

In a bottom-up design, healthcare consumption is collected at individual patient level and illness costs are modelled at the same level. Compared to a top-down approach, in which total expenditure for a given area or policy is divided by the number of patients with a given disease, the bottom-up approach provides greater accuracy [22]. However, in the French healthcare system, healthcare expenditure on patients, particularly in the ambulatory care system, cannot be directly linked to one specific diagnosis. To overcome this limitation, we chose to estimate the cost associated with each chronic disease using regression models. The marginal costs associated with one disease were estimated on individual-level data as the mean marginal difference in the predicted outcome (total individual healthcare expenditure in 2014) with the chronic disease independent variables switched on or off. This makes it possible to estimate the ‘counterfactual’ of what the cost would have been in the absence of chronic disease, while leaving the other model parameters unchanged. This approach is commonly used to estimate incremental costs for diseases and risk factors [23-25]. A useful modelling framework in such cases is a two-stage model [26]. Two-stage models are appropriate for analysing zero-inflated cost data with skewness [27], which is typical in medical expenditure data [26]. Our dataset included both many people with zero healthcare spending and some with extremely high spending. In our two-stage model, the first part P (cost > 0) was modelled using a logit model; then, conditional on the healthcare spending being positive, the value of the spending was modelled using gamma regressions with log link [28, 29]. Models were stratified by sex and were age adjusted. The 10 binary chronic disease variables were added as main interest variables. Two-way interactions between these variables were also included in the model to account for possible effect modification in the presence of comorbidities (see latter for a precise assessment of the sign of the modification, namely super-additivity or under-additivity). In order to control for the presence of a chronic condition outside of the list of the 10 selected chronic conditions, we also added ‘other LTI’ as a systematic covariate in the model (at least one ongoing LTI for another chronic condition in 2014). In each stratum (combination of age categories and sex), the increase in healthcare expenditure attributable to each disease was calculated by subtracting average predicted expenditure for sick people in each category from average predicted expenditure for the individuals with the other disease variables set to 0 (or 1 in case of comorbidity for a given other disease). For example, in given strata i, the cost associated with chronic disease dj (with no other comorbidity) was estimated as follows: Where is cost in 2014 associated with chronic disease j in strata i (no other comorbidity), ĉi is predicted outcome in strata i, di is binary chronic disease variable for disease i, and djk is interaction variable between chronic disease variables dj and dk. We obtained an average cost per capita attributable to each chronic disease by calculating a weighted mean over all strata, with: Where is COI calculation for disease dj, N is total number of strata (=combination of sex and age categories), and wi is weight for stratum i (=number of individuals in the sample of persons with at least one disease).

Estimating super-additivity in costs, aggregated data and the simulation exercise

The econometric models allowed estimation of (1) simple COI calculations (10 diseases with no other comorbidity; ), and (2) coupled COI calculations for the 45 two-by-two possible comorbidities ((10 × 9)/2), for the cost of disease dj in the presence of disease dk (see Additional file 1 for a reformulation of equation (1) in case of comorbidity). The precise assessment of ‘super-additivity’ was then computed on the basis of the following comparison: When the left-hand side of the inequality was superior to the right-hand side, the assessment was ‘super-additivity’ – the two estimated costs coupled in comorbidity were superior to the addition of the two separate COI calculations with no other comorbidity. Aggregate estimates were determined by multiplying the per capita estimates by the number of people in the corresponding strata. Since the EGB was created by a national random sampling of 1/97th of the French population, we multiplied all figures by 97 in order to get an estimate of the national expenditure associated with each chronic disease. We also performed a simulation exercise in which we ‘eliminated’ diabetes from the two-stage models, by switching the dummy variable to ‘off’ in all cases (the computer-program was able to estimate the virtual elimination of the nine other diseases; estimates are available on request). The population remained the same; we only simulated a ‘virtual’ situation of people suddenly healed of the disease. The objective of this simulation was to estimate how the savings resulting from preventive action on one disease would also affect the treatment costs of the nine remaining chronic diseases through its super-additivity effect. Confidence intervals (CIs) were computed via Monte Carlo simulations (10,000 replications). Statistical analyses were performed with SAS statistical software, version 9.4 (SAS Institute Inc., Cary, NC, USA).

Results

Cohort characteristics

Of the 476,252 people included in the cohort, 48.9% were men and 22.7% were aged over 65, which is relatively close to the census estimates for the French general population in 2014 (23.1% [30]; Table 2).
Table 2

Sociodemographic characteristics of the study population (n = 476,252)

%
Sex
 Male48.92
 Female51.08
Agea
 18–3934.78
 40–4918.40
 50–5916.61
 60–647.50
 65–696.73
 70–744.45
 75–794.08
 80–843.57
 85–892.36
 >891.53

aAge group definition was based on the overall age-specific prevalence of the 10 selected chronic diseases; broader age groups (10/20 years) were used for individuals under 60 in order to obtain sufficiently sized age groups

Sociodemographic characteristics of the study population (n = 476,252) aAge group definition was based on the overall age-specific prevalence of the 10 selected chronic diseases; broader age groups (10/20 years) were used for individuals under 60 in order to obtain sufficiently sized age groups

Prevalence of chronic diseases

Using LTI, drug dispensing and hospital discharge data, we found that the chronic disease with the highest number of cases was respiratory illness (7.8%), followed by diabetes (7.1%) and heart disease (3.7%) (Table 3). Prevalence rates tended to be higher among men. Prevalence estimates according to the identification method are available in Table 3.
Table 3

Prevalence estimates according to the identification method (n = 476,252)

Long-Term Illness dataa Hospital discharge datab Drug Dispensing datac Overall prevalence estimates
N % N % N % N %
Stroke19380.430770.743480.9
Heart disease11,7642.512,4612.617,4653.7
Cancerd 10,4822.274231.612,6562.7
Diabetes24,7055.216,2453.430,4546.433,6867.1
Chronic kidney disease12530.347611.052671.1
Respiratory illnesse 10810.262091.334,6717.337,2037.8
Alcohol use disorder9270.261881.366831.4
Cirrhosis10730.238470.843600.9
Major depression91681.991681.9
Neurological disorders33550.742010.911120.259451.3

aChronic diseases were identified using the ICD-10 classification (Table 1) of the Long-Term Illness registry

bChronic diseases were identified using the ICD-10 classification (Table 1) of diagnoses reported in the hospital discharge database

cWe considered that a person had a chronic disease if they had been dispensed at least three drugs in the corresponding ATC category [17] at different times over the calendar year

dBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal

eChronic obstructive pulmonary disease, asthma

Prevalence estimates according to the identification method (n = 476,252) aChronic diseases were identified using the ICD-10 classification (Table 1) of the Long-Term Illness registry bChronic diseases were identified using the ICD-10 classification (Table 1) of diagnoses reported in the hospital discharge database cWe considered that a person had a chronic disease if they had been dispensed at least three drugs in the corresponding ATC category [17] at different times over the calendar year dBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal eChronic obstructive pulmonary disease, asthma

Prevalence of comorbidities

Of our cohort, 78.7% had none of the 10 selected chronic diseases in 2014, 15.8% had only one chronic disease, 4.0% had two chronic diseases, and 1.5% had at least three chronic diseases. Among persons with two chronic diseases or less, the most frequent type of comorbidity was diabetes associated with respiratory illness (Table 4).
Table 4

Prevalence of comorbidities among the 10 selected chronic diseases (%, n = 469,255)a

No other diseaseb StrokeHeart diseaseCancerc DiabetesChronic kidney diseaseRespiratory illnessd CirrhosisAlcohol use disordersMajor depression
No disease79.88
Stroke0.39
Heart disease1.620.05
Cancersc 1.580.020.08
Diabetes4.150.080.600.21
Chronic kidney disease0.320.010.070.040.11
Respiratory illnessd 5.340.050.330.230.660.06
Cirrhosis0.280.000.020.030.090.010.05
Alcohol use disorders0.610.020.040.020.060.010.110.10
Major depression1.220.010.040.050.120.010.190.010.06
Neurological disorders0.550.040.070.040.110.040.070.010.020.02

aCalculated among persons with two chronic diseases or less (98.5% of the sample)

bOf the nine other selected chronic diseases

cBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal

dChronic obstructive pulmonary disease, asthma

Prevalence of comorbidities among the 10 selected chronic diseases (%, n = 469,255)a aCalculated among persons with two chronic diseases or less (98.5% of the sample) bOf the nine other selected chronic diseases cBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal dChronic obstructive pulmonary disease, asthma

Per capita healthcare expenditure

For our cohort, the average healthcare expenditure per capita in 2014 was estimated at 2684 € (±7646 €). For those under 50 years old, costs were significantly higher among women (1841 vs. 1186 €; P < 0.001). However, for those aged 50 years and above, costs were not significantly different between men and women (4011 vs. 4029 €; P = 0.657).

Cost associated with each chronic disease for people without comorbidity

Two-stage model estimations are provided in Table 5, as defined in the methods section by the quantity , with the mean of each substrata-estimated marginal difference in the predicted outcome with the chronic disease variables dj switched on or off. Column 1 of Table 5 indicates the figures and CIs among people with no comorbidity (involving the selected chronic diseases). The average estimated cost per capita associated with one chronic disease was the highest for CKD (8323 €, 95% CI 7090–9555 €) and the lowest for respiratory illnesses (1285 €, 95% CI 1103–1466 €). Please note that these figures relate to the weighted average estimates of the costs in 2014 for prevalent cases (detected before July 2013) and incident cases (diagnosed between July 2013 and June 2014). The method also allowed the generation of COI calculations in 2014, stratified by dates of diagnosis (results available on request).
Table 5

Average costs per capita in 2014 and 95% CI associated with the 10 selected chronic diseases according to type of comorbidity – two-stage model estimates (n = 476,252)

Cost associated with… Comorbidity
No other comorbidity Stroke Heart disease Cancers a Diabetes Chronic kidney disease
Stroke3466; 2973–39594203; 3524–48822784; 1913–36565659; 4804–65137833; 6032–9635
Heart disease1828; 1570–20872566; 2055–30772156; 1721–25912687; 2293–30815172; 4215–6130
Cancersa 5115; 4322–59094434; 3229–56395443; 3229–56396240; 5143–733614,042; 11,528–16,556
Diabetes1776; 1510–20413969; 3326–46112634; 2218–30512900; 2378–34238349; 7036–9662
Chronic kidney disease8323; 7090–955512,690; 10,557–14,82311,666; 9826–13,50717,249; 14,365–20,13414,895; 12,638–17,153
Respiratory illnessb 1285; 1103–14661775; 1374–21752332; 1956–27093016; 2258–37741955; 1663–22464440; 3630–5249
Cirrhosis4225; 3623–482713,625; 10,987–16,2635808; 4845–677112,402; 10,044–14,7595377; 4543–621115,256; 12,593–17,920
Major depression1528; 1303–17542421; 1356–34861929; 1527–23312803; 2020–35871879; 1565–21942900; 1664–4135
Neurological disorders2121; 1798–24451617; 839–23952404; 1809–30003648; 2754–45413847; 3045–46491142; 239–2523
Alcohol user disorders2323; 1924–27224303; 2939–56673319; 2712–39275492; 3820–71634056; 3401–47119344; 7457–11,231
Cost associated with… Comorbidity
Respiratory illness b Cirrhosis Major depression Neurological disorders Alcohol use disorders
Stroke3955; 3327–458412,865; 10,309–15,4224358; 3136–55802961; 2200–37225445; 4167–6724
Heart disease2876; 2436–33163411; 2676–41462229; 1812–26452111; 1605–26182825; 2299–3350
Cancersa 6847; 5508–818513,292; 10,624–15,9606390; 5184–75966642; 5368–79158284; 6319–10,249
Diabetes2446; 2092–28002927; 2339–35162127; 1736–25173502; 2852–41513509; 2911–4107
Chronic kidney disease11477; 9762–13,19319,354; 16,269–22,4399694; 7992–11,3967343; 5447–924015,344; 12,813–17,874
Respiratory illnessb 2331; 1837–28251389; 1003–17742275; 1866–26832180; 1810–2550
Cirrhosis1632; 1268–19975500; 4434–65656375; 5125–76264520; 3798–5242
Major depression1632; 1267–19982803; 1902–37032322; 1080–35651871; 1391–2350
Neurological disorders3111; 2587–36364271; 3254–52882915; 1607–42242393; 1877–2909
Alcohol user disorders3219; 2666–37722618; 1964–32712665; 2012–33182594; 2059–3129

aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal

bChronic obstructive pulmonary disease, asthma

Note: To account for the different sociodemographic structures (e.g. younger age profiles for people without comorbidity), the same set of weights is used to estimate the average cost of the disease for people with and without comorbidity

Average costs per capita in 2014 and 95% CI associated with the 10 selected chronic diseases according to type of comorbidity – two-stage model estimates (n = 476,252) aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal bChronic obstructive pulmonary disease, asthma Note: To account for the different sociodemographic structures (e.g. younger age profiles for people without comorbidity), the same set of weights is used to estimate the average cost of the disease for people with and without comorbidity

Extra cost associated with each chronic disease in the presence of comorbidity

Disease by disease, extra costs due to the presence of a comorbidity estimate varied greatly depending on the nature of the chronic disease and the comorbidity (Table 5, columns 2–11, see also Additional file 1 for the calculation method). The extra costs associated with diabetes were estimated at 1776 € without comorbidity, 2446 € (+670 €) when associated with respiratory illness, and 2634 € (+858 €) when associated with heart disease. The costs associated with heart disease were estimated at approximately 1828 € for individuals with no comorbidity, 2687 € (+859 €) for individuals with diabetes as comorbidity, 2566 € (+738 €) for individuals with stroke as comorbidity, and 2876 € (+1048 €) for individuals with respiratory illness as comorbidity. The resulting events of super-additivity were assessed by the comparison described in inequality (3). A synthetic view is given in Table 6 for the 45 two-by-two possible comorbidities. There were only four cases where the costs were not super-additive.
Table 6

Assessment of ‘super-additivity’ for the 45 two-by-two possible comorbidity combinations (n = 476,252)

Alcohol use disordersNeurological disordersMajor depressionCirrhosisRespiratory illnessb Chronic kidney diseaseDiabetesCancersa Heart disease
Stroke+++++++
Heart disease++++++++
Cancersa +++++++
Diabetes++++++
Chronic kidney disease++++
Respiratory illnessb +++
Cirrhosis+++
Major depression++
Neurological disorders+

Note: The precise assessment of ‘super-additivity’ was computed on the basis of the comparison: (3)

+ Left-hand side of inequality (3) is superior to the right-hand side, the assessment is ‘super-additivity’

– No super additivity (left-hand side of inequality (3) lower to the right-hand side)

aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal

bChronic obstructive pulmonary disease, asthma

Assessment of ‘super-additivity’ for the 45 two-by-two possible comorbidity combinations (n = 476,252) Note: The precise assessment of ‘super-additivity’ was computed on the basis of the comparison: (3) + Left-hand side of inequality (3) is superior to the right-hand side, the assessment is ‘super-additivity’ – No super additivity (left-hand side of inequality (3) lower to the right-hand side) aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal bChronic obstructive pulmonary disease, asthma

Aggregate costs

When these per capita costs were aggregated at national level, the chronic diseases with the highest estimated costs were cancer (6.8 billion €) followed by CKD and diabetes (6.4 billion €; Table 7).
Table 7

Aggregate costs in 2014 associated with the 10 selected chronic diseases (n = 476,252)

Aggregate costs (real data, including the extra cost of comorbidity) (€)Aggregate costs without diabetesc (€)
Stroke1,766,157,7591,668,987,170
Heart disease3,810,314,5863,640,257,499
Cancersa 6,760,703,7036,721,315,309
Diabetes6,361,926,072
Chronic kidney disease6,349,510,8555,868,318,845
Respiratory illnessb 4,884,750,6084,720,450,554
Cirrhosis2,288,778,6282,254,496,590
Major depression1,345,807,4661,326,877,079
Neurological disorders1,439,130,1111,345,681,049
Alcohol use disorders1,550,325,3401,508,304,205

aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal

bChronic obstructive pulmonary disease, asthma

cSimulation exercise in the absence of diabetes

Note: Stroke costs the French government 1766 million €. In the virtual exercise, where diabetes would be cured from society, stroke would only cost 1668 million €, because those patients suffering from stroke and diabetes would no longer have to bear the extra costs of stroke due to diabetes

Aggregate costs in 2014 associated with the 10 selected chronic diseases (n = 476,252) aBreast/Lung/Colorectal/Stomach/Liver/Kidney/Pancreatic/Oesophageal bChronic obstructive pulmonary disease, asthma cSimulation exercise in the absence of diabetes Note: Stroke costs the French government 1766 million €. In the virtual exercise, where diabetes would be cured from society, stroke would only cost 1668 million €, because those patients suffering from stroke and diabetes would no longer have to bear the extra costs of stroke due to diabetes

Simulation exercise without diabetes

When diabetes was ‘virtually’ cancelled from society (all sick people are cured of diabetes), we first saved 6.4 billion € as a direct effect (Table 7). However, diabetes may also interact super-additively with other treatment costs and, therefore, its cancelation would also have indirect effects; for example, the aggregate costs of CKD were significantly lower (−481 million €; Table 6) when diabetes was removed from the model. Termination of diabetes had also an impact on the aggregate cost of heart disease (−170 million €; Table 7), which is frequently associated with diabetes. A lesser impact was observed on the aggregate costs of respiratory illness (−164 million €) or stroke (−97 million €).

Discussion

Summary of results

The costs of the 10 selected chronic diseases were substantially higher for individuals with comorbidity (compared to similar agents without comorbidity), demonstrating the pattern of super-additive costs in cases of diseases interaction. Super-additivity was demonstrated for 41 cases out of the 45 couples studied. We also simulated preventive action on diabetes (prevalence set at 0%). Our results show that the system can save a significant amount of money not only on diabetes itself, but also on the chronic diseases that are frequently associated with diabetes. We estimate that the direct effect of diabetes disappearing is a saving of 6 billion €, but that the indirect effect is a saving of more than 1 billion €, cutting costs by an extra 18%. This points to severe underestimation of the economic benefits (returns) of preventive action, and confirms that comorbidity(ies) should be taken into account in COI analyses.

Strengths and limitations

A major strength of the study is the estimation of disease-related healthcare costs both in the absence and presence of comorbidity. As recommended elsewhere [31], we used a regression-based bottom-up approach to estimate disease costs. Moreover, our COI analysis was performed on a very large sample of claim data. Compared to a top-down (attributable fraction) approach, estimates based on a bottom-up approach are more accurate because they can account for the occurrence of higher treatment intensity among those with the disease and, subsequently, the extra-expenditures for comorbidities are better captured [9, 31]; therefore, we were able to obtain more reliable estimates [26, 32]. By adding two-way interactions between the chronic disease variables in the two-stage cost model, we estimated the costs of multiple combinations of disease, and thus the extra cost of comorbidity. This enabled us to achieve accurate cost estimations and to precisely compute the super-additive monetary impact of comorbidity. To our knowledge, this kind of approach has not been used previously in a COI study. Nevertheless, the study has several limitations. Firstly, drug-based diagnoses are only proxies for medical diagnoses. Using drug prescription data to identify individuals with chronic diseases could result in errors in prevalence/incidence estimates. However, in our view, the other methods used to detect illnesses (hospital discharge data and LTI) compensate for this. Secondly, we limited our study to a selection of 10 chronic diseases. Since we examined a relatively low number of diseases, there are likely important comorbidities that have been missed. Including too few comorbidities in a cost regression model may lead to an overestimation of the effects of the comorbidities that are included if they are correlated with omitted comorbidities [33]. In order to limit this effect, we added the ‘other LTI’ variable in the two-step regression model, controlling for the presence of a chronic disease outside of the list of the 10 selected chronic diseases, and reducing unobserved heterogeneity. Thirdly, this study was performed on a medico-administrative database from France, whose healthcare system comprises a fully integrated network of public hospitals, private hospitals, doctors and other medical service providers. The individual receiving care is generally reimbursed for all medical treatment on the basis of a price established by the Social Security administration, unlike practices in other countries. Access to care in France is very easy, with a large decisional autonomy allowed to both the physician and the patient, who are free to adapt treatments as they wish [34]. Therefore, a major limitation of our results regarding super-additivity concerns the generalisability of the results to other countries with different healthcare systems, relying, for instance, on tighter treatment protocols. Fourthly, in the simulation exercise (where we eliminated diabetes), our estimate of savings only took into account the nine other comorbidities and their resulting super-additive costs. Further analyses should be performed to estimate how much more could be saved if a wider range of chronic and non-chronic diseases were considered, particularly comorbidities that are clinically related to the disease of interest [33]. Finally, the number of variables was very limited in our study (age, sex and estimated date of diagnosis) since we had no information on income level, educational level, employment status, supplementary mutual health insurance or the presence of risk factors (like tobacco/alcohol consumption, body mass index).

Comparison with other COI studies

The literature offers competing estimates of disease costs, with each study having its own data and methods [2-7]. First, we found per capita healthcare expenditures similar to those estimated in 2010 by the French Directorate for Research, Studies, Assessment and Statistics [35] (2698 € vs. 2684 € in our study). In a French study published in 2003 [36], the total amount spent by the general health scheme on care for diabetic patients was estimated at 6 billion € in 2000, with 2.4 billion € attributed to the treatment of diabetes alone. In another study on the French ENTRED survey [37], including 6710 diabetic patients covered by the National Health Insurance, the total reimbursement cost for patients was estimated at 12.5 billion € in 2007, but the amount attributable to diabetes alone was not estimated. In a report published in 2007 by the French National Cancer Institute [38], cancer-related healthcare costs in 2004 were estimated at 11 billion €. However, in a study published in 2013 [39], cancer-related healthcare costs for France were estimated at 7 billion € in 2008.

Conclusions

The main lessons from this paper are, firstly, that there are indeed considerable comorbidities in the French population – of the 21.3% of the population who suffer from the 10 selected illnesses, 25.7% are in fact suffering from more than one. Secondly, the treatment costs of the illnesses are clearly super-additive when they co-exist within the same patient, creating an extra cost that is ignored when disease treatments are considered separately. Our simulation exercise, although unrealistic, highlights this last point – if a disease like diabetes were to be avoided, the healthcare system could save not only the direct costs of diabetes, but also the extra costs that diabetes may generate through its interaction with other diseases. This represents more than 15% of the cost-of-diabetes valuation (and billions of euros), and suggests that the potential benefits of any preventive action against this kind of chronic disease are generally underestimated.
  29 in total

Review 1.  Methods for analyzing health care utilization and costs.

Authors:  P Diehr; D Yanez; A Ash; M Hornbrook; D Y Lin
Journal:  Annu Rev Public Health       Date:  1999       Impact factor: 21.981

2.  Annual medical spending attributable to obesity: payer-and service-specific estimates.

Authors:  Eric A Finkelstein; Justin G Trogdon; Joel W Cohen; William Dietz
Journal:  Health Aff (Millwood)       Date:  2009-07-27       Impact factor: 6.301

3.  French national health insurance information system and the permanent beneficiaries sample.

Authors:  P Tuppin; L de Roquefeuil; A Weill; P Ricordeau; Y Merlière
Journal:  Rev Epidemiol Sante Publique       Date:  2010-07-03       Impact factor: 1.019

4.  Medical care expenditures for diabetes, its chronic complications, and its comorbidities.

Authors:  T A Hodgson; A J Cohen
Journal:  Prev Med       Date:  1999-09       Impact factor: 4.018

5.  Nonaspirin nonsteroidal anti-inflammatory drugs and risk of hospitalization for intracerebral hemorrhage: a population-based case-control study.

Authors:  Søren P Johnsen; Lars Pedersen; Søren Friis; William J Blot; Joseph K McLaughlin; Jørgen H Olsen; Henrik T Sørensen
Journal:  Stroke       Date:  2003-02       Impact factor: 7.914

6.  The effect of weight loss on health, productivity, and medical expenditures among overweight employees.

Authors:  Marcel Bilger; Eric A Finkelstein; Eliza Kruger; Deborah F Tate; Laura A Linnan
Journal:  Med Care       Date:  2013-06       Impact factor: 2.983

7.  The excess mortality related to cardiovascular diseases and cancer among adults pharmacologically treated for diabetes--the 2001-2006 ENTRED cohort.

Authors:  I Romon; G Rey; L Mandereau-Bruno; A Weill; E Jougla; E Eschwège; D Simon; C Druet; A Fagot-Campagna
Journal:  Diabet Med       Date:  2014-04-07       Impact factor: 4.359

8.  Economic burden of cancer across the European Union: a population-based cost analysis.

Authors:  Ramon Luengo-Fernandez; Jose Leal; Alastair Gray; Richard Sullivan
Journal:  Lancet Oncol       Date:  2013-10-14       Impact factor: 41.316

Review 9.  Review of statistical methods for analysing healthcare resources and costs.

Authors:  Borislava Mihaylova; Andrew Briggs; Anthony O'Hagan; Simon G Thompson
Journal:  Health Econ       Date:  2010-08-27       Impact factor: 3.046

10.  Disability-adjusted life years (DALYs) for 291 diseases and injuries in 21 regions, 1990-2010: a systematic analysis for the Global Burden of Disease Study 2010.

Authors:  Christopher J L Murray; Theo Vos; Rafael Lozano; Mohsen Naghavi; Abraham D Flaxman; Catherine Michaud; Majid Ezzati; Kenji Shibuya; Joshua A Salomon; Safa Abdalla; Victor Aboyans; Jerry Abraham; Ilana Ackerman; Rakesh Aggarwal; Stephanie Y Ahn; Mohammed K Ali; Miriam Alvarado; H Ross Anderson; Laurie M Anderson; Kathryn G Andrews; Charles Atkinson; Larry M Baddour; Adil N Bahalim; Suzanne Barker-Collo; Lope H Barrero; David H Bartels; Maria-Gloria Basáñez; Amanda Baxter; Michelle L Bell; Emelia J Benjamin; Derrick Bennett; Eduardo Bernabé; Kavi Bhalla; Bishal Bhandari; Boris Bikbov; Aref Bin Abdulhak; Gretchen Birbeck; James A Black; Hannah Blencowe; Jed D Blore; Fiona Blyth; Ian Bolliger; Audrey Bonaventure; Soufiane Boufous; Rupert Bourne; Michel Boussinesq; Tasanee Braithwaite; Carol Brayne; Lisa Bridgett; Simon Brooker; Peter Brooks; Traolach S Brugha; Claire Bryan-Hancock; Chiara Bucello; Rachelle Buchbinder; Geoffrey Buckle; Christine M Budke; Michael Burch; Peter Burney; Roy Burstein; Bianca Calabria; Benjamin Campbell; Charles E Canter; Hélène Carabin; Jonathan Carapetis; Loreto Carmona; Claudia Cella; Fiona Charlson; Honglei Chen; Andrew Tai-Ann Cheng; David Chou; Sumeet S Chugh; Luc E Coffeng; Steven D Colan; Samantha Colquhoun; K Ellicott Colson; John Condon; Myles D Connor; Leslie T Cooper; Matthew Corriere; Monica Cortinovis; Karen Courville de Vaccaro; William Couser; Benjamin C Cowie; Michael H Criqui; Marita Cross; Kaustubh C Dabhadkar; Manu Dahiya; Nabila Dahodwala; James Damsere-Derry; Goodarz Danaei; Adrian Davis; Diego De Leo; Louisa Degenhardt; Robert Dellavalle; Allyne Delossantos; Julie Denenberg; Sarah Derrett; Don C Des Jarlais; Samath D Dharmaratne; Mukesh Dherani; Cesar Diaz-Torne; Helen Dolk; E Ray Dorsey; Tim Driscoll; Herbert Duber; Beth Ebel; Karen Edmond; Alexis Elbaz; Suad Eltahir Ali; Holly Erskine; Patricia J Erwin; Patricia Espindola; Stalin E Ewoigbokhan; Farshad Farzadfar; Valery Feigin; David T Felson; Alize Ferrari; Cleusa P Ferri; Eric M Fèvre; Mariel M Finucane; Seth Flaxman; Louise Flood; Kyle Foreman; Mohammad H Forouzanfar; Francis Gerry R Fowkes; Marlene Fransen; Michael K Freeman; Belinda J Gabbe; Sherine E Gabriel; Emmanuela Gakidou; Hammad A Ganatra; Bianca Garcia; Flavio Gaspari; Richard F Gillum; Gerhard Gmel; Diego Gonzalez-Medina; Richard Gosselin; Rebecca Grainger; Bridget Grant; Justina Groeger; Francis Guillemin; David Gunnell; Ramyani Gupta; Juanita Haagsma; Holly Hagan; Yara A Halasa; Wayne Hall; Diana Haring; Josep Maria Haro; James E Harrison; Rasmus Havmoeller; Roderick J Hay; Hideki Higashi; Catherine Hill; Bruno Hoen; Howard Hoffman; Peter J Hotez; Damian Hoy; John J Huang; Sydney E Ibeanusi; Kathryn H Jacobsen; Spencer L James; Deborah Jarvis; Rashmi Jasrasaria; Sudha Jayaraman; Nicole Johns; Jost B Jonas; Ganesan Karthikeyan; Nicholas Kassebaum; Norito Kawakami; Andre Keren; Jon-Paul Khoo; Charles H King; Lisa Marie Knowlton; Olive Kobusingye; Adofo Koranteng; Rita Krishnamurthi; Francine Laden; Ratilal Lalloo; Laura L Laslett; Tim Lathlean; Janet L Leasher; Yong Yi Lee; James Leigh; Daphna Levinson; Stephen S Lim; Elizabeth Limb; John Kent Lin; Michael Lipnick; Steven E Lipshultz; Wei Liu; Maria Loane; Summer Lockett Ohno; Ronan Lyons; Jacqueline Mabweijano; Michael F MacIntyre; Reza Malekzadeh; Leslie Mallinger; Sivabalan Manivannan; Wagner Marcenes; Lyn March; David J Margolis; Guy B Marks; Robin Marks; Akira Matsumori; Richard Matzopoulos; Bongani M Mayosi; John H McAnulty; Mary M McDermott; Neil McGill; John McGrath; Maria Elena Medina-Mora; Michele Meltzer; George A Mensah; Tony R Merriman; Ana-Claire Meyer; Valeria Miglioli; Matthew Miller; Ted R Miller; Philip B Mitchell; Charles Mock; Ana Olga Mocumbi; Terrie E Moffitt; Ali A Mokdad; Lorenzo Monasta; Marcella Montico; Maziar Moradi-Lakeh; Andrew Moran; Lidia Morawska; Rintaro Mori; Michele E Murdoch; Michael K Mwaniki; Kovin Naidoo; M Nathan Nair; Luigi Naldi; K M Venkat Narayan; Paul K Nelson; Robert G Nelson; Michael C Nevitt; Charles R Newton; Sandra Nolte; Paul Norman; Rosana Norman; Martin O'Donnell; Simon O'Hanlon; Casey Olives; Saad B Omer; Katrina Ortblad; Richard Osborne; Doruk Ozgediz; Andrew Page; Bishnu Pahari; Jeyaraj Durai Pandian; Andrea Panozo Rivero; Scott B Patten; Neil Pearce; Rogelio Perez Padilla; Fernando Perez-Ruiz; Norberto Perico; Konrad Pesudovs; David Phillips; Michael R Phillips; Kelsey Pierce; Sébastien Pion; Guilherme V Polanczyk; Suzanne Polinder; C Arden Pope; Svetlana Popova; Esteban Porrini; Farshad Pourmalek; Martin Prince; Rachel L Pullan; Kapa D Ramaiah; Dharani Ranganathan; Homie Razavi; Mathilda Regan; Jürgen T Rehm; David B Rein; Guiseppe Remuzzi; Kathryn Richardson; Frederick P Rivara; Thomas Roberts; Carolyn Robinson; Felipe Rodriguez De Leòn; Luca Ronfani; Robin Room; Lisa C Rosenfeld; Lesley Rushton; Ralph L Sacco; Sukanta Saha; Uchechukwu Sampson; Lidia Sanchez-Riera; Ella Sanman; David C Schwebel; James Graham Scott; Maria Segui-Gomez; Saeid Shahraz; Donald S Shepard; Hwashin Shin; Rupak Shivakoti; David Singh; Gitanjali M Singh; Jasvinder A Singh; Jessica Singleton; David A Sleet; Karen Sliwa; Emma Smith; Jennifer L Smith; Nicolas J C Stapelberg; Andrew Steer; Timothy Steiner; Wilma A Stolk; Lars Jacob Stovner; Christopher Sudfeld; Sana Syed; Giorgio Tamburlini; Mohammad Tavakkoli; Hugh R Taylor; Jennifer A Taylor; William J Taylor; Bernadette Thomas; W Murray Thomson; George D Thurston; Imad M Tleyjeh; Marcello Tonelli; Jeffrey A Towbin; Thomas Truelsen; Miltiadis K Tsilimbaris; Clotilde Ubeda; Eduardo A Undurraga; Marieke J van der Werf; Jim van Os; Monica S Vavilala; N Venketasubramanian; Mengru Wang; Wenzhi Wang; Kerrianne Watt; David J Weatherall; Martin A Weinstock; Robert Weintraub; Marc G Weisskopf; Myrna M Weissman; Richard A White; Harvey Whiteford; Natasha Wiebe; Steven T Wiersma; James D Wilkinson; Hywel C Williams; Sean R M Williams; Emma Witt; Frederick Wolfe; Anthony D Woolf; Sarah Wulf; Pon-Hsiu Yeh; Anita K M Zaidi; Zhi-Jie Zheng; David Zonies; Alan D Lopez; Mohammad A AlMazroa; Ziad A Memish
Journal:  Lancet       Date:  2012-12-15       Impact factor: 79.321

View more
  25 in total

1.  Comorbid Chronic Physical Illnesses in Type 1 Diabetes Adolescents: Personal, Caregiver, and Family Functioning.

Authors:  Demivette Gómez-Rivera; Eduardo Cumba-Avilés
Journal:  Salud Conducta Humana       Date:  2021-12-23

2.  The Association Between Obesity and Key Health or Psychosocial Outcomes Among Autistic Adults: A Systematic Review.

Authors:  Daniel G Gilmore; Anne Longo; Brittany N Hand
Journal:  J Autism Dev Disord       Date:  2021-09-15

3.  Network-medicine framework for studying disease trajectories in U.S. veterans.

Authors:  Kelly Cho; Albert-László Barabási; Italo Faria do Valle; Brian Ferolito; Hanna Gerlovin; Lauren Costa; Serkalem Demissie; Franciel Linares; Jeremy Cohen; David R Gagnon; J Michael Gaziano; Edmon Begoli
Journal:  Sci Rep       Date:  2022-07-14       Impact factor: 4.996

4.  Costs of multimorbidity: a systematic review and meta-analyses.

Authors:  Phuong Bich Tran; Joseph Kazibwe; Georgios F Nikolaidis; Ismo Linnosmaa; Mieke Rijken; Josefien van Olmen
Journal:  BMC Med       Date:  2022-07-19       Impact factor: 11.150

5.  Trends in and drivers of healthcare expenditure in the English NHS: a retrospective analysis.

Authors:  Idaira Rodriguez Santana; María José Aragón; Nigel Rice; Anne Rosemary Mason
Journal:  Health Econ Rev       Date:  2020-06-30

Review 6.  Cannabis Use in Hospitalized Patients with Chronic Pain.

Authors:  Vwaire Orhurhu; Ivan Urits; Mayowa Olusunmade; Akinola Olayinka; Mariam Salisu Orhurhu; Chiedozie Uwandu; Musa Aner; Sebele Ogunsola; Loretta Akpala; Sameer Hirji; Omar Viswanath; Jay Karri; Thomas Simopoulos; Jatinder Gill
Journal:  Adv Ther       Date:  2020-07-06       Impact factor: 3.845

7.  The short-term effect of BMI, alcohol use, and related chronic conditions on labour market outcomes: A time-lag panel analysis utilizing European SHARE dataset.

Authors:  Andrea B Feigl; Yevgeniy Goryakin; Marion Devaux; Aliénor Lerouge; Sabine Vuik; Michele Cecchini
Journal:  PLoS One       Date:  2019-03-11       Impact factor: 3.240

8.  Multiple chronic conditions at a major urban health system: a retrospective cross-sectional analysis of frequencies, costs and comorbidity patterns.

Authors:  Usnish B Majumdar; Christophe Hunt; Patrick Doupe; Aaron J Baum; David J Heller; Erica L Levine; Rashi Kumar; Robert Futterman; Cother Hajat; Sandeep P Kishore
Journal:  BMJ Open       Date:  2019-10-15       Impact factor: 2.692

9.  Cost-effectiveness analysis of a multiple health behaviour change intervention in people aged between 45 and 75 years: a cluster randomized controlled trial in primary care (EIRA study).

Authors:  Maria Rubio-Valera; Antoni Serrano-Blanco; Ignacio Aznar-Lou; Edurne Zabaleta-Del-Olmo; Marc Casajuana-Closas; Alba Sánchez-Viñas; Elizabeth Parody-Rúa; Bonaventura Bolíbar; Montserrat Iracheta-Todó; Oana Bulilete; Tomàs López-Jiménez; Haizea Pombo-Ramos; María Victoria Martín Miguel; Rosa Magallón-Botaya; Jose Ángel Maderuelo-Fernández; Emma Motrico; Juan Bellón; Ruth Martí-Lluch
Journal:  Int J Behav Nutr Phys Act       Date:  2021-07-02       Impact factor: 6.457

10.  Epidemiology of multimorbidity in conditions of extreme poverty: a population-based study of older adults in rural Burkina Faso.

Authors:  Maria Lisa Odland; Collin Payne; Miles D Witham; Mark J Siedner; Till Bärnighausen; Mamadou Bountogo; Boubacar Coulibaly; Pascal Geldsetzer; Guy Harling; Jennifer Manne-Goehler; Lucienne Ouermi; Ali Sie; Justine I Davies
Journal:  BMJ Glob Health       Date:  2020-03-29
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.