Explaining the excess mortality in Scotland compared with England: pooling of 18 cohort studies.

BACKGROUND: Mortality in Scotland is higher than in the rest of west and central Europe and is improving more slowly. Relative to England and Wales, the excess is only partially explained by area deprivation. We tested the extent to which sociodemographic, behavioural, anthropometric and biological factors explain the higher mortality in Scotland compared with England.
METHODS: Pooled data from 18 nationally representative cohort studies comprising the Health Surveys for England (HSE) and the Scottish Health Survey (SHS). Cox regression analysis was used to quantify the excess mortality risk in Scotland relative to England with adjustment for baseline characteristics.
RESULTS: A total of 193,873 participants with a mean of 9.6 years follow-up gave rise to 21,345 deaths. The age-adjusted and sex-adjusted all-cause mortality HR for Scottish respondents compared with English respondents was 1.40 (95% CI 1.34 to 1.47), which attenuated to 1.29 (95% CI 1.23 to 1.36) with the addition of the baseline socioeconomic and behavioural characteristics. Cause-specific mortality HRs attenuated only marginally to 1.43 (95% 1.28 to 1.60) for ischaemic heart disease, 1.37 (95% CI 1.15 to 1.63) for stroke, 1.41 (95% CI 1.30 to 1.53) for all cancers, 3.43 (95% CI 1.85 to 6.36) for illicit drug-related poisoning and 4.64 (95% CI 3.55 to 6.05) for alcohol-related mortality. The excess was greatest among young adults (16-44 years) and was observed across all occupational social classes with the greatest excess in the unskilled group.
CONCLUSIONS: Only a quarter of the excess mortality among Scottish respondents could be explained by the available baseline risk factors. Greater understanding is required on the lived experience of poverty, the role of social support, and the historical, environmental, cultural and political influences on health in Scotland. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Introduction

The population of Scotland has experienced higher mortality rates than the rest of the UK since the 1920s, and improved more slowly than the rest of continental Europe since the 1950s.1–3 Initially, this was largely ascribed to higher mortality from cardiovascular disease (CVD), stroke and cancer. However, this pattern of cause-specific deaths changed around 1980 with a rise in rates of violent,4 drug-related and suicide deaths.5 With an accompanying increase in rates of alcohol-related deaths over subsequent decades, the mortality pattern now has parallels to that observed in eastern Europe.2 3 6

Relative to England and Wales, mortality rates in Scotland were 12% higher in 1981, increasing to 15% higher in 2001. The proportion of this excess, which could be explained by area-based socioeconomic deprivation, declined from 62% to 47% during the same period. Individual measures of socioeconomic status revealed similar findings for coronary heart disease.7 This apparently inexplicable excess mortality, over and above that explained by area deprivation, has been dubbed the ‘Scottish Effect’.8

There is therefore a need to explain why Scotland experiences higher rates of mortality than the rest of west and central Europe, why area deprivation is increasingly less able to explain the excess in comparison to England and Wales and why inequalities in mortality within Scotland are relatively higher.9–11 To date, there have been at least 17 hypotheses suggested to explain these phenomena,12 13 but the investigation of many of these has been limited by a lack of comparable individual data linked to health outcomes, and where these data have been available, they may not be generalisable.14 Although it is clear that some health behaviours are implicated in the higher mortality (particularly alcohol6 15 and illicit drugs16), the prevalence of many others are relatively similar in Scotland to other areas.17 18 This has raised the possibility that other factors may be an important explanation.19 Furthermore, simple explanations that include only health behaviours without some understanding of the ‘causes of the causes’ are insufficient, and so hypotheses relating to deindustrialisation, unemployment, economic and social policy20 21 (not least the neoliberal approach seen in the UK) have been proposed.1 12 13 22–25 Further research is therefore required in order to design policy and practice with the aim of alleviating the human suffering associated with the higher mortality rates.

Major population health surveys conducted from the mid-1990s in Scotland and England, whose respondents have been linked to subsequent cause-specific mortality, have created powerful, well-characterised cohort studies which draw on random population samples.26 27 Much of the data collected in the health surveys are directly comparable and there have now been a sufficient number of deaths to facilitate comparative pooled analyses of mortality in England and Scotland. Thus, this study aims to ascertain the extent to which any of the baseline risk factors explain the higher mortality in Scotland, beginning with social position, given the earlier finding from ecological and individual studies of an excess after adjustment for deprivation.7 8

Methods

Data sources

We used the data collected in a series of 18 independent studies conducted between 1995 and 2003 (the Scottish Health Surveys, SHS) and 1994–2008 (the Health Surveys for England, HSE). Consenting survey respondents have been linked to the National Health Service registries up until the first quarter of 2011 for data on cause-specific mortality (the proportion consenting in each cohort study is given in table 1 (mean 86%, range 72–96%)). These cohort studies have been described in detail elsewhere.26 27 Briefly, random, stratified, population-based samples of the Scottish population aged 16–64, 16–74 and ≥16 years were taken in 1995, 1998 and 2003, respectively. In England, random population samples were drawn from the population aged ≥16 years in each year from 1994 to 2008. At the interview, data were collected on occupational social class, educational attainment, health behaviours (such as diet, smoking and alcohol consumption), pre-existing morbidity, self-assessed health and the 12-item General Health Questionnaire.28 During a subsequent nurse visit, weight, height, spirometry and blood pressure were objectively measured; blood samples were taken from a subsample.

Table 1

Characteristics of study participants according to individual cohort studies: follow-up of 18 cohort studies from the Health Survey for England and Scottish Health Survey (N=193 873)

		Health Survey for England																Scottish Health Survey
		1994	1995	1996	1997	1998	1999	2000	2001	2002	2003	2004	2005	2006	2007	2008	N	1995	1998	2003	N
Adults irrespective of consent status	N	15 804	16 055	16 443	8582	15 908	13 947	11 025	15 647	10 331	14 836	12 758	10 303	14 142	6882	15 102	197 765	7932	9040	8092	25 064
Household response	%	77	78	79	76	74	76	75	74	74	73	72	74	68	64	64		81*	77	67
Estimated adult interview response	%	71	73	75	71	69	70	68	67	67	66	66	64	61	58	58		93	92	91
Consented to mortality linkage	%	95.6	93.7	93.7	93.9	94.6	90.1	71.9	88.4	88.9	87.3	75.7	80.6	82.6	80.5	78.2	–	85.3	86.9	87.9	–
	N	15 113	15 036	15 411	8060	15 046	12 571	7931	13 835	9181	12 954	9661	8308	11 683	5542	11 807	172 139	6763	7857	7114	21 734
Follow-up (years)	Mean	15.0	14.2	13.4	12.6	11.7	11.2	9.3	9.2	8.3	7.3	6.4	5.4	4.5	3.5	2.5	172 139	13.8	10.6	5.7	21 734
	SD	3.9	3.6	3.2	2.8	2.6	1.8	2.8	1.6	1.2	1.2	0.8	0.9	0.6	0.4	0.3		2.2	2.0	0.9
Deaths from all causes		2924	2821	2640	1229	2177	963	1639	1393	593	970	367	699	477	173	172	172 139	638	934	536	21 734
Age	Mean	46.0	46.3	46.4	46.2	46.8	43.8	51.8	47.3	39.4	47.8	45.4	54.6	49.2	48.5	48.8	172 139	40.2	45.2	49.6	21 734
	SD	18.6	18.5	18.5	18.1	18.5	17.9	21.0	18.2	19.6	18.1	17.8	19.6	18.2	18.1	18.4		13.3	15.9	17.8
	Range	16–97	16–100	16–102	16–95	16–97	16–96	16–102	16–99	16–97	16–99	16–102	16–99	16–97	16–97	16–97		16–64	16–74	16–95
Female	%	54.4	54.1	54.1	54.0	54.7	54.0	56.0	54.7	55.8	55.2	56.2	54.7	55.0	55.2	55.4	172 139	55.1	55.9	55.8	21 734
Non-manual occupational social class (I–IIINM)	%	54.1	55.7	55.1	55.2	54.7	53.9	57.1	57.6	57.6	59.3	59.4	58.8	61.0	61.3	61.1	161 702	51.4	51.9	56.0	20 492
Left school ≥16 (approximates to compulsory education)	%	61.8	61.3	62.9	63.2	64.0	68.4	62.2	67.9	77.1	70.0	74.9	63.1	72.3	74.0	73.4	172 017	66.6	62.8	64.8	21 716
Current smoker	%	27.4	27.5	28.6	28.1	27.8	25.1	24.6	25.4	27.8	24.6	21.2	21.1	22.0	21.5	21.5	171 477	37.0	34.8	26.3	21 591
Drinks alcohol at least weekly	%	62.2	64.2	65.2	65.2	65.3	49.8	60.6	65.1	64.5	64.8	49.0	62.3	61.2	60.7	60.3	170 166	63.1	61.4	60.3	21 365
Self-assessed general health good or very good	%	76.4	76.3	76.4	74.5	74.1	71.9	71.9	74.5	77.5	75.1	73.1	71.1	74.6	74.2	74.8	172 101	75.7	74.6	71.8	21 734
Long-standing illness	%	39.5	41.8	42.7	44.5	44.2	41.6	47.4	46.0	40.2	47.4	43.7	52.7	46.2	45.9	45.6	172 095	37.0	43.3	44.2	21 734

*The sample design in 1995 selected only one adult randomly per household at random.

The end points of interest were all-cause mortality and mortality from: CVD (International Classification of Diseases (ICD)-9 codes 390-459 and ICD-10 chapter I); ischaemic heart disease (ICD-9 codes 410-414 and ICD-10 codes I20-I25); stroke (ICD-9 codes 430-438 and ICD-10 codes I60-I69); all cancers (ICD-9 codes 140-239 and ICD-10 codes C00-D48); individual cancers; smoking-related cancers (ICD-9 codes 141-151, 155.0, 157, 160.0, 160.2-160.9, 161, 162.2-162.9, 180, 188, 189 and 205 and ICD-10 codes C01-16, C22, C25, C30.0, C31, C32, C34, C53, C64, C65, C67 and C92, in line with WHO definitions29 30); alcohol-related causes (ICD-9 codes 291, 303, 305.0, 425.5, 571.0, 571.1, 571.2, 571.3, 571.4, 571.5, 571.8, 571.9 and E860 and ICD-10 codes F10, G31.2, G62.1, I42.6, K29.2, K70, K73, K74.0, K74.1, K74.2, K74.6, K86.0, X45, X65 and Y15); illicit drug-related causes (ICD-9 codes 304-305 (not 305.1), 965-71, E935-41, E950.0-E950.5, E962 and E980.0-E980.5 and ICD-10 codes F11-F16, F18, F19, X40-X44, X60-X64, X85 and Y10-Y14); and external causes (ICD-9 codes 800-999 and ICD-10 codes V00-Y98; for both intentional external deaths (identified by any mention of ICD-9 codes E950-E959 and E980-E989 or ICD-10 codes X60-X84 and Y10-Y34 associated with an underlying external cause of death) and unintentional external deaths (all deaths where the underlying cause of death was external and had no mention of the ICD codes indicating an intentional motivation)).

Analyses

We examined log (−log(survival)) plots for total mortality to confirm that the proportional hazards assumption was valid. Cox proportional regression31 was then used—with calendar time in months elapsed from survey date as the time scale—to compute HRs with accompanying 95% CIs for the relation of country of residence (based on survey) with mortality experience. We also performed a sensitivity analysis using age as the timescale for the analysis rather than age-adjusted calendar time.

Having tested that gender did not modify the residence–mortality relation, these HRs were initially adjusted for age and sex. This was followed by the individual addition of occupational social class, educational attainment, smoking status, frequency of alcohol consumption, self-assessed health and long-standing illness. Finally, we adjusted for all factors simultaneously. In planned sensitivity analyses, these analyses were repeated for all-cause mortality for restricted age strata (16–45 and ≥45 years) and by occupational social class strata to investigate the suggestion of higher mortality among young adults11 14 32 33 and in more deprived neighbourhoods.11 14 32 33 For selected outcomes, we also examined the impact of controlling for height in addition to a much wider range of individual baseline survey and clinical measurement data for which there were more than 20% of data missing. These were: doctor-diagnosed CVD and hypertension; and doctor-diagnosed diabetes; portions of fruit and vegetables eaten on a day prior to the survey; antidepressant use; anxiolytic use; physical activity34; psychological distress measured by the 12-item General Health Questionnaire (GHQ-12); objectively measured body mass index; systolic blood pressure; diastolic blood pressure; forced vital capacity (FVC); forced expiratory volume in 1 s (FEV1); and peak flow rate. Where individuals had missing data, we excluded them from the relevant analyses.

Finally, to empirically assess the degree to which the linked HSE and SHS cohort studies were representative of the English and Scottish populations, we also tabulated the denominator populations and number of deaths for each 5-year age–sex stratum for each year of follow-up and created an equivalent table for the English and Scottish populations overall using routine administrative data. We then performed a negative binomial regression using R V.2.15.2 to compare the relative all-cause mortality rates between the pooled surveys and their corresponding overall populations. All other analyses used PASW Statistics V.18.0.

Results

There were 222 829 individuals in the 18 cohort studies, of whom 193 873 had sufficiently complete data to facilitate analysis (172 139 in HSE and 21 734 in SHS, web figure 1). Fifteen English cohort studies for each year between 1994 and 2008 were available, as were three Scottish cohort studies from 1995, 1998 and 2003. Over a period of time, the proportion of people consenting to participate in the survey and to mortality linkage declined, as did smoking prevalence. There were also secular rises in the socioeconomic status of study members as evidenced by the proportion in non-manual occupational social classes and those leaving school aged >16 years (table 1). Relative to study members who declined to consent to being linked to mortality records, participants who did were somewhat more likely to be healthy, be from a non-manual social class, have higher educational attainment and be less likely to smoke or have a long-term limiting illness; web table 1).

The baseline characteristics of the pooled English and pooled Scottish cohort studies are given in web table 2. The proportion of the sample in the English studies of the non-manual social class and with greater educational attainment was slightly higher than that in the Scottish studies, while the prevalence of smoking was substantially higher in Scotland compared with England (32.8% vs 25.3%). The prevalence of psychological distress at baseline in the Scottish and English studies was broadly similar (with 59%, 26%, 8% and 7% in the HSE studies and 59%, 24%, 8% and 8% in the SHS studies with GHQ-12 scores of 0, 1–3, 4–6 and 7–12, respectively).

The age-adjusted and sex-adjusted HR for mortality in the pooled Scottish studies compared with the English studies for all-cause mortality was 1.40 (95% CI 1.34 to 1.47). Additional adjustment for occupational social class, educational attainment, frequency of alcohol consumption, self-reported health or long-standing illness did little to attenuate the relationship, whereas only adding smoking to the model had an appreciable effect (HR=1.31, 95% CI 1.25 to 1.37). Adjustment for all these factors combined resulted in a raised risk of total mortality of 29% (HR 1.29, 95% CI 1.23 to 1.36) in the Scottish studies relative to the English studies (table 2).

Table 2

HRs (95% CI) for all-cause mortality, and deaths from cancer: Scotland relative to England (N=193 873)

Model*	All-cause mortality					Cancer†
	Deaths	N	HSE	SHS	p Value	Deaths	N	HSE	SHS	p Value
			HR	HR				HR	HR
Age-adjusted and sex-adjusted (basic model)§	21 345	193 873	1	1.40 (1.34 to 1.47)	<0.001	6009	193 873	1	1.54 (1.42 to 1.66)	<0.001
+Occupational social class	20 410	183 043	1	1.39 (1.33 to 1.46)	<0.001	5839	183 043	1	1.52 (1.41 to 1.65)	<0.001
+Educational attainment	21 318	193 733	1	1.39 (1.32 to 1.45)	<0.001	6006	193 733	1	1.52 (1.41 to 1.65)	<0.001
+Smoking status	21 309	193 068	1	1.31 (1.25 to 1.37)	<0.001	5997	193 068	1	1.42 (1.31 to 1.53)	<0.001
+Frequency of alcohol consumption	21 311	191 531	1	1.39 (1.33 to 1.45)	<0.001	6000	191 531	1	1.54 (1.42 to 1.66)	<0.001
+Self-assessed general health	21 339	193 835	1	1.39 (1.33 to 1.46)	<0.001	6007	193 835	1	1.53 (1.41 to 1.65)	<0.001
+Long-standing illness	21 341	193 829	1	1.41 (1.35 to 1.48)	<0.001	6008	193 829	1	1.54 (1.43 to 1.67)	<0.001
Multiply adjusted‡	20 330	181 560	1	1.29 (1.23 to 1.36)	<0.001	5818	181 560	1	1.41 (1.30 to 1.53)	<0.001

*Covariates selected from potentially relevant variables because data for these variables were missing in less than 20% of participants.

†ICD-9 codes 140-239 and ICD-10 codes C00-D48.

‡Model adjusted for age, sex, occupational social class, educational attainment, smoking status, frequency of alcohol consumption, self-assessed general health and long-standing illness.

§The unadjusted HR suggests that death rates are lower in Scotland but the age distributions of the two samples are different—the HSE cohorts are older.

HSE, Health Surveys for England; ICD, International Classification of Diseases; SHS, Scottish Health Survey.

For all cancers combined, the age-adjusted and sex-adjusted HR for the Scottish studies was 1.54 (95% CI 1.42 to 1.66), which was only partially explained by smoking (HR 1.42, 95% CI 1.31 to 1.53) and not substantially by occupational social class, educational attainment, frequency of alcohol consumption, self-assessed general health or long-standing illness (multiply adjusted HR 1.41, 95% CI 1.30 to 1.53; table 2). Web table 3 shows the HRs for smoking-related cancers and a range of site-specific cancers. The multiply adjusted HR for smoking-related cancers was 1.62 (95% CI 1.45 to 1.81) and for non-smoking-related cancers 1.22 (1.09 to 1.37). Particularly high multiply adjusted HRs were observed for lung cancer (1.67, 95% CI 1.43 to 1.94), oesophageal cancer (2.23, 1.60 to 3.09), bladder cancer (1.62, 1.04 to 2.54), cancer of the central nervous system (1.74, 1.12 to 2.72), leukaemia (2.32, 1.1.45 to 3.71), multiple myeloma (1.60, 0.81 to 3.13), liver cancer (2.54, 1.37 to 4.73) and mesothelioma (2.04, 1.06 to 3.93). The multiply adjusted models explained a very small additional proportion of the excess mortality compared with the age-adjusted and sex-adjusted models for each of these specific cancers. There was no evidence of an excess mortality for prostate or pancreatic cancer, or for non-Hodgkin's lymphoma.

A similar pattern to all-cause mortality was observed for CVD, ischaemic heart disease and stroke, where the multiply adjusted HRs were 1.27 (95% CI 1.16 to 1.38), 1.43 (1.28 to 1.60) and 1.37 (1.15 to 1.63), respectively (table 3). For intentional external causes (ie, intentional self-harm, violence or events of undetermined intent), the multiply adjusted HR was 1.68 (95% CI 1.07 to 2.64), and for unintentional external causes (ie, all other accidents, assaults, medical/surgical complications, or other external causes of death) it was similar in the Scottish studies compared with the English studies (HR 0.88, 95% CI 0.62 to 1.24; table 4).

Table 3

HRs (95% CI) for all-cause mortality, and deaths from cardiovascular disease, ischaemic heart disease and stroke: Scotland relative to England (N=193 873)

	Cardiovascular disease*					Ischaemic heart disease†					Stroke‡
Model	Deaths	N	HSE	SHS	p Value	Deaths	N	HSE	SHS	p Value	Deaths	N	HSE	SHS	p Value
			HR	HR				HR	HR				HR	HR
Age-adjusted and sex-adjusted (basic model)	7372	193 873	1	1.37 (1.26 to 1.48)	<0.001	3555	193 873	1	1.60 (1.43 to 1.77)	<0.001	1793	193 873	1	1.42 (1.20 to 1.68)	<0.001
+Occupational social class	7025	183 043	1	1.35 (1.25 to 1.47)	<0.001	3406	183 043	1	1.54 (1.38 to 1.72)	<0.001	1683	183 043	1	1.43 (1.20 to 1.70)	<0.001
+Educational attainment	7363	193 733	1	1.36 (1.25 to 1.47)	<0.001	3550	193 733	1	1.57 (1.41 to 1.75)	<0.001	1792	193 733	1	1.42 (1.19 to 1.68)	<0.001
+Smoking status	7365	193 068	1	1.29 (1.19 to 1.40)	<0.001	3551	193 068	1	1.50 (1.35 to 1.67)	<0.001	1791	193 068	1	1.36 (1.14 to 1.61)	<0.001
+Frequency of alcohol consumption	7362	191 531	1	1.35 (1.24 to 1.46)	<0.001	3554	191 531	1	1.57 (1.41 to 1.75)	<0.001	1791	191 531	1	1.39 (1.17 to 1.65)	<0.001
+Self-assessed general health	7370	193 835	1	1.36 (1.26 to 1.48)	<0.001	3554	193 835	1	1.58 (1.42 to 1.76)	<0.001	1792	193 835	1	1.42 (1.20 to 1.69)	<0.001
+Long-standing illness	7372	193 829	1	1.38 (1.28 to 1.50)	<0.001	3555	193 829	1	1.61 (1.45 to 1.80)	<0.001	1793	193 829	1	1.43 (1.21 to 1.70)	<0.001
Fully-adjusted§	7000	181 560	1	1.27 (1.16 to 1.38)	<0.001	3395	181 560	1	1.43 (1.28 to 1.60)	<0.001	1678	181 560	1	1.37 (1.15 to 1.63)	<0.001

§Model adjusted for age, sex, occupational social class, educational attainment, smoking status, frequency of alcohol consumption, self-assessed general health and long-standing illness.

*ICD-9 codes 390-459 and ICD-10 chapter I.

†ICD-9 codes 410-414 and ICD-10 codes I20-I25.

‡ICD-9 codes 430-438 and ICD-10 codes I60-I69.

HSE, Health Surveys for England; ICD, International Classification of Diseases; SHS, Scottish Health Survey.

Table 4

HRs (95% CI) for deaths from external causes, intentional and unintentional: Scotland relative to England (N=193 873)

	External (intentional)*					External (unintentional)
Model	Deaths†	N	HSE	SHS	p Value	Deaths	N	HSE	SHS	p Value
			HR	HR				HR	HR
Age-adjusted and sex-adjusted (basic model)	122	193 873	1	1.85 (1.18 to 2.89)	0.007	418	193 873	1	0.95 (0.69 to 1.32)	0.777
+Occupational social class	119	183 634	1	1.86 (1.19 to 2.91)	0.007	398	183 043	1	0.93 (0.67 to 1.31)	0.693
+Educational attainment	122	193 733	1	1.85 (1.18 to 2.89)	0.007	418	193 733	1	0.95 (0.68 to 1.31)	0.745
+Smoking status	122	193 068	1	1.65 (1.05 to 2.58)	0.030	415	193 068	1	0.87 (0.62 to 1.22)	0.408
+Frequency of alcohol consumption	122	191 531	1	1.86 (1.19 to 2.91)	0.007	417	191 531	1	0.96 (0.69 to 1.33)	0.793
+Self-assessed general health	122	193 835	1	1.82 (1.16 to 2.84)	0.009	418	193 835	1	0.95 (0.68 to 1.31)	0.741
+Long-standing illness	122	193 829	1	1.85 (1.18 to 2.89)	0.007	418	193 829	1	0.95 (0.69 to 1.32)	0.778
Fully-adjusted‡	119	181 151	1	1.68 (1.07 to 2.64)	0.025	396	181 560	1	0.88 (0.62 to 1.24)	0.453

*Intentional deaths were identified by any mention of ICD-9 codes E950-E959 (intentional) and E980-E989 (undetermined intent) or ICD-10 codes X60-X84 (intentional) and Y10-Y34 (undetermined intent) associated with an underlying external cause of death (ICD-9 codes 800-999 or ICD-10 codes V00-Y98).

†HSE deaths 98; SHS deaths 24.

‡Model adjusted for age, sex, occupational social class, educational attainment, smoking status, frequency of alcohol consumption, self-assessed general health and long-standing illness.

HSE, Health Surveys for England; ICD, International Classification of Diseases; SHS, Scottish Health Survey.

The age-adjusted and sex-adjusted alcohol-related mortality in the Scottish studies was more than five times higher than that in the English studies (HR 5.43, 95% CI 4.20 to 7.02). This was only marginally explained by the baseline risk factors (in particular smoking), giving a multiply adjusted HR of 4.64 (95% CI 3.55 to 6.05). Similarly, the age-adjusted and sex-adjusted drug-related poisoning mortality in the Scottish studies was almost four times higher than that in the English studies (HR 3.86, 95% CI 2.15 to 6.94), which again was only marginally explained by the baseline risk factors (multiply adjusted HR 3.43, 95% CI 1.85 to 6.36; figure 1 and table 5).

Figure 1

Multiply adjusted HRs for Scotland relative to England.

Table 5

HRs (95% CI) for deaths related to alcohol* or drugs†: Scotland relative to England (N=193 873)

Model‡	Alcohol-related deaths*					Drug-related poisonings†
	Deaths	N	HSE	SHS	p Value	Deaths	N	HSE	SHS	p Value
			HR	HR				HR	HR
Age-adjusted and sex-adjusted (basic model)	252	193 831	1	5.43 (4.20 to 7.02)	<0.001	50	193 606	1	3.86 (2.15 to 6.94)	<0.001
+Occupational social class	246	183 004	1	5.26 (4.06 to 6.82)	<0.001	46	182 793	1	3.84 (2.09 to 7.06)	<0.001
+Educational attainment	251	193 691	1	5.34 (4.13 to 6.91)	<0.001	50	193 466	1	3.87 (2.15 to 6.95)	<0.001
+Smoking status	249	193 026	1	4.47 (3.44 to 5.80)	<0.001	50	192 801	1	3.32 (1.84 to 5.98)	<0.001
+Frequency of alcohol consumption	251	191 489	1	5.73 (4.44 to 7.42)	<0.001	48	191 264	1	3.77 (2.06 to 6.87)	<0.001
+Self-assessed general health	252	193 793	1	5.26 (4.07 to 6.80)	<0.001	50	193 568	1	3.65 (2.03 to 6.56)	<0.001
+Long-standing illness	252	193 787	1	5.45 (4.22 to 7.04)	<0.001	50	193 562	1	3.88 (2.16 to 6.98)	<0.001
Fully-adjusted§	241	181 521	1	4.64 (3.55 to 6.05)	<0.001	45	181 310	1	3.43 (1.85 to 6.36)	<0.001

*Coded according to the General Register Office for Scotland convention using ICD-9 codes 291, 303, 305.0, 425.5, 571.0, 571.1, 571.2, 571.3, 571.4, 571.5, 571.8, 571.9 and E860 and ICD-10 codes F10, G31.2, G62.1, I42.6, K29.2, K70, K73, K74.0, K74.1, K74.2, K74.6, K86.0, X45, X65 and Y15.

†ICD-9 codes 304-305 (not 305.1), 965-71, E935–41, E950.0-E950.5, E962 and E980.0-E980.5 and ICD-10 codes F11-F16, F18, F19, X40-X44, X60-X64, X85 and Y10-Y14.

‡Covariates selected from potentially relevant variables because data for these variables were missing in less than 20% of participants.

§Model adjusted for age, sex, occupational social class, educational attainment, smoking status, frequency of alcohol consumption, self-assessed general health and long-standing illness.

HSE, Health Surveys for England; ICD, International Classification of Diseases; SHS, Scottish Health Survey.

Web table 4 shows the all-cause HRs stratified into broad age categories to investigate whether the excess mortality in the Scottish studies was greater among young adults, as has been shown in previous studies,32 and whether this is explained by the baseline risk factors. For those aged 16–44 and 45–64 years, the age-adjusted and sex-adjusted HRs were higher than those for all ages (HR 1.68, 95% CI 1.44 to 1.97 and 1.71, 95% CI 1.59 to 1.83), which adjusted to (HR 1.54, 95% CI 1.30 to 1.81 and 1.47, 95% CI 1.37 to 1.58) with the addition of the baseline risk factors.

Web table 5 shows the HRs for residency in relation to all-cause mortality stratified by occupational social class. This shows that the excess age-standardised and sex-standardised mortality is present across all occupational social class categories except for social class I where the multiply adjusted HR was in fact imprecisely lower in the Scottish studies (0.85; 0.59 to 1.23). The multiply adjusted HRs for the Scottish studies were 1.20 (95% CI 1.08 to 1.34) in social class II, 1.32 (1.18 to 1.47) in social class IIINM, 1.31 (1.20 to 1.43) in social class IIIM, 1.27 (1.14 to 1.41) in social class IV and 1.40 (1.22 to 1.61) in social class V. The HR for the interaction between country and social class was 1.05 (p=0.12).

Web table 6 gives the subgroup analyses of the models adjusted using a wider range of baseline characteristics that were available for a smaller proportion of linked survey respondents. This shows that few of the additional baseline factors offer much additional explanatory power, with the exception of FVC, FEV1 and peak flow. Notably, neither pre-existing morbidity, blood pressure, physical activity, portions of fruit and vegetables eaten, body mass index, antidepressant use nor anxiolytic use explained any substantial proportion of the standardised excess.

Discussion

Main results

Mortality rates in the Scottish studies were 40% higher than in the English studies for all causes. The mortality rates for almost all specific causes of death were higher, although with some heterogeneity: for instance, mortality for ischaemic heart disease was 60% and stroke mortality was 42% higher in the Scottish studies. The relative differences in mortality rates were particularly high for: all cancers (54% higher); intentional external causes (85% higher); lung and oesophageal cancer (more than twice as high); for drug-related poisonings (almost four times higher) and for alcohol-related deaths (more than five times higher). Taking into account the most obvious explanatory factor, socioeconomic characteristics, explained only a small proportion of the overall observed excess, with the multiply adjusted all-cause mortality rate remaining 29% higher in the Scottish studies relative to the English studies. This reflects the relatively minor differences in risk factors between countries, the main difference being a greater proportion who smoked in the Scottish studies. Lung function did explain a larger proportion of the excess in the subgroup for whom these data were available, but this measure is by definition functional and the exposures which diminish it are unclear. In the age-stratified analysis, the relative mortality rates were observed to be highest in those aged 16–44 years (65% higher) and in those aged 45–64 years (70% higher), compared with 40% higher for all ages. Excess mortality was also observed across most occupational social class groups (with the exception of professionals). This suggests that the factors which are contributing to the excess mortality in Scotland are only partially modified by social class and there are likely to either be exposures that impact across all social groups (with a greater impact among the working class population) or that there are two layers of contributing exposures to the excess, but only one of which impacts across the whole population.

Study strengths and weaknesses

The cohort studies formed from the linked health surveys (HSE and SHS) are designed to be representative of the adult population in England and Scotland and utilise stratified random sampling methods to achieve this goal. Other examinations of explanations for the Scottish-English mortality differentials have often utilised data from cohort studies of working populations, thus affecting the generalisability of any findings.14 It is most likely that almost all deaths will have been captured in the death registries, making the estimated mortality rates internally valid.26 27 The cohort studies also provide premorbid, individual risk factor data not available for routine data, which allows a wider range of potential explanatory factors to be tested with adjustment for confounding.

Despite the survey sample frame being representative of the adult non-institutionalised population, the declining response rates to the baseline surveys and subsequent linkage, the non-coverage of some institutional populations in the sample frame and the consequent potential for non-representativeness are real.35 Both HSE and SHS normally present their results after inverse probability weighting to adjust for non-response bias. We have not weighted our data because: such weighting factors are available for the most recent years only; there are inherent difficulties of using different weights for different years; and because responders are intrinsically different from non-responders and simply up-weighting the responders’ data does not adequately adjust for non-response.36 37 Previous comparisons of HSE and SHS data found that weighting did not change the overall results (Rich Mitchell, personal communication). We did not have comparable measures of area deprivation in the data set and using only individual measures of socioeconomic status may have left some residual confounding.38 We assumed no loss to follow-up in the analyses, which could have biased the results if experienced differentially between HSE and SHS. Although unlikely, it is possible that differential measurement bias (eg, in previous smoking) might have underestimated the impact of some of the explanatory variables in the model. A mediation analysis approach may have facilitated a more detailed consideration of the role of confounding, direct and indirect causes, but was beyond the scope of this paper.

We used the standard approach to Cox modelling of using time since baseline and treating age as a confounder (which is important given the differences in the baseline ages of the cohorts). Web table 7 provides a sensitivity analysis using age as the timescale in the models rather than age-adjusted calendar time. This inflates the HRs in the Scottish population across all causes of death, but the patterning is similar. The age ranges in the cohorts differ slightly and we have chosen to adjust for age rather than restrict those included in the analysis to preserve the sample size. However, to expose the differences across the age range, we have stratified the samples in web table 4, which shows larger HRs for younger adults (which fits with the known higher excess in this age group).2

Preliminary analyses of the age-standardised all-cause mortality rates in the linked SHS compared with the rates derived from routine deaths data suggest that the rates may be underestimated by 33% for men and 20% for women.37 The all-cause mortality rates in the linked HSE and SHS studies here were 31% and 21% lower than in the English and Scottish populations, respectively. Routine data suggest that alcohol-related deaths are approximately twice as high in the Scottish population as in England and Wales,39 yet the age-adjusted and sex-adjusted HR in the Scottish studies compared with the English studies was over five. These all suggest that the healthy respondent effect may be more acute for the English studies. Furthermore, the Scottish data are for a slightly earlier period. Both of these factors will have inflated the HRs comparing the Scottish with the English studies.

Comparison with the existing literature and implications

The excess age-standardised and sex-standardised mortality in the Scottish studies in this study is 40%, more than double that seen using routine data for all ages around 2001 when the difference was 15%.8 Just under half of the excess in 2001 could be explained by area deprivation, but very little of the excess in this study could be explained by individual occupational social class or educational attainment. A recent review of the potential explanations for the excess mortality in Scotland suggested that behavioural factors were unlikely by themselves to explain the differences, and this is confirmed by these analyses—with only smoking explaining a substantial proportion (about a quarter) of the excess. This analysis also concurs with the finding of a greater excess mortality among young adults, and that the excess is seen across most of the socioeconomic spectrum, but is skewed towards the more deprived groups.20 21 32 40 41

Self-rated health in Scotland has been shown to be worse than in England and Wales and worse in Greater Glasgow as compared with a range of other European metropolitan areas. Unlike in this study, in those analyses, the excess in Scotland could entirely be accounted for by differences in economic activity, but the excess in Glasgow could not be explained by social class and educational attainment.42 43 The value of self-rated health as an outcome measure in investigating the mortality phenomena in Scotland is therefore unclear, particularly since there are socioeconomic, demographic and cultural factors which may lead to artefactual differences between population groups.44 45

Further work is therefore required to explore factors which are not routinely collected in health surveys or administrative data, which might explain the excess mortality in Scotland. This includes more sensitive measures of the lived experience of poverty, the role of social support within communities, greater understanding of the impact of historical46 47 and cultural influences and the differential impact of local and national politics on health outcomes.12 13 Further work is also required to examine why psychological distress appears to be more toxic to health in Scotland than in England.48

Mortality in Scotland is higher than in the rest of west and central Europe and is improving more slowly. Relative to England and Wales, the excess is only partially explained by area deprivation.

Mortality was 40% higher in Scottish cohort members than in English cohort members, and only around a quarter was explicable by socioeconomic, behavioural, anthropological or biological factors.