Literature DB >> 22850552

Chronic preoperative pain and psychological robustness predict acute postoperative pain outcomes after surgery for breast cancer.

J Bruce1, A J Thornton, N W Scott, S Marfizo, R Powell, M Johnston, M Wells, S D Heys, A M Thompson.   

Abstract

BACKGROUND: Few epidemiological studies have prospectively investigated preoperative and surgical risk factors for acute postoperative pain after surgery for breast cancer. We investigated demographic, psychological, pain-related and surgical risk factors in women undergoing resectional surgery for breast cancer.
METHODS: Primary outcomes were pain severity, at rest (PAR) and movement-evoked pain (MEP), in the first postoperative week.
RESULTS: In 338 women undergoing surgery, those with chronic preoperative pain were three times more likely to report moderate to severe MEP after breast cancer surgery (OR 3.18, 95% CI 1.45-6.99). Increased psychological 'robustness', a composite variable representing positive affect and dispositional optimism, was associated with lower intensity acute postoperative PAR (OR 0.63, 95% CI 0.48-0.82) and MEP (OR 0.71, 95% CI 0.54-0.93). Sentinel lymph node biopsy (SLNB) and intraoperative nerve division were associated with reduced postoperative pain. No relationship was found between preoperative neuropathic pain and acute pain outcomes; altered sensations and numbness postoperatively were more common after axillary sample or clearance compared with SLNB.
CONCLUSION: Chronic preoperative pain, axillary surgery and psychological robustness significantly predicted acute pain outcomes after surgery for breast cancer. Preoperative identification and targeted intervention of subgroups at risk could enhance the recovery trajectory in cancer survivors.
© 2012 Cancer Research UK

Entities:  

Mesh:

Year:  2012        PMID: 22850552      PMCID: PMC3464763          DOI: 10.1038/bjc.2012.341

Source DB:  PubMed          Journal:  Br J Cancer        ISSN: 0007-0920            Impact factor:   7.640


Breast cancer is the commonest cancer affecting women with a 5-year survival above 80% as a result of earlier diagnosis and improved management (UK, 2011). Understanding and monitoring the acute and long-term sequelae of treatment is an increasingly high priority (Harrington ; Ganz ; Richards ). Painful adverse symptoms can last for many years after surgery for breast cancer and the adverse impact upon postoperative quality of life is well documented (Macdonald ; Gärtner ; Peuckmann ; Andersen and Kehlet, 2011). However, less is known about who is at greatest risk of developing adverse postoperative outcomes after cancer surgery. Improving the identification and typology of risk subgroups should provide opportunities for targeting prevention and treatment initiatives in cancer survivors. Severe pain in the acute postoperative period has consistently been found to predict chronic postsurgical pain, although few studies have prospectively examined whether this relationship exists after surgery for breast cancer (Katz ). One systematic review of 32 studies identified preoperative pain, anxiety, age and type of surgery as significant predictors of acute postoperative pain after different types of surgery, although only two studies involving breast surgery were included, neither of which found any relationship with preoperative pain (Ip ). Methodological quality of studies was poor, hampered by small sample sizes, or failure to capture important preoperative pain and psychological variables. Postsurgical pain is known to be predominantly neuropathic in character (Bruce ), whereby neuropathic pain is defined as ‘pain caused by a lesion or disease of the somatosensory system’ (Jensen ). However, few studies record detailed information on the chronicity or character of pain experienced by patients before breast cancer surgery. This is important as postoperative pain may be a continuation of pre-existing pain rather than an incident adverse event attributable to surgery. Chronic preoperative pain may contribute to central sensitisation from longstanding exposure to nociceptive input (Wilder-Smith ). Preoperative pain may be amplified or accelerated by surgical incision, subsequent tissue injury, pathophysiological responses and local inflammatory processes (Kehlet ; Gerbershagen ). Surgical factors contribute to the genesis of pain: intraoperative nerve damage may contribute to the severity, character and chronicity of postoperative pain. Preservation of the intercostobrachial nerve (ICBN) may be difficult because of anatomical location, traversing the axilla in close relation to the axillary lymph nodes (Loukas ). The relatively new surgical technique of sentinel lymph node biopsy (SLNB) avoids unnecessary axillary dissection in many patients, thereby reducing postoperative arm morbidity (Fleissig ). Acute postoperative pain severity is predicted by emotional distress, particularly anxiety and depression (Johnston, 1986; Johnston and Vögele, 1993; Katz ). Most current literature focuses upon psychological vulnerability factors or absence of vulnerability predicting postoperative outcome, rather than specifically investigating the role of psychological robustness or resilience and whether these could be protective against adverse outcomes. Optimism, considered a personality trait, has been broadly conceptualised as optimists attributing negative events to external factors, whereas pessimists attribute negative events to internal factors and generally considering these as persistent and stable rather than temporary (Peterson ; Meevissen ). Dispositional optimism has been associated with coping strategies relevant to postoperative recovery in patients undergoing coronary artery bypass surgery (Scheier ). The degree to which potentially protective factors such as positive disposition (e.g., positive affect, optimism) and other psychological vulnerability factors (e.g., pain catastrophizing or negative affect) and are associated with acute pain after breast cancer surgery is currently unknown. Recent recommendations call for large-scale prospective studies incorporating repeated longitudinal assessment to investigate predictors of surgical outcomes (Katz, 2011; Kehlet and Dahl, 2011), and improved postoperative pain reporting (Srikandarajah and Gilron, 2011). Empirical determination of antecedent preoperative, intraoperative risk and protective factors for acute postoperative pain will inform our understanding of transitional pathways towards pain chronicity (Katz, 2011). Moreover, it will enhance our understanding of the burden of pain-related adverse events in cancer survivors (Harrington ). This study investigated whether preoperative psychological vulnerability (anxiety, depression, pain catastrophizing, surgical worry) and psychological ‘robustness’ (positive affect, dispositional optimism), pain status and surgical factors were associated with acute pain severity, in the first week after breast and axillary surgery. We hypothesised that psychological distress, adjusted for demographic and clinical factors including intraoperative nerve dissection, would predict higher acute pain severity (pain at rest (PAR); movement-evoked pain), while psychological robustness would be protective against acute pain outcomes after breast and axillary surgery. Furthermore, we hypothesised that chronicity of preoperative pain would be associated with increased severity of acute postoperative pain.

Materials and methods

Design, setting and inclusion eligibility

The Study of Recovery after Breast Surgery (Recovery Study) is an epidemiological, prospective cohort study that recruited women from four breast cancer units, serving a catchment population of 574 027 (females, all ages), across the North of Scotland. Newly diagnosed women aged ⩾18 years, with histologically proven primary invasive or non-invasive breast cancer, requiring surgical excision of their tumour with or without axillary surgery, were eligible for inclusion. Exclusion criteria included: men, women aged <18 years, pregnant women, history of major psychiatric disorder, previous breast or axillary surgery, bilateral surgery, recurrent disease or detectable metastatic disease at the time of initial diagnosis. Surgery was the first line of treatment, therefore other clinical variables relating to adjuvant therapies, chemotherapy and/or radiotherapy are not reported in this manuscript.

Participant recruitment

Recruitment and consent was undertaken following diagnosis at breast clinics and screening centres, or on the hospital ward when patients were admitted before surgery. Clinical or research staff invited patients to participate and provided packs containing an information sheet, consent form and baseline questionnaire. Participants provided signed consent for access to medical records for research purposes. The study was approved by Fife and Forth Valley National Health Service (NHS) Multicentre Research Ethics Committee with local governance approvals obtained from separate regional NHS organisations.

Sample size

We used national breast cancer incidence data to estimate regional annual new diagnoses for Northern Scotland, calculating that 675 women would be eligible for invitation to participate over an 18-month period. The study was powered to detect chronic postsurgical pain at longer-term follow-up: we estimated a pain incidence of 43% at 9 months after surgery (Smith ). We assumed a 60% response rate from 675 women and 70% response rate at 9 months (n=405). A recruited sample of 405 women would provide 80% power to detect a 3.4 unit difference in psychological distress measured using the State Trait Anxiety Inventory (STAI) between those with and without chronic pain, assuming a s.d. of 10 units (Tasmuth ).

Data collection

Questionnaires and data collection tools were modelled on our previous quantitative studies of chronic pain (Smith ; Bruce ; Macdonald ; Powell ). Demographic variables included age, marital status, highest qualification achieved and employment status reported in preoperative questionnaires. Body mass index was calculated from height and weight measured on admission for surgery. Women were allocated to a Scottish Index of Multiple Deprivation quintile using Scottish postcode data (1 most deprived, 5 most affluent).

Preoperative pain

Detailed assessment of the character, location and duration of any pain was undertaken to determine ‘pain history’ before surgery. The International Association for the Study of Pain definition of continuous or intermittent pain lasting for 3 months or longer was used to define chronic preoperative pain (IASP, 1994). Patients reporting any ache, pain, discomfort, altered sensations or numbness in the previous week were asked to provide further information using upper body maps, pain-related symptom grids and the following validated neuropathic pain instruments: Self-completed Leeds Assessment of Neuropathic Symptoms and Signs pain scale (S-LANSS) (Bennett ; Bouhassira and Attal, 2009), and the ‘Douleur Neuropathique 4’ (DN4) questionnaire (Bouhassira ). The S-LANSS and DN4 have been used in epidemiological surveys, whereby scores of ⩾12 and ⩾3, respectively, are indicative of pain with neuropathic characteristics. Self-reported co-morbidity, from a predetermined list of conditions, was categorised as painful or non-painful comorbidity. This list included 15 conditions, of which 10 were considered to be ‘painful’ (e.g., migraine, angina, back problems and so on). We used the Functional Assessment of Cancer Therapy-Breast questionnaire arm subscale to assess preoperative arm morbidity: swelling/tenderness, numbness, painful movement, range of movement and stiffness. Lower scores indicate greater arm morbidity (range 0–20).

Psychological variables

A range of emotional and cognitive variables were measured preoperatively to capture psychological status. Full standardised instruments were used to measure psychological vulnerability (anxiety, depression, catastrophizing and surgical worry); and robustness (positive affect and dispositional optimism). The STAI was used to measure state and trait anxiety, whereby higher scores indicate greater anxiety (range 20–80) (Spielberger ). Depressive thoughts were assessed using the Hospital Anxiety and Depression Scale (HADS) depression subscale, with higher scores indicating poorer mental health (range 0–21) (Zigmond and Snaith, 1983). The 13-item Pain Catastrophizing Scale (PCS) was used to capture pain catastrophizing, defined as an exaggerated negative orientation to aversive stimuli (Pavlin ). Total PCS scores range from 0–52 with higher values indicating greater catastrophizing. Surgical worry was captured using a single item asking patients to rate ‘how worried you are about your operation’ (four-category response) modified from previous studies (Broadbent ; Powell ). The full Positive and Negative Affect Scale (PANAS) was used to capture affect; the timing of the stem question ‘how you generally feel’ was applied, with higher scores indicating greater positive affect (range 10–50) (Watson ). Two indicators of psychological robustness were assessed: the tendency to experience general positive affect was captured using the Positive Affectivity scale of the PANAS (PANAS-PA). Dispositional optimism, defined as generalised outcome expectancies that good things, rather than bad things will happen, was measured using the short version of the Life Orientation Test (LOT) (Scheier and Carver, 1987) (scale range 0–32).

Clinical/surgical variables

Breast surgery was categorised as wide local excision (WLE), mastectomy or mastectomy with immediate reconstruction. Axillary procedures were categorised as SLNB, axillary four node sample (ANS) or axillary node clearance (ANC). Data on tumour grade and status were extracted from medical records. Surgeons were asked to record whether or not the ICBN was identified, and, if identified, whether the nerve was preserved with no apparent damage, preserved with potential damage, the main trunk was divided or some branches divided and others preserved at the time of surgery.

Anaesthetic variables

A pragmatic, open protocol was permitted for anaesthetic regimes. General anaesthesia was induced with propofol and fentanyl or alfentanil with volatile maintenance using isoflurane, sevoflurane or desflurane together with nitrous oxide or air. Intraoperative morphine up to 10 mg intravenous was used for mastectomy or axillary clearance, with bupivacaine infiltration of the breast around the site of skin incision used for WLE’s at the end of surgery. Bupivacaine infiltration was also administered to the axillary wound following ANS or SLNB. Usual analgesia included intravenous paracetamol (1 g) and 10 mg or 30 mg IV ketorolac, dependent upon age and comorbidity. Postoperative analgesia was 1 g paracetamol 6–8 hourly as required.

Outcome variables

After surgery, patients were contacted by telephone on the 7th postoperative day and asked to report PAR and movement-evoked pain (MEP), on average in the first week and in the preceding 24 hours, using a numerical rating scale (NRS) from 0 (no pain) to 10 (worst pain imaginable) (Cleeland and Ryan, 1994). Women were asked about pain on movement rather than a specific movement or activity. Data were collected on number of wounds, presence of drain, which wound was (most) painful, pain severity and analgesic consumption. Pain character was assessed by asking women to select the ‘best’ descriptor for their most painful wound or related-area. Pain descriptors offered included: ache, pain, discomfort, altered sensations or numbness. These descriptors were selected from the literature and from our previous research with women reporting chronic pain after breast cancer surgery (Smith ; Macdonald ; Baron ). Women were asked whether they had taken pain killers during the week since the operation and in the last 24 hours.

Statistical analysis

Descriptive analyses were undertaken on preoperative, surgical and acute pain data. Categorical data were described using frequencies and percentages, continuous data using mean (s.d.) for normally distributed data and median (interquartile range) for skewed data. Cronbach’s alpha was used to measure the internal consistency of psychological subscales. First, univariate analyses were used to investigate associations between preoperative characteristics and acute postoperative pain. Pain at rest and MEP in the first postoperative week were studied using a threshold of ⩾4 on the 0–10 NRS (Peters ; Gärtner ; Srikandarajah and Gilron, 2011). Chi-squared tests (with continuity correction) were used for categorical variables, independent t-tests for normally distributed continuous variables and Mann–Whitney tests for skewed continuous variables. Multiple logistic regression models were then used to determine whether selected preoperative psychological variables (vulnerability: STAI state anxiety, STAI trait anxiety, HADS depression, PCS and surgical worry; robustness: PANAS-PA and LOT) were associated with acute PAR and MEP after adjusting for age and clinical variables (type of breast surgery, type of axillary surgery, ICBN status, preoperative chronic pain). The list of variables to be included in the models was prespecified by the Recovery Study Group. As there was evidence of multicollinearity between the psychological variables, factor analysis was used to reduce these to a smaller number of factors. An approach using principal components with promax rotation was used and the number of included factors decided after consideration of the eigenvalues and the slope of the scree plot. The included factors were then incorporated within the multiple logistic regression models predicting PAR and MEP, controlling for age and the clinical variables.

Results

Response rate

A total of 406 women were recruited from four breast cancer units; of these, 44 women (10.8%) were excluded from the study (preoperative questionnaire completed postoperatively n=26; previous breast cancer surgery n=9; bilateral breast procedure n=4, major psychiatric disorder n=2; other n=3). Preoperative data were available for 362 women. Acute pain data were obtained from 341 (94%), but three women were excluded from the acute pain analyses as their data were collected more than 30 days after surgery (Figure 1). The study population with complete data therefore comprises 338 women. Median (IQR) time from completion of baseline questionnaire to surgery was 1 day (1–4 days); 90% of women underwent surgery within 2 weeks of completion of baseline questionnaire. Median (IQR) time from surgery to the acute pain assessment was 8 (7–10) days. Preoperative demographic, surgical and psychological characteristics for the full sample are presented in Table 1.
Figure 1

Flow chart of recruited participants.

Table 1

Preoperative demographic, surgical and psychological characteristics (Eligible N=362)

Age, years, mean (s.d.) [N]59.1 (10.8) [356]
BMI, Mean (s.d.) [N]28.0 (5.9) [350]
Married, N (%)241/362 (66.6)
  
Highest educational level N (%)
 School only109 (30.3)
 Work or college qualification180 (50.0)
 Degree qualification71 (19.7)
 Missing2
  
Deprivation score quintile (SIMD) N (%)
 1 (most deprived)17 (4.7)
 235 (9.7)
 365 (18.0)
 4145 (40.1)
 5 (most affluent)100 (27.6)
  
Breast surgery N (%)
 WLE228 (63.9)
 Mastectomy92 (25.8)
 Mastectomy with reconstruction15 (4.2)
 Missing5
  
Axillary surgery N (%)
 SLNB146 (42.1)
 ANS94 (26.0)
 ANC107 (29.6)
 Missing15
  
ICBN status N (%)
 Not identified96 (27.4)
 Preserved144 (41.1)
 Divided/damaged110 (31.4)
 Missing12
  
Cancer status N (%)
 Invasive342 (95)
 Non-invasive17 (5)
  
Arm morbidity
 FACT-B arm subscale, median (IQR) [N]20 (20–20) [361]
  
Psychological  
 STAI state, median (IQR) [N] {Cronbach α}40 (30–50) [347] {0.86}
 STAI trait, median (IQR) [N] {Cronbach α}32.5 (26–42) [350] {0.94}
 HADS anxiety, median (IQR) [N] {Cronbach α}7 (3–10) [360] {0.89}
 HADS depression, median (IQR) [N] {Cronbach α}1.5 (0–4) [360] {0.85}
 PANAS positive, mean (s.d.) [N] {Cronbach α}30.5 (4.9) [355] {0.76}
 PANAS negative, mean (s.d.) [N] {Cronbach α}23.0 (4.5) [355] {0.64}
 PCS total score, mean (s.d.) [N] {Cronbach α}11.0 (9.2) [349] {0.94}
 LOT, median (IQR) [N] {Cronbach α}24 (16–32) [345] {0.51}
  
Surgical worry N (%)
 Not at all/a little221 (61.7)
 Quite a bit/very much137 (38.3)
 Missing4
  
Any painful comorbidity N (%)
 Yes231 (63.8)
 No131 (36.2)
  
Chronic pain (>3 months) before surgeryaN (%)
 Yes56 (15.6)
 No303 (84.4)
 Missing3
  
Preoperative neuropathic pain b
 DN4, mean (s.d.) [N]1.32 (1.5) [134]
 S-LANSS, mean (s.d.) [N]5.30 (5.5) [148]

Abbreviations: ANC=axillary node clearance; ANS=axillary node sample; BMI=body mass index; DN4=Douleur Neuropathique 4; FACT=Functional Assessment of Cancer Therapy; HADS=Hospital Anxiety and Depression Scale; IQR=interquartile range; LOT=Life Orientation Test; PANAS=Positive and Negative Affect Scale; PCS=Pain Catastrophizing Scale; SIMD=Scottish Index of Multiple Deprivation; S-LANSS=Self-completed Leeds Assessment of Neuropathic Symptoms and Signs; SLNB=sentinel lymph node biopsy; STAI=State Trait Anxiety Inventory; WLE=wide local excision.

Chronic pain in the upper body persisting for more than 3 months before surgery.

In women with ache, pain, discomfort, altered sensations or numbness in the upper body in the previous week.

Sample characteristics

Mean age was 59.1 years (s.d. 10.8); most women were married (241/362, 67%) or widowed (45/362, 12%). Almost half of the sample were retired (162/362, 45%) with most of the remainder working full-time, part-time or being self-employed (160/362, 44%). A high proportion of women had completed work-related (64/360, 18%), college (116/360, 32%) or degree, qualifications (71/360, 20%).

Preoperative pain character

Overall, 151/359 (42%) women reported ache, pain, discomfort, altered sensations or numbness in the upper body in the week before surgery; of these only 56/359 women (16%) fulfilled the definition of chronic preoperative pain, with painful symptoms in the upper body persisting for 3 months or more before surgery. Neuropathic pain scores were obtained for those reporting any preoperative pain (including ache, discomfort, altered sensations, numbness) in the upper body (n=151): mean DN4 scores were 1.32 (s.d. 1.5; n=134); mean S-LANSS scores were 5.30 (s.d. 5.5; n=148) (Table 1). The overall proportion of women categorised as having preoperative pain of predominantly neuropathic origin was low: 27/359 (8%) were DN4-positive and 22/359 (6%) were S-LANSS-positive.

Surgical variables

Overall, 228/357 women underwent WLE (64%), 92 (26%) underwent mastectomy, with 15 (4%) women undergoing mastectomy with concurrent reconstructive surgery. The most frequently performed axillary procedure was SLNB (146/347, 42%) followed by ANC (107/347, 31%) and ANS (94/347, 28%). Most tumours were invasive breast cancers (342/359, 95%) rather than non-invasive (in situ cancer) (17/359, 5%), with tumour grade 1 (45/359, 13%), 2 (183, 51%) or 3 (131 37%) and with axillary node status graded as negative (243/356, 68%) or positive (113/356; 32%). Complete data on ICBN handling was obtained for 350/362 women (97%); the ICBN was divided or damaged in 110/351(31%).

Acute postoperative pain

In the first postoperative week, 308/336 (94%) women reported any PAR (NRS⩾1). Mean (s.d.) pain scores at rest in the first postoperative week were: PAR 3.18 (2.13) (N=336) and MEP 3.83 (2.32) (N=335). On the 7th postoperative day, mean (s.d.) scores for PAR were 2.76 (2.10) (N=336) and 3.33 (2.24) for MEP (N=336). Moderate to severe PAR (⩾4 on 0–10 NRS) was reported by 137/336 (40.8%) women, with 169/335 (50.4%) reporting moderate to severe MEP during the first postoperative week. On the day of assessment, 182/336 (54.2%) had taken analgesics in the previous 24 h.

Postoperative pain descriptor and location

The most commonly reported pain-related descriptor in the first week after surgery was ‘discomfort’ (141/338; 42%), followed by ‘altered sensations’ (85/338; 25%), ‘pain’ (85/338; 25%) and ‘numbness’ (83/338; 25%). Only 27/338 (8%) women chose ‘ache’ and 31/338 (9%) women did not choose any descriptor. Women were less likely to experience altered sensations or numbness after SLNB compared with ANS or ANC surgery (Table 2). The likelihood of experiencing postoperative numbness and altered sensation increased with the extent of axillary surgery: sentinel biopsy (50/137, 36%), axillary sampling (36/88, 41%), axillary clearance (51/103, 50%) (P=0.045, χ2 test for trend).
Table 2

Pain severity and character 1 week after breast cancer surgery (n/N (%))

  WLE
Mastectomy
  SLNB ANS ANC SLNB ANS ANC
Any pain? >1a102/107 (95)69/70 (99)40/40 (100)27/28 (96)16/17 (94)59/62 (95)
⩾4 PARa36/107 (34)33/70 (47)17/40 (43)10/28 (36)8/17 (47)29/62 (47)
⩾4 MEPa47/107 (44)33/70 (47)23/39 (59)15/28 (54)8/17 (47)38/62 (61)
Altered sensations or numbness39/107 (36)25/71 (35)25/41 (61)11/28 (39)11/17 (65)26/62 (42)

Abbreviations: ANC=axillary node clearance; ANS=axillary node sample; MEP=movement-evoked pain; PAR=pain at rest; SLNB=sentinel lymph node biopsy; WLE=wide local excision.

NRS 0–10.

Preoperative predictors of moderate to severe acute postoperative pain

Univariate analyses examined whether preoperative and perioperative factors were associated with moderate to severe PAR and MEP in the first postoperative week, using a threshold of ⩾4 on the 0–10 NRS (Table 3). Greater preoperative arm morbidity, higher levels of state and trait anxiety, depression, lower optimism and greater surgical worry were associated with moderate to severe (⩾4 on 0–10 NRS) acute postoperative PAR and MEP in the first postoperative week. There was evidence that higher preoperative pain catastrophizing scores were associated with moderate to severe PAR (Mann–Whitney P=0.03); although this was only of borderline significance for pain on movement (P=0.08). Preoperative chronic pain was a statistically significant predictor of both PAR and MEP (Table 3). A significantly lower proportion of women with ICBN preservation reported moderate to severe acute postoperative MEP (P=0.004). Two logistic regression models were then used to investigate which factors were associated with PAR and MEP ⩾4 in the first postoperative week (results not shown). There was no evidence that any of the psychological variables were associated with either MEP or PAR in these multivariate analyses, but there was a strong suggestion of multicollinearity between these variables: this can cause inflated s.e. and therefore wider than expected confidence intervals.
Table 3

Univariate analyses: factors associated with clinically meaningful pain (⩾4 on 0–10 NRS) 1 week in first week after breast cancer surgery: PAR and MEP

  PAR in first postoperative week
MEP in first postoperative week
 No (Elig N=199)Yes (Elig N=137) No (Elig N=166)Yes (Elig N=169) 
Factor Mean (s.d.) [ N ] Mean (s.d.) [ N ] P -value ( t -test) Mean (s.d.) [ N ] Mean (s.d.) [ N ] P -value ( t -test)
Age59.4 (10.4) [194]59.1 (11.2) [136]0.3159.5 (10.5) [161]59.1 (11.0) [168]0.73
       
 N (%)N (%)P-value (χ2 test)N (%)N (%)P-value (χ2 test)
Type of breast surgery
 WLE139 (61.2)88 (38.3)0.44120 (53.1)106 (46.9)0.11
 Mastectomy60 (56.1)47 (43.9) 46 (43.0)61 (57.0) 
 Missing02 02 
       
Type of axillary surgery
 ANC56 (54.9)46 (45.1)0.1340 (39.6)61 (60.4)0.08
 ANS46 (52.9)41 (47.1) 46 (52.9)41 (47.1) 
 SLNB89 (65.0)48 (34.3) 73 (53.3)64 (46.7) 
 Missing82 73 
       
ICBN status
 Not identified50 (56.2)39 (43.8)0.0937 (41.6)52 (58.4)0.004
 Preserved89 (65.0)48 (35.0) 82 (59.9)55 (40.1) 
 Divided/damaged52 (51.0)50 (49.0) 41 (40.6)60 (59.4) 
 Missing80 62 
       
 Median (IQR) [N]Median (IQR) [N]P-value (Mann–Whitney)Median (IQR) [N]Median (IQR) [N]P-value (Mann–Whitney)
FACT-B+4
 Baseline arm morbidity subscale20 (20–20) [198]20 (20–20) [137]0.0220 (20–20) [165]20 (20–20) [169]0.01
       
HADS
 Baseline depression1 (0–3) [198]2.5 (1–5) [136]<0.0011 (0–3) [165]2 (0.25–5) [168]0.003
       
STAI
 Baseline-state anxiety40 (30–46.7) [191]43.3 (33.3–53.3) [130]0.00340 (30–46.7) [158]43.3 (33.3–50.8) [162]0.02
 Baseline trait anxiety30 (25–38) [191]34.7 (29–44.5) [133]<0.00130 (25–38.2) [158]34 (28–44.5) [165]0.003
       
LOT       
 Baseline24 (20–32) [188]20 (16–28) [132]0.00224 (20–32) [156]20 (16–28) [163]0.03
       
Pain catastrophizing score (PCS)
 Baseline total score8 (3–14) [191]9 (5–18) [133]0.038 (3.25–14) [160]9 (5–18) [163]0.08
       
  Mean (s.d.) [ N ] Mean (s.d.) [ N ] P -value ( t -test) Mean (s.d.) [ N ] Mean (s.d.) [ N ] P -value ( t -test)
PANAS
 Baseline positive affect30.8 (4.7) [194]30.2 (5.2) [135]0.2630.9 (4.6) [161]30.3 (5.2) [167]0.28
       
 N (%)N (%)P-value (χ2 test)N (%)N (%)P-value (χ2 test)
Worry about operation
 Not at all/a little133 (63.6)76 (36.4)0.04112 (53.8)96 (46.2)0.04
 Quite a bit/very much63 (51.2)60 (48.8) 51 (41.5)72 (58.5) 
 Missing31 31 
       
Preoperative chronic pain a
 Yes22 (43.1)29 (56.9)0.0212 (23.5)39 (76.5)<0.001
 No175 (62.1)107 (37.9) 151 (53.7)130 (46.3) 
 Not known21 30 
       
Any painful comorbidity
 Yes118 (55.1)96 (44.9)0.0697 (45.3)117 (54.7)0.05
 No81 (66.4)41 (33.6) 69 (57.0)52 (43.0) 
       
 N (%)N (%)P-value (χ2 test)N (%)N (%)P-value (χ2 test)
Preoperative neuropathic pain (NeuP) in previous week
 DN4 ⩽3
  Non-NeuP52 (54.7)43 (45.3)0.2133 (34.7)62 (65.3)0.61
 DN4⩾3
  NeuP characteristics10 (38.5)16 (61.5) 7 (26.9)19 (73.1) 
  No painb13778 12688 

Abbreviations: ANC=axillary node clearance; ANS=axillary node sample; DN4=Douleur Neuropathique 4; FACT=Functional Assessment of Cancer Therapy; HADS=Hospital Anxiety and Depression Scale; ICBN=intercostobrachial nerve; IQR=interquartile range; LOT=Life Orientation Test; PCS=Pain Catastrophizing Scale; MEP=movement-evoked pain; NRS=numerical rating scale; PANAS=Positive and Negative Affect Scale; PAR=pain at rest; SLNB=sentinel lymph node biopsy; STAI=State Trait Anxiety Inventory; WLE=wide local excision.

In upper body.

Reported no preoperative pain in previous week.

Factor analysis was used to reduce the psychological variables to a smaller number of factors (Table 4). The first derived component had an eigenvalue of 3.52 and was particularly associated with higher values of PANAS-PA and LOT optimism, also with lower values of STAI trait anxiety and HADS depression. The second component had an eigenvalue of 1.06 and appeared to be more related to current worry (e.g., worry about the operation) but given the relatively low eigenvalue of the second component and the slope of the scree plot, only the first component was selected for the multivariate analysis. This component was labelled ‘psychological robustness’, as it would appear to fit within the broader dimension of resources that characterise psychological positivism; thus combining a ‘habitual style of anticipating favourable outcomes’ (Scheier and Carver, 1987) and reflective of ‘energy, excitement and enthusiasm’ (Watson and Pennebaker, 1989). This component, representing dispositional optimism and ‘psychological robustness’, was then entered into the two logistic regression models predicting PAR and MEP adjusting for age and clinical variables (Table 5). There was strong evidence that preoperative psychological robustness was associated with reduced likelihood of both PAR (OR: 0.63, 95% CI: 0.48–0.82) and MEP (OR: 0.71, 95% CI: 0.54–0.93) in the first week after surgery. Compared with SLNB, patients undergoing axillary node sampling (OR: 2.17, 95% CI: 1.15–4.08) and nodal clearance (OR: 3.45, 95% CI 1.45–8.46) were significantly more likely to experience moderate to severe PAR and MEP in the first postoperative week. Using a 3-category classification for ICBN handling, significantly lower odds of moderate to severe MEP after breast cancer surgery was observed after intraoperative nerve division or damage.
Table 4

Results of factor analysis using principal components with promax rotation (N=299)

  Component 1
Eigenvalue3.52
  
Correlations
 STAI-state anxiety0.17
 STAI trait anxiety0.63
 HADS depression0.64
 Total PCS−0.14
 PANAS: positive affect−0.97
 Dispositional optimism (LOT)−0.73
 Surgical worry (four category variable)−0.12

Abbreviations: HADS=Hospital Anxiety and Depression Scale; PCS=Pain Catastrophizing Scale; PANAS=Positive and Negative Affect Scale; LOT=Life Orientation Test; STAI=State Trait Anxiety Inventory.

Component 1 reversed for analyses and labelled ‘psychological robustness’.

Table 5

Multiple logistic regression models predicting PAR (⩾4 on 0–10 NRS) and MEP 1 week after breast cancer surgery in first postoperative week

  PAR ( N =275)
MEP ( N =274)
  Odds ratio (95% CI) P -value Odds ratio (95% CI) P -value
Age1.01 (0.98, 1.03)0.581.01 (0.98, 1.03)0.56
     
Type of breast surgery
 WLE10.3710.59
 Mastectomy1.31 (0.73, 2.35) 1.18 (0.65, 2.16) 
     
Type of axillary surgery
 SLNB10.0410.03
 ANS2.17 (1.15, 4.08) 1.30 (0.69, 2.46) 
 ANC2.02 (0.84, 4.84) 3.45 (1.41, 8.46) 
     
ICBN status
 Not identified10.2410.005
 Preserved0.58 (0.30, 1.12) 0.35 (0.18, 0.68) 
 Divided/damaged0.78 (0.31, 2.00) 0.31 (0.12, 0.80) 
     
Preoperative chronic pain
 No10.2610.004
 Yes1.48 (0.75, 2.95) 3.18 (1.45, 6.99) 
     
Component 1: ‘psychological robustness’0.63 (0.48, 0.82)0.0010.71 (0.54, 0.93)0.01

Abbreviations: ANC=axillary node clearance; ANS=axillary node sample; ICBN=intercostobrachial nerve; MEP=movement-evoked pain; NRS=numerical rating scale; PAR=pain at rest; SLNB=sentinel lymph node biopsy; WLE=wide local excision.

Discussion

We have used an epidemiological study design to identify preoperative demographic, psychological, pain-related and surgical risk factors for moderate to severe acute postoperative pain after surgery for breast cancer. Chronic preoperative pain, type of axillary surgery and psychological ‘robustness’, specifically dispositional optimism and positive affect were statistically significant independent predictors of acute postoperative pain severity in the first week after breast and axillary surgery. There was no evidence of a relationship between age or type of breast surgery and acute pain outcomes. Interestingly, we observed a significantly reduced risk of moderate to severe PAR and MEP after nerve preservation or intraoperative nerve division/damage. Overall, 41% (137/336) and 50% (169/335) of women reported moderate to severe PAR and MEP, respectively, on the 7th postoperative day after breast cancer surgery. Despite advances in perioperative anaesthesia and analgesia, studies suggest that fewer than half of patients receive adequate pain relief after surgery (Rawal and Allvin, 1998). Our NRS cutoff of ⩾4 to indicate clinically relevant moderate to severe pain is comparable with other literature of breast surgery and other surgical procedures (Peters ; Aasvang ; Gärtner ). Pain scores of ⩾4 have been empirically demonstrated to affect general activity, mood and postoperative mobility after surgery, and are considered clinically important for treatment (Peters ). We hypothesised that increased psychological robustness and greater psychological vulnerability would predict acute pain severity. Although univariate analysis revealed significant associations between all distress-related variables and increased severity of acute pain, these were not statistically significant after adjustment for other variables. Nevertheless, this may be a result of collinearity between the variables. Our derived composite variable, incorporating dispositional optimism and positive affect, was protective against acute postoperative pain. Optimism has been positively associated with a range of health outcomes, including symptom report and other recovery measures after surgery (Scheier and Carver, 1987; Peters ). In a heterogeneous sample of surgical patients, not including those with breast cancer, higher levels of dispositional optimism before surgery preoperatively predicted better mental health and vitality at 12-month follow-up (Peters ). However, the previous literature mostly focuses upon vulnerability or absence of vulnerability predicting postoperative outcome, rather than specifically investigating the role of psychological robustness. For example, negative affectivity has been found to predict self-reported symptoms in a range of health conditions (Watson and Pennebaker, 1989). Watson and Pennebaker propose that those who are high in negative affectivity are more vigilant of symptoms, thus are more likely to be aware of body sensations such as pain. This is supported by literature arguing that psychological variables can be considered constituent components of negative affectivity. For example, pain may seem less severe to those who are relaxed compared with those who are anxious (Rainville ). However, other mechanisms of effect are possible: anxiety or pain catastrophising may affect behaviours that could influence recovery, as per fear avoidance theories of chronic pain (Leeuw ). One early surgical study found that dispositional optimism was associated with the coping strategies of making plans and setting goals relevant to postoperative recovery by patients before undergoing coronary artery bypass surgery (Scheier ). There is good evidence that psychological preparation for surgery, addressing preoperative emotions and cognitions, improves a range of recovery-related outcomes, including postoperative pain, suggesting there are opportunities for intervention before surgery for breast cancer (Johnston and Vögele, 1993; Powell ). We also examined whether the presence of chronic preoperative pain predicted the severity of acute postoperative pain. There was strong evidence for this, independent of preoperative psychological status and intraoperative nerve dissection: women with chronic preoperative pain were more than three times more likely to report stimulus-dependent MEP (OR 3.19; 95% CI 1.47–6.92). We prospectively assessed prior pain experience before surgery, distinguishing between chronic and non-chronic painful symptoms, to exclude pain associated with preoperative investigations, e.g., diagnostic core biopsy. The mechanisms for pain predicting pain are unclear, although likely to be due to neuroplasticity from sustained alterations to central nervous function, e.g., central neuroplasticity has been demonstrated in patients with chronic low back pain before spinal surgery (Wilder-Smith ). The presence of preoperative pain and comorbidities are associated with increased risk of acute and chronic pain, although evidence for chronic postsurgical pain is predominantly from studies of stump and phantom pain after amputation surgery and from musculoskeletal conditions rather than breast cancer surgery (Wilder-Smith ). A Danish national cross-sectional study reported increased risk of chronic pain after breast cancer surgery in those reporting low back pain and headache, although findings were based upon patient recall of preoperative morbidity from 2 years previously (Gärtner ). With regards to surgical variables, axillary sampling and clearance were associated with significantly higher rates of pain in the first week after surgery compared with sentinel node biopsy. Our study included the migration from the four node sampling technique to SLNB, thus provided the opportunity to identify variation in outcome reporting by different axillary surgical techniques. However, It is worth noting that the four node sample technique is now of historical interest (Goldhirsch ), although may still be routine in centres with limited access to nuclear medicine. We found an unexpected decrease in the odds of moderate to severe acute postoperative pain after both ICBN preservation or nerve damage or division. This may relate to reporting differences, whereby some surgeons reported ‘nerve not identified’ during WLE and others reported ‘nerve preserved’. However, it may be clinically plausible that patients experience postoperative numbness rather than intense pain immediately after nerve division. The likelihood of experiencing postoperative neuropathic-type characteristics of numbness and altered sensations increased by extent of axillary surgery: sentinel biopsy (37%), axillary sampling (41%) vs axillary clearance (50%) (P<0.05). Whether immediate numbness and altered sensations predict long-term pain outcome will be determined from long-term follow-up of our sample; numbness and paraesthesia in the first postoperative week may mask or dampen painful symptoms in the acute and subacute recovery period. We also cannot exclude the possibility that intensive analgesia during hospitalisation contributes to the response to pain during the first postoperative week. The pathway to pain chronicity is often conceptualised as linear, yet it is plausible that differences in pain descriptors at various recovery time points may reflect distinct underlying pathophysiological mechanisms. In addition to duration of preoperative pain, our data are novel with respect to exploring pain character before and immediately after breast and axillary surgery. We found no relationship between preoperative neuropathic pain and severity of postoperative pain, although the overall prevalence of neuropathic characteristics before surgery was low (6–7%). Reassuringly, prevalence in our sample is comparable with national epidemiological surveys screening for neuropathic pain (Attal ). Pain is a subjective, patient-reported outcome. We accepted self-report of neuropathic characteristics without clinical examination, laboratory-based electrophysiological testing or brain imaging (e.g. microneurography or functional magnetic resonance imaging. Although these detailed investigations have been recently endorsed within international guidelines for the assessment of neuropathic pain (Haanpää ), these methods are largely incompatible with epidemiological, population-based studies. Postoperatively, we enquired about the most painful wound or area, assuming this would correspond to the most troublesome or bothersome pain. Rather than using a pain character questionnaire, we offered women a choice of verbal pain descriptors. Most women were encouraged to select a single ‘best’ descriptor for their pain, but due to differences in data collection, some assessors allowed women to select more than one descriptor. At the time of patient recruitment, there were no published neuropathic screening instruments suitable for administration by telephone, nor had any instruments been validated for the immediate postoperative period. However, our selection of pain descriptors was empirically driven, with terms extracted from our previous quantitative studies and qualitative transcripts from interviews with women reporting persistent postsurgical pain 9–12 years after mastectomy (Macdonald ). Until recently, diagnosis of neuropathic pain was based upon deficits identified from sensory examination although recent research has demonstrated good discriminant ability using pain descriptors, including numbness. Consequently, clinical examination may not be mandatory for the diagnosis of neuropathic pain (Bouhassira ).

Methodological strengths

This is the first prospective study to identify the role of preoperative psychological, clinical and pain-related predictors of acute postoperative pain after breast and axillary surgery. Our sample was large enough to permit multiple comparisons of putative predictors. The methodological strengths include geographical coverage, whereby patients were recruited from a diverse population from urban, rural and remote-rural locations across Northern Scotland. The sociodemographic distribution of our sample reflected the UK breast cancer incidence data, with a higher age-standardised incidence observed among those with the least socioeconomic deprivation (Shack ). This study complies with current demands for larger postsurgical studies with detailed preoperative data collection and comprehensive assessment of pain history (location, character, duration, comorbidity), psychological and physical health before surgery (Kehlet and Rathmell, 2010; Katz, 2011). Few surgical epidemiology studies have attempted to record and adjust for intraoperative nerve handling. Surgeons contributed to the design of ICBN data collection forms, which may account for the high return rate of intraoperative nerve data (97%). Additionally, the precise classification of axillary procedures distinguishes between contemporaneous techniques of sentinel node biopsy, axillary sampling and axillary clearance; other studies of pain outcomes have grouped the different surgical procedures that patients undergo to their axilla together, have used binary comparisons or have excluded axillary procedures completely (Steegers ; Fecho ; Gärtner ).

Limitations

We allowed an open, pragmatic approach to anaesthesia and perioperative analgesia and did not systematically adjust for prevention or treatment modalities, which may impact upon pain reporting. However, an open policy approach has been followed by many other epidemiological and clinical studies of acute and chronic postoperative pain (Peters ). The majority of our admissions were short-stay (<48 h), limiting our ability to prospectively track analgesic consumption and pain relief from medication. However, a recent review highlighted that demographic, surgical and psychological factors, rather than anaesthesiology variables, are important for prediction of acute pain severity (Ip ). Pain intensity in the initial hours and days whilst hospitalised is masked by analgesic use, thus it has been argued that later acute pain scores are more reflective of overall acute postoperative pain (Gottschalk and Ochroch, 2008). Hence, our selection of day 7 pain outcomes: severe acute pain on postoperative days 4 (Peters ), 6 and 7 (Gottschalk and Ochroch, 2008), has been found to predict CPSP.

Conclusions

The Recovery study has generated important data on the clinical and psychological predictors of acute postoperative pain after surgery for breast cancer and has identified potentially modifiable factors that may respond to preoperative intervention. We found strong evidence for surgically induced moderate to severe acute postoperative pain in women with chronic preoperative pain and those having more invasive axillary procedures, and conversely, those who had high levels of dispositional optimism and positive affect were less likely to report postoperative pain. Identification of those most at risk of acute and persistent postoperative complications is important for management and also supporting long-term recovery in these cancer survivors (Ganz ). Clinicians and healthcare professionals should, therefore, be aware of increased risk of poor outcome in those with a history of chronic pain. There is potential for evaluation of brief preoperative cognitive behaviour interventions, such as cognitive reframing or other psychological coping techniques, targeted at enhancing positive outlook and expectations before undergoing surgery for breast cancer. Women should be instructed on the importance of pain management, with further exploration to identify whether postoperative analgesic needs are being met. We aim to follow-up of our patient cohort to monitor chronic pain-related outcomes and recovery trajectory after surgery for breast cancer.
  53 in total

1.  Preoperative chronic pain in radical prostatectomy patients: preliminary evidence for enhanced susceptibility to surgically induced pain.

Authors:  Hans J Gerbershagen; Oguzhan Dagtekin; Jan Gaertner; Frank Petzke; Axel Heidenreich; Rainer Sabatowski; Enver Ozgür
Journal:  Eur J Anaesthesiol       Date:  2010-05       Impact factor: 4.330

2.  Assessment of postoperative pain--need for action!

Authors:  Henrik Kehlet; Jørgen B Dahl
Journal:  Pain       Date:  2011-03-24       Impact factor: 6.961

3.  Health complaints, stress, and distress: exploring the central role of negative affectivity.

Authors:  D Watson; J W Pennebaker
Journal:  Psychol Rev       Date:  1989-04       Impact factor: 8.934

4.  Pre-operative emotional states and post-operative recovery.

Authors:  M Johnston
Journal:  Adv Psychosom Med       Date:  1986

5.  Pain-related emotions modulate experimental pain perception and autonomic responses.

Authors:  Pierre Rainville; Quoc Viet Huynh Bao; Pablo Chrétien
Journal:  Pain       Date:  2005-11-14       Impact factor: 6.961

6.  Post-operative arm morbidity and quality of life. Results of the ALMANAC randomised trial comparing sentinel node biopsy with standard axillary treatment in the management of patients with early breast cancer.

Authors:  Anne Fleissig; Lesley J Fallowfield; Carolyn I Langridge; Leigh Johnson; Robert G Newcombe; J Michael Dixon; Mark Kissin; Robert E Mansel
Journal:  Breast Cancer Res Treat       Date:  2005-09-15       Impact factor: 4.872

Review 7.  Meeting highlights: updated international expert consensus on the primary therapy of early breast cancer.

Authors:  Aron Goldhirsch; William C Wood; Richard D Gelber; Alan S Coates; Beat Thürlimann; Hans-Jörg Senn
Journal:  J Clin Oncol       Date:  2003-07-07       Impact factor: 44.544

Review 8.  Pain assessment: global use of the Brief Pain Inventory.

Authors:  C S Cleeland; K M Ryan
Journal:  Ann Acad Med Singapore       Date:  1994-03       Impact factor: 2.473

9.  Chronic pain and other sequelae in long-term breast cancer survivors: nationwide survey in Denmark.

Authors:  V Peuckmann; O Ekholm; N K Rasmussen; M Groenvold; P Christiansen; S Møller; J Eriksen; P Sjøgren
Journal:  Eur J Pain       Date:  2008-07-16       Impact factor: 3.931

Review 10.  Psychological preparation and postoperative outcomes for adults undergoing surgery under general anaesthesia.

Authors:  Rachael Powell; Neil W Scott; Anne Manyande; Julie Bruce; Claus Vögele; Lucie M T Byrne-Davis; Mary Unsworth; Christian Osmer; Marie Johnston
Journal:  Cochrane Database Syst Rev       Date:  2016-05-26
View more
  29 in total

Review 1.  Breast cancer and chronic pain: a mixed methods review.

Authors:  Lorraine R Feeney; Shona M Tormey; Dominic C Harmon
Journal:  Ir J Med Sci       Date:  2018-02-05       Impact factor: 1.568

2.  Pain in cancer survivors.

Authors:  Matthew Rd Brown; Juan D Ramirez; Paul Farquhar-Smith
Journal:  Br J Pain       Date:  2014-11

Review 3.  [Management of patients with chronic pain in acute and perioperative medicine : An interdisciplinary challenge].

Authors:  J Erlenwein; M Pfingsten; M Hüppe; D Seeger; A Kästner; R Graner; F Petzke
Journal:  Anaesthesist       Date:  2020-02       Impact factor: 1.041

4.  Preoperative Psychosocial and Psychophysical Phenotypes as Predictors of Acute Pain Outcomes After Breast Surgery.

Authors:  Kristin L Schreiber; Nantthasorn Zinboonyahgoon; Xinling Xu; Tara Spivey; Tari King; Laura Dominici; Ann Partridge; Mehra Golshan; Gary Strichartz; Rob R Edwards
Journal:  J Pain       Date:  2018-11-23       Impact factor: 5.820

5.  Preoperative Patient Expectations of Postoperative Pain Are Associated with Moderate to Severe Acute Pain After VATS.

Authors:  Emine Ozgur Bayman; Kalpaj R Parekh; John Keech; Nyle Larson; Mark Vander Weg; Timothy J Brennan
Journal:  Pain Med       Date:  2019-03-01       Impact factor: 3.750

6.  Religion, spirituality, and physical health in cancer patients: A meta-analysis.

Authors:  Heather S L Jim; James E Pustejovsky; Crystal L Park; Suzanne C Danhauer; Allen C Sherman; George Fitchett; Thomas V Merluzzi; Alexis R Munoz; Login George; Mallory A Snyder; John M Salsman
Journal:  Cancer       Date:  2015-08-10       Impact factor: 6.860

7.  Do Eligibility Criteria for Ductal Carcinoma In Situ (DCIS) Active Surveillance Trials Identify Patients at Low Risk for Upgrade to Invasive Carcinoma?

Authors:  Tawakalitu O Oseni; Barbara L Smith; Constance D Lehman; Charmi A Vijapura; Niveditha Pinnamaneni; Manisha Bahl
Journal:  Ann Surg Oncol       Date:  2020-05-16       Impact factor: 5.344

Review 8.  Persistent Post-Mastectomy Pain: Risk Factors and Current Approaches to Treatment.

Authors:  Raymond C Tait; Kim Zoberi; McKenzie Ferguson; Kimberly Levenhagen; Rebecca A Luebbert; Kevin Rowland; Gretchen B Salsich; Christopher Herndon
Journal:  J Pain       Date:  2018-06-30       Impact factor: 5.820

9.  Persistent breast pain 5 years after treatment of invasive breast cancer is largely unexplained by factors associated with treatment.

Authors:  Robin J Bell; Penelope J Robinson; Fathima Nazeem; Mary Panjari; Pamela Fradkin; Max Schwarz; Susan R Davis
Journal:  J Cancer Surviv       Date:  2013-08-23       Impact factor: 4.442

Review 10.  Psychological preparation and postoperative outcomes for adults undergoing surgery under general anaesthesia.

Authors:  Rachael Powell; Neil W Scott; Anne Manyande; Julie Bruce; Claus Vögele; Lucie M T Byrne-Davis; Mary Unsworth; Christian Osmer; Marie Johnston
Journal:  Cochrane Database Syst Rev       Date:  2016-05-26
View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.