Reported Outcomes in Interdisciplinary Pain Treatment: An Overview of Systematic Reviews and Meta-Analyses of Randomised Controlled Trials.

Background: There is considerable diversity of outcome selections and methodologies for handling the multiple outcomes across all systematic reviews (SRs) of Interdisciplinary Pain Treatment (IPT) due to the complexity. This diversity presents difficulties for healthcare decision makers. Better recommendations about how to select outcomes in SRs (with or without meta-analysis) are needed to explicitly demonstrate the effectiveness of IPT. Objective: This overview systematically collates the reported outcomes and measurements of IPT across published SRs and identifies the methodological characteristics. Additionally, we provide some suggestions on framing the selection of outcomes and on conducting SRs of IPT.
Methods: Three electronic databases (PubMed, Cochrane Library, and Epistemonikos) and the PROSPERO registry for ongoing SR were supplemented with hand-searching ending on 30 September 2021.
Results: We included 18 SRs with data on 49007 people from 356 primary randomised controlled trials (RCTs); eight were followed by meta-analysis and ten used narrative syntheses of data. For all the SRs, pain was the most common reported outcome (72%), followed by disability/functional status (61%) and working status (61%). Psychological well-being and quality of life were also reported in half of the included SR (50%). The core outcome domains according to VAPAIN, IMMPACT, and PROMIS were seldom met. The methodological quality varied from critically low to moderate according to AMSTAR2. The AMSTAR2 rating was negatively correlated to the number of outcome domains in PROMIS, and VAPAIN was positively correlated with IMMPACT and PROMIS, indicating the intercorrelations between the reported outcomes.
Conclusion: This systematic overview showed wide-ranging disparity in reported outcomes and applied outcome domains in SRs evaluating IPT interventions for chronic pain conditions. The intercorrelations between the reported outcomes should be appropriately handled in future research. Some approaches are discussed as well.

Introduction

Description of the Patient Populations

According to the International Association for the Study of Pain (IASP), chronic pain is pain that persists or recurs for more than 3 months.1 Significant emotional distress and/or functional disability are well-known characteristics of chronic pain. The prevalence of chronic non-cancer pain is estimated to be between 8.7% and 64.4% across diverse populations around the world, depending on the assessments method used.2 In Europe, about 19% adults suffer from chronic pain conditions with moderate-severe pain intensity.3 In the US, about 8% of adults have chronic pain that cause limitations in normal life activities such as work, social, recreational, and self-care activities.4 When assessing the patient with chronic pain, it is important to determine the activated pain mechanisms, ie, if the pain is nociceptive (injury to non-neural tissues producing noxious stimulus), neuropathic (injury to the somatosensory nervous system), nociplastic (altered nociception despite no clear evidence of tissue damage) or combinations of these.5 Such characterisations are important steps towards mechanism-based management and treatments of chronic pain conditions.

Description of Interdisciplinary Pain Treatment (IPT)

Interdisciplinary pain treatment (IPT), based on the IASP, is a multimodal treatment provided by a multidisciplinary team collaborating in assessment and treatment using a shared bio-psycho-social (BPS) model and goals.6 This model suggests that chronic pain is based on a foundation of neurobiology (partially unknown) influenced by and interacting with biological, psychological, and social/contextual factors.7–11 The BPS framework is applied in modern clinical management of pain to better evaluate pain and its negative consequences for patients,12,13 including physical functioning,11 psychological well-being,10 and quality of life.14 Apart from medical treatment, IPT usually contains two or more well-synchronised treatment components such as physical, occupational, psychological, social, and educational components over a specified period (several weeks). Unlike pharmacological treatments or unimodal interventions, IPT is a complex intervention targeting the whole patient, including behaviours.15

Besides IPT, other common names used in the literature are Interdisciplinary pain rehabilitation program (IPRP), multimodal rehabilitation, multidisciplinary rehabilitation, biopsychosocial pain rehabilitation, and pain management program.

How IPT Works

IPT is generally offered when unimodal interventions (eg, pharmacological treatment, surgery, and rehabilitation with a unimodal approach) have not been associated with important improvements or when the patient with chronic pain has a complex condition, for example, with respect to comorbidities (eg, depressive and anxiety symptoms) and/or prolonged sick leave and difficulties with return to work. The BPS framework captures the total complexity of the pain condition and provides clues for reasonable interventions, including IPT. Hence, IPT targets the complexity in several components simultaneously and is well-coordinated (pain intensity, depressive symptoms, perceived health, and return to work) over time. For years, several systematic reviews (SRs) have reported that IPT is more effective compared with single-treatment or usual care.16–18 However, how this is achieved in detail and the importance of duration or other dosage aspects are not known.19

Why It is Important to Do This Review

True measures of healthcare quality are the outcomes that matter to patients.20 By using patient‐reported outcomes (PROMs), we can measure the quality of IPT and identify possible ways to improve IPT.21 Pain is a personal experience and patients with chronic pain conditions often describe wide consequences: significant pain intensity, psychological distress, insomnia, reduced work ability and sick-leave, ill-health, worse physical functioning and low quality of life.22–27 The large variation of the study procedures and published outcomes makes comparing RCTs difficult.28 Without standardised outcome measures, interpretation and implementation of evidence are challenging. To improve the choice of outcome measures to assess the effectiveness of IPT, several core outcomes sets (COSs) have been developed. In this paper, we used three relatively established guidelines for reporting outcomes: 1) Validation and application of a core set of patient-relevant outcome domains (VAPAIN);29 2) Initiative on methods, measurements, and pain assessments in clinical trials (IMMPACT);30 and 3) Patient-reported outcomes measurement information system (PROMIS).31

IPT is a complex intervention. The published systematic reviews (SRs) that explicitly select IPT outcomes have not been well studied and documented.32 Therefore, the evaluation of complex interventions such as IPT are ambiguous and different definitions of a positive outcome of an IPT trial have been presented.33 On the other hand, meta-research studies (ie, research on research) have increased rapidly to evaluate and improve research methods and reporting practices.34 To date, only one SR of randomised controlled trials (RCTs) has been used to investigate reported outcomes of an IPT,28 and no study has determined which reported outcomes are used in SRs of IPT. To fill this knowledge gap, we aim to provide a meticulous overview of the IPT outcomes reported in SRs with or without meta-analysis to evaluate the quality of IPT reported outcomes. In addition, we provide an overview of methodological aspects related to SRs of IPT to initiate a discussion of how to develop new methods of conducting and reporting SRs with complex interventions.

Methods

Study Design

We conducted a systematic overview of reviews35 following a standardised methodological approach in line with a published protocol (International Registered Report Identifier: PRR1-10.2196/17795).32 We also reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA 2020) statement, including the PRISMA 2020 for Abstracts checklist36 (see PRISMA 1 and in the ).

Search Strategy

We undertook a comprehensive literature search using PubMed, Cochrane Database of Systematic Reviews, and Epistemonikos from the earliest record through 30 September 2021. A search strategy was created using a combination of the following terms adjusted per database if needed: chronic pain, neuropathic pain, chronic persistent pain, pain rehabilitation, pain therapy, multidisciplinary, interdisciplinary, multimodal, multidisciplinary biopsychosocial rehabilitation, combined modality therapy, and patient care team. Hence, with respect to selection of pain conditions, we included nociceptive, neuropathic and nociplastic chronic pain conditions. We also used a sensitive filter created to retrieve only SRs citations in PubMed.37 The full search strategy is outlined in in the . The search strategy was limited by study design, but no restrictions were made on setting or context of the included articles or publication date. We also screened the reference lists of relevant records for additional articles and searched the International Prospective Register of Systematic Reviews (PROSPERO) for relevant ongoing reviews ( in the ). Two independent reviewers (ED and H-JD) searched the databases, evaluated the titles and abstracts of each identified record, examined the full text eligibility, and assessed whether a potentially eligible article fulfilled our inclusion criteria. Any disagreement was solved by discussion between the two reviewers or, if required, a third reviewer (BG) was consulted until agreement was reached.

Study Selection

We included SRs with or without meta-analysis assessing the effectiveness of IPT strategies for chronic pain. SRs that assessed IPT as a part of other interventions were included if separate results and outcomes for IPT were given. We also included other types of evidence synthesis that have been published and fulfilled our following inclusion criteria – ie, network meta-analyses or living SRs, individual patient data meta-analysis, and health agency reviews.

To be eligible, SRs needed to accomplish the following: 1) present a definition of IPT throughout the full text along with description of components involved in the intervention; 2) include adult male or female participants or both (at least 75% of the participants must be ≥18 years of age) with chronic/persistent nociceptive, neuropathic and/or nociplastic pain condition (ie, pain lasting at least 3 months) as described in our protocol;32 3) include only RCTs published in English or Swedish; and 4) compare IPT with treatment as usual, wait list, no treatment, or an alternative active intervention including comparisons between two different types of IPT.

Although there is some overlap, SRs that assessed “back school interventions” or work-hardening programmes were excluded because they are not considered identical treatment to IPT.38 We further excluded SRs if they had any of the following characteristics: 1) included patients with a diagnosis of chronic pain due to cancer, infection, inflammatory arthropathy, osteoporosis, fracture, pregnancy, rheumatoid arthritis, or other rheumatic pain;32 2) included patients with subacute or acute pain (ie, pain less than 3 months); 3) included study designs other than RCTs (eg, clinical trials without randomization, single study designs, and cohort studies); 4) included secondary research studies as the unit of analysis (ie, overview of reviews, umbrella reviews, scoping reviews, summary of systematic reviews, or mixed methods review); and 5) published in languages other than English or Swedish. In cases of duplicate publications (ie, the same SR from the same research group in a different journal) (see38,39), we kept the most comprehensive and detailed version of the article. However, updated versions of the same SRs were considered for inclusion (see38,40).

Data Extraction

Endnote software (X9 version) was used to collect the results of the searches and to remove duplicates. Two independent reviewers (ED and H-JD) performed data extraction using pre-defined excel forms. The list of variables of interest included the following: PMID/DOI of the included SR, first author, publication year, chronic pain conditions, control/comparison arms, number of RCTs of IPTs included in the SR, outcomes investigated (primary and secondary if such categorization exists), and total number of participants. Furthermore, we abstracted data in terms of the duration of the treatment (weeks and hours), treatment components, setting, and follow-up length. Finally, we recorded any method, strategy, considerations, or discussion regarding how the authors chose which outcomes to study and which methods to use to evaluate the evidence (eg, the GRADE approach) as well as methodological aspects such as reporting of funding, methods for risk of bias appraisal, synthesis of results, and details of meta-analytic processes if meta-analysis were conducted.

Any discrepancy was solved by discussion between the two reviewers. Data extraction on characteristics of included studies and reported outcomes of ITP was double checked by a third reviewer (BG).

Quality Assessment of Included Reviews

The quality of the included SRs was rated by means of the AMSTAR 2 tool (A Measurement Tool to Assess Systematic Reviews version 2)41 and by two independent reviewers (ED and H-JD). Any discrepancy between two reviewers for individual AMSTAR-2 questions was discussed until agreement was reached. AMSTAR-2 comprises 16 items and four options are provided to answer the questions of items: “Yes”, “Partial Yes”, “No” or “No meta-analysis conducted”. Seven critical items involve protocol content and registration, comprehensive literature search, providing reasons for excluding studies, assessment of RoB for individual studies, appropriate synthesis of results (meta-analytic methods), consideration of RoB in results and impact of publication bias. AMSTAR 2 categorises the quality of systematic reviews into four domains – high quality, moderate quality, low quality, or critically low quality – based on 16 items and sets a very high threshold for a high overall rating.42

Data Synthesis

We performed descriptive statistics to present our results using median and interquartile range for quantitative variables and absolute and relative frequencies for qualitative variables. We also used a narrative synthesis approach employing tabular presentations stratified by the AMSTAR2 assessment per SR. For conceptual classification, outcome domains were organised using three established guidelines of reporting outcomes: 1) VAPAIN statement for IPTs including eight core outcome domains;29 2) IMMPACT statement including six core outcome domains;30 and 3) PROMIS recommendations including three core outcome domains.31 Each domain per statement was scored as positive (Y) or negative (N). The total score was computed by counting the number of outcome domains scored as positive. For AMSTAR2, we rated critically low quality as one, low quality as two, moderate quality as three, and high quality as four. Lastly, we used the spearman rho correlation coefficient (0.00–0.19: very weak; 0.20–0.39: weak; 0.40–0.59: moderate; 0.60–0.79: strong; ≥0.80: very strong) to determine the relationship between the AMSTAR2 rating and the other variables such as number of outcome domains in VAPAIN, IMMPACT, or PROMIS, total number of outcomes, total sample size, number of included studies, and year of publication. All analyses were conducted in STATA, version 17.0 (StataCorp LLC) and R software, version 4.1.2.

Differences Between Protocol and Review

We made small changes in terms of the inclusion criteria between this version and the published protocol.32 This involved clarifying that other types of SRs as described in study selection were considered for inclusion and excluding the criterion of the detailed description of professionals involved in the intervention as only a trivial number of the included SRs provided this information in detail. We also updated our search up to 30 September 2021, including PROSPERO database.

Results

Search Results

Figure 1 illustrates the PRISMA flow of the selection process. After deduplication, the initial electronic database search identified 3253 potentially eligible systematic reviews. After screening records by title and abstract, we considered 145 potentially eligible reviews for inclusion and retrieved full-text articles. Grounds for exclusion after full-text assessment are illustrated in in the . We also identified six ongoing reviews on PROSPERO; three were completed and published,43–45 but only one45 met our inclusion criteria and therefore was included in the final set (see Table S2 in the for details). Finally, 18 published articles met the inclusion criteria and were included in this review.16–18,38,40,45–57

Figure 1

PRISMA flow chart.

Characteristics of Included IPT Systematic Reviews

The 18 selected SRs included a total of 356 primary RCTs and a total of 49006 participants. Eight of the included SRs were quantitative syntheses followed by meta-analysis and ten used narrative syntheses of data. Most of the SRs focused largely or completely on chronic low back pain and three on fibromyalgia. The remaining focused on chronic non-cancer pain in general. No SR eligible for our overview focused specifically on neuropathic pain. The proportion of female participants ranged between 21% and 100%. The median number of the total sample size per SR was 2212 (inter-quartile range [IQR] = 1334 to 4925, range 600 to 6858) and the median number of included primary RCTs was 15.5 (IQR = 9 to 27, range 2 to 46). A comprehensive description of each SR is provided in Tables 1 and 2. The methodological quality varied from critically low to moderate according to AMSTAR2 (see in the for details).

Table 1

Characteristics of Systematic Reviews with Meta-Analysis Stratified by AMSTAR2 Evaluation

Author, Year (Ref)/Objectives	Pain Condition Treated (Definition)/Setting	IPT (Definition)	No. of Included Studies (Total Sample Size)	Mean Age or Age Range, Years (% Female)	Outcomes, (No. of Reported Outcomes)	Distinction Between Primary and Secondary	Specific Strategy Used to Select Outcomes	Risk of Bias Assessment in Included Studies	Evaluation of the Evidence	AMSTAR2
Casey, 202045/ the effectiveness of IPT versus active physical interventions	Chronic non-cancer pain (pain persisting for 12 wks or more)/NR	A coordinated approach to pain management, usually delivered to groups by a team of health care professionals from disciplines such as pain medicine, nursing, psychology, physiotherapy, and occupational therapy	27 (4424)	40 to 61 (NR)	Pain intensity, disability/ (2)	No	If >1 measure of pain intensity or disability was used in a study, then the one considered to be the primary outcome	Serious high risk of bias in the majority of included studies	GRADE	Moderate
Martinez-Calderon, 202046/ which interventions enhance pain self-efficacy	Chronic musculoskeletal pain, according to the multidimensional diagnostic criteria for chronic pain by Dworkin et al, 2016a/NR	Interventions involving a combination of therapies (ie, exercise plus psychological therapy or self-management strategies plus exercise)	32 (5425)	NR (NR)	Pain self-efficacy/(1)	No	No	Serious high risk of bias in the majority of included studies	GRADE	Moderate
Papadopoulou, 201647/the effectiveness of pharmacological and non-pharmacological interventions	Fibromyalgia syndrome (based on ACR 1990 criteria)/NR	A set of therapeutic strategies to manage pain	8 (1027)	NR (NR)	Pain intensity, sleep disturbance, physical function, fatigue, depression, anxiety, and dyscognition/ (7)	No	OMERACT-10	Serious high risk of bias in the majority of included studies	No	Moderate
Kamper, 201438/ the effectiveness of IPT versus usual care and with physical treatments	Chronic low back pain (pain persisting for 12 wks)/ Rehabilitation units	A physical component (eg, an exercise program) and at least one other element from the biopsychosocial model that is psychological or social and occupational.	41 (6858)	40 to 45(21 to 100)	Pain, back‐specific disability or functional status, and work status (return to work, sick leave), generic health or quality of life, healthcare service utilisation, global improvement, psychological and cognitive function (depression, anxiety, fear avoidance, coping strategies), adverse events/ (12)	Yes	Measures collected at long‐term follow‐up were considered primary outcomes	Thirteen studies were assessed as low risk of bias	GRADE	Moderate
van Middelkoop, 201148/ the effectiveness of physical and rehabilitation interventions	Chronic low back pain (defined as pain persisting for 12 wks)/NR	One physical dimension and one of the other dimensions (psychological or social or occupational)	6 (1229)	38 to 43(37 to 100)	Pain, physical functional status, perceived recovery (eg, overall improvement), return to work (eg, return to work status, sick leave days), and side effects/ (5)	Yes	No	Three studies were assessed as low risk of bias	GRADE	Low
Häuser, 200949/ the efficacy of IPT	Fibromyalgia syndrome (based on ACR 1990 criteria)/Outpatients	The therapy treatment had to include at least two non-pharmacologic therapies (at least one educational or other psychological therapy and at least one exercise therapy)	9 (1119)	44 to 50 (96)	Pain, fatigue, sleep disturbances, depressive symptoms, and quality of life/ (5)	No	No	Six studies were of moderate quality and three studies were of low quality	No	Low
Gianola, 201857/ to compare via calculation of minimal important difference units, outcomes after IPT versus usual care	Chronic low back pain (defined as pain persisting for 3 mo or more)/NR	As given by Kamper et al, 2014b	13 (NR)	NR (NR)	Pain/ (1)	No	To present a clinically relevant measure to illustrate the benefit of the intervention to patients	No assessment of risk of bias	No	Critically low
Norlund, 200950/ the efficacy of IPT	Chronic low back pain lasting more than 4 wks/NR	The definition of multidisciplinary interventions included studies involving two or more healthcare disciplines	7 (1450)	NR (51)	Return to work/ (1)	No	No	Four studies were of moderate quality and three studies were of low quality	No	Critically low

Notes:aDworkin RH, Bruehl S, Fillingim RB, Loeser JD, Terman GW, Turk DC. Multidimensional Diagnostic Criteria for Chronic Pain: Introduction to the ACTTION-American Pain Society Pain Taxonomy (AAPT). J Pain. 2016 Sep;17(9 Suppl):T1-9 bKamper SJ, Apeldoorn AT, Chiarotto A, Smeets RJ, Ostelo RW, Guzman J, van Tulder MW. Multidisciplinary biopsychosocial rehabilitation for chronic low back pain. Cochrane Database Syst Rev. 2014 Sep 2;(9):CD000963.

Abbreviations: ACR, American College of Rheumatology; GRADE, Grades of Recommendation, Assessment, Development, and Evaluation; IPT, Interdisciplinary Pain Treatment; mo, months; NR, Not reported; OMERACT, Outcome Measures in Rheumatology Clinical Trials; wks, weeks.

Table 2

Characteristics of Systematic Reviews with Narrative Synthesis Stratified by AMSTAR2 Evaluation

Author, Year (Ref)/ Objectives	Pain Condition Treated (Definition)/Setting	IPT (Definition)	No. of Included Studies (Total Sample Size)	Mean Age or Age Range, Years (%Female)	Outcomes, (No. of Reported Outcomes)	Distinction Between Primary and Secondary	Specific Strategy Authors Used to Select Outcomes	Risk of Bias Assessment in Included Studies	Evaluation of the Evidence	AMSTAR2
Martinez-Calderon, 202051/ the effectiveness of conservative and surgical interventions	Chronic low back pain (pain persisting for 3 mo or more according to the multidimensional diagnostic criteria for chronic pain by Dworkin et al, 2016)a/NR	A minimum of two or more healthcare disciplines (physical, psychological or social)	17 (2017)	35 to 72 (59)	Kinesiophobia, fear-avoidance beliefs, fear of falling/ (3)	No	Fear becomes maladaptive	Half had low risk of bias	GRADE	Moderate
Martinez-Calderon, 202152/ the effectiveness of different interventions	Fibromyalgia syndrome (according to the IASP classification of chronic pain for the ICD-11th edition) /NR	A set of different therapeutic strategies to manage pain	2 (600)	39 to 56 (88)	Fear-avoidance beliefs, fear of movement, fear of pain, kinesiophobia, and pain-related anxiety/ (5)	No	Fear is a key factor in management of chronic musculoskeletal pain	Serious high risk of bias in the majority of included studies	GRADE	Moderate
Scascighini, 200816/the effectiveness of IPT	Chronic non-specific musculoskeletal pain (eg, chronic low back or back pain, fibromyalgia, no definition is given)/ Outpatients and inpatients	At least three of the following categories: psychotherapy, physiotherapy, relaxation techniques, medical treatment or patient education, vocational therapy	27 (2407)	NR (NR)	Pain, emotional strain, quality of life, disability, coping, physical capacity, return to work, sick leave, use of medicaments, use of the healthcare system, pain behaviour or subjective overall success/ (12)	Yes	No	Serious high risk of bias in the majority of included studies	The higher effectiveness had to be demonstrated in at least two of the five primary outcomes or in at least one of the primary and two of the secondary outcomes and GRADE	Moderate
Guzmán, 200240/ the effectiveness of IPT	Chronic low back pain (pain in the lumbar and/or gluteal region with or without radiation to the lower extremities of more than 3 mo)/ Pain clinics or hospitals	A minimum of one physical and one of the other dimensions (psychological or social/occupational)	12 (1964)	NR (NR)	Pain severity, global improvement, functional status, quality of life, and employment status/ (5)	No	No	Only three studies had low risk of bias	Best evidence synthesis approach by van Tulder criteria (1997)b	Moderate
SBU-report, 201018/ the effectiveness of rehabilitation approaches	Chronic non-cancer pain (pain persisting for 3 mo or more)	A minimum of two or more healthcare disciplines (physical, psychological, or social)	46 (6213)	NR (NR)	Pain, disability or functional status, psychological and cognitive function (depression, anxiety, fear avoidance, coping strategies), generic health or quality of life, work status (return to work, sick leave), healthcare service utilisation, global improvement, sleep quality, medication, pain behaviour, and adverse events/ (14)	Yes	IMMPACT	NR	GRADE	Low
van Geen, 200755/ the effectiveness of IPT	Chronic low back pain (pain persisting for 12 wks or more)/ Outpatients and inpatients	The involvement of several disciplines, such as psychologists, physiotherapists, occupational therapists, and/or medical specialists	10 (1958)	NR (NR)	Work participation, experienced pain, functional status, and quality of life/ (4)	No	No	Half had low risk of bias	More than 50% of the high-quality studies showed effectiveness on the outcome studied	Low
SBU-report, 2006a,b17/ the effectiveness of rehabilitation approaches	Chronic non-cancer pain (pain persisting for 3 mo or more)/ NR	A minimum of two or more healthcare disciplines (physical, psychological, or social)	46 (6213)	NR (67)	Pain, disability or functional status, work status (return to work, sick leave), generic health or quality of life, healthcare service utilisation, global improvement, psychological and cognitive function (depression, anxiety, fear avoidance, coping strategies)/ (10)	No	No	NR	Oxford CEMB levels of evidence	Low
Garschagen, 201553/ the effectiveness of IPT and the need for spiritual care	Chronic non-cancer pain (defined as pain persisting for 3 mo or more) /Hospital, outpatients, special clinics and rehabilitation centres	A coordinated approach to pain management, usually delivered to groups by a team of health care professionals from disciplines such as pain medicine, nursing, psychology, physiotherapy, and occupational therapy	14 (2672)	NR (NR)	Coping skills, pain, emotional distress, well-being and/or health, employment, and functioning/ (7)	No	No	No assessment of risk of bias	Oxman and Guaytt	Critically low
Waterschoot, 201454/ the effectiveness of IPT	Chronic low back pain (disabling non-specific CLBP for at least 3 mo)/NR	A rehabilitation program based on the biopsychosocial model with three or more disciplines providing the program (with or without a medical doctor)	18 (3430)	38 to 52 (37 to 100)	Disability, work participation, and quality of life/ (3)	No	No	Twelve studies were categorized as low risk of bias	No	Critically low
Nielson, 200156/ the effectiveness of IPT and unimodal aproaches	Chronic pain (no definition given)/NR	A coordinated approach to pain management usually delivered by a team of healthcare professionals from disciplines	21 (NR)	NR (NR)	Pain, function, and work outcomes/ (3)	No	No	No assessment of risk of bias	No	Critically low

Notes: aDworkin RH, Bruehl S, Fillingim RB, Loeser JD, Terman GW, Turk DC. Multidimensional Diagnostic Criteria for Chronic Pain: Introduction to the ACTTION-American Pain Society Pain Taxonomy (AAPT). J Pain. 2016 Sep;17(9 Suppl):T1-9. bvan Tulder, M. W., Assendelft, W. J., Koes, B. W., and Bouter, L. M. (1997). Method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group for Spinal Disorders. Spine, 22(20), 2323–2330.

Abbreviations: CEMB, The Centre for Evidence-Based Medicine; CLBP, chronic low back pain; GRADE, Grades of Recommendation, Assessment Development, and Evaluation; IASP, International Association for the Study of Pain; ICD-11, International Classification of Diseases,11th edition; IMMPACT, Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials; IPT= Interdisciplinary Pain Treatment; mo, months; NR, Not reported; wks, weeks.

The duration of the IPT treatment of the RCTs evaluated varied considerably across SRs (ranged from 1 week to 24 weeks) and only two SRs38,40 clearly reported the hours of treatment. All but three SRs45,47,57 included RCTs that compared an IPT with both active and passive comparison arms (eg, treatment as usual (TAU), waiting list control (WLC), no intervention, No-IPT interventions, and different types of IPTs). Details of treatment components and professionals involved were rarely reported in SRs. Only six16,38,40,49,55,58 gave details about population settings for the primary RCTs (eg, outpatients or inpatients, and primary care or specialist care).

Characteristics of Reported Outcomes in IPT Systematic Reviews

In all included SRs, the reported outcomes were assessed by validated self-report instruments with few exceptions for work status outcomes, which used data from labour markets, social security systems, or unemployment rates. Only four SRs (three SRs with meta-analysis and one without)16,18,38,48 clearly stated primary and secondary outcomes. In one SR,38 the authors specified only measures collected at long-term follow-up (12 months or more) were considered the primary outcomes (Tables 1 and 2). The median number of reported outcomes per SR was 5 (IQR = 3 to 7, range 1 to 14). The most common reported outcomes were pain (72%), disability or functional status (61%), work status (61%), psychological or emotional strain and cognitive function (50%), and quality of life (50%). However, only seven SRs provided a specific strategy for selecting outcomes (39%).18,38,45–47,51,57 Notably, only two SRs18,47 (11%) assessed outcome domains using established guidelines (OMERACT-10 and IMMACT) of reporting outcomes (Tables 1 and 2).

Reported Outcomes Domains Measured by VAPAIN, IMMPACT, and PROMIS Guidelines in IPT Systematic Reviews

According to VAPAIN, no SR assessed a combination of all eight core outcome domains (Table 3). The median number of reported outcome domains per SR was 3.5 (IQR = 1 to 5, range 1 to 7). Physical activity (14/18 SRs, 78%), pain intensity (12/18 SRs, 67%), productivity (11/18 SRs, 61%), emotional well-being (10/18 SRs, 55%), and health-related quality of life (9/18 SRs, 50%) were most frequently reported. The less commonly reported outcome domains were satisfaction with social roles and the patient’s activities and perceptions of treatment goal achievement (both 4/18 SRs, 22%).

Table 3

Outcome Domains Assessed by VAPAIN Statement in Included Systematic Reviews

VAPAIN Outcome Domains
Author, Year	Pain Intensity	Pain Frequency	Physical Activity	Emotional Well-Being	Satisfaction with Social Roles and Activities	Productivity (Paid and Unpaid, at Home and at Work, Inclusive Presentism, and Absenteeism)	Health-Related Quality of Life	Patient’s Perception of Treatment Goal Achievement	Score
Systematic reviews with meta-analysis
Casey, 202045	Y	N	Y	N	N	N	N	N	2/8
Martinez-Calderon, 202046	N	N	Y	N	N	N	N	N	1/8
Papadopoulou, 201647	Y	N	N	N	N	N	N	N	1/8
Kamper, 201438	Y	N	Y	N	N	Y	N	N	2/8
van Middelkoop, 201148	Y	N	Y	Y	Y	Y	Y	Y	7/8
Häuser, 200949	Y	N	Y	N	N	Y	N	Y	4/8
Gianola, 201857	Y	N	Y	Y	N	N	Y	N	4/8
Norlund, 200950	N	N	N	N	N	Y	N	N	1/8
Systematic reviews with narrative synthesis
Martinez-Calderon, 202051	N	N	N	Y	N	N	N	N	1/8
Martinez-Calderon, 202152	N	N	N	Y	N	N	N	N	1/8
Scascighini, 200816	Y	N	Y	Y	Y	Y	Y	Y	7/8
Guzmán, 200240	Y	N	Y	N	Y	Y	Y	N	5/8
SBU-report, 201018	Y	N	Y	Y	Y	Y	Y	Y	7/8
van Geen, 200755	Y	N	Y	N	N	Y	Y	N	4/8
SBU-report, 2006a,b17	Y	N	Y	Y	N	Y	Y	N	5/8
Garschagen, 201553	N	N	Y	Y	N	Y	N	N	3/8
Waterschoot, 201454	N	N	Y	N	N	Y	Y	N	3/8
Nielson, 200156	Y	N	Y	Y	N	Y	Y	N	5/8

Abbreviations: Y, Yes; N, No.

Only two SRs18,48 assessed a combination of all six core outcome domains according to IMMPACT (Table 4). The median number of reported outcome domains per SR was 2.5 (IQR = 1 to 3, range 1 to 6). Physical functioning (15/18 SRs, 83%), pain (12/18 SRs, 67%), and emotional functioning (11/18 SRs, 61%) were most frequently reported. The less commonly reported outcome domains were symptoms and adverse events (5/18 SRs, 28%) and participant disposition (2/18 SRs, 11%).

Table 4

Outcome Domains Assessed by IMMPACT and PROMIS Statements in Included Systematic Reviews

Author, Year	IMMPACT Outcome Domains							PROMIS Outcome Domains
	Pain	Physical Functioning	Emotional Functioning	Participant Ratings of Improvement and Satisfaction with Treatment	Symptoms and Adverse Events	Participant Disposition (eg, Adherence to the Treatment Regimen and Reasons for Premature Withdrawal from the Trial)	Score	Physical Health (Including the Core Health Outcome Domains of Symptoms and Function)	Mental Health (Including the Core Health Outcome Domains of Affect, Behaviour, and Cognition)	Social Health (Including the Core Health Outcome Domains of Relationships and Function)	Score
Systematic reviews with meta-analysis
Casey, 202045	Y	Y	N	N	N	N	2/6	Y	N	N	1/3
Martinez-Calderon, 202046	N	Y	N	N	N	N	1/6	Y	N	N	1/3
Papadopoulou, 201647	Y	N	N	N	N	N	1/6	Y	N	N	1/3
Kamper, 201438	Y	Y	N	N	N	N	2/6	Y	N	Y	2/3
van Middelkoop, 201148	Y	Y	Y	Y	Y	Y	6/6	Y	Y	Y	3/3
Häuser, 200949	Y	Y	N	N	Y	N	3/6	Y	N	Y	2/3
Gianola, 201857	Y	Y	Y	N	N	N	3/6	Y	Y	Y	3/3
Norlund, 200950	N	Y	N	N	N	N	1/6	N	N	Y	1/3
Systematic reviews with narrative synthesis
Martinez-Calderon, 202051	N	N	Y	N	N	N	1/6	N	Y	N	1/3
Martinez-Calderon, 202152	N	N	Y	N	N	N	1/6	N	Y	N	1/3
Scascighini, 200816	Y	Y	Y	Y	Y	N	5/6	Y	Y	Y	3/3
Guzmán, 200240	Y	Y	N	Y	N	N	3/6	Y	N	Y	2/3
SBU-report, 201018	Y	Y	Y	Y	Y	Y	6/6	Y	Y	Y	3/3
van Geen, 200755	Y	Y	N	N	Y	N	3/6	Y	N	Y	2/3
SBU-report, 2006a,b17	Y	Y	Y	Y	N	N	4/6	Y	Y	Y	3/3
Garschagen, 201553	N	Y	Y	Y	N	N	2/6	Y	Y	N	2/3
Waterschoot, 201454	N	Y	Y	N	N	N	2/6	Y	N	Y	2/3
Nielson, 200156	Y	Y	Y	N	N	N	3/6	Y	Y	Y	3/3

Abbreviations: Y, Yes; N, No.

According to PROMIS, six SRs16–18,48,56,57 assessed a combination of all three core outcome domains (Table 4). The median number of reported outcome domains per SR was 2 (IQR = 1 to 3, range 1 to 3). Physical health was reported in 15/18 SRs (83%), social health in 11/18 SRs (61%), and mental health in 10/18 SRs (55%).

Univariate Spearman rho analysis (Figure 2) showed a negative correlation between AMSTAR2 rating and PROMIS score (weak) as well as AMSTAR2 rating and total number of outcomes (moderate). VAPAIN score was positively correlated with IMMPACT score and PROMIS score (very strong). The scores for IMMPACT, VAPAIN, and PROMIS had negative correlations with year of publication (strong and moderate). Total sample size was positively correlated with number of included studies (very strong).

Figure 2

Correlation heatmap. AMSTAR2 categorised the quality of systematic reviews into four domains: high quality, moderate quality, low quality, and critically low quality. VAPAIN statement for IPTs includes eight core outcome domains: pain intensity, pain frequency, physical activity, emotional wellbeing, satisfaction with social roles and activities, productivity, health-related quality of life, and patient’s perception of treatment goal achievement. The IMMPACT statement includes six core outcome domains: pain, physical functioning, emotional functioning, participant ratings of improvement and satisfaction with treatment, symptoms and adverse events, and participant disposition. The PROMIS recommendation includes three core outcome domains: physical, mental, and social health.

Methodological Characteristics of Included IPT Systematic Reviews

None of the SRs assessed IPT as a complex intervention. However, 11 SRs reported the quality of the evidence with an appropriate guidance and comprehensive methods.16–18,38,40,45,46,48,49,51–53 Likewise, two other SRs16,55 used simple methods (ie, “the higher effectiveness had to be demonstrated in at least two out of the five primary outcomes, or at least in one of the primary and two of the secondary outcomes” and “effectiveness was judged to be robust if more than 50% of the high-quality studies showed effectiveness on the outcome studied” (Tables 1 and 2).

Authors in three SRs50,53,56 did not report any potential sources of conflict of interest, including any funding they received for conducting their review. Fifteen SRs16–18,38,40,45–52,54,55 (83%) assessed the methodological quality of included studies, but less than half clearly stated the tool used and none used the risk of bias of included RCTs as an inclusion criterion. The most common checklists were Cochrane Risk of Bias Tool and van Tulder-11 criteria. The random effect models with Der Simonian and Laird variance estimator were mainly used as statistical synthesis of data in the eight SRs38,45–50,58 with meta-analysis. All the models used the I2 Index as an indicator of heterogeneity. Subgroup or sensitivity analysis was done by six meta-analytic SRs,38,45–47,49,50 but meta-regression analysis was done using only one meta-analytic SR.46

Discussion

Summary of Main Results

This systematic overview showed wide-ranging disparity in reported outcomes and applied outcome domains in SRs evaluating IPT interventions for chronic non-cancer pain conditions. This finding was based on the 18 published SRs with data on more than 49000 people in 356 primary RCTs. Most RCTs reported nociplastic pain (eg, fibromyalgia, low back pain), and no SR focused specifically on neuropathic pain. The duration of IPT varied across the SRs. Primary or secondary outcomes and the rationale of selecting outcome domains were not always stated. Compared to IMMPACT or VAPAIN guidelines, more SRs followed PROMIS to assess outcome domains. However, by counting the number of reported outcome domains according to the three guidelines, we found a positive correlation of VAPAIN with IMMPACT and PROMIS, indicating an intercorrelation between the outcome domains included per standardised statement/guideline. A variety of methodological characteristics of SRs are also notable, which affects the quality of the reporting evidence.

Common Reported Outcomes in SRs Included IPT

Apart from pain as the most common reported outcome (72%) in all included SRs, disability or functional status (61%) and working status (61%) were also frequently evaluated as outcomes after IPT. Only half of the SRs reported psychological well-being and quality of life. The results reflect the complexity of chronic pain in a biopsychosocial context, and the outcomes after IPT are supposed to include a variety of physical, mental, and social aspects. However, it is uncertain which outcomes are prioritised. For example, whether pain intensity should be included as a major outcome of IPT is often debatable.17,59–62 In addition, SRs did not consider outcomes of adverse events or harms. Lack of specificity on such outcome domains may also bias SR conclusions.63

Reporting many outcomes in SRs did not increase the quality of the SRs as a negative correlation was found between AMSTAR2 rating and total number of outcomes. Based on these results, we believe the guidelines for complex intervention for conducting a SR on pain should be re-evaluated. Recently, a new PRISMA extension, known as PRISMA-CI statement and checklist, has been developed to address the important reporting gaps relative to complex interventions in healthcare.64

Why is It Difficult to Report Standardised Outcomes of IPT?

We need to be aware that the evaluation of complex interventions such as IPT is not clear cut and definitions of a positive outcome of a IPT trial vary in different publications.33 Although VAPAIN, IMMPACT, and PROMIS are established recommendations for assessing IPT outcomes, few SRs applied them to categorise their outcome domains. A main consequence might be a decreased quality of SRs since a negative correlation between AMSTAR2 and PROMIS was noted. A possible reason of not using these guidelines can be overlooking of the complexity of IPT. In this systematic overview, we found no SR clearly presented the complexity of IPT and considered the intercorrelations between the selected outcomes. For example, outcome measures evaluated separately in one SR38 may be problematic as the outcomes are most likely to be intercorrelated.15

Methodological Characteristics Affect the Quality of the Evidence

The approach GRADE for evidence ratings was used in many but not all included SRs. However, since IPT is a complex intervention with high levels of heterogeneity and indirectness assessment, using only GRADE may not adequately describe the evidence base.65,66 The latter is supported by Movsisyan and colleges;67 they found that the outcomes of complex interventions were more likely to be rated as “very low” quality of evidence compared with those of simple interventions (37.5% vs 9.1% for the primary benefit outcomes). New methods for grading the evidence such as threshold analysis in guideline development have been recently used.68 We also found diversities in methodological quality assessments of included RCTs and even more often did not state the tool they used in assessment as well as did not use risk of bias of RCTs as an inclusion criterion. With respect to included meta-analytic SRs, we found that subgroup or sensitivity analysis and meta-regression analysis were seldom conducted. Such methodological shortcomings may inflate the quality of the reported evidence.69,70

Our Suggestions on Handling the Multi-Correlated Outcomes of IPT in SRs

First, clear definitions of positive outcomes from IPT need to be presented in each SR. RCTs’ different definitions of positive outcomes from IPT should be addressed before an SR is conducted. For example, some SRs treated an outcome of a RCT as a positive outcome when a majority of outcomes were significantly better than for the control intervention.17,18 In another SR, the authors predetermined primary and secondary outcomes and what was necessary to classify an intervention as positive before reviewing the RCTs.16 The recommended guidelines may help categorise the variables into separate domains and minimise the risk of multivariate correlations. Furthermore, advanced graphical approaches such as harvest plots or bubble plots71 can be useful tools for illustrating and synthesising the matrix of the negative effects, no effects, and positive effects across RCTs in a SR with complex interventions.72

Second, intercorrelations between reported outcomes for different RCTs should be considered. One approach is to use the suggested outcome guidelines along with preliminary responder criteria based on several variables per outcome. For example, the evaluation of IPTs for patients with pain in fibromyalgia may be incorporated using both OMERACT core domains and preliminary responder criteria that best favour IPT over control.47,73,74 Another approach is to use appropriate statistical methods to handle the intercorrelations. Multivariate methods that are can handle intercorrelated outcomes in one analysis have been presented.75,76 We have recently suggested how simultaneous goals can be handled using scores from principal component analysis (PCA) in RCTs and observational studies.15 Other methods can obtain non-dependent effect sizes and include rationales for selecting effect sizes such as a random selection of effect sizes or averaging them to minimise their interrelations.76 For example, when the measurement of pain is evaluated with two or more instruments (eg, VAS and NRS), then it may be more feasible to average the effect size of both instruments into one effect size before meta-analysis of the data.

Third, rather than conducting separate univariate meta-analysis, researchers may consider applying multivariate meta-analysis (MVMA) to provide a framework to address multi-correlated outcomes from IPT.77,78 MVMA can simultaneously analyse multiple outcomes of interest and the summary result for each outcome depends on correlated results from related outcomes. However, implementing such an approach requires information about the correlations between the effect sizes, which is rarely reported in original RCTs, as well as knowledge of advance statistical programs like R software.76,79 Other meta-analytic strategies include multilevel hierarchical modelling which can show the variation in the true effect sizes across studies or multivariate meta regression which can allow intervention characteristics and mediating effects of intermediate outcomes to be examined together.70,76 Finally, mixed treatment comparison meta-analysis methods can also be useful for exploring the different components and combinations of components of IPT as such an approach can examine the effectiveness of a particular component (or combination of components).80

Strengths and Limitations

Most importantly, to our knowledge, this is the first overview that addresses disparity in reported outcomes and applies outcome domains in published SRs when evaluating IPT for chronic pain conditions. Using the latest AMSTAR2 checklist, we were able to evaluate the evidence quality of all the included SRs. Despite the complexity of IPT, we mapped, categorised, and compared the reported outcomes according to the VAPAIN statement, IMMPACT, and PROMIS recommendations to evaluate the current evidence of pain rehabilitation processes. This review was designed by experienced reviewers and researchers in this field, guided by a protocol, and carefully stated the difference between the protocol and this review.

This systematic overview has several limitations. First, selection bias cannot be avoided. SRs of RCTs may be associated with risk for bias resulting from an unrepresentative selection of patients and researcher allegiance.81 Other study designs, for example, SRs with registry cohorts and observational studies, were not included. Thus, real-world data are lacking. Second, in addition to the varied components of IPT, IPT had great variability in terms of duration of treatment and time of outcome assessment. Whether the reported outcomes from RCTs were related to these factors is not reflected in the present work. Third, the search strategy was limited to three electronic databases and SRs published in English or Swedish. There were no searches of the grey literature, so we might have missed some eligible reviews. However, we searched PROSPERO to identify any ongoing SRs on the topic. One may also argue that our investigation is limited to a small number of included SRs and therefore we may have not captured the entire field. However, we adopted very strict inclusion criteria related to the topic to assess the cutting edge evidence. Finally, the study population considered, ie, different pain conditions and the definition adopted in the SRs for IPT might have influenced the outcomes reported. Given these limitations, future research is needed to improve the framing the selection of research outcomes of IPT.

Implications for Future Research

To facilitate evidence synthesis and assessment in complex treatments for chronic pain in every day clinical practice, we need to find a proper way to frame the selection of the research on IPT outcomes. The currently established guidelines for assessing IPT outcomes (VAPAIN, IMMPACT, and PROMIS) are important for categorising outcome domains. Moreover, researchers who conduct SRs and meta-analyses are supposed to appropriately handle the intercorrelations between outcomes and the interactions between components of complex interventions.71,72

There is also a need to develop clinically accepted ways to apply the established guidelines for reporting outcome domains of IPT. A lack of consensus of evaluating reported outcomes of IPT in SRs makes it difficult to decide whether the evidence from SRs should be applied in clinical practice. A lack of consensus may also confuse health-care providers and policy makers when evaluating the need of tailoring current IPT. Clinical implications will suggest how to report outcomes that capture the information from real-world data to assess the effects of IPT.

Conclusion

Currently, there is a wide-ranging disparity in reported outcomes and applied outcome domains in SRs evaluating IPT for chronic pain conditions. According to the definition of complex interventions, IPT has two common characteristics: it has intercorrelated outcomes or mediators and moderators of effect (outcome complexity) and it has multiple components (intervention complexity).82 Given this, we present a menu of SR procedures for addressing sources of complexity when answering questions about the effects of IPT in research synthesis:

The SRs of IPT should follow the PRISMA-CI extension.

The inclusion criteria should clearly identify and describe the outcome domains and provide guidance for handling different outcome measurements on the same domain.

The selection of outcomes should follow the established guidelines such as VAPAIN.

The scope of included outcomes should address both effectiveness and harms on which strength of the evidence will be graded.

Quantitative graphical synthesis approaches such as harvest or bubble plots should be adopted to illustrate patterns in results of multiple outcomes. They can also be used as an alternative method of vote counting in SRs when meta-analysis is not feasible.

Subgroup analysis and meta-regression should be performed to examine how features of the interventions impact effect size. Mixed treatment comparison meta-analysis may also be useful when examining the intervention complexity and the effects of the different intervention components.

More advanced meta-analytical methods are required that will encourage the exploration and handling of the intercorrelation of the outcomes.76

There is a clear need for the development and implementation of new methods of grading evidence of IPT and, considering proper framing of the questions, judgements about directness and consistency of evidence and the need for additional contextual and qualitative evidence are needed that provide information about the circumstances when the intervention works best.66

We believe that our work is the first step to further test our suggestions in future evidence synthesis.