Knee arthroscopy versus conservative management in patients with degenerative knee disease: a systematic review.

OBJECTIVE: To determine the effects and complications of arthroscopic surgery compared with conservative management strategies in patients with degenerative knee disease.
DESIGN: Systematic review. MAIN OUTCOME MEASURES: Pain, function, adverse events. DATA SOURCES: MEDLINE, EMBASE, the Cochrane Central Register of Controlled Trials (CENTRAL), Google Scholar and Open Grey up to August 2016. ELIGIBILITY CRITERIA: For effects, randomised clinical trials (RCTs) comparing arthroscopic surgery with a conservative management strategy (including sham surgery) in patients with degenerative knee disease. For complications, RCTs and observational studies. REVIEW
METHODS: Two reviewers independently extracted data and assessed risk of bias for patient-important outcomes. A parallel guideline committee (BMJ Rapid Recommendations) provided input on the design and interpretation of the systematic review, including selection of patient-important outcomes. We used the GRADE approach to rate the certainty (quality) of the evidence.
RESULTS: We included 13 RCTs and 12 observational studies. With respect to pain, the review identified high-certainty evidence that knee arthroscopy results in a very small reduction in pain up to 3 months (mean difference =5.4 on a 100-point scale, 95% CI 2.0 to 8.8) and very small or no pain reduction up to 2 years (mean difference =3.1, 95% CI -0.2 to 6.4) when compared with conservative management. With respect to function, the review identified moderate-certainty evidence that knee arthroscopy results in a very small improvement in the short term (mean difference =4.9 on a 100-point scale, 95% CI 1.5 to 8.4) and very small or no improved function up to 2 years (mean difference =3.2, 95% CI -0.5 to 6.8). Alternative presentations of magnitude of effect, and associated sensitivity analyses, were consistent with the findings of the primary analysis. Low-quality evidence suggested a very low probability of serious complications after knee arthroscopy.
CONCLUSIONS: Over the long term, patients who undergo knee arthroscopy versus those who receive conservative management strategies do not have important benefits in pain or function. TRIAL REGISTRATION NUMBER: PROSPERO CRD42016046242. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

This in an update of previously published systematic reviews on the topic.

This review is linked to a BMJ Rapid Recommendations project. We conducted the review directed by a guideline panel that included patient representatives. This guideline panel provided detailed input with regards to the patients, interventions and outcomes and the interpretation of the results from this review.

We included seven new studies, analysed data focusing on clinical interpretability and explicitly assessed the certainty in the estimates of effect.

We performed meta-analyses using different measures of effect, and conducted subgroup and sensitivity analyses that strengthened our conclusions.

Introduction

As a result of degenerative knee disease (osteoarthritis in the knee which can involve the joint lining and/or menisci), ∼25% of people over 45 years, experience pain and other symptoms that may be severe and negatively impact quality of life (QoL).1–3 Total knee arthroplasty is the only definitive therapy available, but is reserved for patients with severe disease who fail conservative management.

In the USA, arthroscopic knee surgery in people with degenerative knee disease is the most common ambulatory orthopaedic procedure, and the ninth most commonly performed ambulatory procedure overall.4 Such surgery results in transient increase in pain and the necessity for restriction in activities for a period of 2–12 weeks.5 6 Current guidelines recommend against arthroscopic lavage and/or debridement for patients with symptomatic knee osteoarthritis, but do not make specific recommendations for or against partial meniscectomy in those with degenerative meniscal tears (with or without other concomitant degenerative changes).7 8 Further, many orthopaedic surgeons suggest that patients with mechanical symptoms and meniscal tears—typically locking or catching of the knee—may benefit from arthroscopic partial meniscectomy.9 10

Our systematic review informs the second BMJ Rapid Recommendations,11 a new BMJ series of trustworthy clinical practice recommendations published in response to potentially practice-changing evidence.12 A trial that compared the outcomes of exercise therapy versus knee arthroscopic partial meniscectomy in 140 middle-aged patients with degenerative meniscal tears, published in July 2016 triggered this systematic review.13 Previous systematic reviews addressing the impact of arthroscopic knee surgery did not consider all patient-important outcomes; did not consider patient importance when addressing patient-reported outcomes such as pain, function and QoL; and did not include all currently available randomised clinical trials (RCTs).14 15

To determine the effects and complications in patients with symptomatic degenerative knee disease, we performed a systematic review and meta-analysis of arthroscopic surgery with debridement, and/or partial meniscectomy compared with conservative management strategies.

Methods

Readers can access the protocol of this systematic review in International prospective registry of systematic reviews (PROSPERO) (CRD42016046242). According to the BMJ Rapid Recommendations process,12 a guideline panel provided critical oversight to the review and identified populations, subgroups and outcomes of interest. The panel included eight content experts and front-line clinicians (three orthopaedic surgeons, one rheumatologist, one epidemiologist, one general practitioner and two physiotherapists), four methodologists (three of them whom are also front-line clinicians and general internists) and three patients with lived experience of degenerative knee disease.

All patients received personal training and support to optimise contributions throughout the guideline development process. The patient panel members led the interpretation of the results based on what they expected the typical patient values and preferences to be, as well as the variation between patients. We also considered patients' values and preferences by using the minimally important difference (MID) to interpret the results obtained in the meta-analyses. These MIDs were obtained from a systematic review of studies in which patients were directly asked about the magnitude of change they had experienced, and whether that change was trivial, small but important, or larger.16 Clinical experts who were part of the team of that systematic review judged the applicability of such studies to the target population and raised no concerns.

Eligibility criteria

For the effects of arthroscopic surgery, we included RCTs comparing arthroscopic surgery, including any or all of debridement and/or partial meniscectomy to any conservative management strategy (exercise therapy, injections, drugs, sham surgery) in patients with symptomatic degenerative knee disease (defined as persistent knee pain that affects the patient's QoL and does not respond to conservative treatment), with or without osteoarthritis, of any age. We excluded studies that enrolled patients with acute trauma and those that enrolled fewer than 10 patients. For the complications of arthroscopic surgery, we also included observational studies (OS) (cohort studies, registry studies and case series) in patients with degenerative knee disease undergoing arthroscopic surgery, with or without a comparison group. We excluded studies published before the year 2000 when considering complications (but not effects).

Literature search

We performed an update of a previously published systematic review15 including MEDLINE (PubMed), EMBASE (Ovid) and Cochrane Central Register of Controlled Trials (CENTRAL) (see online supplementary appendix 1) from 1 January 2014 to 16 August 2016. In addition, we constructed specific search strategies for these three databases for one outcome not studied in the previous review (nerve damage), with no date limits. We also searched for grey literature using the first 500 hits from Google Scholar and Open Grey. We did not limit any of the searches by language of publication.

Study selection and data abstraction

Teams of two reviewers, working independently, performed all study selection and data abstraction using standardised forms and reviewed the titles and abstract of all the references resulting from the searches. We retrieved and reviewed the full text of all references identified as potentially eligible by at least one reviewer. We also reviewed the full text of all references excluded at the full text screening stage in the prior review.17 We included all studies judged as eligible by the two reviewers. Reviewers resolved disagreements by discussion.

Reviewers abstracted characteristics of eligible studies including study design, number of patients enrolled, age and sex distribution, number of patients followed-up, whether partial meniscectomy was performed, cointerventions, and outcomes, including pain, function, QoL and knee replacement. When authors reported results from more than one measure of pain or function, we decided a priori to use only the measure ranked highest in a hierarchy of patient-reported outcomes specific to the patients of interest.18 When studies had more than two arms, we only used the data from the arms relevant to this study. The review addressed these outcomes at 3 months or less, and at the longest follow-up reported.

The review addressed complication outcomes of mortality, venous thromboembolism (VTE), infection and nerve damage. Reviewers abstracted the absolute number of patients who experienced the outcomes over the follow-up period. When studies did not report VTE but reported pulmonary embolism and deep-vein thrombosis separately instead, we used these numbers to estimate the number of VTEs, considering the potential overlap due to patients experiencing both.19 We examined these outcomes over the 3 months following surgery.

Summary measures and data synthesis

We summarised continuous outcomes (pain, function and QoL) at the study level using the difference in change from baseline between groups. When baseline mean and SD per group at baseline and follow-up, but not change measures, were available, we assumed a within group correlation of 0.5 to estimate the SD of the change from baseline per study arm. If arm-level data were not reported, we abstracted the difference in change from baseline between the groups. When SDs at follow-up were not reported, we assumed the same SD as at baseline. When no SDs were available, we used the weighted average from all the other RCTs measuring the outcome with the same instrument. When studies reported medians and IQRs, we converted to means and SDs.20

We performed meta-analyses, and present results for patient-reported continuous outcomes in two ways. First, we transformed all scores to the scale of an index instrument, the highest in the hierarchy and pooled results of all studies using the mean difference as the summary measure. This resulted in scores that could range from 0 to 100, in which higher scores signified better outcomes (less pain, better function, better QoL). Second, we used the MID of each of the instruments to determine the proportion of patients who reached a change in the outcome that was larger than a MID. To inform this analysis, a parallel team performed a linked systematic review to establish the most credible MIDs for each of the instruments used to measure pain, function and QoL. The most credible MID was the median of all the credible MIDs. Details of this review are available in a publication related to this BMJ Rapid Recommendation.(Devji T, et al. Submitted for publication 2016) We then estimated and pooled the difference in the proportion of patients between groups achieving this difference.16 When no credible MID was found for a particular instrument, we used the MID of the index instrument. Data for time-to-knee replacement was not available, so we summarised the data for knee replacement using the proportion of patients who had the outcome per group and pooled those data using relative risk as the summary measure. These meta-analyses were performed using random effects models using the Hartung-Knapp-Sidik-Jonkman method.21 22 All analyses were performed using an intention-to-treat approach. When authors did not report data in a way that allowed incorporation it in the meta-analyses, we summarised the results narratively.

For complications, we used the number of patients having the event and the total number of patients undergoing knee arthroscopy, and pooled these data using a generalised linear mixed-effects model that allowed inclusion of studies with no events without a continuity correction.23

We planned to perform four subgroup analyses for the outcomes pain and function: trials in which there was >50% of patients with radiographic osteoarthritis (defined as Kellgren-Lawrence grades 2–4) versus trials with ≤50% of patients with radiographic osteoarthritis; trials in which patients were blinded versus not blinded; trials in which meniscectomy was performed versus those in which it was not; and trials in which a control group received an active intervention (eg, exercise therapy, injections) versus control groups without such interventions (eg, waiting list, no treatment). We performed sensitivity analyses for calculating the difference in patients who achieve a change higher than the MID in two ways: (1) using the lowest and highest value of the MID of each instrument, based on the range of the MIDs that were deemed credible, and (2) calculating the standardised mean difference and then transforming the standardised mean difference into a risk difference17 (this method does not use an MID). All data analyses used the package meta in the software R, V.3.3.1.(R: a language and environment for statistical computing (program). Vienna, Austria: R Foundation for Statistical Computing, 2016).

Certainty of the evidence assessments

We assessed the certainty of the estimates of effect (quality of evidence) using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.24 We considered potential limitations in risk of bias, inconsistency, imprecision, indirectness and publication bias.25–28 We used a modification of the Cochrane Risk of bias tool29 to assess the risk of bias of the studies informing on the effects of arthroscopic surgery, and the relevant items of the Methodological Index for Non-Randomised Studies (MINORS) tool30 to assess the risk of bias of the studies informing on the complications of knee arthroscopy. All authors, in consultation with the parallel BMJ Rapid Recommendation guideline panel31 participated in, and came to consensus regarding, certainty of estimates ratings.

The median of the change in score in the control arm from the studies that reported this information and did not use sham surgery as a control provided estimates of expected outcome in the control group (which is the equivalent of the baseline risk in dichotomous outcomes), which informed calculation of absolute estimates of effect. Summary of findings tables32 created using MAGICapp33 summarised key information for all patient-important outcomes.

Results

Of 710 unique references screened in title and abstract, 149 articles underwent full text screening, of which 13 RCTs informing the effects of knee arthroscopy13 34–46 and 15 studies informing the complications of knee arthroscopy (12 OS47–58 and three RCTs13 38 43) proved eligible (figure 1).

Figure 1

Study selection process. RCT, randomised clinical trial.

Effects

Study characteristics

The 13 eligible RCTs were published between 1993 and 2016, recruited a median of 119 patients, and enrolled patients with mean age from 48.944 to 62.834 years old and a sex distribution from 5%40 to 81.7%42 women. Two studies performed sham surgery in the control group,40 43 while most of the other studies used exercise therapy.13 35 36 38 39 41 44 46 table 1 presents details of study characteristics.

Table 1

Characteristics of randomised clinical trials included in systematic review of effects

Study	Number of patients enrolled	Comparator	Patients age (mean)	% females	ROA >50%*	Pain measure†	Baseline mean intervention (SD)	Baseline mean control (SD)	Function measure†	Baseline mean (SD)	Baseline mean control (SD)
Chang, 199334	34	Close needle joint lavage	62.8	71.6	Y	AIMS pain	65 (20)	61 (21)	AIMS physical function	23 (16)	17 (10)
Gauffin, 201435	150	Exercise therapy	54.5	27.3	N	KOOS pain	55 (18)	58 (18)	KOOS ADL	65 (18)	68 (22)
Herrlin, 2007,36 201337	96	Exercise therapy	54	38.9	N	KOOS pain	56 (18)	63 (21)	KOOS ADL	68 (21)	73 (20)
Katz, 201338	351	Exercise therapy	58.4	56.7	Y	KOOS pain	54 (16)	53 (16)	WOMAC function	37 (18)	38 (18)
Kirkley, 200839	188	Exercise therapy	59.6	62.9	Y	WOMAC pain	52 (21)	43 (24)	WOMAC function	51 (21)	43 (23)
Kise, 201613	140	Exercise therapy	49.6	39	Y	KOOS pain	68 (15)	63 (21)	KOOS ADL	80 (16)	75 (22)
Moseley, 200240	119	Sham surgery	52.8	5	Y	SF-36 body pain	39 (19)	38 (18)	SF-36 physical function	42 (22)	47 (23)
Osteras, 201241	17	Exercise therapy	49.7	23.6	N	VAS	37 (10)	35 (17)	NM	−	−
Saeed, 201542	120	Hyaluronic acid injection	NR	81.7	NR	Knee society score‡	NR	NR	Knee society score‡	NR	NR
Sihvonen, 201343	146	Sham surgery	52	39	N	VAS	58 (20)	61 (20)	Lysholm knee score‡	NA	NA
Stensrud, 201544	82	Exercise therapy	48.9	35.4	N	Ordinal scale	NR	NR	Ordinal scale	NR	NR
Vermesan, 201345	114	Steroid injection	58.4	79.2	NR	Oxford knee score‡	NR	NR	Oxford knee score‡	NR	NR
Yim, 201346	108	Exercise therapy	56.8	79.4	N	VAS	52 (18)	49 (15)	Lysholm score‡	NA	NA

*Based on Kellgren-Lawrence classification. Grades 2–4 were considered radiographic OA.

†All measures were converted to 0–100 scale. Higher scores mean less pain and better function.

‡Instrument combines pain and function together.

ADL, Function in Daily Living; AIMS, Arthritis Impact Measurement Scale; KOOS, Knee injury and Osteoarthritis Outcome Score; NA, not applicable; NM, not measured; NR, not reported; ROA, Radiographic osteoarthritis; SF-36, 36-Item Short-Form Survey; VAS, Visual Analogue Scale; WOMAC, Western Ontario and McMaster Universities Arthritis Index.

Effects of knee arthroscopy

Table 2 presents the GRADE summary of findings for effects of knee arthroscopy compared with control. Patients who underwent arthroscopic surgery had a change in pain scores larger on average than patients who received control, in the short-term (5.4 points on a 100-point scale, 95% CI 2.0 to 8.8, n=10 studies, 1231 patients, see online supplementary appendix figure S1) and long-term (3.1 95% CI −0.2 to 6.4, n=8 studies, 1097 patients, see online supplementary appendix figure S2). The MID for this outcome measured with the index instrument (KOOS pain subscale) was 12 points.59 Using the MIDs specific to each instrument, (Devji T, et al. Submitted for publication 2016) 12.4% more patients receiving arthroscopy achieved an improvement in pain greater than the MID (n=11 studies, 1102 patients) in the short term.

Table 2

Summary of findings for the effects of knee arthroscopy versus control in patients with degenerative knee disease

OutcomeTimeframe	Study results and measurements	Absolute effect estimates		Certainty in effect estimates(Quality of evidence)	Summary
		Conservative management	Arthroscopy
Short term
Pain (difference in change from baseline)3 months	Measured by: different instruments converted to scale of index instrument (KOOS pain subscale)Scale: 0–100 high better, minimally important difference 12)Data from 1231 patients in 10 studiesFollow-up 3 months	15.0Points (mean)	20.0Points (mean)	High	On average, knee arthroscopy results in very small extra reduction in pain scores when compared with control
		Difference: mean difference 5.4 more(95% CI 1.9 more—8.8 more)
Pain (difference in patients who achieve a change higher than the MID)3 months	Data from 1102 patients in 9 studiesFollow-up 3 months	669Per 1000	793Per 1000	High	Knee arthroscopy increases the number of patients with an important reduction in short-term pain by ∼12 in 100
		Difference: 124 more per 1000
Function (difference in change from baseline)3 months	Measured by: different instruments converted to scale of index instrument (KOOS ADL subscale, Scale: 0–100, high betterminimally important difference 8)Based on data from 964 patients in 7 studiesFollow-up 3 months	9.0Points (mean)	14.0Points (mean)	ModerateOwing to serious risk of bias, borderline inconsistency and borderline imprecision	Knee arthroscopy may increase function change slightly more than control
		Difference: mean difference 4.9 more(95% CI 1.5 more—8.4 more)
Function (difference in patients who achieve a change higher than the MID)3 months	Based on data from 835 patients in 6 studiesFollow-up 3 months	519Per 1000	653Per 1000	ModerateOwing to serious risk of bias	Knee arthroscopy probably increases the number of patients with an important improvement in short-term function ∼13 in 100
		Difference: 134 more per 1000
Quality of life (difference in change from baseline)3 months	Measured by: EQ-5D VASScale: 0–100, high better minimally important difference 15Based on data from 120 patients in one studyFollow-up 3 months	8.0Points (mean)	14.0Points (mean)	LowOwing to serious risk of bias, owing to serious imprecision	Knee arthroscopy may have, on average, little or no difference on QoL change, compared with control
		Difference: mean difference 6.0 greater(95% CI 1.5 fewer—13.5 more)
Pain and functionup to 3 months	Based on data from 316 patients in 3 studiesFollow-up up to 3 months	Three studies evaluated the effects of knee arthroscopy in pain and function using measures that combined these two outcomes together or that could not be pooled. One study reported a difference in change from baseline in the Oxford knee score that favoured arthroscopy by 4.9 points (95% CI 3.61 to 6.20, 114 patients) over steroids injections. A second study reported no differences in the median in an overall self-assessment based on a 7-point ordinal scale (82 patients) when comparing knee arthroscopy to exercise therapy. The third study reported that patients who received intra-articular hyaluronic acid injections reported less pain than patients who received knee arthroscopy (120 patients)		ModerateOwing to serious risk of bias	Knee arthroscopy probably has little or no difference in pain and function when compared with control
Long term
Pain (difference in change from baseline)1–2 years	Measured by: different instruments converted to scale of index instrument (KOOS pain subscale minimally important difference 12)Scale: 0–100, high betterBased on data from 1097 patients in 8 studiesFollow-up 2 years	19.0Points (mean)	22.0Points (mean)	High	On average, knee arthroscopy results in no difference or a very small reduction, in pain
		Difference: mean difference 3.13 more(95% CI 0.17 fewer—6.43 more)
Function (difference in change from baseline)1–2 years	Measured by: different instruments converted to scale of index instrument (KOOS ADL subscale minimally important difference 8)Scale: 0–100, high betterBased on data from 843 patients in 6 studiesFollow-up 2 years	10.0Points (mean)	13.0Points (mean)	ModerateOwing to serious risk of bias and borderline imprecision	On average, knee arthroscopy probably does results in no improvement or a very small improvement, in function
		Difference: mean difference 3.16 more(95% CI 0.48 less—6.8 more)
Quality of life (difference in change from baseline)1–2 years	Measured by: EQ-5D VAS, 15D (converted to EQ-5D scale, MID 15)Scale: 0–100, high betterBased on data from 269 patients in 2 studiesFollow-up 1 year	10.3Points (mean)	12.4Points (mean)	High	On average, knee arthroscopy does not result in an important improvement in quality of life
		Difference: mean difference 2.12 more(95% CI 0.96 fewer—5.21 more)
Knee replacement1–2 years	Relative risk: 1.89(95% CI 0.51 to 7.0)Based on data from 497 patients in 2 studiesFollow-up 1 year	12Per 1000	23Per 1000	ModerateOwing to serious imprecision	On average, knee arthroscopy does not result in an increase in the risk of knee replacement
		Difference: 11 more per 1000(95% CI 107 more—6 fewer)
Pain and function1–2 years	Based on data from 114 patients in one studyFollow-up 1 year	One study measured pain and function using a composite score. The study showed that patients who receive arthroscopy have a change in Oxford knee score 2.6 points higher than patients receiving steroids injections (95% CI 1.14 to 4.06)		ModerateOwing to serious risk of bias	Knee arthroscopy probably has little or no difference on pain and function

15D, the Health Related Quality of Life 15-Dimension questionnaire; ADL, Function in Daily Living; KOOS, Knee injury and Osteoarthritis Outcome Score; VAS, Visual Analogue Scale.

Over the first 3 months of follow-up, the median average of improvement in pain was 15 points in patients who received conservative management versus 20 points in patients who underwent knee arthroscopy; over the long term, the median average improvement 19 points in patients who received conservative management versus 22 points in patients who underwent knee arthroscopy.

Patients who underwent arthroscopic surgery had an improvement in function score that was, on average, 4.9 points larger on a 100-point scale than patients who received control in the short term (95% CI 1.5 to 8.4, n=7 studies, 964 patients, see online supplementary appendix figure S3), and 3.2 points larger (95% CI −0.5 to 6.8, n=6 studies, 843 patients see online supplementary appendix figure S4) in the long term. The MID for this outcome measured with the index instrument (KOOS ADL subscale) was 8 points.59 The probability of achieving a change in function higher than the MID was 13.4% higher in patients receiving arthroscopy (n=6 studies, 835 patients) in the short term.

In the short term, patients who received conservative management achieved a median average improvement in function of 9 points, versus 14 points in patients who underwent knee arthroscopy; over the long term, the median average improvement was 10 points in patients who received conservative management versus 13 points in patients who underwent knee arthroscopy.

We were able to perform subgroup analyses according to blinding of patients and proportion of patients with radiographic osteoarthritis >50% for both of these outcomes. None of the analyses showed differences in results between groups (see online supplementary appendix figures S5–12). All RCTs performed partial meniscectomy as part of the intervention when needed, and all used active comparators. Therefore, we did not perform subgroup analyses for these variables.

Sensitivity analyses showed that for short-term pain and short-term function, results using the upper and lower limit of the MID estimate, and the approach using the standardised mean difference, in all cases yielded lower estimates of the numbers with important benefit from arthroscopy than did our primary analysis (see online supplementary appendix 2).

Changes in QoL scores were similar between patients undergoing knee arthroscopy and patients receiving control. In the short term, the difference in change from baseline scores was 6 points greater for knee arthroscopy (95% CI −1.5 to 13.5, n=1 study, 120 patients). In the long term, the difference in change from baseline was 2.1 points (95% CI −1.0 to 5.2, n=2 studies, 269 patients, see online supplementary appendix figure S13). The MID for the index instrument (EQ-5D) is 15 points.60 The median average of improvement in QoL was 8 points in patients who received conservative management versus 14 points in patients who underwent knee arthroscopy in the short term; and 10.3 points in patients who received conservative management versus 12.4 points in patients who underwent knee arthroscopy.

The risk of undergoing knee replacement up to 1 year after the intervention was 1.89 times higher in patients undergoing knee arthroscopy (95% CI 0.51 to 7, n=2 studies, 497 patients, see online supplementary appendix figure S14).

Certainty of the evidence

There was high certainty in the estimates of effects for the outcome pain and moderate certainty in the estimates of effect for the outcome function. Although risk of bias due to lack of blinding that could affect the patient-reported outcomes was a concern in most of the trials, and the proportion of losses to follow-up was higher than desirable (see online supplementary appendix figure S15), for pain, trials with a low risk of bias reported similar results to those in which there were risk of bias concerns (see online supplementary appendix figures S5 and 7). For function, there was less evidence from trials at low risk of bias, so we rated down our certainty in evidence for risk of bias (see online supplementary appendix figures S9 and 11). In addition, the estimates for this outcome were imprecise. There was no evidence of publication bias (see online supplementary appendix figure S16).

The certainty of the estimates of QoL was low in the short term due to risk of bias and imprecision, but high in the long term. The certainty of the estimates for knee replacement was moderate due to imprecision. Table 2 presents the details of the assessments per outcome.

Complications

The studies included in the complications systematic review reported data from a median of 20 770 patients. Average patient age ranged from 4252 to 62.456 years, and the proportion of women from 39%13 to 64.6%.49 table 3 presents detailed study characteristics.

Table 3

Characteristics of studies included in systematic review of complications

Study	Design	Number of patients	Age (mean)	% females
Basques, 201547	Retrospective cohort (registry)	17 774	53	46.9
Bohensky, 201448	Retrospective cohort (registry)	139 031	NR	42.5
Cancienne, 201649	Prospective cohort	173 216	NR	64.6
Hame, 201250	Retrospective cohort (registry)	314 578	NR	62
Hetsroni, 201151	Retrospective cohort (registry)	418 323	45.5	46.8
Hoppener, 200652	Retrospective cohort (registry)	335	42	43.3
Jameson, 201153	Retrospective cohort (registry)	261 446	46	40.7
Katz, 201338	RCT	174	59	55.9
Kise, 201613	RCT	70	48.9	39
Krych, 201554	Retrospective cohort (registry)	12 595	NR	NR
Maletis, 201255	Retrospective cohort (registry)	20 770	44	42.8
Sihvonen, 201343	RCT	70	52	58
Wai, 200256	Retrospective cohort (registry)	14 391	62.4	49.9
Yacub, 200957	Retrospective cohort (registry)	12 426	NR	57.3
Yeranosian, 201358	Retrospective cohort (registry)	432 038	NR	NR

NR, not reported, RCT, randomised clinical trial.

Complications of knee arthroscopy

Table 4 provides a GRADE summary of findings for the complications of knee arthroscopy. Patients who underwent knee arthroscopy have an extremely small risk of death, that is, (<1 in 1000, 95% CI 0 to 1, n=7 studies, 454 086 patients, see online supplementary appendix figure S17); a risk of VTE of five in 1000 (95% CI 2 to 10, n=11 studies, 1 119 920 patients, see online supplementary appendix figure S18); a risk of infection of 2 in 1000 (95% CI 1 to 4, n=5 studies, 603 838 patients, see online supplementary appendix figure S19) and an extremely small risk of nerve damage (<1 in 1000, 95% CI 0 to 1, n=1 study, 12 426 patients).

Table 4

Summary of findings for the complications of knee arthroscopy versus control in patients with degenerative knee disease

OutcomeTimeframe	Study results and measurements	Absolute effect estimates		Certainty in effect estimates(Quality of evidence)	Summary
		Conservative management	Arthroscopy
Mortality3 months	Based on data from 454 086 patients in 7 studiesFollow-up 3 months	0Per 1000	0Per 1000	LowOwing to serious risk of bias and serious inconsistency	Arthroscopy may have an extremely small risk of mortality
		Difference: <1 more per 1000(95% CI 0 more—1 more)
Venous thromboembolism3 months	Based on data from 1 119 920 patients in 11 studiesFollow-up 3 months	0per 1000	5per 1000	LowOwing to serious risk of bias, owing to serious inconsistency	Arthroscopy may have a small risk for venous thromboembolism
		Difference: 5 more per 1000(95% CI 2 more—10 more)
Infection3 months	Based on data from 603 838 patients in 5 studiesFollow-up 3 months	0per 1000	2per 1000	LowOwing to serious risk of bias, owing to serious inconsistency	Arthroscopy may have a very small risk for infection
		Difference: 2 more per 1000(95% CI 1 more—4 more)
Nerve damage3 months	Based on data from 12 426 patients in one studyFollow-up 3 months	0Per 1000	0Per 1000	LowOwing to serious risk of bias, owing to serious indirectness	Arthroscopy may have an extremely small risk of nerve damage
		Difference: <1 more per 1000(95% CI 0 more—1 more)

The estimates of complications of knee arthroscopy had low certainty. All studies suffered from risk of bias concerns, mainly due to the retrospective nature of the data collection (using data that had not been collected for the purposes of the study) (see online supplementary appendix figure S20). The studies informing mortality, VTE and infection showed inconsistent results from a clinical and statistical perspective, which resulted in rating down the certainty for the pooled estimate. Finally, the only study informing nerve damage included patients with arthroscopy of the shoulder as well,57 and therefore warranted rating down this estimate for indirectness. There was no evidence of publication bias (see online supplementary appendix figure S21). Table 4 presents details regarding the assessments of the certainty of the complications of knee arthroscopy per outcome.

Discussion

This systematic review provides high-quality evidence that patients with degenerative knee disease who undergo arthroscopy experience, on average, very small benefits in pain, function and QoL over periods of up to 3 months when compared with patients who receive a conservative management strategy (table 2). Results up to 2 years failed to show benefits in pain or function, and excluded any but very small benefits (table 2). The median of the average pain change in patients receiving conservative management was 15 points in the short term and 19 points in the long term (MID 12 points). Patients receiving arthroscopy had average change 5.4 points higher in the short term, and 3.1 points higher in the long term. These differences were not patient important. Thus, whether patients receive arthroscopy or not, the clinical trial experience suggests, on average, a small benefit in pain reduction over the short and long term.

The results for function proved similar, with very small average differences in the short term, and no convincing evidence of benefit in the long term (table 2). Patients who received a conservative management strategy had a median average change of 9 points in the short term and 10 points in the long term. (MID 8 points). Risk of bias limitations leave this evidence less secure (moderate quality) than for pain.

Study results provide high-quality evidence that the benefits of arthroscopic surgery on QoL over the long term are minimal, if they exist at all (table 2). Low-quality evidence raises the possibility of a higher risk of knee replacement with arthroscopic surgery.

We found a low risk of serious adverse effects in patients undergoing knee arthroscopy. The risk of mortality and nerve damage may be close to 0, while the risk of VTE and infection may be five and two in 1000 patients, respectively. We have low certainty in this evidence, however, because the studies included were likely to be biased and showed results that were inconsistent.

Our systematic review has particular strengths. First, it provides the most comprehensive and trustworthy body of evidence up to date, including 10 studies not included in the most recent prior review.15 While the conclusions of our systematic review may not be qualitatively different from the conclusions of previous reviews addressing the same question, we believe that all the additions in terms of studies included and methods for summarising, presenting and appraising the evidence strengthen the conclusions derived from this body of evidence considerably. Second, this systematic review was developed in parallel with a BMJ Rapid Recommendation according to predefined standards, methods and processes.12 Extensive input from content experts and patients in the guideline panel throughout the process secured appropriate selection of outcomes and analyses as well as appropriate interpretation of the results from the systematic review. The rapid recommendations published together with our linked systematic review should provide clinicians and their patients with optimal guidance in practice and will also allow other guideline organisations to reuse or adapt content to their contexts, if needed. Third, by converting all the instruments to the scale of an index instrument we do overcome the potential limitations of using the standardised mean difference (namely, the analysis depending on a similar SD across studies, and the resulting measure of effect being difficult to interpret), and provide an estimate of the proportion of patients who would achieve a minimally important change per arm, and the difference between these proportions. This allows incorporating patients' values and preferences explicitly when interpreting the results. A rigorous linked systematic review of studies addressing the issue informed our estimates of the minimally important change (Devji T, et al. Submitted for publication 2016) and our results were robust to accounting for the uncertainty in the MID, as well as to calculating the proportion who might benefit using an approach relying on the standardised mean difference. Fourth, we provide an explicit and transparent assessment of the certainty in the absolute estimates of effect, which considers limitations of the evidence with regards to risk of bias, inconsistency, imprecision, indirectness and publication bias.61

Our review is limited by suboptimal reporting in many of the original studies, requiring imputing SDs and, in a number of studies, estimating correlations between baseline and follow-up. It is possible that there is a subgroup of patients—for instance, those with locking symptoms—who do achieve substantial benefit from arthroscopic knee surgery. The available studies do not, however, provide evidence of any such subgroup. The burden of proof now rests with those who claim that such a subpopulation exists, with compelling RCT evidence required to substantiate the claim.

In summary, our results provide low-quality evidence that knee arthroscopy is a safe procedure with a low risk of complications and moderate to high-quality evidence that the procedure provides very small benefits in pain and function over conservative therapy in the short term. The evidence fails to support a persistence of these benefits over the long term. Patients and their healthcare providers must trade-off the marginal short-term benefits against the burden of the surgical procedure (pain, swelling, limited mobility, restriction of activities, over a period of 2–6 weeks).

Siemieniuk RAC, Harris IA, Agoritsas T, et al. Arthroscopic surgery for degenerative knee arthritis and meniscal tears: a clinical practice guideline. BMJ 2017;257:j1982. doi:10.1136/bmj.j1982 Summary of the results from the Rapid Recommendation process

Brignardello-Peterson R, Guyatt GH, Schandelmaier S, et al. Knee arthroscopy versus conservative management in patients with degenerative knee disease: a systematic review. BMJ Open 2017;7:e016114. doi:10.1136/bmjopen-2017-016114 Review of all available randomised trials that assessed the benefits of knee arthroscopy compared with non-operative care and observational studies that assessed risks

Devji T, Guyatt GH, Lytvyn L, et al. Application of minimal important differences in degenerative knee disease outcomes: a systematic review and case study to inform BMJ Rapid Recommendations. BMJ Open 2017;7:e015587. doi:10.1136/bmjopen-2016-015587 Review addressing what level of individual change on a given scale is important to patients (minimally important difference). The study informed sensitivity analyses for the review on net benefit, informed discussions on patient values and preferences, and was key to interpreting the magnitude of effect sizes and the strength of the recommendation

MAGICapp (www.magicapp.org) Expanded version of the results with multilayered recommendations, evidence summaries, and decision aids for use on all devices