The U.K. NICE 2014 Guidelines for Osteoarthritis of the Knee: Lessons Learned in a Narrative Review Addressing Inadvertent Limitations and Bias.

Several systematic reviews suggest that acupuncture is effective for knee osteoarthritis (OA), and furthermore a safe and cost-effective treatment for this condition. A recent clinical practice guideline (CPG) from the National Institute for Health and Care Excellence (NICE), in the United Kingdom, recommended against the use of acupuncture on the grounds that the effect size (ES) in comparison with sham acupuncture is too small. Safety data were not considered in the review, in addition the levels of evidence for acupuncture against other recommended therapies were not compared. Consequently, it is argued that this NICE guideline has limitations that lead to several potential biases in its evaluation of acupuncture, which were not addressed correctly: (1) NICE's prior scoping process limited its review. (2) NICE introduced the method of developing recommendations based on the consideration of which interventions make "minimal important differences" of an ES of 0.5 or greater, rather than the statistical significance of the effect of an intervention when compared with an appropriate comparison. (3) Evidence that sham acupuncture is not physiologically inert and has some level of beneficial effect, hence artificially reducing the magnitude of the ES in comparison with sham. (4) The low adverse effects profile of acupuncture. (5) Evidence from trials comparing acupuncture with usual or standard care was not considered, nor was cost-effectiveness data. (6) Lack of the usual CPG "head-to-head" comparisons between interventions. If the same criteria and methods that have been applied to acupuncture were applied to other NICE-recommended therapies for knee OA, including patient centeredness, patient education, self-management and weight loss, nonsteroidal anti-inflammatory drug (NSAIDs), and cyclooxygenase-2 inhibitor (COX-2 inhibitors), these too would no longer be recommended and opiates would become the first line of drug prescription. Given the problems with sham acupuncture, perhaps now is the time to embrace pragmatic studies and employ comparative effectiveness studies instead.