Literature DB >> 35210347

Characteristics and quality of clinical practice guidelines addressing acupuncture interventions: a systematic survey of 133 guidelines and 433 acupuncture recommendations.

Xiaorong Tang1, Xiaoshuang Shi2,3, Hong Zhao3,4, Liming Lu1, Ze Chen1, Yixuan Feng3, Lanping Liu5, Ruihua Duan6, Pingping Zhang5, Yuqin Xu3, Shuo Cui3, Fen Gong6, Jingwen Fei5, Neng-Gui Xu1, Xianghong Jing7, Gordon Guyatt8,9, Yu-Qing Zhang7,8,10,11.   

Abstract

OBJECTIVE: To systematically summarise acupuncture-related Clinical Practice Guidelines (CPGs)'s clinical and methodological characteristics and critically appraise their methodology quality.
DESIGN: We summarised the characteristics of the guidelines and recommendations and evaluated their methodological quality using the Appraisal of Guidelines Research and Evaluation II (AGREE II) instrument. DATA SOURCES: Nine databases were searched from 1 January 2010 to 20 September 2020. ELIGIBILITY CRITERIA FOR SELECTING STUDIES: We included the latest version of acupuncture CPGs, which must have used at least one systematic review addressing the benefits and harms of alternative care options to inform acupuncture recommendations. DATA EXTRACTION AND SYNTHESIS: Reviewers, working in pairs, independently screened and extracted data. When there are statistical differences among types of CPGs, we reported the data by type in the text, but when not, we reported the overall data.
RESULTS: Of the 133 eligible guidelines, musculoskeletal and connective tissue diseases proved the most commonly addressed therapeutic areas. According to the AGREE II instrument, the CPG was moderate quality in the domain of clarity of scope and purpose, clarity of presentation, the rigour of development, stakeholder involvement and low quality in editorial independence, and applicability. The study identified 433 acupuncture-related recommendations; 380 recommended the use of acupuncture, 28 recommended against the use of acupuncture and 25 considered acupuncture but did not make recommendations. Of the 303 recommendations that used Grading of Recommendations Assessment, Development and Evaluation to determine the strength of recommendations, 152 were weak recommendations, 131 were strong recommendations, of which 104 were supported by low or very low certainty evidence (discordant recommendations).
CONCLUSION: In the past 10 years, a large number of CPGs addressing acupuncture interventions exist. Although these guidelines may be as or more rigorous than many others, considerable room for improvement remains. © Author(s) (or their employer(s)) 2022. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Entities:  

Keywords:  complementary medicine; health economics; public health

Mesh:

Year:  2022        PMID: 35210347      PMCID: PMC8883258          DOI: 10.1136/bmjopen-2021-058834

Source DB:  PubMed          Journal:  BMJ Open        ISSN: 2044-6055            Impact factor:   2.692


This systematic survey includes a comprehensive search of eligible clinical practice guidelines (CPGs) and systemic and explicit eligibility criteria. This study used the Appraisal of Guidelines Research and Evaluation II instrument to evaluate the methodological of eligible CPGs. This study investigated the utilisation of the Grading of Recommendations Assessment, Development and Evaluation in CPGs. This study documented recommendations discordant with respect to evidence strength and certainty. Limitations include the exclusion of guidelines not supported by any systematic reviews; our findings, therefore, do not apply to the lowest methodological quality guidelines.

Introduction

With more than 3000 years of history, acupuncture is one of the widely used complementary and alternative therapies.1 2 Among the 192 WHO member states, 183 have used acupuncture.3 In Norway, 34%–64% of doctors recommend acupuncture to their patients.4 The increasing acupuncture application in practice has led to growing demands for clinical practice guidelines (CPGs), with many countries and academic organisations including acupuncture in their CPGs.5 6 Trustworthy CPGs base their recommendations on systematic reviews (SRs) assessing the benefits and harms of alternative care options, rate the certainty of the evidence and grade the strength of recommendations.7 8 CPGs help clinicians, managers and policy-makers select the best available evidence to support decision making. Despite the existing large number of acupuncture-related CPGs, the clinical and methodological status of CPGs, including recommendations, remain underexplored. This systematic survey summarises acupuncture-related CPGs’ clinical and methodological characteristics and critically assesses their methodology quality.

Methods

Definition

Acupuncture and acupuncture point

In this study, acupuncture is used in a broad sense refers to interventions that use any stimulation on acupuncture points, including manual acupuncture, electric acupuncture (electroacupuncture), acupressure, moxibustion, warm needling, fire needling, transcutaneous electrical nerve, laser acupuncture, microsystem acupuncture, thread-embedding therapy, medicine acicula, point injection, acupoint paste; magnetic acupuncture, blood-letting therapy, acupotomy.9 Acupuncture point: the point in humans where stimulation and manipulation are performed in acupuncture therapies.10

Types of CPG

This study divides eligible CPGs into three types: acupuncture-specific CPG (all recommendations include acupuncture interventions), traditional and complementary medicine (T&CM) CPG (all recommendations include T&CM interventions), and Comprehensive CPG (all recommendations include conventional interventions, and some include acupuncture interventions).

Acupuncture recommendation

We define acupuncture recommendations as recommendations (including for, against or considered but did not make recommendations) in which authors considered acupuncture as a treatment or prophylactic (eg, prevent nausea and vomiting after chemotherapy) option.

Conventional medicine

Conventional medicine is defined as pharmacological, and other non-pharmacological used in conventional medicine systems to treat, prevent disease, or restore, correct, or modify physiological function.11

Outcome classification

We categorised outcomes into symptoms (eg, pain, insomnia); function (eg, poststroke motor function); surrogate outcomes (eg, blood pressure); quality of life (eg, short Form 36 survey); morality and major morbid events (eg, myocardial infarction).12

Eligibility criteria

Eligible CPGs met all the following criteria: (1) title or abstract included keywords ‘CPG’ or ‘guideline’ or ‘guidelines’ or ‘guidance’; If the CPG had no abstract, introduction, scope, purpose, rationale, background or objectives presented at least one of these keywords; (2) full text included ‘acupuncture’ or ‘acupressure’ or ‘transcutaneous electrical nerve’ (3) the CPG used at least one SRs addressing the benefits and harms of alternative care options to inform recommendations; (4) the CPG addressed patient prevention or treatment; (5) the CPG included at least one recommendation addressing acupuncture and (6) the latest version of a CPG when multiple versions exist. This study excluded health technology assessment.

Literature search

LL, HZ and YZ developed the search strategy. The keywords included guideline, recommendation, advice, opinion, acupuncture, transcutaneous electrical nerve stimulation, acupressure, etc (detail in online supplemental material 1). Two reviewers (ZC and XS) systematically searched databases including MEDLINE, EMBASE, Trip medical database, the Guidelines International Network, Agency for Healthcare Research and Quality, National Institute for Health and Care Excellence, Canadian Medical Association’s CPGs database, the New Zealand Ministry of Health, China National Knowledge Internet (CNKI), Wanfang Data, China Biology Medicine, and China Science and Technology Journal Database from 1 January 2010 to 20 September 2020. Without language restriction, we searched subject terms and free words. The reviewers managed records using EndNote (V.X9.0).

CPGs selection, data extraction and analysis

Reviewers, working in pairs, independently screened and extracted data. After title and abstract screening, reviewers retrieved and evaluated potentially eligible guidelines’ full texts, resolving disagreement by discussion or consultation with a third reviewer (XS). To collect data, we designed a structured data extraction table in Excel. Reviewers extracted two types of information from each CPG: (1) CPG level information, for example, region of the publication, types of CPG, target users, and diseases or conditions investigated, (2) recommendation level information, for example, strength and direction of the recommendation, intervention (eg, types of acupuncture and acupoints), comparators included in the recommendation, outcomes informing the recommendation. To compare the variables across different types of CPGs, we used the χ2 and, when necessary, Fisher’s exact test. When there are statistical differences among types of CPGs, we reported the data by type in the text, but when not, we reported the overall data. We showed all data in the tables. This study conducted the analyses using Statistical Package for the Social Sciences (SPSS, V.22) and set the significance level at 5% (p<0.05).

Quality appraisal

The study used the Appraisal of Guidelines Research and Evaluation II (AGREE-II) instrument, which includes 23 appraisal criteria (items) organised within six domains: scope and purpose, stakeholder involvement, the rigour of development, clarity of presentation, applicability, and editorial independence, to assess the quality of CPGs. Reviewers rated each item on a seven-point scale from strongly disagree (score 1) to strongly agree (score 7). We calculated the scaled domain score (higher score indicates better quality) according to AGREE II (the ‘obtained score’ was the sum of the appraisers' scores per item)13: (Obtained score − Minimum possible score) / (Maximum possible score − Minimum possible score). Prior to quality appraisal, eight reviewers received training in AGREE II with repeated assessment until the chance-corrected agreements were ≥0.6 for each pair of reviewers in each domain. Two reviewers (ZC and XT) independently assessed each CPG, and when the discussion failed to resolve the disagreement, a third reviewer (XS) arbitrated the case. AGREE II instrument does not set minimum domain scores or patterns of scores across domains to differentiate between high quality and low quality guidelines. As previously suggested, we considered domain and overall scores under 50% to indicate low quality, >50% as moderate quality and >80% as high quality.14–16

Patient and public involvement

No patient involved.

Results

Our initial search yielded 8943 citations, of which 3122 were excluded due to duplicate publication and 4848 deemed ineligible. Of the 973 full texts, we excluded 840 reports for the following reasons: 793 did not include any recommendation regarding acupuncture, 28 were not CPGs, 16 had unavailable full texts and 3 were duplicate publications. The 133 CPGs deemed eligible, including 433 acupuncture recommendations (figure 1).
Figure 1

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram. CPG, clinical practice guideline.

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram. CPG, clinical practice guideline.

Characteristics of included CPGs and recommendations

Table 1 and online supplemental material 2 present eligible CPGs’ summary characteristics.
Table 1

Characteristics of 133 included CPG in the study

VariableN (%)
Region
International3 (2.3)
America49 (36.8)
Asia44 (33.1)
Europe31 (23.3)
Oceania6 (4.5)
Type of CPG
Comprehensive CPG89 (66.9)
T&CM CPG13 (9.8)
Acupuncture-specific CPG31 (23.3)
CPGs with at least one acupuncture recommendation supported by systematic reviews
Comprehensive CPG46 (34.6)
T&CM CPG7 (5.3)
Acupuncture-specific CPG12 (9.0)
The health intent*
Treatment129 (97.0)
Prevention17 (12.8)
Target users*
Healthcare provider127 (95.5)
Policy-maker9 (6.8)
Patient39 (29.3)
Using GRADE to assess thecertainty of the evidence
Reported69 (51.9)
Not reported64 (48.1)
Using GRADE to assess the strength of recommendation
Reported59 (44.4)
Not reported74 (55.6)

*One CPG can contribute to more than one category.

CPG, clinical practice guidelines; GRADE, Grading of Recommendations Assessment, Development and Evaluation; T&CM, traditional and complementary medicine.

Characteristics of 133 included CPG in the study *One CPG can contribute to more than one category. CPG, clinical practice guidelines; GRADE, Grading of Recommendations Assessment, Development and Evaluation; T&CM, traditional and complementary medicine. The organisations that conducted CPGs were from North America (49, 36.8%), Asia (44, 33.2%), Europe (31, 23.3%), Oceania (6, 4.5%) and international organisations (eg, WHO) (3, 2.2%). Guideline category proved comprehensive in 89 (66.9%), acupuncture-specific CPGs in 31 (23.3%) and T&CM specific in 13 (9.8%). Sixty-nine (51.9%) used Grading of Recommendations Assessment, Development and Evaluation (GRADE) to assess the certainty of the evidence, and 59 (44.4%) used GRADE to assess the strength of recommendation. Figure 2 shows CPGs and recommendations’ therapeutic areas distribution, quantity, and methodological rigour. Areas most frequently addressed proved musculoskeletal and connective tissue diseases (39, 29.3%), neurological disorders (21, 15.8%) and oncology (11, 8.3%). CPGs seldom addressed endocrine, nutritional and metabolic, ophthalmology, cardiovascular diseases, respiratory diseases and dermatology (one per therapeutic area).
Figure 2

A multidimensional plot for acupuncture guidelines and recommendations’ quantity, methodological rigour and distribution of therapeutic areas. Each pie represents a therapeutic area. (1) Pie size: number of CPGs (larger=more studies). (2) Pie colour: direction of recommendation (green: recommend for, red: recommend against; pink: did not make a recommendation). CPG, clinical practice guideline.

A multidimensional plot for acupuncture guidelines and recommendations’ quantity, methodological rigour and distribution of therapeutic areas. Each pie represents a therapeutic area. (1) Pie size: number of CPGs (larger=more studies). (2) Pie colour: direction of recommendation (green: recommend for, red: recommend against; pink: did not make a recommendation). CPG, clinical practice guideline.

Methodological quality of CPGs

Table 2 presents CPGs AGREE II rating. Of all CPGs, domains evaluated by AGREE Ⅱ scored from the highest to lowest include: ‘scope and purpose,’ ‘clarity of presentation,’ ‘rigour of development,’ ‘stakeholder involvement’, ‘editorial independence,’ and ‘application.’ The first four domains proved moderate quality (ie, 50% or higher rating), and the last two domains deemed low quality (ie, scored less than 50%).
Table 2

The methodological quality of 133 CPGs (%)

DomainComprehensive CPGsT&CM CPGsAcupuncture-specific CPGsTotalP value
Scope and purpose74.066.095.278.40.386
Stakeholder involvement49.832.767.850.1
Rigour of development51.645.971.356.3
Clarity of presentation75.268.279.874.4
Application32.122.435.430.0
Editorial independence53.448.733.245.1

CPG, clinical practice guidelines; T&CM, traditional and complementary medicine.

The methodological quality of 133 CPGs (%) CPG, clinical practice guidelines; T&CM, traditional and complementary medicine. For comprehensive CPGs, ‘clarity of presentation’ (75.2%), ‘scope and purpose’ (74.0%), ‘editorial independence(53.4%)’ and ‘rigour of development’ (51.6%)proved moderate quality; meanwhile ‘stakeholder involvement(49.8%)’, and ‘application(32.1%)’ proved lower quality. For T&CM CPGs, ‘clarity of presentation’ (68.2%), and ‘scope and purpose’ (66.0%) were moderate quality; meanwhile ‘editorial independence’ (48.7%), ‘rigour of development’ (45.9%), ‘stakeholder involvement’ (32.7%) and ‘application’ (22.4%) were lower quality. For acupuncture-specific CPGs, ‘scope and purpose’ (95.2%) was high quality; and ‘clarity of presentation’ (79.8%), ‘rigour of development’ (71.3%), and ‘stakeholder involvement’ (67.8%) were moderate quality; meanwhile ‘application’ (35.4%) and ‘editorial independence’ (33.2%) were lower quality. The low rating in the ‘application’ domain reflects inadequate consideration of resource use (52, 39.1%) and monitoring/auditing standards. The absence of a conflict-of-interest (COI) statement (61, 45.9%) and lack of explicit explanation on how COIs are considered (58,43.6%) from CPGs developers led to the low rating in the ‘editorial independence’ domain. In addition to item 5 in AGREE II, whether guideline developers considered patients’ values and preferences, we evaluated whether the CPG explicitly explained how they considered it. The results showed that 43.6% reported considering patients' values and preferences, of which only less than 10.5% explicitly explained how they were considered (online supplemental 3 table A).

Acupuncture recommendations specific analyses

Evidence supporting acupuncture recommendations

Table 3 shows the evidence that supported acupuncture recommendations. Type of study design used to inform acupuncture recommendations from the most to the least frequently are randomised controlled trial and controlled clinical trial, SR and meta-analysis, observational study, narrative review, expert consensus and Chinese classic texts/textbook. Of all acupuncture recommendations, 314 (72.5%) used GRADE to assess the certainty of evidence. Low or very low certainty evidence supported over 80% of the 314 acupuncture recommendations.
Table 3

Evidence supports acupuncture recommendations

VariableN (%)
Type of study supporting acupuncture recommendations*(n=433)
SR or meta-analysis135 (31.2)
RCT or CCT250 (57.7)
Observational studies114 (26.3)
Narrative review36 (8.3)
Expert consensus24 (5.5)
Chinese classic texts/ Textbook4 (0.9)
Not reported47 (10.9)
Recommendations used GRADE to assess thecertainty of evidence (n=314)
Comprehensive CPG46 (40.7)
T&CM CPG24 (36.3)
Acupuncture-specific CPG244 (96.1)
Certainty of evidencesupporting recommendations using GRADE (n=314)
High5 (1.6)
Moderate33 (10.5)
Low105 (33.4)
Very low157 (50.0)
Not reported14 (4.5)

*One recommendation can contribute to more than one category.

development, and evaluation, CCT, controlled clinical trial; CPG, clinical practice guidelines; GRADE, Grading of Recommendations Assessment, Development and Evaluation; RCT, randomised controlled trial; SR, systematic review; T&CM, traditional and complementary medicine.

Evidence supports acupuncture recommendations *One recommendation can contribute to more than one category. development, and evaluation, CCT, controlled clinical trial; CPG, clinical practice guidelines; GRADE, Grading of Recommendations Assessment, Development and Evaluation; RCT, randomised controlled trial; SR, systematic review; T&CM, traditional and complementary medicine.

Direction, strength and rationale of the recommendations

Of the 433 acupuncture recommendations, 380 (87.8%) recommended or suggested using acupuncture, 28 (6.4%) recommended or suggested against, and 25 (5.8%) did not make recommendations. Of the 303 (70.0% of all recommendations in the guidelines) recommendations that used GRADE to determine the strength of recommendations, 152 (50.2%) were weak recommendations, and 131 (43.2%) were strong recommendations, of which 104 (79.4%) were supported by low or very low certainty evidence (we will refer to this situation as discordant recommendations15 (table 4).
Table 4

Direction and strength of acupuncture recommendations

VariableN (%)
The direction of the recommendation (n=433)
In favour380 (87.8)
Against28 (6.4)
Did not make recommendations25 (5.8)
Strength of the recommendation assessed with GRADE (n=303)
Strong 131 (43.2)
High and moderate certainty of the evidence26 (19.8)
Low and very low certainty of the evidence104 (79.4)
Not reported1 (0.8)
Weak 152 (50.2)
High and moderate certainty of the evidence10 (6.6)
Low and very low certainty of the evidence135 (88.8)
Not reported7 (4.6)
Not reported 20 (6.6)

GRADE, Grading of Recommendations Assessment, Development and Evaluation.

Direction and strength of acupuncture recommendations GRADE, Grading of Recommendations Assessment, Development and Evaluation. online supplemental 3 table B shows the rationale when making acupuncture recommendations. For all CPGs, treatment benefits are the main reason for recommending or against acupuncture (264, 61.0%). Forty-one (36.3%) comprehensive CPGs consider the certainty of evidence as an important issue in making recommendations, while T &CM and acupuncture-specific CPGs seldom consider certainty (1, 0.4%). Less than 10% of all CPGs reported patients’ values and preferences, cost, adverse events and feasibility as part of their rationale for making acupuncture recommendations.

Patient characteristics in acupuncture recommendations

Acupuncture recommendations report patient information poorly. Of all acupuncture recommendations, only 16 (8.7%) reported the severity of the disease. Seventeen (15.0%), 3 (4.5%), and 101 (39.8%) of the comprehensive, T & CM and acupuncture-specific CPGs reported the stage of the disease (online supplemental 3 table C).

Acupuncture interventions in the recommendations and remarks

Acupuncture recommendations and remarks reported limited details regarding acupuncture intervention (table 5). Comprehensive CPGs most frequently include manual acupuncture and acupressure in acupuncture recommendations. T&CM and acupuncture-specific CPGs most frequently include manual and electro-acupuncture in acupuncture recommendations. Most acupuncture recommendations in all CPGs focus on stand-alone usage of acupuncture therapies, and only 99 (22.9%) recommendations use acupuncture as a combination/ adjunct therapy. Moreover, almost no recommendations reported the acupuncture points selection except for acupuncture-specific CPGs (206, 81.1%).
Table 5

Details of acupuncture interventions in the recommendations and remarks

Description of acupuncture interventionN (%)P value
Comprehensive CPGsT&CM CPGsAcupuncture-specific CPGs
Type of acupuncture* (n=433)
Manual acupuncture57 (50.4)37 (56.1)121 (47.6)<0.001
Electroacupuncture13 (11.5)13 (19.7)42 (16.5)
Acupressure19 (16.8)2 (3.0)5 (2.0)
Moxibustion, warm needling, fire needling6 (5.3)12 (18.2)55 (21.7)
Other†26 (23.0)14 (21.2)97 (38.2)
Not reported44 (38.9)14 (21.2)15 (5.9)
Acupuncture alone or with other interventions* (n=433)
Alone100 (88.5)42 (63.6)192 (75.6)0.006
With conventional medicine4 (3.5)9 (13.6)16 (6.3)
With Chinese herbal medicine2 (1.8)4 (6.1)5 (2.0)
With Non-pharmacological interventions10 (8.8)14 (21.2)41 (16.1)
Acupuncture points selection (n=433)
Reported6 (5.3)20 (30.3)206 (81.1)<0.001
Not reported107 (94.7)46 (69.7)48 (18.9)
Acupuncture points selection based onTraditional Chinese medicine syndromedifferentiation (n=433)
Reported0 (0.0)1 (1.5)39 (15.4)<0.001
Not reported113 (100.0)65 (98.5)215 (84.6)
Acupuncture points selection based onMeridian syndrome differentiation (n=433)
Reported0 (0.0)0 (0.0)5 (2.0)0.177
Not reported113 (100.0)66 (100.0)249 (98.0)

*One recommendation can contribute to more than one category.

†Include laser acupuncture, microsystem acupuncture, thread-embedding therapy, medicine acicula, point injection, transcutaneous electrical nerve, acupoint paste; magnetic acupuncture, blood-letting therapy, acupotomy.

CPG, clinical practice guidelines; T&CM, traditional and complementary medicine.

Details of acupuncture interventions in the recommendations and remarks *One recommendation can contribute to more than one category. †Include laser acupuncture, microsystem acupuncture, thread-embedding therapy, medicine acicula, point injection, transcutaneous electrical nerve, acupoint paste; magnetic acupuncture, blood-letting therapy, acupotomy. CPG, clinical practice guidelines; T&CM, traditional and complementary medicine.

Comparators in acupuncture recommendations

Approximately three-quarters of the CPGs recommendations (323, 74.6%) did not report the comparators (online supplemental 3 table D). Among all CPGs recommendations that reported the comparators, comprehensive CPGs most often compared acupuncture with no acupuncture (12, 10.6%), T&CM CPGs most often compared acupuncture with non-pharmacological therapy (22, 33.3%), and acupuncture-specific CPGs most often compared acupuncture with conventional medicine (32, 12.6%).

Outcomes summarised to inform acupuncture recommendations

Among all acupuncture recommendations, 130 (30.0%) did not summarise the outcomes used to inform recommendations: 43/113, 38/66 and 49/254 were in comprehensive, T&CM and acupuncture-specific CPGs. Of the remaining 382, from the most to the least summarised types of outcomes are: symptoms (253, 58.4%), function (86, 19.9%), quality of life (29, 6.7%), surrogate outcomes (12, 2.8%), mortality (1, 0.2%) and major morbid events (1, 0.2%) (online supplemental 3 table E).

Discussion

This study identified 133 CPGs and 433 recommendations addressing acupuncture intervention published between 2010 and 2019 that most frequently addressed musculoskeletal and connective tissue diseases (29.3%), neurological disorders (15.8%), obstetrics, gynaecology, and women’s health (9.7%), and oncology (9.0%) (figure 2). Guidelines overwhelmingly recommended in favour of acupuncture (87.8% of recommendations), with the remainder split more or less evenly between recommendations against or no recommendation. Of the 303 (70.0%) recommendations that used GRADE to determine the strength of recommendations, 152 (50.2%) were weak recommendations, 131 (43.2%) were strong recommendations, of which 104 (79.4%) were supported by low or very low certainty evidence (discordant recommendations). According to the AGREE II instrument, included CPGs proved moderate quality in ‘scope and purpose,’ ‘clarity of presentation,’ ‘rigour of development’ and ‘stakeholder involvement,’ but low quality in ‘editorial independence’ and ‘applicability’ domains.

Strengths and limitations

Our study, the most comprehensive that systematically evaluated CPGs addressing acupuncture interventions, has several strengths. First, this systematic survey includes a comprehensive search of eligible CPGs, systemic and explicit application of eligibility criteria, duplicate and independent study selection and data extraction, and rigorous methodological assessment of CPGs using the AGREE-II instrument. Second, our research investigated the utilisation of the GRADE approach in CPGs and recommendations. Moreover, we documented recommendations discordant with respect to strength and certainty. Third, this survey identified the missing aspect in AGREE II that most acupuncture-related CPGs did not explicitly report how they consider patients’ values and preferences, hindering guidelines’ applicability. The limitation of our study includes: (1) we did not include Japanese and South Korean guideline databases, and (2) we excluded guidelines not supported by any SRs—thus, results do not apply to the lowest methodological quality guidelines.

Relation to other studies

Jeremy Y Ng.et al17 investigated the quantity and quality of T&CM (eg, herbal medicine, acupuncture, chiropractic and osteopathic manipulation) guidelines in MEDLINE, EMBASE and CINAH, etc. This survey examined a few selected interventions in T & CM and only included three acupuncture-related guidelines. Guo LH et al18 evaluated the methodological quality of acupuncture CPGs conducted by the China Institute of Acupuncture and Moxibustion. Consistent with our results, both articles identified ‘applicability’ and ‘editorial independence’ as Acupuncture-specific CPGs ’main limitations, but they omitted non-Chinese CPGs. Guo Y et al6 conducted a systematic survey to summarise the diseases and disorders most commonly treated with acupuncture in CPGs and concluded that acupuncture recommendations might be limited to painful conditions. They only searched the National Guideline Clearinghouse database, which might explain their failure to present the broad picture of acupuncture guidelines that our survey describes. None of the three studies analysed whether patients’ values and preferences were explicitly considered, and only Wu et al summarised whether CPGs used the GRADE approach.

Implications

Acupuncture guidelines could improve by consistently supporting recommendations with SRs, explicitly considering patients’ values and preferences, providing additional details regarding patients’ characteristics, acupuncture interventions/definition, comparators and outcomes summarised. Despite available evidence and the wide application of acupuncture as an adjunct therapy in practice (eg, in combination with conventional medicine),19–22 acupuncture recommendations often do not address this question. Future guidelines should much more frequently address this issue. The GRADE approach perceives strong recommendations supported by low or very low certainty evidence (ie, discordant recommendations) as questionable and often inappropriate.23 Guidelines addressing acupuncture intervention should better understand the GRADE approach, include panels that support the GRADE approach’s optimal usage, and collaborate with well-trained methodologists to avoid discordant recommendations.24 25 Both financial and intellectual COIs can impact panels and guideline developers’ judgement and the recommendations.26 27 Proper management of COIs can mitigate bias related to it and increase CPGs’ credibility. CPGs addressing acupuncture should report guideline’ funding sources, declare and manage all guideline developers and panel members’ COIs considering available literature.28 29

Conclusion

In the past 10 years, many CPGs addressing acupuncture interventions covering various diseases and conditions exist. Although these guidelines may be as or more rigorous than many others, considerable room for improvement remains, particularly, guideline developers should better manage COIs, explicitly considering patients values and preferences and resources utilisation, using more SRs to support recommendations and avoiding discordant recommendations.
  24 in total

Review 1.  Acupuncture in the management of pain of musculoskeletal and neurologic origin.

Authors:  J Y Wong; L M Rapson
Journal:  Phys Med Rehabil Clin N Am       Date:  1999-08       Impact factor: 1.784

2.  Guidelines International Network: toward international standards for clinical practice guidelines.

Authors:  Amir Qaseem; Frode Forland; Fergus Macbeth; Günter Ollenschläger; Sue Phillips; Philip van der Wees
Journal:  Ann Intern Med       Date:  2012-04-03       Impact factor: 25.391

3.  AGREE II: advancing guideline development, reporting, and evaluation in health care.

Authors:  Melissa C Brouwers; Michelle E Kho; George P Browman; Jako S Burgers; Francoise Cluzeau; Gene Feder; Béatrice Fervers; Ian D Graham; Jeremy Grimshaw; Steven E Hanna; Peter Littlejohns; Julie Makarski; Louise Zitzelsberger
Journal:  Prev Med       Date:  2010-08-20       Impact factor: 4.018

4.  Recommendations for acupuncture in clinical practice guidelines of the national guideline clearinghouse.

Authors:  Yao Guo; Hong Zhao; Fang Wang; Si-Nuo Li; Yu-Xiu Sun; Ming-Juan Han; Bao-Yan Liu
Journal:  Chin J Integr Med       Date:  2017-01-24       Impact factor: 1.978

5.  Quality of reporting and evidence in American Academy of Pediatrics guidelines.

Authors:  Andre Isaac; Michael Saginur; Lisa Hartling; Joan L Robinson
Journal:  Pediatrics       Date:  2013-03-25       Impact factor: 7.124

6.  Cost-effectiveness of acupuncture care as an adjunct to exercise-based physical therapy for osteoarthritis of the knee.

Authors:  David G T Whitehurst; Stirling Bryan; Elaine M Hay; Elaine Thomas; Julie Young; Nadine E Foster
Journal:  Phys Ther       Date:  2011-03-17

7.  Acupuncture as an adjunct therapy in the treatment of eating disorders: a randomised cross-over pilot study.

Authors:  Sarah Fogarty; David Harris; Chris Zaslawski; Andrew J McAinch; Lily Stojanovska
Journal:  Complement Ther Med       Date:  2010-10-18       Impact factor: 2.446

8.  Doctors' attitudes to acupuncture--a Norwegian study.

Authors:  A J Norheim; V Fønnebø
Journal:  Soc Sci Med       Date:  1998-08       Impact factor: 4.634

9.  Conflict of interest as ethical shorthand: understanding the range and nature of "non-financial conflict of interest" in biomedicine.

Authors:  Quinn Grundy; Christopher Mayes; Kelly Holloway; Sasha Mazzarello; Brett D Thombs; Lisa Bero
Journal:  J Clin Epidemiol       Date:  2019-12-19       Impact factor: 6.437

Review 10.  Guidelines for the symptomatic management of fever in children: systematic review of the literature and quality appraisal with AGREE II.

Authors:  Elena Chiappini; Barbara Bortone; Luisa Galli; Maurizio de Martino
Journal:  BMJ Open       Date:  2017-07-31       Impact factor: 2.692

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.