Reporting specifications regarding epilepsy practice guidelines based on the RIGHT reporting checklist: an analysis.

OBJECTIVE: Clinical guidelines are designed to optimise patient care and provide efficient approaches for therapy. Epilepsy is a chronic brain disorder that continues to experience a considerable treatment gap due to non-standard recommendations. We assessed the reporting quality of clinical practice guidelines on epilepsy over the past 5 years to generate a reporting specification for this study.
SETTING: Seven databases were searched in May 2018 focusing on the period from 2013 to 2018. These included Medline, EMBASE, PubMed, Cumulative Index to Nursing and Allied Health Literature, China National Knowledge Infrastructure, Wanfang and Chinese Science and Technology Journal Database (VIP). Reporting quality of epilepsy guidelines was assessed by two independent authors using the Reporting Items for practice Guidelines in HealThcare (RIGHT) approach. Spearman's correlation was used to assess inter-rater reliability. PARTICIPANTS: Participants with epilepsy or seizure, not limited by age, gender, course of disease or cause of epilepsy, were included.
INTERVENTIONS: There were no limitations with regard to intervention. PRIMARY AND SECONDARY OUTCOME MEASURES: The outcome was the ability of the RIGHT tool to measure reporting quality.
RESULTS: Twelve relevant guidelines were included in this study. The reporting quality was not high in any of the included guidelines. The highest reporting quality included a 'yes' proportion of 77.1%, whereas the worst included a corresponding proportion of 37.1%. Overall evaluation results showed that 16.7% of the included guidelines were of high quality, 75% were of medium quality and 8.3% were of low quality. The correlation between the two estimators was credible (ρ>0.7).
CONCLUSIONS: Appraisal of these guidelines using the RIGHT tool revealed that the quality of reporting varied among guidelines. Items that exhibited low quality in most included guidelines were healthcare questions, rationale/explanation for recommendations, quality assurance, funding source(s) and role(s) of the funder, and limitations of the guideline. Thus, these aspects should receive greater attention in future guideline reporting. © Author(s) (or their employer(s)) 2019. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

To the best of our knowledge, no studies have assessed the quality of epilepsy guidelines using the Reporting Items for practice Guidelines in HealThcare (RIGHT) checklist.

The included guidelines were measured using the RIGHT tool, produced by the Practice Guidelines in Healthcare Group, a component of WHO.

Twelve relevant guidelines, involving six regions, were included in this study.

The study showed insufficient reporting quality in some areas.

This study indicates that greater attention is needed with regard to healthcare questions, rationale/explanation for recommendations, quality assurance, and funding source(s) and role(s) of the funder in future guidelines reporting.

Introduction

Epilepsy is a chronic, repeating, relapsing neurological brain disorder with high incidence and mortality rates, and the disorder can affect any individual irrespective of age, region and ethnicity.1 2 According to WHO in 2014, there are approximately 50 million patients with epilepsy worldwide, with the disease morbidity rate being 4‰−7‰. Compared with adults, children and adolescents have a higher prevalence but a lower mortality rate. An earlier study reported that mortality from the disorder was up to 3% in American children, but more than 30% in American adults.3 Although the disorder can be controlled in most patients by appropriate therapy, some (especially those living in developing countries) are not able to receive appropriate treatment for reasons such as poor income, cognitive deficiencies and healthcare costs. In China, for example, the treatment gap is approximately 63%, implying that about four million patients do not receive the recommended treatment for epilepsy.4

Clinical guidelines based on high-quality systematic review evidence assessed the benefits and limitations of alternative care options for facilitating optimised patient care and effective therapy approaches.5 With increasing worldwide attention to epilepsy, a growing body of clinical guidelines are available. However, these guidelines are not standardised, varying in terms of the respective country’s definition of epilepsy. Although clinical guidelines allow for standardising and improving the quality of clinical practice, questions on guideline development and reporting remain unanswered.6 7 Ineffective treatment methods for epilepsy persist because of unclear pathogenesis and lack of quality, standardised clinical guidelines. An instructive clinical guideline should be based on high-quality evidence-based systematic reviews and reporting. However, the reporting quality of clinical guidelines seems low,8 and the currently used tools do not accurately address quality assessment and reporting in a single statement. There are two reporting checklists available for clinical guidelines: one is the Appraisal of Guidelines, Research and Evaluation instrument (AGREE) and another is the Reporting Items for practice Guidelines in HealThcare (RIGHT). AGREE, developed by a small group, was produced for use in both quality assessment and reporting, although it was limited to items derived from the tool itself (rather than other assessments).9 To construct a specific clinical guideline and fill the gap in current assessment approaches, Chen and colleagues10 from the WHO established the RIGHT tool.

In this review, we analyse the reporting quality of epilepsy practice guidelines based on the RIGHT tool. This will help identify insufficient reporting section to better guide clinical control of epilepsy.

Methods

Study design

This study comprised a review of epilepsy clinical practice guidelines (CPG) using the RIGHT tool.

Review protocol

This study was performed in accordance with the guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses.11

Eligibility criteria

Types of guidelines

Guidelines that focused on preventive and/or therapeutic intervention in epilepsy were included, whereas those solely describing epidemiology, training, research methods or legal issues regarding epilepsy were excluded. Furthermore, summarised organisational guidelines, comments or correspondence studies were excluded.

Types of participants and public involvement

There were no patients involved in this study. In this study, we focused on guidelines and not participants themselves, which needs no ‘Patient and Public Involvement’. In those included guidelines, participants with epilepsy or seizure, regardless of age, gender, course of disease or cause of epilepsy (eg, caused by pregnancy or trauma), were included.

Types of interventions

There were no limitations with regard to interventions. Drug therapies and non-drug therapies recommended in the guidelines were included.

Literature search

Guidelines meeting the eligibility criteria were searched in English and Chinese using a computer program to avoid subjective interpretation. Seven databases, Medline, EMBASE, PubMed, Cumulative Index to Nursing and Allied Health Literature, China National Knowledge Infrastructure, Wanfang and Chinese Science and Technology Journal Database (VIP), were searched for articles published from January 2013 to December 2018. The search strategy used the terms ‘epilepsy’ or ‘seizure’ (‘癫痫’) AND ‘guideline’ or ‘guidance’ or ‘recommendation’ or ‘consensus’ or ‘policy’ (‘指南’ or ‘专家共识’). We also searched Medline, a publicly available repository of guidelines in China (http://guide.medlive.cn), using keyword searches based on the eligibility criterion of ‘epilepsy’ (‘癫痫’). Concomitantly, the National Guideline Clearinghouse (http://www.guideline.gov), National Institute for Health and Care Excellence (http://www.nice.org.uk), International League Against Epilepsy (ILAE) (http://www.ilae.org) and WHO (http://www.who.int) were searched using the terms ‘epilepsy’ or ‘seizure’ AND ‘guideline’. Two authors (ZW and YZ) screened the titles and abstracts independently to standardise screening, and selection differences, if any, were resolved through discussion. Full texts were screened to confirm eligibility.

Data extraction

The following information was extracted from each guideline: title of the guideline, region(s) of guideline development, year of publication, source of publication, organisation(s) responsible for the guideline, number of authors, target population, funding, guideline focus and whether it was an update of a previous edition. Other information pertaining to guideline format included basic information, background, evidence, recommendations, review and quality assurance, funding, declaration and management of interests, and other information (eg, suggestions for further research and limitations of the guideline).

Assessment of the quality of reporting

The RIGHT tool is a checklist that can be used to assess the reporting quality of CPG, and aids in understanding and implementation of clinical guidelines, serves as a standard for guideline reporting in peer reviews (ie, for reviewers and journal editors), and assists developers in guideline reporting.10 The RIGHT tool consists of seven sections: basic information (items 1–4), background (items 5–9), evidence (items 10–12), recommendation (items 13–15), review and quality assurance (items 16–17), funding and declaration and management of interests (items 18–19), and other information (items 20–22). Assessment was performed by two authors (ZW and YZ); ‘yes’ indicated full reporting of necessary information, whereas ‘no’ indicated partial or no reporting. We defined reporting to be of high quality if the ‘yes’ responses were >70%, medium quality if they were 40%–70% and low quality if they were <40%. Spearman’s correlation was used to assess inter-rater reliability (ρ>0.7 indicated good inter-rater reliability). If opinions differed, a third author (LL) made a final decision. The percentage of fully reported items was expressed to assess reporting quality of guidelines.

Data analysis and investigation of heterogeneity

Data were analysed using SPSS V.19.0 and Microsoft Excel (Microsoft, Redmond, Washington, USA). The descriptive results are shown in tables. Inter-rater reliability was calculated for each domain of the RIGHT instrument using intraclass correlation coefficient with a ρ value.

Results

Of the total 938 potentially relevant articles identified, 883 were excluded after title and abstract screening. The remaining 55 were retrieved and full texts were read, resulting in 12 guidelines that met the inclusion criteria (figure 1).

Figure 1

PRISMA flow diagram for this study. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; RIGHT, Reporting Items for practice Guidelines in HealThcare.

Guideline characteristics

The characteristics of the included guidelines12–23 are detailed in table 1. Of the included guidelines, one16 produced by the ILAE was an international guideline, one20 established by the ILAE-Commission on European Affairs focused on women and girls with epilepsy in Europe, one19 was published for neonatal seizure in Australia, two were published in the USA (one15 focused on vagus nerve stimulation and the other17 focused on convulsive status epilepticus), two were published in the UK (one14 was published in Scotland not focused on epilepsy in pregnancy and the other18 placed emphasis on epilepsy in pregnancy all over the UK), and four were published in China (three12 21 22 were produced in mainland China and one14 was produced in Hong Kong). One22 guideline referred to treatments involving traditional Chinese medicine (TCM), but was limited to a summary of this approach; another was a guideline established for TCM clinical diagnosis and treatment of paediatric patients, including a detailed description of TCM treatments for children with epilepsy; and one23 guideline focused on presurgical epilepsy work-up. The correlation between the two estimators is shown in table 2, and the ρ of each item was >0.7, indicating the robustness of this study results.

Table 1

Guideline characteristics

Title of guideline	Region(s) of publication	Year of publication	Source of publication	Organisation(s) responsible for guideline	Authors (n)	Target population	Funding	Previous edition updating
Clinical practice guideline12	China	2015	Journal of Epilepsy, People’s Medical Publishing House	CAAE	63	Adult	NR	Yes, 2006
An update of the Hong Kong Epilepsy Guideline: consensus statement on the use of antiepileptic drugs in Hong Kong13	China, Hong Kong	2017	Hong Kong Medical Journal (https://www.hkmj.org)	HKES	14	Adult and children	Hong Kong Epilepsy Society	Yes, 2009
Diagnosis and management of epilepsy in adults. A national clinical guideline14	Scotland, UK	2015	SIGN publication no 143(https://www.sign.ac.uk/guidelines/fulltext/50/index.html)	SIGN	26	Adult	NR	No
Evidence-based guideline update: vagus nerve stimulation for the treatment of epilepsy: report of the Guideline Development Subcommittee of the American Academy of Neurology15	USA	2013	Neurology (http://www.neurology.org/content/early/2013/08/28/WNL.0b013e3182a393d1.full.html)	AAN	6	Adult and children	AAN	Yes, 1999
Updated ILAE evidence review of antiepileptic drug efficacy and effectiveness as initial monotherapy for epileptic seizures and syndromes16	International	2013	Epilepsia	ILAE	10	Adult and children	ILAE, NIH, Epilepsy Research Foundation	Yes, 2006
Evidence-based guideline: treatment of convulsive status epilepticus in children and adults: report of the Guideline Committee of the American Epilepsy Society17	USA	2016	Epilepsy C urrents	AES	16	Adult and children	Epilepsy Foundation, Child Neurology Society, American College of Emergency Physicians, Association of Child Neurology Nurses, American Association of Neuroscience Nurses	No
Epilepsy in pregnancy. Green-top Guideline No 6818	UK	2016	https://www.nice.org.uk	RCOG	6	Women in pregnancy	Association of British Neurologists, Epilepsy Action, Royal College of General Practitioners, Royal College of Midwives and the Royal College of Physicians	No
Queensland Clinical Guidelines: neonatal seizure19	Australia	2017	https://www.health.qld.gov.au/qcg	QCG	37	Neonatal	Healthcare Improvement Unit, Queensland Health	Yes, 2011
Valproate in the treatment of epilepsy in girls and women of childbearing potential: recommendations from a joint task force of ILAE-Commission on European Affairs and EAN20	European	2015	Epilepsia	ILAE-Commission on European Affairs, EAN	8	Women and girls	CEA-ILAE, EAN	No
Expert consensus: long-term management of epilepsy in children21	China	2013	Chinese Journal of Paediatrics (http://d.wanfangdata.com.cn/Periodical_zhek201309016.aspx)	CMA	29	Children	NR	No
Guideline for TCM pediatrics clinical diagnosis and treatment pediatric epilepsy (amendment)22	China	2017	Journal of Paediatrics of TCM	CACM	12	Children	SATCM	Yes, 2014
Revised version of quality guidelines for presurgical epilepsy evaluation and surgical epilepsy therapy issued by the Austrian, German and Swiss working group on presurgical epilepsy diagnosis and operative epilepsy treatment23	Austria, Germany and Switzerland	2016	Epilepsia	WG	14	Presurgical epilepsy	NR	Yes, 2014

AAN, American Academy of Neurology; AES, American Epilepsy Society; CAAE, China Association Against Epilepsy; CACM, China Association of Chinese Medicine; CEA-ILAE, Commission of European Affairs of the International League Against Epilepsy; CMA, Chinese Medical Association; EAN, European Academy of Neurology; HKES, Hong Kong Epilepsy Society; ILAE, International League Against Epilepsy; NIH, National Institutes of Health; NR, not reported; QCG, Queensland Clinical Guidelines; RCOG, Royal College of Obstetricians and Gynaecologists; SATCM, State Administration of Traditional Chinese Medicine; SIGN, Scottish Intercollegiate Guidelines Network; TCM, traditional Chinese medicine; WG, executive board of the working group (WG) on presurgical epilepsy diagnosis and operative epilepsy treatment.

Table 2

Assessment Spearman’s correlation (ρ) of every item

Items	Criteria	Number of ‘yes’	%	Spearman’s correlation (ρ)
Basic information
1	Title/subtitle	12	100	0.90
2	Executive summary	12	100	0.90
3	Abbreviations and acronyms	12	100	0.87
4	Corresponding developer	10	83.3	0.84
Background
5	Brief description of the health problem(s)	10	83.3	0.86
6	Aim(s) of the guideline and specific objectives	10	83.3	0.84
7	Target population(s)	9	75	0.81
8	End users and settings	3	25	0.81
9	Guideline development groups	5	41.7	0.78
Evidence
10	Healthcare questions	0	0	0.82
11	Systematic reviews	11	91.6	0.73
12	Assessment of the certainty of the body of evidence	6	50	0.71
Recommendations
13	Recommendations	6	50	0.76
14	Rationale/explanation for recommendations	0	0	0.77
15	Evidence to decision processes	2	16.7	0.72
Review and quality assurance
16	External review	6	50	0.88
17	Quality assurance	1	8.3	0.97
Funding and declaration and management of interests
18	Funding source(s) and role(s) of the funder	2	16.7	0.91
19	Declaration and management of interests	4	33.3	0.82
Other information
20	Access	10	83.3	0.87
21	Suggestions for further research	4	33.3	0.82
22	Limitations of the guideline	1	8.3	0.93

Quality of reporting evaluation by RIGHT

The quality of guideline reporting was evaluated using the RIGHT tool; notably, most included guidelines did not show high reporting quality (table 3). We assessed each item in strict accordance with the standard and calculated the percentage of fully reported items. The best reporting quality achieved a score of 77.1%,18 whereas the worst achieved a score of 37.1%.21 Overall evaluation results showed that 16.7% of included guidelines were of high quality, 75% were of medium quality and 8.3% were of low quality (figure 2).

Table 3

Quality of reporting evaluation by RIGHT (each item)

Section/topic	Number	Item	Assessment
			12	13	14	15	16	17	18	19	20	21	22	23
Basic information
Title/subtitle	1a	Identify the report as a guideline, that is, with ‘guideline(s)’ or ‘recommendation(s)’ in the title.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
	1b	Describe the year of publication of the guideline.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
	1c	Describe the focus of the guideline, such as screening, diagnosis, treatment management, prevention or others.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Executive summary	2	Provide a summary of the recommendations contained in the guideline.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Abbreviations and acronyms	3	Define new or key terms, and provide a list of abbreviations and acronyms if applicable.	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes
Corresponding developer	4	Identify at least one corresponding developer or author who can be contacted about the guideline.	No	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Background
Brief description of the health problem(s)	5	Describe the basic epidemiology of the problem, such as the prevalence/incidence, morbidity, mortality and burden (including financial) resulting from the problem.	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes	Yes	No	Yes
Aim(s) of the guideline and specific objectives	6	Describe the aim(s) of the guideline and specific objectives, such as improvements in health indicators (eg, mortality and disease prevalence), quality of life or cost saving.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	No	Yes
Target population(s)	7a	Describe the primary population(s) that is affected by the recommendation(s) in the guideline.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
	7b	Describe any subgroups that are given special consideration in the guideline.	Yes	No	Yes	Yes	Yes	Yes	No	Yes	Yes	No	Yes	Yes
End users and settings	8a	Describe the intended primary users of the guideline (such as primary care providers, clinical specialists, public health practitioners, programme managers and policymakers) and other potential users of the guideline.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes
	8b	Describe the setting(s) for which the guideline is intended, such as primary care, low-income and middle-income countries, or inpatient facilities.	Yes	Yes	No	No	No	No	No	No	No	No	No	Yes
Guideline development groups	9a	Describe how all contributors to the guideline development were selected and their roles and responsibilities (eg, steering group, guideline panel, external reviewers, systematic review team and methodologists).	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes
	9b	List all individuals involved in developing the guideline, including their title, role(s) and institutional affiliation(s).	No	Yes	Yes	No	No	Yes	Yes	Yes	Yes	No	Yes	No
Evidence
Healthcare questions	10a	State the key questions that were the basis for the recommendations in PICO (population, intervention, comparator and outcome) or other format as appropriate.	No	No	No	No	No	No	No	No	No	No	No	No
	10b	Indicate how the outcomes were selected and sorted.	Yes	No	No	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	No
Systematic reviews	11a	Indicate whether the guideline is based on new systematic reviews done specifically for this guideline or whether existing systematic reviews were used.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes
	11b	If the guideline developers used existing systematic reviews, reference these and describe how those reviews were identified and assessed (provide the search strategies and the selection criteria, and describe how the risk of bias was evaluated) and whether they were updated.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes
Assessment of the certainty of the body of evidence	12	Describe the approach used to assess the certainty of the body of evidence.	No	No	No	No	Yes	Yes	Yes	Yes	No	No	Yes	Yes
Recommendations
Recommendations	13a	Provide clear, precise and actionable recommendations.	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
	13b	Present separate recommendations for important subgroups if the evidence suggests that there are important differences in factors influencing recommendations, particularly the balance of benefits and harms across subgroups.	Yes	No	Yes	Yes	Yes	Yes	Yes	No	Yes	Yes	Yes	Yes
	13c	Indicate the strength of recommendations and the certainty of the supporting evidence.	No	Yes	Yes	Yes	Yes	Yes	Yes	No	No	No	Yes	Yes
Rationale/explanation for recommendations	14a	Describe whether values and preferences of the target population(s) were considered in the formulation of each recommendation. If yes, describe the approaches and methods used to elicit or identify these values and preferences. If values and preferences were not considered, provide an explanation.	No	No	No	No	No	No	No	No	No	No	Yes	Yes
	14b	Describe whether cost and resource implications were considered in the formulation of recommendations. If yes, describe the specific approaches and methods used (such as cost-effectiveness analysis) and summarise the results. If resource issues were not considered, provide an explanation.	No	No	No	No	No	No	No	No	No	No	Yes	No
	14c	Describe other factors taken into consideration when formulating the recommendations, such as equity, feasibility and acceptability.	No	No	No	No	No	No	Yes	No	No	No	No	Yes
Evidence to decision processes	15	Describe the processes and approaches used by the guideline development group to make decisions, particularly the formulation of recommendations (such as how consensus was defined and achieved and whether voting was used).	No	No	No	No	Yes	No	No	No	No	No	Yes	No
Review and quality assurance
External review	16	Indicate whether the draft guideline underwent independent review and, if so, how this was executed and the comments considered and addressed.	Yes	No	Yes	No	No	No	Yes	Yes	Yes	No	Yes	No
Quality assurance	17	Indicate whether the guideline was subjected to a quality assurance process.	No	No	No	No	Yes	No	No	No	No	No	No	No
Funding and declaration and management of interests
Funding source(s) and role(s) of the funder	18a	Describe the specific sources of funding for all stages of guideline development.	No	Yes	No	Yes	Yes	Yes	Yes	Yes	Yes	No	Yes	No
	18b	Describe the role of funder(s) in the different stages of guideline development and in the dissemination and implementation of the recommendations.	No	No	No	Yes	Yes	No	No	No	No	No	No	No
Declaration and management of interests	19a	Describe what types of conflicts (financial and non-financial) were relevant to guideline development.	No	No	No	Yes	No	Yes	Yes	No	Yes	No	Yes	Yes
	19b	Describe how conflicts of interest were evaluated and managed and how users of the guideline can access the declarations.	No	No	No	Yes	No	No	Yes	No	Yes	No	Yes	No
Other information
Access	20	Describe where the guideline, its appendices and other related documents can be accessed.	No	No	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes	Yes
Suggestions for further research	21	Describe the gaps in the evidence and/or provide suggestions for future research.	No	No	No	Yes	Yes	Yes	Yes	No	No	No	No	No
Limitations of the guideline	22	Describe any limitations in the guideline development process (such as the development groups were not multidisciplinary or patients’ values and preferences were not sought), and indicate how these limitations might have affected the validity of the recommendations.	No	No	No	No	No	Yes	No	No	No	No	No	No
Per cent of ‘yes’*			51.4	48.6	54.3	68.6	68.6	68.6	77.1	54.3	65.7	37.1	74.3	65.7

*'yes’ means full reporting of the information needed; ‘no’ means partly or not reporting.

RIGHT, Reporting Items for practice Guidelines in HealThcare.

Figure 2

Quality of reporting evaluation by RIGHT. (A) Reporting quality for each guideline. (B) Overall evaluation of reporting quality.

Basic information

In general, all included guidelines showed sufficient reporting of basic information. Only two12 14 did not report any corresponding developers or authors, whereas others fully reported the title, executive summary, abbreviations and corresponding information.

Background

Background was not adequately reported in any of the included guidelines; notably, two16 22 did not describe the epidemiology of epilepsy, two19 22 did not clearly describe the aim of the guidelines, three12 18 21 had no subgroups, one19 did not explicitly describe the intended primary and potential users, two13 21 did not describe the specific roles of authors who contributed to guideline development, and four12 15 16 21 did not list the identity information of authors. Furthermore, only two12 13 guidelines were intended to focus on low-income regions.

Evidence

Reporting of evidence was inadequate. Although most included guidelines stated that they were developed based on randomised controlled trials or meta-analyses, none included regular reporting of population, intervention, comparator and outcome. Four guidelines13 14 21 23 did not indicate the manner in which outcomes were selected, and it was unclear whether those guidelines were the first version or an updated version.21 Five16–19 22 included guidelines assessed evidence in accordance with the Grading of Recommendations Assessment, Development and Evaluation approach.

Recommendation

Clear and actionable recommendations were provided in all guidelines; however, four12 19–21 did not clearly indicate the strength of each recommendation, only one22 considered feedback from children with epilepsy and their parents (ie, through follow-up and online survey), two16 22 emphasised that guideline development groups had made decisions through repeated discussions, and only two guidelines18 23 included equity when formulating its recommendations.

Review and quality assurance

Six guidelines12 14 18–20 22 had been peer-reviewed, and only one16 had undergone quality assurance process.

Funding and declaration and management of interests

Three guidelines12 14 21 did not describe the funding sources, whereas two15 16 precisely declared that the stakeholder did not participate in the development of the guidelines at any stage. Four15 18 20 22 had detailed a description of the conflict of interest of the authors.

Other information

Most guidelines provided accession websites for the full guidelines and their appendices but two.12 13 Four guidelines15–18 provided suggestions for further research; one17 presented some limitations of its use and suggested future guideline developers to avoid such limitations.

Discussion

This study identified 12 guidelines on epilepsy published in the past 5 years, including both Western medicine and TCM. Appraisal of these guidelines with the RIGHT tool revealed that the quality of reporting varied among guidelines. Some of the included guidelines showed relatively higher quality and favourable overall recommendations; these could be used by healthcare providers and patients as the basis for discussion on management of epilepsy. However, considering individual differences among patients, each recommendation should be used with caution. Moreover, some items in these guidelines were of low quality (eg, healthcare-related questions, rationale/explanation for recommendations, quality assurance, funding source(s) and role(s) of the funder, and limitations of the guideline); thus, these aspects should receive greater attention in future guideline reporting.

Notable strengths of this study include its use of comprehensive systematic review to identify eligible clinical guidelines and its assessment of quality using the RIGHT tool, which is published by the WHO and is an internationally accepted standard for appraisal of guidelines. This study found that CPGs for epilepsy are wide-ranging and have been published in many regions in the past 5 years.

However, according to the appraisal of each item based on the RIGHT tool, all included guidelines were designated as ‘recommended with provisions or modifications’ due to inadequate reporting quality. A previous research drew a conclusion of a heterogeneity in methodological quality and great gaps in topics of epilepsy guidelines as assessed by AGREE II tool.24 Although different tools were used to assess epilepsy guidelines, and both assessment tools as mentioned above focus on different aspects, similar findings were concluded in this study, showing that the included epilepsy guidelines are of poor reporting quality. The findings in the present study are consistent with the assessments of guidelines in multiple regions, as well as patients and clinical medicine interventions: the included guidelines did not adhere to established reporting quality standards, and further improvement in guideline development is needed. Although there were limitations in the included guidelines according to assessment via the RIGHT tool, only four of the included guidelines provided suggestions for future guideline developers to avoid such limitations in future work. The greatest limitation in the included guidelines was a lack of consideration of the requirements and recommendations for patients and their relatives with regard to psychological or economic burden. An ideal clinical guideline should enable improvement for patients and their disorders, thereby guiding clinical doctors and better serving the patients. Furthermore, few or the included guidelines reported how stakeholders influenced the development of the guidelines, which suggests that the guidelines may exhibit low credibility, especially those targeting a specific treatment recommendation. Only one guideline focused on TCM interventions for epilepsy; reporting of this guideline was not of high quality and solely targeted children with epilepsy. It is well known that antiepileptic drugs perform irreversible harm to the liver and kidneys; epilepsy in 25.3% of adult patients and 13.4% of paediatric patients was reported to have led to intractable epilepsy due to antiepileptic resistance and long-term treatment.25 Thus, to reduce the adverse effects of antiepileptic drugs, TCM or other complementary alternative therapies should be recommended for use in clinical applications according to a systematic review. The findings of this study may serve as an alert for epilepsy guidelines development and reporting in the future as poor reporting quality of CPGs could mislead clinical care for patients with epilepsy.

Limitations

There were some limitations to this study. The main limitation was that only papers published in English and Chinese were searched for this study, leading to some guidelines published in Japanese, Russian, French, Spanish, German, Italian or other languages being missed. Second, the inclusion of six regions limited the findings to those regions; however, the regions were chosen because they were expected to be representative. We consider epilepsy interventions and other healthcare practices to have a particular impact in the USA, Europe, UK and China, where higher morbidity is reported. Third, a robust series of eligibility criteria were formulated and tested before these guidelines were identified; however, some guidelines might be missed by computerised searches. Finally, the RIGHT tool has a broad range of assessment of individual guideline components for specialists across medical specialties and levels of seniority, which might have led to subjective estimation during the decision-making process. However, the correlation between the estimators suggested that the RIGHT tool overcomes this potential bias.

In future updates, guidelines that achieved higher quality of reporting and overall recommendations could be improved based on the RIGHT tool specifications, as well as with insight from a large number of resources that are available to support guideline development and implementation.26 27 Future research should identify patients with epilepsy and interventions other than those reviewed here in a manner supported by sufficient evidence to facilitate guideline development.

Conclusions

Appraisal of these guidelines using the RIGHT tool revealed that the quality of reporting varied among guidelines. Items that exhibited low quality in most included guidelines were healthcare questions, rationale/explanation for recommendations, quality assurance, funding source(s) and role(s) of the funder, and limitations of the guideline. Thus, these aspects should receive greater attention in future guideline reporting.