Literature DB >> 32414832

Consensus on the exercise and dosage variables of an exercise training programme for chronic non-specific neck pain: protocol for an international e-Delphi study.

Jonathan Price1, Alison Rushton2, Vasileios Tyros3, Nicola R Heneghan4.   

Abstract

INTRODUCTION: Clinical guidelines and systematic reviews recommend exercise in the management of chronic non-specific neck pain. Although exercise training programmes that consist of both motor control exercise and exercises for the superficial cervical muscles (segmental exercises) are effective, the exercise variables including dosage vary considerably across trials or are poorly reported. This study aims to gain expert consensus on these exercise variables so that they can be described clearly using intervention reporting checklists to inform clinical practice and future clinical trials. METHODS AND ANALYSIS: This protocol for an international Delphi study is informed by the Guidance on Conducting and REporting DElphi Studies recommendations and published to ensure quality, rigour and transparency. The study will consist of three rounds using anonymous online questionnaires. Expert exercise professionals (physiotherapists, strength and conditioning coaches and so on) and academics in neck pain management will be identified through literature searches, peer referral and social media calls for expression of interest. In round 1, participants will answer open-ended questions informed by intervention and exercise reporting checklists. Responses will be analysed thematically by two independent reviewers. In round 2, participants will rate their level of agreement with statements generated from round 1 and previous clinical trials using a 5-point Likert scale where 1=strongly disagree and 5=strongly agree. In round 3, participants will re-rate their agreement with statements that achieved consensus in round 2. Statements reaching consensus among participants must meet progressively increased a priori criteria at rounds 2 and 3, measured using descriptive statistics: median, IQR and percentage agreement. Inferential statistics will be used to evaluate measures of agreement between participants (Kendall's coefficient of concordance) and stability between rounds (Wilcoxon rank-sum test). Statements achieving consensus in round 3 will provide expert recommendations of the key exercise and dosage variables in the management of chronic non-specific neck pain. ETHICS AND DISSEMINATION: Ethical approval was provided by the University of Birmingham Ethics Committee (Ref:ERN_19-1857). Results will be disseminated through peer-reviewed publications and conference presentations. © Author(s) (or their employer(s)) 2020. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.

Entities:  

Keywords:  musculoskeletal disorders; rehabilitation medicine; spine; sports medicine

Mesh:

Year:  2020        PMID: 32414832      PMCID: PMC7232615          DOI: 10.1136/bmjopen-2020-037656

Source DB:  PubMed          Journal:  BMJ Open        ISSN: 2044-6055            Impact factor:   2.692


This Delphi protocol is informed by the Guidance on Conducting and REporting DElphi Studies recommendations. Expert eligibility is predefined and includes international and multiprofessional representation. This protocol states definitions and a priori criteria for consensus, agreement and stability. The study will use a systematic consensus process to provide expert recommendations on the exercise and dosage variables of an exercise training programme for chronic non-specific neck pain that can be used in clinical practice and future clinical trials. The study results will be specific to chronic non-specific neck pain rehabilitation, limiting the external validity to other musculoskeletal conditions.

Introduction

Chronic non-specific neck pain (CNSNP) affects 289 million people worldwide with increasing prevalence.1 2 The subsequent disability is significant resulting in CNSNP being considered one of the leading causes of years lived with disability.2 Despite multiple guidelines and systematic reviews informing clinical practice,3–9 patient outcomes are suboptimal, reflected by the increasing rank of CNSNP’s cause for global disability-adjusted life years.10–12 One explanation for poor patient outcomes is the vague recommendations of ‘exercise’ or ‘strengthening exercise’ from clinical guidelines and systematic reviews that inform clinical practice. Furthermore, exercise dosage recommendations (sets, repetitions, load, frequency and so on) are lacking and considered a research priority.13 Several trials have demonstrated small to very large short-term effects on pain and disability when using exercise training programmes that combine submaximal effort exercises for the deep cervical muscles to improve co-ordination and sequential spinal control (motor control exercises) and exercises for the superficial cervical muscles to improve the ability of the neck to produce, transfer and absorb force (segmental exercises).14–20 Although packages using a combination of motor control and segmental exercise appear promising, the optimal dosage and long-term effectiveness of this exercise training programme are unknown and require evaluation through an adequately powered low risk of bias clinical trials. The Medical Research Council recommends complex interventions such as exercise training programmes to be defined prior to clinical trials.21 The Consensus on Exercise Reporting Template (CERT)22 and the Template for Intervention Description and Replication (TIDieR)23 are reporting checklists that aid in defining and reporting the design of exercise interventions. A key component of each reporting checklist is exercise training variables such as progressive overload, specificity, exercise selection order and dosage, as manipulation of these variables results in different performance and physical outcomes.24 25 To date, the exercise and dosage variables of an exercise training programme of motor control and segmental exercise for CNSNP cannot be reported in accordance with CERT or TIDieR due to significant heterogeneity or poor reporting of previous trials.14–20 Consensus on these variables will enable a clearly defined exercise intervention for use in clinical trials and clinical practice.

Aims

The aim of this e-Delphi study is twofold. Initially, we will obtain exercise and academic professional expert opinion on the exercise and dosage variables of an exercise training programme consisting of motor control and segmental exercise for the management of CNSNP. We will then conduct a systematic process to gain consensus on the exercise and dosage variables reported to inform future research and clinical practice.

Methodology

Justification of Delphi methodology

Exploring exercise variables through qualitative research methodologies such as interviews and focus groups would embrace the diversity of opinion between experts providing rich detail and a deeper understanding, but this diversity maybe problematic when defining an intervention.26 As heterogeneity of motor control and segmental exercise variables already exists across trials, a convergence of information is required. Research methodologies such as Delphi techniques, consensus development conferences and nominal group techniques can all achieve consensus.27 28 The Delphi method is a systematic approach to achieving consensus among experts through the independent completion of sequential questionnaires that are refined on feedback resulting in a convergence of opinion and eventual consensus.29 A Delphi method is advantageous over other forms of consensus techniques owing to (1) independent and anonymous participation reducing peer pressure and other extrinsic factors present in group techniques that cause subject bias30 31; (2) controlled feedback between rounds encouraging consensus by providing participants with the opportunity to refine their opinions29; (3) using experts with a range of knowledge and experience to improve content validity and response rates32–34; and (4) electronic questionnaires removing geographical limitations.29

Design

This protocol is informed by Guidance on Conducting and REporting DElphi Studies (CREDES)35 (online supplementary file 1) and other recommended criteria.36 As no register exists for Delphi research, the protocol has been published to ensure quality, rigour and transparency. The three-round e-Delphi is summarised in figure 1.27 Data collection is planned between March and August 2020. All rounds will be completed electronically and anonymously using REDCap, a secure web application for building and managing online surveys.37 38 Round 1 will be used to generate statements on exercise and dosage variables for both motor control and segmental exercises. Experts will rate their agreement with statements in rounds 2 and 3 using a 5-point Likert scale. Three rounds are commonly cited to be sufficient to achieve consensus.27 Statements that achieve consensus in round 3 will be used to describe the key exercise and dosage variables for a CNSNP exercise training programme which includes motor control and segmental exercises.
Figure 1

Delphi study procedures. CERT, Consensus on Exercise Reporting Template; TIDieR, Template for Intervention Description and Replication.

Delphi study procedures. CERT, Consensus on Exercise Reporting Template; TIDieR, Template for Intervention Description and Replication.

Expert eligibility and sample

A purposive sampling method will be used to recruit a range of experts in CNSNP exercise prescription. It is recommended that a heterogeneous sample is used representing a spectrum of opinions29 and therefore experts will be recruited from two distinct groups: Exercise professionals: any professional who uses exercise to manage neck pain will be considered (eg, physiotherapists, strength and conditioning coaches, osteopaths and chiropractors). Eligible participants will have a relevant postgraduate qualification or >5 years of sports or musculoskeletal experience. Experts will treat ≥5 patients with CNSNP per month using exercise. Experts will be identified through existing professional networks and social media/internet-based searching. Academics: eligible academics will have ≥2 peer-reviewed publications focused on the use of exercise in the management of CNSNP in the past 10 years.39 Academics will be identified through CNSNP systematic reviews/randomised clinical trials published indexed in PubMed and Expertscape searches.13 Experts will be recruited worldwide, aged 18 or above, able to read and write English and willing to participate. They will be invited to participate by the lead author (JP) through email. Recruitment will be maximised by encouraging identified experts to snowball the invitation with other suitable participants and calls for expressions of interest on social media.40 41 Upon experts confirming their interest and eligibility, they will be provided with a link to the Research Electronic Data Capture (REDCap) system at the University of Birmingham, where a Participant Information Sheet (online supplementary file 2) and Consent Form will be hosted.37 38 The Participant Information Sheet will clarify study procedures, eligibility criteria, assure anonymity and explain the withdrawal process. Participants may withdraw at any time up until the data analysis of the Round 3 Questionnaire. Due to the nature of the Delphi process, responses will be used up to the point of withdrawal. Participants will be able to withdraw from the study by contacting the Principal Investigator or Primary Academic Supervisor. Consent will be obtained electronically through REDCap.37 38 Recruitment will continue for 4 weeks with a reminder sent at week 2. Should there be no contact within the 4 weeks then no further communication will be sent.42 There is no universal guide to sample size in Delphi studies, and expert panels have ranged from 4 to 3000 participants.43 Previous Delphi studies with an aim of intervention development typically achieved consensus with responses from 10 to 27 experts in the final round39 44–47 and therefore, a conservative estimate of 27 final responses is required. Assuming a response rate of 70%, a minimum of 40 experts are required to complete the consent form to ensure at least 27 responses in round 3.29 To prevent over-representation from one expert group, recruitment will be monitored to achieve an approximate 50/50 split between exercise and academic professionals.

Procedure

Round 1

The objectives of round 1 will be to obtain participant demographic data and generate statements on exercise and dosage variables based on expert opinion. Participants will complete the Participant Details Form collecting information on professional background, highest qualification, primary country of work, work setting, H-index, publication count, years qualified and grade of clinical work. The Round 1 Questionnaire (online supplementary file 3) will consist of open-ended questions informed by CERT and TIDieR.22 23 Open-ended questions improve the content validity as statements are generated by expert opinion.29 31 Statements generated from previous clinical trials14–20 will be included in round 2, rather than round 1 to allow participants to provide their expert opinion without bias from the literature, thereby reducing experimenter bias.34 The questions will ask participants to identify the exercise and dosage variables they consider important when prescribing exercise for CNSNP. They will then be asked to list and explain what patients or other factors may affect or inform their reasoning when prescribing the exercise and dosage variables that they identified. Participants will be asked to answer open-ended questions for both motor control and segmental exercises independently with definitions of both subgroups of exercise provided for clarity (online supplementary file 3).48 Participants will have the opportunity to provide general comments at the end. The Round 1 Questionnaire (online supplementary file 3) was piloted for feedback on readability, relevance and appropriateness through the Study Steering Group and edited accordingly. Round 1 will be open for 1 month with email reminders, including the withdrawal process, being provided at weeks 1 and 3.49

Round 2

The objectives of round 2 are to evaluate consensus on statements regarding exercise and dosage variables and to identify any further statements. Participants will be provided with feedback explaining how statements were generated from round 1 and then asked to rate their agreement with the statements using a 5-point Likert scale where 1=strongly disagree and 5=strongly agree.49 A 5-point scale is preferred as it possesses acceptability psychometric properties while being quick and easy for participants to reduce frustration and demotivation.50 An open text box will be included for each statement for any additional comments or further statement generation. All comments will be analysed by the study team and reviewed by the Study Steering Group. All participants will be invited to round 2, including those who did not complete round 1, provided they have not withdrawn from the study. This provides the opportunity for participants to continue their involvement who were unable to complete previous rounds due to time or other commitments.29 As per round 1, the Round 2 Questionnaire will remain active for 4 weeks with email reminders sent at weeks 1 and 3.

Round 3

The objective of round 3 is to strengthen consensus on statements regarding exercise and dosage variables. The Round 3 Questionnaire will include feedback from round 2 using descriptive statistics, promoting reflection before completing the final questionnaire. In round 3, participants will be asked to rate their agreement with the statements achieving consensus from round 2 using the same 5-point Likert scale.39 Statements that do not achieve consensus in round 2 will be discarded. A free-text box will be provided for participants to clarify responses but the generation of new statements will not be encouraged. All participants will be invited to participate in round 3, which will again remain active for 4 weeks with email reminders sent at weeks 1 and 3.

Data analysis

Quantitative and qualitative data will be inputted into IBM SPSS Statistics V.25 and QSR International’s NVivo V.12 Plus software, respectively, for analyses.51 52 Data will be analysed independently by two researchers (JP and VT) at each round. The complete agreement between researchers is required for statements to be included, with disagreements resolved by discussion.53 The Study Steering Group will review the data at each stage for feedback and editing before dissemination. Qualitative data will be examined using a theoretical thematic analysis to generate statements under themes preidentified from CERT/TIDieR and then examined inductively for any new themes.26 54 Original wording from one expert that best represents the wording across participants with similar statements will be used where possible and all other statements will be discarded.34 Statements generated from previous clinical trial findings not identified from participant responses will also be included14–20 For any statement to be included, it must be described at least once by any participant or via previous clinical trials; therefore, any stand-alone statements will be kept and included. The Round 2 Questionnaire will be constructed using the statements generated. Qualitative data will be analysed using thematic analysis for the emergence of any new statements. Descriptive and inferential statistics will be used to evaluate agreement and consensus (table 1). Any statements not achieving the a priori criteria for consensus will be discarded (median ≥3; IQR ≤1.5; percentage agreement ≥60%).
Table 1

Definitions and statistical measures of consensus, agreement and stability

DefinitionStatisticsRound 2Round 3
ConsensusThe extent to which the group of experts share the same opinionMedian≥3≥3.5
IQR≤1.5≤1
Percentage agreement≥60%≥70%
AgreementA measure of inter-rater agreement where the rating of one expert can be predicted by the rating of anotherKendall’s coefficient of concordance (W)Significant agreement (p<0.05)Significant agreement (p<0.05)
StabilityThe consistency of responses between successive roundsWilcoxon rank-sum testNASignificance level p<0.05
Definitions and statistical measures of consensus, agreement and stability Descriptive and inferential statistics will evaluate consensus against a priori criteria (median ≥3.5; IQR ≤1; percentage agreement ≥70%) (table 1). Statements achieving consensus after round 3 will be used to describe the key exercise and dosage variables of motor control and segmental exercise training programme. Statements that fail to achieve consensus in round 3 will be discarded.

Consensus, agreement and stability

A discrepancy exists as to the definitions and statistical measures of consensus and agreement within the literature.36 53 55 56 Some argue that consensus and agreement are interchangeable,55 whereas others recommend separate definitions.57 58 To ensure clarity, the following definitions will be used in this study: Consensus: the extent to which the group of experts share the same opinion.55 Agreement: a measure of inter-rater agreement where the rating of one expert can be predicted by the rating of another.59 Stability: the consistency of responses between successive rounds.55 57 Consensus, agreement and stability will be assessed in each round using a combination of descriptive and inferential statistics (table 1).36 53 56 Consensus will be evaluated using descriptive statistics of central tendency and dispersion. As the Likert scale is considered an ordinal scale,60 median and IQR will be used.55 60 Percentage agreement, defined as the percentage of responses rated agree/strongly agree, will also be used to evaluate consensus among experts for each statement.39 49 Progressively increased criteria will be used between rounds 2 and 3 to encourage convergence and strengthen overall consensus.39 49 Agreement between experts across all items and within categories identified after round 1 will be evaluated using Kendall’s coefficient of concordance (W) where 0 is no agreement and 1 is perfect agreement.59 The stability of the responses between rounds 2 and 3 will be evaluated using the Wilcoxon rank-sum test.55 61 Statistical significance will be set at p<0.05.

Data management

All personal information and data will be kept secure from any third party using a password-protected computer during the study. Only members of the study team will have access to the study data. On completion of the study, the data will be kept securely for 10 years in the School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, UK before being securely destroyed in accordance with University guidelines.

Study steering group

The Study Steering Group will provide study oversight with members consisting of coauthors and patient/public, methodological and clinical expertise (table 2). The Study Steering Group will meet at key stages throughout the study to provide feedback on questionnaire development, structure and clarity; aid in expert identification; review study results at each round and agree statement inclusion; review study conduct and aid in the dissemination of findings. Members of the Study Steering Group who are not coauthors will not have access to raw data or be able to influence the study process. Feedback and changes suggested by the Study Steering Group must be agreed between the study coauthors before implementation.
Table 2

Study steering group members, backgrounds and roles

BackgroundProfessional titleRole
PatientNACo-chair/patient representative
Academic nurseLecturerCo-chair/methodological representative
Clinical physiotherapistConsultant physiotherapistClinical representative
PatientNAPatient representative
Academic physiotherapistSenior lecturerPrimary supervisor
Academic physiotherapistReader in musculoskeletal sciencesSecondary supervisor
Clinical physiotherapistPhysiotherapistCo-investigator
Clinical academic trainee physiotherapistPre-doctoral clinical academic fellowPrinciple investigator

NA, not applicable.

Study steering group members, backgrounds and roles NA, not applicable.

Ethics

Appropriate ethical approval has been granted from the University of Birmingham Ethics Committee (Ref: ERN_19–1857). Informed consent will be received from all participants before completing any questionnaires. They will be informed of the withdrawal process and that any feedback will be anonymised for privacy.

Patient and public involvement

The study was conceived from our clinical working with patients with spinal complaints over many years and their views used to highlight the relevance of this research. Two patients were involved in reviewing the findings of the original systematic review that underpinned this study, suggesting alternatively terminology that better reflects patient views. Our Study Steering Group patient representatives helped refine the research aim of this study as well as contributing to the design of Participant Information Sheets, expression of interest emails/social media posts and developing the Round 1 Questionnaire. It is anticipated that our patient representatives will continue to co-chair the Study Steering Group, review study results at each round and study conduct. Our patient representatives will be instrumental in future dissemination of findings to patient cohorts, as well as informing future fellowship applications for the lead author (JP). Patient and public involvement in the full study will be reported using the Guidance for Reporting Involvement of Patients and the Public2-short form (GRIPP2-SF) when disseminating the study results.62

Discussion

This Delphi study will provide expert consensus on the exercise and dosage variables of an exercise training programme consisting of motor control and segmental exercises for CNSNP that could not be determined from the current literature. Conducting an e-Delphi allows the development of expert informed recommendations from a range of worldwide experts who can participate anonymously, which should be considered a strength. The expert eligibility criteria could be considered a limitation of the study as it may exclude experts in exercise prescription who see a small volume of patients experiencing neck pain. However, there is currently no clear guidelines as to how best define an expert.27 35 63 The strict eligibility criteria used are important to ensure that findings are appropriate to CNSNP as it is currently unknown whether approaches to exercise are transferable between different musculoskeletal conditions. Future research will require the acceptability and feasibility of exercise and dosage variables to be evaluated by patient and physiotherapists focus groups. Results will inform the development of an intervention that will be defined using CERT/TIDieR and evaluated in a low risk of bias, adequately powered clinical trial investigating long-term outcomes and optimal dosage.
  44 in total

Review 1.  Research guidelines for the Delphi survey technique.

Authors:  F Hasson; S Keeney; H McKenna
Journal:  J Adv Nurs       Date:  2000-10       Impact factor: 3.187

Review 2.  Consensus development methods, and their use in clinical guideline development.

Authors:  M K Murphy; N A Black; D L Lamping; C M McKee; C F Sanderson; J Askham; T Marteau
Journal:  Health Technol Assess       Date:  1998       Impact factor: 4.014

3.  Return to play criteria after hamstring muscle injury in professional football: a Delphi consensus study.

Authors:  Mattia Zambaldi; Ian Beasley; Alison Rushton
Journal:  Br J Sports Med       Date:  2017-02-28       Impact factor: 13.800

Review 4.  Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies.

Authors:  Ivan R Diamond; Robert C Grant; Brian M Feldman; Paul B Pencharz; Simon C Ling; Aideen M Moore; Paul W Wales
Journal:  J Clin Epidemiol       Date:  2014-04       Impact factor: 6.437

5.  The New Agenda for Neck Pain Research: A Modified Delphi Study.

Authors:  Priscilla Viana Silva; Leonardo Oliveira Pena Costa; Chris G Maher; Steven J Kamper; Lucíola da Cunha Menezes Costa
Journal:  J Orthop Sports Phys Ther       Date:  2019-07-10       Impact factor: 4.751

6.  Motor control using cranio-cervical flexion exercises versus other treatments for non-specific chronic neck pain: A systematic review and meta-analysis.

Authors:  Carmen Martin-Gomez; Rebeca Sestelo-Diaz; Victor Carrillo-Sanjuan; Marcos Jose Navarro-Santana; Judit Bardon-Romero; Gustavo Plaza-Manzano
Journal:  Musculoskelet Sci Pract       Date:  2019-04-20       Impact factor: 2.520

7.  Developing an acupuncture protocol for treating phantom limb pain: a Delphi consensus study.

Authors:  Esmé G Trevelyan; Warren A Turner; Nicola Robinson
Journal:  Acupunct Med       Date:  2014-12-08       Impact factor: 2.267

Review 8.  Development of an active behavioural physiotherapy intervention (ABPI) for acute whiplash-associated disorder (WAD) II management: a modified Delphi study.

Authors:  Taweewat Wiangkham; Joan Duda; M Sayeed Haque; Alison Rushton
Journal:  BMJ Open       Date:  2016-09-14       Impact factor: 2.692

9.  Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990-2013: quantifying the epidemiological transition.

Authors:  Christopher J L Murray; Ryan M Barber; Kyle J Foreman; Ayse Abbasoglu Ozgoren; Foad Abd-Allah; Semaw F Abera; Victor Aboyans; Jerry P Abraham; Ibrahim Abubakar; Laith J Abu-Raddad; Niveen M Abu-Rmeileh; Tom Achoki; Ilana N Ackerman; Zanfina Ademi; Arsène K Adou; José C Adsuar; Ashkan Afshin; Emilie E Agardh; Sayed Saidul Alam; Deena Alasfoor; Mohammed I Albittar; Miguel A Alegretti; Zewdie A Alemu; Rafael Alfonso-Cristancho; Samia Alhabib; Raghib Ali; François Alla; Peter Allebeck; Mohammad A Almazroa; Ubai Alsharif; Elena Alvarez; Nelson Alvis-Guzman; Azmeraw T Amare; Emmanuel A Ameh; Heresh Amini; Walid Ammar; H Ross Anderson; Benjamin O Anderson; Carl Abelardo T Antonio; Palwasha Anwari; Johan Arnlöv; Valentina S Arsic Arsenijevic; Al Artaman; Rana J Asghar; Reza Assadi; Lydia S Atkins; Marco A Avila; Baffour Awuah; Victoria F Bachman; Alaa Badawi; Maria C Bahit; Kalpana Balakrishnan; Amitava Banerjee; Suzanne L Barker-Collo; Simon Barquera; Lars Barregard; Lope H Barrero; Arindam Basu; Sanjay Basu; Mohammed O Basulaiman; Justin Beardsley; Neeraj Bedi; Ettore Beghi; Tolesa Bekele; Michelle L Bell; Corina Benjet; Derrick A Bennett; Isabela M Bensenor; Habib Benzian; Eduardo Bernabé; Amelia Bertozzi-Villa; Tariku J Beyene; Neeraj Bhala; Ashish Bhalla; Zulfiqar A Bhutta; Kelly Bienhoff; Boris Bikbov; Stan Biryukov; Jed D Blore; Christopher D Blosser; Fiona M Blyth; Megan A Bohensky; Ian W Bolliger; Berrak Bora Başara; Natan M Bornstein; Dipan Bose; Soufiane Boufous; Rupert R A Bourne; Lindsay N Boyers; Michael Brainin; Carol E Brayne; Alexandra Brazinova; Nicholas J K Breitborde; Hermann Brenner; Adam D Briggs; Peter M Brooks; Jonathan C Brown; Traolach S Brugha; Rachelle Buchbinder; Geoffrey C Buckle; Christine M Budke; Anne Bulchis; Andrew G Bulloch; Ismael R Campos-Nonato; Hélène Carabin; Jonathan R Carapetis; Rosario Cárdenas; David O Carpenter; Valeria Caso; Carlos A Castañeda-Orjuela; Ruben E Castro; Ferrán Catalá-López; Fiorella Cavalleri; Alanur Çavlin; Vineet K Chadha; Jung-Chen Chang; Fiona J Charlson; Honglei Chen; Wanqing Chen; Peggy P Chiang; Odgerel Chimed-Ochir; Rajiv Chowdhury; Hanne Christensen; Costas A Christophi; Massimo Cirillo; Matthew M Coates; Luc E Coffeng; Megan S Coggeshall; Valentina Colistro; Samantha M Colquhoun; Graham S Cooke; Cyrus Cooper; Leslie T Cooper; Luis M Coppola; Monica Cortinovis; Michael H Criqui; John A Crump; Lucia Cuevas-Nasu; Hadi Danawi; Lalit Dandona; Rakhi Dandona; Emily Dansereau; Paul I Dargan; Gail Davey; Adrian Davis; Dragos V Davitoiu; Anand Dayama; Diego De Leo; Louisa Degenhardt; Borja Del Pozo-Cruz; Robert P Dellavalle; Kebede Deribe; Sarah Derrett; Don C Des Jarlais; Muluken Dessalegn; Samath D Dharmaratne; Mukesh K Dherani; Cesar Diaz-Torné; Daniel Dicker; Eric L Ding; Klara Dokova; E Ray Dorsey; Tim R Driscoll; Leilei Duan; Herbert C Duber; Beth E Ebel; Karen M Edmond; Yousef M Elshrek; Matthias Endres; Sergey P Ermakov; Holly E Erskine; Babak Eshrati; Alireza Esteghamati; Kara Estep; Emerito Jose A Faraon; Farshad Farzadfar; Derek F Fay; Valery L Feigin; David T Felson; Seyed-Mohammad Fereshtehnejad; Jefferson G Fernandes; Alize J Ferrari; Christina Fitzmaurice; Abraham D Flaxman; Thomas D Fleming; Nataliya Foigt; Mohammad H Forouzanfar; F Gerry R Fowkes; Urbano Fra Paleo; Richard C Franklin; Thomas Fürst; Belinda Gabbe; Lynne Gaffikin; Fortuné G Gankpé; Johanna M Geleijnse; Bradford D Gessner; Peter Gething; Katherine B Gibney; Maurice Giroud; Giorgia Giussani; Hector Gomez Dantes; Philimon Gona; Diego González-Medina; Richard A Gosselin; Carolyn C Gotay; Atsushi Goto; Hebe N Gouda; Nicholas Graetz; Harish C Gugnani; Rahul Gupta; Rajeev Gupta; Reyna A Gutiérrez; Juanita Haagsma; Nima Hafezi-Nejad; Holly Hagan; Yara A Halasa; Randah R Hamadeh; Hannah Hamavid; Mouhanad Hammami; Jamie Hancock; Graeme J Hankey; Gillian M Hansen; Yuantao Hao; Hilda L Harb; Josep Maria Haro; Rasmus Havmoeller; Simon I Hay; Roderick J Hay; Ileana B Heredia-Pi; Kyle R Heuton; Pouria Heydarpour; Hideki Higashi; Martha Hijar; Hans W Hoek; Howard J Hoffman; H Dean Hosgood; Mazeda Hossain; Peter J Hotez; Damian G Hoy; Mohamed Hsairi; Guoqing Hu; Cheng Huang; John J Huang; Abdullatif Husseini; Chantal Huynh; Marissa L Iannarone; Kim M Iburg; Kaire Innos; Manami Inoue; Farhad Islami; Kathryn H Jacobsen; Deborah L Jarvis; Simerjot K Jassal; Sun Ha Jee; Panniyammakal Jeemon; Paul N Jensen; Vivekanand Jha; Guohong Jiang; Ying Jiang; Jost B Jonas; Knud Juel; Haidong Kan; André Karch; Corine K Karema; Chante Karimkhani; Ganesan Karthikeyan; Nicholas J Kassebaum; Anil Kaul; Norito Kawakami; Konstantin Kazanjan; Andrew H Kemp; Andre P Kengne; Andre Keren; Yousef S Khader; Shams Eldin A Khalifa; Ejaz A Khan; Gulfaraz Khan; Young-Ho Khang; Christian Kieling; Daniel Kim; Sungroul Kim; Yunjin Kim; Yohannes Kinfu; Jonas M Kinge; Miia Kivipelto; Luke D Knibbs; Ann Kristin Knudsen; Yoshihiro Kokubo; Soewarta Kosen; Sanjay Krishnaswami; Barthelemy Kuate Defo; Burcu Kucuk Bicer; Ernst J Kuipers; Chanda Kulkarni; Veena S Kulkarni; G Anil Kumar; Hmwe H Kyu; Taavi Lai; Ratilal Lalloo; Tea Lallukka; Hilton Lam; Qing Lan; Van C Lansingh; Anders Larsson; Alicia E B Lawrynowicz; Janet L Leasher; James Leigh; Ricky Leung; Carly E Levitz; Bin Li; Yichong Li; Yongmei Li; Stephen S Lim; Maggie Lind; Steven E Lipshultz; Shiwei Liu; Yang Liu; Belinda K Lloyd; Katherine T Lofgren; Giancarlo Logroscino; Katharine J Looker; Joannie Lortet-Tieulent; Paulo A Lotufo; Rafael Lozano; Robyn M Lucas; Raimundas Lunevicius; Ronan A Lyons; Stefan Ma; Michael F Macintyre; Mark T Mackay; Marek Majdan; Reza Malekzadeh; Wagner Marcenes; David J Margolis; Christopher Margono; Melvin B Marzan; Joseph R Masci; Mohammad T Mashal; Richard Matzopoulos; Bongani M Mayosi; Tasara T Mazorodze; Neil W Mcgill; John J Mcgrath; Martin Mckee; Abigail Mclain; Peter A Meaney; Catalina Medina; Man Mohan Mehndiratta; Wubegzier Mekonnen; Yohannes A Melaku; Michele Meltzer; Ziad A Memish; George A Mensah; Atte Meretoja; Francis A Mhimbira; Renata Micha; Ted R Miller; Edward J Mills; Philip B Mitchell; Charles N Mock; Norlinah Mohamed Ibrahim; Karzan A Mohammad; Ali H Mokdad; Glen L D Mola; Lorenzo Monasta; Julio C Montañez Hernandez; Marcella Montico; Thomas J Montine; Meghan D Mooney; Ami R Moore; Maziar Moradi-Lakeh; Andrew E Moran; Rintaro Mori; Joanna Moschandreas; Wilkister N Moturi; Madeline L Moyer; Dariush Mozaffarian; William T Msemburi; Ulrich O Mueller; Mitsuru Mukaigawara; Erin C Mullany; Michele E Murdoch; Joseph Murray; Kinnari S Murthy; Mohsen Naghavi; Aliya Naheed; Kovin S Naidoo; Luigi Naldi; Devina Nand; Vinay Nangia; K M Venkat Narayan; Chakib Nejjari; Sudan P Neupane; Charles R Newton; Marie Ng; Frida N Ngalesoni; Grant Nguyen; Muhammad I Nisar; Sandra Nolte; Ole F Norheim; Rosana E Norman; Bo Norrving; Luke Nyakarahuka; In-Hwan Oh; Takayoshi Ohkubo; Summer L Ohno; Bolajoko O Olusanya; John Nelson Opio; Katrina Ortblad; Alberto Ortiz; Amanda W Pain; Jeyaraj D Pandian; Carlo Irwin A Panelo; Christina Papachristou; Eun-Kee Park; Jae-Hyun Park; Scott B Patten; George C Patton; Vinod K Paul; Boris I Pavlin; Neil Pearce; David M Pereira; Rogelio Perez-Padilla; Fernando Perez-Ruiz; Norberto Perico; Aslam Pervaiz; Konrad Pesudovs; Carrie B Peterson; Max Petzold; Michael R Phillips; Bryan K Phillips; David E Phillips; Frédéric B Piel; Dietrich Plass; Dan Poenaru; Suzanne Polinder; Daniel Pope; Svetlana Popova; Richie G Poulton; Farshad Pourmalek; Dorairaj Prabhakaran; Noela M Prasad; Rachel L Pullan; Dima M Qato; D Alex Quistberg; Anwar Rafay; Kazem Rahimi; Sajjad U Rahman; Murugesan Raju; Saleem M Rana; Homie Razavi; K Srinath Reddy; Amany Refaat; Giuseppe Remuzzi; Serge Resnikoff; Antonio L Ribeiro; Lee Richardson; Jan Hendrik Richardus; D Allen Roberts; David Rojas-Rueda; Luca Ronfani; Gregory A Roth; Dietrich Rothenbacher; David H Rothstein; Jane T Rowley; Nobhojit Roy; George M Ruhago; Mohammad Y Saeedi; Sukanta Saha; Mohammad Ali Sahraian; Uchechukwu K A Sampson; Juan R Sanabria; Logan Sandar; Itamar S Santos; Maheswar Satpathy; Monika Sawhney; Peter Scarborough; Ione J Schneider; Ben Schöttker; Austin E Schumacher; David C Schwebel; James G Scott; Soraya Seedat; Sadaf G Sepanlou; Peter T Serina; Edson E Servan-Mori; Katya A Shackelford; Amira Shaheen; Saeid Shahraz; Teresa Shamah Levy; Siyi Shangguan; Jun She; Sara Sheikhbahaei; Peilin Shi; Kenji Shibuya; Yukito Shinohara; Rahman Shiri; Kawkab Shishani; Ivy Shiue; Mark G Shrime; Inga D Sigfusdottir; Donald H Silberberg; Edgar P Simard; Shireen Sindi; Abhishek Singh; Jasvinder A Singh; Lavanya Singh; Vegard Skirbekk; Erica Leigh Slepak; Karen Sliwa; Samir Soneji; Kjetil Søreide; Sergey Soshnikov; Luciano A Sposato; Chandrashekhar T Sreeramareddy; Jeffrey D Stanaway; Vasiliki Stathopoulou; Dan J Stein; Murray B Stein; Caitlyn Steiner; Timothy J Steiner; Antony Stevens; Andrea Stewart; Lars J Stovner; Konstantinos Stroumpoulis; Bruno F Sunguya; Soumya Swaminathan; Mamta Swaroop; Bryan L Sykes; Karen M Tabb; Ken Takahashi; Nikhil Tandon; David Tanne; Marcel Tanner; Mohammad Tavakkoli; Hugh R Taylor; Braden J Te Ao; Fabrizio Tediosi; Awoke M Temesgen; Tara Templin; Margreet Ten Have; Eric Y Tenkorang; Abdullah S Terkawi; Blake Thomson; Andrew L Thorne-Lyman; Amanda G Thrift; George D Thurston; Taavi Tillmann; Marcello Tonelli; Fotis Topouzis; Hideaki Toyoshima; Jefferson Traebert; Bach X Tran; Matias Trillini; Thomas Truelsen; Miltiadis Tsilimbaris; Emin M Tuzcu; Uche S Uchendu; Kingsley N Ukwaja; Eduardo A Undurraga; Selen B Uzun; Wim H Van Brakel; Steven Van De Vijver; Coen H van Gool; Jim Van Os; Tommi J Vasankari; N Venketasubramanian; Francesco S Violante; Vasiliy V Vlassov; Stein Emil Vollset; Gregory R Wagner; Joseph Wagner; Stephen G Waller; Xia Wan; Haidong Wang; Jianli Wang; Linhong Wang; Tati S Warouw; Scott Weichenthal; Elisabete Weiderpass; Robert G Weintraub; Wang Wenzhi; Andrea Werdecker; Ronny Westerman; Harvey A Whiteford; James D Wilkinson; Thomas N Williams; Charles D Wolfe; Timothy M Wolock; Anthony D Woolf; Sarah Wulf; Brittany Wurtz; Gelin Xu; Lijing L Yan; Yuichiro Yano; Pengpeng Ye; Gökalp K Yentür; Paul Yip; Naohiro Yonemoto; Seok-Jun Yoon; Mustafa Z Younis; Chuanhua Yu; Maysaa E Zaki; Yong Zhao; Yingfeng Zheng; David Zonies; Xiaonong Zou; Joshua A Salomon; Alan D Lopez; Theo Vos
Journal:  Lancet       Date:  2015-08-28       Impact factor: 79.321

10.  Delphi Survey for Designing a Intervention Research Study on Childhood Obesity Prevention.

Authors:  Min Jeong Kim; Eunju Sung; Eun Young Choi; Young-Su Ju; Eal-Whan Park; Yoo-Seock Cheong; Sunmi Yoo; Kyung Hee Park; Hyung Jin Choi; Seolhye Kim
Journal:  Korean J Fam Med       Date:  2017-09-22
View more
  3 in total

1.  Prioritization of patient safety health policies: Delphi survey using patient safety experts in Japan.

Authors:  Yosuke Hatakeyama; Shigeru Fujita; Shuhei Iida; Yoji Nagai; Yoshiko Shimamori; Junko Ayuzawa; Tomohiro Hirao; Ryo Onishi; Kanako Seto; Kunichika Matsumoto; Tomonori Hasegawa
Journal:  PLoS One       Date:  2020-09-17       Impact factor: 3.240

2.  Expert consensus on a standardised definition and severity classification for adverse events associated with spinal and peripheral joint manipulation and mobilisation: protocol for an international e-Delphi study.

Authors:  Martha Funabashi; Katherine A Pohlman; Lindsay M Gorrell; Stacie A Salsbury; Andrea Bergna; Nicola R Heneghan
Journal:  BMJ Open       Date:  2021-11-11       Impact factor: 2.692

3.  Development of the Practice of Pharmaceutical Care for Cancer Pain Management in Outpatient Clinics Using the Delphi Method.

Authors:  Lu Zhang; Xia-Yang Ren; Hang-Xing Huang; Ya-Min Huang; Ling Huang; Xiao-Ping Chen; Yao Chen; Chen Wang; Jian Xiao
Journal:  Front Pharmacol       Date:  2022-06-02       Impact factor: 5.988

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.