Leonard H van den Berg1, Eric Sorenson2, Gary Gronseth2, Eric A Macklin2, Jinsy Andrews2, Robert H Baloh2, Michael Benatar2, James D Berry2, Adriano Chio2, Philippe Corcia2, Angela Genge2, Amelie K Gubitz2, Catherine Lomen-Hoerth2, Christopher J McDermott2, Erik P Pioro2, Jeffrey Rosenfeld2, Vincenzo Silani2, Martin R Turner2, Markus Weber2, Benjamin Rix Brooks2, Robert G Miller2, Hiroshi Mitsumoto2. 1. From the Department of Neurology (L.H.v.d.B.), Brain Center Rudolf Magnus, University Medical Center Utrecht, the Netherlands; Department of Neurology (E.S.), Mayo Clinic, Rochester, MN; Department of Neurology (G.G.), University of Kansas Medical Center, Kansas City; Department of Medicine (E.A.M.), Massachusetts General Hospital, Biostatistics Center, Harvard Medical School, Boston; Department of Neurology (J.A., H.M.), Columbia University, Eleanor and Lou Gehrig ALS Center, New York, NY; Department of Neurology (R.H.B.), Cedars-Sinai Medical Center, Los Angeles, CA; Department of Neurology (M.B.), University of Miami, FL; Neurological Clinical Research Institute (J.D.B.), Massachusetts General Hospital, Boston; Rita Levi Montalcini Department of Neuroscience (A.C.), University of Torino, Italy; Centre Constitutif SLA (P.C.), Université de Tours, France; Department of Neurology (A.G.), Clinical Research Unit, Montreal Neurological Institute, Neurosurgery, McGill University, Montreal, Canada; National Institute of Neurological Disorders and Stroke (A.K.G.), National Institutes of Health, Bethesda, MD; ALS Center (C.L.-H.), University of California San Francisco; Department of Neuroscience (C.J.M.), Sheffield Institute for Translational Neuroscience, University of Sheffield, UK; Department of Neurology (E.P.P.), Section of ALS & Related Disorders, Cleveland Clinic, OH; Department of Neurology (J.R.), The Center for Restorative Neurology, Loma Linda University School of Medicine, CA; Department of Neurology and Laboratory of Neuroscience (V.S.), Istituto Auxologico Italiano, IRCCS, Milan; Department of Pathophysiology and Transplantation (V.S.), "Dino Ferrari" Centre, Università degli Studi di Milano, Milan, Italy; Nuffield Department of Clinical Neurosciences (M.R.T.), University of Oxford, UK; Neuromuscular Diseases Unit/ALS Clinic (M.W.), Kantonsspital St. Gallen, Switzerland; Carolinas Neuromuscular/ALS-MDA Care Center (B.R.B.), Charlotte; Department of Neurology (B.R.B.), Carolinas Medical Center, University of North Carolina School of Medicine, Charlotte; Forbes Norris ALS Treatment and Research Center (R.G.M.), California Pacific Medical Center San Francisco; and Department of Neurosciences (R.G.M.), Stanford University, CA. L.H.vandenBerg@umcutrecht.nl. 2. From the Department of Neurology (L.H.v.d.B.), Brain Center Rudolf Magnus, University Medical Center Utrecht, the Netherlands; Department of Neurology (E.S.), Mayo Clinic, Rochester, MN; Department of Neurology (G.G.), University of Kansas Medical Center, Kansas City; Department of Medicine (E.A.M.), Massachusetts General Hospital, Biostatistics Center, Harvard Medical School, Boston; Department of Neurology (J.A., H.M.), Columbia University, Eleanor and Lou Gehrig ALS Center, New York, NY; Department of Neurology (R.H.B.), Cedars-Sinai Medical Center, Los Angeles, CA; Department of Neurology (M.B.), University of Miami, FL; Neurological Clinical Research Institute (J.D.B.), Massachusetts General Hospital, Boston; Rita Levi Montalcini Department of Neuroscience (A.C.), University of Torino, Italy; Centre Constitutif SLA (P.C.), Université de Tours, France; Department of Neurology (A.G.), Clinical Research Unit, Montreal Neurological Institute, Neurosurgery, McGill University, Montreal, Canada; National Institute of Neurological Disorders and Stroke (A.K.G.), National Institutes of Health, Bethesda, MD; ALS Center (C.L.-H.), University of California San Francisco; Department of Neuroscience (C.J.M.), Sheffield Institute for Translational Neuroscience, University of Sheffield, UK; Department of Neurology (E.P.P.), Section of ALS & Related Disorders, Cleveland Clinic, OH; Department of Neurology (J.R.), The Center for Restorative Neurology, Loma Linda University School of Medicine, CA; Department of Neurology and Laboratory of Neuroscience (V.S.), Istituto Auxologico Italiano, IRCCS, Milan; Department of Pathophysiology and Transplantation (V.S.), "Dino Ferrari" Centre, Università degli Studi di Milano, Milan, Italy; Nuffield Department of Clinical Neurosciences (M.R.T.), University of Oxford, UK; Neuromuscular Diseases Unit/ALS Clinic (M.W.), Kantonsspital St. Gallen, Switzerland; Carolinas Neuromuscular/ALS-MDA Care Center (B.R.B.), Charlotte; Department of Neurology (B.R.B.), Carolinas Medical Center, University of North Carolina School of Medicine, Charlotte; Forbes Norris ALS Treatment and Research Center (R.G.M.), California Pacific Medical Center San Francisco; and Department of Neurosciences (R.G.M.), Stanford University, CA.
Abstract
OBJECTIVE: To revise the 1999 Airlie House consensus guidelines for the design and implementation of preclinical therapeutic studies and clinical trials in amyotrophic lateral sclerosis (ALS). METHODS: A consensus committee comprising 140 key members of the international ALS community (ALS researchers, clinicians, patient representatives, research funding representatives, industry, and regulatory agencies) addressed 9 areas of need within ALS research: (1) preclinical studies; (2) biological and phenotypic heterogeneity; (3) outcome measures; (4) disease-modifying and symptomatic interventions; (5) recruitment and retention; (6) biomarkers; (7) clinical trial phases; (8) beyond traditional trial designs; and (9) statistical considerations. Assigned to 1 of 8 sections, committee members generated a draft set of guidelines based on a "background" of developing a (pre)clinical question and a "rationale" outlining the evidence and expert opinion. Following a 2-day, face-to-face workshop at the Airlie House Conference Center, a modified Delphi process was used to develop draft consensus research guidelines, which were subsequently reviewed and modified based on comments from the public. Statistical experts drafted a separate document of statistical considerations (section 9). RESULTS: In this report, we summarize 112 guidelines and their associated backgrounds and rationales. The full list of guidelines, the statistical considerations, and a glossary of terms can be found in data available from Dryad (appendices e-3-e-5, doi.org/10.5061/dryad.32q9q5d). The authors prioritized 15 guidelines with the greatest potential to improve ALS clinical research. CONCLUSION: The revised Airlie House ALS Clinical Trials Consensus Guidelines should serve to improve clinical trial design and accelerate the development of effective treatments for patients with ALS.
OBJECTIVE: To revise the 1999 Airlie House consensus guidelines for the design and implementation of preclinical therapeutic studies and clinical trials in amyotrophic lateral sclerosis (ALS). METHODS: A consensus committee comprising 140 key members of the international ALS community (ALS researchers, clinicians, patient representatives, research funding representatives, industry, and regulatory agencies) addressed 9 areas of need within ALS research: (1) preclinical studies; (2) biological and phenotypic heterogeneity; (3) outcome measures; (4) disease-modifying and symptomatic interventions; (5) recruitment and retention; (6) biomarkers; (7) clinical trial phases; (8) beyond traditional trial designs; and (9) statistical considerations. Assigned to 1 of 8 sections, committee members generated a draft set of guidelines based on a "background" of developing a (pre)clinical question and a "rationale" outlining the evidence and expert opinion. Following a 2-day, face-to-face workshop at the Airlie House Conference Center, a modified Delphi process was used to develop draft consensus research guidelines, which were subsequently reviewed and modified based on comments from the public. Statistical experts drafted a separate document of statistical considerations (section 9). RESULTS: In this report, we summarize 112 guidelines and their associated backgrounds and rationales. The full list of guidelines, the statistical considerations, and a glossary of terms can be found in data available from Dryad (appendices e-3-e-5, doi.org/10.5061/dryad.32q9q5d). The authors prioritized 15 guidelines with the greatest potential to improve ALS clinical research. CONCLUSION: The revised Airlie House ALS Clinical Trials Consensus Guidelines should serve to improve clinical trial design and accelerate the development of effective treatments for patients with ALS.
Consensus guidelines for performing clinical trials in amyotrophic lateral sclerosis (ALS) were published in 1999, only a few years after approval of riluzole, the first drug to treat ALS.[1] Since then, more than 40 clinical trials have provided clinical trial experience, and 2 additional drugs have been approved: dextromethorphan/quinidine for symptomatic treatment of pseudobulbar affect and the disease-modifying drug edaravone.[2,3] Riluzole provides a modest prolongation of survival and edaravone a modest slowing of functional decline in a selected cohort, but there is still an urgent need for more effective therapies.The following advances have raised expectations and may improve ALS trial success: (1) the ability to model human disease using induced pluripotent stem cell lines[4,5]; (2) the discovery of an increasing number of ALS-associated genes[6]; (3) recognition of ALS as a phenotypically, etiologically, and biologically heterogeneous disease[6,7]; (4) the development of techniques to analyze “big data” to subclassify ALS more accurately and generate personalized prediction models[8,9]; and (5) the emergence of new outcome measures such as disease staging and technology-assisted outcomes.[10,11] In addition, rigorous methods of establishing trial guidelines have evolved. The modified Delphi process has become a common method of achieving consensus, particularly when scientific evidence is suboptimal.[12]In 2016, international stakeholders met at the Airlie House Conference Center, Warrenton, VA, to develop new ALS clinical trials research guidelines using the modified Delphi method.
Methods
Following the proposal to revise the 1999 guidelines at the ALS Research Group Summit Meeting, held October 2014, an Organizing Committee and Advisory Board were assembled including international stakeholders in ALS research. The Organizing Committee identified 9 areas to be addressed: (1) preclinical studies; (2) biological and phenotypic heterogeneity; (3) outcome measures; (4) therapeutic and symptomatic interventions; (5) recruitment and retention; (6) biomarkers; (7) clinical trial phases; (8) beyond traditional trial designs; and (9) statistical considerations (see appendix 1 for the leadership and appendix 2 for membership of each section).The first stage of developing the guidelines involved identifying key members of the international ALS community, including researchers, clinicians, health care professionals, patients and caregivers, representatives from patient advocacy groups, industry, funding agencies, and regulatory agencies. Each member was assigned to 1 of the 8 nonstatistical sections with a maximum of 20 people/section. Seven experts in statistics produced a separate document on Statistical Considerations. These individuals also participated in 1 or 2 of the nonstatistical sections. Under the guidance of the section leaders, the nonstatistical sections independently identified key areas to be addressed within their topic. This resulted in a draft document including a background describing the context for each topic, a series of preliminary evidence-informed guidelines, and a rationale providing the evidence and expert opinion supporting each guideline. Each statement within the rationale was classified as one of the following: (1) supported by evidence (with appropriate references); (2) accepted on principle (if the statement is widely believed to be true by the ALS community even in the absence of conclusive evidence); or (3) an inference logically derived from other premises (deductive conclusion).The second stage of developing guidelines was a face-to-face meeting of stakeholders that took place in the Airlie House Conference Center in Warrenton, VA, in March 2016. Appointed leaders from each group presented the draft guidelines, which was followed by a discussion by all conference participants. Discussions focused on the logical rationale for the guidelines, validity of the axiomatic and evidence statements, logical basis of any inferences, and the absence of any necessary premises. Following the discussion, additional comments on each of the guidelines were submitted anonymously. Each section met again independently to review the feedback and provide modifications to their document's background, rationale, or guidelines. This resulted in a second draft document from each of the 8 sections.The third stage of developing guidelines included a month-long public comment period (August 2016) on the 8 nonstatistical documents. Each section met to review the publicly provided anonymous feedback, modify content as needed, and provide a written explanation for actions taken or not taken to modify the document in response to the feedback. This resulted in a third draft document from each of the sections (data available from Dryad, appendix e-4, doi.org/10.5061/dryad.32q9q5d).The fourth stage of developing the guidelines entailed a modified Delphi consensus process in which the guidelines and supporting rationales were reviewed under the guidance of G.G. (American Academy of Neurology, Guideline Methodologist).[12] During this stage, the members of each section provided anonymous judgments regarding the cogency of the rationales supporting the guidelines and the anticipated impact of each guideline. Cogency issues were addressed by answering the following yes/no questions:Assuming all premises are true, is the rationale logical?Are the evidence-based statements correct?Do you agree with the stipulated axioms?Are the internal inferences correct?Are important premises missing from the rationale?If all 5 questions gained an affirmative response from 80% or more of the respondents, consensus was declared.Next, the respondents were asked to assess, using a 4-point ordinal score, how adherence to the guidelines would affect the following domains:The benefit relative to harm ratio (large, moderate, small, none)Feasibility (always, usually, occasionally, rarely)Cost relative to benefit (small, moderate, large, very large)Consensus on the guidelines was declared when 80% of respondents rated the effect of adherence within 1 ordinal rank in all 3 domains. If consensus was not achieved after the first round of voting, guidelines were reviewed, modified, and subjected to subsequent rounds of voting, up to a maximum of 3. After consensus was attained, a guideline was rejected if the lowest modal score in any domain indicated the lowest level of effect (no benefit, rarely feasible, very large cost). Otherwise, the strength of the guideline was indicated by the auxiliary verbs may, should, or must. Guidelines were designated by “may” when the lowest modal score in any domain was in the second lowest category (small benefit, occasionally feasible, large cost) and indicated reasonable options for ALS researchers. Guidelines designated by “should” resulted when the lowest modal score in any domain was in the second highest category (moderate benefit, usually feasible, moderate cost) and indicated actions ALS researchers would usually follow. Guidelines were designated by “must” when modal scores in all domains were in the highest category (large benefit, always feasible, small cost) and indicated actions would almost always follow.This process generated a final list of 112 guidelines. Because of the large number of guidelines generated, the section leaders and conference organizers were asked to prioritize 15 guidelines with the greatest potential to improve ALS clinical research. These high-priority guidelines are summarized in the results section below. Section 9 on statistical guidelines was not developed using the modified Delphi process.We emphasize that these are guidelines that were not developed using the American Academy of Neurology's practice guideline development process.
Results
For a full review of the ALS Clinical Trials Guidelines, the reader is referred to data available from Dryad (appendices e-4 and e-5, doi.org/10.5061/dryad.32q9q5d). A summary of the most important guidelines and those prioritized (marked with *) by section leaders and conference organizers are presented below.
Preclinical studies
Background
Demonstrations of efficacy in animal models have not led to successful therapies in humans. The development of drugs has been hampered by genetically engineered animal models that do not reflect the complete spectrum of phenotypes present in people living with ALS (PALS) and by inconsistency in the design and execution of preclinical studies, as well as a paucity of naturally occurring ALS animal models.[13-16]Our ability to model human disease using induced pluripotent stem cell lines, 3-dimensional tissue models, and other complex in vitro systems, has improved dramatically.[4,5] Such cellular model systems permit confirmation of target engagement but may not effectively model the complex pathophysiology of ALS.
Guidelines
*Investigators should provide a firm biological rationale for moving a therapeutic candidate into human trials. This rationale may arise from data obtained in engineered animal models or cellular models, naturally occurring ALS-like animal diseases, and/or from human clinical data.Investigators should use preclinical models for assessment of (1) efficacy (ALS models) or (2) safety, toxicity, bioavailability, and biodistribution (can also be conducted in wild-type animals/cells).Investigators may prioritize development of model systems that recapitulate key pathologies seen in sporadic ALS, such as cytoplasmic TDP-43 (TAR DNA-binding protein 43) mislocalization.To enhance existing in vitro models, investigators may develop model systems with multiple relevant cell types in organoid-like or similar 3-dimensional structures to improve cellular maturity and to study noncell autonomous disease processes.*Investigators should develop preclinical pharmacodynamic and target engagement biomarkers for therapeutic candidates to inform the design of human trials whenever possible.Investigators should develop, publish, and adhere to best practice guidelines for the use of fully characterized preclinical ALS models.*Investigators and research funders should commit effort, time, and funds to independent preclinical validation studies of therapeutic candidates, and publish positive and negative results, ideally in a peer-reviewed, open-access format.
Biological and phenotypic heterogeneity
Incident cases (all new cases diagnosed within a specific time frame [usually 6 months to a year after diagnosis]) have a worse prognosis than prevalent cases (all existing diagnosed cases). Prevalent cases are generally younger and more likely to have a spinal presentation and slower progression.[17-19]While the clinical presentation of familial cases resembles that of sporadic cases, specific gene abnormalities may influence the clinical phenotype and prognosis. Genetic analyses could be performed before and during trials in cases of unexpected response since little is known regarding the genetic-epigenetic interplay or modifier gene polymorphisms in ALS.More than 30% of PALS manifest cognitive impairment, which may exacerbate functional decline and lead to earlier death.[20] There are multiple other factors that affect phenotype and survival, but stratification can realistically be performed for only 3 or 4 factors, depending on the size of the trial. The issue of having to stratify for too many variables could be overcome by the use of a reliable prediction model of prognosis.[9]Investigators should preferentially enroll PALS with “clinically definite,” “clinically probable,” “probable-laboratory supported,” and “clinically possible” ALS, who have a short interval from disease onset to trial entry.Investigators should stratify for genetic factors and cognitive (especially executive function) and behavioral impairments.*Investigators should collect DNA from all participants, when possible, to allow genetic post hoc analyses, which may reveal important stratification or screening factors for a subsequent clinical trial(s).Investigators should choose to stratify for factors most relevant to the outcome measure of the trial.Investigators could stratify based on prognostic systems or prediction models.
Outcome measures
For a primary outcome, an endpoint is needed in phase 3 clinical trials that is robust, can be reliably measured, and is clinically meaningful. Survival and functional scales fulfill these criteria but have limitations: survival trials require large numbers of patients with long follow-up time, while functional scales are limited because of deaths and variable follow-up periods with resulting missing data points.[21-23] Other or additional outcome measures will have to be included, explored, or validated. A short background of each of these (potential) outcome measures is below.An endpoint combining survival and function may adjust for dropouts and increase power.[24,25]Muscle strength: As progressive weakness is the cardinal symptom of ALS, accurate measurement of muscle strength represents a direct measure of disease status.[24-26]Respiratory failure carries a poor prognosis and is the most common cause of death in ALS.Quality of life (QOL) is an important part of human existence and a critical outcome of treatment for PALS.[27,28]Cognitive and behavioral abnormalities have been recognized in many patients with ALS and can be debilitating.[29]Motor neuron function: Electrophysiology can assess the function of the upper and lower motor neurons.Staging: Various methods of clinically staging ALS have been proposed.[10,30-32]Responder analyses: With our improved understanding of ALS as a multifactorial disorder, responder analyses have the potential to demonstrate beneficial effects of a proposed treatment on a subset of PALS with a shared unique pathophysiology. Such benefits may be missed in a broader analysis that pools all PALS.Technology-assisted outcomes of mobility through use of pedometers, accelerometers, activity trackers, and motion analysis systems could be used to more objectively quantify daily locomotor activities.Networks (NEALS [Northeast ALS Consortium], TRICALS [Trial Research Initiative to Cure ALS]) have been established to organize adequate training and certification to ensure quality control of outcome measures.Investigators should include either a survival analysis or functional assessment as the primary outcome measure in phase 3 trials with the alternative included as a secondary outcome.Investigators may include a combined survival/functional outcome measure as an exploratory endpoint.Investigators may include quantitative strength assessments as a primary outcome measure.Investigators may include a health-independent, ALS-specific QOL scale as a primary outcome measure in symptomatic management trials.Investigators may include assessments of cognitive or behavioral function as primary or secondary outcome measures.Investigators should use measures of pulmonary function as an outcome; these may be used as a primary outcome.Investigators may use electrophysiology measures, electrical impedance myography, health-independent ALS-specific QOL scales, bulbar assessment scales, staging, and caregiver measurements as secondary outcome measures.Investigators may include responder analyses; the parameters and definitions of a “responder” should be specified prior to trial initiation.Investigators may include technology-assisted measurements as exploratory endpoints.*All study examiners should undergo training to ensure uniformity of study procedures across sites and across time.
Disease-modifying and symptomatic interventions
Symptomatic interventions are those that do not modify the underlying pathophysiology but that treat specific symptoms. In trials of disease-modifying interventions, symptom management (e.g., with noninvasive ventilation [NIV],[33] nutrition, and gastrostomy[34]) may alter results obtained using validated disease scales and affect other trial outcomes including survival. Relatively few studies of symptomatic therapies or medical devices have been completed.ALS is the result of a complex cascade involving multiple cell types and various mechanisms converging to result in motor neuron cell death.[35] Thus, novel therapies could be aimed at multiple aspects of the disease cascade (i.e., multidrug trials). Combination drug therapies have proven effective for other diseases (e.g., HIV, lymphoma), even when the agents involved have not shown individual efficacy. Hence, it may not be necessary to demonstrate efficacy separately for single drugs prior to using them in multidrug ALS trials. Disease-specific biomarkers relative to the various mechanisms being tested will be needed to assess the contribution of each drug in a multidrug trial.[36]*When a symptomatic intervention is effective (e.g., NIV), the investigator should consider permitting its use for trial participants. Ethical implications and challenges to enrollment should be carefully considered if such a symptomatic intervention is used as an exclusion factor for participation.Investigators should plan a priori analyses and standardize and record use of interventions known to affect disease course within a clinical trial (e.g., NIV, gastrostomy placement).*Investigators should conduct rigorous randomized controlled trials of symptomatic therapies or medical devices and utilize a patient-reported outcome and QOL measure as either a primary or secondary outcome in such trials.Investigators may use multidrug therapy in ALS clinical trial design.Trialists may use disease-specific assays for any combination drug trial to assess both clinical efficacy and the individual pathophysiologic mechanisms.
Recruitment and retention
Clinical trials require the enthusiasm of PALS and caregivers to support enrollment, minimize missing data, and avoid dropout. Leading clinical trial groups from fields outside of ALS are increasingly partnering with patients and caregivers on the development of protocols, recruitment strategies, and publications.[37,38]There is increasing pressure by PALS and caregivers to obtain access to treatments, including investigational therapies, which have not been adequately studied and thus, are not known to be effective. History demonstrates that most investigational therapies will ultimately be determined ineffective by well-designed clinical trials. Most therapies cause side effects, and phase 1 studies commonly underestimate the risks from new therapies because of small sample size and limited generalizability.The Right to Try Act of 2017 was signed into law on May 30, 2018. Our full consensus-based guidelines were finalized before this time. We have added a comment on the approved legislation in the full guidelines found in data available from Dryad (appendix e-4, page 45, doi.org/10.5061/dryad.32q9q5d).*Investigators should ensure ALS clinical trial results are published in open access journals.All efforts should be made to improve trial design in ways that expand the number of PALS receiving the experimental therapy, including limiting use of a placebo arm.Investigators should explain to PALS that withdrawing from clinical trials may reduce the certainty of results.Because safety and efficacy of experimental drugs are not demonstrated in phase 1 clinical trials, drug developers should move as quickly as possible to subsequent phase 2 trials where more reliable data on these parameters are obtained.Physicians may counsel PALS requesting investigational therapies that (1) because most investigational therapies are ultimately found to be ineffective and have side effects, PALS are more likely to be harmed than helped by such treatments, (2) physicians are not obliged to prescribe such therapies outside a clinical trial designed to establish safety and efficacy, (3) insurers are unlikely to pay for such therapies, and (4) manufacturers are not obliged to make such therapies available.
Biomarkers
Use of biomarkers, defined as “characteristics that are objectively measured and evaluated as indicators of normal biological processes, pathological processes, or biological responses to therapeutic interventions,” may facilitate greater success of ALS clinical trials. Various types of biomarkers are recognized (table), each with a different potential application in the clinical trial setting. In considering the potential use of biomarkers, a distinction should be made between generic biomarkers of motor neuron loss (e.g., neurofilaments) and biomarkers that might be specific to a drug with a particular mechanism of action (e.g., cytokines as markers of inflammation). A plethora of biomarker candidates (biological fluids, neuroimaging, and neurophysiologic studies) have emerged, but none have been formally validated for routine clinical or therapeutic trial use in ALS. In addition to ensuring that these candidates meet minimum methodologic criteria, pragmatic issues such as patient tolerability, burden of participation, investigator time, cost, complexity, need for specialized equipment, training, and certification will also require consideration.
Table
Types of biomarkers
Types of biomarkers*In designing and implementing ALS clinical trials, investigators should incorporate (to the extent that they have been developed and validated as such) predictive biomarkers, prognostic biomarkers, and, especially in phase 2 trials, pharmacodynamic biomarkers (table) (3 prioritized guidelines [6-1-1, 6-1-2, and 6-1-3] on pages 46 and 47 of the full guidelines found in data available from Dryad, appendix e-4, doi.org/10.5061/dryad.32q9q5d).*Investigators should ensure that biomarkers are quantifiable and can be measured reliably using standardized operating procedures across multiple centers, accounting for relevant sources of variability, including intra- and intersubject, intra- and interassessment (assay, evaluator, scanner), and interlaboratory/site.Investigators should accumulate additional experimental data to support the use of biomarkers in future clinical trials for go/no-go decisions.
Clinical trial phases
The process of investigating novel treatment consists of 3 phases:The purpose of phase 1 studies is to define the short-term safety profile, pharmacokinetic profile, and maximum tolerated dose. Many times, phase 1 trials incorporate single ascending dose and multiple ascending dose designs to accomplish these goals.Phase 2 trials assess optimal dosing, expand pharmacokinetics, determine whether a therapy has the desired biological effect, monitor safety and tolerability, and whether a potential therapy reaches and affects its intended target.[39,40] Clinical efficacy is not the main goal of phase 2 studies.[39,41,42]Phase 3 trials aim to demonstrate efficacy. The long track record of negative phase 3 trials emphasizes the need for innovative trial design.[2,39] Randomized, placebo-controlled clinical trials remain the most robust way to demonstrate efficacy of an intervention.[2] Alternatively, there are study designs that assess efficacy without the use of placebo controls, which can be explored.[43]Alternative study designs (adaptive designs, seamless phase 2/3 designs, enrichment designs, or futility designs) (see also statistical considerations in data available from Dryad, appendix e-5, doi.org/10.5061/dryad.32q9q5d) can provide an opportunity to more efficiently and rapidly conduct clinical trials to evaluate potential therapies.There are distinct challenges and opportunities in performing early-phase gene and stem cell therapy trials in ALS, which require special approaches and unique trial designs for testing these therapies. When small subpopulations are targeted or a large effect is expected, as with certain gene therapy approaches, traditional concurrent placebo controls may not be feasible.In phase 1 studies, investigators should incorporate single ascending dose and multiple ascending dose designs to evaluate safety, pharmacokinetic profile, and maximum tolerated dose. Investigators may include a placebo control to evaluate the adverse event rate but may omit placebo when its inclusion involves excessive risk. They may choose to conduct studies in healthy volunteers or PALS depending on the nature of the intervention and goals of the study.*Investigators should carefully review phase 2 trial results and choose a primary endpoint that is clinically meaningful and adequately powered for phase 3.Investigators may move from phase 2 to phase 3 with at least adequate information on safety and tolerability, and should move forward if there is safety and tolerability in combination with (1) information regarding pharmacodynamically optimal dose, (2) evidence of target engagement, and/or (3) evidence of clinical efficacy.Investigators may assess biological effect and/or preliminary efficacy, even using novel methods (e.g., predictive algorithms or exploratory biomarkers), to support a decision to move a therapy to phase 3 trials.*When designing phase 3 trials, investigators should seek to use placebo-control before considering alternative designs.Investigators should work with biostatisticians to consider alternative designs.Investigators should use novel approaches to trial design to appropriately study gene and cell therapies with potentially invasive delivery or lifelong biological effects; efficacy should be part of the consideration for future phase 2/3 novel trial designs, at the time a phase 1 trial is designed and implemented.*Investigators should publish all clinical trial results, negative or positive, so they are widely available to the ALS community.
Beyond the traditional clinical trial
Despite positive effects in animal models or phase 2 trials, numerous promising therapeutics have failed during phase 3 studies over the last 20 years. Thus, a reappraisal of phase 3 methodologies is warranted because (1) many trials lack evidence that the therapy either reaches the CNS or engages the intended target, (2) drug-drug interactions between riluzole and the investigational drug may have affected the potential efficacy of the investigated drug, (3) more efficient and effective outcome measures are needed, including those that combine function and survival, and (4) phenotypic and genotypic heterogeneity of the ALS population has not been considered in inclusion criteria in previous trials. However, a lack of positive trials does not necessarily indicate a flawed process but may reflect lack of substantial efficacy, limited biomarkers, and limited sensitivity of the outcome measures.[2]Improved regulatory trials, that aim to evaluate the efficacy of a new intervention in a well-controlled setting with the aim of obtaining regulatory approval, are required.[2,3,44] The regulatory path is designed to protect patients and identify therapies that meet the required level of proof of efficacy.The NIH definition of a pragmatic trial is one in which approved drugs are tested in real-world settings.[45] Pragmatic trials may become a future consideration as new therapies are proven to affect the course of the disease.Investigators may include measures of target engagement and evidence of CNS penetration (if warranted) in the earliest PALS treated by the therapeutic molecule (phase 1).Investigators may seek to detect possible interactions of the investigational agent with riluzole.[46]Investigators should develop more efficient and effective outcome measures.Investigators should continue to aggressively pursue disease-modifying therapies, utilizing the scientific method that is inherent in regulatory compliant trials to increase the likelihood that therapies become available to PALS.Investigators should utilize pragmatic trial designs to compare established interventions and determine the external validity of positive phase 3 trials.
Discussion
A recent review of all clinical trials in ALS identified a critical need to update the original Airlie House consensus guidelines.[2] These guidelines were published in 1999, early on in the ALS clinical trial experience, based on a conventional literature review with an informal “consensus” among ALS experts.[1] The present project was undertaken to (1) update the earlier guidelines on the basis of intervening experience, (2) improve the efficiency and consistency of ALS clinical trials, and (3) use modern methods of examining evidence and establishing consensus. The modified Delphi process was applied,[12] involving 140 international stakeholders with diverse interests and experience, in a multistage process. This approach was chosen to minimize bias since the option of a truly evidence-based approach was limited by the quality of available scientific evidence. The modified Delphi process is a formal consensus process that decreases the risk of bias being introduced into the guideline development process by reducing the influence of dominant personalities and group-think, encouraging input from all participants, and increasing the probability that participants will change their opinions after considering other perspectives.[12] Participants share their perspectives in a systematic way with the ultimate goal of achieving an unbiased consensus on a set of specific guidelines that are evidence-informed.The 1999 guidelines briefly covered a number of statistical issues pertaining to phase 3 clinical trials. The 2018 guidelines include a more comprehensive statistical section that covers guidance for all phases of clinical research. Guidance on handling of dropouts, stratification, covariate adjustment, time-to-failure analyses, and lead-in designs has been updated and expanded, including discussion of predicted outcomes in design and analysis of trials. New guidance is provided in the following areas: pilot trial design; group-sequential methods application; pros and cons of adaptive trial designs; use of historical controls; biomarker development; combined analysis of survival and progression; use of linear mixed models for repeated measurements of longitudinal outcomes; specification and analysis of secondary outcomes; subgroup analyses; trial registration; data standardization; and data sharing.ALS research has advanced considerably since publication of the previous guidelines. The introduction of 3 new areas of guidelines, namely, preclinical studies (section 1), biological and phenotypic heterogeneity (section 2), and biomarkers (section 6) reflects this.In line with the present initiative, adherence to best practice guidelines and standards for preclinical treatment studies in ALS models and biomarker studies should enhance data accuracy and reproducibility, and therapeutic candidate selection before entering clinical trials.Preclinical treatment studies have focused for years on the first and best studied ALS model, the mutated hSOD1 (present in only 1%–2% of PALS) transgenic mouse, but this has not led to effective therapies. Indeed, SOD1 transgenic models do not represent sporadic or other forms of genetic disease in patients.[16,47,48] Newer models based on discoveries of many other genes focus almost entirely on genetic forms of ALS.[47] Disease models that recapitulate key pathologies or biological processes seen in (subsets of) sporadic PALS must be prioritized for more successful translation of treatment efficacy from ALS disease models to patients.[49,50] The recognition that ALS is etiologically and biologically heterogeneous implies that multiple disease models need to be generated to cover all ALS subsets. Yet, at the same time, clinical research involving patients has increasingly been recognized as essential to our understanding of disease heterogeneity and to the success of a precision medicine approach.Gene therapy strategies in patients with a SOD1 or C9orf72 mutation represent the first successful examples of such a personalized approach. But for nonfamilial ALS, larger datasets are required. Such datasets are best collected and analyzed through international collaboration. Given the degree of disease heterogeneity, data from genetics, lifestyle and environmental studies, and patient-derived 2- and 3-dimensional (organoid) induced pluripotent stem cell models will be required. Such datasets are best combined with detailed phenotyping (including cognition) using internationally harmonized patient registries, neuroimaging and neurophysiologic studies, and biomarkers from biological fluids. This approach will provide essential tools to identify subsets of patients with shared etiology or biology and will facilitate targeted clinical trials by enabling the selection of patients most likely to benefit from a particular experimental therapeutic approach. Allowing patients and caregivers to participate in the design and execution of clinical trials is another important aspect of the 2018 guidelines.Given the rate at which the field has advanced in recent years, we suggest a follow-up meeting to refine the guidelines within 4 years. Moreover, we view the 2018 clinical trial guidelines not as inflexible, final, or complete, but rather as an updated starting point for improving clinical trial design and accelerating the development of effective treatments for patients with ALS.
Authors: Ammar Al-Chalabi; Orla Hardiman; Matthew C Kiernan; Adriano Chiò; Benjamin Rix-Brooks; Leonard H van den Berg Journal: Lancet Neurol Date: 2016-10 Impact factor: 44.182
Authors: John Ravits; Stanley Appel; Robert H Baloh; Richard Barohn; Benjamin Rix Brooks; Lauren Elman; Mary Kay Floeter; Christopher Henderson; Catherine Lomen-Hoerth; Jeffrey D Macklis; Leo McCluskey; Hiroshi Mitsumoto; Serge Przedborski; Jeffrey Rothstein; John Q Trojanowski; Leonard H van den Berg; Steven Ringel Journal: Amyotroph Lateral Scler Frontotemporal Degener Date: 2013-05 Impact factor: 4.092
Authors: James F Howard; Kimiaki Utsugisawa; Michael Benatar; Hiroyuki Murai; Richard J Barohn; Isabel Illa; Saiju Jacob; John Vissing; Ted M Burns; John T Kissel; Srikanth Muppidi; Richard J Nowak; Fanny O'Brien; Jing-Jing Wang; Renato Mantegazza Journal: Lancet Neurol Date: 2017-10-20 Impact factor: 44.182
Authors: Neil G Simon; Martin R Turner; Steve Vucic; Ammar Al-Chalabi; Jeremy Shefner; Catherine Lomen-Hoerth; Matthew C Kiernan Journal: Ann Neurol Date: 2014-09-30 Impact factor: 10.422
Authors: Hiroshi Mitsumoto; Diana C Garofalo; Regina M Santella; Eric J Sorenson; Björn Oskarsson; J Americo M Fernandes; Howard Andrews; Jonathan Hupf; Madison Gilmore; Daragh Heitzman; Richard S Bedlack; Jonathan S Katz; Richard J Barohn; Edward J Kasarskis; Catherine Lomen-Hoerth; Tahseen Mozaffar; Sharon P Nations; Andrea J Swenson; Pam Factor-Litvak Journal: Amyotroph Lateral Scler Frontotemporal Degener Date: 2020-04-10 Impact factor: 4.092
Authors: James Berry; Benjamin Brooks; Angela Genge; Terry Heiman-Patterson; Stanley Appel; Michael Benatar; Robert Bowser; Merit Cudkowicz; Clifton Gooch; Jeremy Shefner; Jurjen Westra; Wendy Agnese; Charlotte Merrill; Sally Nelson; Stephen Apple Journal: Neurol Clin Pract Date: 2021-08
Authors: Helena Chaytow; Emily Carroll; David Gordon; Yu-Ting Huang; Dinja van der Hoorn; Hannah Louise Smith; Thomas Becker; Catherina Gwynne Becker; Kiterie Maud Edwige Faller; Kevin Talbot; Thomas Henry Gillingwater Journal: EBioMedicine Date: 2022-08-11 Impact factor: 11.205
Authors: Charis Wong; Rachel S Dakin; Jill Williamson; Judith Newton; Michelle Steven; Shuna Colville; Maria Stavrou; Jenna M Gregory; Elizabeth Elliott; Arpan R Mehta; Jeremy Chataway; Robert J Swingler; Richard Anthony Parker; Christopher J Weir; Nigel Stallard; Mahesh K B Parmar; Malcolm R Macleod; Suvankar Pal; Siddharthan Chandran Journal: BMJ Open Date: 2022-07-07 Impact factor: 3.006
Authors: Michael Benatar; Lanyu Zhang; Lily Wang; Volkan Granit; Jeffrey Statland; Richard Barohn; Andrea Swenson; John Ravits; Carlayne Jackson; Ted M Burns; Jaya Trivedi; Erik P Pioro; James Caress; Jonathan Katz; Jacob L McCauley; Rosa Rademakers; Andrea Malaspina; Lyle W Ostrow; Joanne Wuu Journal: Neurology Date: 2020-05-08 Impact factor: 9.910
Authors: Stephen A Goutman; Orla Hardiman; Ammar Al-Chalabi; Adriano Chió; Masha G Savelieff; Matthew C Kiernan; Eva L Feldman Journal: Lancet Neurol Date: 2022-03-22 Impact factor: 59.935
Authors: C Carlomagno; P I Banfi; A Gualerzi; S Picciolini; E Volpato; M Meloni; A Lax; E Colombo; N Ticozzi; F Verde; V Silani; M Bedoni Journal: Sci Rep Date: 2020-06-23 Impact factor: 4.379
Authors: Sanjay Kalra; Hans-Peter Müller; Abdullah Ishaque; Lorne Zinman; Lawrence Korngut; Angela Genge; Christian Beaulieu; Richard Frayne; Simon J Graham; Jan Kassubek Journal: Neurology Date: 2020-07-09 Impact factor: 9.910
Authors: Sabrina Paganoni; Eric A Macklin; Suzanne Hendrix; James D Berry; Michael A Elliott; Samuel Maiser; Chafic Karam; James B Caress; Margaret A Owegi; Adam Quick; James Wymer; Stephen A Goutman; Daragh Heitzman; Terry Heiman-Patterson; Carlayne E Jackson; Colin Quinn; Jeffrey D Rothstein; Edward J Kasarskis; Jonathan Katz; Liberty Jenkins; Shafeeq Ladha; Timothy M Miller; Stephen N Scelsa; Tuan H Vu; Christina N Fournier; Jonathan D Glass; Kristin M Johnson; Andrea Swenson; Namita A Goyal; Gary L Pattee; Patricia L Andres; Suma Babu; Marianne Chase; Derek Dagostino; Samuel P Dickson; Noel Ellison; Meghan Hall; Kent Hendrix; Gale Kittle; Michelle McGovern; Joseph Ostrow; Lindsay Pothier; Rebecca Randall; Jeremy M Shefner; Alexander V Sherman; Eric Tustison; Prasha Vigneswaran; Jason Walker; Hong Yu; James Chan; Janet Wittes; Joshua Cohen; Justin Klee; Kent Leslie; Rudolph E Tanzi; Walter Gilbert; Patrick D Yeramian; David Schoenfeld; Merit E Cudkowicz Journal: N Engl J Med Date: 2020-09-03 Impact factor: 176.079