W Speier1, C Arnold, N Pouratian. 1. Department of Neurosurgery, University of California, Los Angeles, CA 90095, USA. Medical Imaging Informatics Group, University of California, Los Angeles, CA 90095, USA.
Abstract
OBJECTIVE: The present review systematically examines the integration of language models to improve classifier performance in brain-computer interface (BCI) communication systems. APPROACH: The domain of natural language has been studied extensively in linguistics and has been used in the natural language processing field in applications including information extraction, machine translation, and speech recognition. While these methods have been used for years in traditional augmentative and assistive communication devices, information about the output domain has largely been ignored in BCI communication systems. Over the last few years, BCI communication systems have started to leverage this information through the inclusion of language models. MAIN RESULTS: Although this movement began only recently, studies have already shown the potential of language integration in BCI communication and it has become a growing field in BCI research. BCI communication systems using language models in their classifiers have progressed down several parallel paths, including: word completion; signal classification; integration of process models; dynamic stopping; unsupervised learning; error correction; and evaluation. SIGNIFICANCE: Each of these methods have shown significant progress, but have largely been addressed separately. Combining these methods could use the full potential of language model, yielding further performance improvements. This integration should be a priority as the field works to create a BCI system that meets the needs of the amyotrophic lateral sclerosis population.
OBJECTIVE: The present review systematically examines the integration of language models to improve classifier performance in brain-computer interface (BCI) communication systems. APPROACH: The domain of natural language has been studied extensively in linguistics and has been used in the natural language processing field in applications including information extraction, machine translation, and speech recognition. While these methods have been used for years in traditional augmentative and assistive communication devices, information about the output domain has largely been ignored in BCI communication systems. Over the last few years, BCI communication systems have started to leverage this information through the inclusion of language models. MAIN RESULTS: Although this movement began only recently, studies have already shown the potential of language integration in BCI communication and it has become a growing field in BCI research. BCI communication systems using language models in their classifiers have progressed down several parallel paths, including: word completion; signal classification; integration of process models; dynamic stopping; unsupervised learning; error correction; and evaluation. SIGNIFICANCE: Each of these methods have shown significant progress, but have largely been addressed separately. Combining these methods could use the full potential of language model, yielding further performance improvements. This integration should be a priority as the field works to create a BCI system that meets the needs of the amyotrophic lateral sclerosis population.
Authors: Jonathan R Wolpaw; Niels Birbaumer; Dennis J McFarland; Gert Pfurtscheller; Theresa M Vaughan Journal: Clin Neurophysiol Date: 2002-06 Impact factor: 3.708
Authors: D B Ryan; G E Frye; G Townsend; D R Berry; S Mesa-G; N A Gates; E W Sellers Journal: Int J Hum Comput Interact Date: 2011-01-01 Impact factor: 3.353
Authors: J Faller; S Torrellas; F Miralles; C Holzner; C Kapeller; C Guger; J Bund; G R Müller-Putz; R Scherer Journal: Conf Proc IEEE Eng Med Biol Soc Date: 2012
Authors: Dennis J McFarland; William A Sarnacki; George Townsend; Theresa Vaughan; Jonathan R Wolpaw Journal: Clin Neurophysiol Date: 2010-11-09 Impact factor: 3.708
Authors: Jane E Huggins; Christoph Guger; Erik Aarnoutse; Brendan Allison; Charles W Anderson; Steven Bedrick; Walter Besio; Ricardo Chavarriaga; Jennifer L Collinger; An H Do; Christian Herff; Matthias Hohmann; Michelle Kinsella; Kyuhwa Lee; Fabien Lotte; Gernot Müller-Putz; Anton Nijholt; Elmar Pels; Betts Peters; Felix Putze; Rüdiger Rupp; Gerwin Schalk; Stephanie Scott; Michael Tangermann; Paul Tubig; Thorsten Zander Journal: Brain Comput Interfaces (Abingdon) Date: 2019-12-10