H Zhang1, R Chavarriaga, Z Khaliliardali, L Gheorghe, I Iturrate, J d R Millán. 1. Defitech Chair in Brain-Machine Interface, Center for Neuroprosthetics, School of Engineering, École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech H4, Chemin des Mines 9, Geneva CH-1202, Switzerland.
Abstract
OBJECTIVES: Recent studies have started to explore the implementation of brain-computer interfaces (BCI) as part of driving assistant systems. The current study presents an EEG-based BCI that decodes error-related brain activity. Such information can be used, e.g., to predict driver's intended turning direction before reaching road intersections. APPROACH: We executed experiments in a car simulator (N = 22) and a real car (N = 8). While subject was driving, a directional cue was shown before reaching an intersection, and we classified the presence or not of an error-related potentials from EEG to infer whether the cued direction coincided with the subject's intention. In this protocol, the directional cue can correspond to an estimation of the driving direction provided by a driving assistance system. We analyzed ERPs elicited during normal driving and evaluated the classification performance in both offline and online tests. RESULTS: An average classification accuracy of 0.698 ± 0.065 was obtained in offline experiments in the car simulator, while tests in the real car yielded a performance of 0.682 ± 0.059. The results were significantly higher than chance level for all cases. Online experiments led to equivalent performances in both simulated and real car driving experiments. These results support the feasibility of decoding these signals to help estimating whether the driver's intention coincides with the advice provided by the driving assistant in a real car. SIGNIFICANCE: The study demonstrates a BCI system in real-world driving, extending the work from previous simulated studies. As far as we know, this is the first online study in real car decoding driver's error-related brain activity. Given the encouraging results, the paradigm could be further improved by using more sophisticated machine learning approaches and possibly be combined with applications in intelligent vehicles.
OBJECTIVES: Recent studies have started to explore the implementation of brain-computer interfaces (BCI) as part of driving assistant systems. The current study presents an EEG-based BCI that decodes error-related brain activity. Such information can be used, e.g., to predict driver's intended turning direction before reaching road intersections. APPROACH: We executed experiments in a car simulator (N = 22) and a real car (N = 8). While subject was driving, a directional cue was shown before reaching an intersection, and we classified the presence or not of an error-related potentials from EEG to infer whether the cued direction coincided with the subject's intention. In this protocol, the directional cue can correspond to an estimation of the driving direction provided by a driving assistance system. We analyzed ERPs elicited during normal driving and evaluated the classification performance in both offline and online tests. RESULTS: An average classification accuracy of 0.698 ± 0.065 was obtained in offline experiments in the car simulator, while tests in the real car yielded a performance of 0.682 ± 0.059. The results were significantly higher than chance level for all cases. Online experiments led to equivalent performances in both simulated and real car driving experiments. These results support the feasibility of decoding these signals to help estimating whether the driver's intention coincides with the advice provided by the driving assistant in a real car. SIGNIFICANCE: The study demonstrates a BCI system in real-world driving, extending the work from previous simulated studies. As far as we know, this is the first online study in real car decoding driver's error-related brain activity. Given the encouraging results, the paradigm could be further improved by using more sophisticated machine learning approaches and possibly be combined with applications in intelligent vehicles.
Authors: Ioannis Kakkos; Errikos M Ventouras; Pantelis A Asvestas; Irene S Karanasiou; George K Matsopoulos Journal: Med Biol Eng Comput Date: 2020-01-09 Impact factor: 2.602
Authors: Benjamin Blankertz; Laura Acqualagna; Sven Dähne; Stefan Haufe; Matthias Schultze-Kraft; Irene Sturm; Marija Ušćumlic; Markus A Wenzel; Gabriel Curio; Klaus-Robert Müller Journal: Front Neurosci Date: 2016-11-21 Impact factor: 4.677
Authors: Nile R Wilson; Devapratim Sarma; Jeremiah D Wander; Kurt E Weaver; Jeffrey G Ojemann; Rajesh P N Rao Journal: Front Neurosci Date: 2019-05-22 Impact factor: 4.677
Authors: Luca Ascari; Anna Marchenkova; Andrea Bellotti; Stefano Lai; Lucia Moro; Konstantin Koshmak; Alice Mantoan; Michele Barsotti; Raffaello Brondi; Giovanni Avveduto; Davide Sechi; Alberto Compagno; Pietro Avanzini; Jonas Ambeck-Madsen; Giovanni Vecchiato Journal: Sensors (Basel) Date: 2021-12-07 Impact factor: 3.576