Robert Bauer1, Mathias Vukelić2, Alireza Gharabaghi3. 1. Division of Functional and Restorative Neurosurgery, and Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen, Germany. Electronic address: robert.bauer@cin.uni-tuebingen.de. 2. Division of Functional and Restorative Neurosurgery, and Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen, Germany. 3. Division of Functional and Restorative Neurosurgery, and Centre for Integrative Neuroscience, Eberhard Karls University Tuebingen, Germany. Electronic address: alireza.gharabaghi@uni-tuebingen.de.
Abstract
OBJECTIVE: The balance between action and reward during neurofeedback may influence reinforcement learning of brain self-regulation. METHODS: Eleven healthy volunteers participated in three runs of motor imagery-based brain-machine interface feedback where a robot passively opened the hand contingent to β-band modulation. For each run, the β-desynchronization threshold to initiate the hand robot movement increased in difficulty (low, moderate, and demanding). In this context, the incentive to learn was estimated by the change of reward per action, operationalized as the change in reward duration per movement onset. RESULTS: Variance analysis revealed a significant interaction between threshold difficulty and the relationship between reward duration and number of movement onsets (p<0.001), indicating a negative learning incentive for low difficulty, but a positive learning incentive for moderate and demanding runs. Exploration of different thresholds in the same data set indicated that the learning incentive peaked at higher thresholds than the threshold which resulted in maximum classification accuracy. CONCLUSION: Specificity is more important than sensitivity of neurofeedback for reinforcement learning of brain self-regulation. SIGNIFICANCE: Learning efficiency requires adequate challenge by neurofeedback interventions.
OBJECTIVE: The balance between action and reward during neurofeedback may influence reinforcement learning of brain self-regulation. METHODS: Eleven healthy volunteers participated in three runs of motor imagery-based brain-machine interface feedback where a robot passively opened the hand contingent to β-band modulation. For each run, the β-desynchronization threshold to initiate the hand robot movement increased in difficulty (low, moderate, and demanding). In this context, the incentive to learn was estimated by the change of reward per action, operationalized as the change in reward duration per movement onset. RESULTS: Variance analysis revealed a significant interaction between threshold difficulty and the relationship between reward duration and number of movement onsets (p<0.001), indicating a negative learning incentive for low difficulty, but a positive learning incentive for moderate and demanding runs. Exploration of different thresholds in the same data set indicated that the learning incentive peaked at higher thresholds than the threshold which resulted in maximum classification accuracy. CONCLUSION: Specificity is more important than sensitivity of neurofeedback for reinforcement learning of brain self-regulation. SIGNIFICANCE: Learning efficiency requires adequate challenge by neurofeedback interventions.
Authors: Sam Darvishi; Alireza Gharabaghi; Michael C Ridding; Derek Abbott; Mathias Baumert Journal: IEEE J Transl Eng Health Med Date: 2018-11-09 Impact factor: 3.316
Authors: Sam Darvishi; Alireza Gharabaghi; Chadwick B Boulay; Michael C Ridding; Derek Abbott; Mathias Baumert Journal: Front Neurosci Date: 2017-02-09 Impact factor: 4.677