Literature DB >> 33501252

A Survey on Probabilistic Models in Human Perception and Machines.

Lux Li1, Robert Rehr2, Patrick Bruns1, Timo Gerkmann2, Brigitte Röder1.   

Abstract

Extracting information from noisy signals is of fundamental importance for both biological and artificial perceptual systems. To provide tractable solutions to this challenge, the fields of human perception and machine signal processing (SP) have developed powerful computational models, including Bayesian probabilistic models. However, little true integration between these fields exists in their applications of the probabilistic models for solving analogous problems, such as noise reduction, signal enhancement, and source separation. In this mini review, we briefly introduce and compare selective applications of probabilistic models in machine SP and human psychophysics. We focus on audio and audio-visual processing, using examples of speech enhancement, automatic speech recognition, audio-visual cue integration, source separation, and causal inference to illustrate the basic principles of the probabilistic approach. Our goal is to identify commonalities between probabilistic models addressing brain processes and those aiming at building intelligent machines. These commonalities could constitute the closest points for interdisciplinary convergence.
Copyright © 2020 Li, Rehr, Bruns, Gerkmann and Röder.

Entities:  

Keywords:  audiovisual integration; automatic speech recognition; causal inference; human psychophysics; multisensory perception; optimal cue integration; signal processing; speech enhancement

Year:  2020        PMID: 33501252      PMCID: PMC7805657          DOI: 10.3389/frobt.2020.00085

Source DB:  PubMed          Journal:  Front Robot AI        ISSN: 2296-9144


  46 in total

1.  The ventriloquist effect results from near-optimal bimodal integration.

Authors:  David Alais; David Burr
Journal:  Curr Biol       Date:  2004-02-03       Impact factor: 10.834

2.  Seeing to hear better: evidence for early audio-visual interactions in speech identification.

Authors:  Jean-Luc Schwartz; Frédéric Berthommier; Christophe Savariaux
Journal:  Cognition       Date:  2004-09

3.  Analyzing neural responses to natural signals: maximally informative dimensions.

Authors:  Tatyana Sharpee; Nicole C Rust; William Bialek
Journal:  Neural Comput       Date:  2004-02       Impact factor: 2.026

4.  Bayesian inference explains perception of unity and ventriloquism aftereffect: identification of common sources of audiovisual stimuli.

Authors:  Yoshiyuki Sato; Taro Toyoizumi; Kazuyuki Aihara
Journal:  Neural Comput       Date:  2007-12       Impact factor: 2.026

5.  Nonlinearities and contextual influences in auditory cortical responses modeled with multilinear spectrotemporal methods.

Authors:  Misha B Ahrens; Jennifer F Linden; Maneesh Sahani
Journal:  J Neurosci       Date:  2008-02-20       Impact factor: 6.167

Review 6.  Neurocomputational approaches to modelling multisensory integration in the brain: a review.

Authors:  Mauro Ursino; Cristiano Cuppini; Elisa Magosso
Journal:  Neural Netw       Date:  2014-08-23

Review 7.  Causal inference and temporal predictions in audiovisual perception of speech and music.

Authors:  Uta Noppeney; Hwee Ling Lee
Journal:  Ann N Y Acad Sci       Date:  2018-03-31       Impact factor: 5.691

8.  Probability matching as a computational strategy used in perception.

Authors:  David R Wozny; Ulrik R Beierholm; Ladan Shams
Journal:  PLoS Comput Biol       Date:  2010-08-05       Impact factor: 4.475

Review 9.  Incorporating behavioral and sensory context into spectro-temporal models of auditory encoding.

Authors:  Stephen V David
Journal:  Hear Res       Date:  2017-12-31       Impact factor: 3.208

10.  A generalized linear model for estimating spectrotemporal receptive fields from responses to natural sounds.

Authors:  Ana Calabrese; Joseph W Schumacher; David M Schneider; Liam Paninski; Sarah M N Woolley
Journal:  PLoS One       Date:  2011-01-11       Impact factor: 3.240

View more
  1 in total

1.  Audiovisual spatial recalibration but not integration is shaped by early sensory experience.

Authors:  Patrick Bruns; Lux Li; Maria J S Guerreiro; Idris Shareef; Siddhart S Rajendran; Kabilan Pitchaimuthu; Ramesh Kekunnaya; Brigitte Röder
Journal:  iScience       Date:  2022-05-23
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.