Literature DB >> 17557592

Discriminating languages by speech-reading.

Salvador Soto-Faraco1, Jordi Navarra, Whitney M Weikum, Athena Vouloumanos, Núria Sebastián-Gallés, Janet F Werker.   

Abstract

The goal of this study was to explore the ability to discriminate languages using the visual correlates of speech (i.e., speech-reading). Participants were presented with silent video clips of an actor pronouncing two sentences (in Catalan and/or Spanish) and were asked to judge whether the sentences were in the same language or in different languages. Our results established that Spanish-Catalan bilingual speakers could discriminate running speech from their two languages on the basis of visual cues alone (Experiment 1). However, we found that this ability was critically restricted by linguistic experience, since Italian and English speakers who were unfamiliar with the test languages could not successfully discriminate the stimuli (Experiment 2). A test of Spanish monolingual speakers revealed that knowledge of only one of the two test languages was sufficient to achieve the discrimination, although at a lower level of accuracy than that seen in bilingual speakers (Experiment 3). Finally, we evaluated the ability to identify the language by speech-reading particularly distinctive words (Experiment 4). The results obtained are in accord with recent proposals arguing that the visual speech signal is rich in informational content, above and beyond what traditional accounts based solely on visemic confusion matrices would predict.

Entities:  

Mesh:

Year:  2007        PMID: 17557592     DOI: 10.3758/bf03193744

Source DB:  PubMed          Journal:  Percept Psychophys        ISSN: 0031-5117


  16 in total

1.  The McGurk phenomenon in Italian listeners.

Authors:  R Bovo; A Ciorba; S Prosser; A Martini
Journal:  Acta Otorhinolaryngol Ital       Date:  2009-08       Impact factor: 2.124

2.  Hearing lips in a second language: visual articulatory information enables the perception of second language sounds.

Authors:  Jordi Navarra; Salvador Soto-Faraco
Journal:  Psychol Res       Date:  2005-12-14

3.  Language identification from visual-only speech signals.

Authors:  Rebecca E Ronquest; Susannah V Levi; David B Pisoni
Journal:  Atten Percept Psychophys       Date:  2010-08       Impact factor: 2.199

4.  Visual speech primes open-set recognition of spoken words.

Authors:  Adam B Buchwald; Stephen J Winters; David B Pisoni
Journal:  Lang Cogn Process       Date:  2009

5.  Cross-modal prediction in speech depends on prior linguistic experience.

Authors:  Carolina Sánchez-García; James T Enns; Salvador Soto-Faraco
Journal:  Exp Brain Res       Date:  2013-02-06       Impact factor: 1.972

6.  Does visual speech information affect word segmentation?

Authors:  Andrea J Sell; Michael P Kaschak
Journal:  Mem Cognit       Date:  2009-09

7.  Cross-modal prediction in speech perception.

Authors:  Carolina Sánchez-García; Agnès Alsius; James T Enns; Salvador Soto-Faraco
Journal:  PLoS One       Date:  2011-10-05       Impact factor: 3.240

8.  Age-related sensitive periods influence visual language discrimination in adults.

Authors:  Whitney M Weikum; Athena Vouloumanos; Jordi Navarra; Salvador Soto-Faraco; Núria Sebastián-Gallés; Janet F Werker
Journal:  Front Syst Neurosci       Date:  2013-11-13

9.  Atypical audiovisual word processing in school-age children with a history of specific language impairment: an event-related potential study.

Authors:  Natalya Kaganovich; Jennifer Schumaker; Courtney Rowland
Journal:  J Neurodev Disord       Date:  2016-09-05       Impact factor: 4.025

10.  Motor excitability during visual perception of known and unknown spoken languages.

Authors:  Swathi Swaminathan; Mairéad MacSweeney; Rowan Boyles; Dafydd Waters; Kate E Watkins; Riikka Möttönen
Journal:  Brain Lang       Date:  2013-05-03       Impact factor: 2.381

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.