Literature DB >> 35695825

Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG).

John Gideon1, Melvin G McInnis1, Emily Mower Provost1.   

Abstract

Automatic speech emotion recognition provides computers with critical context to enable user understanding. While methods trained and tested within the same dataset have been shown successful, they often fail when applied to unseen datasets. To address this, recent work has focused on adversarial methods to find more generalized representations of emotional speech. However, many of these methods have issues converging, and only involve datasets collected in laboratory conditions. In this paper, we introduce Adversarial Discriminative Domain Generalization (ADDoG), which follows an easier to train "meet in the middle" approach. The model iteratively moves representations learned for each dataset closer to one another, improving cross-dataset generalization. We also introduce Multiclass ADDoG, or MADDoG, which is able to extend the proposed method to more than two datasets, simultaneously. Our results show consistent convergence for the introduced methods, with significantly improved results when not using labels from the target dataset. We also show how, in most cases, ADDoG and MADDoG can be used to improve upon baseline state-of-the-art methods when target dataset labels are added and in-the-wild data are considered. Even though our experiments focus on cross-corpus speech emotion, these methods could be used to remove unwanted factors of variation in other settings.

Entities:  

Keywords:  adversarial; cross-corpus; domain generalization; emotion recognition

Year:  2019        PMID: 35695825      PMCID: PMC9173710          DOI: 10.1109/taffc.2019.2916092

Source DB:  PubMed          Journal:  IEEE Trans Affect Comput        ISSN: 1949-3045            Impact factor:   13.990


  4 in total

Review 1.  Core affect and the psychological construction of emotion.

Authors:  James A Russell
Journal:  Psychol Rev       Date:  2003-01       Impact factor: 8.934

2.  ECOLOGICALLY VALID LONG-TERM MOOD MONITORING OF INDIVIDUALS WITH BIPOLAR DISORDER USING SPEECH.

Authors:  Zahi N Karam; Emily Mower Provost; Satinder Singh; Jennifer Montgomery; Christopher Archer; Gloria Harrington; Melvin G Mcinnis
Journal:  Proc IEEE Int Conf Acoust Speech Signal Process       Date:  2014-07-14

3.  Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG).

Authors:  John Gideon; Melvin G McInnis; Emily Mower Provost
Journal:  IEEE Trans Affect Comput       Date:  2019-05-14       Impact factor: 13.990

4.  MOOD STATE PREDICTION FROM SPEECH OF VARYING ACOUSTIC QUALITY FOR INDIVIDUALS WITH BIPOLAR DISORDER.

Authors:  John Gideon; Emily Mower Provost; Melvin McInnis
Journal:  Proc IEEE Int Conf Acoust Speech Signal Process       Date:  2016-03
  4 in total
  3 in total

1.  Improving Cross-Corpus Speech Emotion Recognition with Adversarial Discriminative Domain Generalization (ADDoG).

Authors:  John Gideon; Melvin G McInnis; Emily Mower Provost
Journal:  IEEE Trans Affect Comput       Date:  2019-05-14       Impact factor: 13.990

2.  Progressively Discriminative Transfer Network for Cross-Corpus Speech Emotion Recognition.

Authors:  Cheng Lu; Chuangao Tang; Jiacheng Zhang; Yuan Zong
Journal:  Entropy (Basel)       Date:  2022-07-29       Impact factor: 2.738

3.  Progressive distribution adapted neural networks for cross-corpus speech emotion recognition.

Authors:  Yuan Zong; Hailun Lian; Jiacheng Zhang; Ercui Feng; Cheng Lu; Hongli Chang; Chuangao Tang
Journal:  Front Neurorobot       Date:  2022-09-15       Impact factor: 3.493

  3 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.