Literature DB >> 33613269

Acoustic and Language Based Deep Learning Approaches for Alzheimer's Dementia Detection From Spontaneous Speech.

Pranav Mahajan1, Veeky Baths2.   

Abstract

Current methods for early diagnosis of Alzheimer's Dementia include structured questionnaires, structured interviews, and various cognitive tests. Language difficulties are a major problem in dementia as linguistic skills break down. Current methods do not provide robust tools to capture the true nature of language deficits in spontaneous speech. Early detection of Alzheimer's Dementia (AD) from spontaneous speech overcomes the limitations of earlier approaches as it is less time consuming, can be done at home, and is relatively inexpensive. In this work, we re-implement the existing NLP methods, which used CNN-LSTM architectures and targeted features from conversational transcripts. Our work sheds light on why the accuracy of these models drops to 72.92% on the ADReSS dataset, whereas, they gave state of the art results on the DementiaBank dataset. Further, we build upon these language input-based recurrent neural networks by devising an end-to-end deep learning-based solution that performs a binary classification of Alzheimer's Dementia from the spontaneous speech of the patients. We utilize the ADReSS dataset for all our implementations and explore the deep learning-based methods of combining acoustic features into a common vector using recurrent units. Our approach of combining acoustic features using the Speech-GRU improves the accuracy by 2% in comparison to acoustic baselines. When further enriched by targeted features, the Speech-GRU performs better than acoustic baselines by 6.25%. We propose a bi-modal approach for AD classification and discuss the merits and opportunities of our approach.
Copyright © 2021 Mahajan and Baths.

Entities:  

Keywords:  affective computing; cognitive decline detection; computational paralinguistics; deep learning; natural language processing

Year:  2021        PMID: 33613269      PMCID: PMC7893079          DOI: 10.3389/fnagi.2021.623607

Source DB:  PubMed          Journal:  Front Aging Neurosci        ISSN: 1663-4365            Impact factor:   5.750


  5 in total

1.  A Transfer Learning Method for Detecting Alzheimer's Disease Based on Speech and Natural Language Processing.

Authors:  Ning Liu; Kexue Luo; Zhenming Yuan; Yan Chen
Journal:  Front Public Health       Date:  2022-04-13

2.  Multimodal Deep Learning Models for Detecting Dementia From Speech and Transcripts.

Authors:  Loukas Ilias; Dimitris Askounis
Journal:  Front Aging Neurosci       Date:  2022-03-17       Impact factor: 5.750

3.  Audio Recording Patient-Nurse Verbal Communications in Home Health Care Settings: Pilot Feasibility and Usability Study.

Authors:  Maryam Zolnoori; Sasha Vergez; Zoran Kostic; Siddhartha Reddy Jonnalagadda; Margaret V McDonald; Kathryn K H Bowles; Maxim Topaz
Journal:  JMIR Hum Factors       Date:  2022-05-11

Review 4.  Speech- and Language-Based Classification of Alzheimer's Disease: A Systematic Review.

Authors:  Inês Vigo; Luis Coelho; Sara Reis
Journal:  Bioengineering (Basel)       Date:  2022-01-11

5.  Personalised treatment for cognitive impairment in dementia: development and validation of an artificial intelligence model.

Authors:  Qiang Liu; Nemanja Vaci; Ivan Koychev; Andrey Kormilitzin; Zhenpeng Li; Andrea Cipriani; Alejo Nevado-Holgado
Journal:  BMC Med       Date:  2022-02-01       Impact factor: 8.775

  5 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.