| Literature DB >> 35465648 |
Raju Maharjan1, Kevin Doherty1, Darius Adam Rohani1, Per Bækgaard2, Jakob E Bardram1.
Abstract
Recent advancements in speech recognition technology in combination with increased access to smart speaker devices are expanding conversational interactions to ever-new areas of our lives - including our health and wellbeing. Prior human-computer interaction research suggests that Conversational Agents (CAs) have the potential to support a variety of health-related outcomes, due in part to their intuitive and engaging nature. Realizing this potential requires however developing a rich understanding of users' needs and experiences in relation to these still-emerging technologies. To inform the design of CAs for health and wellbeing, we analyze 2741 critical reviews of 485 Alexa health and fitness Skills using an automated topic modeling approach; identifying 15 subjects of criticism across four key areas of design (functionality, reliability, usability, pleasurability). Based on these findings, we discuss implications for the design of engaging CAs to support health and wellbeing.Entities:
Keywords: Alexa; conversational agent (CA); conversational user interface (CUI); health and wellbeing; structural topic model (STM); text analysis; virtual assistant (VA); voice user interface (VUI)
Year: 2022 PMID: 35465648 PMCID: PMC9021431 DOI: 10.3389/fdgth.2022.840232
Source DB: PubMed Journal: Front Digit Health ISSN: 2673-253X
Summary of the results from prior related work analyzing reviews of Alexa health and fitness skills and Alexa devices.
|
|
|
|
|
|---|---|---|---|
| Pradhan et al. ( | Amazon Echo, Dot & Tap devices | 346 | Manual |
|
| |||
| 1. Novel use cases of the Echo device for people with disabilities, including in speech therapy and as supports for caregivers. | |||
| 2. Challenges for people with disabilities include, discoverability (particularly for users with visual impairments) speech recognition, device ecosystem related issues (need to ensure that the entire device ecosystem–and not just the voice interaction–is accessible), memory demands (having to remember voice commands is problematic for older adults or users with cognitive impairments). | |||
| Purington et al. ( | Amazon Echo & Tap devices | 587 | Manual |
|
| |||
| 1. The degree of device personification is linked with the sociability of interactions. Personification predicts user satisfaction. | |||
| 2. Reviewers mentioning multiple member households are more likely to personify the device than reviewers mentioning living alone. | |||
| Shin and Huh-Yoo ( | Health and Fitness Skills | 443 | Manual |
|
| |||
| 1. Skills are primarily used as a way to jump start behavior change, to enhance health and wellness routines, and to overcome time and spatial limitations. | |||
| 2. Trust in the content provider and transparency of the CHAs' limitations are important factors for users' adoption of these systems. | |||
| 3. Design considerations: matching initial user expectations, transparency concerning CHA's limitations, methods of commercialization, use cases for peripheral devices and the quality of agents' instructions and commands. | |||
| 4. In addition to Nielsen's design heuristics, authors recommend increased personification of agents, provision of content from trusted sources, and allowing users to tailor utterance speed and tone among other CHA characteristics. | |||
| Gao et al. ( | Amazon Echo devices | 55502 | Automated |
|
| |||
| 1. Reviews reflecting personification of Echo displayed more positive emotions than those which considered Echo solely an electronic device. | |||
| 2. Echo features liked by users: hands-free use, efficient task management (e.g., shopping lists, timer and alarm settings, ordering from Amazon) and information retrieval, entertainment, and connectivity with other smart home systems. | |||
| 3. Echo features disliked by users: voice/language (problems misinterpreting speech or returning inappropriate responses), privacy-related measures (always-on listening), device limitations (query only, English-only support, the inability to change the wake word, lack of portability, the need to be connected, upgrade notifications at midnight, and the inability to reschedule updates), as well as application limitations (support for only 1 timer and 1 alarm, the inability to fast forward or skip ahead when listening to music) | |||
Figure 1Diagnostic values of the residuals across the models with a value of K ranging from 5 to 50.
Figure 2Distribution of Skills and reviews for each of the 19 health and fitness categories included in this study.
Figure 3Subjects of criticism of Alexa Skills designed to support wellbeing, grouped within Aarron Walter's hierarchy of user needs (30). Each subject of criticism contains one or multiple topics [T#] generated by STM. The words in parenthesis are the 7 highest probability words of the respective topic. The percentages show the proportion of the reviews. Check mark indicates the topics that have been discussed in prior work by Shin et al. (34).