Literature DB >> 32025572

Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants.

Alicia L Nobles1,2, Eric C Leas1,3, Theodore L Caputi1,4, Shu-Hong Zhu5, Steffanie A Strathdee2, John W Ayers1,2.   

Abstract

We investigated how intelligent virtual assistants (IVA), including Amazon's Alexa, Apple's Siri, Google Assistant, Microsoft's Cortana, and Samsung's Bixby, responded to addiction help-seeking queries. We recorded if IVAs provided a singular response and if so, did they link users to treatment or treatment referral services. Only 4 of the 70 help-seeking queries presented to the five IVAs returned singular responses, with the remainder prompting confusion (e.g., "did I say something wrong?"). When asked "help me quit drugs" Alexa responded with a definition for the word drugs. "Help me quit…smoking" or "tobacco" on Google Assistant returned Dr. QuitNow (a cessation app), while on Siri "help me quit pot" promoted a marijuana retailer. IVAs should be revised to promote free, remote, federally sponsored addiction services, such as SAMSHA's 1-800-662-HELP helpline. This would benefit millions of IVA users now and more to come as IVAs displace existing information-seeking engines.
© The Author(s) 2020.

Entities:  

Keywords:  Epidemiology; Rehabilitation

Year:  2020        PMID: 32025572      PMCID: PMC6989668          DOI: 10.1038/s41746-019-0215-9

Source DB:  PubMed          Journal:  NPJ Digit Med        ISSN: 2398-6352


Introduction

Intelligent virtual assistants (IVA), such as Apple’s Siri, are transforming how the public seeks and finds information.[1] IVAs are interfaces that enable users to interact with smart devices using spoken language in a natural way and provide a singular response to a query similar to speaking to a person.[2] In contrast, traditional search engines return millions of relevant results to a query, relying on the user to collate the results and reach a conclusion. For example, querying “what’s the weather?” on a search engine would return multiple links from different weather services, but an IVA is designed to return a singular result—the current, local forecast. Already half of US adults (46%) use IVAs[3] and companies are substantially invested in the proliferation of IVAs. Yet, public health has done little to harness or study these technologies.[4,5] One study[4] found smartphone IVAs inconsistently recognized suicide-related queries with responses failing to direct users to the National Suicide Prevention Lifeline. Another study[6] found that when asked a variety of health-related queries (i.e., queries originated by study participants and standard queries related to medication and emergency scenarios developed by researchers), IVAs directed users to take actions that could result in harm or death. One of America’s most pressing public health emergencies is substance use disorder. Over 47,000 people died from an opioid overdose in 2017.[7] Given the stigmatized nature of substance use disorder, IVAs could confidentially direct those in need to remote substance use resources. We performed an analysis of IVA responses to addiction help-seeking queries related to drugs and alcohol to assess what treatment resources, if any, are being promoted.

Results

Responses to help-seeking queries

When presented with the query “help me quit drugs”, only Amazon Alexa provided a singular response by defining the term drugs: “A drug is any substance that when inhaled, injected, smoked, consumed… causes a physiological change in the body…” No other IVA provided a singular response, including Apple Siri, Google Assistant, and Microsoft Cortana. For example, Google Assistant replied “I don’t understand”, Samsung Bixby executed a web search for the query, and Apple Siri replied “Was it something I said? I’ll go away if you say ‘goodbye’ ”. The results were similar regardless of the substance cited in our queries (Table 1). All queries for alcohol and opioids across all IVAs failed to return any singular result, yielding confusion (e.g., Microsoft Cortana “I’m sorry. I couldn’t find that skill”). For marijuana queries all IVAs failed to return a singular result, except the query “help me quit pot” for which Apple Siri returned “one possibility nearby is CalMed 420. Want to try that one?” directing users to a local marijuana retailer.[8] Only 2 of the 25 queries for tobacco returned singular results, with Google Assistant linking users to Dr. QuitNow (a mobile cessation app) for “help me quit…smoking or tobacco”.
Table 1

Summary of singular responses to addiction-related queries on intelligent virtual assistants.

Provided singular response (Yes/No)
Substance typeQuery “help me quit…”Apple SiriAmazon AlexaMicrosoft CortanaSamsung BixbyGoogle Assistant
DrugsDrugsa
AlcoholAlcohol
Drinking
MarijuanaMarijuana
Potb
Weed
OpioidsFentanyl
Heroin
Opioids
Painkillers
TobaccoCigarettes
Vaping
Smokingc
Tobaccod

Blank space indicates that no singular response was provided.

aHelp me quit drugs… “A drug is any substance that when inhaled, injected, smoked, consumed, absorbed via patch on the skin, or dissolved under the tongue causes a physiological change in the body…” ~Amazon Alexa.

bHelp me quit pot… “One possibility nearby is CalMed 420. Want to try that one?” ~Apple Siri.

cHelp me quit smoking… “Sure, for that, you might like talking to Dr. QuitNow. Wanna give that a try?” ~Google Assistant.

dHelp me quit tobacco… “Do you want to give Dr. QuitNow a try?” ~Google Assistant.

Note: All queries were executed on the respective IVA platforms from San Diego, California during January 2019.

Summary of singular responses to addiction-related queries on intelligent virtual assistants. Blank space indicates that no singular response was provided. aHelp me quit drugs… “A drug is any substance that when inhaled, injected, smoked, consumed, absorbed via patch on the skin, or dissolved under the tongue causes a physiological change in the body…” ~Amazon Alexa. bHelp me quit pot… “One possibility nearby is CalMed 420. Want to try that one?” ~Apple Siri. cHelp me quit smoking… “Sure, for that, you might like talking to Dr. QuitNow. Wanna give that a try?” ~Google Assistant. dHelp me quit tobacco… “Do you want to give Dr. QuitNow a try?” ~Google Assistant. Note: All queries were executed on the respective IVA platforms from San Diego, California during January 2019.

Discussion

Among 70 addiction help-seeking queries presented to the five leading IVAs, only four queries elicited singular responses (one promoting a marijuana retailer) and only two queries linked to remote treatment or treatment referral programs. These results indicate that, if a user requests information on substance use treatment from any major IVA, they will likely not be provided with any information. Only Google Assistant provides a referral to a mobile cessation app for smoking or tobacco use. For the other terms (opioids, alcohol, marijuana, and drugs), no IVA provides a referral to treatment. Indeed, Siri’s referral to a marijuana retailer demonstrates that IVAs could be detrimental rather than helpful. Altogether, the IVAs’ responses to substance use help-seeking requests are a missed opportunity for promoting referrals to substance use treatment. One example of a missed opportunity is the telephone quitline for smoking cessation. Telephone counseling has been extensively tested and recommended by the Clinical Practice Guidelines.[9] There is a network of state quitlines with a national portal, a toll-free number, 1-800-QUIT-NOW. The number has been promoted since 2004.[10] Moreover, the U.S. Centers for Disease Control and Prevention (CDC) has launched an aggressive and sustained nationwide media campaign since 2012 to encourage smokers to call this number to get help yielding.[11] If an IVA responded with “Do you want to call 1-800-QUIT-NOW?” when prompted with “help me quit smoking,” the user could connect with a trained counselor. Promoting free government resources such as the quitline on IVAs is a logical extension of search engine’s recent adoption of OneBox strategies that prioritize free government resources in response to health queries. The missed opportunity herein is clear, and just as clear when examples for other substances are considered (i.e., 1-800-662-HELP for other addiction treatment referrals, including opioids).[12] How then do these gaps in health promotion persist two decades into the digital revolution,[13] and can they be closed? First, health promotion is potentially outside the profit-driven mission of technology companies. However, these companies are still involved in the health promotion industry because of how the public uses their services. The health community can make technology companies another vendor for how health agencies disseminate their services. Given the public’s use of IVAs now and in the years to come,[2] this may yield a larger return on investment for health agencies than their traditional paid campaigns. Second, overriding algorithms represents a potential liability for technology companies who lack health subject matter expertise. Technology companies therefore may be reluctant to steer users to specific services for fear of public backlash that might reduce their user base or legal action when users are referred to dubious services selected by non-health experts. Providing subject matter expertise to technology companies, celebrating the cooperation of technology companies with public health to their users in social good campaigns, and regulating potential litigation against companies that promote the best available evidence-based resources can reduce liabilities that hinder action. Third, public health is doing a poor job of prioritizing technology companies as partners. Public health can be more proactive and invest in identifying gaps between consumers’ help-seeking and information retrieval results. The return on investment in this area of research is high given that one study on IVAs has already changed the information consumers receive on several IVA-enabled devices.[4] A larger investment in applied research could yield even greater responses. Our study was limited to only a few substance help-seeking queries and may not be reflective of common queries, but the consistency of the negative results suggests omitted queries might yield similar findings. Our study was restricted to San Diego, CA thereby the singular IVA response that linked to a local marijuana retailer in one case may not be replicated in all settings. Still, our results are a strong call to action for this new area of research. To ensure the best, free, public addiction services are promoted by IVAs, research toward addressing the systemic shortcomings we discovered can begin now. Such effort would galvanize a collaboration between technology companies and public health professionals to give the public the information they need to take charge of their health.

Methods

Procedure for help-seeking queries

We investigated five IVAs representing 99% of the smartphone and stand-alone IVA marketplace: Amazon Alexa (Echo Dot home device), Apple Siri (iPhone 7 smartphone), Google Assistant (ZTE Blade Spark (Z971) smartphone), Microsoft Cortana (Samsung Galaxy S8 smartphone), and Samsung Bixby (Samsung Galaxy S9 smartphone).[14] The software for each device was up-to-date at the time of the study (January 2019) and the language was set to US English. We mimicked addiction help-seeking queries on these IVAs in January 2019 in San Diego, CA. The common stem for all our prompts was “help me quit…” concluding with generic (e.g.,…“drugs”) and substance-specific requests (e.g.,…“drinking”) for the most used substances, including alcohol (140.6M users), tobacco (48.7M), marijuana (26.0M), and opioids (11.4M).[15] Ultimately, this resulted in 14 types of queries, including “drugs” (for drugs), “alcohol” and “drinking” (for alcohol), “marijuana,” “pot,” and “weed” (for marijuana), “fentanyl,” “heroin,” “opioids,” and “painkillers” (for opioids), and “cigarettes,” “vaping,” “smoking,” and “tobacco” (for tobacco) across five devices for a total of 70 queries. Recent research indicates that IVAs may struggle to comprehend medical terms.[16] Consequently, each addiction help-seeking query was repeated by two different authors, who each independently recorded the response verbatim. The queries were spoken live (i.e., the voices were not recorded and then replayed) by two native English speakers. All responses were consistent. The IVAs with graphical user interfaces (Alexa is the only IVA without a graphical user interface) all transcribe the spoken query into text that is displayed on the screen. The authors ensured the accuracy of the query by confirming the query was correctly dictated. We assessed responses along two dimensions: (A) Did IVAs provide a singular response to addiction help-seeking queries (Yes/No)? (B) Among the singular responses from IVAs, what proportion linked to an available treatment or treatment referral service (Yes/No)? The former assesses if they are recognizing the query, the latter on how IVAs would ideally operate by providing a referral to treatment.[17] The proportion of singular and treatment or treatment referral were calculated across IVAs and substance.
  11 in total

1.  Treating tobacco use and dependence: 2008 update U.S. Public Health Service Clinical Practice Guideline executive summary.

Authors: 
Journal:  Respir Care       Date:  2008-09       Impact factor: 2.258

2.  Changes in Internet searches associated with the "Tips from Former Smokers" campaign.

Authors:  John W Ayers; Benjamin M Althouse; Sherry Emery
Journal:  Am J Prev Med       Date:  2015-06       Impact factor: 5.043

3.  Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health.

Authors:  Adam S Miner; Arnold Milstein; Stephen Schueller; Roshini Hegde; Christina Mangurian; Eleni Linos
Journal:  JAMA Intern Med       Date:  2016-05-01       Impact factor: 21.873

4.  Talking to Machines About Personal Mental Health Problems.

Authors:  Adam S Miner; Arnold Milstein; Jefferey T Hancock
Journal:  JAMA       Date:  2017-10-03       Impact factor: 56.272

5.  Online Sales of Marijuana: An Unrecognized Public Health Dilemma.

Authors:  Theodore L Caputi; Eric C Leas; Mark Dredze; John W Ayers
Journal:  Am J Prev Med       Date:  2018-03-22       Impact factor: 5.043

6.  Could behavioral medicine lead the web data revolution?

Authors:  John W Ayers; Benjamin M Althouse; Mark Dredze
Journal:  JAMA       Date:  2014-04-09       Impact factor: 56.272

Review 7.  Tobacco quitlines: looking back and looking ahead.

Authors:  C M Anderson; S-H Zhu
Journal:  Tob Control       Date:  2007-12       Impact factor: 7.552

8.  Media Trends for the Substance Abuse and Mental Health Services Administration 800-662-HELP Addiction Treatment Referral Services After a Celebrity Overdose.

Authors:  John W Ayers; Alicia L Nobles; Mark Dredze
Journal:  JAMA Intern Med       Date:  2019-03-01       Impact factor: 21.873

9.  Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice.

Authors:  Matt Boyd; Nick Wilson
Journal:  PLoS One       Date:  2018-03-28       Impact factor: 3.240

10.  Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: An Observational Study of Siri, Alexa, and Google Assistant.

Authors:  Timothy W Bickmore; Ha Trinh; Stefan Olafsson; Teresa K O'Leary; Reza Asadi; Nathaniel M Rickles; Ricardo Cruz
Journal:  J Med Internet Res       Date:  2018-09-04       Impact factor: 5.428

View more
  10 in total

1.  The Answer Bot Effect (ABE): A powerful new form of influence made possible by intelligent personal assistants and search engines.

Authors:  Robert Epstein; Vivian Lee; Roger Mohr; Vanessa R Zankich
Journal:  PLoS One       Date:  2022-06-01       Impact factor: 3.752

2.  Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic.

Authors:  Emre Sezgin; Yungui Huang; Ujjwal Ramtekkar; Simon Lin
Journal:  NPJ Digit Med       Date:  2020-09-16

3.  Clinical Advice by Voice Assistants on Postpartum Depression: Cross-Sectional Investigation Using Apple Siri, Amazon Alexa, Google Assistant, and Microsoft Cortana.

Authors:  Samuel Yang; Jennifer Lee; Emre Sezgin; Jeffrey Bridge; Simon Lin
Journal:  JMIR Mhealth Uhealth       Date:  2021-01-11       Impact factor: 4.773

4.  Reliability of Commercial Voice Assistants' Responses to Health-Related Questions in Noncommunicable Disease Management: Factorial Experiment Assessing Response Rate and Source of Information.

Authors:  Caterina Bérubé; Zsolt Ferenc Kovacs; Elgar Fleisch; Tobias Kowatsch
Journal:  J Med Internet Res       Date:  2021-12-20       Impact factor: 5.428

Review 5.  An Overview of Organs-on-Chips Based on Deep Learning.

Authors:  Jintao Li; Jie Chen; Hua Bai; Haiwei Wang; Shiping Hao; Yang Ding; Bo Peng; Jing Zhang; Lin Li; Wei Huang
Journal:  Research (Wash D C)       Date:  2022-01-19

6.  Mitigating Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: Exploratory Mixed Methods Experiment.

Authors:  Timothy W Bickmore; Stefán Ólafsson; Teresa K O'Leary
Journal:  J Med Internet Res       Date:  2021-11-09       Impact factor: 5.428

7.  Design and Formative Evaluation of a Virtual Voice-Based Coach for Problem-solving Treatment: Observational Study.

Authors:  Corina R Ronneberg; Nancy E Wittels; Olu A Ajilore; Jun Ma; Thomas Kannampallil; Vikas Kumar; Nan Lv; Joshua M Smyth; Ben S Gerber; Emily A Kringle; Jillian A Johnson; Philip Yu; Lesley E Steinman
Journal:  JMIR Form Res       Date:  2022-08-12

8.  Chatbots in the fight against the COVID-19 pandemic.

Authors:  Adam S Miner; Liliana Laranjo; A Baki Kocaballi
Journal:  NPJ Digit Med       Date:  2020-05-04

9.  Syndromic Surveillance Insights from a Symptom Assessment App Before and During COVID-19 Measures in Germany and the United Kingdom: Results From Repeated Cross-Sectional Analyses.

Authors:  Alicia Mehl; Francois Bergey; Caoimhe Cawley; Andreas Gilsdorf
Journal:  JMIR Mhealth Uhealth       Date:  2020-10-09       Impact factor: 4.773

10.  Scale-up of Digital Innovations in Health Care: Expert Commentary on Enablers and Barriers.

Authors:  Hannes Schlieter; Lisa A Marsch; Diane Whitehouse; Lena Otto; Ana Rita Londral; Gisbert Wilhelm Teepe; Martin Benedict; Joseph Ollier; Tom Ulmer; Nathalie Gasser; Sabine Ultsch; Bastian Wollschlaeger; Tobias Kowatsch
Journal:  J Med Internet Res       Date:  2022-03-11       Impact factor: 7.076

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.