Ken Cheung1, Wodan Ling1, Chris J Karr2, Kenneth Weingardt3, Stephen M Schueller3, David C Mohr3. 1. Department of Biostatistics, Columbia University Mailman School of Public Health, New York, NY, USA. 2. Audacious software, Chicago, IL, USA. 3. Center for Behavioral Intervention Technologies (CBITs), Department of Preventive Medicine, Northwestern University, Chicago, IL, USA.
Abstract
Objective: While depression and anxiety are common mental health issues, only a small segment of the population has access to standard one-on-one treatment. The use of smartphone apps can fill this gap. An app recommender system may help improve user engagement of these apps and eventually symptoms. Methods: IntelliCare was a suite of apps for depression and anxiety, with a Hub app that provided app recommendations aiming to increase user engagement. This study captured the records of 8057 users of 12 apps. We measured overall engagement and app-specific usage longitudinally by the number of weekly app sessions ("loyalty") and the number of days with app usage ("regularity") over 16 weeks. Hub and non-Hub users were compared using zero-inflated Poisson regression for loyalty, linear regression for regularity, and Cox regression for engagement duration. Adjusted analyses were performed in 4561 users for whom we had baseline characteristics. Impact of Hub recommendations was assessed using the same approach. Results: When compared to non-Hub users in adjusted analyses, Hub users had a lower risk of discontinuing IntelliCare (hazard ratio = 0.67, 95% CI, 0.62-0.71), higher loyalty (2- to 5-fold), and higher regularity (0.1-0.4 day/week greater). Among Hub users, Hub recommendations increased app-specific loyalty and regularity in all 12 apps. Discussion/ Conclusion: Centralized app recommendations increase overall user engagement of the apps, as well as app-specific usage. Further studies relating app usage to symptoms can validate that such a recommender improves clinical benefits and does so at scale.
Objective: While depression and anxiety are common mental health issues, only a small segment of the population has access to standard one-on-one treatment. The use of smartphone apps can fill this gap. An app recommender system may help improve user engagement of these apps and eventually symptoms. Methods: IntelliCare was a suite of apps for depression and anxiety, with a Hub app that provided app recommendations aiming to increase user engagement. This study captured the records of 8057 users of 12 apps. We measured overall engagement and app-specific usage longitudinally by the number of weekly app sessions ("loyalty") and the number of days with app usage ("regularity") over 16 weeks. Hub and non-Hub users were compared using zero-inflated Poisson regression for loyalty, linear regression for regularity, and Cox regression for engagement duration. Adjusted analyses were performed in 4561 users for whom we had baseline characteristics. Impact of Hub recommendations was assessed using the same approach. Results: When compared to non-Hub users in adjusted analyses, Hub users had a lower risk of discontinuing IntelliCare (hazard ratio = 0.67, 95% CI, 0.62-0.71), higher loyalty (2- to 5-fold), and higher regularity (0.1-0.4 day/week greater). Among Hub users, Hub recommendations increased app-specific loyalty and regularity in all 12 apps. Discussion/ Conclusion: Centralized app recommendations increase overall user engagement of the apps, as well as app-specific usage. Further studies relating app usage to symptoms can validate that such a recommender improves clinical benefits and does so at scale.
Authors: Emily G Lattie; Stephen M Schueller; Elizabeth Sargent; Colleen Stiles-Shields; Kathryn Noth Tomasino; Marya E Corden; Mark Begale; Chris J Karr; David C Mohr Journal: Internet Interv Date: 2016-06-16
Authors: David C Mohr; Kathryn Noth Tomasino; Emily G Lattie; Hannah L Palac; Mary J Kwasny; Kenneth Weingardt; Chris J Karr; Susan M Kaiser; Rebecca C Rossom; Leland R Bardsley; Lauren Caccamo; Colleen Stiles-Shields; Stephen M Schueller Journal: J Med Internet Res Date: 2017-01-05 Impact factor: 5.428
Authors: Colleen Stiles-Shields; Enid Montague; Emily G Lattie; Stephen M Schueller; Mary J Kwasny; David C Mohr Journal: JMIR Hum Factors Date: 2017-08-11
Authors: Niranjan Bidargaddi; Peter Musiat; Megan Winsall; Gillian Vogl; Victoria Blake; Stephen Quinn; Simone Orlowski; Gaston Antezana; Geoffrey Schrader Journal: J Med Internet Res Date: 2017-05-12 Impact factor: 5.428
Authors: Samantha Kolovson; Abhishek Pratap; Jaden Duffy; Ryan Allred; Sean A Munson; Patricia A Areán Journal: Int Conf Pervasive Comput Technol Healthc Date: 2020-05
Authors: Hilary Weingarden; Aleksandar Matic; Roger Garriga Calleja; Jennifer L Greenberg; Oliver Harrison; Sabine Wilhelm Journal: JMIR Mhealth Uhealth Date: 2020-06-18 Impact factor: 4.773
Authors: Emily G Lattie; Susan M Kaiser; Nameyeh Alam; Kathryn N Tomasino; Elizabeth Sargent; Caryn Kseniya Rubanovich; Hannah L Palac; David C Mohr Journal: J Med Internet Res Date: 2018-11-29 Impact factor: 5.428
Authors: Robin De Croon; Leen Van Houdt; Nyi Nyi Htun; Gregor Štiglic; Vero Vanden Abeele; Katrien Verbert Journal: J Med Internet Res Date: 2021-06-29 Impact factor: 5.428