Daniel C Stokes1, Rachel Kishton1, Haley J McCalpin1, Arthur P Pelullo1, Zachary F Meisel1, Rinad S Beidas1, Raina M Merchant1. 1. Penn Medicine Center for Digital Health (Stokes, McCalpin, Pelullo, Merchant), Center for Emergency Care Policy and Research, Department of Emergency Medicine (Stokes, Meisel, Merchant), Department of Psychiatry (Beidas), and Penn Medical Ethics and Health Policy (Beidas), Perelman School of Medicine, University of Pennsylvania, Philadelphia; National Clinician Scholars Program (Kishton), Leonard Davis Institute of Health Economics (Meisel, Merchant), and Penn Implementation Science Center at the Leonard Davis Institute (Beidas), University of Pennsylvania, Philadelphia.
Abstract
OBJECTIVE: Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings. METHODS: United States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p<0.001. RESULTS: Of 10,191 unique mental health treatment facilities, 1,383 (13.6%) had relevant Yelp pages with 8,133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's ρ=0.39) and nonpharmacologic treatment (ρ=0.16). Topics negatively correlated with review ratings included rude staff (ρ=-0.14) and safety and abuse (ρ=-0.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including "outpatient mental health facility" (ρ=0.13), and 33 were negatively correlated with review rating, including accepting Medicare (ρ=-0.21). CONCLUSIONS: Narrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.
OBJECTIVE: Previous studies indicate that patients' satisfaction with mental health care is correlated with both treatment outcomes and quality of life. The aims of this study were to describe online reviews of mental health treatment facilities, including key themes in review content, and to evaluate the correlation between narrative review themes, facility characteristics, and review ratings. METHODS: United States National Mental Health Services Survey (N-MHSS) facilities were linked to corresponding Yelp pages, created between March 2007 and September 2019. Correlations between review ratings and both machine learning-generated latent Dirichlet allocation topics and N-MHSS-reported facility characteristics were measured by using Spearman's rank-order correlation coefficient. Significance was defined by a Bonferroni-adjusted p<0.001. RESULTS: Of 10,191 unique mental health treatment facilities, 1,383 (13.6%) had relevant Yelp pages with 8,133 corresponding reviews. The number of newly reviewed facilities and the number of new reviews increased throughout the study period. Narrative topics positively correlated with review ratings included caring staff (Spearman's ρ=0.39) and nonpharmacologic treatment (ρ=0.16). Topics negatively correlated with review ratings included rude staff (ρ=-0.14) and safety and abuse (ρ=-0.14). Of 126 N-MHSS survey items, 11 were positively correlated with review rating, including "outpatient mental health facility" (ρ=0.13), and 33 were negatively correlated with review rating, including accepting Medicare (ρ=-0.21). CONCLUSIONS: Narrative topics provide information beyond what is currently collected through the N-MHSS. Topics associated with positive and negative reviews, such as staff attitude toward patients, can guide improvement in patients' satisfaction and engagement with mental health care.
Entities:
Keywords:
Natural language processing; Patient satisfaction; Quality of care
Authors: Naomi S Bardach; Audrey Lyndon; Renée Asteria-Peñaloza; L Elizabeth Goldman; Grace A Lin; R Adams Dudley Journal: BMJ Qual Saf Date: 2015-12-15 Impact factor: 7.035
Authors: Benjamin L Ranard; Rachel M Werner; Tadas Antanavicius; H Andrew Schwartz; Robert J Smith; Zachary F Meisel; David A Asch; Lyle H Ungar; Raina M Merchant Journal: Health Aff (Millwood) Date: 2016-04 Impact factor: 6.301
Authors: Daniel C Stokes; Arthur P Pelullo; Nandita Mitra; Zachary F Meisel; Eugenia C South; David A Asch; Raina M Merchant Journal: JAMA Netw Open Date: 2021-10-01