Liam T Synan1, Mark A Eid2, Casey R Lamb3, Sandra L Wong4. 1. Department of Surgery, Dartmouth-Hitchcock Medical Center and Geisel School of Medicine at Dartmouth, Lebanon, NH; Geisel School of Medicine at Dartmouth, Hanover, NH. 2. Department of Surgery, Dartmouth-Hitchcock Medical Center and Geisel School of Medicine at Dartmouth, Lebanon, NH; VA Quality Scholars Program, White River Junction VAMC, White River Junction, VT; VA Outcomes Group, White River Junction VAMC, White River Junction, VT. 3. Department of Surgery, Dartmouth-Hitchcock Medical Center and Geisel School of Medicine at Dartmouth, Lebanon, NH. 4. Department of Surgery, Dartmouth-Hitchcock Medical Center and Geisel School of Medicine at Dartmouth, Lebanon, NH; Geisel School of Medicine at Dartmouth, Hanover, NH. Electronic address: Sandra.L.Wong@hitchcock.org.
Abstract
BACKGROUND: Hospital reviews posted online by patients are unsolicited and less structured than Hospital Consumer Assessment of Healthcare Providers and Systems surveys. The differences between online review platforms and their degrees of correlation with validated satisfaction and safety measures are unknown. METHODS: We identified 515 large acute care teaching hospitals in the United States. We collected patient satisfaction results and postsurgical patient safety indicators from Hospital Compare. We also collected hospital star ratings (1-5) from Facebook, Google, and Yelp. Mean ratings were compared with paired t tests. Concordance between ratings websites, Hospital Consumer Assessment of Healthcare Providers and Systems scores, and surgical safety indicators were assessed with Pearson's correlation coefficient. RESULTS: Mean Facebook ratings (3.81, interquartile range 3.5-4.3) were more favorable than Google (3.26, interquartile range 2.8-3.6) or Yelp (2.59, interquartile range 2.3-2.9). Facebook ratings were least strongly correlated with the Hospital Consumer Assessment of Healthcare Providers and Systems recommended hospital score (ρ = 0.356). Google was modestly correlated (ρ = 0.479), and Yelp was most strongly correlated (ρ = 0.500). The negative correlation between crowdsourced rating and composite safety indicator was too small to be meaningful on any platform. CONCLUSION: There is variation between platforms in consumer ratings of hospitals. Ratings on Facebook are more favorable than Google or Yelp. These are independently correlated with Hospital Consumer Assessment of Healthcare Providers and Systems scores. These findings suggest that unstructured consumer reviews generally reflect similar directionality as Hospital Consumer Assessment of Healthcare Providers and Systems satisfaction scores. Users should be aware of the significant difference between platforms. Consumer ratings platforms are not consistently correlated with postsurgical patient safety indicators, so online ratings may not reflect the safety of surgical care received.
BACKGROUND: Hospital reviews posted online by patients are unsolicited and less structured than Hospital Consumer Assessment of Healthcare Providers and Systems surveys. The differences between online review platforms and their degrees of correlation with validated satisfaction and safety measures are unknown. METHODS: We identified 515 large acute care teaching hospitals in the United States. We collected patient satisfaction results and postsurgical patient safety indicators from Hospital Compare. We also collected hospital star ratings (1-5) from Facebook, Google, and Yelp. Mean ratings were compared with paired t tests. Concordance between ratings websites, Hospital Consumer Assessment of Healthcare Providers and Systems scores, and surgical safety indicators were assessed with Pearson's correlation coefficient. RESULTS: Mean Facebook ratings (3.81, interquartile range 3.5-4.3) were more favorable than Google (3.26, interquartile range 2.8-3.6) or Yelp (2.59, interquartile range 2.3-2.9). Facebook ratings were least strongly correlated with the Hospital Consumer Assessment of Healthcare Providers and Systems recommended hospital score (ρ = 0.356). Google was modestly correlated (ρ = 0.479), and Yelp was most strongly correlated (ρ = 0.500). The negative correlation between crowdsourced rating and composite safety indicator was too small to be meaningful on any platform. CONCLUSION: There is variation between platforms in consumer ratings of hospitals. Ratings on Facebook are more favorable than Google or Yelp. These are independently correlated with Hospital Consumer Assessment of Healthcare Providers and Systems scores. These findings suggest that unstructured consumer reviews generally reflect similar directionality as Hospital Consumer Assessment of Healthcare Providers and Systems satisfaction scores. Users should be aware of the significant difference between platforms. Consumer ratings platforms are not consistently correlated with postsurgical patient safety indicators, so online ratings may not reflect the safety of surgical care received.