Lauren E Snyder1, Daniel F Phan1,2, Kristen C Williams3, Eduardo Piqueiras3, Sarah E Connor3, Sheba George4,5, Lorna Kwan3, Jefersson Villatoro Chavez3, Megha D Tandel3, Stanley K Frencher3, Mark S Litwin3,4,6,7, John L Gore8, Andrea L Hartzler1. 1. Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, Washington, USA. 2. Department of Biobehavioral Nursing and Health Informatics, School of Nursing, University of Washington, Seattle, Washington, USA. 3. Department of Urology, University of California, Los Angeles, California, USA. 4. Department of Community Health Sciences, The Fielding School of Public Health, University of California, Los Angeles, California, USA. 5. Department of Preventive & Social Medicine and the Center for Biomedical Informatics, Charles R. Drew University of Medicine & Science, Los Angeles, California, USA. 6. School of Nursing, University of California, Los Angeles, California, USA. 7. Department of Health Policy & Management, The Fielding School of Public Health, University of California, Los Angeles, California, USA. 8. Department of Urology, University of Washington, Seattle, Washington, USA.
Abstract
OBJECTIVE: Visual timelines of patient-reported outcomes (PRO) can help prostate cancer survivors manage longitudinal data, compare with population averages, and consider future trajectories. PRO visualizations are most effective when designed with deliberate consideration of users. Yet, graph literacy is often overlooked as a design constraint, particularly when users with limited graph literacy are not engaged in their development. We conducted user testing to assess comprehension, utility, and preference of longitudinal PRO visualizations designed for prostate cancer survivors with limited literacy. MATERIALS AND METHODS: Building upon our prior work co-designing longitudinal PRO visualizations with survivors, we engaged 18 prostate cancer survivors in a user study to assess 4 prototypes: Meter, Words, Comic, and Emoji. During remote sessions, we collected data on prototype comprehension (gist and verbatim), utility, and preference. RESULTS: Participants were aged 61-77 (M = 69), of whom half were African American. The majority of participants had less than a college degree (95%), had inadequate health literacy (78%), and low graph literacy (89%). Among the 4 prototypes, Meter had the best gist comprehension and was preferred. Emoji was also preferred, had the highest verbatim comprehension, and highest rated utility, including helpfulness, confidence, and satisfaction. Meter and Words both rated mid-range for utility, and Words scored lower than Emoji and Meter for comprehension. Comic had the poorest comprehension, lowest utility, and was least preferred. DISCUSSION: Findings identify design considerations for PRO visualizations, contributing to the knowledge base for visualization best practices. We describe our process to meaningfully engage patients from diverse and hard-to-reach groups for remote user testing, an important endeavor for health equity in biomedical informatics. CONCLUSION: Graph literacy is an important design consideration for PRO visualizations. Biomedical informatics researchers should be intentional in understanding user needs by involving diverse and representative individuals during development.
OBJECTIVE: Visual timelines of patient-reported outcomes (PRO) can help prostate cancer survivors manage longitudinal data, compare with population averages, and consider future trajectories. PRO visualizations are most effective when designed with deliberate consideration of users. Yet, graph literacy is often overlooked as a design constraint, particularly when users with limited graph literacy are not engaged in their development. We conducted user testing to assess comprehension, utility, and preference of longitudinal PRO visualizations designed for prostate cancer survivors with limited literacy. MATERIALS AND METHODS: Building upon our prior work co-designing longitudinal PRO visualizations with survivors, we engaged 18 prostate cancer survivors in a user study to assess 4 prototypes: Meter, Words, Comic, and Emoji. During remote sessions, we collected data on prototype comprehension (gist and verbatim), utility, and preference. RESULTS: Participants were aged 61-77 (M = 69), of whom half were African American. The majority of participants had less than a college degree (95%), had inadequate health literacy (78%), and low graph literacy (89%). Among the 4 prototypes, Meter had the best gist comprehension and was preferred. Emoji was also preferred, had the highest verbatim comprehension, and highest rated utility, including helpfulness, confidence, and satisfaction. Meter and Words both rated mid-range for utility, and Words scored lower than Emoji and Meter for comprehension. Comic had the poorest comprehension, lowest utility, and was least preferred. DISCUSSION: Findings identify design considerations for PRO visualizations, contributing to the knowledge base for visualization best practices. We describe our process to meaningfully engage patients from diverse and hard-to-reach groups for remote user testing, an important endeavor for health equity in biomedical informatics. CONCLUSION: Graph literacy is an important design consideration for PRO visualizations. Biomedical informatics researchers should be intentional in understanding user needs by involving diverse and representative individuals during development.
Authors: J L Donovan; F C Hamdy; J A Lane; D E Neal; M Mason; C Metcalfe; E Walsh; J M Blazeby; T J Peters; P Holding; S Bonnington; T Lennon; L Bradshaw; D Cooper; P Herbert; J Howson; A Jones; N Lyons; E Salter; P Thompson; S Tidball; J Blaikie; C Gray; P Bollina; J Catto; A Doble; A Doherty; D Gillatt; R Kockelbergh; H Kynaston; A Paul; P Powell; S Prescott; D J Rosario; E Rowe; M Davis; E L Turner; R M Martin Journal: N Engl J Med Date: 2016-09-14 Impact factor: 91.245
Authors: Hanan J Aboumatar; Kathryn A Carson; Mary Catherine Beach; Debra L Roter; Lisa A Cooper Journal: J Gen Intern Med Date: 2013-05-21 Impact factor: 5.128
Authors: Kerry L Kilbridge; Gertrude Fraser; Murray Krahn; Elizabeth M Nelson; Mark Conaway; Randall Bashore; Andrew Wolf; Michael J Barry; Debra A Gong; Robert F Nease; Alfred F Connors Journal: J Clin Oncol Date: 2009-03-23 Impact factor: 44.544
Authors: Claire F Snyder; Katherine C Smith; Elissa T Bantug; Elliott E Tolbert; Amanda L Blackford; Michael D Brundage Journal: Cancer Date: 2017-01-13 Impact factor: 6.860