OBJECTIVE: The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users. MATERIALS AND METHODS: We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants' perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol. RESULTS: Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations. CONCLUSIONS: A bar graph combined with emojis was participants' preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.
OBJECTIVE: The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users. MATERIALS AND METHODS: We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants' perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol. RESULTS: Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations. CONCLUSIONS: A bar graph combined with emojis was participants' preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.
Authors: Dror Ben-Zeev; Susan M Kaiser; Christopher J Brenner; Mark Begale; Jennifer Duffecy; David C Mohr Journal: Psychiatr Rehabil J Date: 2013-09-09
Authors: Urmimala Sarkar; Gato I Gourley; Courtney R Lyles; Lina Tieu; Cassidy Clarity; Lisa Newmark; Karandeep Singh; David W Bates Journal: J Gen Intern Med Date: 2016-07-14 Impact factor: 5.128
Authors: P Taenzer; B D Bultz; L E Carlson; M Speca; T DeGagne; K Olson; R Doll; Z Rosberger Journal: Psychooncology Date: 2000 May-Jun Impact factor: 3.894
Authors: Barry D Weiss; Mary Z Mays; William Martz; Kelley Merriam Castro; Darren A DeWalt; Michael P Pignone; Joy Mockbee; Frank A Hale Journal: Ann Fam Med Date: 2005 Nov-Dec Impact factor: 5.166
Authors: Elissa T Bantug; Theresa Coles; Katherine C Smith; Claire F Snyder; Julie Rouette; Michael D Brundage Journal: Patient Educ Couns Date: 2015-11-02
Authors: Kim M Unertl; Chris L Schaefbauer; Terrance R Campbell; Charles Senteio; Katie A Siek; Suzanne Bakken; Tiffany C Veinot Journal: J Am Med Inform Assoc Date: 2015-07-30 Impact factor: 4.497
Authors: Lauren E Snyder; Daniel F Phan; Kristen C Williams; Eduardo Piqueiras; Sarah E Connor; Sheba George; Lorna Kwan; Jefersson Villatoro Chavez; Megha D Tandel; Stanley K Frencher; Mark S Litwin; John L Gore; Andrea L Hartzler Journal: J Am Med Inform Assoc Date: 2022-10-07 Impact factor: 7.942
Authors: Sharon Chiang; Robert Moss; Angela P Black; Michele Jackson; Chuck Moss; Jonathan Bidwell; Christian Meisel; Tobias Loddenkemper Journal: JAMIA Open Date: 2021-03-01
Authors: Colby J Hyland; Ruby Guo; Ravi Dhawan; Manraj N Kaur; Paul A Bain; Maria O Edelen; Andrea L Pusic Journal: J Patient Rep Outcomes Date: 2022-03-07