Bahareh Ansari1,2, Erika G Martin1,2,3. 1. Center for Policy Research, Rockefeller College of Public Affairs and Policy, University at Albany, Albany, New York, USA. 2. Center for Collaborative HIV Research in Practice and Policy, School of Public Health, University at Albany, Albany, New York, USA. 3. Department of Public Administration and Policy, Rockefeller College of Public Affairs and Policy, University at Albany, Albany, New York, USA.
Abstract
OBJECTIVE: To develop a usability checklist for public health dashboards. MATERIALS AND METHODS: This study systematically evaluated all publicly available dashboards for sexually transmitted infections on state health department websites in the United States (N = 13). A set of 11 principles derived from the information visualization literature were used to identify usability problems that violate critical usability principles: spatial organization, information coding, consistency, removal of extraneous ink, recognition rather than recall, minimal action, dataset reduction, flexibility to user experience, understandability of contents, scientific integrity, and readability. Three user groups were considered for public health dashboards: public health practitioners, academic researchers, and the general public. Six reviewers with usability knowledge and diverse domain expertise examined the dashboards using a rubric based on the 11 principles. Data analysis included quantitative analysis of experts' usability scores and qualitative synthesis of their textual comments. RESULTS: The dashboards had varying levels of complexity, and the usability scores were dependent on the dashboards' complexity. Overall, understandability of contents, flexibility, and scientific integrity were the areas with the most major usability problems. The usability problems informed a checklist to improve performance in the 11 areas. DISCUSSION: The varying complexity of the dashboards suggests a diversity of target audiences. However, the identified usability problems suggest that dashboards' effectiveness for different groups of users was limited. CONCLUSIONS: The usability of public health data dashboards can be improved to accommodate different user groups. This checklist can guide the development of future public health dashboards to engage diverse audiences.
OBJECTIVE: To develop a usability checklist for public health dashboards. MATERIALS AND METHODS: This study systematically evaluated all publicly available dashboards for sexually transmitted infections on state health department websites in the United States (N = 13). A set of 11 principles derived from the information visualization literature were used to identify usability problems that violate critical usability principles: spatial organization, information coding, consistency, removal of extraneous ink, recognition rather than recall, minimal action, dataset reduction, flexibility to user experience, understandability of contents, scientific integrity, and readability. Three user groups were considered for public health dashboards: public health practitioners, academic researchers, and the general public. Six reviewers with usability knowledge and diverse domain expertise examined the dashboards using a rubric based on the 11 principles. Data analysis included quantitative analysis of experts' usability scores and qualitative synthesis of their textual comments. RESULTS: The dashboards had varying levels of complexity, and the usability scores were dependent on the dashboards' complexity. Overall, understandability of contents, flexibility, and scientific integrity were the areas with the most major usability problems. The usability problems informed a checklist to improve performance in the 11 areas. DISCUSSION: The varying complexity of the dashboards suggests a diversity of target audiences. However, the identified usability problems suggest that dashboards' effectiveness for different groups of users was limited. CONCLUSIONS: The usability of public health data dashboards can be improved to accommodate different user groups. This checklist can guide the development of future public health dashboards to engage diverse audiences.
Authors: Harrell W Chesson; Ian H Spicknall; Adrienna Bingham; Marc Brisson; Samuel T Eppink; Paul G Farnham; Kristen M Kreisel; Sagar Kumar; Jean-François Laprise; Thomas A Peterman; Henry Roberts; Thomas L Gift Journal: Sex Transm Dis Date: 2021-04-01 Impact factor: 2.830
Authors: Kristen M Kreisel; Ian H Spicknall; Julia W Gargano; Felicia M T Lewis; Rayleen M Lewis; Lauri E Markowitz; Henry Roberts; Anna Satcher Johnson; Ruiguang Song; Sancta B St Cyr; Emily J Weston; Elizabeth A Torrone; Hillard S Weinstock Journal: Sex Transm Dis Date: 2021-04-01 Impact factor: 2.830
Authors: Lauren N Carroll; Alan P Au; Landon Todd Detwiler; Tsung-Chieh Fu; Ian S Painter; Neil F Abernethy Journal: J Biomed Inform Date: 2014-04-16 Impact factor: 6.317