Dawn Dowding1, Jacqueline A Merrill2,3. 1. Division of Nursing, Midwifery and Social Work, School of Health Sciences, University of Manchester, Manchester, United Kingdom. 2. Department of Biomedical Informatics, Columbia University, New York, New York, United States. 3. School of Nursing, Columbia University, New York, New York, United States.
Abstract
BACKGROUND: Heuristic evaluation is used in human-computer interaction studies to assess the usability of information systems. Nielsen's widely used heuristics, first developed in 1990, are appropriate for general usability but do not specifically address usability in systems that produce information visualizations. OBJECTIVE: This article develops a heuristic evaluation checklist that can be used to evaluate systems that produce information visualizations. Principles from Nielsen's heuristics were combined with heuristic principles developed by prior researchers specifically to evaluate information visualization. METHODS: We used nominal group technique to determine an appropriate final set. The combined existing usability principles and associated factors were distributed via email to a group of 12 informatics experts from a range of health care disciplines. Respondents were asked to rate each factor on its importance as an evaluation heuristic for visualization systems on a scale from 1 (definitely don't include) to 10 (definitely include). The distribution of scores for each item were calculated. A median score of ≥8 represented consensus for inclusion in the final checklist. RESULTS: Ten of 12 experts responded with rankings and written comments. The final checklist consists of 10 usability principles (7 general and 3 specific to information visualization) substantiated by 49 usability factors. Three nursing informatics experts then used the checklist to evaluate a vital sign dashboard developed for home care nurses, using a task list designed to explore the full functionality of the dashboard. The experts used the checklist without difficulty, and indicated that it covered all major usability problems encountered during task completion. CONCLUSION: The growing capacity to generate and electronically process health data suggests that data visualization will be increasingly important. A checklist of usability heuristics for evaluating information visualization systems can contribute to assuring high quality in electronic data systems developed for health care. Georg Thieme Verlag KG Stuttgart · New York.
BACKGROUND: Heuristic evaluation is used in human-computer interaction studies to assess the usability of information systems. Nielsen's widely used heuristics, first developed in 1990, are appropriate for general usability but do not specifically address usability in systems that produce information visualizations. OBJECTIVE: This article develops a heuristic evaluation checklist that can be used to evaluate systems that produce information visualizations. Principles from Nielsen's heuristics were combined with heuristic principles developed by prior researchers specifically to evaluate information visualization. METHODS: We used nominal group technique to determine an appropriate final set. The combined existing usability principles and associated factors were distributed via email to a group of 12 informatics experts from a range of health care disciplines. Respondents were asked to rate each factor on its importance as an evaluation heuristic for visualization systems on a scale from 1 (definitely don't include) to 10 (definitely include). The distribution of scores for each item were calculated. A median score of ≥8 represented consensus for inclusion in the final checklist. RESULTS: Ten of 12 experts responded with rankings and written comments. The final checklist consists of 10 usability principles (7 general and 3 specific to information visualization) substantiated by 49 usability factors. Three nursing informatics experts then used the checklist to evaluate a vital sign dashboard developed for home care nurses, using a task list designed to explore the full functionality of the dashboard. The experts used the checklist without difficulty, and indicated that it covered all major usability problems encountered during task completion. CONCLUSION: The growing capacity to generate and electronically process health data suggests that data visualization will be increasingly important. A checklist of usability heuristics for evaluating information visualization systems can contribute to assuring high quality in electronic data systems developed for health care. Georg Thieme Verlag KG Stuttgart · New York.
Authors: Christopher A Harle; Julie DiIulio; Sarah M Downs; Elizabeth C Danielson; Shilo Anders; Robert L Cook; Robert W Hurley; Burke W Mamlin; Laura G Militello Journal: Appl Clin Inform Date: 2019-09-25 Impact factor: 2.342
Authors: Jenny E Dolan; Hannah Lonsdale; Luis M Ahumada; Amish Patel; Jibin Samuel; Ali Jalali; Jacquelin Peck; JoAnn C DeRosa; Mohamed Rehman; Anna M Varughese; Allison M Fernandez Journal: Appl Clin Inform Date: 2019-07-31 Impact factor: 2.342
Authors: Marva Foster; Catherine Albanese; Qiang Chen; Kristen A Sethares; Stewart Evans; Lisa Soleymani Lehmann; Jacqueline Spencer; Jacob Joseph Journal: Appl Clin Inform Date: 2020-02-26 Impact factor: 2.342
Authors: Danny T Y Wu; Scott Vennemeyer; Kelly Brown; Jason Revalee; Paul Murdock; Sarah Salomone; Ashton France; Katherine Clarke-Myers; Samuel P Hanke Journal: Appl Clin Inform Date: 2019-11-13 Impact factor: 2.342
Authors: Olivia Nelson; Brian Sturgis; Keri Gilbert; Elizabeth Henry; Kelly Clegg; Jonathan M Tan; Jack O Wasey; Allan F Simpao; Jorge A Gálvez Journal: Appl Clin Inform Date: 2019-08-07 Impact factor: 2.342
Authors: Thomas A Lasko; David A Owens; Daniel Fabbri; Jonathan P Wanderer; Julian Z Genkins; Laurie L Novak Journal: Appl Clin Inform Date: 2020-10-21 Impact factor: 2.342
Authors: John D McGreevey; Colleen P Mallozzi; Randa M Perkins; Eric Shelov; Richard Schreiber Journal: Appl Clin Inform Date: 2020-01-01 Impact factor: 2.342