James G Dolan1, Feng Qian2, Peter J Veazie1. 1. Department of Community and Preventive Medicine (JGD, PJV) University of Rochester, Rochester, NY 2. Department of Anesthesiology (FQ), University of Rochester, Rochester, NY
Abstract
BACKGROUND: Good decisions depend on an accurate understanding of the comparative effectiveness of decision alternatives. The best way to convey data needed to support these comparisons is unknown. OBJECTIVE: To determine how well 5 commonly used data presentation formats convey comparative effectiveness information. METHODS: The study was an Internet survey using a factorial design. Participants consisted of 279 members of an online survey panel. Study participants compared outcomes associated with 3 hypothetical screening test options relative to 5 possible outcomes with probabilities ranging from 2 per 5000 (0.04%) to 500 per 1000 (50%). Data presentation formats included a table, a "magnified" bar chart, a risk scale, a frequency diagram, and an icon array. Outcomes included the number of correct ordinal judgments regarding the more likely of 2 outcomes, the ratio of perceived versus actual relative likelihoods of the paired outcomes, the intersubject consistency of responses, and perceived clarity. RESULTS: The mean number of correct ordinal judgments was 12 of 15 (80%), with no differences among data formats. On average, there was a 3.3-fold difference between perceived and actual likelihood ratios (95% confidence interval = 3.0-3.6). Comparative judgments based on flowcharts, icon arrays, and tables were all significantly more accurate and consistent than those based on risk scales and bar charts (P < 0.001). The most clearly perceived formats were the table and the flowchart. Low subjective numeracy was associated with less accurate and more variable data interpretations and lower perceived clarity for icon displays, bar charts, and flow diagrams. CONCLUSIONS: None of the data presentation formats studied can reliably provide patients, especially those with low subjective numeracy, with an accurate understanding of comparative effectiveness information.
BACKGROUND: Good decisions depend on an accurate understanding of the comparative effectiveness of decision alternatives. The best way to convey data needed to support these comparisons is unknown. OBJECTIVE: To determine how well 5 commonly used data presentation formats convey comparative effectiveness information. METHODS: The study was an Internet survey using a factorial design. Participants consisted of 279 members of an online survey panel. Study participants compared outcomes associated with 3 hypothetical screening test options relative to 5 possible outcomes with probabilities ranging from 2 per 5000 (0.04%) to 500 per 1000 (50%). Data presentation formats included a table, a "magnified" bar chart, a risk scale, a frequency diagram, and an icon array. Outcomes included the number of correct ordinal judgments regarding the more likely of 2 outcomes, the ratio of perceived versus actual relative likelihoods of the paired outcomes, the intersubject consistency of responses, and perceived clarity. RESULTS: The mean number of correct ordinal judgments was 12 of 15 (80%), with no differences among data formats. On average, there was a 3.3-fold difference between perceived and actual likelihood ratios (95% confidence interval = 3.0-3.6). Comparative judgments based on flowcharts, icon arrays, and tables were all significantly more accurate and consistent than those based on risk scales and bar charts (P < 0.001). The most clearly perceived formats were the table and the flowchart. Low subjective numeracy was associated with less accurate and more variable data interpretations and lower perceived clarity for icon displays, bar charts, and flow diagrams. CONCLUSIONS: None of the data presentation formats studied can reliably provide patients, especially those with low subjective numeracy, with an accurate understanding of comparative effectiveness information.
Authors: Sara Arab; Anthony O Gramolini; Peipei Ping; Thomas Kislinger; Brian Stanley; Jennifer van Eyk; Maral Ouzounian; David H MacLennan; Andrew Emili; Peter P Liu Journal: J Am Coll Cardiol Date: 2006-10-17 Impact factor: 24.094
Authors: Angela Fagerlin; Brian J Zikmund-Fisher; Peter A Ubel; Aleksandra Jankovic; Holly A Derry; Dylan M Smith Journal: Med Decis Making Date: 2007-07-19 Impact factor: 2.583
Authors: Kathryn S Tomsho; Erin Polka; Stacey Chacker; David Queeley; Marty Alvarez; Madeleine K Scammell; Karen M Emmons; Rima E Rudd; Gary Adamkiewicz Journal: Environ Health Date: 2022-07-12 Impact factor: 7.123
Authors: Monika Wagner; Dima Samaha; Hanane Khoury; William M O'Neil; Louis Lavoie; Liga Bennetts; Danielle Badgley; Sylvie Gabriel; Anthony Berthon; James Dolan; Matthew H Kulke; Mireille Goetghebeur Journal: Adv Ther Date: 2017-12-21 Impact factor: 3.845
Authors: Paul K J Han; Norbert Hootsmans; Michael Neilson; Bethany Roy; Terence Kungel; Caitlin Gutheil; Michael Diefenbach; Moritz Hansen Journal: BMJ Open Date: 2013-09-13 Impact factor: 2.692