James Henderson1,2, Zachary Bouck3,4, Rob Holleman2, Cherry Chu3, Mandi L Klamerus2, Robin Santiago3, R Sacha Bhatia3,5, Eve A Kerr2,6,7. 1. Consulting for Statistics, Computing and Analytics Research, University of Michigan, Ann Arbor. 2. Veterans Affairs Center for Clinical Management Research, Ann Arbor, Michigan. 3. Institute for Health Systems Solutions and Virtual Care, Women's College Hospital, Toronto, Ontario, Canada. 4. Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada. 5. Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada. 6. Department of Internal Medicine, University of Michigan, Ann Arbor. 7. Michigan Program on Value Enhancement, Institute for Healthcare Policy and Innovation, University of Michigan, Ann Arbor.
Abstract
Importance: Evidence comparing the consequences of Choosing Wisely recommendations across health systems or with the consequences of recommendations plus policy change is lacking. Objectives: To compare changes in the use of 2 low-value laboratory tests after the release of Choosing Wisely recommendations across 3 health care jurisdictions and changes associated with a related policy change. Design, Setting, and Participants: This cross-sectional study was a population-based interrupted time series of adult patients (aged 18-64 years) who had primary care visits between January 1, 2010, and June 30, 2015, or established hypothyroidism between January 1, 2012, and June 30, 2015, across 3 health care delivery jurisdictions: Ontario, Canada; the US Veterans Health Administration; and the US employer-sponsored insurance market. Data analysis was performed from March 21, 2018, to October 31, 2019. Exposures: A December 2010 payment policy change that eliminated reimbursement of vitamin D screening in Ontario, Canada, and the subsequent release of Choosing Wisely recommendations against low-value use of vitamin D tests in February 2013 and triiodothyronine tests in October 2013 in the United States and both tests in October 2014 in Canada. Main Outcomes and Measures: Relative marginal effects (RMEs) comparing low-value testing rates after the release of Choosing Wisely recommendations with rates expected based on prerelease trends and the associated change in low-value vitamin D testing after the 2010 payment policy change in Ontario, Canada. Results: Of 54 223 448 total persons, 28 504 576 (52.6%) were female, with 17 895 458 persons (33.0%) aged 18 to 34 years, 11 101 985 (20.5%) aged 35 to 44 years, and 25 226 005 (46.5%) aged 45 to 64 years. The December 2010 policy eliminating reimbursement for low-value vitamin D screening in Ontario, Canada, was associated with a 92.7% (95% CI, 92.4%-93.0%) relative reduction in such screening. Corresponding Choosing Wisely recommendations were associated with smaller reductions: 4.5% (95% CI, 2.6%-6.3%) in Ontario, 13.8% (95% CI, 11.8%-15.9%) for US Veterans Health Administration, and 14.0% (95% CI, 12.8%-15.2%) for US employer-sponsored insurance. In contrast, low-value use of triiodothyronine testing did not change significantly in Ontario, Canada (RME, 0.3%; 95% CI, -1.4% to 2.0%) or the US Veterans Health Administration (RME, 0.7%; 95% CI, -4.7% to 6.4%) and increased (RME, 3.0%; 95% CI, 1.6%-4.4%) for US employer-sponsored insurance. Conclusions and Relevance: In this study, marginal reductions in the use of 2 low-value laboratory tests were associated with the release of related Choosing Wisely recommendations but a greater reduction in low-value vitamin D screening was associated with a previous payment policy change implemented in Ontario, Canada. These findings suggest that recommendations alone may be insufficient to significantly reduce use of low-value services and that pairing recommendations with policy changes may be more effective.
Importance: Evidence comparing the consequences of Choosing Wisely recommendations across health systems or with the consequences of recommendations plus policy change is lacking. Objectives: To compare changes in the use of 2 low-value laboratory tests after the release of Choosing Wisely recommendations across 3 health care jurisdictions and changes associated with a related policy change. Design, Setting, and Participants: This cross-sectional study was a population-based interrupted time series of adult patients (aged 18-64 years) who had primary care visits between January 1, 2010, and June 30, 2015, or established hypothyroidism between January 1, 2012, and June 30, 2015, across 3 health care delivery jurisdictions: Ontario, Canada; the US Veterans Health Administration; and the US employer-sponsored insurance market. Data analysis was performed from March 21, 2018, to October 31, 2019. Exposures: A December 2010 payment policy change that eliminated reimbursement of vitamin D screening in Ontario, Canada, and the subsequent release of Choosing Wisely recommendations against low-value use of vitamin D tests in February 2013 and triiodothyronine tests in October 2013 in the United States and both tests in October 2014 in Canada. Main Outcomes and Measures: Relative marginal effects (RMEs) comparing low-value testing rates after the release of Choosing Wisely recommendations with rates expected based on prerelease trends and the associated change in low-value vitamin D testing after the 2010 payment policy change in Ontario, Canada. Results: Of 54 223 448 total persons, 28 504 576 (52.6%) were female, with 17 895 458 persons (33.0%) aged 18 to 34 years, 11 101 985 (20.5%) aged 35 to 44 years, and 25 226 005 (46.5%) aged 45 to 64 years. The December 2010 policy eliminating reimbursement for low-value vitamin D screening in Ontario, Canada, was associated with a 92.7% (95% CI, 92.4%-93.0%) relative reduction in such screening. Corresponding Choosing Wisely recommendations were associated with smaller reductions: 4.5% (95% CI, 2.6%-6.3%) in Ontario, 13.8% (95% CI, 11.8%-15.9%) for US Veterans Health Administration, and 14.0% (95% CI, 12.8%-15.2%) for US employer-sponsored insurance. In contrast, low-value use of triiodothyronine testing did not change significantly in Ontario, Canada (RME, 0.3%; 95% CI, -1.4% to 2.0%) or the US Veterans Health Administration (RME, 0.7%; 95% CI, -4.7% to 6.4%) and increased (RME, 3.0%; 95% CI, 1.6%-4.4%) for US employer-sponsored insurance. Conclusions and Relevance: In this study, marginal reductions in the use of 2 low-value laboratory tests were associated with the release of related Choosing Wisely recommendations but a greater reduction in low-value vitamin D screening was associated with a previous payment policy change implemented in Ontario, Canada. These findings suggest that recommendations alone may be insufficient to significantly reduce use of low-value services and that pairing recommendations with policy changes may be more effective.
Authors: R Sacha Bhatia; Wendy Levinson; Samuel Shortt; Ciara Pendrith; Elana Fric-Shamji; Marjon Kallewaard; Wilco Peul; Jeremy Veillard; Adam Elshaug; Ian Forde; Eve A Kerr Journal: BMJ Qual Saf Date: 2015-06-19 Impact factor: 7.035
Authors: Christopher Naugler; Brenda Hemmelgarn; Hude Quan; Fiona Clement; Tolulope Sajobi; Roger Thomas; Tanvir C Turin; William Hnydyk; Alex Chin; James Wesenberg Journal: CMAJ Open Date: 2017-01-17
Authors: Christopher M Petrilli; James Henderson; Jenna M Keedy; Emily R Dibble; Melissa Y Wei; Julie K Prussack; Grant Greenberg; Eve A Kerr Journal: Am J Med Date: 2018-07-29 Impact factor: 4.965
Authors: Jonathan Brett; Donovan T Maust; Zach Bouck; Rosalinda V Ignacio; Graham Mecredy; Eve A Kerr; Sacha Bhatia; Adam G Elshaug; Sallie A Pearson Journal: J Am Geriatr Soc Date: 2018-02-12 Impact factor: 5.562
Authors: Carrie H Colla; Nancy E Morden; Thomas D Sequist; William L Schpero; Meredith B Rosenthal Journal: J Gen Intern Med Date: 2014-11-06 Impact factor: 5.128
Authors: Alan Rosenberg; Abiy Agiro; Marc Gottlieb; John Barron; Peter Brady; Ying Liu; Cindy Li; Andrea DeVries Journal: JAMA Intern Med Date: 2015-12 Impact factor: 21.873
Authors: James F Burke; Eve A Kerr; Ryan J McCammon; Rob Holleman; Kenneth M Langa; Brian C Callaghan Journal: Neurology Date: 2016-07-08 Impact factor: 9.910
Authors: Jessica M Welch; Thompson Zhuang; Lauren M Shapiro; Alex H S Harris; Laurence C Baker; Robin N Kamal Journal: Clin Orthop Relat Res Date: 2022-05-24 Impact factor: 4.755
Authors: John N Mafi; Rachel O Reid; Lesley H Baseman; Scot Hickey; Mark Totten; Denis Agniel; A Mark Fendrick; Catherine Sarkisian; Cheryl L Damberg Journal: JAMA Netw Open Date: 2021-02-01
Authors: Sheharyar Raza; Andre C Amaral; Jeffrey Pang; Fuad Moussa; Dominick Shelton; Lowyl Notario; Heather Harrington; Jeannie L Callum; Paul M Yip Journal: BMJ Open Qual Date: 2020-12
Authors: Thomas R Radomski; Robert Feldman; Yan Huang; Florentina E Sileanu; Carolyn T Thorpe; Joshua M Thorpe; Michael J Fine; Walid F Gellad Journal: JAMA Netw Open Date: 2020-09-01