William B Weeks1, Tor D Tosteson2, James M Whedon3, Brent Leininger4, Jon D Lurie5, Rand Swenson2, Christine M Goertz6, Alistair J O'Malley7. 1. Professor, The Geisel School of Medicine at Dartmouth, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH; Chair, Health Services and Clinical Research Program, Palmer Center for Chiropractic Research, Palmer College of Chiropractic, Davenport, IA. Electronic address: wbw@dartmouth.edu. 2. Professor, The Geisel School of Medicine at Dartmouth, The Dartmouth Institute for Health Policy and Clinical Practice, Davenport, IA. 3. Instructor, The Geisel School of Medicine at Dartmouth, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH; Director, Health Services Research, Southern California University of Health Sciences, Whittier, CA. 4. Research Fellow, Integrative Health & Wellbeing Research Program, Center for Spirituality & Healing, University of Minnesota, Minneapolis, MN. 5. Associate Professor, The Geisel School of Medicine at Dartmouth, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH. 6. Vice Chancellor, Palmer College of Chiropractic, and Director, Palmer Center for Chiropractic Research, Davenport, IA. 7. Professor, The Geisel School of Medicine at Dartmouth, Department of Biomedical Data Science, The Dartmouth Institute for Health Policy and Clinical Practice, Lebanon, NH.
Abstract
OBJECTIVE: Patients who use complementary and integrative health services like chiropractic manipulative treatment (CMT) often have different characteristics than do patients who do not, and these differences can confound attempts to compare outcomes across treatment groups, particularly in observational studies when selection bias may occur. The purposes of this study were to provide an overview on how propensity scoring methods can be used to address selection bias by balancing treatment groups on key variables and to use Medicare data to compare different methods for doing so. METHODS: We described 2 propensity score methods (matching and weighting). Then we used Medicare data from 2006 to 2012 on older, multiply comorbid patients who had a chronic low back pain episode to demonstrate the impact of applying methods on the balance of demographics of patients between 2 treatment groups (those who received only CMT and those who received no CMT during their episodes). RESULTS: Before application of propensity score methods, patients who used only CMT had different characteristics from those who did not. Propensity score matching diminished observed differences across the treatment groups at the expense of reduced sample size. However, propensity score weighting achieved balance in patient characteristics between the groups and allowed us to keep the entire sample. CONCLUSIONS: Although propensity score matching and weighting have similar effects in terms of balancing covariates, weighting has the advantage of maintaining sample size, preserving external validity, and generalizing more naturally to comparisons of 3 or more treatment groups. Researchers should carefully consider which propensity score method to use, as using different methods can generate different results.
OBJECTIVE:Patients who use complementary and integrative health services like chiropractic manipulative treatment (CMT) often have different characteristics than do patients who do not, and these differences can confound attempts to compare outcomes across treatment groups, particularly in observational studies when selection bias may occur. The purposes of this study were to provide an overview on how propensity scoring methods can be used to address selection bias by balancing treatment groups on key variables and to use Medicare data to compare different methods for doing so. METHODS: We described 2 propensity score methods (matching and weighting). Then we used Medicare data from 2006 to 2012 on older, multiply comorbid patients who had a chronic low back pain episode to demonstrate the impact of applying methods on the balance of demographics of patients between 2 treatment groups (those who received only CMT and those who received no CMT during their episodes). RESULTS: Before application of propensity score methods, patients who used only CMT had different characteristics from those who did not. Propensity score matching diminished observed differences across the treatment groups at the expense of reduced sample size. However, propensity score weighting achieved balance in patient characteristics between the groups and allowed us to keep the entire sample. CONCLUSIONS: Although propensity score matching and weighting have similar effects in terms of balancing covariates, weighting has the advantage of maintaining sample size, preserving external validity, and generalizing more naturally to comparisons of 3 or more treatment groups. Researchers should carefully consider which propensity score method to use, as using different methods can generate different results.
Authors: Michael R Polen; Donald K Freeborn; Frances L Lynch; John P Mullooly; Daniel M Dickinson Journal: J Behav Health Serv Res Date: 2006-07 Impact factor: 1.505
Authors: Ian D Coulter; Eric L Hurwitz; Alan H Adams; Barbara J Genovese; Ron Hays; Paul G Shekelle Journal: Spine (Phila Pa 1976) Date: 2002-02-01 Impact factor: 3.468
Authors: Jeremy A Rassen; Abhi A Shelat; Jessica Myers; Robert J Glynn; Kenneth J Rothman; Sebastian Schneeweiss Journal: Pharmacoepidemiol Drug Saf Date: 2012-05 Impact factor: 2.890
Authors: Brook I Martin; Richard A Deyo; Sohail K Mirza; Judith A Turner; Bryan A Comstock; William Hollingworth; Sean D Sullivan Journal: JAMA Date: 2008-02-13 Impact factor: 56.272
Authors: Sidney M Rubinstein; Rik van Eekelen; Teddy Oosterhuis; Michiel R de Boer; Raymond W J G Ostelo; Maurits W van Tulder Journal: J Manipulative Physiol Ther Date: 2014-09-05 Impact factor: 1.437
Authors: William B Weeks; Brent Leininger; James M Whedon; Jon D Lurie; Tor D Tosteson; Rand Swenson; Alistair J O'Malley; Christine M Goertz Journal: J Manipulative Physiol Ther Date: 2016-02-19 Impact factor: 1.437
Authors: Joe Amoah; Elizabeth A Stuart; Sara E Cosgrove; Anthony D Harris; Jennifer H Han; Ebbing Lautenbach; Pranita D Tamma Journal: Clin Infect Dis Date: 2020-12-03 Impact factor: 9.079
Authors: Ling Han; Joseph L Goulet; Melissa Skanderson; Harini Bathulapalli; Stephen L Luther; Robert D Kerns; Cynthia A Brandt Journal: Pain Med Date: 2019-01-01 Impact factor: 3.750
Authors: James M Whedon; Anupama Kizhakkeveettil; Andrew Wj Toler; Serena Bezdjian; Daniel Rossi; Sarah Uptmor; Todd A MacKenzie; Jon D Lurie; Eric L Hurwitz; Ian Coulter; Scott Haldeman Journal: Spine (Phila Pa 1976) Date: 2022-02-15 Impact factor: 3.468