Dawn Smith1,2, Natalie Kuzla1,2, Joshua Thorpe1,3,4, Laura Scott1, Mary Ersek1,2. 1. 1 PROMISE Center, Philadelphia Veterans Affairs Medical Center , Philadelphia, Pennsylvania. 2. 4 University of Pennsylvania School of Nursing , Philadelphia, Pennsylvania. 3. 2 Center for Health Equity Research and Promotion, Department of Veterans Affairs Medical Center , Pittsburgh, Pennsylvania. 4. 3 Department of Pharmacy and Therapeutics, University of Pittsburgh School of Pharmacy , Pittsburgh, Pennsylvania.
Abstract
BACKGROUND: Patients' and families' evaluations of health care, including palliative care, are widely used as performance measures. Survey scores may be affected by nonresponse bias, resulting in inaccurate performance evaluation. OBJECTIVES: Our aim was to examine nonresponse bias for the mailed version of the Department of Veterans Affairs (VA) Bereaved Family Survey Performance Measure (BFS-PM) and evaluate the effect of nonresponse bias on facilities' BFS-PM scores. METHODS: A cross-sectional analysis of a national sample was conducted. The sample consisted of 20,540 veterans who died in one of 146 VA Medical Centers (VAMCs) between October 2012 and September 2013. Next of kin (NOK) were asked to complete and return the survey. The BFS-PM is defined as the proportion of NOK who rated overall care for the veteran during the last month of life as "excellent." After creating a model to predict the likelihood of response based on patient and clinical characteristics, we applied inverse probability weights to examine their effect on facilities' scores. We also evaluated facility performance before and after weighting for nonresponse vis-à-vis varying benchmarks. RESULTS: We received 8912 surveys (45% response rate). The mean change in facility BFS-PM scores after weighting was -2%, (range: -10% to+11%). The scores of 31% of facilities changed more than±2%. The number of facilities meeting hypothetical benchmarks of 60%, 70%, and 80% also changed as a result of weighting for nonresponse. CONCLUSION: Our results underscore the importance of appropriately addressing nonresponse in the use of quality-of-care metrics based on Bereaved Family Survey (BFS) data.
BACKGROUND:Patients' and families' evaluations of health care, including palliative care, are widely used as performance measures. Survey scores may be affected by nonresponse bias, resulting in inaccurate performance evaluation. OBJECTIVES: Our aim was to examine nonresponse bias for the mailed version of the Department of Veterans Affairs (VA) Bereaved Family Survey Performance Measure (BFS-PM) and evaluate the effect of nonresponse bias on facilities' BFS-PM scores. METHODS: A cross-sectional analysis of a national sample was conducted. The sample consisted of 20,540 veterans who died in one of 146 VA Medical Centers (VAMCs) between October 2012 and September 2013. Next of kin (NOK) were asked to complete and return the survey. The BFS-PM is defined as the proportion of NOK who rated overall care for the veteran during the last month of life as "excellent." After creating a model to predict the likelihood of response based on patient and clinical characteristics, we applied inverse probability weights to examine their effect on facilities' scores. We also evaluated facility performance before and after weighting for nonresponse vis-à-vis varying benchmarks. RESULTS: We received 8912 surveys (45% response rate). The mean change in facility BFS-PM scores after weighting was -2%, (range: -10% to+11%). The scores of 31% of facilities changed more than±2%. The number of facilities meeting hypothetical benchmarks of 60%, 70%, and 80% also changed as a result of weighting for nonresponse. CONCLUSION: Our results underscore the importance of appropriately addressing nonresponse in the use of quality-of-care metrics based on Bereaved Family Survey (BFS) data.
Authors: Claire A Richards; Chuan-Fen Liu; Paul L Hebert; Mary Ersek; Melissa W Wachterman; Lynn F Reinke; Leslie L Taylor; Ann M O'Hare Journal: Clin J Am Soc Nephrol Date: 2019-08-29 Impact factor: 8.237
Authors: Joan G Carpenter; Meghan McDarby; Dawn Smith; Megan Johnson; Joshua Thorpe; Mary Ersek Journal: J Palliat Med Date: 2017-05-04 Impact factor: 2.947
Authors: Ann Kutney-Lee; Scarlett L Bellamy; Mary Ersek; Elina L Medvedeva; Dawn Smith; Joshua M Thorpe; J Margo Brooks Carthon Journal: J Am Geriatr Soc Date: 2022-01-05 Impact factor: 5.562
Authors: Claire A Richards; Paul L Hebert; Chuan-Fen Liu; Mary Ersek; Melissa W Wachterman; Leslie L Taylor; Lynn F Reinke; Ann M O'Hare Journal: JAMA Netw Open Date: 2019-10-02
Authors: Shelli L Feder; Janet Tate; Mary Ersek; Supriya Krishnan; Sarwat I Chaudhry; Lori A Bastian; Joshua Rolnick; Ann Kutney-Lee; Kathleen M Akgün Journal: J Pain Symptom Manage Date: 2020-09-12 Impact factor: 3.612