Xiaoxin I Yao1, Xiaofei Wang2, Paul J Speicher3, E Shelley Hwang3, Perry Cheng1, David H Harpole3, Mark F Berry4, Deborah Schrag5, Herbert H Pang1,2. 1. School of Public Health, Li Ka Shing Faculty of Medicine, Hong Kong SAR, China. 2. Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, NC, USA. 3. Duke University Medical Center and Duke Cancer Institute, Durham, NC, USA. 4. Stanford University Medical Center, Stanford, CA, USA. 5. Dana-Farber/Harvard Cancer Center, Boston, MA, USA.
Abstract
Background: : Propensity score (PS) analysis is increasingly being used in observational studies, especially in some cancer studies where random assignment is not feasible. This systematic review evaluates the use and reporting quality of PS analysis in oncology studies. Methods: : We searched PubMed to identify the use of PS methods in cancer studies (CS) and cancer surgical studies (CSS) in major medical, cancer, and surgical journals over time and critically evaluated 33 CS published in top medical and cancer journals in 2014 and 2015 and 306 CSS published up to November 26, 2015, without earlier date limits. The quality of reporting in PS analysis was evaluated. It was also compared over time and among journals with differing impact factors. All statistical tests were two-sided. Results: More than 50% of the publications with PS analysis from the past decade occurred within the past two years. Of the studies critically evaluated, a considerable proportion did not clearly provide the variables used to estimate PS (CS 12.1%, CSS 8.8%), incorrectly included non baseline variables (CS 3.4%, CSS 9.3%), neglected the comparison of baseline characteristics (CS 21.9%, CSS 15.6%), or did not report the matching algorithm utilized (CS 19.0%, CSS 36.1%). In CSS, the reporting of the matching algorithm improved in 2014 and 2015 ( P = .04), and the reporting of variables used to estimate PS was better in top surgery journals ( P = .008). However, there were no statistically significant differences for the inclusion of non baseline variables and reporting of comparability of baseline characteristics. Conclusions: The use of PS in cancer studies has dramatically increased recently, but there is substantial room for improvement in the quality of reporting even in top journals. Herein we have proposed reporting guidelines for PS analyses that are broadly applicable to different areas of medical research that will allow better evaluation and comparison across studies applying this approach.
Background: : Propensity score (PS) analysis is increasingly being used in observational studies, especially in some cancer studies where random assignment is not feasible. This systematic review evaluates the use and reporting quality of PS analysis in oncology studies. Methods: : We searched PubMed to identify the use of PS methods in cancer studies (CS) and cancer surgical studies (CSS) in major medical, cancer, and surgical journals over time and critically evaluated 33 CS published in top medical and cancer journals in 2014 and 2015 and 306 CSS published up to November 26, 2015, without earlier date limits. The quality of reporting in PS analysis was evaluated. It was also compared over time and among journals with differing impact factors. All statistical tests were two-sided. Results: More than 50% of the publications with PS analysis from the past decade occurred within the past two years. Of the studies critically evaluated, a considerable proportion did not clearly provide the variables used to estimate PS (CS 12.1%, CSS 8.8%), incorrectly included non baseline variables (CS 3.4%, CSS 9.3%), neglected the comparison of baseline characteristics (CS 21.9%, CSS 15.6%), or did not report the matching algorithm utilized (CS 19.0%, CSS 36.1%). In CSS, the reporting of the matching algorithm improved in 2014 and 2015 ( P = .04), and the reporting of variables used to estimate PS was better in top surgery journals ( P = .008). However, there were no statistically significant differences for the inclusion of non baseline variables and reporting of comparability of baseline characteristics. Conclusions: The use of PS in cancer studies has dramatically increased recently, but there is substantial room for improvement in the quality of reporting even in top journals. Herein we have proposed reporting guidelines for PS analyses that are broadly applicable to different areas of medical research that will allow better evaluation and comparison across studies applying this approach.
Authors: S T Normand; M B Landrum; E Guadagnoli; J Z Ayanian; T J Ryan; P D Cleary; B J McNeil Journal: J Clin Epidemiol Date: 2001-04 Impact factor: 6.437
Authors: Tarik Benmarhnia; John P Pierce; Eric Leas; Martha M White; David R Strong; Madison L Noble; Dennis R Trinidad Journal: Am J Epidemiol Date: 2018-11-01 Impact factor: 4.897
Authors: Jeff Y Yang; Michael Webster-Clark; Jennifer L Lund; Robert S Sandler; Evan S Dellon; Til Stürmer Journal: Gastrointest Endosc Date: 2019-04-30 Impact factor: 9.427
Authors: Ryan D Ross; Xu Shi; Megan E V Caram; Pheobe A Tsao; Paul Lin; Amy Bohnert; Min Zhang; Bhramar Mukherjee Journal: Health Serv Outcomes Res Methodol Date: 2020-10-20
Authors: Sherry Kit Wa Chan; Stephanie Wing Yan Chan; Herbert H Pang; Kang K Yan; Christy Lai Ming Hui; Wing Chung Chang; Edwin Ho Ming Lee; Eric Yu Hai Chen Journal: JAMA Psychiatry Date: 2018-05-01 Impact factor: 21.596