BACKGROUND / OBJECTIVE: Modelers lack a tool to systematically and clearly present complex model results, including those from sensitivity analyses. The objective was to propose linear regression metamodeling as a tool to increase transparency of decision analytic models and better communicate their results. METHODS: We used a simplified cancer cure model to demonstrate our approach. The model computed the lifetime cost and benefit of 3 treatment options for cancer patients. We simulated 10,000 cohorts in a probabilistic sensitivity analysis (PSA) and regressed the model outcomes on the standardized input parameter values in a set of regression analyses. We used the regression coefficients to describe measures of sensitivity analyses, including threshold and parameter sensitivity analyses. We also compared the results of the PSA to deterministic full-factorial and one-factor-at-a-time designs. RESULTS: The regression intercept represented the estimated base-case outcome, and the other coefficients described the relative parameter uncertainty in the model. We defined simple relationships that compute the average and incremental net benefit of each intervention. Metamodeling produced outputs similar to traditional deterministic 1-way or 2-way sensitivity analyses but was more reliable since it used all parameter values. CONCLUSIONS: Linear regression metamodeling is a simple, yet powerful, tool that can assist modelers in communicating model characteristics and sensitivity analyses.
BACKGROUND / OBJECTIVE: Modelers lack a tool to systematically and clearly present complex model results, including those from sensitivity analyses. The objective was to propose linear regression metamodeling as a tool to increase transparency of decision analytic models and better communicate their results. METHODS: We used a simplified cancer cure model to demonstrate our approach. The model computed the lifetime cost and benefit of 3 treatment options for cancerpatients. We simulated 10,000 cohorts in a probabilistic sensitivity analysis (PSA) and regressed the model outcomes on the standardized input parameter values in a set of regression analyses. We used the regression coefficients to describe measures of sensitivity analyses, including threshold and parameter sensitivity analyses. We also compared the results of the PSA to deterministic full-factorial and one-factor-at-a-time designs. RESULTS: The regression intercept represented the estimated base-case outcome, and the other coefficients described the relative parameter uncertainty in the model. We defined simple relationships that compute the average and incremental net benefit of each intervention. Metamodeling produced outputs similar to traditional deterministic 1-way or 2-way sensitivity analyses but was more reliable since it used all parameter values. CONCLUSIONS: Linear regression metamodeling is a simple, yet powerful, tool that can assist modelers in communicating model characteristics and sensitivity analyses.
Authors: Radboud J Duintjer Tebbens; Kimberly M Thompson; M G Myriam Hunink; Thomas A Mazzuchi; Daniel Lewandowski; Dorota Kurowicka; Roger M Cooke Journal: Med Decis Making Date: 2008-03-18 Impact factor: 2.583
Authors: Andrew H Briggs; Milton C Weinstein; Elisabeth A L Fenwick; Jonathan Karnon; Mark J Sculpher; A David Paltiel Journal: Med Decis Making Date: 2012 Sep-Oct Impact factor: 2.583
Authors: Zafar Zafari; Kristian Thorlund; J Mark FitzGerald; Carlo A Marra; Mohsen Sadatsafavi Journal: Pharmacoeconomics Date: 2014-10 Impact factor: 4.981
Authors: Devin Incerti; Jeffrey R Curtis; Jason Shafrin; Darius N Lakdawalla; Jeroen P Jansen Journal: Pharmacoeconomics Date: 2019-06 Impact factor: 4.981
Authors: Bohdan Nosyk; Janet Weiner; Emanuel Krebs; Xiao Zang; Benjamin Enns; Czarina N Behrends; Daniel J Feaster; Hawre Jalal; Brandon D L Marshall; Ankur Pandya; Bruce R Schackman; Zachary F Meisel Journal: Med Decis Making Date: 2020-08-05 Impact factor: 2.583
Authors: Huaiyang Zhong; Margaret L Brandeau; Golnaz Eftekhari Yazdi; Jianing Wang; Shayla Nolen; Liesl Hagan; William W Thompson; Sabrina A Assoumou; Benjamin P Linas; Joshua A Salomon Journal: Med Decis Making Date: 2022-06-23 Impact factor: 2.749
Authors: Katy B Kozhimannil; Rachel R Hardeman; Fernando Alarid-Escudero; Carrie A Vogelsang; Cori Blauer-Peterson; Elizabeth A Howell Journal: Birth Date: 2016-01-14 Impact factor: 3.689