Vanessa M Brown1, Jiazhou Chen2, Claire M Gillan3, Rebecca B Price4. 1. Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA. Electronic address: brownvm2@upmc.edu. 2. Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA. 3. Department of Psychology, Trinity College Dublin, Dublin, Ireland. 4. Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA. Electronic address: pricerb@upmc.edu.
Abstract
BACKGROUND: Computational models show great promise in mapping latent decision-making processes onto dissociable neural substrates and clinical phenotypes. One prominent example in reinforcement learning is model-based planning, which specifically relates to transdiagnostic compulsivity. However, the reliability of computational model-derived measures such as model-based planning is unclear. Establishing reliability is necessary to ensure that such models measure stable, traitlike processes, as assumed in computational psychiatry. Although analysis approaches affect validity of reinforcement learning models and reliability of other task-based measures, their effect on reliability of reinforcement learning models of empirical data has not been systematically studied. METHODS: We first assessed within- and across-session reliability and effects of analysis approaches (model estimation, parameterization, and data cleaning) of measures of model-based planning in patients with compulsive disorders (n = 38). The analysis approaches affecting test-retest reliability were tested in 3 large generalization samples (healthy participants: n = 541 and 111; people with a range of compulsivity: n = 1413). RESULTS: Analysis approaches greatly influenced reliability: reliability of model-based planning measures ranged from 0 (no concordance) to above 0.9 (acceptable for clinical applications). The largest influence on reliability was whether model-estimation approaches were robust and accounted for the hierarchical structure of estimated parameters. Improvements in reliability generalized to other datasets and greatly reduced the sample size needed to find a relationship between model-based planning and compulsivity in an independent dataset. CONCLUSIONS: These results indicate that computational psychiatry measures such as model-based planning can reliably measure latent decision-making processes, but when doing so must assess the ability of methods to estimate complex models from limited data.
BACKGROUND: Computational models show great promise in mapping latent decision-making processes onto dissociable neural substrates and clinical phenotypes. One prominent example in reinforcement learning is model-based planning, which specifically relates to transdiagnostic compulsivity. However, the reliability of computational model-derived measures such as model-based planning is unclear. Establishing reliability is necessary to ensure that such models measure stable, traitlike processes, as assumed in computational psychiatry. Although analysis approaches affect validity of reinforcement learning models and reliability of other task-based measures, their effect on reliability of reinforcement learning models of empirical data has not been systematically studied. METHODS: We first assessed within- and across-session reliability and effects of analysis approaches (model estimation, parameterization, and data cleaning) of measures of model-based planning in patients with compulsive disorders (n = 38). The analysis approaches affecting test-retest reliability were tested in 3 large generalization samples (healthy participants: n = 541 and 111; people with a range of compulsivity: n = 1413). RESULTS: Analysis approaches greatly influenced reliability: reliability of model-based planning measures ranged from 0 (no concordance) to above 0.9 (acceptable for clinical applications). The largest influence on reliability was whether model-estimation approaches were robust and accounted for the hierarchical structure of estimated parameters. Improvements in reliability generalized to other datasets and greatly reduced the sample size needed to find a relationship between model-based planning and compulsivity in an independent dataset. CONCLUSIONS: These results indicate that computational psychiatry measures such as model-based planning can reliably measure latent decision-making processes, but when doing so must assess the ability of methods to estimate complex models from limited data.
Authors: Miriam Sebold; Stephan Nebe; Maria Garbusow; Matthias Guggenmos; Daniel J Schad; Anne Beck; Soeren Kuitunen-Paul; Christian Sommer; Robin Frank; Peter Neu; Ulrich S Zimmermann; Michael A Rapp; Michael N Smolka; Quentin J M Huys; Florian Schlagenhauf; Andreas Heinz Journal: Biol Psychiatry Date: 2017-05-22 Impact factor: 13.382
Authors: Marc Guitart-Masip; Quentin J M Huys; Lluis Fuentemilla; Peter Dayan; Emrah Duzel; Raymond J Dolan Journal: Neuroimage Date: 2012-04-21 Impact factor: 6.556
Authors: Peter F Hitchcock; Willoughby B Britton; Kahini P Mehta; Michael J Frank Journal: Cogn Affect Behav Neurosci Date: 2022-09-27 Impact factor: 3.526
Authors: Michael Moutoussis; Benjamín Garzón; Sharon Neufeld; Dominik R Bach; Francesco Rigoli; Ian Goodyer; Edward Bullmore; Marc Guitart-Masip; Raymond J Dolan Journal: Neuron Date: 2021-05-20 Impact factor: 17.173