Literature DB >> 20569174

Bayesian online learning of the hazard rate in change-point problems.

Robert C Wilson1, Matthew R Nassar, Joshua I Gold.   

Abstract

Change-point models are generative models of time-varying data in which the underlying generative parameters undergo discontinuous changes at different points in time known as change points. Change-points often represent important events in the underlying processes, like a change in brain state reflected in EEG data or a change in the value of a company reflected in its stock price. However, change-points can be difficult to identify in noisy data streams. Previous attempts to identify change-points online using Bayesian inference relied on specifying in advance the rate at which they occur, called the hazard rate (h). This approach leads to predictions that can depend strongly on the choice of h and is unable to deal optimally with systems in which h is not constant in time. In this letter, we overcome these limitations by developing a hierarchical extension to earlier models. This approach allows h itself to be inferred from the data, which in turn helps to identify when change-points occur. We show that our approach can effectively identify change-points in both toy and real data sets with complex hazard rates and how it can be used as an ideal-observer model for human and animal behavior when faced with rapidly changing inputs.

Entities:  

Mesh:

Year:  2010        PMID: 20569174      PMCID: PMC2966286          DOI: 10.1162/NECO_a_00007

Source DB:  PubMed          Journal:  Neural Comput        ISSN: 0899-7667            Impact factor:   2.026


  11 in total

1.  Bayesian partitioning for estimating disease risk.

Authors:  D G Denison; C C Holmes
Journal:  Biometrics       Date:  2001-03       Impact factor: 2.571

2.  Bayesian inference on biopolymer models.

Authors:  J S Liu; C E Lawrence
Journal:  Bioinformatics       Date:  1999-01       Impact factor: 6.937

3.  Matching behavior and the representation of value in the parietal cortex.

Authors:  Leo P Sugrue; Greg S Corrado; William T Newsome
Journal:  Science       Date:  2004-06-18       Impact factor: 47.728

4.  Linear-Nonlinear-Poisson models of primate choice dynamics.

Authors:  Greg S Corrado; Leo P Sugrue; H Sebastian Seung; William T Newsome
Journal:  J Exp Anal Behav       Date:  2005-11       Impact factor: 2.468

5.  Dynamic response-by-response models of matching behavior in rhesus monkeys.

Authors:  Brian Lau; Paul W Glimcher
Journal:  J Exp Anal Behav       Date:  2005-11       Impact factor: 2.468

6.  Prefrontal neural correlates of memory for sequences.

Authors:  Bruno B Averbeck; Daeyeol Lee
Journal:  J Neurosci       Date:  2007-02-28       Impact factor: 6.167

7.  A simple objective technique for measuring flexibility in thinking.

Authors:  E A BERG
Journal:  J Gen Psychol       Date:  1948-07

8.  Automatic adaptive segmentation of clinical EEGs.

Authors:  J S Barlow; O D Creutzfeldt; D Michael; J Houchin; H Epelbaum
Journal:  Electroencephalogr Clin Neurophysiol       Date:  1981-05

9.  Detecting and predicting changes.

Authors:  Scott D Brown; Mark Steyvers
Journal:  Cogn Psychol       Date:  2008-11-01       Impact factor: 3.468

10.  Learning the value of information in an uncertain world.

Authors:  Timothy E J Behrens; Mark W Woolrich; Mark E Walton; Matthew F S Rushworth
Journal:  Nat Neurosci       Date:  2007-08-05       Impact factor: 24.884

View more
  50 in total

1.  Functionally dissociable influences on learning rate in a dynamic environment.

Authors:  Joseph T McGuire; Matthew R Nassar; Joshua I Gold; Joseph W Kable
Journal:  Neuron       Date:  2014-11-19       Impact factor: 17.173

2.  Coupled Decision Processes Update and Maintain Saccadic Priors in a Dynamic Environment.

Authors:  Timothy Doyeon Kim; Mohammad Kabir; Joshua I Gold
Journal:  J Neurosci       Date:  2017-02-27       Impact factor: 6.167

3.  Sure enough: efficient Bayesian learning and choice.

Authors:  Brad R Foley; Paul Marjoram
Journal:  Anim Cogn       Date:  2017-07-01       Impact factor: 3.084

Review 4.  Temporal trade-offs in psychophysics.

Authors:  David L Barack; Joshua I Gold
Journal:  Curr Opin Neurobiol       Date:  2016-02-26       Impact factor: 6.627

5.  Temporal changes in survival after cardiac surgery are associated with the thirty-day mortality benchmark.

Authors:  Bryan G Maxwell; Jim K Wong; D Craig Miller; Robert L Lobato
Journal:  Health Serv Res       Date:  2014-04-09       Impact factor: 3.402

6.  Comment on "Single-trial spike trains in parietal cortex reveal discrete steps during decision-making".

Authors:  Michael N Shadlen; Roozbeh Kiani; William T Newsome; Joshua I Gold; Daniel M Wolpert; Ariel Zylberberg; Jochen Ditterich; Victor de Lafuente; Tianming Yang; Jamie Roitman
Journal:  Science       Date:  2016-03-25       Impact factor: 47.728

7.  Control of entropy in neural models of environmental state.

Authors:  Timothy H Muller; Rogier B Mars; Timothy E Behrens; Jill X O'Reilly
Journal:  Elife       Date:  2019-02-28       Impact factor: 8.140

8.  A bayesian foundation for individual learning under uncertainty.

Authors:  Christoph Mathys; Jean Daunizeau; Karl J Friston; Klaas E Stephan
Journal:  Front Hum Neurosci       Date:  2011-05-02       Impact factor: 3.169

Review 9.  Optimal models of decision-making in dynamic environments.

Authors:  Zachary P Kilpatrick; William R Holmes; Tahra L Eissa; Krešimir Josić
Journal:  Curr Opin Neurobiol       Date:  2019-07-19       Impact factor: 6.627

10.  Change detection, multiple controllers, and dynamic environments: insights from the brain.

Authors:  John M Pearson; Michael L Platt
Journal:  J Exp Anal Behav       Date:  2012-12-05       Impact factor: 2.468

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.