Literature DB >> 16384034

Linear theory for control of nonlinear stochastic systems.

Hilbert J Kappen1.   

Abstract

We address the role of noise and the issue of efficient computation in stochastic optimal control problems. We consider a class of nonlinear control problems that can be formulated as a path integral and where the noise plays the role of temperature. The path integral displays symmetry breaking and there exists a critical noise value that separates regimes where optimal control yields qualitatively different solutions. The path integral can be computed efficiently by Monte Carlo integration or by a Laplace approximation, and can therefore be used to solve high dimensional stochastic control problems.

Year:  2005        PMID: 16384034     DOI: 10.1103/PhysRevLett.95.200201

Source DB:  PubMed          Journal:  Phys Rev Lett        ISSN: 0031-9007            Impact factor:   9.161


  12 in total

1.  Efficient computation of optimal actions.

Authors:  Emanuel Todorov
Journal:  Proc Natl Acad Sci U S A       Date:  2009-07-02       Impact factor: 11.205

2.  Effects of water currents on fish migration through a Feynman-type path integral approach under [Formula: see text] Liouville-like quantum gravity surfaces.

Authors:  Paramahansa Pramanik
Journal:  Theory Biosci       Date:  2021-05-20       Impact factor: 1.919

3.  Near-optimal protocols in complex nonequilibrium transformations.

Authors:  Todd R Gingrich; Grant M Rotskoff; Gavin E Crooks; Phillip L Geissler
Journal:  Proc Natl Acad Sci U S A       Date:  2016-08-29       Impact factor: 11.205

4.  The effect of model uncertainty on cooperation in sensorimotor interactions.

Authors:  J Grau-Moya; E Hez; G Pezzulo; D A Braun
Journal:  J R Soc Interface       Date:  2013-08-14       Impact factor: 4.118

5.  Time-integrated position error accounts for sensorimotor behavior in time-constrained tasks.

Authors:  Julian J Tramper; Bart van den Broek; Wim Wiegerinck; Hilbert J Kappen; Stan Gielen
Journal:  PLoS One       Date:  2012-03-21       Impact factor: 3.240

6.  Hedging your bets: intermediate movements as optimal behavior in the context of an incomplete decision.

Authors:  Adrian M Haith; David M Huberdeau; John W Krakauer
Journal:  PLoS Comput Biol       Date:  2015-03-30       Impact factor: 4.475

7.  Noise Response Data Reveal Novel Controllability Gramian for Nonlinear Network Dynamics.

Authors:  Kenji Kashima
Journal:  Sci Rep       Date:  2016-06-06       Impact factor: 4.379

8.  Learning Universal Computations with Spikes.

Authors:  Dominik Thalmeier; Marvin Uhlmann; Hilbert J Kappen; Raoul-Martin Memmesheimer
Journal:  PLoS Comput Biol       Date:  2016-06-16       Impact factor: 4.475

9.  Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task.

Authors:  Ken Kinjo; Eiji Uchibe; Kenji Doya
Journal:  Front Neurorobot       Date:  2013-04-05       Impact factor: 2.650

10.  What is value-accumulated reward or evidence?

Authors:  Karl Friston; Rick Adams; Read Montague
Journal:  Front Neurorobot       Date:  2012-11-02       Impact factor: 2.650

View more

北京卡尤迪生物科技股份有限公司 © 2022-2023.