Perception, Action and Utility: The Tangled Skein

Perception, Action and Utility: The Tangled Skein (2011)

Cached

Download Links

by Samuel J. Gershman , Nathaniel D. Daw

BibTeX

@MISC{Gershman11perception,action,
    author = {Samuel J. Gershman and Nathaniel D. Daw},
    title = {Perception, Action and Utility: The Tangled Skein},
    year = {2011}
}

Bookmark

OpenURL

Abstract

Normative theories of learning and decision-making are motivated by a computational-level analysis of the task facing an animal: what should the animal do to maximize future reward? However, much of the recent excitement in this field originates in how the animal arrives at its decisions and reward predictions—-algorithmic questions about which the computational-level analysis is silent.

Citations

2827	Reinforcement Learning: An Introduction - Sutton, Barto - 1998
1497	Prospect Theory: An Analysis of Decision Under - Kahneman, Tversky - 1979
1015	The Foundations of Statistics - Savage - 1954
917	Statistical decision theory and Bayesian analysis - Berger - 1985
656	An Introduction to Variational Methods for Graphical Models - Jordan, Ghahramani, et al. - 1999
588	Monte Carlo statistical methods - Robert, Casella - 2004
508	Signal Detection Theory and Psychophysics - Green, Swets - 1966
344	Hierarchical models of object recognition in cortex. Nat Neurosci 2 - Riesenhuber, Poggio - 1999
322	PR: A neural substrate of prediction and reward - Schultz, Dayan, et al. - 1997
162	Reasoning about beliefs and actions under computational resource constraints - Horvitz - 1987
151	Foraging theory - Stephens, Krebs - 1986
147	and Eric Wefald. Principles of metareasoning - Russell - 1991
132	Risk, Ambiguity and the Savage Axioms”, The Quarterly - Ellsberg - 1961
106	Hierarchical Bayesian inference in the visual cortex - Lee, Mumford - 2003
91	Dynamic programming and influence diagrams - Tatman, Shachter - 1990
62	A method for using belief networks as influence diagrams - Cooper - 1988
61	Neural correlates of decision variables in parietal cortex. Nature 400, 233–238. (doi:10.1038/22268 - Platt, Glimcher - 1999
55	Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control - Daw, Niv, et al. - 2005
47	The Bayesian brain: the role of uncertainty in neural coding and computation. Trends Neurosci - Knill, Pouget - 2004
46	A theory of cortical responses - Friston - 2005
45	Cortical microstimulation influences perceptual judgements of motion direction - Salzman, Britten, et al. - 1990
44	The physics of optimal decision making: a formal analysis of models of performance in twoalternative forced choice tasks - Bogacz, Brown, et al. - 2006
43	Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey - Shadlen, Newsome - 2001
41	Neuronal correlates of a perceptual decision - Newsome, Britten, et al. - 1989
40	Banburismus and the brain: Decoding the relationship between sensory stimuli, decisions, and reward - Gold, Shadlen - 2002
31	2004 Matching behavior and the representation of value in the parietal cortex. Science 304, 1782–1787 - Sugrue, Corrado, et al. - 2005
31	Probabilistic inference for solving discrete and continuous state Markov decision processes - Toussaint, Storkey - 2006
30	Base rates in category learning - Kruschke - 1996
28	Using expectation-maximization for reinforcement learning - Dayan, Hinton - 1997
28	Bayesian decision theory in sensorimotor control. Trends Cogn - Körding, Wolpert - 2006
27	2003 Decisions, uncertainty, and the brain: the science of neuroeconomics - Glimcher
23	P: The learning curve: implications of a quantitative analysis - CR, Fairhurst, et al.
21	The Free-energy Principle: A Unified Brain Theory? Nature Reviews Neuroscience - Friston
18	The pigeon as particle filter - Daw, Courville - 2007
17	Bounded rationality in individual decision making - Camerer - 1998
17	Attention modulates responses in the human lateral geniculate nucleus - O’Connor, Fukui, et al. - 2002
16	Locally Bayesian learning with applications to retrospective revaluation and highlighting - Kruschke
14	Reward timing in the primary visual cortex - Shuler, Bear - 2006
13	Representation and timing in theories of the dopamine system - Daw, Courville, et al. - 2006
11	One and done? optimal decisions from very few samples - Vul, Goodman, et al. - 2009
10	Goal-directed decision making in prefrontal cortex: a computational framework - Botvinick, An - 2009
9	Bayesian approaches to associative learning: From passive to active learning - Kruschke - 2008
9	Sensitivity to changes in base-rate information - Medin, Bettger - 1991
8	Reinforcement learning in the brain - Niv - 2009
8	Rational approximations to rational models: alternative algorithms for category learning - Sanborn, Griffiths, et al. - 2010
8	Decision making, movement planning and statistical decision theory - Trommershäuser, Maloney, et al.
8	Model-free reinforcement learning as mixture learning - Vlassis, Toussaint
7	The application of statistical decision theory to animal behaviour - McNamara, Houston - 1980
6	Testing the efficiency of sensory coding with optimal stimulus ensembles - Machens, Gollisch, et al. - 2005
6	Learning policy improvements with path integrals - Theodorou, Buchli, et al. - 2010