Temporal difference models and reward-related learning in the human brain

Temporal difference models and reward-related learning in the human brain (2003)

Cached

Download Links

by Peter Dayan , Karl Friston , Hugo Critchley , London Wcn Bg

Venue:	Neuron
Citations:	30 - 2 self

BibTeX

@ARTICLE{Dayan03temporaldifference,
    author = {Peter Dayan and Karl Friston and Hugo Critchley and London Wcn Bg},
    title = {Temporal difference models and reward-related learning in the human brain},
    journal = {Neuron},
    year = {2003},
    volume = {38},
    pages = {329--337}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

John P. O’Doherty, V(tUCS) and V(tUCS � 1) generates a positive prediction error that, in the simplest form of TD learning, is used to increment the value at time tUCS – 1 (in proportion to

Citations

324	PR: A neural substrate of prediction and reward - Schultz, Dayan, et al. - 1997
303	A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement - Rescorla, Wagner - 1972
182	Predictive reward signal of dopamine neurons - Schultz - 1998
95	Time-derivative models of pavlovian reinforcement - Sutton, Barto - 1990
69	A model for Pavlovian learning: variations in the effectiveness of conditioned but not of unconditioned stimuli - Pearce, Hall - 1980
62	Responses of monkey dopamine neurons during CAROLYN W. HARLEY learning of behavioral reactions - Ljungberg, Apicella, et al. - 1992
44	Anticipation of increasing monetary reward selectively recruits nucleus accumbens. J Neurosci 21: RC - Knutson, CM, et al. - 2001
29	Value-dependent selection in the brain: simulation in a synthetic neural model. Neuroscience 59 - KJ, Tononi, et al. - 1994
27	Neural responses during anticipation of a primary taste reward - O’Doherty, Deichmann, et al. - 2002
25	Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature - Mirenowicz, Schultz - 1996
24	Orbitofrontal cortex and basolateral amygdala encode expected outcomces during learning - Schoenbaum, Chiba, et al. - 1998
22	Importance of unpredictability for reward responses in primate dopamine neurons - Mirenowicz, Schultz - 1994
20	M (2000) Delay activity of orbital and lateral prefrontal neurons of the monkey varying with different rewards - Hikosaka, Watanabe
20	Representation of pleasant and aversive taste in the human brain - O’Doherty, Rolls, et al. - 2001
19	Dissociable neural responses in human reward systems - Elliott, Friston, et al. - 2000
19	Spatial registration and normalisation of images - KJ, Ashburner, et al. - 1995
17	Activity in human ventral striatum locked to errors of reward prediction - Pagnoni, Zink, et al. - 2002
16	Dissociation of reward anticipation and outcome with event-related fMRI - Knutson, Fong, et al. - 2001
9	JR: Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology - Schultz, Tremblay, et al. - 1998
8	Responses of human frontal cortex to surprising events are predicted by formal associative learning theory - Fletcher, Anderson, et al. - 2001
7	Orbitofrontal cortex is activated during breaches of expectation in tasks of visual attention - Nobre, Coull, et al. - 1999
7	Learning about pain: the neural substrate of the prediction error of aversive events - Ploghaus, Tracey, et al. - 2000
6	The representation of the pleasantness of touch in the human brain, and its relation to taste and olfactory areas - Francis, Rolls, et al. - 1999
5	Learning and selective - Dayan, Kakade, et al. - 2000
3	Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity - Oades, Halliday - 1987
2	Neurochemical architecture of the human striatum - Holt, Graybiel, et al. - 1997
2	Three-dimensional cartography of functional territories in the human striatopallidal complex by using calbindin immunoreactivity - Karachi, Francois, et al. - 2002
1	the absolute value of �tUCS (�tUCS positive ��tUCS negative) or�tCS and the real value of �tUCS (�tUCS positive ��tUCS negative). Also - Apicella, Scarnati, et al. - 1992
1	responses to the CS�, CS�, or CSneut stimuli were also modeled - Berns, McClure, et al. - 2001
1	as regressors of no interest. In addition, the six scan-to-scan motion Predictability modulates human brain response to reward. J. Neuparameters produced during realignment were included to account rosci. 21, 2793–2798. for residual effects of scan-to-sca - Breiter, Aharon, et al.
1	level by including the � images for the �tCS and two �tUCS regressors - Delgado, Nystrom, et al. - 1995
1	The Human Brain (Vienna - Duvernoy - 1999
1	Orbitofrontal - Schoenbaum, Chiba, et al. - 1998
1	Predictive reward signal of dopamine neurons - Fletcher, Anderson, et al. - 1998
1	80, 1–27. sponses of human frontal cortex to surprising events are predicted - Neurophysiol - 1997
1	Reward prening - Francis, Rolls, et al. - 1998
1	Value-dependent selection in the brain: simulation in a - M - 1994
1	Spatial registration and normalisation - Frackowiak - 1995
1	Learning and The results from each subject were taken to the random effects selective attention - Dayan, Kakade, et al. - 2000