Abstract

Schultz, Wolfram. Predictive reward signal of dopamine neurons. is called rewards, which elicit and reinforce approach behav-J. Neurophysiol. 80: 1–27, 1998. The effects of lesions, receptor ior. The functions of rewards were developed further during blocking, electrical self-stimulation, and drugs of abuse suggest the evolution of higher mammals to support more sophistithat midbrain dopamine systems are involved in processing reward cated forms of individual and social behavior. Thus biologiinformation and learning approach behavior. Most dopamine neucal and cognitive needs define the nature of rewards, and rons show phasic activations after primary liquid and food rewards and conditioned, reward-predicting visual and auditory stimuli. the availability of rewards determines some of the basic They show biphasic, activation-depression responses after stimuli parameters of the subject’s life conditions. that resemble reward-predicting stimuli or are novel or particularly Rewards come in various physical forms, are highly variable salient. However, only few phasic activations follow aversive stim-in time and depend on the particular environment of the subject. uli. Thus dopamine neurons label environmental stimuli with appe- Despite their importance, rewards do not influence the brain titive value, predict and detect rewards and signal alerting and motivating events. By failing to discriminate between different

Citations

1446	A new approach to linear filtering and prediction problems - Kalman - 1960
447	Adaptive switching circuits - Widrow, Ho€ - 1960
156	A theory of cerebellar cortex - Marr - 1969
35	Reward expectancy in primate prefrontal neurons. Nature 382, 629–632. (doi:10.1038/382629a0 - Watanabe - 1996
31	An identified neuron mediates the unconditioned stimulus in associative olfactory learning in honeybees. Nature 366: 59–63 - Hammer - 1993
29	Value-dependent selection in the brain: simulation in a synthetic neural model. Neuroscience 59 - KJ, Tononi, et al. - 1994
28	The Wisconsin Card Sorting Test: theoretical analysis and modeling in a neuronal network - Dehaene, Changeux - 1991
18	FE: Impulse activity of locus coeruleus neurons in awake rats and monkeys is a function of sensory stimulation and arousal - SL, Aston-Jones, et al. - 1980
18	AA: Phasic versus tonic dopamine release and the modulation of dopamine system responsivity: a hypothesis for the etiology of schizophrenia. Neuroscience - Grace - 1991
17	CS-US interval and US intensity in classical conditioning of the rabbit's nictitating membrane response - Smith - 1968
14	Responses to reward in monkey dorsal and ventral striatum. Exp Brain Res - Apicella, Ljungberg, et al. - 1991
14	Neuronal activity in monkey striatum related to the expectation of predictable environmental events - Apicella, Scarnati, et al. - 1992
14	Neuroleptics and operant behavior: The anhedonia hypothesis - Wise - 1982
12	Arbib, “A model of primate visual-motor conditional learning - Fagg, A - 1992
11	Input–output organization of the sensorimotor striatum in the squirrel monkey - Flaherty, Graybiel - 1994
11	Tyrosine hydroxylase-immunoreactive boutons in synaptic contact with identified striatonigral neurons, with particular reference to dendritic spines - Freund, Powell, et al. - 1984
11	Prolonged and extrasynaptic excitatory action of dopamine mediated by Dl receptors in the rat striatum in vivo - Gonon - 1997
11	H: Mesocorticolimbic dopaminergic network: functional and regulatory roles. Physiol Rev 71 - MOAL, SIMON - 1991
10	Regional and laminar distribution of the dopamine and serotonin innervation in the macaque cerebral cortex: a radioautographic study - Berger, Trottier, et al. - 1988
10	The role of dopamine in drug abuse viewed from the perspective of its role in motivation. Drug and Alcohol Dependence - Chiara - 1995
10	Response to novelty and its rapid habituation in locus coeruleus neurons of the freely exploring rat - Vankov, Hervé-Minvielle, et al. - 1995
9	Dopaminergic antagonists prevent long-term maintenance of posttetanic LTP in the CA1 region of rat hippocampal slices - Frey, Schroeder, et al. - 1990
8	Cognitive deficit caused by regional depletion of dopamine in prefrontal cortex of rhesus monkey. Science 205: 929–932 - BROZOSKI, BROWN, et al. - 1979
8	Prefrontal unit activity during associative learning in the monkey - Watanabe - 1990
8	Neuronal responses in the ventral striatum of the behaving macaque - Williams, Rolls, et al. - 1993
7	Tonically discharging neurons of monkey striatum respond to preparatory and rewarding stimuli - Apicella, Scarnati, et al. - 1991
7	Modeling the roles of basal ganglia in timing and sequencing saccadic eye movements - Arbib, Dominey - 1995
7	Abnormal influences of passive limb movement on the activity of globus pallidus neurons in parkinsonian monkeys - Filion, Tremblay, et al. - 1988
7	Total number of neurons in the neostriatal, pallidal, subthalamic, and substantia nigral nuclei of the rat basal ganglia: A stereological study using the cavalieri and optical disector methods - Oorschot - 1996
7	Dorsal accessory inferior olive activity diminishes during acquisition of the rabbit classically conditioned eyelid response - Sears, Steinmetz - 1991
7	Concentration-dependent actions of stimulated dopamine release on neuronal activity in rat striatum - Williams, Millar - 1990
6	Differential effect of stress on in vivo dopamine release in striatum, nucleus accumbens, and medial prefrontal cortex - Abercrombie, Keefe, et al. - 1989
6	Intracranial self-stimulation in relation to the ascending dopaminergic systems of the midbrain: a moveable electrode mapping study - Corbett, Wise - 1980
6	Relations between movement and single cell discharge in the substantia nigra of the behaving monkey - Delong, Crutcher, et al. - 1983
6	An autoradiographic analysis of the efferent connections from premotor and adjacent prefrontal regions (areas 6 - Kunzle - 1978
6	The appropriateness of behavioral responses coded in post-trial activity of primate prefrontal units. Neurosci Lett - Watanabe - 1989
6	Neuroleptic-induced ”anhedonia” in rats: Pimozide blocks reward quality of food - Wise, Spindler, et al. - 1978
5	Reinforcement, expectancy, and learning - Bolles - 1972
5	Two input systems for body representations in the primate striatal matrix: experimental evidence in the squirrel monkey - FLAHERTY, A - 1993
5	On the cerebellum and motor - LLINAS, P - 1993
5	GABA A receptormediated inhibition of rat substantia nigra dopaminergic neurons by pars reticulata projection neurons - Tepper, Martin, et al. - 1995
5	Associative learning in degenerative neostriatal disorders: contrasts in explicit and implicit remembering between Parkinson's and Huntington's diseases - Sprengelmeyer, Canavan, et al. - 1995
5	Memory for temporal order and conditional associative-learning in patients with Parkinson’s disease. Neuropsychologia 28: 1283–1293 - Vriezen, Moscovitch - 1990
5	Neuronal responses related to reinforcement in the primate basal forebrain. Brain Res. 509: 213–231 - Wilson, Rolls - 1990
4	Depletion of dopamine in the caudate nucleus but not in nucleus accumbens impairs reaction-time performance in rats - Amalric, Koob - 1987
4	Synaptic plasticity in the caudate nucleus of patients with Parkinson’s disease. Neurodegeneration 5: 121–128 - ANGLADE, MOUATT-PRIGENT, et al. - 1996
4	cellular and subcellular variations in the distribution of D1 and D5 dopamine receptors in primate brain - BERGSON, MRZLJAK, et al. - 1995
4	Neuropsychological interpretation of the effects of drive and incentive-motivation on general activity and instrumental behavior. Psychol Rev 75 - Bindra - 1968
4	Neural signals in the monkey ventral striatum related to motivation for juice and cocaine rewards - Bowman, Aigner, et al. - 1996
4	Chemical and structural analysis of the relation between cortical inputs and tyrosine hydroxylase-containing terminals in rat neostriatum. Brain Res. 302: 267–275 - Bouyer, Park, et al. - 1984