We develop a theoretical framework that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations. In particular, we show how activity in the cerebral cortex can make predictions about future receipt of reward and how fluctuations in the activity levels of neurons in diffuse dopamine systems above and below baseline levels would represent errors in these predictions that are delivered to cortical and subcottical targets. We present a model for how such errors could be constructed in a real brain that is consistent with physiological results for a subset of dopaminergic neurons located in the ventral tegmental area and surrounding dopaminergic neurons. The theory also makes testable predictions about human choice behavior on a simple decision-making task. Furthermore, we show that, through a simple influence on synaptic plasticity, fluctuations in dopamine release can act to change the predictions in an appropriate manner. Key words: prediction; dopamine; diffuse ascending systems; synaptic plasticity; reinforcement learning; reward In mammals, mesencephalic dopamine neurons participate in a number of important cognitive and physiological functions including motivational processes (Wise, 1982; Fibiger and Phillips, 1986; Koob and Bloom, 1988) reward processing (Wise, 1982) working

Neurons in the visual cortex of monkeys respond selectively to the disparity between the images in the two eyes. Recent recordings have shown that some of the disparity-selective neurons in the primary visual cortex and the posterior parietal cortex are modulated by the distance of fixation. A population of such gain-modulated, disparity-selective neurons forms a set of basis functions of horizontal disparity and distance of fixation that can be used as an intermediate representation for computing egocentric distance. This distributed representation is consistent with psychophysical studies of human depth perception; in contrast, neurons explicitly tuned to distance are not consistent with how we perceive distance. In a population model that includes noise in the firing rates of neurons, the perceived distance is

There exist a large number of visual illusions indicating that perception differs from pure representation of physical input. For example, a spot of light can be characterized by its position, but it does not contribute any information about orientation. However, when moved fast enough, a continuous streak along its trajectory is perceived that helps to determine the orientation of the movement path. The question arises whether the processing of the trajectory and its orientation are simultaneously represented in the primary visual cortex. Here I show A fast-moving spot of light produces a continuous streak along its trajectory that can be used to extract orientation information (Geisler, 1999). Although motion streaks should hamper a clear perception of an object’s actual position, there is opposite evidence that the visual system contains mechanisms to “deblur” motion smear (Burr, 1980; Castet, 1994). To solve the apparent

Undulatory locomotion is common to nematodes as well as to limbless vertebrates, but its control is not understood in spite of the identification of hundred of genes involved in Caenorhabditis elegans locomotion. To reveal the mechanisms of nematode undulatory locomotion, we quantitatively analyzed the movement of C. elegans with genetic perturbations to neurons, muscles, and skeleton (cuticle). We also compared locomotion of different Caenorhabditis species. We constructed a theoretical model that combines mechanics and biophysics, and that is constrained by the observations of propulsion and muscular velocities, as well as wavelength and amplitude of undulations. We find that normalized wavelength is a conserved quantity among wild-type C. elegans individuals, across mutants, and across different species. The velocity of forward propulsion scales linearly with the velocity of the muscular wave and the corresponding slope is also a

Are there general principles for pattern generation? We examined this question by analyzing the operation of large populations of evolved model central pattern generators (CPGs) for walking. Three populations of model CPGs were evolved, containing three, four, or five neurons. We identified six general principles. First, locomotion performance increased with the number of interneurons. Second, the top 10 three-, four-, and fiveneuron CPGs could be decomposed into dynamical modules, an abstract description developed in a companion article. Third, these dynamical modules were multistable: they could be switched between multiple stable output configurations. Fourth, the rhythmic pattern generated by a CPG could be understood as a closed chain of successive destabilizations of one dynamical module by another. A combinatorial analysis enumerated the possible dynamical modular structures. Fifth, one-dimensional modules were frequently observed and, in some cases, could be assigned specific functional roles. Finally, dynamic dynamical modules, in which the modular structure itself changed over one cycle, were frequently observed. The existence of these general principles despite significant variability in both patterns of connectivity and neural parameters was explained by degeneracy in the maps from neural parameters to neural dynamics to behavior to fitness. An analysis of the biomechanical properties of the model body was essential for relating neural activity to behavior. Our studies of evolved model circuits suggest that, in the absence of other constraints, there is no compelling reason to expect neural circuits to be functionally decomposable as the number of interneurons increase. Analyzing idealized model pattern generators may be an effective methodology for gainin...

"Learningu is a term used to describe a wide range of adaptive animal behaviors. The focus of studies on the neural substrates for these behaviors is generally at the cellular and molecular levels. An animal's behavior, however, is the result