Perceptual events derive their significance to an animal from their meaning about the world, that is from the information they carry about their causes. The brain should thus be able to efficiently infer the causes underlying our sensory events. Here we use multisensory cue combination to study causal inference in perception. We formulate an ideal-observer model that infers whether two sensory cues originate from the same location and that also estimates their location(s). This model accurately predicts the nonlinear integration of cues by human subjects in two auditory-visual localization tasks. The results show that indeed humans can efficiently infer the causal structure as well as the location of causes. By combining insights from the study of causal inference with the ideal-observer approach to sensory cue combination, we show that the capacity to infer causal structure is not limited to conscious, high-level cognition; it is also performed continually and effortlessly in perception.

The representation of value is a critical component of decision making. Rational choice theory assumes that options are assigned absolute values, independent of the value or existence of other alternatives. However, context-dependent choice behavior in both animals and humans violates this assumption, suggesting that biological decision processes rely on comparative evaluation. Here we show that neurons in the monkey lateral intraparietal cortex encode a relative form of saccadic value, explicitly dependent on the values of the other available alternatives. Analogous to extra-classical receptive field effects in visual cortex, this relative representation incorporates target values outside the response field and is observed in both stimulus-driven activity and baseline firing rates. This context-dependent modulation is precisely described by divisive normalization, indicating that this standard form of sensory gain control may be a general mechanism of cortical computation. Such normalization in decision circuits effectively implements an adaptive gain control for value coding and provides a possible mechanistic basis for behavioral contextdependent violations of rationality.

We examined strategies for classifying macaque vocalizations into their corresponding categories, as well as whether or not there was evidence that prefrontal auditory neurons were related to this process. We found that static estimates of the spectral and temporal contrasts of the calls were not effective features for discriminating among the call classes. A hidden Markov model (HMM), however, was more effective at discriminating among the call classes, reaching a performance of almost 75 % correct. Finally, we found that the responses of prefrontal auditory neurons could be predicted more effectively as linear functions of the probabilistic output of the HMM than as linear functions of the spectral features of the calls. This provides evidence that, for call recognition, the macaque auditory system likely performs dynamic processing of vocalizations, and that prefrontal auditory neurons carry a signal related to the output of this processing. Key words: prefrontal cortex; vocalizations; macaque; hidden Markov model; encoding; primate

Recent studies suggest that visual features are stored in working memory (WM) via sensory recruitment or sustained stimulus-specific patterns of activity in cortical regions that encode memoranda. One important question concerns the spatial extent of sensory recruitment. One possibility is that sensory recruitment is restricted to neurons that are retinotopically mapped to the positions occupied by the remembered items. Alternatively, specific feature values could be represented via a spatially global recruitment of neurons that encode the remembered feature, regardless of the retinotopic position of the remembered stimulus. Here, we evaluated these alternatives by requiring subjects to remember the orientation of a grating presented in the left or right visual field. Functional magnetic resonance imaging and multivoxel pattern analysis were then used to examine feature-specific activations in early visual regions during memory maintenance. Activation patterns that discriminated the remembered feature were found in regions of contralateral visual cortex that corresponded to the retinotopic position of the remembered item, as well as in ipsilateral regions that were not retinotopically mapped to the position of the stored stimulus. These results suggest that visual details are held in WM through a spatially global recruitment of early sensory cortex. This spatially global recruitment may enhance memory precision by facilitating robust population coding of the stored

Correlations among spikes, both on the same neuron and across neurons, are ubiquitous in the brain. For example cross-correlograms can have large peaks, at least in the periphery (Rodieck, 1967; Mastronarde, 1983a; Mastronarde, 1983b; Nirenberg et al., 2001; Dan et al., 1998), and smaller – but still non-negligible –