. A computational model of hippocampal activity during spatial cognition and navigation tasks is presented. The spatial representation in our model of the rat hippocampus is built on-line during exploration via two processing streams. An allothetic vision-based representation is built by unsupervised Hebbian learning extracting spatio-temporal properties of the environment from visual input. An idiothetic representation is learned based on internal movement-related information provided by path integration. On the level of the hippocampus, allothetic and idiothetic representations are integrated to yield a stable representation of the environment by a population of localized overlapping CA3-CA1 place fields. The hippocampal spatial representation is used as a basis for goal-oriented spatial behavior. We focus on the neural pathway connecting the hippocampus to the nucleus accumbens. Place cells drive a population of locomotor action neurons in the nucleus accumbens. Reward-based learnin...

We are capable of drawing a variety of inferences effortlessly, spontaneously, and with remarkable efficiency — as though these inferences are a reflex response of our cognitive apparatus. This remarkable human ability poses a challenge for cognitive science and computational neuroscience: How can a network of slow neuron-like elements represent a large body of systematic knowledge and perform a wide range of inferences with such speed? The connectionist model Shruti attempts to address this challenge by demonstrating how a neurally plausible network can encode a large body of semantic and episodic facts, systematic rules, and knowledge about entities and types, and yet perform a wide range of explanatory and predictive inferences within a few hundred milliseconds. Relational structures (frames, schemas) are represented in Shruti by clusters of cells, and inference in Shruti corresponds to a transient propagation of rhythmic activity over such cell-clusters wherein dynamic bindings are represented by the synchronous firing of appropriate cells. Shruti encodes mappings across relational structures using high-efficacy links that enable the propagation of rhythmic activity, and it encodes items in long-term memory as coincidence and conincidence-error detector circuits that become active in response to the occurrence (or non-occurrence) of appropriate coincidences in the on going flux of rhythmic activity.

We present a computational neural network model of recognition memory based on the biological structures of the hippocampus and medial temporal lobe cortex (MTLC), which perform complementary learning functions. The hippocampal component of the model contributes to recognition by recalling specific studied details. MTLC can not support recall, but it is possible to extract a scalar familiarity signal from MTLC that tracks how well the test item matches studied items. We present simulations that establish key qualitative differences in the operating characteristics of the hippocampal recall and MTLC familiarity signals, and we identify several manipulations (e.g., target-lure similarity, interference) that differentially affect the two signals. We also use the model to address the stochastic relationship between recall and familiarity (i.e., are they independent), and the effects of partial vs. complete hippocampal

Hippocampal ‘place ’ cells and the head-direction cells of the dorsal presubiculum and related neocortical and thalamic areas appear to be part of a preconfigured network that generates an abstract internal representation of two-dimensional space whose metric is self-motion. It appears that viewpoint-specific visual information (e.g. landmarks) becomes secondarily bound to this structure by associative learning. These associations between landmarks and the preconfigured path integrator serve to set the origin for path integration and to correct for cumulative

Using experimental facts about long-term potentiation (LTP) and hippocampal place cells, we model how a spatial map of the environment can be created in the rat hippocampus. Sequential firing of place cells during exploration induces, in the model, a pattern of LTP between place cells that shifts the location coded by their ensemble activity away from the actual location of the animal. These shifts provide a navigational map that, in a simulation of the Morris maze, can guide the animal toward its goal. The model demonstrates how behaviorally generated modifications of synaptic strengths can be read out to affect subsequent behavior. Our results also suggest a way that navigational maps can be constructed from experimental recordings of hippocampal place cells. *Current address: Dept. of Brain and Cognitive Sciences, MIT E25-236, 45 Carlton St., Cambridge, MA 02139. Blockade of long term potentiation (LTP) and hippocampal lesions drastically impair

The concepts of declarative memory and procedural memory have been used to distinguish two basic types of learning. A neural network model suggests how such memory processes work together as recognition learning, reinforcement learning, and sensory-motor learning take place during adaptive behaviors. To coordinate these processes, the hippocampal formation and cerebellum each contain circuits that learn to adaptively time their outputs. Within the model, hippocampal timing helps to maintain attention on motivationally salient goal objects during variable task-related delays, and cerebellar timing controls the release of conditioned responses. This property is part of the model's description of how cognitive-emotional interactions focus attention on motivationally valued cues, and how this process breaks down due to hippocampal ablation. The model suggests that the hippocampal mechanisms that help to rapidly draw attention to salient cues could prematurely release motor commands were no...

We present a purely vision-based scheme for learning a parsimonious representation of an open environment. Using simple exploration behaviours, our system constructs a graph of appropriately chosen views. To navigate between views connected in the graph, we employ a homing strategy inspired by findings of insect ethology. Simulations and robot experiments demonstrate the feasibility of the proposed approach. Introduction 1 To survive in unpredictable and sometimes hostile environments animals have developed powerful strategies to find back to their shelter or to a previously visited food source. Successful navigation can already be achieved using simple mechanisms such as association of landmarks with movements (Wehner et al. 1996) or tracking of environmental features (Collett 1996). To understand more complex forms of spatial behaviour like finding shortcuts, however, we have to go beyond reactive control strategies, towards systems with internal states. In as far as they ...

The CA3 network in the hippocampus may operate as an autoassociator, in which declarative memories, known to be dependent on hippocampal processing, could be stored, and subsequently retrieved, using modifiable synaptic efficacies in the CA3 recurrent collateral system. On the basis of this hypothesis, the authors explore the computational relevance of the extrinsic afferents. to the CA3 network. A quantitative statistical analysis of the information that may be relayed by such afferent connections reveals the need for two distinct systems of input synapses. The synapses of the first system need to be strong (but not associatively modifiable) in order to force, during learning, the CA3 cells into a pattern of activity relatively independent of any inputs being received from the recurrent collaterals, and which thus reflects sizable amounts of new information. It is proposed that the mossy fiber system performs this function. A second system, with a large number of associatively modifiable synapses on each receiving cell, is needed in order to relay a signal specific enough to initiate the retrieval process. This may be identified, we propose, with the perforant path input to CA3. Key words: hippocampus, autoassociative memory, attractor neural networks, associative synapses, information storage

ABSTRACT: This paper presents a model of how hippocampal place cells might be used for spatial navigation in two watermaze tasks: the standard reference memory task and a delayed matching-to-place task. In the reference memory task, the escape platform occupies a single location and rats gradually learn relatively direct paths to the goal over the course of days, in each of which they perform a fixed number of trials. In the delayed matching-to-place task, the escape platform occupies a novel location on each day, and rats gradually acquire one-trial learning, i.e., direct paths on the second trial of each day. The model uses a local, incremental, and statistically efficient connectionist algorithm called temporal difference learning in two distinct components. The first is a reinforcement-based ‘‘actor-critic’ ’ network that is a general model of classical and instrumental conditioning. In this case, it is applied to navigation, using place cells to provide information about state. By itself, the actor-critic can learn the reference memory task, but this learning is inflexible to changes to the platform location. We argue that one-trial learning in the delayed matching-to-place task demands a goal-independent representation of space. This is provided by the second component of the model: a network that uses temporal difference learning and selfmotion information to acquire consistent spatial coordinates in the environment. Each component of the model is necessary at a different stage of the task; the actor-critic provides a way of transferring control to the component that performs best. The model successfully captures gradual acquisition in both tasks, and, in particular, the ultimate development of one-trial learning in the delayed matching-to-place task. Place cells report a form of stable, allocentric information that is well-suited to the various kinds of learning in the model. Hippocampus 2000;10:1–16.

Two studies invesligated updaling q[' se!f-position and heading dwinx real. imagined, wld simuh#ed locomotion. Snl/ects wel'e e.-los('d to (1 IWO-S(',k qHellt pttl]l with a titI'll between segnlentx.' they ,.ponded by tin'rang to,bee the ori,,in as they would if they had walked the path }nd were at the end ' the second stsment. The conalllions q['pathwG eA7oaw'e int htded physical walking. intaxined ,valking j)'om a verbal description. watchbtg another person wall and eperiencing optic flow that simulated walkinx. with or without a phys- ical turn between the path segments. tf .sldgects fitlied to npdaw an internal representation g' heading, but did encode tile pathway tl'ajeo tory. they xhottkl httve overturlcd hv the magnitltde 'the turn between the patJ segments. 5nch svslemalic overturnbig was ./bund in the description and watching comlitions, but not with physical walking. Simulated optic flow was not by itse'sttt'ient to induce spatial ttpdat- ing j/tat supported correct turn t'espon.cs+ An important component of navigation is updating knowledge of one's spatial position and orientation. People navigating on foot receive multiple cues for updating, Vision signals sclf-nolion by the changing positions of distal landmarks and by the optic flow teld. Proprioception (including veslibt, lar sensing as well as kines- hetic feedback from muscles. tendons. and joints) provides cues to the navigator's velocity and acceleration. In 1he research reported here, we asked how well people update heir inlernal representation of location and orientation as they rave[ in space under conditions in which these cues are reduced or unavailable, including conditions in which they do not physically move at all. The conditions examined included wafking without vision (proprioceplive cues...