this paper is to present such a reformulation. The cell assembly provides the cognitive system with flexibility far beyond the simple activation of concepts. Instead of viewing the assembly as simply active or latent we see the activation of the assembly as coming in a series of phases. Each phase of activity serves a different purpose, giving the theory the power and flexibility to handle a wide range of psychological data.

minicolumns, forgetting, incremental learning, reaction time Summary: During the last few decades we have seen a convergence among ideas and hypotheses regarding functional principles underlying human memory. Hebb’s now more than fifty years old conjecture concerning synaptic plasticity and cell assemblies, formalized mathematically as attractor neural networks, has remained among the most viable and productive theoretical frameworks. It suggests plausible explanations for Gestalt aspects of active memory like perceptual completion, reconstruction and rivalry. We review the biological plausibility of these theories and discuss some critical issues concerning their associative memory functionality in the light of simulation studies of models with palimpsest memory properties. The focus is on memory properties and dynamics of networks modularized in terms of cortical minicolumns and hypercolumns. Biophysical compartmental models demonstrate attractor dynamics that support cell assembly operations with fast convergence and low firing rates. Using a scaling model we obtain reasonable relative connection densities and amplitudes. An abstract attractor network model reproduces systems level psychological phenomena seen in human memory experiments as the Sternberg and von Restorff effects. We conclude that there is today considerable substance in Hebb's theory of cell assemblies and its attractor network formulations, and that they have contributed to increasing our understanding of cortical associative memory function. The criticism raised with regard to biological and psychological plausibility as well as low storage capacity, slow retrieval etc has largely been disproved. Rather, this paradigm has gained further support from new experimental data as well as computational modeling.

Abstract. Different models of attractor networks have been proposed to form cell assemblies. Among them, networks with a fixed synaptic matrix can be distinguished from those including learning dynamics, since the latter adapt the attractor landscape of the lateral connections according to the statistics of the presented stimuli, yielding a more complex behavior. We propose a new learning rule that builds internal representations of input timuli as attractors of neurons in a recurrent network. The dynamics of activation and synaptic adaptation are analyzed in experiments where representations for different input patterns are formed, focusing on the properties of the model as a memory system. The experimental results are exposed along with a survey of different Hebbian rules proposed in the literature for attractors formation. These rules are compared with the help of a new tool, the learning map, where LTP and LTD, as well as homo- and heterosynaptic competition, can be graphically interpreted.

On behalf of:

In this review, models of cortical associative memory with a background in Hebb's cell assembly hypothesis will be discussed. One mathematical realization of a Hebbian cell assembly is a recurrent artificial neural network. These recurrent attractor networks have several favorable features when used as models of cortical associative memory and they have been used to describe several cortical functions including models of olfactory and motor cortex, EEG and field potentials, psychology of memory retrieval and language deficits.

Abstract The brain processes underlying cognitive tasks must be very robust. Disruptions such as the destruction of large numbers of neurons, or the impact of alcohol and lack of sleep do not have negative effects except when they occur in an extreme form. This robustness implies that the parameters determining the functioning of networks of individual neurons must have large ranges or there must exist stabilizing mechanisms that keep the functioning of a network within narrow bounds. The simulation of a minimal neuronal architecture necessary to study cognitive tasks is described, which consists of a loop of three cellassemblies. A crucial factor in this architecture is the critical threshold of a cell-assembly. When activated at a level above the critical threshold, the activation in a cellassembly is subject to autonomous growth, which leads to an oscillation in the loop. When activated below the critical threshold, excitation gradually extinguishes. In order to circumvent the large parameter space of spiking neurons, a rate-dependent model of neuronal firing was chosen. The resulting parameter space of 12 parameters was explored by means of a genetic algorithm. The ranges of the parameters for which the architecture produced the required oscillations and extinctions, turned out to be relatively narrow. These ranges remained narrow when a stabilizing mechanism, controlling the total amount of activation, was introduced. The architecture thus shows chaotic behaviour. Given the overall stability of the operation of the brain, it can be concluded that there must exist other mechanisms that make the network robust. Three candidate mechanisms are discussed: synaptic scaling, synaptic homeostasis, and the synchronization of neural spikes.