Sparse distributed memory using rank-order neural codes

Stephen B. Furber, Gavin Brown, Joy Bose, John Michael Cumpstey, Peter Marshall, Jonathan L. Shapiro

Research output: Contribution to journalArticlepeer-review

Abstract

A variant of a sparse distributed memory (SDM) is shown to have the capability of storing and recalling patterns containing rank-order information. These are patterns where information is encoded not only in the subset of neuron outputs that fire, but also in the order in which that subset fires. This is an interesting companion to several recent works in the neuroscience literature, showing that human memories may be stored in terms of neural spike timings. In our model, the ordering is stored in static synaptic weights using a Hebbian single-shot learning algorithm, and can be reliably recovered whenever the associated input is supplied. It is shown that the memory can operate using only unipolar binary connections throughout. The behavior of the memory under noisy input conditions is also investigated. It is shown that the memory is capable of improving the quality of the data that passes through it. That is, under appropriate conditions the output retrieved from the memory is less noisy than the input used to retrieve it. Thus, this memory architecture could be used as a component in a complex system with stable noise properties and, we argue, it can be implemented using spiking neurons. © 2007 IEEE.
Original languageEnglish
Pages (from-to)648-659
Number of pages11
JournalIEEE Transactions on Neural Networks
Volume18
Issue number3
DOIs
Publication statusPublished - May 2007

Keywords

  • Associative memory
  • Neural networks (NNs)
  • Rank-order codes
  • Sparse distributed memory (SDM)
  • Spiking neurons

Fingerprint

Dive into the research topics of 'Sparse distributed memory using rank-order neural codes'. Together they form a unique fingerprint.

Cite this