Comparison of Artificial and Spiking Neural Networks on Digital Hardware

Research output: Contribution to journalArticlepeer-review

144 Downloads (Pure)

Abstract

Despite the success of Deep Neural Networks—a type of Artificial Neural Network (ANN)—in problem domains such as image recognition and speech processing, the energy and processing demands during both training and deployment are growing at an unsustainable rate in the push for greater accuracy. There is a temptation to look for radical new approaches to these applications, and one such approach is the notion that replacing the abstract neuron used in most deep networks with a more biologically- plausible spiking neuron might lead to savings in both energy and resource cost. The most common spiking networks use rate-coded neurons for which a simple translation from a pre-trained ANN to an equivalent spike-based network (SNN) is readily achievable. But does the spike-based network offer an improvement of energy efficiency over the original deep network? In this work, we consider the digital implementations of the core steps in an ANN and the equivalent steps in a rate-coded spiking neural network. We establish a simple method of assessing the relative advantages of rate-based spike encoding over a conventional ANN model. Assuming identical underlying silicon technology we show that most rate-coded spiking network implementations will not be more energy or resource efficient than the original ANN, concluding that more imaginative uses of spikes are required to displace conventional ANNs as the dominant computing framework for neural computation.
Original languageEnglish
Article number651141
Pages (from-to)651141
Number of pages7
JournalFrontiers in Neuroscience
Volume15
DOIs
Publication statusPublished - 6 Apr 2021

Keywords

  • artificial neural network
  • deep neural network
  • neuromorphic hardware
  • rate-based encoding
  • spiking neural network

Fingerprint

Dive into the research topics of 'Comparison of Artificial and Spiking Neural Networks on Digital Hardware'. Together they form a unique fingerprint.

Cite this