Error driven synapse augmented neurogenesis

Research output: Contribution to journalArticlepeer-review

13 Downloads (Pure)

Abstract

Capturing the learning capabilities of the brain has the potential to revolutionize artificial intelligence. Humans display an impressive ability to acquire knowledge on the fly and immediately store it in a usable format. Parametric models of learning, such as gradient descent, focus on capturing the statistical properties of a data set. Information is precipitated into a network through repeated updates of connection weights in the direction gradients dictate will lead to less error. This work presents the EDN (Error Driven Neurogenesis) algorithm which explores how neurogenesis coupled with non-linear synaptic activations enables a biologically plausible mechanism to immediately store data in a one-shot, online fashion and readily apply it to a task without the need for parameter updates. Regression (auto-mpg) test error was reduced more than 135 times faster and converged to an error around three times smaller compared to gradient descent using ADAM optimization. EDN also reached the same level of performance in wine cultivar classification 25 times faster than gradient descent and twice as fast when applied to MNIST and the inverted pendulum (reinforcement learning).
Original languageEnglish
Article number949707
Number of pages19
JournalFrontiers in Artificial Intelligence
Volume5
DOIs
Publication statusPublished - 28 Oct 2022

Keywords

  • classification
  • neurogenesis
  • one-shot
  • regression
  • reinforcement learning
  • synaptic activation

Fingerprint

Dive into the research topics of 'Error driven synapse augmented neurogenesis'. Together they form a unique fingerprint.

Cite this