Live demonstration: CNN inference on the focal plane with a pixel processor array

Stephen J. Carey, Laurie Bose, Thomas Richardson, Walterio Mayol-Cuevas, Jianing Chen, Piotr Dudek

Research output: Chapter in Book/Report/Conference proceedingChapterpeer-review

Abstract

We present a novel method of CNN inference on a pixel processor array device, demonstrating it using a handwritten digit (digits 0-9) classification task, with all steps of the neural network computation performed on the focal plane. The vision chip that we deploy (SCAMP-7) has a 256x256 array of processor elements (PE) integrated within the image sensor. The algorithm runs at over 3000 frames per second (FPS) and over 90% classification accuracy, with the sensor chip only outputting ten scalar values corresponding to the classification scores.
Original languageEnglish
Title of host publication52nd IEEE International Symposium on Circuits and Systems, ISCAS 2020; Virtual, Online
Place of Publication[Seville, Spain]
PublisherIEEE
Number of pages1
ISBN (Print)9781728133201
DOIs
Publication statusPublished - Oct 2020

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
Volume2020-October

Fingerprint

Dive into the research topics of 'Live demonstration: CNN inference on the focal plane with a pixel processor array'. Together they form a unique fingerprint.

Cite this