TY - GEN
T1 - Pixel Processor Arrays For Low Latency Gaze Estimation
AU - Bose, Laurie
AU - Chen, Jianing
AU - Carey, Stephen J.
AU - Dudek, Piotr
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022/3
Y1 - 2022/3
N2 - We demonstrate the use of a Pixel Processor Array (PPA) vision sensor for achieving rates of over 10,000 Hz, with processing latency below 0.1 ms, in a gaze tracking application, performing image processing directly upon the sensor itself with minimal external computation. Each pixel processing element of the PPA sensor is capable of light sensing, data storage and computation, allowing various visual processing to be performed efficiently at the point of light capture. We demonstrate how information such as pupil location, size, and LED reflections upon the eye's surface can be extracted by the PPA, along with a simple gaze tracker using pupil location. By extracting such information directly on-sensor, the data needing to be transferred from sensor to external processing is reduced from entire images to a hand-full of contextual bytes, this provides significant saving in terms of power, time and allows for frame-rates far exceeding traditional camera sensors.
AB - We demonstrate the use of a Pixel Processor Array (PPA) vision sensor for achieving rates of over 10,000 Hz, with processing latency below 0.1 ms, in a gaze tracking application, performing image processing directly upon the sensor itself with minimal external computation. Each pixel processing element of the PPA sensor is capable of light sensing, data storage and computation, allowing various visual processing to be performed efficiently at the point of light capture. We demonstrate how information such as pupil location, size, and LED reflections upon the eye's surface can be extracted by the PPA, along with a simple gaze tracker using pupil location. By extracting such information directly on-sensor, the data needing to be transferred from sensor to external processing is reduced from entire images to a hand-full of contextual bytes, this provides significant saving in terms of power, time and allows for frame-rates far exceeding traditional camera sensors.
KW - Communication hardware
KW - Hardware
KW - Human computer interaction (HCI)
KW - Human-centered computing
KW - Interaction paradigms
KW - interfaces and storage
KW - Sensors and actuators
KW - Virtual reality
UR - https://www.scopus.com/pages/publications/85129634620
U2 - 10.1109/VRW55335.2022.00336
DO - 10.1109/VRW55335.2022.00336
M3 - Conference contribution
AN - SCOPUS:85129634620
T3 - Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022
SP - 970
EP - 971
BT - Proceedings - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022
PB - IEEE
T2 - 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2022
Y2 - 12 March 2022 through 16 March 2022
ER -