Clearspeech: A display reader for the visually handicapped

Tim Morris; Paul Blenkhorn; Luke Crossey; Quang Ngo; Martin Ross; David Werner; Christina Wong

doi:10.1109/TNSRE.2006.881538

Clearspeech: A display reader for the visually handicapped

Tim Morris, Paul Blenkhorn, Luke Crossey, Quang Ngo, Martin Ross, David Werner, Christina Wong

Research output: Contribution to journal › Article › peer-review

Abstract

Many domestic appliances and much office equipment is controlled using a keypad and a small digital display. Programming such devices is problematical for the blind and visually handicapped. In this paper, we describe a device that may be used to read the displays on these devices. The device is designed to accept a description of the display being read, which specifies the types and locations of elements of the display. Images are captured using a handheld webcam. Images are processed to remove the distortions due to the camera orientation. The elements of the screen are interpreted and a suitable audio output is generated. In suitably illuminated scenes, the display data is interpreted correctly in approximately 90% of the cases investigated. © 2006 IEEE.

Original language	English
Article number	11
Pages (from-to)	492-500
Number of pages	8
Journal	IEEE Transactions on Neural Systems and Rehabilitation Engineering
Volume	14
Issue number	4
DOIs	https://doi.org/10.1109/TNSRE.2006.881538
Publication status	Published - Dec 2006

Keywords

Assistive devices
Audio interpretation
Display reader

Access to Document

10.1109/TNSRE.2006.881538

Cite this

@article{3febc46cf6384703a12471e05a217181,

title = "Clearspeech: A display reader for the visually handicapped",

abstract = "Many domestic appliances and much office equipment is controlled using a keypad and a small digital display. Programming such devices is problematical for the blind and visually handicapped. In this paper, we describe a device that may be used to read the displays on these devices. The device is designed to accept a description of the display being read, which specifies the types and locations of elements of the display. Images are captured using a handheld webcam. Images are processed to remove the distortions due to the camera orientation. The elements of the screen are interpreted and a suitable audio output is generated. In suitably illuminated scenes, the display data is interpreted correctly in approximately 90% of the cases investigated. {\textcopyright} 2006 IEEE.",

keywords = "Assistive devices, Audio interpretation, Display reader",

author = "Tim Morris and Paul Blenkhorn and Luke Crossey and Quang Ngo and Martin Ross and David Werner and Christina Wong",

year = "2006",

month = dec,

doi = "10.1109/TNSRE.2006.881538",

language = "English",

volume = "14",

pages = "492--500",

journal = "IEEE Transactions on Neural Systems and Rehabilitation Engineering",

issn = "1534-4320",

publisher = "IEEE",

number = "4",

}

TY - JOUR

T1 - Clearspeech: A display reader for the visually handicapped

AU - Morris, Tim

AU - Blenkhorn, Paul

AU - Crossey, Luke

AU - Ngo, Quang

AU - Ross, Martin

AU - Werner, David

AU - Wong, Christina

PY - 2006/12

Y1 - 2006/12

N2 - Many domestic appliances and much office equipment is controlled using a keypad and a small digital display. Programming such devices is problematical for the blind and visually handicapped. In this paper, we describe a device that may be used to read the displays on these devices. The device is designed to accept a description of the display being read, which specifies the types and locations of elements of the display. Images are captured using a handheld webcam. Images are processed to remove the distortions due to the camera orientation. The elements of the screen are interpreted and a suitable audio output is generated. In suitably illuminated scenes, the display data is interpreted correctly in approximately 90% of the cases investigated. © 2006 IEEE.

AB - Many domestic appliances and much office equipment is controlled using a keypad and a small digital display. Programming such devices is problematical for the blind and visually handicapped. In this paper, we describe a device that may be used to read the displays on these devices. The device is designed to accept a description of the display being read, which specifies the types and locations of elements of the display. Images are captured using a handheld webcam. Images are processed to remove the distortions due to the camera orientation. The elements of the screen are interpreted and a suitable audio output is generated. In suitably illuminated scenes, the display data is interpreted correctly in approximately 90% of the cases investigated. © 2006 IEEE.

KW - Assistive devices

KW - Audio interpretation

KW - Display reader

U2 - 10.1109/TNSRE.2006.881538

DO - 10.1109/TNSRE.2006.881538

M3 - Article

VL - 14

SP - 492

EP - 500

JO - IEEE Transactions on Neural Systems and Rehabilitation Engineering

JF - IEEE Transactions on Neural Systems and Rehabilitation Engineering

SN - 1534-4320

IS - 4

M1 - 11

ER -

Clearspeech: A display reader for the visually handicapped

Abstract

Keywords

Access to Document

Fingerprint

Cite this