The role of visual processing in computational models of reading

  • Ya-Ning Chang

    Student thesis: Phd

    Abstract

    Visual processing is the earliest core process required to support a normal reading system. However, little attention has been given to its role in any of the existing cognitive/computational models of reading. The ultimate goal of this thesis is to create a large-scale model of reading, which can generate phonology and semantics from print. Building such a model will allow for the exploration of a number of theoretically important cognitive phenomena in both normal and impaired reading including: font and size invariance; letter confusability; length effects; and pure alexic reading patterns. To achieve this goal, there are a number of important sub-goals that need to be achieved: (1) to develop a visual processing component which is capable of recognising letters in different fonts and sizes; (2) to produce a model that can develop useful intermediate (orthographic) representations as a consequence of learning; (3) to develop a set of semantic representations compact enough to allow efficient learning but that can still capture realistic semantic similarity relationships; (4) to integrate all the components together into a large-scale recurrent reading model; and (5) to extend the model to support picture naming, and to explore whether damage to the visual system can produce symptoms similar to those found in PA patients. Chapter 2 started by developing a simple feedforward network for letter recognition. The model was trained with letters in various transformations, which allowed the model to learn to deal with size and shape invariance problems as well as accounting for letter confusability effects and generalising to previously unseen letters. The model achieved this by extracting key features from visual input which could be used to support accurate letter recognition. Chapter 3 incorporated the letter recognition component developed in Chapter 2 into a word reading model. The reading model was trained on the mappings between print and phonology, with the orthographic representations which learn to emerge over training. The model could support accurate nonword naming and simulated the length by lexicality interaction observed in normal reading. A system of semantic representations was developed in Chapter 4 by using co-occurrence statistics to generate semantic codes that preserved realistic similarity relationships. Chapter 5 integrated all the components developed in the previous chapters together into a large-scale recurrent reading model. Finally, Chapter 6 extended the reading model to perform object recognition along with the reading task. When the model's visual system was damaged it was able to simulate the abnormal length effect typically seen in PA patients. The damaged model also showed impaired reaction times in object naming and preserved sensitivity to lexical/semantic variables in reading. The picture naming performance was modulated by visual complexity. In summary, the results highlight the importance of incorporating visual information into computational models of single word reading, and suggest that doing so will enable the exploration of a wide range of effects that were previously inaccessible to these types of connectionist models.
    Date of Award1 Aug 2012
    Original languageEnglish
    Awarding Institution
    • The University of Manchester
    SupervisorStephen Welbourne (Supervisor) & Steve Furber (Supervisor)

    Keywords

    • Letter recognition
    • Reading
    • Pure alexia
    • VWFA
    • Semantic representation
    • PDP model
    • Computational Modelling
    • Visual processing
    • Length effect

    Cite this

    '