An exploration of the other side of semantic communication: How the spontaneous movements of the human hand add crucial meaning to narrative

Past research has suggested that those spontaneous movements of the human hand made during talk convey significant semantic information over and above the speech, at least when the unit of speech analyzed is the individual clause. However, no previous research has tested whether this information is represented linguistically elsewhere in the narrative (or is directly inferable from the rest of the narrative). The first study, reported here, uses an experimental procedure to identify which specific imagistic gestures add semantic information to the speech. The second study analyzes whether the specific gestures still do this when respondents hear the whole narrative. It was found that two thirds of the semantic information, thought to be carried by the gestures, is, in fact, represented in the linguistic discourse, or is inferable from it. However, one third of the additional semantic information contained in the gestures is not represented linguistically in the narrative nor is it inferable from it. In other words, a proportion of the imagistic gestures that accompany speech are absolutely critical to semantic communication. © Walter de Gruyter.