We see what we hear; sometimes we hear what we see
Keywords
No Thumbnail Available
Authors
Issue Date
2022-10-31
Language
en
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
What we hear is not always what we see. Speech and gestures are known to be integrated in speech production and perception. The present study explores the perception of lexical stress in Dutch: 1) to what extent visual articulatory cues and beat gestures are used in clear speech perception; 2) to what extent visual articulatory cues are used in degraded speech perception. The results of Experiment 1 are aligned with previous studies that beat gestures, not visual articulatory cues, are used in the perception of lexical stress in clear speech, despite the availability of facial articulatory cues. The results of Experiment 2 show that visual articulatory cues are used in degraded speech with the absence of beat gestures. This suggests listeners first make use of what information is available to them and then pick and choose what combination of audio and visual cues they need in a given situation. Speech and gestures are indeed intertwined in perception.
Description
Citation
Supervisor
Faculty
Faculteit der Letteren