The effect of mouth visibility and/or gestures on degraded speech comprehension.

Keywords
Thumbnail Image
Date
2021-07-08
Language
en
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This research is aimed at comparing the benefit of visible speech alone and that of gestures alone separately in disambiguating speech in noise and to determine how these benefits relate to the benefit of having both visual articulators in a joint context using the same paradigm as in Drijvers and Özyürek (2017). Results showed that visible speech can enhance degraded speech comprehension and that iconic gestures can enhance degraded speech comprehension. The benefit from gestures alone is higher than that of visible speech alone. Similarly, speech comprehension is also more enhanced when gestures are added to visible speech than when visible speech is added to speech that is already accompanied by gestures. The enhancement effects of visible speech to speech without visual articulators or to speech with gestures do not differ. The highest enhancement is reached when both visible speech and gestures are added to speech without any visual articulators.
Description
Citation
Faculty
Faculteit der Letteren