The Effect of Audiovisual Speech Perception on Listening Effort in Children

Keywords

Loading...
Thumbnail Image

Issue Date

2024-07-10

Language

nl

Document type

Journal Title

Journal ISSN

Volume Title

Publisher

Title

ISSN

Volume

Issue

Startpage

Endpage

DOI

Abstract

Listening effort has been defined as the cognitive effort that is dedicated to a listening task. From the Ease of Language Understanding model (Rönnberg et al., 2013), two contradictory hypotheses arise regarding the effect of the addition of visual information to a noisy speech signal on listening effort. On the one hand, the addition of visual information might reduce mismatches, thus reduce the engagement of working memory and thereby listening effort. On the other hand, sensory integration might be argued to appeal to working memory and therefore increase listening effort. We tested these hypotheses by administering a speech-in-noise task and an n-back task in an audio-only (AO) and audiovisual (AV) condition to children of two age groups. Additionally, we included a forward digit span task to account for the influence of working memory on listening effort. Results showed that although speech recognition accuracy increased in the AV condition, listening effort did not differ between the conditions. Additionally, working memory scores did not correlate with task scores. More research is needed to investigate the effects of audiovisual speech perception on listening effort.

Description

Citation

Faculty

Faculteit der Letteren