Evaluating hallucinations and repair in open-domain dialogue systems.

dc.contributor.advisor	Liesenfeld, A.M.
dc.contributor.advisor	Thesing, C.
dc.contributor.author	Wouw, I. van de
dc.date.issued	2023-01-28
dc.description.abstract	This study investigates the repair strategies employed by large language models, during conversations with human interactors and the influence these strategies have on the human interactor’s perception. A corpus of 1123 conversations was collected and analysed, as well as a survey of 14 respondents. The results indicate that the chatbot is limited in its ability to resolve conversational errors and that hallucinations had no adverse influence on user experience. This research has implications for the development of open-domain dialogue systems and conversational agents in the form of evaluation metrics that can be used in order to create a realistic understanding of the capabilities of this technology.
dc.identifier.uri	https://theses.ubn.ru.nl/handle/123456789/15463
dc.language.iso	en
dc.thesis.faculty	Faculteit der Letteren
dc.thesis.specialisation	specialisations::Faculteit der Letteren::Bachelor Communicatie- en Informatiewetenschappen::International Business Communication
dc.thesis.studyprogramme	studyprogrammes::Faculteit der Letteren::Bachelor Communicatie- en Informatiewetenschappen
dc.thesis.type	Bachelor
dc.title	Evaluating hallucinations and repair in open-domain dialogue systems.

Now showing 1 - 1 of 1