Apparent Personality Prediction using Multimodal Residual Networks with 3D Convolution

Simple item page
dc.contributor.advisorGerven, M.A.J. van
dc.contributor.advisorRas, G.E.H.
dc.contributor.authorIacob, S.
dc.date.issued2018-07-01
dc.description.abstractIn this thesis we propose a 3D apparent personality prediction model as extension of the multimodal residual neural network used for first impression analysis by Güçlütürk et al. [1]. The original model was trained on audio-visual data from YouTube videos and predicts the Big Five personality traits of the people in the video. The auditory data and the visual data were randomly selected within a clip, and thus not synchronized. The novel contribution of this research is to study the effect of extending the visual information over multiple frames, and of synchronizing the two modalities on the performance of the model. The model architecture was adapted to include these changes, and several new models were trained. Each performed better than the baseline models trained on the same dataset. Moreover, we provide evidence that temporal information improves the performance. However, a different network architecture is needed to prove the effect of the synchronization.en_US
dc.identifier.urihttps://theses.ubn.ru.nl/handle/123456789/7036
dc.language.isonlen_US
dc.thesis.facultyFaculteit der Sociale Wetenschappenen_US
dc.thesis.specialisationBachelor Artificial Intelligenceen_US
dc.thesis.studyprogrammeArtificial Intelligenceen_US
dc.thesis.typeBacheloren_US
dc.titleApparent Personality Prediction using Multimodal Residual Networks with 3D Convolutionen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Iacob, S.-BSc-Thesis-2018.pdf
Size:
1.15 MB
Format:
Adobe Portable Document Format
Download
Collections
Faculteit der Sociale Wetenschappen