Exploiting Feature Relations and External Knowledge in Multimedia Event Detection
| dc.contributor.advisor | Farquhar, J.D.R. | |
| dc.contributor.advisor | Boer, Maaike de - Data Scientist TNO | |
| dc.contributor.author | Kostas, Vangelis | |
| dc.date.issued | 2018-12-14 | |
| dc.description.abstract | Detection of complex events in diverse Internet videos is a very important step towards making sense of all the terabytes of video information uploaded every minute. The detection of such high-level semantics in the video can help with tasks ranging from security (automated surveillance system) to video search engines. We are testing the application of a fusion strategy that takes into account feature and class relationships by applying a weight regularization. As further extension we propose a weight initialization that adds prior expected values for the covariance between layer weight matrices. Using this initialization we can enforce an initial hierarchy/interdependency for the output labels and/or input features. The hierarchy of the labels can be calculated using external knowledge from WordNet however in our case we used the already calculated hierarchy of the corpus labels. We use a baseline of average fusion to compare our results for different fusion strategies. Furthermore we use different error functions to enforce the hierarchy of labels when the regularization isn’t applied. Finally we perform an analysis and visualization of the feature correlations before and after the regularization. Which shows that regularized features display a higher correlation than their un-regularized counterparts. This suggests that shared learning is imposed by the layer weight matrix covariances included in the regularization. | en_US |
| dc.embargo.lift | 10000-01-01 | |
| dc.embargo.type | Permanent embargo | en_US |
| dc.identifier.uri | https://theses.ubn.ru.nl/handle/123456789/10711 | |
| dc.language.iso | en | en_US |
| dc.thesis.faculty | Faculteit der Sociale Wetenschappen | en_US |
| dc.thesis.specialisation | Master Artificial Intelligence | en_US |
| dc.thesis.studyprogramme | Artificial Intelligence | en_US |
| dc.thesis.type | Master | en_US |
| dc.title | Exploiting Feature Relations and External Knowledge in Multimedia Event Detection | en_US |
Files
Original bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- S4526651_KostasV 2018.pdf
- Size:
- 4.08 MB
- Format:
- Adobe Portable Document Format