View-Based Off-Axis Perspective Projection for AR-Based Videoconferencing

Keywords
Loading...
Thumbnail Image
Issue Date
2022-06-27
Language
en
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Extended reality for online communication is slowly growing with market leaders like Facebook Horizon and Google Starline. Virtual Visits is a project by TNO that aims to provide private and corporate users with an affordable and usable AR-based videoconferencing system. In this research, we aim to evaluate the effect of view-based off-axis perspective projection on the overall experience of videoconferencing systems. On a 46-inch vertically oriented screen, we project a 3D point cloud of the observer’s partner onto a live video capture of the observer’s room. With the Zed 2i stereo camera, we use eye tracking to determine the observer’s location. These values are used to compute the perspective projection matrix, which causes the background of the video call to move based on the observer’s position. As a result, the perspective changes like it would happen in the real world, and with the live video capture of your room as the background of the video call, the screen will function more like a frame/window. Results showed that perspective projection negatively affects the overall experience. However, we can conclude that the large screen size positively influences the feeling of closeness and social presence. Future research with a higher quality system should give us a better idea of the impact of perspective projection on videoconferencing systems.
Description
Citation
Faculty
Faculteit der Sociale Wetenschappen