View-Based Off-Axis Perspective Projection for AR-Based Videoconferencing
Keywords
Loading...
Authors
Issue Date
2022-06-27
Language
en
Document type
Journal Title
Journal ISSN
Volume Title
Publisher
Title
ISSN
Volume
Issue
Startpage
Endpage
DOI
Abstract
Extended reality for online communication is slowly growing with market leaders like Facebook Horizon
and Google Starline. Virtual Visits is a project by TNO that aims to provide private and corporate
users with an affordable and usable AR-based videoconferencing system. In this research, we aim to evaluate
the effect of view-based off-axis perspective projection on the overall experience of videoconferencing
systems. On a 46-inch vertically oriented screen, we project a 3D point cloud of the observer’s partner
onto a live video capture of the observer’s room. With the Zed 2i stereo camera, we use eye tracking to
determine the observer’s location. These values are used to compute the perspective projection matrix,
which causes the background of the video call to move based on the observer’s position. As a result, the
perspective changes like it would happen in the real world, and with the live video capture of your room
as the background of the video call, the screen will function more like a frame/window. Results showed
that perspective projection negatively affects the overall experience. However, we can conclude that
the large screen size positively influences the feeling of closeness and social presence. Future research
with a higher quality system should give us a better idea of the impact of perspective projection on
videoconferencing systems.
Description
Citation
Supervisor
Faculty
Faculteit der Sociale Wetenschappen