Conference paper · Book chapter
A Simulation System for Scene Synthesis in Virtual Reality
Coding and Visual Communication, Department of Photonics Engineering, Technical University of Denmark1
Department of Photonics Engineering, Technical University of Denmark2
BBC Research & Development3
Centre of Excellence for Silicon Photonics for Optical Communications, Centers, Technical University of Denmark4
Real-world scene synthesis can be realized through view synthesis or 3D reconstruction methods. While industrial and commercial demands emerge for real-world scene synthesis in virtual reality (VR) using head-mounted displays (HMDs), the methods in the literature generally do not target specific display devices.
To meet the rising demands, we propose a simulation system to evaluate scene synthesis methods in VR. Our system aims at providing the full pipeline of scene capturing, processing, rendering, and evaluation. The capturing module provides various input dataset formulations. The processing and rendering module integrates three representative scene synthesis methods with a voluntary performance-aid option.
Finally, the evaluation module supports traditional metrics as well as perception-based metrics. An experiment demonstrates the use of our system for identifying the best capturing strategy among the three degrees of foveation tested. As can be expected, the FovVideoVDP metric (based on a model of the human visual system) finds the highest degree of foveation giving best results.
The three other quality metrics from the evaluation module (which use features to measure similarity) confirm that result. The synthetic scenes in the experiment can run in VR with an average latency of 5.9 ms for the two selected scenarios across the tested methods on Nvidia GTX 2080 ti.
Language: | English |
---|---|
Publisher: | Springer |
Year: | 2021 |
Pages: | 67-84 |
Proceedings: | 18<sup>th</sup> EuroXR International Conference |
Series: | Lecture Notes in Computer Science |
ISBN: | 3030907384 , 3030907392 , 9783030907389 and 9783030907396 |
ISSN: | 03029743 and 16113349 |
Types: | Conference paper and Book chapter |
DOI: | 10.1007/978-3-030-90739-6_5 |
ORCIDs: | Liu, Jingyu , Mantel, Claire and Forchhammer, Søren |