Performance of Augmented Reality Remote Rendering via Mobile Network

Kai Manuel Börner, Arnulph Fuhrmann and Michael Andreas Bösinger

In: Virtuelle und Erweiterte Realität – 17. Workshop der GI-Fachgruppe VR/AR, 2020, Trier, Germany

Abstract

The algorithms for augmented reality (AR) applications, which are used to insert virtual objects in the real world, have been continuously improved in recent years. Software development kits (SDKs) for the mobile operating systems Android and iOS have been published which allow the usage of AR without markers. The complete rendering, as well as the tracking, are executed on the smartphone. Therefore, the graphical quality is limited. With remote rendering, large parts of the rendering can be transferred to a server. In this paper, a remote rendering system for an AR app based on Unity is presented. The system was implemented for an edge server, which is located within the network of the mobile network operator. Our evaluation shows that the system achieves better average frame times, even when the application is running for a longer time period. Furthermore, the graphical fidelity is improved compared to pure mobile rendering.

Videos

Two videos comparing the performance of local and remote rendering:

Demo Video auf Youtube – small scale scene

Demo Video auf Youtube – large scale scene

Presentation

Slides of the paper presentation: PDF

Paper

Final published paper:   https://dx.doi.org/10.18420/vrar2020_14

Ähnliches

SVEn – Shared Virtual Environment

SVEn – Shared Virtual Environment

This paper presents a system for a shared virtual experience which was developed within a student project. The main idea is to have two or more persons at different locations, who can interact with each other in the same virtual environment. In order to realize this idea every person is motion-captured and wears a head-mounted display (HMD). The virtual environment is rendered with the Unity game engine and the tracked positions are updated via the internet. The virtual environment developed in this project is highly immersive and users felt a strong sense of presence.

Perceptual Comparison of Four Upscaling Algorithms for Low-Resolution Rendering for Head-mounted VR Displays

When rendering images in real-time, shading pixels is a comparatively expensive
operation. Especially for head-mounted displays, where separate images are rendered for
each eye and high frame rates need to be achieved. Upscaling algorithms are one possibility
of reducing the pixel shading costs. Four basic upscaling algorithms are implemented in a
VR rendering system, with a subsequent user study on subjective image quality. We find
that users preferred methods with a better contrast preservation.