Performance of Augmented Reality Remote Rendering via Mobile Network

Kai Manuel Börner, Arnulph Fuhrmann and Michael Andreas Bösinger

In: Virtuelle und Erweiterte Realität – 17. Workshop der GI-Fachgruppe VR/AR, 2020, Trier, Germany

Abstract

The algorithms for augmented reality (AR) applications, which are used to insert virtual objects in the real world, have been continuously improved in recent years. Software development kits (SDKs) for the mobile operating systems Android and iOS have been published which allow the usage of AR without markers. The complete rendering, as well as the tracking, are executed on the smartphone. Therefore, the graphical quality is limited. With remote rendering, large parts of the rendering can be transferred to a server. In this paper, a remote rendering system for an AR app based on Unity is presented. The system was implemented for an edge server, which is located within the network of the mobile network operator. Our evaluation shows that the system achieves better average frame times, even when the application is running for a longer time period. Furthermore, the graphical fidelity is improved compared to pure mobile rendering.

Videos

Two videos comparing the performance of local and remote rendering:

Demo Video auf Youtube – small scale scene

Demo Video auf Youtube – large scale scene

Presentation

Slides of the paper presentation: PDF

Paper

Final published paper:   https://dx.doi.org/10.18420/vrar2020_14