Performance of Augmented Reality Remote Rendering via Mobile Network

Kai Manuel Börner, Arnulph Fuhrmann and Michael Andreas Bösinger

In: Virtuelle und Erweiterte Realität – 17. Workshop der GI-Fachgruppe VR/AR, 2020, Trier, Germany

Abstract

The algorithms for augmented reality (AR) applications, which are used to insert virtual objects in the real world, have been continuously improved in recent years. Software development kits (SDKs) for the mobile operating systems Android and iOS have been published which allow the usage of AR without markers. The complete rendering, as well as the tracking, are executed on the smartphone. Therefore, the graphical quality is limited. With remote rendering, large parts of the rendering can be transferred to a server. In this paper, a remote rendering system for an AR app based on Unity is presented. The system was implemented for an edge server, which is located within the network of the mobile network operator. Our evaluation shows that the system achieves better average frame times, even when the application is running for a longer time period. Furthermore, the graphical fidelity is improved compared to pure mobile rendering.

Videos

Two videos comparing the performance of local and remote rendering:

Demo Video auf Youtube – small scale scene

Demo Video auf Youtube – large scale scene

Presentation

Slides of the paper presentation: PDF

Paper

Final published paper: https://dx.doi.org/10.18420/vrar2020_14

Publikationen

The influence of different audio representations on linear visually induced self-motion

We investigate the influence of four different audio representations on visually induced self-motion (vection). Our study followed the hypothesis, that the feeling of visually induced vection can be increased by audio sources while lowering negative feelings such as visually induced motion sickness.

Publikationen

The Effectiveness of Changing the Field of View in a HMD on the Perceived Self-Motion

The following paper investigates the effect on the intensity of perceived vection by changing the field of view (FOV) using a headmounted
display (HMD) in a virtual environment (VE).

Publikationen

Collision Detection for Deformable Objects

This paper summarizes recent research in the area of deformable collision detection. Various approaches based on bounding volume hierarchies, distance fields, and spatial partitioning are discussed. Further, image-space techniques and stochastic methods are considered.

Publikationen

Interaktive 3D Visualisierung

Inzwischen ermöglichen neue Algorithmen und hoch entwickelte GPUs das Rendering mit physikalisch basierten Modellen, wodurch die Darstellungsqualität realistisch geworden ist. Gleichzeitig kann die Geometrie mittels Echtzeitsimulation dynamisch verformt werden, so dass der Anwender sich nicht nur in der 3D Szene interaktiv bewegen, sondern diese auch sofort verändern kann.

Publikationen

Distance Fields for Rapid Collision Detection in Physically Based Modeling

In this paper we address the problem of rapid distance computation between rigid objects and highly deformable objects, which is important in the context of physically based modeling of e.g hair or clothing.

Publikationen

Self-Shadowing of dynamic scenes with environment maps using the GPU

In this paper we present a method for illuminating a dynamic scene with a high dynamic range environment map with real-time or interactive frame rates, taking into account self shadowing. Current techniques require static geometry, are limited to few and small area lights or are limited in the frequency of the shadows.

Abstract

Videos

Presentation

Paper

Ähnliches