Socially Immersive Avatar-Based Communication

Daniel Roth, Kristoffer Waldow, Marc Erich Latoschik, Gary Bente, Arnulph Fuhrmann
In: Proceedings of the 24rd IEEE Virtual Reality (IEEE VR) conference, 2017

Abstract

In this paper, we present SIAM-C, an avatar-mediated communication platform to study socially immersive interaction in virtual environments. The proposed system is capable of tracking, transmitting, representing body motion, facial expressions, and voice via virtual avatars and inherits the transmission of human behaviors that are available in real-life social interactions. Users are immersed using active stereoscopic rendering projected onto a life-size projection plane, utilizing the concept of “fish tank” virtual reality (VR). Our prototype connects two separate rooms and allows for socially immersive avatar-mediated communication in VR.

Paper

DOI: 10.1109/VR.2017.7892275

Preprint: PDF

Ähnliches

Addressing Deaf or Hard-of-Hearing People in Avatar-Based Mixed Reality Collaboration Systems

Addressing Deaf or Hard-of-Hearing People in Avatar-Based Mixed Reality Collaboration Systems

We propose an easy to integrate Automatic Speech Recognition and textual visualization extension for an avatar-based MR remote collaboration system that visualizes speech via spatial floating speech bubbles. In a small pilot study, we achieved word accuracy of our extension of 97% by measuring the widely used word error rate.

Perceptual Comparison of Four Upscaling Algorithms for Low-Resolution Rendering for Head-mounted VR Displays

When rendering images in real-time, shading pixels is a comparatively expensive
operation. Especially for head-mounted displays, where separate images are rendered for
each eye and high frame rates need to be achieved. Upscaling algorithms are one possibility
of reducing the pixel shading costs. Four basic upscaling algorithms are implemented in a
VR rendering system, with a subsequent user study on subjective image quality. We find
that users preferred methods with a better contrast preservation.

Real-time tone mapping – An evaluation of color-accurate methods for luminance compression

Recent advances in real-time rendering enable virtual production pipelines in a broad range of industries. These pipelines are based on a fast, latency-free handling in addition to the accurate appearance of results. This requires the use of high dynamic range rendering for photo-realistic results and a tone mapping operator for a matched display.