Investigating the Influence of Sound Source Visualization on the Ventriloquism Effect in an Auralized Virtual Reality Environment

Nigel Frangenberg, Kristoffer Waldow and Arnulph Fuhrmann
In: Proceedings of 28th IEEE Virtual Reality Conference (VR ’21), Lisbon, Portugal

Left: The visual representations of the loudspeaker (left to right): Basic, Abstract, Realistic. Right: The room as seen by the subjects with the photogrammetry model (R) and the vertical shift mode (V).

 

Abstract

The ventriloquism effect (VQE) describes the illusion that the puppeteer’s voice seems to come out of the puppet’s mouth. This effect can even be observed in virtual reality (VR) when a spatial discrepancy between the auditory and visual component occurs. However, previous studies have never fully investigated the impact of visual quality on VQE. Therefore, we conducted an exploratory experiment to investigate the influence of the visual appearance of a loudspeaker on the VQE in VR. Our evaluation yields significant differences in the vertical plane which leads to the assumption that the less realistic model had a stronger VQE than the realistic one.

Paper

Final published paper:   https://ieeexplore.ieee.org/document/9419101

Video

Video

Ähnliches

Immersive Exploration of OSGi-based Software Systems in Virtual Reality

Immersive Exploration of OSGi-based Software Systems in Virtual Reality

We present an approach for exploring OSGi-based software systems in virtual reality. We employ an island metaphor, which represents every module as a distinct island. The resulting island system is displayed in the confines of a virtual table, where users can explore the software visualization on multiple levels of granularity by performing intuitive navigational tasks. Our approach allows users to get a first overview about the complexity of an OSGi-based software system by interactively exploring its modules as well as the dependencies between them.

Acquisition and Validation of Spectral Ground Truth Data for Predictive Rendering of Rough Surfaces

Acquisition and Validation of Spectral Ground Truth Data for Predictive Rendering of Rough Surfaces

In this work, we acquired a set of precisely and spectrally resolved ground truth data. It consists of the precise description of a new developed reference scene including isotropic BRDFs of 24 color patches, as well as the reference measurements of all patches under 13 different angles inside the reference scene.

Using MQTT for Platform Independent RemoteMixed Reality Collaboration

In this paper, we present a Mixed Reality telepresence system that allows the connection of multiple AR or VR devices to create a shared virtual environment by using the simple MQTT networking protocol. It follows a subscribe-publish pattern for reliable and easy platform independent integration. Therefore, it is possible to realize different clients that handle communication and allow remote collaboration. To allow embodied natural human interaction, the system maps the human interaction channels, gestures, gaze and speech, to an abstract stylized avatar by using an upper body inverse kinematic approach. This setup allows spatially separated persons to interact with each other via an avatar-mediated communication.