Investigating the Influence of Sound Source Visualization on the Ventriloquism Effect in an Auralized Virtual Reality Environment

Nigel Frangenberg, Kristoffer Waldow and Arnulph Fuhrmann
In: Proceedings of 28th IEEE Virtual Reality Conference (VR ’21), Lisbon, Portugal

Left: The visual representations of the loudspeaker (left to right): Basic, Abstract, Realistic. Right: The room as seen by the subjects with the photogrammetry model (R) and the vertical shift mode (V).

 

Abstract

The ventriloquism effect (VQE) describes the illusion that the puppeteer’s voice seems to come out of the puppet’s mouth. This effect can even be observed in virtual reality (VR) when a spatial discrepancy between the auditory and visual component occurs. However, previous studies have never fully investigated the impact of visual quality on VQE. Therefore, we conducted an exploratory experiment to investigate the influence of the visual appearance of a loudspeaker on the VQE in VR. Our evaluation yields significant differences in the vertical plane which leads to the assumption that the less realistic model had a stronger VQE than the realistic one.

Paper

Final published paper:   https://ieeexplore.ieee.org/document/9419101

Video

Video

Ähnliches

An Evaluation of Smartphone-Based Interaction in AR for Constrained Object Manipulation

An Evaluation of Smartphone-Based Interaction in AR for Constrained Object Manipulation

In Augmented Reality, interaction with the environment can be achieved with a number of different approaches. In current systems, the most common are hand and gesture inputs. However experimental applications also integrated smartphones as intuitive interaction devices and demonstrated great potential for different tasks. One particular task is constrained object manipulation, for which we conducted a user study. In it we compared standard gesture-based approaches with a touch-based interaction via smartphone. We found that a touch-based interface is significantly more efficient, although gestures are being subjectively more accepted. From these results we draw conclusions on how smartphones can be used to realize modern interfaces in AR.